SEARCH · Engineering Papers

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Electron Tomography and Machine Learning for Understanding the Highly Ordered Structure of Leafhopper Brochosomes

Insects known as leafhoppers (Hemiptera: Cicadellidae) produce hierarchically structured nanoparticles known as brochosomes that are exuded and applied to the insect cuticle, thereby providing camouflage and anti-wetting properties to aid insect survival. Although the physical properties of brochosomes are thought to depend on the leafhopper species, the structure–function relationships governing brochosome behavior are not fully understood. Brochosomes have complex hierarchical structures and morphological heterogeneity across species, due to which a multimodal characterization approach is required to effectively elucidate their nanoscale structure and properties. In this work, we study the structural and mechanical properties of brochosomes using a combination of atomic force microscopy (AFM), electron microscopy (EM), electron tomography, and machine learning (ML)-based quantification of large and complex scanning electron microscopy (SEM) image data sets. This suite of techniques allows for the characterization of internal and external brochosome structures, and ML-based image analysis methods of large data sets reveal correlations in the structure across several leafhopper species. Our results show that brochosomes are relatively rigid hollow spheres with characteristic dimensions and morphologies that depend on leafhopper species. Nanomechanical mapping AFM is used to determine a characteristic compression modulus for brochosomes on the order of 1–3 GPa, which is consistent with crystalline proteins. Altogether, this work provides an improved understanding of the structural and mechanical properties of leafhopper brochosomes using a new set of ML-based image classification tools that can be broadly applied to nanostructured biological materials.

Chemical structure↗

DOE OSTI2020

Pump depletion in Raman lasing in a graded index multimode fibre

We examine multimode diode laser pump depletion in a graded index multimode (MM) fibre Raman laser generating a high-quality Stokes beam. Spatial ‘hole burning’ in the transmitted pump beam is demonstrated. A balance model is constructed for interaction of the pump and Stokes waves in the MM Raman laser. Analytical formulas are derived and used in calculations demonstrating qualitative agreement with experimental data. The origin of the observed quantitative discrepancies is discussed. (paper)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Deep Multimodal Networks for M-type Star Classification with Paired Spectrum and Photometric Image

Abstract Traditional stellar classification methods include spectral and photometric classification separately. Although satisfactory results can be achieved, the accuracy could be improved. In this paper, we pioneer a novel approach to deeply fuse the spectra and photometric images of the sources in an advanced multimodal network to enhance the model’s discriminatory ability. We use Transformer as the fusion module and apply a spectrum–image contrastive loss function to enhance the consistency of the spectrum and photometric image of the same source in two different feature spaces. We perform M-type stellar subtype classification on two data sets with high and low signal-to-noise ratio (S/N) spectra and corresponding photometric images, and the F1-score achieves 95.65% and 90.84%, respectively. In our experiments, we prove that our model effectively utilizes the information from photometric images and is more accurate than advanced spectrum and photometric image classifiers. Our contributions can be summarized as follows: (1) We propose an innovative idea for stellar classification that allows the model to simultaneously consider information from spectra and photometric images. (2) We discover the challenge of fusing low-S/N spectra and photometric images in the Transformer and provide a solution. (3) The effectiveness of Transformer for spectral classification is discussed for the first time and will inspire more Transformer-based spectral classification models.

Astronomy & Astrophysics↗

DOE OSTI2022

Ice-nucleating agents in sea spray aerosol identified and quantified with a holistic multimodal freezing model

Sea spray aerosol (SSA) is a widely recognized important source of ice-nucleating particles (INPs) in the atmosphere. However, composition-specific identification, nucleation processes, and ice nucleation rates of SSA-INPs have not been well constrained. Microspectroscopic characterization of ambient and laboratory-generated SSA confirms that water-borne exudates from planktonic microorganisms composed of a mixture of proteinaceous and polysaccharidic compounds act as ice-nucleating agents (INAs). These data and data from previously published mesocosm and wave channel studies are subsequently used to further develop the stochastic freezing model (SFM) producing ice nucleation rate coefficients for SSA-INPs. The SFM simultaneously predicts immersion freezing and deposition and homogeneous ice nucleation by SSA particles under tropospheric conditions. Predicted INP concentrations agree with ambient and laboratory measurements. In addition, this holistic freezing model is independent of the source and exact composition of the SSA particles, making it well suited for implementation in cloud and climate models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

An Integrated Deposition and Passivation Strategy for Controlled Crystallization of 2D/3D Halide Perovskite Films

Abstract This work introduces a simplified deposition procedure for multidimensional (2D/3D) perovskite thin films, integrating a phenethylammonium chloride (PEACl)‐treatment into the antisolvent step when forming the 3D perovskite. This simultaneous deposition and passivation strategy reduces the number of synthesis steps while simultaneously stabilizing the halide perovskite film and improving the photovoltaic performance of resulting solar cell devices to 20.8%. Using a combination of multimodal in situ and additional ex situ characterizations, it is demonstrated that the introduction of PEACl during the perovskite film formation slows down the crystal growth process, which leads to a larger average grain size and narrower grain size distribution, thus reducing carrier recombination at grain boundaries and improving the device's performance and stability. The data suggests that during annealing of the wet film, the PEACl diffuses to the surface of the film, forming hydrophobic (quasi‐)2D structures that protect the bulk of the perovskite film from humidity‐induced degradation.

2D/3D perovskites↗

DOE OSTI2025

Pilot-Scale Validation of Distributed Optical Fiber Sensors for Underground Pipeline Monitoring

Monitoring parameters such as hoop strain, pressure, and acoustic vibrations is key to detecting potential leaks, intrusions, or structural issues. Distributed optical fiber sensor (DOFS) systems provide a compelling solution for continuous, real-time monitoring over long distances. This paper details the development and pilot-scale implementation of DOFS systems for underground pipeline monitoring, evolving from a proof-of-concept stage. Multiple custom-designed DOFS interrogator units—such as optical frequency-domain reflectometry (OFDR), Brillouin optical time-domain analysis (BOTDA), and multimodal interferometer-based fiber acoustic sensor systems were tested to measure the key parameters, such as hoop strain, pipe pressure, surrounding soil temperature, and acoustic vibrations. The underground product pipeline’s outer diameter is 30 inches, the wall thickness is 1.28 inches, and 3 feet deep from the surface. The fiber deployment strategies and sensing data acquisition methods for these systems are discussed. The results demonstrate the effectiveness of DOFS in detecting hoop strain, temperature changes, and acoustic vibrations, showcasing their potential for real-time monitoring and enhancing pipeline safety. These findings from pilot-scale testing offer valuable insights into advancing pipeline monitoring technologies and improving the reliability of underground pipeline systems.

fiber optic sensors↗

DOE OSTI2025

Bridging multimodal microscopy for advanced characterization on nuclear fuel using machine learning

Uranium dioxide (UO 2 ), widely used as driver fuel in light water reactors, experiences microstructure and property change by nuclear fission reactions. This paper bridges the characterization of fresh UO 2 fuel at different length scales, serving as a baseline for future post irradiation examination of irradiated UO 2 fuel. To characterize the microstructural change of nuclear fuel, modern approaches cover a wide range of length scales through different characterization techniques, such as mm scale for Synchrotron-based X-ray computed tomography (SXCT) and microscale for focused ion beam (FIB) and scanning electron microscopy (SEM). It is challenging to bridge the data and knowledge of the same sample in different length scales. This paper proposed a deep learning framework leveraging transfer learning to detect microstructural defects, trained from a sparse FIB, SEM, and SXCT images. The proposed model achieved superior performance in defect segmentation on multiscale microscopic data compared to four of the latest deep learning models.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Disentangling the chemistry of Australian plant exudates from a unique historical collection

For thousands of years, the unique physicochemical properties of plant exudates have defined uses in material culture and practical applications. Native Australian plant exudates, including resins, kinos, and gums, have been used and continue to be used by Aboriginal Australians for numerous technical and cultural purposes. A historic collection of well-preserved native Australian plant exudates, assembled a century ago by plant naturalists, gives a rare window into the history and chemical composition of these materials. Here we report the full hierarchical characterization of four genera from this collection, Xanthorrhoea, Callitris, Eucalyptus, and Acacia, from the local elemental speciation, to functional groups and main molecular markers. We use high-resolution X-ray Raman spectroscopy (XRS) to achieve bulk-sensitive chemical speciation of these plant exudates, including insoluble, amorphous, and cross-linked fractions, without the limitation of invasive and/or surface specific methods. Combinatorial testing of the XRS data allows direct classification of these complex natural species as terpenoid, aromatic, phenolic, and polysaccharide materials. Differences in intragenera chemistry was evidenced by detailed interpretation of the XRS spectral features. We complement XRS with Fourier-transform infrared (FT-IR) spectroscopy, gas chromatography–mass spectrometry (GC-MS), and pyrolysis–GC-MS (Py-GC-MS). This multimodal approach provides a fundamental understanding of the chemistry of these natural materials long used by Aboriginal Australian peoples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Seeing is Believing: Autonomous Microscopy and the Data Revolution in Materials Science

This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Seeing is Believing: Autonomous Microscopy and the Data Revolution in Materials Science

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

30 cm Drop Modeling

This report documents modeling and analysis of the 30 cm cask drop scenario for spent nuclear fuel (SNF) casks. The 30 cm drop is an important hypothetical dynamic loading scenario for SNF because 10 CFR 71.71 defines testing requirements for normal conditions of transport (NCT) of SNF packages, and free drop (of 30 cm for the heaviest packages) tests are required. Other NCT conditions specified in 10 CFR 71.71 include vibration normally incident to transport, and DOE’s multimodal transportation test (MMTT) and related analysis concluded that mechanical shock and vibration incident to transportation is negligible for SNF structural integrity because the loads are so small. The SNF cask 30 cm drop has a lot more potential to cause damage to SNF because the kinetic energy and momentum of the system is stopped abruptly during the cask impact event. Test data and model predictions both agree that the SNF assemblies are subjected to significantly higher loads in a cask drop event than normal transportation shock and vibration, but currently there is no reason to expect gross structural damage of the fuel assembly or widespread SNF cladding failure as a result of a 30 cm cask drop. The ultimate goal of this work is to close the knowledge gap of stress profiles on SNF rods and fuel assembly components during NCT, and this report describes the progress toward reaching that goal as well as a plan for finishing this work over the next year or two. Key remaining tasks include refining the fuel assembly model, calculating a selection of specific fuel assembly cases to populate the damage model, and finally running the damage model to predict the full general response range of 30 cm drop loads on SNF.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

Predicting and Controlling Corrosion (Abbreviated Final Report)

Corrosion accumulates significant replacement costs in the transportation, utility, manufacturing, and infrastructure sectors. It also underpins several of LLNL’s core missions in stockpile stewardship, defense, and energy security. Whereas most corrosion and aging models are empirically parameterized to describe well-defined conditions late in the reaction, the factors that determine the early stages of corrosion—during which mitigation could be most impactful— are poorly understood. This project addressed the critical need for new approaches to predict the kinetics of corrosion initiation based on firm physical and chemical understanding. The activities encompassed degradation of relevant metals in both hydrogen-rich and environmental corrosion scenarios. The team integrated state-of-the-art multiscale simulation, in situ characterization, and data science within three technical thrusts: hydriding of Ti alloys; aqueous corrosion of Al and Ni-Cr alloys; and degradation of additively manufactured 316L stainless steel. In each case, novel capabilities were developed to identify and track the impacts of key atomistic, compositional, and microstructural features on the metal systems. For hydriding, protocols were developed to tightly integrate multiscale models, advanced multimodal characterization, and machine learning to determine how hydrogen interacts with native passivating surface oxides and nucleates new undesired phases, shedding new light on the critical role of grain boundaries, interfaces, and atomically disordered regions. For aqueous corrosion, the project demonstrated methods to predict dissolution rates of metal surfaces in corrosive solutions, to measure and understand microstructural and grain orientation effects on corrosion susceptibility, and to investigate competing growth and dissolution kinetics of surface oxides. For additively manufactured metals, analysis using state-of-the-art microscopy techniques revealed the role of specific heterogeneities invoked during laser processing, including cellular structure, dislocations, and precipitates, on corrosion susceptibility. In addition to new capabilities and understanding, the project provided an avenue for workforce development, as well as key partnerships with stakeholders in corrosion science.

08 HYDROGEN↗

DOE OSTI2023

Elucidating a dissolution–deposition reaction mechanism by multimodal synchrotron X-ray characterization in aqueous Zn/MnO 2 batteries

Aqueous Zn/MnO 2 batteries with their environmental sustainability and competitive cost, are becoming a promising, safe alternative for grid-scale electrochemical energy storage. Here, presented as a promising design principle to deliver a higher theoretical capacity, this work offers fundamental understanding of the dissolution–deposition mechanism of Zn/β-MnO 2 . A multimodal synchrotron characterization approach including three operando X-ray techniques (powder diffraction, absorption spectroscopy, and fluorescence microscopy) is coupled with elementally resolved synchrotron X-ray nano-tomography. Together they provide a direct correlation between structural evolution, reaction chemistry, and 3D morphological changes. Operando synchrotron X-ray diffraction and spectroscopy show a crystalline-to-amorphous phase transition. Quantitative modeling of the operando data by Rietveld refinement for X-ray diffraction and multivariate curve resolution (MCR) for X-ray absorption spectroscopy are used in a complementary fashion to track the structural and chemical transitions of both the long-range (crystalline phases) and short-range (including amorphous phases) ordering upon cycling. Scanning X-ray microscopy and full-field nano-tomography visualizes the morphology of electrodes at different electrochemical states with elemental sensitivity to spatially resolve the formation of the Zn- and Mn-containing phases. Overall, this work critically indicates that for Zn/MnO 2 aqueous batteries, the reaction pathways involving Zn–Mn complex formation upon cycling become independent of the polymorphs of the initial electrode and sheds light on the interplay among structural, chemical, and morphological evolution for electrochemically driven phase transitions.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Resilient information and inference networks under mixed-trust sensing

With ubiquitous digitization, sensing, and computational intelligence deployed in increasingly more and broader domains, including critical infrastructure, potentially misleading and destabilizing effects of multimodal anomalies and adversarial behavior are growing in importance. Here, we develop randomized and reinforcement learning-based strategies for strategically recruiting and utilizing deployed (and, thus, vulnerable and potentially faulty and/or compromised) nodes from information and inference networks, while defending against adversaries that attempt to misguide assessments of inferred variables. Recognizing that, besides communication and other costs, sampling from any observable node can either provide true data or dangerously expose our inference to misinformation (without being easily distinguishable what actually happens), the proposed strategies proceed by progressively recruiting nodes and cautiously scaling their information contribution based on assumed, or, in our reinforcement learning approach, intelligently weighed trustworthiness, with the learning approach also considering network-wide, threat-inclusive risk/value tradeoffs. While avoiding the hardware, communication, analytical and computational burden of explicit redundancy, the proposed defensive schemes enable on-the-fly assessments of underlying processes, and system-wide situational awareness with demonstrable resilience against adversarial activities.

97 - MATHEMATICS AND COMPUTING↗

DOE OSTI2023

A Multifidelity and Multimodal Machine Learning Approach for Extracting Bonding Environments of Impurities and Dopants from X-ray Spectroscopies

Extended X-ray absorption fine structure (EXAFS) spectroscopy is crucial for determining the coordination environment of impurities and dopants; however, it requires difficult measurements. X-ray absorption near edge structure (XANES) spectroscopy and X-ray emission spectroscopy (XES) can be obtained easily but cannot be converted to determine structures. In this work we develop tools to map measured XANES to the EXAFS signal through machine learning, thereby facilitating the use of EXAFS structural-determination analyses on XANES data. Through the use of Deep Operator Networks (DeepONets), we are able to accurately predict the EXAFS spectrum between 6 and 14 Å -1 from the first 6 Å -1 (~100 eV) of the absorption spectrum of Cu 2+ substitutional defects in the Fe 3+ mineral hematite (a-Fe 2 O 3 ). This surprising finding implies that theoretical analyses of X-ray absorption spectra could be implemented that extract the same conclusions as high-quality EXAFS studies from spectra collected over a much smaller range of photon energies. To encourage similar efforts, the simulated x-ray spectra, machine learning, and fitting code is made publicly available.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

Long-term Multimodal Recording Reveals Epigenetic Adaptation Routes in Dormant Breast Cancer Cells

Patients with estrogen receptor–positive breast cancer receive adjuvant endocrine therapies (ET) that delay relapse by targeting clinically undetectable micrometastatic deposits. Yet, up to 50% of patients relapse even decades after surgery through unknown mechanisms likely involving dormancy. To investigate genetic and transcriptional changes underlying tumor awakening, we analyzed late relapse patients and longitudinally profiled a rare cohort treated with long-term neoadjuvant ETs until progression. Next, we developed an in vitro evolutionary study to record the adaptive strategies of individual lineages in unperturbed parallel experiments. Our data demonstrate that ETs induce nongenetic cell state transitions into dormancy in a stochastic subset of cells via epigenetic reprogramming. Single lineages with divergent phenotypes awaken unpredictably in the absence of recurrent genetic alterations. Targeting the dormant epigenome shows promising activity against adapting cancer cells. Overall, this study uncovers the contribution of epigenetic adaptation to the evolution of resistance to ETs.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2021

A closer look at corrosion of steel reinforcement bars in concrete using 3D neutron and X-ray computed tomography

Corrosion of reinforcing bars constitutes the largest threat to the durability of concrete structures. Thus, several studies have investigated the nature of the corrosion products, most using post-mortem analyses. However, corrosion products evolve when in contact with oxygen, hindering result interpretation. This work presents instead a state-of-the-art, non-destructive 3D method for the assessment of corrosion of embedded reinforcements. Multimodal neutron and X-ray tomography was used to observe, non-destructively, the characteristics of the corrosion products in two concrete samples, with the aim of investigating possible benefits of the use of this technique for reinforced concrete structures. One sample was naturally corroded, extracted from an 81-year-old bridge, the other was corroded via the galvanostatic method, resulting in corrosion-induced cracks. Quantitative and qualitative data was acquired, including the iron-to-rust volumetric ratio in macroscopic interfacial voids and the thickness of the corrosion layer at the steel concrete interface. The iron-to-rust volumetric ratio corresponded to large, soluble, corrosion products, forming in environments with low availability of oxygen for both samples.

36 MATERIALS SCIENCE↗