Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Coupling Shared E-scooters and Public Transit: A Spatial and Temporal Analysis

The integration of shared e-scooters with public transit is a promising solution for urban mobility's first/last-mile challenge. This study explores spatiotemporal factors influencing this integration, using 35-day e-scooter trip data from Chicago. Employing a random-effect negative binomial approach, we modeled the frequency of e-scooter trips to access/egress to/from bus stops and train stations. Results indicate that weather conditions, design features like intersection density, and multimodal network density significantly influence usage. The transit system characteristics such as service frequency have a positive effect on the integration of e-scooters and trains while a similar effect for bus and e-scooter integration was not significant. Furthermore, safety-related variables such as accident and crime rates as well as demographic characteristics were also revealed to be significant factors in our study. These findings offer vital insights to urban planners and policymakers for infrastructure, safety enhancements, and interventions to encourage efficient e-scooter-public transit integration.

Chicago↗
DOE OSTI2020

Joint Analysis of Program Data Representations using Machine Learning for Improved Software Assurance and Development Capabilities

We explore the use of multiple deep learning models for detecting flaws in software programs. Current, standard approaches for flaw detection rely on a single representation of a software program (e.g., source code or a program binary). We illustrate that, by using techniques from multimodal deep learning, we can simultaneously leverage multiple representations of software programs to improve flaw detection over single representation analyses. Specifically, we adapt three deep learning models from the multimodal learning literature for use in flaw detection and demonstrate how these models outperform traditional deep learning models. We present results on detecting software flaws using the Juliet Test Suite and Linux Kernel.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Correlative multimodal chemical imaging via machine learning

Machine learning approach can combine mass spectral imaging (MSI) techniques, one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The machine learning approach can perform transformations on the spectral image data of the two MSI techniques to reduce dimensionality, and using a correlation technique, find relationships between the transformed spectral image data. The determined relationships can be used to generate MSI spectra of desired resolution.

Ovchinnikova, Olga S.↗
DOE OSTI2025

Using multimodal X-ray computed tomography to advance 3D petrography: A non-destructive investigation of olivine inside a carbonaceous chondrite

Rocks form in three dimensions through time and studying them provides information from inside dynamic systems we cannot otherwise observe. Yet how we typically access the interior of the rocks themselves to gain that information may limit our understanding and influence how we reconstruct the processes that formed them. Here, we demonstrate combined non-destructive 3D X-ray imaging techniques that produce quantitative densitometric and crystallographic maps of entire individual grains inside a rock. Olivine grains throughout a sample of the carbonaceous chondrite Northwest Africa (NWA) 11346 were each characterized by size, shape, composition, zoning intensity, and crystallographic orientation. The addition of 3D crystallographic mapping to calibrated 3D densitometric analysis—used to calculate chemical composition—demonstrates a fully non-destructive petrographic method and provides unique insight. For instance, in our case, using crystallographic data to delineate individual grains and then measuring the 3D size, shape, and composition of each distinguishes variably reset relict grains from those later crystallized after a melting event. Intersection in a 2D slice could not have led to this interpretation because the integration of three-dimensional size, rounding, composition, location, and crystallographic orientation measured from each grain forms the key patterns. Multimodal laboratory X-ray imaging has strong potential to advance 3D petrography.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Wave climate and energy resources in American Samoa from a 42-year high-resolution hindcast

Here, this paper presents an analysis of the wave climate and a characterization of the wave energy resources in American Samoa, a U.S. territory covering seven south central Pacific islands and atolls. A numerical wave model based on WAVEWATCH III® and unstructured SWAN was developed, validated, and executed for 1979–2020 to generate a hindcast dataset suitable for resource characterization. Model-data comparisons were performed with measurements collected in situ and from satellite-based altimeters. The model was found to perform well with a bias in significant wave height of -0.14 m and -0.06 m against buoy and altimeters, respectively. The multimodal sea state of American Samoa is investigated by identifying the sources of energy reaching the islands and partitioning the wave spectrum accordingly. The wave resources characterization follows the International Electrotechnical Commission Technical Specifications to be compatible with studies performed for other U.S. regions. The average omnidirectional wave power at 2 km from shore around Tutuila, the main island of American Samoa, is 14 kW/m. Locations east and west of the islands have a more consistent resource throughout the year because the northwest and southwest swells that are dominant during different seasons complement each other.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

Imaging and spatially resolved mass spectrometry applications in nephrology

The application of spatially resolved mass spectrometry (MS) and MS imaging approaches for studying biomolecular processes in the kidney is rapidly growing. These powerful methods, which enable label-free and multiplexed detection of many molecular classes across omics domains (including metabolites, drugs, proteins and protein post-translational modifications), are beginning to reveal new molecular insights related to kidney health and disease. Further, the complexity of the kidney often necessitates multiple scales of analysis for interrogating biofluids, whole organs, functional tissue units, single cells and subcellular compartments. Various MS methods can generate omics data across these spatial domains and facilitate both basic science and pathological assessment of the kidney. Optimal processes related to sample preparation and handling for different MS applications are rapidly evolving. Emerging technology and methods, improvement of spatial resolution, broader molecular characterization, multimodal and multiomics approaches and the use of machine learning and artificial intelligence approaches promise to make these applications even more valuable in the field of nephology. Overall, spatially resolved MS and MS imaging methods have the potential to fill much of the omics gap in systems biology analysis of the kidney and provide functional outputs that cannot be obtained using genomics and transcriptomic methods.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Immersive Analytics in Critical Spatial Domains: From Materials to Energy Systems

Immersive analytics (IA) leverages virtual reality, augmented reality, and mixed reality to transform how users interact with complex datasets across domains such as science, industry, and education. These immersive technologies offer spatial and multimodal environments that foster intuitive exploration, but they also introduce challenges related to cognitive load, interface design, and system performance. Here, this article presents a comprehensive review of visualization techniques, interaction models, and multimodal inputs utilized in IA. Drawing on case studies in scientific visualization, industrial training, and educational communication, we examine both the potential and limitations of current systems. Finally, we propose future research directions, focusing on real‐time collaboration, adaptive user interfaces, and scalable data exploration strategies to advance the field.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Three-dimensional simulations of reshocked inclined Richtmyer-Meshkov instability: Effects of initial perturbations

The effect of initial perturbations on the evolution of the inclined Richtmyer-Meshkov turbulent mixing layer before and after reshock initiated by a shock wave with Mach number 1.55 is investigated through three-dimensional (3D) simulations using the flash code. The 3D simulations aim to reproduce both predominantly single-mode and multimode interfaces between light and heavy gases (N 2 -CO 2 , Atwood number, A≈0.22; amplitude to wavelength ratio of 0.088) which were created in an inclined shock tube facility to analyze the effects of initial conditions on mixing development in the entire flow field. The two-dimensional center slices of 3D simulations are compared with the experimental results to validate the computational code. Mixing width, mixed mass, mixed-mass thickness, and circulation in addition to concentration fields are shown to be in good agreement with the experimental data. The three-dimensional density and vorticity fields are first presented to qualitatively describe the flow behavior before and after reshock. Several measured density/velocity-related quantities indicate that the growth of the mixing material is strongly dependent on initial conditions. Before reshock and at early times after reshock, flow is clearly maintaining the memory of initial perturbations. However, at late time after reshock, although the large wavelength feature still dominates the flow motion, and the morphology of the two different interfaces indicates several differences, by breakdown of large-scale coherent structures to much finer scales, the memory of small scales of the multimode initial perturbation is not as clear as pre-reshock. Regarding three-dimensionality of the flow, before reshock in the multimode case, the baroclinic vorticity production, circulation, turbulent kinetic energy, and turbulent mass flux suggest that the small-scale roll-up features along the large inclined wavelength quickly evolves in all three dimensions. The coherent vortex tubes break down to smaller wormlike vortex structures, and turbulent fluctuations in the out-of-plane dimension are comparable to the spanwise direction. After reshock, this three-dimensionality of mixing growth was observed in the flow for both initial conditions. The results of this work represent a significant extension of previous computational studies performed on this specific topic. A different code with a different numerical method is validated through comparison with the experimental data. The initial perturbations are directly measured from the experimental results. Moreover, the entire three-dimensional experimental shock tube domain is simulated, and more quantities are investigated to understand the mixing mechanism and instability evolution in all three dimensions.

42 ENGINEERING↗
DOE OSTI2023

Extrapolation of the Rainflow-Counted Load Ranges for Fatigue Assessment of the Wind Turbine's Blades

Wind turbine design standards recommend the use of statistical modeling coupled with extrapolation of the short-term load data to long-term periods for fatigue reliability assessment. However, statistical error and computational expense can limit the accuracy of such approaches. In the case of wind turbine blades, the errors are more significant because of the high material fatigue exponent that makes the damage estimations more sensitive to variations. In addition, due to different excitation sources, the flapwise load range histogram is not unimodal, and thus its statistical modeling is complex. In the present work, we provide three methods for statistical modeling of the flapwise bending moment ranges including a novel approach based on frequency-based separation of the modes. The first two methods are simplified approaches for modeling the most crucial load ranges using unimodal distributions and the third method involves multimodal distribution fitting. The research is based on 3600 10-minute aeroelastic simulations of DTU 10MW case study wind turbine from which a benchmark damage equivalent load (DEL) is calculated. The DEL calculated by each of the three proposed methods is compared to this reference. The results show that the conventional approach based on using 6 seeds as well as using mixture models fitted on the limited data lead to under-conservative results with errors up to 23%. On the other hand, the simplified unimodal approaches provided in this work can provide conservative estimations of the fatigue damage with mean values 5% and 12% higher than the benchmark. However, the variability of the DEL estimates is higher when using unimodal extrapolation of the load ranges, and the data can be conservative by 17.5%. The proposed unimodal fits suggested for modeling and extrapolation of the blade's load ranges provide less errors relatively and most importantly conservative DEL estimations while maintaining computational efficiency.

blade fatigue↗
DOE OSTI2021

Femtosecond Laser Desorption Postionization MS vs ToF-SIMS Imaging for Uncovering Biomarkers Buried in Geological Samples

The study of lipid molecular fossils by traditional biomarker analysis requires bulk sample crushing, followed by solvent extraction, and then the analysis of the extract by gas chromatography-mass spectrometry (GC–MS). This traditional analysis mixes all organic compounds in the sample regardless of their origins, with a loss of information on the spatial distribution of organic molecules within the sample. These shortcomings can be overcome using the chemical mapping of intact samples. Spectroscopic techniques such as UV fluorescence or Raman spectroscopy, laser ablation inductively coupled plasma mass spectrometry, and time-of-flight secondary ion mass spectrometry (ToF-SIMS) are among those elemental and molecular mapping techniques. This study employed femtosecond (fs) laser ablation combined with single-photon ionization, a method called fs-laser desorption postionization mass spectrometry (fs-LDPI-MS). In this work, a pulsed ~75 fs, 800 nm laser was used to ablate the geological sample, which was then photoionized after a few microseconds by a pulsed 7.9 eV vacuum ultraviolet laser. An organic carbon-rich geological sample was used for this study to map hydrocarbon biomarkers in sediments that were previously studied by GC–MS. The petrography of this sample was examined by optical and fluorescence microscopy. It is demonstrated here that fs-LDPI-MS combined with petrography for multimodal imaging can expose buried compounds within the sample via in situ layer removal. When used in conjunction with traditional organic geochemical analysis, this method has the potential to determine the spatial distribution of organic biomarkers in geological material. Finally, fs-LDPI-MS imaging data are compared with ToF-SIMS imaging that is commonly used for such studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Nonlinear Topological Photonics: Capturing Nonlinear Dynamics and Optical Thermodynamics

Combining multiple optical resonators or engineering dispersion of complex media has provided an effective method for demonstrating topological physics controlling photons in unprecedented ways such as unidirectional light propagation and spatially localized modes between an interface or on a corner. Further, adding nonlinear responses to those topological photonic systems has enabled achieving diverse phases of photons in both space and time, allowing for more functionalities in photonic devices that provide a new playground for studying dynamic features of nonlinear topological systems. However, most methods for describing nonlinear topological photonic systems rely on linear topological theories, making it challenging to accurately characterize the topology of nonlinear systems. Thus, substantial efforts have focused on rigorously describing nonlinear topological phases and developing effective tools to analyze nonlinear topological effects. Meanwhile, coupled multimode optical waveguides with nonlinear dynamic responses provide an excellent platform for the statistical description of photons, opening a new paradigm called “optical thermodynamics”. This review will introduce the basic concepts of nonlinear topological photonics and the recent development of theoretical approaches focusing on data-driven approaches for creating phase diagrams as well as the spectral localizer framework and the pseudospectrum method for understanding optical nonlinearities in topological systems. In addition, the new concept of optical thermodynamics will be introduced with some recent theoretical works.

Topological photonics↗
DOE OSTI2021

November Mega-AI Newsletter

Mega AI, an internal investment at Pacific Northwest National Laboratory, aims to develop next-generation artificial intelligence (AI) capabilities unique to the Department of Energy national lab complex to address research gaps in large-scale multimodal representation learning, multitask inferences, and the need for increased generalizability, rapid adaptivity, and usability of AI technologies. In this newsletter, we highlight recent developments in the research community on next-gen AI technologies focusing on massive-scale model development, deployment and evaluation, data and code availability, model interactions, and new features and capabilities that are relevant to Mega AI’s goals and science and security applications.

Volkova, Svitlana↗
DOE OSTI2021

Integrated transmission electron microscope

An integrated transmission electron microscope comprising multiple electron sources for tuned beams of ultrafast, scanning probe, and parallel illumination in varied beam energies can be alternated within sub-microseconds onto a sample with dynamic ‘transient state’ processes to acquire atomic-scale structural/chemical data with site specificity. The various electron sources and condenser optics enable high-resolution imaging, high-temporal resolution imaging, and chemical imaging, using fast-switching magnets to direct the different electron beams onto a single maneuverable objective pole piece where the sample resides. Such multimodal in situ characterization tools housed in a single microscope have the potential to revolutionize materials science.

Jungjohann, Katherine L.↗
DOE OSTI2025

Pilot-Scale Validation of Distributed Optical Fiber Sensors for Underground Pipeline Monitoring

Distributed fiber optic sensing is a cutting-edge technology that has found extensive applications in the monitoring of Ensuring the safety, integrity, and operational efficiency of underground product pipelines is vital for maintaining the nation’s critical infrastructure. Monitoring parameters such as hoop strain, pressure, and acoustic vibrations is key to detecting potential leaks, intrusions, or structural issues. Distributed optical fiber sensor (DOFS) systems provide a compelling solution for continuous, real-time monitoring over long distances. This paper details the development and pilot-scale implementation of DOFS systems for underground pipeline monitoring, evolving from a proof-of-concept stage. Multiple custom-designed DOFS interrogator units—such as optical frequency-domain reflectometry (OFDR), Brillouin optical time-domain analysis (BOTDA), and multimodal interferometer-based fiber acoustic sensors—were employed to measure key parameters like hoop strain, pressure, and acoustic vibrations. The underground product pipeline's outer diameter is 30 inches, the wall thickness is 1.28 inches, and the 3-foot depth. The fiber deployment strategies, and sensing data acquisition methods for these systems are discussed. The results demonstrate the effectiveness of DOFS in detecting hoop strain, temperature changes, and acoustic vibrations, showcasing their potential for real-time monitoring and enhancing pipeline safety.

distributed fiber sensing↗
DOE OSTI2024

Multimodal sensor fusion for real-time standoff estimation in directed energy deposition

In Laser Powder-based Direct Energy Deposition (LP-DED) systems, achieving consistency, precision and quality of produced parts requires tight control over printing parameters. One of the critical parameters is the standoff distance. Maintaining an optimal standoff height is crucial for achieving correct laser power density and powder catchment efficiency, as both laser and powder streams are focused at this distance. Here, this study introduces a novel approach using multimodal sensor fusion to predict standoff height in real-time. The proposed system integrates two low-profile, cost-effective sensors: an RGB coaxial camera and a high frequency and high dynamic range microphone. By utilizing a simple fully connected neural network, trained on a limited dataset, data fusion of these sensors allowed for the real-time prediction of the standoff height. The results demonstrate high resolution and accuracy of the predictions across multiple geometries and a wide range of standoff heights. This approach offers a simple, and cost-effective solution for real-time standoff height monitoring and lays the groundwork for future integration into commercial LP-DED systems.

42 ENGINEERING↗
DOE OSTI2026

Advanced Facility Design and AI/ML Enabled Safeguards to Establish Secure, Economical Recycling of Fast Reactor Fuels (Final Scientific/Technical Report)

The project, "Advanced Facility Design and AI/ML Enabled Safeguards to Establish Secure, Economical Recycling of Fast Reactor Fuels," represents a significant advancement in nuclear fuel recycling technology. It integrates cutting-edge multimodal sensor fusion, machine learning (ML), and digital twin (DT) technologies to address challenges in material safeguarding, process optimization, and regulatory compliance for pyroprocessing facilities. This research has significantly enhanced the understanding of pyrochemical fuel recycling processes by developing innovative tools and methodologies. The Multimodal Safeguards Monitoring Unit (MSMU) combines electroanalytical techniques, Raman spectroscopy, and differential thermal analysis (DTA) to enable high-fidelity, near-real-time material accountancy measurements. Machine learning techniques, such as Long Short-Term Memory (LSTM) autoencoders, are utilized to detect anomalies in material balances and sensor data, improving the reliability of safeguards monitoring. Additionally, digital twin technology has been established to provide real-time system-level monitoring and diagnostics, integrating physics-based models with sensor data to optimize process safety and efficiency.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗
DOE OSTI2022

Damage Tolerance Assessment of Laser Clad Repairs of Coarse Grain Ti-6Al-4V

Background: Laser cladding offers a promising approach to repairing aviation components, with the ability to restore the geometric shape and the static and fatigue strength. Objective: The damage tolerance of a coarse grain Ti-6Al-4 V material is assessed via three sets of samples: (i) baseline, (ii) laser clad repaired, and (iii) laser cladding followed by heat treatment. Method: The specimens were subjected to fatigue loading using a marker band technique, in which cracks initiated from pre-defined laser slots and the small crack growth rates were measured by quantitative fractography. Additional characterization was performed on these samples, including hardness measurements, microstructure analysis, and multimodal residual stress analyses. Results: The region of the specimen undergoing laser cladding exhibited higher hardness values and a compressive residual stress, based on the slitting method. The samples subjected to heat treatment after cladding displayed negligible differences in grain size and minimal residual stress relaxation. Conclusions: The results demonstrated significant variability, with data demonstrating that cracks in the laser clad region (exhibiting the largest compressive residual stress) grew faster than cracks in the substrate region of the sample or in the baseline cases. Finally, these counterintuitive results are rationalized with additional analyses from synchrotron-based energy dispersive X-ray diffraction and high energy X-ray diffraction, demonstrating significant spatial variability in the residual elastic strains in the millimeter-sized prior β grains within the material.

36 MATERIALS SCIENCE↗