Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

TH-CD-207A-07: Prediction of High Dimensional State Subject to Respiratory Motion: A Manifold Learning Approach

Purpose: The development of high dimensional imaging systems (e.g. volumetric MRI, CBCT, photogrammetry systems) in image-guided radiotherapy provides important pathways to the ultimate goal of real-time volumetric/surface motion monitoring. This study aims to develop a prediction method for the high dimensional state subject to respiratory motion. Compared to conventional linear dimension reduction based approaches, our method utilizes manifold learning to construct a descriptive feature submanifold, where more efficient and accurate prediction can be performed. Methods: We developed a prediction framework for high-dimensional state subject to respiratory motion. The proposed method performs dimension reduction in a nonlinear setting to permit more descriptive features compared to its linear counterparts (e.g., classic PCA). Specifically, a kernel PCA is used to construct a proper low-dimensional feature manifold, where low-dimensional prediction is performed. A fixed-point iterative pre-image estimation method is applied subsequently to recover the predicted value in the original state space. We evaluated and compared the proposed method with PCA-based method on 200 level-set surfaces reconstructed from surface point clouds captured by the VisionRT system. The prediction accuracy was evaluated with respect to root-mean-squared-error (RMSE) for both 200ms and 600ms lookahead lengths. Results: The proposed method outperformed PCA-based approach with statistically higher prediction accuracy. In one-dimensional feature subspace, our method achieved mean prediction accuracy of 0.86mm and 0.89mm for 200ms and 600ms lookahead lengths respectively, compared to 0.95mm and 1.04mm from PCA-based method. The paired t-tests further demonstrated the statistical significance of the superiority of our method, with p-values of 6.33e-3 and 5.78e-5, respectively. Conclusion: The proposed approach benefits from the descriptiveness of a nonlinear manifold and the prediction reliability in such low dimensional manifold. The fixed-point iterative approach turns out to work well practically for the pre-image recovery. Our approach is particularly suitable to facilitate managing respiratory motion in image-guide radiotherapy. This work is supported in part by NIH grant R01 CA169102-02.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

The confluence of machine learning and multiscale simulations

Multiscale modeling has a long history of use in structural biology, as computational biologists strive to overcome the time- and length-scale limits of atomistic molecular dynamics. Contemporary machine learning techniques, such as deep learning, have promoted advances in virtually every field of science and engineering and are revitalizing the traditional notions of multiscale modeling. Deep learning has found success in various approaches for distilling information from fine-scale models, such as building surrogate models and guiding the development of coarse-grained potentials. However, perhaps its most powerful use in multiscale modeling is in defining latent spaces that enable efficient exploration of conformational space. In conclusion, this confluence of machine learning and multiscale simulation with modern high-performance computing promises a new era of discovery and innovation in structural biology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Large Scale Caching and Streaming of Training Data for Online Deep Learning

The training of deep neural network models on large data remains a difficult problem, despite progress towards scalable techniques. In particular, there is a mismatch between the random but predetermined order in which AI flows select training samples and the streaming I/O patterns for which traditional HPC data storage (e.g., parallel file systems) are designed. In addition, as more data are obtained, it is feasible neither simply to train learning models incrementally, due to catastrophic forgetting (i.e., bias towards new samples), nor to train frequently from scratch, due to prohibitive time and/or resource constraints. In this paper, we study data management techniques that combine caching and streaming with rehearsal support in order to enable efficient access to training samples in both offline training and continual learning. We revisit state-of-art streaming approaches based on data pipelines that transparently handle prefetching, caching, shuffling, and data augmentation, and discuss the challenges and opportunities that arise when combining these methods with data-parallel training techniques. We also report on preliminary experiments that evaluate the I/O overheads involved in accessing the training samples from a parallel file system (PFS) under several concurrency scenarios, highlighting the impact of the PFS on the design of the data pipelines.

data pipelines↗
DOE OSTI2022

OPF-Learn: An Open-Source Framework for Creating Representative AC Optimal Power Flow Datasets: Preprint

Increasing levels of renewable generation motivate a growing interest in data-driven approaches for AC optimal power flow (AC OPF) to manage uncertainty. However, a lack of disciplined dataset creation and benchmarking prohibits useful comparison between approaches in the literature. To instigate confidence, models must be able to reliably predict solutions across a wide range of operating conditions. This paper develops the OPF-Learn package for Julia and Python which uses a computationally efficient approach to create representative datasets that span a wide spectrum of the AC OPF feasible region. Load profiles are uniformly sampled from a convex set that contains the AC OPF feasible set. For each infeasible point found, the convex set is reduced using infeasibility certificates, found by utilizing properties of a relaxed formulation. The framework is shown to generate datasets which are more representative of the entire feasible space versus traditional techniques seen in the literature, improving machine learning model performance.

dataset↗
DOE OSTI2025

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗
DOE OSTI2019

Operational Planning Strategy for a Sequim Bay Underwater UXO Test Site (SBU2)

The Department of Defense (DoD) has identified more than 400 underwater sites that are potentially contaminated with munitions. Most areas are in shallow water (0-35 m) where the munitions pose a threat to human health and the environment. The Strategic Environmental Research and Development Program (SERDP) and Environmental Security Technology Certification Program (ESTCP) held a workshop in 2018 to establish the requirements, framework, protocols, responsibilities, and time lines for development of a series of underwater UXO Standardized Demonstration sites (“test beds”) for the purpose of testing the efficacy of sensors, equipment, and technologies to detect UXO. The workshop recommended a phased approach to building test beds to capitalize on: 1) incorporation of lessons learned from existing DoD funded projects, 2) leveraging existing underwater test bed environments funded by other programs, and 3) supporting recursive learning from early phases of the test bed development (i.e. efficiently optimizing through a scaling-up approach). This strategy document provides the framework to establish a working operational plan for the Sequim Bay Underwater UXO (SBU2) Test Bed (Phase II). Details of the plan are dependent on earlier phases of the effort as shown in Figure 1. Results from Phase I are being evaluated, and when complete, will inform the next iteration of this plan. As such, it should be considered a living document that will be informed by the lessons learned and updated as new information becomes known and requirements are refined. This approach will allow SBU2 to evolve to meet the needs of the remediation community.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2019

Estimation of full-field, full-order experimental modal model of cable vibration from digital video measurements with physics-guided unsupervised machine learning and computer vision

Cables are critical components for a variety of structures such as stay cables and suspenders of cable-stayed bridges and suspension bridges. When in operational service, they are vulnerable to cumulative fatigue damage induced by dynamic loads (e.g., the cyclic vehicle loads and wind excitation). To accurately analyze and predict their dynamics behaviors and performance that could be spatially local and temporal transient, it is essential to perform high-resolution vibration measurements, from which their dynamics properties are identified and, subsequently, a high spatial resolution, full-modal-order dynamics model of cable vibration can be established. In this study, we develop a physics-guided, unsupervised machine learning-based video processing approach that can blindly and efficiently extract the full-field (as many points as the pixel number of the video frame) modal parameters of cable vibration using only the video of an operating (output-only) cable. In particular, by incorporating the physics of cable vibration (taut string model), a novel automated modal motion filtering method is proposed to enable autonomous identification of full-order (as many modes as possible) dynamic parameters, including those weakly excited modes that used to be challenging to identify in operational modal analysis. Therefore, a full-field, full-order modal model of cable vibration is established by the proposed method. Furthermore, this new approach provides a low-cost and noncontact technique to estimate the cable tension using only the video of the vibrating cable where the fundamental frequency is automatically and efficiently estimated to compute the cable tension according to the taut string equation. Laboratory experiments on a bench-scale cable are conducted to validate the developed approach.

42 ENGINEERING↗
DOE OSTI2016

Multimodal Event Detection in Twitter Hashtag Networks

In this study, event detection in a multimodal Twitter dataset is considered. We treat the hashtags in the dataset as instances with two modes: text and geolocation features. The text feature consists of a bag-of-words representation. The geolocation feature consists of geotags (i.e., geographical coordinates) of the tweets. Fusing the multimodal data we aim to detect, in terms of topic and geolocation, the interesting events and the associated hashtags. To this end, a generative latent variable model is assumed, and a generalized expectation-maximization (EM) algorithm is derived to learn the model parameters. The proposed method is computationally efficient, and lends itself to big datasets. Lastly, experimental results on a Twitter dataset from August 2014 show the efficacy of the proposed method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Dynamics and lipid membrane coupling of the RAS-RAF complex revealed via multiscale simulations

To gain molecular and mechanistic insights into initiation of the RAS-RAF signaling cascade, we developed and used a combination of multiscale simulation and experimental approaches. The influence and impact of the membrane on RAS and RAF proteins is a factor we are just beginning to understand and appreciate in more detail. Molecular simulation is an ideal methodology to further study this complicated relationship between the membrane and associated proteins. Our previous work using Multiscale Machine-learned Modeling Infrastructure investigated different lipid compositions solely around the KRAS4b protein and the interplay between protein behavior and these membrane environments. Multiscale Machine-learned Modeling Infrastructure uses machine learning to couple adjacent simulation scales and has been efficiently scaled across some of the world’s largest high-performance computers. Recently, we have expanded this multiresolution framework to include the all-atom simulation scale and to incorporate the RAF RBDCRD domains. Here, we present the overall analysis results from this new simulation campaign comprising a mixture of RAS and RAF RBDCRD proteins. Approximately 35,000 coarse-grained and 10,000 all-atom molecular dynamics simulations were completed, sampled from a variety of protein/lipid composition configurations that were generated from a micron-scale continuum simulation containing hundreds of copies of the proteins. Our studies suggest that orientations of the RAS-RBDCRD complex on the membrane occupy distinct configurational states, and the spatial patterns of lipid arrangements around these different protein states are unique to each state. The extent and size of lipid “fingerprints” imposed on the membrane by the RAS-RBDCRD protein complex are significantly larger than observed for just the RAS protein on its own. These protein complexes strongly associate, but we do not observe statistically significant preferred protein-protein orientations. These observations indicate that spatial colocalization of RAS-RBDCRD proteins in the same vicinity may be assisted by specific membrane environments, acting to increase the probability of signaling complex formation.

Carpenter, Timothy S. [Lawrence Livermore National↗
DOE OSTI2022

Continuous conditional generative adversarial networks for data-driven solutions of poroelasticity with heterogeneous material properties

Machine learning-based data-driven modeling can allow computationally efficient time-dependent solutions of PDEs, such as those that describe subsurface multiphysical problems. In this work, our previous approach (Kadeethum et al., 2021d) of conditional generative adversarial networks (cGAN) developed for the solution of steady-state problems involving highly heterogeneous material properties is extended to time-dependent problems by adopting the concept of continuous cGAN (CcGAN). The CcGAN that can condition continuous variables is developed to incorporate the time domain through either element-wise addition or conditional batch normalization. Moreover, this framework can handle training data that contain different timestamps and then predict timestamps that do not exist in the training data. As a numerical example, the transient response of the coupled poroelastic process is studied in two different permeability fields: Zinn & Harvey transformation and a bimodal transformation. The proposed CcGAN uses heterogeneous permeability fields as input parameters while pressure and displacement fields over time are model output. Our results show that the model provides sufficient accuracy with computational speed-up. This robust framework will enable us to perform real-time reservoir management and robust uncertainty quantification in poroelastic problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Critical review of lithium recovery from geothermal brines with implications for Smackover Formation, USA

The rapidly growing demand for lithium, a critical element for energy storage and national security technologies, has intensified concerns over the long-term availability and environmental impact of conventional lithium sources, such as hard-rock mining. To meet future demand, it is vital to explore unconventional resources that can provide sustainable domestic supplies. Geothermal brines, produced as a byproduct of geothermal energy generation, offer a promising alternative for lithium recovery by leveraging existing infrastructure and renewable energy production. In particular, the Smackover Formation, an extensive reservoir of high-salinity brines spanning Arkansas, Texas, Louisiana, Mississippi, and Alabama in the U.S. Gulf Coast, holds significant untapped lithium reserves. Co-producing geothermal energy and lithium from these brines aligns with sustainable extraction objectives while addressing resource scarcity. This review synthesizes current knowledge of lithium occurrence in the Smackover Formation and geothermal resources in the region, while also exploring how emerging tools such as machine learning can enhance resource targeting and co-production efficiency. Finally, we discuss key technical challenges and outline future research directions needed to advance lithium extraction from geothermal brines and secure a resilient domestic supply chain.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Time-lapse seismic inversion for CO 2 saturation with SeisCO2Net: An application to Frio-II site

Seismic monitoring of geological CO 2 storage (GCS) involves highly nonlinear seismic inversion and petrophysical inversion, making it challenging to estimate CO 2 volume efficiently and detect possible early CO 2 leakages. Deep learning (DL) using convolutional neural networks (CNNs) has shown promise in solving highly nonlinear seismic inversion problems. However, direct estimation of CO 2 plume extent/saturation from time-lapse seismic gathers using DL is still underexplored, with no reported field applications to date. The investigation of field data is primarily hindered by scarcity of field data for neural network training. Other obstacles include highly nonlinear seismic-petrophysics inverse relationship, and presence of noise in field seismic data. We introduce SeisCO2Net, a deep CNN that predicts CO 2 saturation maps directly from time-lapse full waveform shot gathers. For training, we use site-specific geological information, fluid flow physics, rock physics, and seismic modeling to generate synthetic datasets that closely resemble the CO 2 storage site. Synthetic tests show promising results, inspiring us to apply SeisCO2Net's trained weights on field data collected at Frio-II GCS site by leveraging transfer learning principles. As reference, we compare SeisCO2Net's predicted CO 2 saturation maps with results obtained from physics-based inversion. Our analyses show both methods display similar CO 2 plume shapes, reasonable CO 2 plume characteristics, and comparable saturation values. Our results suggest pre-training CNNs on physics-informed synthetic datasets and then applying the learned weights to field data is a viable approach to estimating field CO 2 saturation. This method effectively addresses the scarcity of field training data, thus encouraging the feasibility of long-term GCS monitoring.

58 GEOSCIENCES↗
DOE OSTI2026

Measurement of the p–$Σ^+$ correlation function in pp collisions at $\sqrt{s}$ = 13 TeV

In this letter, the first measurement of the femtoscopic correlation of protons and $Σ^+$ hyperons is presented and used to study the p–$Σ^+$ interaction. The measurement is performed with the ALICE detector in high-multiplicity triggered pp collisions at $\sqrt{s}$ = 13 TeV. The $Σ^+$ hyperons are reconstructed using a missing-mass approach in the decay channel to p + π 0 with π 0 → $γγ$, while both $Σ^+$ and protons are identified using a machine learning approach. These techniques result in a high reconstruction efficiency and purity, which allows the measurement of the p–$Σ^+$ correlation function for the first time. Thanks to the high significance achieved in the p–$Σ^+$ correlation signal, it is possible to discriminate between the predictions of different models of the N–$Σ$ interaction and to accomplish a first determination of the p–$Σ^+$ scattering parameters.

Femtoscopy↗
DOE OSTI2022

Machine Learning-Guided Discovery of Ternary Compounds Containing La, P, and Group 14 Elements

In this work, we integrate a deep machine learning (ML) method with first-principles calculations to efficiently search for the energetically favorable ternary compounds. Using La–Si–P as a prototype system, we demonstrate that ML-guided first-principles calculations can efficiently explore crystal structures and their relative energetic stabilities, thus greatly accelerate the pace of material discovery. A number of new La–Si–P ternary compounds with formation energies less than 30 meV/atom above the known ternary convex hull are discovered. Among them, the formation energies of La 5 SiP 3 and La 2 SiP phases are only 2 and 10 meV/atom, respectively, above the convex hull. These two compounds are dynamically stable with no imaginary phonon modes. Moreover, by replacing Si with heavier-group 14 elements in the eight lowest-energy La–Si–P structures from our ML-guided predictions, a number of low-energy La–X–P phases (X = Ge, Sn, Pb) are predicted.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Machine learning the metastable phase diagram of covalently bonded carbon

Abstract Conventional phase diagram generation involves experimentation to provide an initial estimate of the set of thermodynamically accessible phases and their boundaries, followed by use of phenomenological models to interpolate between the available experimental data points and extrapolate to experimentally inaccessible regions. Such an approach, combined with high throughput first-principles calculations and data-mining techniques, has led to exhaustive thermodynamic databases (e.g. compatible with the CALPHAD method), albeit focused on the reduced set of phases observed at distinct thermodynamic equilibria. In contrast, materials during their synthesis, operation, or processing, may not reach their thermodynamic equilibrium state but, instead, remain trapped in a local (metastable) free energy minimum, which may exhibit desirable properties. Here, we introduce an automated workflow that integrates first-principles physics and atomistic simulations with machine learning (ML), and high-performance computing to allow rapid exploration of the metastable phases to construct “metastable” phase diagrams for materials far-from-equilibrium. Using carbon as a prototypical system, we demonstrate automated metastable phase diagram construction to map hundreds of metastable states ranging from near equilibrium to far-from-equilibrium (400 meV/atom). We incorporate the free energy calculations into a neural-network-based learning of the equations of state that allows for efficient construction of metastable phase diagrams. We use the metastable phase diagram and identify domains of relative stability and synthesizability of metastable materials. High temperature high pressure experiments using a diamond anvil cell on graphite sample coupled with high-resolution transmission electron microscopy (HRTEM) confirm our metastable phase predictions. In particular, we identify the previously ambiguous structure of n -diamond as a cubic-analog of diaphite-like lonsdaelite phase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Inverse design of cellular structures with the targeted nonlinear mechanical response

Advanced additive manufacturing capabilities have enabled a transformational ability to create sophisticated cellular structures using diverse materials. By altering the topology of the unit cell, the mechanical behavior, such as the stress-strain response during compression, can be modulated. Nevertheless, identifying a printable topology within an enormous design space that would precisely deliver the targeted nonlinear material response is challenging. We propose a data-driven generative framework based on a conditional variational autoencoder (cVAE) architecture that can inverse design the cellular structure based on the intended nonlinear stress-strain response. Trained on a dataset of structure-property pairs, the cVAE learns a compact and expressive latent space that enables efficient mapping from targets to feasible geometries. Two inference modes are explored: (1) decoder-only generation, which enables the exploration of diverse designs conditioned solely on the desired mechanical response, and (2) encoder-decoder generation, which further allows for the incorporation of desired topologies, ensuring the generated structure conforms to both mechanical properties and to desired-topology constraints. The results demonstrate that the model can generate structurally plausible and mechanically accurate designs, with the predicted stress-strain curves closely matching the targets. Even under joint conditioning, the model effectively balances geometric fidelity and functional performance.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Hydrogen in disordered titania: connecting local chemistry, structure, and stoichiometry through accelerated exploration

Hydrogen incorporation in native surface oxides of metal alloys often controls the onset of metal hydriding, with implications for materials corrosion and hydrogen storage. A key representative example is titania, which forms as a passivating layer on a variety of titanium alloys for structural and functional applications. These oxides tend to be structurally diverse, featuring polymorphic phases, grain boundaries, and amorphous regions that generate a disparate set of unique local environments for hydrogen. Here, we introduce a workflow that can efficiently and accurately navigate this complexity. First, a machine learning force field, trained on ab initio molecular dynamics simulations, was used to generate amorphous configurations. Density functional theory calculations were then performed on these structures to identify local oxygen environments, which were compared against experimental observations. Second, to classify subtle differences across the disordered configuration space, we employ a graph-based sampling procedure. Finally, local hydrogen binding energies and hopping kinetics are computed using exhaustive density functional theory calculations on representative configurations. Here, we leverage this methodology to show that hydrogen binding energetics are described by local oxygen coordination, which in turn is affected by stoichiometry, and form the basis of hopping kinetics and diffusion. Together these results imply that hydrogen incorporation and transport in TiO x can be tailored through compositional engineering, with implications for improving the performance and durability of titanium-derived alloys in hydrogen environments.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Temporal Characterization and Filtering of Sensor Data to Support Anomaly Detection

Here, we present an approach for characterizing complex temporal behavior in the sensor measurements of a system in order to support detection of anomalies in that system. We first characterize typical behavior by extending a hidden Markov model-based approach to time series alignment. We then use a trace of that learned behavior to develop a particle filter that enables efficient estimation of the filtering distribution on the state space. This produces filtered residuals that can then be used in an anomaly detection framework. Our motivating example is the daily behavior of a building’s heating, ventilation, and air conditioning (HVAC) system, using sensor measurements that arrive every minute and induce a state space with 15,120 states. We provide an end-to-end demonstration of our approach showing improved performance of anomaly detection after application of alignment and filtering compared to the unaligned data. The proposed model is implemented as a computationally efficient R package alignts (align time series) built with R and Fortran 95 with OpenMP support.

47 OTHER INSTRUMENTATION↗