Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MACHINE LEARNING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Machine learning for impurity charge-state transition levels in semiconductors from elemental properties using multi-fidelity datasets

Quantifying charge-state transition energy levels of impurities in semiconductors is critical to understanding and engineering their optoelectronic properties for applications ranging from solar photovoltaics to infrared lasers. While these transition levels can be measured and calculated accurately, such efforts are time-consuming and more rapid prediction methods would be beneficial. Here, we significantly reduce the time typically required to predict impurity transition levels using multi-fidelity datasets and a machine learning approach employing features based on elemental properties and impurity positions. We use transition levels obtained from low-fidelity (i.e., local-density approximation or generalized gradient approximation) density functional theory (DFT) calculations, corrected using a recently proposed modified band alignment scheme, which well-approximates transition levels from high-fidelity DFT (i.e., hybrid HSE06). Further, the model fit to the large multi-fidelity database shows improved accuracy compared to the models trained on the more limited high-fidelity values. Crucially, in our approach, when using the multi-fidelity data, high-fidelity values are not required for model training, significantly reducing the computational cost required for training the model. Our machine learning model of transition levels has a root mean squared (mean absolute) error of 0.36 (0.27) eV vs high-fidelity hybrid functional values when averaged over 14 semiconductor systems from the II–VI and III–V families. As a guide for use on other systems, we assessed the model on simulated data to show the expected accuracy level as a function of bandgap for new materials of interest. Finally, we use the model to predict a complete space of impurity charge-state transition levels in all zinc blende III–V and II–VI systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

The ab initio non-crystalline structure database: empowering machine learning to decode diffusivity

Non-crystalline materials exhibit unique properties that make them suitable for various applications in science and technology, ranging from optical and electronic devices and solid-state batteries to protective coatings. However, data-driven exploration and design of non-crystalline materials is hampered by the absence of a comprehensive database covering a broad chemical space. In this work, we present the largest computed non-crystalline structure database to date, generated from systematic and accurate ab initio molecular dynamics (AIMD) calculations. We also show how the database can be used in simple machine-learning models to connect properties to composition and structure, here specifically targeting ionic conductivity. These models predict the Li-ion diffusivity with speed and accuracy, offering a cost-effective alternative to expensive density functional theory (DFT) calculations. Furthermore, the process of computational quenching non-crystalline structures provides a unique sampling of out-of-equilibrium structures, energies, and force landscape, and we anticipate that the corresponding trajectories will inform future work in universal machine learning potentials, impacting design beyond that of non-crystalline materials. In addition, combining diffusion trajectories from our dataset with models that predict liquidus viscosity and melting temperature could be utilized to develop models for predicting glass-forming ability.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Process Optimization of Carbon Electrode Materials Manufacturing by Experimental Study and Machine Learning Techniques

Electrospun carbon fibers from coal have been investigated as electrodes for batteries and supercapacitors. Despite the excellent properties of coal-derived carbon fibers (CCNF) for energy storage devices, there still lacks systematic understanding on how various process parameters affect final electrode performances, which poses challenges to scale from pilot to high volume manufacturing. The goals of this project are twofold. First, we focuse on process optimization for converting a new precursor from powder river basin (PRB) coal, referred to as coal-based polyurethane (CPU) to CCNF using electrospinning. Second, different machine learning techniques will be examined using experimental data from this work and open literature. Specifically, for CPU the following process parameters need to be characterized and optimized in order to produce CCNFs with desirable mechanical integrity and physiochemical properties: precursor composition and viscosity, operating voltage and distance, oxidation and carbonization temperature and duration. Consequently, physiochemical properties of the fibers were characterized to correlate these process parameters with desirable electrochemical performance. Given the complex nature of the fiber production process, ML models are assessed for their ability to capture the nonlinear relationship between process parameters and the electrochemical properties in applications including supercapacitors. As such, we applied various machine learning techniques, to determine which technique produces a model that best predicts device function.

Cincotta, Robert E.F.↗
DOE OSTI2021

Machine Learning Predictions of Transition Probabilities in Atomic Spectra

Forward modeling of optical spectra with absolute radiometric intensities requires knowledge of the individual transition probabilities for every transition in the spectrum. In many cases, these transition probabilities, or Einstein A-coefficients, quickly become practically impossible to obtain through either theoretical or experimental methods. Complicated electronic orbitals with higher order effects will reduce the accuracy of theoretical models. Experimental measurements can be prohibitively expensive and are rarely comprehensive due to physical constraints and sheer volume of required measurements. Due to these limitations, spectral predictions for many element transitions are not attainable. In this work, we investigate the efficacy of using machine learning models, specifically fully connected neural networks (FCNN), to predict Einstein A-coefficients using data from the NIST Atomic Spectra Database. For simple elements where closed form quantum calculations are possible, the data-driven modeling workflow performs well but can still have lower precision than theoretical calculations. For more complicated nuclei, deep learning emerged more comparable to theoretical predictions, such as Hartree–Fock. Unlike experiment or theory, the deep learning approach scales favorably with the number of transitions in a spectrum, especially if the transition probabilities are distributed across a wide range of values. It is also capable of being trained on both theoretical and experimental values simultaneously. In addition, the model performance improves when training on multiple elements prior to testing. The scalability of the machine learning approach makes it a potentially promising technique for estimating transition probabilities in previously inaccessible regions of the spectral and thermal domains on a significantly reduced timeline.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Machine learning for natural resource assessment: An application to the blind geothermal systems of Nevada

A study is underway to apply machine learning methods to evaluate natural resource potential. In particular, we are considering the search for blind geothermal systems in Nevada. Beginning with the data and experience from the previous Nevada play fairway analysis project, we are building models in TensorFlow/Keras and gaining experience toward predicting the geothermal resource potential as a probability map. During the first year of this project we have encountered several issues particular to using geological and geophysical data sets with these tools. Through an illustrative example we develop a promising workflow for future use as more data become available and are analyzed.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Machine learning and deep learning tools for the automated capture of cancer surveillance data

The National Cancer Institute and the Department of Energy strategic partnership applies advanced computing and predictive machine learning and deep learning models to automate the capture of information from unstructured clinical text for inclusion in cancer registries. Applications include extraction of key data elements from pathology reports, determination of whether a pathology or radiology report is related to cancer, extraction of relevant biomarker information, and identification of recurrence. With the growing complexity of cancer diagnosis and treatment, capturing essential information with purely manual methods is increasingly difficult. These new methods for applying advanced computational capabilities to automate data extraction represent an opportunity to close critical information gaps and create a nimble, flexible platform on which new information sources, such as genomics, can be added. This will ultimately provide a deeper understanding of the drivers of cancer and outcomes in the population and increase the timeliness of reporting. These advances will enable better understanding of how real-world patients are treated and the outcomes associated with those treatments in the context of our complex medical and social environment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Effects of Nonequilibrium Atomic Structure on Ionic Diffusivity in LLZO: A Classical and Machine Learning Molecular Dynamics Study

To improve the performance of electrochemical devices, it is essential to understand the effects of nonequilibrium motifs in solids, such as grain boundaries, amorphous phases, and highly strained regions, on atomic-scale transport and stability. Molecular dynamics simulations are used to explore the combined effect of far-from-equilibrium atomic structures and the choice of interatomic potential on ionic diffusivity predictions for Li 7 La 3 Zr 2 O 12 (LLZO), a promising solid electrolyte for all-solid-state batteries. Amorphization and high strain are considered using both classical Buckingham interatomic potentials and machine learning force fields. Here we find that both crystalline expansion and amorphization tend to slow diffusion, although the different physical encodings in the two potentials impact the properties in different ways. We trace these variations to a combination of structural and transport factors, the contributions of which are deconvoluted computationally. Graph-based analysis reveals that the variations for amorphous LLZO arise from the connectivity of diffusion pathways within the predicted structures, which generally correlates with diffusivity and is notably higher for structures generated by the machine learning force fields. Our study provides additional insight into the relationship between atomic structure and diffusivity in LLZO, while also highlighting the need for care in choosing and validating potentials to simulate far from equilibrium structures.

25 ENERGY STORAGE↗
DOE OSTI2020

ChemML : A machine learning and informatics program package for the analysis, mining, and modeling of chemical and materials data

ChemML is an open machine learning (ML) and informatics program suite that is designed to support and advance the data-driven research paradigm that is currently emerging in the chemical and materials domain. ChemML allows its users to perform various data science tasks and execute ML workflows that are adapted specifically for the chemical and materials context. Key features are automation, general-purpose utility, versatility, and user-friendliness in order to make the application of modern data science a viable and widely accessible proposition in the broader chemistry and materials community. Finally, ChemML is also designed to facilitate methodological innovation, and it is one of the cornerstones of the software ecosystem for data-driven in silico research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Machine Learning Using a Simple Feature for Detecting Multiple Types of Events From PMU Data

This paper describes simple and efficient machine learning (ML) methods for efficiently detecting multiple types of power system events captured by PMUs scarcely placed in a large power grid. It uses a single feature from each PMU based on a rectangle area enclosing the event in a given data window. This single feature is sufficient to enable commonly used ML models to detect different types of events quickly and accurately. The feature is used by five ML models on four different data-window sizes. The results indicated a tradeoff between the execution speed and detection accuracy in variety of data-window size choices. Here, the proposed method is insensitive to most data quality issues typical for data from field PMUs, and thus it does not require major data cleansing efforts prior to feature extraction.

Big data↗
DOE OSTI2021

Machine learning using host/guest energy histograms to predict adsorption in metal–organic frameworks: Application to short alkanes and Xe/Kr mixtures

A machine learning (ML) methodology that uses a histogram of interaction energies has been applied to predict gas adsorption in metal–organic frameworks (MOFs) using results from atomistic grand canonical Monte Carlo (GCMC) simulations as training and test data. In this work, the method is first extended to binary mixtures of spherical species, in particular, Xe and Kr. In addition, it is shown that single-component adsorption of ethane and propane can be predicted in good agreement with GCMC simulation using a histogram of the adsorption energies felt by a methyl probe in conjunction with the random forest ML method. Here, the results for propane can be improved by including a small number of MOF textural properties as descriptors. We also discuss the most significant features, which provides physical insight into the most beneficial adsorption energy sites for a given application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Monitoring covariance in multivariate time series: Comparing machine learning and statistical approaches

Abstract In complex systems with multiple variables monitored at high‐frequency, variables are not only temporally autocorrelated, but they may also be nonlinearly related or exhibit nonstationarity as the inputs or operation changes. One approach to handling such variables is to detrend them prior to monitoring and then apply control charts that assume independence and stationarity to the residuals. Monitoring controlled systems is even more challenging because the control strategy seeks to maintain variables at prespecified mean levels, and to compensate, correlations among variables may change, making monitoring the covariance essential. In this paper, a vector autoregressive model (VAR) is compared with a multivariate random forest (MRF) and a neural network (NN) for detrending multivariate time series prior to monitoring the covariance of the residuals using a multivariate exponentially weighted moving average (MEWMA) control chart. Machine learning models have an advantage when the data's structure is unknown or may change. We design a novel simulation study with nonlinear, nonstationary, and autocorrelated data to compare the different detrending models and subsequent covariance monitoring. The machine learning models have superior performance for nonlinear and strongly autocorrelated data and similar performance for linear data. An illustration with data from a reverse osmosis process is given.

Weix, Derek↗
DOE OSTI2023

Machine learning results and code

Results for all the Four MLP-NN, RF, XGBR, and RF algorithms for each of geophysical array`s and machine learning python code is provided.

58 GEOSCIENCES↗
DOE OSTI2021

Predicting impurity spectral functions using machine learning

The Anderson Impurity Model (AIM) is a canonical model of quantum many-body physics. Here we investigate whether machine learning models, both neural networks (NN) and kernel ridge regression (KRR), can accurately predict the AIM spectral function in all of its regimes, from empty orbital, to mixed valence, to Kondo. To tackle this question, we construct two large spectral databases containing approximately 410 000 and 600 000 spectral functions of the single-channel impurity problem. We show that the NN models can accurately predict the AIM spectral function in all of its regimes, with pointwise mean absolute errors down to 0.003 in normalized units. We find that the trained NN models outperform models based on KRR and enjoy a speedup on the order of 10 5 over traditional AIM solvers. Finally, the required size of the training set of our model can be significantly reduced using farthest point sampling in the AIM parameter space, which is important for generalizing our method to more complicated multichannel impurity problems of relevance to predicting the properties of real materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
DOE OSTI2022

Data-centric machine learning in quantum information science

Abstract We propose a series of data-centric heuristics for improving the performance of machine learning systems when applied to problems in quantum information science. In particular, we consider how systematic engineering of training sets can significantly enhance the accuracy of pre-trained neural networks used for quantum state reconstruction without altering the underlying architecture. We find that it is not always optimal to engineer training sets to exactly match the expected distribution of a target scenario, and instead, performance can be further improved by biasing the training set to be slightly more mixed than the target. This is due to the heterogeneity in the number of free variables required to describe states of different purity, and as a result, overall accuracy of the network improves when training sets of a fixed size focus on states with the least constrained free variables. For further clarity, we also include a ‘toy model’ demonstration of how spurious correlations can inadvertently enter synthetic data sets used for training, how the performance of systems trained with these correlations can degrade dramatically, and how the inclusion of even relatively few counterexamples can effectively remedy such problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

A first-principles machine-learning force field for heterogeneous ice nucleation on microcline feldspar

The formation of ice in the atmosphere affects precipitation and cloud properties, and plays a key role in the climate of our planet. Although ice can form directly from liquid water at deeply supercooled conditions, the presence of foreign particles can aid ice formation at much warmer temperatures. Over the past decade, experiments have highlighted the remarkable efficiency of feldspar minerals as ice nuclei compared to other particles present in the atmosphere. However, the exact mechanism of ice formation on feldspar surfaces has yet to be fully understood. Here, we develop a first-principles machine-learning model for the potential energy surface aimed at studying ice nucleation at microcline feldspar surfaces. The model is able to reproduce with high-fidelity the energies and forces derived from density-functional theory (DFT) based on the SCAN exchange and correlation functional. Our training set includes configurations of bulk supercooled water, hexagonal and cubic ice, microcline, and fully-hydroxylated feldspar surfaces exposed to vacuum, liquid water, and ice. In this work, we apply the machine-learning force field to study different fully-hydroxylated terminations of the (100), (010), and (001) surfaces of microcline exposed to vacuum. Our calculations suggest that terminations that do not minimize the number of broken bonds are preferred in vacuum. We also study the structure of supercooled liquid water in contact with microcline surfaces, and find that water density correlations extend up to around 10 Å from the surfaces. Finally, we show that the force field maintains a high accuracy during the simulation of ice formation at microcline surfaces, even for large systems of around 30,000 atoms. Future work will be directed towards the calculation of nucleation free energy barriers and rates using the force field developed herein, and understanding the role of different microcline surfaces on ice nucleation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Improving Grid Awareness by Empowering Utilities with Machine Learning and Artificial Intelligence

Gap filling time series data typically depends on linear interpolation. More recently gap filling advancements include machine learning techniques. However, none leverage advanced learning approach that uses cohort training or a neighborhood informed approach, which is described in this report. The report also describes a physics informed approach using Reduced Order Models (ROM). There are several methods to capture the nature of the detailed system in aggregated models, however there is a trade-off for these methods developed for multiple applications. These methods have specific requirements and applications that includes consideration of dynamics or covering a larger range of operating conditions, etc. The various methods of aggregation are: 1) Thevenin equivalents for downstream networks 2) Equivalent feeder representation to capture downstream network losses accurately 3) Structured reduced order models for dynamics 4) System identification-based ROM (abstract dynamical model) Methods described in items 1 and 2 above are ideal for steady-state models and useful for this application. Of these two methods, based on the data availability, the targeted application, the reduced order model that is proposed to be developed is the equivalent feeder model representation. This includes a structure of the reduced order model whose parameters can be determined by the system load and losses with the meter measurements.

14 SOLAR ENERGY↗