Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Artificial Neural Networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Exponential Escape Rate of Filamentary Incubation in Mott Spiking Neurons

Mott materials such as vanadium oxides, when subject to a strong applied voltage, present an inhomogeneous insulator-to-metal transition with formation of metallic filaments within the insulating bulk. This property is enabling the development of compact and power-efficient neuromorphic devices known as Mott neurons. However, the nature of the transition has not been fully understood yet, as it may be attributed to different effects, including Joule self-heating and hot-carrier injection. Moreover, the experimental determination of the threshold voltage needed to induce the transition has proven to be challenging, as the transition becomes increasingly unpredictable when the threshold is approached. The physical understanding of these issues would not only deepen our understanding of Mott insulators, but would also be an important step toward the realization of neuromorphic devices based on such materials. In this work we use numerical simulations based on the Mott resistor network model to study the nature of the filament incubation and formation process. Here, we show that both electronic and thermal effects, in the form of current density focusing and Joule self-heating, respectively, contribute to the filamentary incubation and growth. Remarkably, we find that the percolation of the metallic filaments near the threshold is intrinsically stochastic, qualitatively similar to the familiar Arrhenius activated behavior and to the stochastic firing of biological neurons. More precisely, we characterize the filament percolation as a Poisson point process, which has the same probability distribution as mathematical models of neuronal firing with an exponential escape rate. Finally, we support the numerical simulation results by performing experiments in VO 2 that are in agreement with the exponential escape rate behavior. Thus, we establish a functionality of Mott insulators that opens a path toward implementing neuromorphic hardware with quantum materials.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Structural and mechanical properties of monolayer amorphous carbon and boron nitride

Amorphous materials exhibit various characteristics that are not featured by crystals and can sometimes be tuned by their degree of disorder (DOD). Here, we report results on the mechanical properties of monolayer amorphous carbon (MAC) and monolayer amorphous boron nitride (maBN) with different DOD. The pertinent structures are obtained by kinetic-Monte-Carlo (kMC) simulations using machine-learning potentials (MLP) with density-functional-theory (DFT)-level accuracy. An intuitive order parameter, namely the areal fraction F x occupied by crystallites within the continuous random network, is proposed to describe the DOD. We find that F x captures the essence of the DOD: Samples with the same F x but different sizes and arrangements of crystallites, obtained using two distinct kMC procedures, have virtually identical radial distributions functions as well as bond-length and bond-angle distributions. Furthermore, by simulating the fracture process with molecular dynamics, we found that the mechanical responses of MAC and maBN before fracture are mainly determined by F x and are insensitive to the sizes and specific arrangements and to some extent the numbers and area distributions of the crystallites. The behavior of cracks in the two materials is analyzed and found to mainly propagate in meandering paths in the CRN region and to be influenced by crystallites in distinct ways that toughen the material. Furthermore, the present results reveal the relation between structure and mechanical properties in amorphous monolayers and may provide a universal toughening strategy for 2D materials.

2-dimensional systems↗
DOE OSTI2025

Predicting the viscoplastic response of a crystallizing fluoropolymer using transient network theory

We employ a molecular theory of dynamic polymer networks to describe the viscoplastic response of rubbery FK-800, a thermoplastic copolymer of chlorotrifluoroethylene and vinylidene fluoride, over a broad range of thermal histories. The kinetics of crystallization at different annealing temperatures was modeled using a modified Avrami equation, whose parameters were found to evolve through simple relationships over the full temperature range of the rubbery state. By fitting experimental compression data, we discovered predictable trends for the physical parameters in our mechanical model over its full range of crystallinities (up to ≈20%) and provided insights based on molecular-level physics to justify them. Using this, an end-to-end model was developed to predict the yielding and post-yield behavior of rubbery FK-800 for arbitrary thermal histories. The model successfully predicted the highly nonlinear evolution of characteristic mechanical signatures (stiffness, yield point, post-yield drop) throughout the crystallization process. A statistical analysis of variance test was employed to determine that the measured variations in the mechanical behavior of rubbery FK-800 are primarily dictated by its fractional crystallinity, regardless of its exact thermal history.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Geometrical-Based Generative Adversarial Network to Enhance Digital Rock Image Quality

X-ray microcomputed tomography (micro-CT) is a common tool for the study of porous media structures and properties. High-quality micro-CT data are required to accurately capture pore structures. Acquiring high-quality micro-CT data, however, is not always possible, owing to application limitations and experimental constraints. Therefore, we propose a geometrical-based generative adversarial network (GAN) to rapidly restore noisy micro-CT images to their clean counterparts. The training data and related ground-truth (GT) data are scanned for 7 min and 9.5 h, respectively. To evaluate the performance of the geometrical-based GAN, a 6003 voxel image that has never been used for training is reconstructed and compared with the corresponding GT image. Histogram matching and linear normalization are implemented to adjust the histogram of the reconstructed image to that of the GT image. A watershed-based segmentation method is then applied to delineate pore and solid phases. Lastly, we measure the Minkowski functionals and petrophysical properties, including absolute permeability, pore size distribution, drainage capillary pressure-saturation curve, and imbibition relative permeability, to estimate the physical accuracy of the denoised image. The results show that the proposed geometrical-based GAN can accurately restore noisy micro-CT data. By reducing the scanning time from 9.5 h to 7 min, the expenditure of collecting micro-CT can be decreased significantly. This is particularly important for applications where time-lapse images of a dynamic process are required, high-throughput imaging is necessary for real-time data analysis, or where the quantification of large sample volumes is required.

58 GEOSCIENCES↗
DOE OSTI2026

Improving missing transverse momentum estimation with a deep neural network

At hadron colliders, the net transverse momentum of particles that do not interact with the detector (missing transverse momentum, $^→_𝑝$$^{miss}_{T}$) is a crucial observable in many analyses. In the standard model, $^→_𝑝$$^{miss}_{T}$ originates from neutrinos. Many beyond-the-standard-model particles, such as dark matter candidates, are also expected to leave the experimental apparatus undetected. This paper presents a novel deep neural network based $^→_𝑝$$^{miss}_{T}$ estimator, DeepMET, developed by the CMS Collaboration at the LHC. The DeepMET algorithm produces a weight for each reconstructed particle based on its properties. The estimator is based on the negative vector sum of the weighted transverse momenta of all reconstructed particles in an event. Compared with other estimators currently employed by CMS, DeepMET improves the $^→_𝑝$$^{miss}_{T}$ resolution by 10%–30%, shows improvement for a wide range of final states, is easier to train, and is more resilient against the effects of additional proton-proton interactions accompanying the collision of interest.

artificial neural networks↗
DOE OSTI2022

Application of machine learning to characterize gas hydrate reservoirs in Mackenzie Delta (Canada) and on the Alaska north slope (USA)

Here, artificial neural network-trained models were used to predict gas hydrate saturation distributions in permafrost-associated deposits in the Eileen Gas Hydrate Trend on the Alaska North Slope (ANS), USA and at the Mallik research site in the Beaufort-Mackenzie Basin, Northwest Territories, Canada. The database of Logging-While-Drilling (LWD) and wireline logs collected at five wells (Mount Elbert, Ignik Sikumi, and Kuparuk 7–11–12 wells at ANS, plus 2L-38 and 5L-38 wells at the Mallik research site) includes more than 10,000 depth points, which were used for training, validation, and testing the machine learning (ML) models. Data used in training the ML models include the well logs of density, porosity, electrical resistivity, gamma radiation, and acoustic wave velocity measurements. Combinations of two or three out of these five well logs were found to reliably predict the gas hydrate saturation with accuracy varying between 80 and 90% when compared to the gas hydrate saturations derived from Nuclear Magnetic Resonance (NMR)-based technique. The ML models trained on data from three ANS wells achieved high fidelity predictions of gas hydrate saturation at the Mallik site. The results obtained in this study indicate that ML models trained on data from one geological basin can successfully predict key reservoir parameters for permafrost-associated gas hydrate accumulations within another basin. A generalized approach for selecting a well log combination that can improve model accuracy is discussed. Overall, the study outcome supports earlier work demonstrating that ML models trained on non-NMR well logs are a viable alternative to physics-driven methods for predicting gas hydrate saturations.

58 GEOSCIENCES↗
DOE OSTI2026

E-PINNs: Epistemic Physics-Informed Neural Networks

Physics-informed neural networks (PINNs) have demonstrated promise as a framework for solving forward and inverse problems involving partial differential equations. Despite recent progress in the field, it remains challenging to quantify uncertainty in these networks. While techniques such as Bayesian PINNs (B-PINNs) provide a principled approach to capturing epistemic uncertainty through Bayesian inference, they can be computationally expensive for large-scale applications. In this work, we propose Epistemic Physics-Informed Neural Networks (E-PINNs), a framework that uses a small network, the epinet, to efficiently quantify epistemic uncertainty in PINNs. The proposed approach works as an add-on to existing, pre-trained PINNs with a small computational overhead. We demonstrate the applicability of the proposed framework in various test cases and compare the results with B-PINNs using Hamiltonian Monte Carlo (HMC) posterior estimation and dropout-equipped PINNs (Dropout-PINNs). In our experiments, E-PINNs achieve calibrated coverage with competitive sharpness at substantially lower cost. We demonstrate that when B-PINNs produce narrower bands, they under-cover in our tests. E-PINNs also show better calibration than Dropout-PINNs in these examples, indicating a favorable accuracy-efficiency trade-off.

AI for Science↗
DOE OSTI2022

Non-destructive measurement and real-time monitoring of apple hardness during ultrasonic contact drying via portable NIR spectroscopy and machine learning

Portable near-infrared spectrometer in the spectral range of 900–1700 nm was evaluated for the first time to assess and monitor apple hardness in real-time during ultrasonic drying. Calibration models were developed using PLS and ANN, and their performances were evaluated by internal leave-one-out cross-validation and an external dataset. Several pre-treatments including standard normal variate (SNV), multiplicative scatter correction (MSC), Savitzky–Golay first and second derivatives were employed to examine the effects of spectral variations in hardness prediction. Seven important wavelengths were selected using weighted regression coefficients to develop a simple MLR model to facilitate the model interpretation and circumvent noise. The models using PLS, MLR, and ANN with selected wavelengths predicted the apple hardness with R 2 p of 0.91, 0.91, 0.95, and RMSEP of 14.78, 14.85, and 12.46 N, respectively. Finally, the results indicate that portable NIR spectrometers are quite promising for real-time monitoring of apple hardness during ultrasonic drying.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

A comparative study of machine learning models for predicting the state of reactive mixing

Mixing phenomena are important mechanisms controlling flow, species transport, and reaction processes in fluids and porous media. Accurate predictions of reactive mixing are critical for many Earth and environmental science problems such as contaminant fate and remediation, macroalgae growth, and plankton biomass evolution. Here, to investigate the evolution of mixing dynamics under different scenarios (e.g., anisotropy, fluctuating velocity fields), a finite-element-based numerical model was built to solve the fast, irreversible bimolecular reaction-diffusion equations to simulate a range of reactive-mixing scenarios. A total of 2,315 simulations were performed using different sets of model input parameters comprising various spatial scales of vortex structures in the velocity field, time-scales associated with velocity oscillations, the perturbation parameter for the vortex-based velocity, anisotropic dispersion contrast (i.e., ratio of longitudinal-to-transverse dispersion), and molecular diffusion. The outputs comprised concentration profiles of reactants and products. The inputs to and outputs from these simulations were concatenated into feature and label matrices, respectively, to train 20 different machine learning (ML) models intended to emulate system behavior. These 20 ML emulators, based on linear methods, Bayesian methods, ensemble learning methods, and multilayer perceptrons (MLPs), were trained to classify the state of mixing and predict three quantities of interest (QoIs) characterizing species production, decay (i.e., average concentration, square of average concentration), and degree of mixing (i.e., variances of species concentration). Unsurprisingly, linear classifiers and regressors failed to reproduce the QoIs; however, ensemble methods (classifiers and regressors) and the MLP model accurately classified the state of reactive mixing and the QoIs. Among ensemble methods, random forest and decision-tree-based AdaBoost faithfully predicted the QoIs. At run time, trained ML emulators produced results times faster than the finite-element simulations. Due to their low computational expense and high accuracy, ensemble and MLP models are excellent emulators for these numerical simulations and great utilities in uncertainty quantification exercises, which can require 1,000s of forward model runs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Application of remote sensing precipitation data and the $\mathrm{CONNECT}$ algorithm to investigate spatiotemporal variations of heavy precipitation: Case study of major floods across Iran (Spring 2019)

In recent years, the number of floods following unprecedented rainfall events have increased in Iran during early spring (March 21st to April 20th, referred to in Iran as the month of “Farvadin”). While numerous studies have addressed changes in climate extremes and precipitation trends at different temporal scales from daily to annual across the country, analyses of short-duration and heavy precipitation, especially during recent years, are rarely considered. Furthermore, most studies investigate the variations in extremes and total precipitation using a limited number of synoptic weather stations across Iran. Here this study assesses the variations in heavy precipitation (precipitation with intensities greater than or equal to 3 mm/3 h) at 0.04° spatial and 3-hourly temporal resolution during the month of Farvardin. In addition, the effect of atmospheric river conditions over Iran and their possible link to intensifying heavy precipitation is explored. For this purpose, the CONNected-objECT (CONNECT) algorithm is applied on a precipitation dataset, Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks-Cloud Classification System (PERSIANN-CCS), and an Integrated Water Vapor Transport (IVT) dataset from the NASA Modern-Era Retrospective Analysis for Research and Applications Version-2 (MERRA-2). The results suggest that the increase in the number of floods in recent years is related to the increase in the intensity and volume of heavy precipitation events, although the frequency and duration of heavy precipitation events have not changed significantly. Furthermore, the results show that atmospheric river conditions over the country are present during the same window as each year’s most extreme events. It is found that 8 out of 13 of the largest ARs over Iran come from moisture plumes with pathways over the African and Red Sea.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Predicting boron coordination in multicomponent borate and borosilicate glasses using analytical models and machine learning

Accurate prediction of boron coordination in multicomponent glasses is critical in glass science and technology as it strongly affects the properties of borate and borosilicate glasses. We have collected a dataset containing 657 glasses from literature with boron coordination values and developed models using analytical functions based on the well accepted Dell, Xiao and Bray model. Good prediction of boron coordination with a R 2 value higher than 0.8 was obtained. The large variation of boron coordination from experiments, originated from sample preparations and characterizations, led to difficulties in obtaining models with better prediction performance. Various machine learning (ML) algorithms were evaluated and slightly better prediction performance was observed; however, interpretation of the ML models is less straight forward. In conclusion, this study developed various models capable of providing quantitative boron coordination predictions, providing insights into its structural roles in multi-component glasses, and suggesting fruitful areas for future research.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Elevated temperature contact creep and friction of nickel-based superalloys using machine learning assisted finite element analysis

Nickel-based superalloys with superior thermochemical, mechanical, and tribological properties are highly utilized for critical components in several high temperature applications such as gas turbines and nuclear reactors. Inconel 617, in particular, is considered as one of the main candidate superalloys for tribo-components in very-high-temperature gas-cooled nuclear reactors. Recent findings indicate that this alloy grows unique surface oxide especially in a high-temperature helium environment with distinctive wear, friction, and contact properties. Here, this study investigates the high temperature contact area evolution and frictional behavior of Inconel 617 using finite element simulation and provides predictive models for the contact and friction performance at different normal loads, dwell times, and temperatures. High temperature helium-aged Inconel 617 top surface properties (up to 600 °C) are utilized along with a single asperity-based deformable elastic-plastic contact model under combined normal and tangential loading. Machine learning is used to assist the finite element results and to predict friction coefficient as well as contact area evolution. While a small difference is observed in the instantaneous friction coefficient (no dwell time) for all temperatures, friction coefficient increases considerably with dwell time. This shows that the effect of contact creep for longer dwell times significantly dominants the effect of high temperature variation in basic mechanical parameters such as modulus and yield strength. It is found that increasing temperature and dwell times lead to the friction coefficient increase, yet the dominance of dwell time effects decreases at higher temperatures and loads. While the analysis is presented for Inconel 617, the methodology is easy to be generalized and can be applied to other HT alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Mechanisms of Ethylene Epoxidation over Silver from Machine Learning-Accelerated First-Principles Modeling and Microkinetic Simulations

In this work we employed machine learning-augmented density functional theory (DFT) thermodynamic calculations to assess the stability of different AgO x structures under catalytic ethylene epoxidation reaction conditions. We found that there are multiple AgO x surface motifs that could co-exist under the relevant conditions. These included Ag surface oxides (e.g., AgO_p(4 × 4) and Ag 1.83 O) and atomic oxygen-covered Ag(111) surfaces. Furthermore, we employed DFT calculations to evaluate the energetics of different reaction mechanisms by which ethylene and oxygen can react on these surfaces. These studies revealed several energetically viable reaction pathways for ethylene epoxidation. Microkinetic modeling analyses, based on the DFT-calculated reaction pathways, showed that ethylene epoxidation can proceed on all surfaces and that multiple pathways, including those involving Langmuir–Hinshelwood and Eley–Rideal mechanisms, could be involved in selective and unselective reactions. The diversity of mechanisms that we discovered in the context of the relatively simple ethylene epoxidation reaction on Ag suggests that the richness and complexity of surface chemistry are most likely a rule rather than an exception in heterogeneous catalytic chemical transformations on metal surfaces and that the concept of a single or even a dominant mechanism and reaction intermediates might need to be revisited for many reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A Generalized Transformer-Based Pulse Detection Algorithm

Pulse-like signals are ubiquitous in the field of single molecule analysis, e.g., electrical or optical pulses caused by analyte translocations in nanopores. The primary challenge in processing pulse-like signals is to capture the pulses in noisy backgrounds, but current methods are subjectively based on a user-defined threshold for pulse recognition. Here, we propose a generalized machine-learning based method, named pulse detection transformer (PETR), for pulse detection. PETR determines the start and end time points of individual pulses, thereby singling out pulse segments in a time-sequential trace. It is objective without needing to specify any threshold. It provides a generalized interface for downstream algorithms for specific application scenarios. PETR is validated using both simulated and experimental nanopore translocation data. It returns a competitive performance in detecting pulses through assessing them with several standard metrics. Finally, the generalization nature of the PETR output is demonstrated using two representative algorithms for feature extraction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

PERSIANN-CCS-CDR, a 3-hourly 0.04° global precipitation climate data record for heavy precipitation studies

Accurate long-term global precipitation estimates, especially for heavy precipitation rates, at fine spatial and temporal resolutions is vital for a wide variety of climatological studies. Most of the available operational precipitation estimation datasets provide either high spatial resolution with short-term duration estimates or lower spatial resolution with long-term duration estimates. Furthermore, previous research has stressed that most of the available satellite-based precipitation products show poor performance for capturing extreme events at high temporal resolution. Therefore, there is a need for a precipitation product that reliably detects heavy precipitation rates with fine spatiotemporal resolution and a longer period of record. Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Cloud Classification System-Climate Data Record (PERSIANN-CCS-CDR) is designed to address these limitations. This dataset provides precipitation estimates at 0.04° spatial and 3-hourly temporal resolutions from 1983 to present over the global domain of 60°S to 60°N. Evaluations of PERSIANN-CCS-CDR and PERSIANN-CDR against gauge and radar observations show the better performance of PERSIANN-CCS-CDR in representing the spatiotemporal resolution, magnitude, and spatial distribution patterns of precipitation, especially for extreme events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A machine learning photon detection algorithm for coherent x-ray ultrafast fluctuation analysis

X-ray free electron laser experiments have brought unique capabilities and opened new directions in research, such as creating new states of matter or directly measuring atomic motion. One such area is the ability to use finely spaced sets of coherent x-ray pulses to be compared after scattering from a dynamic system at different times. This enables the study of fluctuations in many-body quantum systems at the level of the ultrafast pulse durations, but this method has been limited to a select number of examples and required complex and advanced analytical tools. By applying a new methodology to this problem, we have made qualitative advances in three separate areas that will likely also find application to new fields. As compared to the “droplet-type” models, which typically are used to estimate the photon distributions on pixelated detectors to obtain the coherent x-ray speckle patterns, our algorithm achieves an order of magnitude speedup on CPU hardware and two orders of magnitude improvement on GPU hardware. We also find that it retains accuracy in low-contrast conditions, which is the typical regime for many experiments in structural dynamics. Finally, it can predict photon distributions in high average-intensity applications, a regime which up until now has not been accessible. Our artificial intelligence-assisted algorithm will enable a wider adoption of x-ray coherence spectroscopies, by both automating previously challenging analyses and enabling new experiments that were not otherwise feasible without the developments described in this work.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Machine learning prediction of self-diffusion in Lennard-Jones fluids

In this work, different machine learning (ML) methods were explored for the prediction of self-diffusion in Lennard-Jones (LJ) fluids. Using a database of diffusion constants obtained from the molecular dynamics simulation literature, multiple Random Forest (RF) and Artificial Neural Net (ANN) regression models were developed and characterized. The role and improved performance of feature engineering coupled to the RF model development was also addressed. The performance of these different ML models was evaluated by comparing the prediction error to an existing empirical relationship used to describe LJ fluid diffusion. It was found that the ANN regression models provided superior prediction of diffusion in comparison to the existing empirical relationships.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Data-driven materials research enabled by natural language processing and information extraction

Given the emergence of data science and machine learning throughout all aspects of society, but particularly in the scientific domain, there is increased importance placed on obtaining data. Data in materials science are particularly heterogeneous, based on the significant range in materials classes that are explored and the variety of materials properties that are of interest. This leads to data that range many orders of magnitude, and these data may manifest as numerical text or image-based information, which requires quantitative interpretation. The ability to automatically consume and codify the scientific literature across domains - enabled by techniques adapted from the field of natural language processing - therefore has immense potential to unlock and generate the rich datasets necessary for data science and machine learning. This review focuses on the progress and practices of natural language processing and text mining of materials science literature and highlights opportunities for extracting additional information beyond text contained in figures and tables in articles. Here, we discuss and provide examples for several reasons for the pursuit of natural language processing for materials, including data compilation, hypothesis development, and understanding the trends within and across fields. Current and emerging natural language processing methods along with their applications to materials science are detailed. We, then, discuss natural language processing and data challenges within the materials science domain where future directions may prove valuable.

36 MATERIALS SCIENCE↗