Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine Learning Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Using Active Learning to Rapidly Develop Machine Learned Diffusion Coefficients of CO 2 Conversion Reagents in Metal–Organic Frameworks

Here, we used a combined molecular dynamics/active learning (AL) approach to create machine learning models that can predict the diffusion coefficient of epichlorohydrin and chloropropene carbonate, the reactant and product of a common CO 2 cycloaddition reaction, in metal–organic frameworks (MOFs). Nanoporous MOFs are effective catalysts for the cycloaddition of CO 2 to epoxides. The diffusion rates within nanoporous catalysts can control the rate of reaction as the reactants and products must diffuse to the active sites within the MOF and then out of the nanoporous material for reusability. However, the diffusion process is routinely ignored when searching for new materials in catalytic applications. Here we verified improvement during the AL process by consistently tracking metrics on the same groups of MOFs to ensure consistency. Metal identity was found to have little impact on diffusion rates, while structural features like pore limiting diameter act as a threshold where a minimum value is needed for high diffusion rates. We identified the MOFs with the highest epichlorohydrin and chloropropene carbonate diffusion coefficients which can be used for further studies of reaction energetics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

One Pot Synthesis of Cyan Emitting CdZnSSe Quantum Dots for Human Centric Lighting

A one pot synthesis of blue and green emissive CdZnSSe quantum dots (QDs) from thio- and selenoureas and Cd and Zn carboxylates is optimized using high throughput robotic optimization. A large set of spectral data (N = 192) is used to train machine learning models that accurately predict the photoluminescence emission wavelength (λmax) and full-width half-maximum, and the relative photoluminescence quantum yield (PLQY) from the S:Se and Zn:Cd stoichiometries and reaction time. ZnS shells are deposited on the crude QD heterostructures using 4-tert-butylbenzyl mercaptan, a more reactive source of sulfide that enables shell growth below the temperature where ion diffusion in the QD can broaden its optical spectrum (≤275 °C). These optimized procedures provide gram quantities of blue-green emitting QDs (PLQY = 85–99%) in a single reaction vessel. A solid state lighting device (4260 K) that incorporates cyan emissive QDs achieved a higher luminous efficacy of 179 lm/W and melanopic daylight efficiency ratio (0.71) than existing commercial human centric lighting devices.

Jordan, Abraham J↗

Elucidating the Role of Hydrogen Bonding in the Optical Spectroscopy of the Solvated Green Fluorescent Protein Chromophore: Using Machine Learning to Establish the Importance of High-Level Electronic Structure

Hydrogen bonding interactions with chromophores in chemical and biological environments play a key role in determining their electronic absorption and relaxation processes, which are manifested in their linear and multidimensional optical spectra. For chromophores in the condensed phase, the large number of atoms needed to simulate the environment has traditionally prohibited the use of high-level excited-state electronic structure methods. By leveraging transfer learning, we show how to construct machine-learned models to accurately predict the high-level excitation energies of a chromophore in solution from only 400 high-level calculations. Here, we show that when the electronic excitations of the green fluorescent protein chromophore in water are treated using EOM-CCSD embedded in a DFT description of the solvent the optical spectrum is correctly captured and that this improvement arises from correctly treating the coupling of the electronic transition to electric fields, which leads to a larger response upon hydrogen bonding between the chromophore and water.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Optimization of Thermal Conductance at Interfaces Using Machine Learning Algorithms

We report optimization of thermal transport across the interface of two different materials is critical to micro-/nanoscale electronic, photonic, and phononic devices. Although several examples of compositional intermixing at the interfaces having a positive effect on interfacial thermal conductance (ITC) have been reported, an optimum arrangement has not yet been determined because of the large number of potential atomic configurations and the significant computational cost of evaluation. On the other hand, computation-driven materials design efforts are rising in popularity and importance. Yet, the scalability and transferability of machine learning models remain as challenges in creating a complete pipeline for the simulation and analysis of large molecular systems. In this work we present a scalable Bayesian optimization framework, which leverages dynamic spawning of jobs through the Message Passing Interface (MPI) to run multiple parallel molecular dynamics simulations within a parent MPI job to optimize heat transfer at the silicon and aluminum (Si/Al) interface. We found a maximum of 50% increase in the ITC when introducing a two-layer intermixed region that consists of a higher percentage of Si. Because of the random nature of the intermixing, the magnitude of increase in the ITC varies. We observed that both homogeneity/heterogeneity of the intermixing and the intrinsic stochastic nature of molecular dynamics simulations account for the variance in ITC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Elucidating Primary Degradation Mechanisms in High-Cycling-Capacity, Compositionally Tunable High-Entropy Hydrides

The hydrogen sorption properties of single-phase bcc (TiVNb) 100–x Cr x alloys (x = 0–35) are reported. All alloys absorb hydrogen quickly at 25 °C, forming fcc hydrides with storage capacity depending on the Cr content. Here, a thermodynamic destabilization of the fcc hydride is observed with increasing Cr concentration, which agrees well with previous compositional machine learning models for metal hydride thermodynamics. The steric effect or repulsive interactions between Cr–H might be responsible for this behavior. The cycling performances of the TiVNbCr alloy show an initial decrease in capacity, which cannot be explained by a structural change. Pair distribution function analysis of the total X-ray scattering on the first and last cycled hydrides demonstrated an average random fcc structure without lattice distortion at short-range order. If the as-cast alloy contains a very low density of defects, the first hydrogen absorption introduces dislocations and vacancies that cumulate into small vacancy clusters, as revealed by positron annihilation spectroscopy. Finally, the main reason for the capacity drop seems to be due to dislocations formed during cycling, while the presence of vacancy clusters might be related to the lattice relaxation. Having identified the major contribution to the capacity loss, compositional modifications to the TiVNbCr system can now be explored that minimize defect formation and maximize material cycling performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computational Investigation of a CO 2 Conversion Strategy via Diels–Alder Reaction in a Carbon Capture Solvent

Molecular-level insights into reactive separations are crucial for the design of new conversion pathways of carbon dioxide (CO 2 ). This work explores a postulated pathway that directs CO 2 to undergo inverse-electron-demand Diels–Alder reactions to produce heterocycles using the CO 2 chemically fixed on water-lean solvent molecules. Density functional theory calculations are applied to evaluate the lowest unoccupied molecular orbital (LUMO) energies of three types of reactants (1,3-butadiene, 1,3-cyclohexadiene, and 1,2,4,5-tetrazine) with various functional substituents. These calculations also provide a data set (5.8k data) for developing a machine learning model to efficiently predict LUMO energies. A computational screening of LUMO energies for an additional 47k diene and tetrazine candidates is performed, and a list of candidates with lowered LUMO energies by electron-withdrawing substituents is provided. These candidates are further examined by their reaction energy barriers computed from the interatomic potential or density functional theory. Two major energy barriers are identified, one for the proton transfer within the water-lean solvent and the other for the CO 2 transfer from the solvent molecule to the reactant candidate (diene or tetrazine). The functional substituents have a more significant impact on the second barrier but a very slight one on the first barrier. This exploratory work demonstrates a new possibility for guiding experimental efforts toward the chemical conversion of fixated CO 2 to value-added compounds.

Chemical reactions↗

Machine-Learning-Assisted Synthesis of Polar Racemates

Racemates have recently received attention as nonlinear optical and piezoelectric materials. We report a machine-learning-assisted composition space approach was applied to synthesize the missing M = Ti, Zr members of the Δ,Λ-[Cu(bpy) 2 (H 2 O)] 2 [MF 6 ] 2·3 H 2 O (M = Ti, Zr, Hf; bpy = 2,2'-bipyridine) family (space group: Pna2 1 ). In each (CuO, MO 2 )/bpy/HF(aq) (M = Ti, Zr, Hf) system, the polar noncentrosymmetric racemate (M-NCS) forms in competition with a centrosymmetric one-dimensional chain compound (M-CS) based on alternating Cu(bpy)(H 2 O) 2 2+ and MF 6 2– basic building units (space groups: Ti-CS (Pnma), Zr-CS (P1̅), Hf-CS (P2/n)). Machine learning models were trained on reaction parameters to gain unbiased insight into the underlying statistical trends in each composition space. A human-interpretable decision tree shows that phase selection is driven primarily by the bpy:CuO molar ratio for reactions containing Zr or Hf, and predicts that formation of the Ti-NCS compound requires that the amount of HF present be decreased to raise the pH, which we verified experimentally. Predictive leave-one-metal-out (LOO) models further confirm that behavior in the Ti system is distinct from that of the Zr and Hf systems. The chemical origin of this distinction was probed via fluorine K-edge X-ray absorption spectroscopy. Pre-edge features in the F1s X-ray absorption spectra reveal the strong ligand-to-metal π bonding between Ti(3d – t 2g ) and F(2p) states that distinguishes the TiF 6 2– anion from the ZrF 6 2– and HfF 6 2– anions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accelerating Solvent Selection for Type II Porous Liquids

Type II porous liquids, comprising intrinsically porous molecules dissolved in a liquid solvent, potentially combine the adsorption properties of porous adsorbents with the handling advantages of liquids. Previously, discovery of appropriate solvents to make porous liquids had been limited to direct experimental tests. We demonstrate an efficient screening approach for this task that uses COSMO-RS calculations, predictions of solvent pK a values from a machine-learning model, and several other features and apply this approach to select solvents from a library of more than 11,000 compounds. Additionally, this method is shown to give qualitative agreement with experimental observations for two molecular cages, CC13 and TG-TFB-CHEDA, identifying solvents with higher solubility for these molecules than had previously been known. Ultimately, the algorithm streamlines the downselection of suitable solvents for porous organic cages to enable more rapid discovery of Type II porous liquids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SeismoGen: Seismic Waveform Synthesis Using GAN With Application to Seismic Data Augmentation

Abstract Detecting earthquake arrivals within seismic time series can be a challenging task. Visual, human detection has long been considered the gold standard but requires intensive manual labor that scales poorly to large data sets. In recent years, automatic detection methods based on machine learning have been developed to improve the accuracy and efficiency. However, the accuracy of those methods relies on access to a sufficient amount of high‐quality labeled training data, often tens of thousands of records or more. We aim to resolve this dilemma by answering two questions: (1) provided with a limited amount of reliable labeled data, can we use them to generate additional, realistic synthetic waveform data? and (2) can we use those synthetic data to further enrich the training set through data augmentation, thereby enhancing detection algorithms? To address these questions, we use a generative adversarial network (GAN), a type of machine learning model which has shown supreme capability in generating high‐quality synthetic samples in multiple domains. Once trained, our GAN model is capable of producing realistic seismic waveforms of multiple labels (noise and event classes). Applied to real Earth seismic data sets in Oklahoma, we show that data augmentation from our GAN‐generated synthetic waveforms can be used to improve earthquake detection algorithms in instances when only small amounts of labeled training data are available.

Wang, Tiantong↗

Climatology and Evolution of the Antarctic Peninsula Föhn Wind-Induced Melt Regime From 1979–2018

Warm and dry föhn winds on the Antarctic Peninsula (AP) cause surface melt that can destabilize vulnerable ice shelves. Topographic funneling of these downslope winds through mountain passes and canyons can produce localized wind-induced melt that is difficult to quantify without direct measurements. Our Föhn Detection Algorithm (FöhnDA) identifies the surface föhn signature that causes melt from measurement by 12 Automatic Weather Stations on the AP, that train a machine learning model to detect föhn in 5 km Regional Atmospheric Climate Model 2 (RACMO2.3p2) simulations and in the ERA5 reanalysis model. We estimate the fraction of AP surface melt attributed to föhn and possibly katabatic winds and identify the drivers of melt, temporal variability, and long-term trends and evolution from 1979–2018. We find that föhn wind-induced melt accounts for 3.1% of the total melt on the AP and can be as high at 18% close to the mountains where the winds funnel through mountain canyons. Föhn-induced surface melt does not significantly increase from 1979–2018, despite a warmer atmosphere and more positive Southern Annular Mode. However, a significant increase (+0.1 Gt y-1) and subsequent decrease/stabilization occur in 1979–1998 and 1999–2018, consistent with the AP warming and cooling trends during the same time periods. Föhn occurrence, more than föhn strength, drives the annual variability in föhn-induced melt. Long-term föhn-induced melt trends and evolution are attributable to seasonal changes in föhn occurrence, with increased occurrence in summer, and decreased occurrence in fall, winter, and early spring over the past 20 years.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

PM 2.5 Is Insufficient to Explain Personal PAH Exposure

To understand how chemical exposure can impact health, researchers need tools that capture the complexities of personal chemical exposure. In practice, fine particulate matter (PM 2.5 ) air quality index (AQI) data from outdoor stationary monitors and Hazard Mapping System (HMS) smoke density data from satellites are often used as proxies for personal chemical exposure, but do not capture total chemical exposure. Silicone wristbands can quantify more individualized exposure data than stationary air monitors or smoke satellites. However, it is not understood how these proxy measurements compare to chemical data measured from wristbands. In this study, participants wore daily wristbands, carried a phone that recorded locations, and answered daily questionnaires for a 7-day period in multiple seasons. We gathered publicly available daily PM 2.5 AQI data and HMS data. We analyzed wristbands for 94 organic chemicals, including 53 polycyclic aromatic hydrocarbons. Wristband chemical detections and concentrations, behavioral variables (e.g., time spent indoors), and environmental conditions (e.g., PM 2.5 AQI) significantly differed between seasons. Machine learning models were fit to predict personal chemical exposure using PM 2.5 AQI only, HMS only, and a multivariate feature set including PM 2.5 AQI, HMS, and other environmental and behavioral information. On average, the multivariate models increased predictive accuracy by approximately 70% compared to either the AQI model or the HMS model for all chemicals modeled. This study provides evidence that PM 2.5 AQI data alone or HMS data alone is insufficient to explain personal chemical exposures. Our results identify additional key predictors of personal chemical exposure.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Distributed Acoustic Sensing to Estimate the Permeability

Optical fiber in a borehole can be interrogated with distributed acoustic sensors (DAS) to capture fracture displacements with the potential to map surrounding fracture networks. We designed a laboratory experiment to test the capability of DAS to determine borehole flow characteristics, and we show that for the first time DAS can be used to remotely estimate permeability. Optical fiber was wrapped around a bead filled pipe and the pressure drop and flow velocity were measured to directly calculate permeability. A machine learning model using statistical features from continuous DAS estimated the bulk permeability. Fluid interactions with the permeable material demonstrate insufficient resolution using DAS amplitude-based measurements for estimating pressure drop to infer permeability. Variations in the spectral domain relate DAS measurements to the pressure drop and provide consistent permeability estimates. Resolution with DAS is sufficient to estimate permeability and provides a reliable method to monitor at depth in borehole conditions.

58 GEOSCIENCES↗

Learning grain boundary segregation energy spectra in polycrystals

The segregation of solute atoms at grain boundaries (GBs) can profoundly impact the structural properties of metallic alloys, and induce effects that range from strengthening to embrittlement. And, though known to be anisotropic, there is a limited understanding of the variation of solute segregation tendencies across the full, multidimensional GB space, which is critically important in polycrystals where much of that space is represented. Here we develop a machine learning framework that can accurately predict the segregation tendency—quantified by the segregation enthalpy spectrum—of solute atoms at GB sites in polycrystals, based solely on the undecorated (pre-segregation) local atomic environment of such sites. We proceed to use the learning framework to scan across the alloy space, and build an extensive database of segregation energy spectra for more than 250 metal-based binary alloys. The resulting machine learning models and segregation database are key to unlocking the full potential of GB segregation as an alloy design tool, and enable the design of microstructures that maximize the useful impacts of segregation.

36 MATERIALS SCIENCE↗

Machine learned features from density of states for accurate adsorption energy prediction

Materials databases generated by high-throughput computational screening, typically using density functional theory (DFT), have become valuable resources for discovering new heterogeneous catalysts, though the computational cost associated with generating them presents a crucial roadblock. Hence there is a significant demand for developing descriptors or features, in lieu of DFT, to accurately predict catalytic properties, such as adsorption energies. Here, we demonstrate an approach to predict energies using a convolutional neural network-based machine learning model to automatically obtain key features from the electronic density of states (DOS). The model, DOSnet, is evaluated for a diverse set of adsorbates and surfaces, yielding a mean absolute error on the order of 0.1 eV. In addition, DOSnet can provide physically meaningful predictions and insights by predicting responses to external perturbations to the electronic structure without additional DFT calculations, paving the way for the accelerated discovery of materials and catalysts by exploration of the electronic space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predicting fault slip via transfer learning

Abstract Data-driven machine-learning for predicting instantaneous and future fault-slip in laboratory experiments has recently progressed markedly, primarily due to large training data sets. In Earth however, earthquake interevent times range from 10’s-100’s of years and geophysical data typically exist for only a portion of an earthquake cycle. Sparse data presents a serious challenge to training machine learning models for predicting fault slip in Earth. Here we describe a transfer learning approach using numerical simulations to train a convolutional encoder-decoder that predicts fault-slip behavior in laboratory experiments. The model learns a mapping between acoustic emission and fault friction histories from numerical simulations, and generalizes to produce accurate predictions of laboratory fault friction. Notably, the predictions improve by further training the model latent space using only a portion of data from a single laboratory earthquake-cycle. The transfer learning results elucidate the potential of using models trained on numerical simulations and fine-tuned with small geophysical data sets for potential applications to faults in Earth.

58 GEOSCIENCES↗

Generalization in quantum machine learning from few training data

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as $\sqrt{T/N}$. When only K$\ll$T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $\sqrt{K/N}$. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

97 MATHEMATICS AND COMPUTING↗

Anomalous lattice thermal conductivity increase with temperature in cubic GeTe correlated with strengthening of second-nearest neighbor bonds

Understanding thermal transport mechanisms in phase change materials is critical to elucidating the microscopic picture of phase transitions and advancing thermal energy conversion and storage. Experiments consistently show that cubic phase germanium telluride (GeTe) has an unexpected increase in lattice thermal conductivity with rising temperature. Despite its ubiquity, resolving its origin has remained elusive. In this work, we carry out temperature-dependent lattice thermal conductivity calculations for cubic GeTe through efficient, high-order machine-learned models and additional corrections for coherence effects. We corroborate the calculated phonon properties with our inelastic X-ray scattering measurements. Our calculated lattice thermal conductivity values agree well with experiments and show a similar increasing trend. Through additional bonding strength calculations, we propose that a major contributor to the increasing lattice thermal conductivity is the strengthening of second-nearest neighbor interactions. The findings herein serve to deepen our understanding of thermal transport in phase-change materials.

36 MATERIALS SCIENCE↗

Generative adversarial networks (GAN) based efficient sampling of chemical composition space for inverse design of inorganic materials

A major challenge in materials design is how to efficiently search the vast chemical design space to find the materials with desired properties. One effective strategy is to develop sampling algorithms that can exploit both explicit chemical knowledge and implicit composition rules embodied in the large materials database. Here, we propose a generative machine learning model (MatGAN) based on a generative adversarial network (GAN) for efficient generation of new hypothetical inorganic materials. Trained with materials from the ICSD database, our GAN model can generate hypothetical materials not existing in the training dataset, reaching a novelty of 92.53% when generating 2 million samples. The percentage of chemically valid (charge-neutral and electronegativity-balanced) samples out of all generated ones reaches 84.5% when generated by our GAN trained with such samples screened from ICSD, even though no such chemical rules are explicitly enforced in our GAN model, indicating its capability to learn implicit chemical composition rules to form compounds. Our algorithm is expected to be used to greatly expand the range of the design space for inverse design and large-scale computational screening of inorganic materials.

36 MATERIALS SCIENCE↗