SEARCH · Engineering Papers
Results for “structured machine learning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
An Ecosystem for Digital Reticular Chemistry
Not Available
Inorganic synthesis-structure maps in zeolites with machine learning and crystallographic distances
Crystallographic representations and machine learning predict inorganic synthesis conditions for arbitrary zeolites, as validated with literature-mined data.
Molecular-Level Exploration of the Structure-Function Relations Underlying Interfacial Charge Transfer in the Subphthalocyanine/C 60 Organic Photovoltaic System
The arrangement of organic molecules at the donor-acceptor interface in an organic photovoltaic (OPV) cell can have a strong effect on the generation of charge carriers and thereby cell performance. In this paper, we report the molecular-level exploration of the ensemble of interfacial donor-acceptor pair geometries and the charge-transfer (CT) rates to which they give rise. Our approach combines molecular-dynamics simulations, electronic structure calculations, machine learning, and rate theory. This approach is applied to the boron subphthalocyanine chloride (donor) and C 60 (acceptor) OPV system. In this work we find that the interface is dominated by a previously unreported donor-acceptor pair edge geometry, which contributes significantly to device performance in a manner that depends on the initial conditions. Quantitative relations between the morphology and CT rates are established, which can be used to advance the design of more efficient OPV devices.
Magnetic borophenes from an evolutionary search
A computational methodology based on ab initio evolutionary algorithms and spin-polarized density functional theory was developed to predict two-dimensional magnetic materials. Its application to a model system borophene reveals an unexpected rich magnetism and polymorphism. A metastable borophene with nonzero thickness is an antiferromagnetic semiconductor from first-principles calculations, and can be further tuned into a half-metal by finite electron doping. In this borophene, the buckling and coupling among three atomic layers are not only responsible for magnetism, but also result in an out-of-plane negative Poisson's ratio under uniaxial tension, making it the first elemental material possessing auxetic and magnetic properties simultaneously.
Scaling Laws of Graph Neural Networks for Atomistic Materials Modeling
Atomistic materials modeling is a critical task with wide-ranging applications, from drug discovery to materials science, where accurate predictions of the target material property can lead to significant advancements in scientific discovery. Graph Neural Networks (GNNs) represent the state-of-the-art approach for modeling atomistic material data thanks to their capacity to capture complex relational structures. While machine learning performance has historically improved with larger models and datasets, GNNs for atomistic materials modeling remain relatively small compared to large language models (LLMs), which leverage billions of parameters and terabyte-scale datasets to achieve remarkable performance in their respective domains. To address this gap, we explore the scaling limits of GNNs for atomistic materials modeling by developing a foundational model with billions of parameters, trained on extensive datasets in terabytescale. Our approach incorporates techniques from LLM libraries to efficiently manage large-scale data and models, enabling both effective training and deployment of these large-scale GNN models. This work addresses three fundamental questions in scaling GNNs: the potential for scaling GNN model architectures, the effect of dataset size on model accuracy, and the applicability of LLM-inspired techniques to GNN architectures. Specifically, the outcomes of this study include (1) insights into the scaling laws for GNNs, highlighting the relationship between model size, dataset volume, and accuracy, (2) a foundational GNN model optimized for atomistic materials modeling, and (3) a GNN codebase enhanced with advanced LLM-based training techniques. Our findings lay the groundwork for large-scale GNNs with billions of parameters and terabyte-scale datasets, establishing a scalable pathway for future advancements in atomistic materials modeling.
Constraining the Multiscale Structure of Geophysical Fields in Machine Learning: The Case of Precipitation
The use of deep-learning algorithms for estimating the value of geophysical variables from remotely sensed information is rapidly expanding. The typical objective function minimized in such algorithms is the mean square error (MSE), which is known to lead to smooth estimates with compressed dynamical range as compared to the true distribution of the variable of interest. Here, we introduce and evaluate alternative objective functions, focusing on the retrieval of precipitation rates from satellite passive microwave radiometric measurements using a deep convolutional neural network. For this testbed application, the results show that explicitly imposing the preservation of the statistical distribution and spatial wavelet power spectrum of the target variable allows to accurately reproduce extreme values and sharp gradients across multiple scales in this study.
Predicting Atmospheric Structure for Infrasound Propagation Using Machine Learning.
Abstract not provided.
Predicting Atmospheric Structure for Infrasound Propagation Using Machine Learning.
Abstract not provided.
Atomistic structure generation and inverse machine-learning for materials from LAMMPS
Invited talk for the telluride science and research center workshop on “Machine Learning and Informatics for Chemistry and Materials”.
Computing Nonlinear Power Spectra Across Dynamical Dark Energy Model Space with Neural ODEs
I show how to compute the nonlinear power spectrum across the entire $w(z)$ dynamical dark energy model space. Using synthetic ΛCDM data, I train a neural ordinary differential equation (ODE) to infer the evolution of the nonlinear matter power spectrum as a function of the background expansion and mean matter density across ∼9 Gyr of cosmic evolution. After training, the model generalises to any dynamical dark energy model parameterised by $w(z)$. With little optimisation, the neural ODE is accurate to within 4% up to $k = 5\, h\, {\mathrm Mpc}^{−1}$. Unlike simulation rescaling methods, neural ODEs naturally extend to summary statistics beyond the power spectrum that are sensitive to the growth history.
Conditional random fields for pattern recognition applied to structured data
Pattern recognition uses measurements from an input domain, X, to predict their labels from an output domain, Y. Image analysis is one setting where one might want to infer whether a pixel patch contains an object that is “manmade” (such as a building) or “natural” (such as a tree). Suppose the label for a pixel patch is “manmade”; if the label for a nearby pixel patch is then more likely to be “manmade” there is structure in the output domain that can be exploited to improve pattern recognition performance. Modeling P(X) is difficult because features between parts of the model are often correlated. Therefore, conditional random fields (CRFs) model structured data using the conditional distribution P(Y|X = x), without specifying a model for P(X), and are well suited for applications with dependent features. This paper has two parts. First, we overview CRFs and their application to pattern recognition in structured problems. Our primary examples are image analysis applications in which there is dependence among samples (pixel patches) in the output domain. Second, we identify research topics and present numerical examples.
Phenotyping Alfalfa (Medicago sativa L.) Root Structure Architecture via Integrating Confident Machine Learning with ResNet-18
Not Available
Predicting Atmospheric Structure for Infrasound Propagation Using Machine Learning.
Abstract not provided.
Revealing the Formation Energy–Exfoliation Energy–Structure Correlation of MAB Phases Using Machine Learning and DFT
MAB phases are popular as high-temperature materials with high damage tolerance and excellent electrical conductivity that are used to exfoliate two-dimensional (2D) transition metal borides (MBenes); a promising material for developing next- generation nanodevices. In this report, we explore the correlation between the formation energy, exfoliation energy and structural factors of MAB phases using DFT and machine learning. In order to do so, we developed three different machine learning models based on the support vector machine, deep neural network, and random forest regressor to study the stability of the MAB phases by calculating their formation energies. Furthermore, our support vector machine and deep neural network models are capable of predicting the formation energies with mean absolute errors less than 0.1 eV/atom. We demonstrated that the stability of a MAB phase for a given transition metal decreases when the A element changes from Al to Tl. The density functional theory (DFT) re- vealed that M-A and M-B bond strength strongly correlates with the stability of MAB phases. In addition, the exfoliation possibility of 2D MBenes becomes higher when the A element changes from Al to Tl due to weakening of M-A and M-B bonds.
Exploring Structure-Sensitive Relations for Small Species Adsorption Using Machine Learning
Accurate prediction of adsorption energies on heterogeneous catalyst surfaces is crucial to predicting reactivity and screening materials. Adsorption linear scaling relations have been developed extensively but often lack accuracy and apply to one adsorbate and a single binding site type at a time. These facts undermine their ability to predict structure sensitivity and optimal catalyst structure. Using machine learning on nearly 300 density functional theory calculations, we demonstrate that generalized coordination number scaling relations hold well for oxygen- and high-valency carbon-binding species but fail for others. Here we reveal that the valency and the electronic coupling of a species with the surface, along with the site type and its coordination environment, are critical for small species adsorption. The model simultaneously predicts the adsorption energy and preferred site and significantly outperforms linear scalings in accuracy. It can expose the structure sensitivity of chemical reactions and enable enhanced catalyst activity via engineering particle shape and facet defects. The generality of our methodology is validated by training the model with transition metal data and transferring it to predict adsorption energies on single-atom alloys.
Benchmarking Coordination Number Prediction Algorithms on Inorganic Crystal Structures
Coordination numbers and geometries form a theoretical framework for understanding and predicting materials properties. Algorithms to determine coordination numbers automatically are increasingly used for machine learning and automatic structural analysis. In this work, we introduce MaterialsCoord, a benchmark suite containing 56 experimentally-derived crystal structures (spanning elements, binaries, and ternary compounds) and their corresponding coordination environments as described in the research literature. We also describe CrystalNN, a novel algorithm for determining near neighbors. We compare CrystalNN against 7 existing near-neighbor algorithms on the MaterialsCoord benchmark, finding CrystalNN to perform similarly to several well-established algorithms. For each algorithm, we also assess computational demand and sensitivity towards small perturbations that mimic thermal motion. Finally, we investigate the similarity between bonding algorithms when applied to the Materials Project database. Finally, we expect that this work will aid the development of coordination prediction algorithms as well as improve structural descriptors for machine learning and other applications.
Machine learning-accelerated discovery of iron cobalt phosphides as rare-earth-free magnets
Here, the discovery of rare-earth-free permanent magnets has been a goal of scientists for decades. The absence of rare-earth elements will alleviate a pressing concern about the availability of rare-earth elements used in permanent magnets. These magnets are crucial for applications such as wind turbines, electric cars, and memory devices. Rare-earth magnets are special owing to a large magnetic anisotropy energy (K 1 ). In contrast, iron cobalt phosphides hold promise since doping P into cubic FeCo can induce anisotropy, leading to a large coercivity, without introducing rare-earth elements. We present a comprehensive search over the Fe-Co-P ternary space for magnets, utilizing recently developed adaptive machine learning feedback to efficiently screen over 850 000 structures. We focus on machine learning acceleration as a paradigm for materials design. Further adaptive genetic algorithm searches and first-principles calculations aid in the identification of 16 new structures below the known convex hull. Five of them possess high magnetic polarization (J s > 1 T). The structures with desirable magnetic properties center on (Fe,Co) 2 P. This supports conventional wisdom, which focuses on the mixture of the two known end compounds: Fe 2 P and Co 2 P. Our work provides guidance for synthesis. We find Fe 7 CoP 4 shows the most promise (J s = 1.03T and K 1 = 0.83MJ/m 3 ).