Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Sampling-based Sublinear Low-rank Matrix Arithmetic Framework for Dequantizing Quantum Machine Learning

We present an algorithmic framework for quantum-inspired classical algorithms on close-to-low-rank matrices, generalizing the series of results started by Tang’s breakthrough quantum-inspired algorithm for recommendation systems [STOC’19]. Motivated by quantum linear algebra algorithms and the quantum singular value transformation (SVT) framework of Gilyén et al. [STOC’19], we develop classical algorithms for SVT that run in time independent of input dimension, under suitable quantum-inspired sampling assumptions. Our results give compelling evidence that in the corresponding QRAM data structure input model, quantum SVT does not yield exponential quantum speedups. Since the quantum SVT framework generalizes essentially all known techniques for quantum linear algebra, our results, combined with sampling lemmas from previous work, suffice to generalize all prior results about dequantizing quantum machine learning algorithms. In particular, our classical SVT framework recovers and often improves the dequantization results on recommendation systems, principal component analysis, supervised clustering, support vector machines, low-rank regression, and semidefinite program solving. We also give additional dequantization results on low-rank Hamiltonian simulation and discriminant analysis. Our improvements come from identifying the key feature of the quantum-inspired input model that is at the core of all prior quantum-inspired results: ℓ 2 -norm sampling can approximate matrix products in time independent of their dimension. We reduce all our main results to this fact, making our exposition concise, self-contained, and intuitive.

Computer Science↗
DOE OSTI2013

High-performance dynamic quantum clustering on graphics processors

Clustering methods in machine learning may benefit from borrowing metaphors from physics. Dynamic quantum clustering associates a Gaussian wave packet with the multidimensional data points and regards them as eigenfunctions of the Schroedinger equation. The clustering structure emerges by letting the system evolve and the visual nature of the algorithm has been shown to be useful in a range of applications. Furthermore, the method only uses matrix operations, which readily lend themselves to parallelization. In this paper, we develop an implementation on graphics hardware and investigate how this approach can accelerate the computations. We achieve a speedup of up to two magnitudes over a multicore CPU implementation, which proves that quantum-like methods and acceleration by graphics processing units have a great relevance to machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Chemical classification program synthesis using generative artificial intelligence

Accurately classifying chemical structures is essential for cheminformatics and bioinformatics, including tasks such as identifying bioactive compounds of interest, screening molecules for toxicity to humans, finding non-organic compounds with desirable material properties, or organizing large chemical libraries for drug discovery or environmental monitoring. However, manual classification is labor-intensive and difficult to scale to large chemical databases. Existing automated approaches either rely on manually constructed classification rules, or are deep learning methods that lack explainability. This work presents an approach that uses generative artificial intelligence to automatically write chemical classifier programs for classes in the Chemical Entities of Biological Interest (ChEBI) database. These programs can be used for efficient deterministic run-time classification of SMILES structures, with natural language explanations. The programs themselves constitute an explainable computable ontological model of chemical class nomenclature, which we call the ChEBI Chemical Class Program Ontology (C3PO). We validated our approach against the ChEBI database, and compared our results against deep learning models and a naive SMARTS pattern based classifier. C3PO outperforms the naive classifier, but does not reach the performance of state of the art deep learning methods. However, C3PO has a number of strengths that complement deep learning methods, including explainability and reduced data dependence. C3PO can be used alongside deep learning classifiers to provide an explanation of the classification, where both methods agree. The programs can be used as part of the ontology development process, and iteratively refined by expert human curators.

Artificial Intelligence↗
DOE OSTI2020

Predicting boron coordination in multicomponent borate and borosilicate glasses using analytical models and machine learning

Accurate prediction of boron coordination in multicomponent glasses is critical in glass science and technology as it strongly affects the properties of borate and borosilicate glasses. We have collected a dataset containing 657 glasses from literature with boron coordination values and developed models using analytical functions based on the well accepted Dell, Xiao and Bray model. Good prediction of boron coordination with a R 2 value higher than 0.8 was obtained. The large variation of boron coordination from experiments, originated from sample preparations and characterizations, led to difficulties in obtaining models with better prediction performance. Various machine learning (ML) algorithms were evaluated and slightly better prediction performance was observed; however, interpretation of the ML models is less straight forward. In conclusion, this study developed various models capable of providing quantitative boron coordination predictions, providing insights into its structural roles in multi-component glasses, and suggesting fruitful areas for future research.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Origin of enhanced performance when Mn-rich rocksalt cathodes transform to δ -DRX

Most Mn-rich cathodes are known to undergo phase transformation into structures resembling spinel-like ordering upon electrochemical cycling. Recently, the irreversible transformation of Ti-containing Mn-rich disordered rock-salt cathodes into a phase — named δ — with nanoscale spinel-like domains has been shown to increase energy density, capacity retention, and rate capability. However, the nature of the boundaries between domains and their relationship with composition and electrochemistry are not well understood. In this work, we discuss how the transformation into the multi-domain structure results in eight variants of Spinel domains, which is crucial for explaining the nanoscale domain formation in the δ -phase. We study the energetics of crystallographically unique boundaries and the possibility of Li-percolation across them with a fine-tuned CHGNet machine learning interatomic potential. Energetics of 16 d vacancies reveal a strong affinity to segregate to the boundaries, thereby opening Li-pathways at the boundary to enhance long-range Li-percolation in the δ structure. Defect calculations of the relatively low-mobility Ti show how it can influence the extent of Spinel ordering, domain morphology and size significantly; leading to guidelines for engineering electrochemical performance through changes in composition.

Anand, Shashwat↗
DOE OSTI2025

Transferable dispersion-aware machine learning interatomic potentials for multilayer transition metal dichalcogenide heterostructures

Stacking atomically thin transition metal dichalcogenides (TMDs) into heterostructures enables exploration of exotic quantum phases, particularly through twist-angle-controlled moiré superlattices. These structures exhibit novel electronic and optical behaviors driven by atomic-scale structural reconstruction. However, studying such systems with DFT is computationally demanding due to their large unit cells and van der Waals (vdW) interactions between layers. To address this, we develop a transferable neural network potential (NNP) that includes long-range vdW corrections up to 12Å with minimal overhead. Trained on vdW-corrected DFT data for Mo- and W-based TMDs with S, Se, and Te, the NNP accurately models monolayers, bilayers, heterostructures, and their interaction with h-BN substrates. It reproduces equilibrium structures, energy landscapes, phonon dispersions, and matches experimental atomic reconstructions in twisted WS2 and MoS2/WSe2 systems. We demonstrate that our NNP achieves DFT-level accuracy and high computational efficiency, enabling large-scale simulations of TMD-based moiré superlattices both with and without substrates.

materials for energy and catalysis↗
DOE OSTI2021

Machine Learning-enabled Scalable Performance Prediction of Scientific Codes

Hardware architectures become increasingly complex as the compute capabilities grow to exascale. Here, we present the Analytical Memory Model with Pipelines (AMMP) of the Performance Prediction Toolkit (PPT). PPT-AMMP takes high-level source code and hardware architecture parameters as input and predicts runtime of that code on the target hardware platform, which is defined in the input parameters. PPT-AMMP transforms the code to an (architecture-independent) intermediate representation, then (i) analyzes the basic block structure of the code, (ii) processes architecture-independent virtual memory access patterns that it uses to build memory reuse distance distribution models for each basic block, and (iii) runs detailed basic-block level simulations to determine hardware pipeline usage. PPT-AMMP uses machine learning and regression techniques to build the prediction models based on small instances of the input code, then integrates into a higher-order discrete-event simulation model of PPT running on Simian PDES engine. We validate PPT-AMMP on four standard computational physics benchmarks and present a use case of hardware parameter sensitivity analysis to identify bottleneck hardware resources on different code inputs. We further extend PPT-AMMP to predict the performance of a scientific application code, namely, the radiation transport mini-app SNAP. To this end, we analyze multi-variate regression models that accurately predict the reuse profiles and the basic block counts. We validate predicted SNAP runtimes against actual measured times.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Genarris: Random generation of molecular crystal structures and fast screening with a Harris approximation

Herein, we present Genarris, a Python package that performs configuration space screening for molecular crystals of rigid molecules by random sampling with physical constraints. For fast energy evaluations, Genarris employs a Harris approximation, whereby the total density of a molecular crystal is constructed via superposition of single molecule densities. Dispersion-inclusive density functional theory is then used for the Harris density without performing a self-consistency cycle. Genarris uses machine learning for clustering, based on a relative coordinate descriptor developed specifically for molecular crystals, which is shown to be robust in identifying packing motif similarity. In addition to random structure generation, Genarris offers three workflows based on different sequences of successive clustering and selection steps: the "Rigorous" workflow is an exhaustive exploration of the potential energy landscape, the "Energy" workflow produces a set of low energy structures, and the "Diverse" workflow produces a maximally diverse set of structures. The latter is recommended for generating initial populations for genetic algorithms. Here, the implementation of Genarris is reported and its application is demonstrated for three test cases. Published by AIP Publishing.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2019

Pore system characterization of organic-rich shales using nanoscale-resolution 3D imaging

The Vaca Muerta Shale in Argentina is the first signifcant commercial shale oil/gas play outside of North America. High-resolution 2D/3D imaging of shale rocks for the purpose of establishing their mineralogy, total, and connected porosities has become more and more sophisticated. In this paper, nanoscale-resolution focused ion beam (FIB)-scanning electron microscopy (SEM) nano-tomography was used to obtain images of pore structures within two organic-rich regions of interest (ROIs), selected based on correlative SEM and automated mineralogy maps. Advanced machine learning classification tools were used to segment the images and assign porosities and other components. Pore size distribution and pore connectivity analyzes revealed that about 95% of all the pores, present within the two ROIs, had a diameter of less than approximately 75 nm, and that most of these pores were poorly connected. In a similar fashion, the flow rate distribution analysis showed that pores with diameters of about 150-330 nm contributed to over 50% of the flow capacity of the connected pore systems. These results suggest that although most of the pores typically found in shales have pore diameter smaller than about 100 nm, most of the hydrocarbon production may be carried by a relatively small number of larger connected pores with pore diameter greater than about 150 nm. This research implies that a large portion of the organic-hosted pores (with diameter typically smaller than about 100 nm) may not provide permeable flow pathways for the oil and/or gas migration, and hence may have very little contribution to the hydrocarbon production.

58 GEOSCIENCES↗
DOE OSTI2021

Inter-well connectivity detection in CO 2 WAG projects using statistical recurrent unit models

Routine well-wise injection and production measurements contain significant information on subsurface structure and properties. Data-driven technology that interprets surface data into subsurface structure or properties can assist operators in making informed decisions by providing a better understanding of field assets. Our machine-learning framework is built on the statistical recurrent unit (SRU) model and interprets well-based injection/production data into inter-well connectivity without relying on a geologic model. We test it on synthetic and field-scale CO 2 EOR projects utilizing the water-alternating-gas (WAG) process. SRU is a special type of recurrent neural network (RNN) that allows for better characterization of temporal trends, by learning various statistics of the input at different time scales. In our application, the complete states (injection rate, pressure and cumulative injection) at injectors and pressure states at producers are fed to SRU as the input and the phase rates at producers are treated as the output. Once the SRU is trained and validated, it is then used to assess the connectivity of each injector to any producer using permutation variable importance method, wherein inputs corresponding to an injector are shuffled and the increase in prediction error at a given producer is recorded as the importance (connectivity metric) of the injector to the producer. This method is tested in both synthetic and field-scale cases. The validation of the proposed data-driven inter-well connectivity assessment is performed using synthetic data from simulation models where inter-well connectivity can be easily measured using the streamline-based flux allocation. The SRU model is shown to offer excellent prediction performance on the synthetic case. Despite significant measurement noise and frequent well shut-ins imposed in the field-scale case, the SRU model offers good prediction accuracy, the overall relative error of the phase production rates at most producers ranges from 10% to 30%. It is shown that the dominant connections identified by the data-driven method and streamline method are in close agreement. This significantly improves confidence in our data-driven procedure. The novelty of this work is that it is purely data-driven method and can directly interpret routine surface measurements to intuitive subsurface knowledge. Furthermore, the streamline-based validation procedure provides physics-based backing to the results obtained from data analytics. This study results in a reliable and efficient data analytics framework that is well-suited for large field applications.

42 ENGINEERING↗
DOE OSTI2023

Mechanistic Insights into Copper(I) and Copper(II) Cation Exchange Reactions in CdSe Nanoplatelets

In this study, we investigated the synthesis of copper selenide nanoplatelets (NPLs) through a cation exchange reaction (CER) in 5-monolayer-thick CdSe NPLs using Cu(I) and Cu(II) precursors. We discovered that the exposure of CdSe NPLs to a Cu(I) precursor led to the transformation of NPLs into Cu 2-x Se while maintaining their nanoplatelet morphology. The replacement of Cd(II) with Cu(I) prevailed over the formation of doped structures. In the case of the Cu(II) precursor, we observed that Cu(II) was first reduced to Cu(I) before being intercalated into the host lattice, resulting in the synthesis of Cu 2-x Se, similar to CER with Cu(I) precursors but without preservation of the initial morphology of NPLs. Interestingly, the presence of oxygen was found to facilitate the cation exchange processes in CdSe NPLs, whereas a nitrogen atmosphere suppressed the CER. Further, despite the similar ionic sizes of Cu(I) and Cu(II), the substitution of Cd(II) with Cu(II) was found to be challenging, possibly due to the involvement of redox processes resulting in the significant deterioration of initial CdSe NPLs. We demonstrate that CER can achieve near-complete substitution of cadmium atoms with monovalent copper at room temperature. Understanding the processes involved in CERs is crucial for engineering more complex structures, such as high-entropy nanoparticles involving cation exchange with different oxidation states and development of material synthesis using machine learning and artificial intelligence approaches.

2D nanoplatelets↗
DOE OSTI2024

Artificial Intelligence for Conjugated Polymers

Conjugated polymers have garnered significant attention due to their diverse applications in electronics, photonics, and energy storage. However, realizing their full potential poses a formidable challenge, as their design has historically relied on iterative adjustments and continuous inspiration from researchers. Traditional methods often struggle to efficiently navigate their vast chemical landscape. In this work, the application of artificial intelligence (AI), specifically machine learning (ML), needs to be discussed in the realm of conjugated polymers. Our paper emphasizes the importance of understanding the structure–property relationships of these polymers and how ML can facilitate property prediction and inverse-design. We delve into various chemical fingerprints, structural descriptors, and ML algorithms, showcasing their utility across a spectrum of applications, including simulations, glass transition temperature determination, photovoltaics, reorganization energy for charge transport, photocatalysts, and sensors. Finally, we give some outlooks in this filed and propose unexplored areas within the field that hold the potential to benefit from ML techniques.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

A review of composite solid-state electrolytes for lithium batteries: fundamentals, key materials and advanced structures

All-solid-state lithium ion batteries (ASSLBs) are considered next-generation devices for energy storage due to their advantages in safety and potentially high energy density. As the key component in ASSLBs, solid-state electrolytes (SSEs) with non-flammability and good adaptability to lithium metal anodes have attracted extensive attention in recent years. Among the current SSEs, composite solid-state electrolytes (CSSEs) with multiple phases have greater flexibility to customize and combine the advantages of single-phase electrolytes, which have been widely investigated recently and regarded as promising candidates for commercial ASSLBs. Based on existing investigations, herein, we present a comprehensive overview of the recent developments in CSSEs. Initially, we introduce the historical development from solid-state ionic conductors to CSSEs, and then summarize the fundamentals including mechanisms of lithium ion transport, key evaluation parameters, design principles, and key materials. Finally, four main types of advanced structures for CSSEs are classified and highlighted according to the recent progress. Moreover, advanced characterization and computational simulation techniques including machine learning are reviewed for the first time, and the main challenges and perspectives of CSSEs are also provided for their future development.

25 ENERGY STORAGE↗
DOE OSTI2018

Hierarchical visualization of materials space with graph convolutional neural networks

The combination of high throughput computation and machine learning has led to a new paradigm in materials design by allowing for the direct screening of vast portions of structural, chemical, and property spaces. The use of these powerful techniques leads to the generation of enormous amounts of data, which in turn calls for new techniques to efficiently explore and visualize the materials space to help identify underlying patterns. In this work, we develop a unified framework to hierarchically visualize the compositional and structural similarities between materials in an arbitrary material space with representations learned from different layers of graph convolutional neural networks. We demonstrate the potential for such a visualization approach by showing that patterns emerge automatically that reflect similarities at different scales in three representative classes of materials: perovskites, elemental boron, and general inorganic crystals, covering material spaces of different compositions, structures, and both. For perovskites, elemental similarities are learned that reflects multiple aspects of atom properties. For elemental boron, structural motifs emerge automatically showing characteristic boron local environments. For inorganic crystals, the similarity and stability of local coordination environments are shown combining different center and neighbor atoms. The method could help transition to a data-centered exploration of materials space in automated materials design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Exploring solvation structure and transport behavior for rational design of advanced electrolytes for next generation of lithium batteries

The efficacy of electrolytes significantly affects battery performance, leading to the development of several strategies to enhance them. Despite this, the understanding of solvation structure remains inadequate. It is imperative to understand the structure–property–performance relationship of electrolytes using diverse techniques. Here, this review explores the recent advancements in electrolyte design strategies for high capacity, high-voltage, wide-temperature, fast-charging, and safe applications. To begin, the current state-of-the-art electrolyte design directions are comprehensively reviewed. Subsequently, advanced techniques and computational methods used to understand the solvation structure are discussed. Additionally, the importance of high-throughput screening and advanced computation of electrolytes with the help of machine learning is emphasized. Finally, future horizons for studying electrolytes are proposed, aimed at improving battery performance and promoting their application in various fields by enhancing the microscopic understanding of electrolytes.

25 ENERGY STORAGE↗
DOE OSTI2024

Identifying Outliers in AI-based Image Compression

Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.

Data Analysis↗