Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Physics informed machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Frequency Emitter Geolocation Using Signal Strength Fingerprinting Informed By 3D Propagation Modeling

This work focuses on the problem of RF geolocation in complex multipath environments. Using 3D electromagnetic propagation modeling to characterize environments of interest will enable more accurate RF geolocation. Specifically, a path-loss radio map can be generated in simulation for use in received signal strength indicators (RSSI) fingerprinting, or pattern matching. RSSI fingerprinting is an example of data-based method that takes site specific information into account which should allow for better performance than other model-based methods that use a generalized model of electromagnetic propagation. This modeling capability will also be used to evaluate the relative performance of RSSI fingerprinting, pathloss model based RSSI methods such as differential received signal strength circles (DRSS), RSSI joint gaussian estimation, and time-difference of arrival (TDOA). New methods using this simulation derived electromagnetic characterization could improve the efficacy of currently deployed and future RF spectral monitoring solutions. Wireless InSite developed by Remcom is used as the simulation tool of choice in this work. An indoor location is simulated with a grid of fixed receivers and a grid of transmit locations. Using the output of the Wireless InSite simulation the response from a given transmit location to a given receive location can be generated. During the first year of the project various geolocation methods evaluated on purely synthetic, but realistic, data. The second year focused on testing and validating the efficacy of simulation informed RF geolocation using two physical testbeds. This work has shown that data-based approaches are more accurate than model-based ones at the expensive of requiring measured or simulated site-specific training data.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Constrained or unconstrained? Neural-network-based equation discovery from data

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or the accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE (or the associated operator) by solving a constrained optimization problem and using an intermediate state representation similar to a physics-informed neural network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the discovered PDE is satisfied at a number of spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on several example problems demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. This work motivates further exploration into using sophisticated constrained optimization methods in scientific machine learning, as opposed to their commonly used, penalty-method or unconstrained counterparts. For both of these methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. Here, we briefly highlight how simultaneously fitting the data while discovering the PDE improves the robustness to noise and other small, yet crucial, implementation details.

Data-driven discovery↗
DOE OSTI2025

Unraveling fundamental mechanisms of silicon nitride crystallization in microelectronics manufacturing

This research project investigates the fundamental mechanisms of silicon nitride (SiN) crystallization, aiming to enhance the understanding of this critical material in microelectronics manufacturing. Through a collaborative effort between Sandia National Laboratories, the University of Tennessee, and the University of Florida, we developed a comprehensive framework that integrates experimental techniques, atomistic modeling, meso-scale simulations, and an integrated multi-scale model to capture this physical phenomenon on multiple time and length scales . The project developed a new machine learning based atomistic potential and utilized advanced phase field modeling to capture the complexities of polycrystalline growth and the influence of mechanical stresses on crystallization dynamics. By employing a grain tracker algorithm, the meso-scale model effectively identified and tracked individual crystal grains, enabling the simulation of anisotropic growth behaviors reflective of SiN’s physical properties. The integration of atomistic simulations with meso-scale modeling created a powerful multi-scale framework that validated atomistic inputs and enhanced predictive accuracy for crystallization dynamics at larger scales, validated experimentally. This adaptable modeling capability not only accelerates development times by informing manufacturing processes but also serves as a valuable starting point for understanding crystallization physics in similar materials. The insights gained from this research unlock new opportunities for the development of advanced materials tailored for future microelectronics and photonics applications. Overall, this project represents a significant advancement in understanding of fundamental physics of SiN and establishes a foundation for future research in material science, bridging the gap between atomic-level phenomena and macroscopic material behaviors for practical applications.

36 MATERIALS SCIENCE↗
DOE OSTI2022

SDSS-IV MaNGA: Unveiling Galaxy Interaction by Merger Stages with Machine Learning

We use machine-learning techniques to classify galaxy merger stages, which can unveil physical processes that drive the star formation and active galactic nucleus (AGN) activities during galaxy interaction. The sample contains 4690 galaxies from the integral field spectroscopy survey SDSS-IV MaNGA and can be separated into 1060 merging galaxies and 3630 nonmerging or unclassified galaxies. For the merger sample, there are 468, 125, 293, and 174 galaxies (1) in the incoming pair phase, (2) in the first pericentric passage phase, (3) approaching or just passing the apocenter, and (4) in the final coalescence phase or post-mergers. With the information of projected separation, line-of-sight velocity difference, Sloan Digital Sky Survey (SDSS) gri images, and MaNGA Hα velocity map, we are able to classify the mergers and their stages with good precision, which is the most important score to identify interacting galaxies. For the two-phase classification (binary; nonmerger and merger), the performance can be high (precision > 0.90) with LGBMClassifier . We find that sample size can be increased by rotation, so the five-phase classification (nonmerger, and merger stages 1, 2, 3, and 4) can also be good (precision > 0.85). The most important features come from SDSS gri images. The contribution from the MaNGA Hα velocity map, projected separation, and line-of-sight velocity difference can further improve the performance by 0%–20%. In other words, the image and the velocity information are sufficient to capture important features of galaxy interactions, and our results can apply to all the MaNGA data, as well as future all-sky surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Revolutionizing Energetic Materials Discovery and Design: The Role of Data Science and Machine Learning

Here this Special Issue of Propellants, Explosives, Pyrotechnics (PEP) is focused on energetic materials discovery and design using Data Science and Machine Learning (DS&ML). The application of DS&ML has proven to be transformative in many areas, where it has been shown to expedite analysis, enable extraction of greater quantities of information from datasets, and guide experiments. However, energetic materials and their applications present unique challenges that often hinder the use of standardized tools and practices. In spite of these challenges, important and compelling advancements are being made toward data-directed research in energetics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A physics-informed multi-agents model to predict thermo-oxidative/hydrolytic aging of elastomers

This paper introduces a novel physics-informed multi-agents constitutive model to propose prediction in quasi-static constitutive behavior of cross-linked elastomer and the loss of mechanical performance during environmental aging. The presented model is used to simulate the effect of single-mechanism chemical aging (i.e. thermal-inducedor hydrolytic aging) on the behavior of the material in this hybrid framework. Those environmental single-mechanism damages change the polymer matrix over time due to massive chain scission, chain formations, and changing the arrangement of molecules in the polymer matrix. Here we propose a data-driven super-constrained machine-learned engine to represent damage in the polymer matrix and capture the changes in material behavior, including its inelastic features such as Mullins effect and permanent set in the course of aging. We have simplified the 3D stress–strain tensor mapping problem into a small number of super-constrained 1D mapping problems by means of a sequential order reduction. An assembly of multiple replicated conditional neural-network learning-agents (L-agents) is trained to systematically simplify the high-dimensional mapping problem into multiple 1D problems, each represented by a different type of agent. Our hybrid framework is designed to capture the effect of deformation history, aging time, and aging temperature. The model is validated with respect to a comprehensive set of experiments specifically designed to benchmark model capabilities and also against available data in the literature. Thermodynamic consistency and frame independency have been verified. Besides acceptable predictive abilities, a significant reduction of computational cost to predict behavior at multiple states of deformation is the most significant feature of this model.

42 ENGINEERING↗
DOE OSTI2021

Towards data-driven constitutive modelling for granular materials via micromechanics-informed deep learning

The analytical description of path-dependent elastic-plastic responses of a granular system is highly complicated because of continuously evolving microstructures and strain localisation within the system undergoing deformation. This study offers an alternative to the current analytical paradigm by developing micromechanics-informed machine-learning based constitutive modelling approaches for granular materials. A set of critical variables associated with the constitutive behaviour of granular materials are identified through an incremental stress-strain relationship analysis. Depending on the strategy to exploit the priori micromechanical knowledge, three different training strategies are explored. The first model uses only the measurable external variables to make stress predictions; the second model utilises a directed graph to link all the external strain sequences and internal microstructural evolution variables into a single prediction model comprised of a series of sub-mappings, and the third model explicitly integrates the physically important non-temporal properties with external strain paths into training through an enhanced Gated Recurrent Unit (GRU). These three models show satisfactory agreement with unseen test specimens based on multi-directional loading cases. The basic features and potential applications of each model are explained. Lastly, the key factors for constitutive training and limitations of the current work are also discussed in detail.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2013

SIM_EXPLORE: Software for Directed Exploration of Complex Systems

Physics-based numerical simulation codes are widely used in science and engineering to model complex systems that would be infeasible to study otherwise. While such codes may provide the highest- fidelity representation of system behavior, they are often so slow to run that insight into the system is limited. Trying to understand the effects of inputs on outputs by conducting an exhaustive grid-based sweep over the input parameter space is simply too time-consuming. An alternative approach called "directed exploration" has been developed to harvest information from numerical simulators more efficiently. The basic idea is to employ active learning and supervised machine learning to choose cleverly at each step which simulation trials to run next based on the results of previous trials. SIM_EXPLORE is a new computer program that uses directed exploration to explore efficiently complex systems represented by numerical simulations. The software sequentially identifies and runs simulation trials that it believes will be most informative given the results of previous trials. The results of new trials are incorporated into the software's model of the system behavior. The updated model is then used to pick the next round of new trials. This process, implemented as a closed-loop system wrapped around existing simulation code, provides a means to improve the speed and efficiency with which a set of simulations can yield scientifically useful results. The software focuses on the case in which the feedback from the simulation trials is binary-valued, i.e., the learner is only informed of the success or failure of the simulation trial to produce a desired output. The software offers a number of choices for the supervised learning algorithm (the method used to model the system behavior given the results so far) and a number of choices for the active learning strategy (the method used to choose which new simulation trials to run given the current behavior model). The software also makes use of the LEGION distributed computing framework to leverage the power of a set of compute nodes. The approach has been demonstrated on a planetary science application in which numerical simulations are used to study the formation of asteroid families.

Burl, Michael↗
DOE OSTI2026

Toward an event-level analysis of hadron structure using differential programming

Reconstructing the internal properties of hadrons in terms of fundamental quark and gluon de- grees of freedom is a central goal in nuclear and particle physics. This effort lies at the core of major experimental programs, such as the Jefferson Lab 12 GeV program and the upcoming Electron-Ion Collider. A primary challenge is the inherent inverse problem: converting large-scale observational data from collision events into the fundamental QCD-defined densities that characterize the micro- scopic structure of hadronic systems. Recent advances in AI and machine learning have opened new avenues for addressing this challenge using deep learning techniques. A particularly promising direction is the integration of complex theoretical calculations and experimental simulations into a unified framework capable of reconstructing these densities directly from event-level information. In this document, we introduce a key algorithm called LOITS, which enables differentiable program- ming within such a framework, facilitating the use of AI/ML techniques to solve the inverse problem of QCF reconstruction at the event level.

Braga, Kevin [College of William and Mary, William↗
DOE OSTI2020

Pairing glue in cuprate superconductors from the self-energy revealed via machine learning

Recently, machine learning was applied to extract both the normal and the anomalous components of the self-energy from photoemission data at the antinodal points in Bi– based cuprate high-temperature superconductors. It was argued that both components do show prominent peaks near 50 meV, which hold information about the pairing glue, but the peaks are hidden in the actual data, which measure only the total self-energy. We analyze the self-energy within an effective fermion-boson theory. We show that soft thermal fluctuations give rise to peaks in both components of the self-energy at a frequency comparable to the superconducting gap, while they cancel in the total self-energy, all irrespective of the nature of the pairing boson. Furthermore, in the quantum limit T → 0 prominent peaks survive only for a very restricted subclass of pairing interactions. We argue that the way to potentially nail down the pairing boson is to determine the thermal evolution of the peaks.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Automated identification of dominant physical processes

The identification of processes that locally and approximately dominate dynamical system behavior has enabled significant advances in understanding and modeling nonlinear differential dynamical systems. Conventional methods of dominant process identification involve piecemeal and ad hoc (non-rigorous, informal) scaling analyses to identify dominant balances of governing equation terms and to delineate the spatiotemporal boundaries (boundaries in space and/or time) of each dominant balance. For the first time, we present an objective global measure of the fit of dominant balances to observations, which is desirable for automation, and was previously undefined. Furthermore, we propose a formal definition of the dominant balance identification problem in the form of an optimization problem. Here, we show that the optimization can be performed by various machine learning algorithms, enabling the automatic identification of dominant balances. Our method is algorithm agnostic and it eliminates reliance upon expert knowledge to identify dominant balances which are not known beforehand.

42 ENGINEERING↗
DOE OSTI2023

Multidisciplinary concurrent optimization framework for multi-phase building design process

Modern day building design projects require multidisciplinary expertise from architects and engineers across various phases of the design (conceptual, preliminary, and detailed) and construction processes. The Architecture Engineering and Construction (AEC) community has recently shifted gears toward leveraging design optimization techniques to make well-informed decisions in the design of buildings. However, most of the building design optimization efforts are either multidisciplinary optimization confined to just a specific design phase (conceptual/preliminary/detailed) or single disciplinary optimization (structural/thermal/daylighting/energy) spanning across multiple phases. Complexity in changing the optimization setup as the design progresses through subsequent phases, interoperability issues between modeling and physics-based analysis tools used at later stages, and the lack of an appropriate level of design detail to get meaningful results from these sophisticated analysis tools are few challenges that limit multi-phase multidisciplinary design optimization (MDO) in the AEC field. Here this paper proposes a computational building design platform leveraging concurrent engineering techniques such as interactive problem structuring, simulation-based optimization using meta models for energy and daylighting (machine learning based) and tradespace visualization. The proposed multi-phase concurrent MDO framework is demonstrated by using it to design and optimize a sample office building for energy and daylighting objectives across multiple phases. Furthermore, limitations of the proposed framework and future avenues of research are listed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Lightweight and effective tensor sensitivity for atomistic neural networks

Atomistic machine learning focuses on the creation of models that obey fundamental symmetries of atomistic configurations, such as permutation, translation, and rotation invariances. In many of these schemes, translation and rotation invariance are achieved by building on scalar invariants, e.g., distances between atom pairs. There is growing interest in molecular representations that work internally with higher rank rotational tensors, e.g., vector displacements between atoms, and tensor products thereof. Here, we present a framework for extending the Hierarchically Interacting Particle Neural Network (HIP-NN) with Tensor Sensitivity information (HIP-NN-TS) from each local atomic environment. Crucially, the method employs a weight tying strategy that allows direct incorporation of many-body information while adding very few model parameters. We show that HIP-NN-TS is more accurate than HIP-NN, with negligible increase in parameter count, for several datasets and network sizes. As the dataset becomes more complex, tensor sensitivities provide greater improvements to model accuracy. In particular, HIP-NN-TS achieves a record mean absolute error of 0.927 $\frac{\text{kcal}}{\text{mol}}$ for conformational energy variation on the challenging COMP6 benchmark, which includes a broad set of organic molecules. We also compare the computational performance of HIP-NN-TS to HIP-NN and other models in the literature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Connection between the physicochemical characteristics of amorphous carbon thin films and their electrochemical properties

Connecting a material's surface chemistry with its electrocatalytic performance is one of the major questions in analytical electrochemistry. This is especially important in many sensor applications where analytes from complex media need to be measured. Unfortunately, today this connection is still largely missing except perhaps for the most simple ideal model systems. Here we present an approach that can be used to obtain insights about this missing connection and apply it to the case of carbon nanomaterials. In this paper we show that by combining advanced computational techniques augmented by machine learning methods with x-ray absorption spectroscopy (XAS) and electrochemical measurements, it is possible to obtain a deeper understanding of the correlation between local surface chemistry and electrochemical performance. As a test case we show how by computationally assessing the growth of amorphous carbon (a-C) thin films at the atomic level, we can create computational structural motifs that may in turn be used to deconvolute the XAS data from the real samples resulting in local chemical information. Then, by carrying out electrochemical measurements on the same samples from which x-ray spectra were measured and that were further characterized computationally, it is possible to gain insight into the interplay between the local surface chemistry and electrochemical performance. To demonstrate this methodology, we proceed as follows: after assessing the basic electrochemical properties of a-C films, we investigate the effect of short HNO 3 treatment on the sensitivity of these electrodes towards an inner sphere redox probe dopamine to gain knowledge about the influence of altered surface chemistry to observed electrochemical performance. Overall, these results pave the way towards a more general assessment of electrocatalysis in different systems and provide the first steps towards data driven tailoring of electrode surfaces to gain optimal performance in a given application.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Prediction of DIII-D Pedestal Structure From Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. Here, an experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (n e ) and electron temperature (T e ) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (I p ), toroidal magnetic field (B Φ ), neutral beam heating power (P NBI ) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Data-centric machine learning in quantum information science

Abstract We propose a series of data-centric heuristics for improving the performance of machine learning systems when applied to problems in quantum information science. In particular, we consider how systematic engineering of training sets can significantly enhance the accuracy of pre-trained neural networks used for quantum state reconstruction without altering the underlying architecture. We find that it is not always optimal to engineer training sets to exactly match the expected distribution of a target scenario, and instead, performance can be further improved by biasing the training set to be slightly more mixed than the target. This is due to the heterogeneity in the number of free variables required to describe states of different purity, and as a result, overall accuracy of the network improves when training sets of a fixed size focus on states with the least constrained free variables. For further clarity, we also include a ‘toy model’ demonstration of how spurious correlations can inadvertently enter synthetic data sets used for training, how the performance of systems trained with these correlations can degrade dramatically, and how the inclusion of even relatively few counterexamples can effectively remedy such problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗