Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “physical learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Hybrid Approaches to Systems Health Management and Prognostics

To facilitate and solve the prediction problem, awareness of the current health state of the system is key, since it is necessary to perform condition-based predictions. To accurately predict the future state of any system, it is required to possess knowledge of its current health state and future operational conditions. Latest achievements of data-driven algorithms in regression of complex nonlinear functions and classification tasks have generated a growing interest in artificial intelligence for industrial applications. Complex multi-physics models as well as digital twins, once purely built on physics and corresponding simplified lumped parameter iterations, can now benefit from machine learning algorithms to mitigate the lack of understanding of some complex behavior. Given models of the current and future system behavior, a general approach of model-based prognostics can solve the prediction problem and further decision making. In principle, data driven approaches can replace expensive experimental test-setups as well as reduce the number of simulations needed to explore, e.g., the parametric space of a multi-parameter model. Nonetheless, the limitations of pure data-driven methods came to light rather quickly, at least for some industries. In many industrial applications, data acquisition is costly, and the volume of data that can be collected does not satisfy the requirements for an effective model training and cross-validation. Therefore, some recent works in the area of machine learning is focusing on blending physics with data-driven algorithms, thus mitigating the drawbacks of the two approaches and emphasizing respective advantages. Partial physical knowledge of the problem can aid the learning process by “guiding” the algorithm towards efficient solutions that satisfy the physics driving the system behavior. The result is a hybrid modeling approach combining physical knowledge as well data driven methods to develop a unified hybrid approach. A hybrid framework for fusing information from physics-based performance models along with deep learning algorithms for prognostics of complex safety critical systems is presented. In this framework, physics-based performance models infer unobservable model parameters related to the system's components health solving a calibration problem in the deep learning approach.

Systems Health Management↗
DOE OSTI2023

Enabling site-specific well leakage risk estimation during geologic carbon sequestration using a modular deep-learning-based wellbore leakage model

Geologic carbon sequestration (GCS) is a promising technology for mitigating net carbon emissions and growing climate concern by storing CO 2 in reservoirs. Oil and gas brownfields are an attractive option for CO 2 storage, but these sites have many historical wellbores from petroleum production and can be a potential leakage pathway for CO 2 or formation brine. Therefore, risk management of GCS operations requires an assessment of potential well leakage. Due to the high uncertainty of the system, stochastic approaches are ideal for quantifying the range of risk behaviors, but they must be computationally efficient in the face of complex physics. Here, we develop a new physics-centric deep learning wellbore model to predict the leakage of CO 2 and brine through leaky wellbores. Multi-physics numerical simulations were used to generate data sets, and physics-informed features were introduced. Neural networks were optimized with an automated searching algorithm. Feature analysis quantifies the impact of each feature on model prediction and confirms the role of physics-inspired parameters. The model shows high predictive performance across a wide range of geologic and injection conditions and well attributes. In conclusion, a case study illustrates how the model is applied to assess well leakage in GCS operations.

58 GEOSCIENCES↗
DOE OSTI2023

Uncovering New Physics in the Cosmic Microwave Background: Developing Novel Theoretical Models and Machine-Learning-Powered Constraints

The search for evidence of new physics via its signatures in the cosmos is a cornerstone goal of the Office of High Energy Physics in the DOE Office of Science. Indeed, the current concordance cosmological model provides intriguing hints for beyond-the-standard-model (BSM) physics, such as dark matter and dark energy. Recently, a potential breakdown has appeared in this model, which could be initial evidence toward a further important revision in our fundamental theoretical understanding of cosmology. This breakdown is reflected in disagreements between inferences of the current expansion rate of the universe, H 0 (the Hubble constant), based on indirect, cosmological data (e.g., from the early universe) and based on direct, local measurements. Despite significant effort, a compelling new concordance cosmological model has yet to be found; achieving significant progress on this front was the first major focus of the project. Theoretical considerations indicate that if the observational discrepancies are not due to systematic errors, they strongly suggest new physics operating in the redshift range just prior to recombination, when cosmic microwave background (CMB) photons last scattered. Crucially, almost all such models produce unique signatures in the CMB temperature and polarization power spectra, which will be measured with unprecedented precision by ongoing and upcoming experiments, including the DOE-supported CMB-S4 project. However, these subtle hints of new physics must be uncovered from beneath a swath of Galactic and extragalactic foreground contamination. Current CMB analysis methods, although powerful, do not optimally infer the CMB power spectrum in the presence of non-Gaussian foregrounds. There is thus scope for theoretical improvement in this foundational challenge of cosmological inference, which formed the second major focus of the project. The primary objectives of the project were two-fold: (1) to develop new theoretical models in cosmology that can restore concordance amongst the full suite of cosmological data sets, thereby potentially providing evidence of novel BSM physics; (2) to develop new theoretical machinery to enable significant sensitivity improvements in searches for new physics in cosmology, particularly via the CMB power spectrum. The two objectives are intertwined, as the analysis methodology improvements in (2) will enable the tightest possible constraints on the signatures of new physics predicted by the novel scenarios in (1). The theoretical approaches to restore concordance focused on models involving novel scalar field dynamics in the pre-recombination universe (the “early dark energy” scenario and modifications thereof), as well as couplings between this field and other components in the standard cosmological model, such as dark matter. We also studied a model featuring a generalization of the decaying dark matter scenario, in which a sub-component of dark matter converts into dark radiation at late times in cosmic history. While these ideas are mostly driven by phenomenological considerations, this tactic has proven extremely successful in cosmology throughout the past few decades, including in the early history of evidence for dark matter and dark energy. The new theoretical machinery envisioned in (2) is undergirded by developments in signal processing and machine learning, which will enable improvements in CMB power spectrum estimation in the presence of non-Gaussian foreground contaminants. In turn, this will yield optimal sensitivity in searches for new physics in the CMB, by maximizing the cosmological information that is extracted from this observable. The most ambitious outcome of this work would be the construction of a new cosmological model that restores concordance amongst data sets. Although the individual models studied here did not fully achieve that goal, significant progress in narrowing down the model space was made, as described below. Moreover, the outcome of the methodological improvements in (2) will significantly impact a wide range of theoretical cosmology, by enabling the tightest possible constraints on any model that leaves novel signatures in the CMB temperature and polarization power spectra.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2024

Opinion: Aerosol Remote Sensing Over the Next Twenty Years

More than two decades ago, aerosol remote sensing underwent a revolution with the launch of the Terra and Aqua satellites. Advancement continued via additional launches carrying new passive and active sensors. Capable of retrieving parameters characterizing aerosol loading, rudimentary particle properties and in some cases aerosol layer height, the satellite view of Earth’s aerosol system came into focus.The modeling communities have made similar advances. Now the efforts have continued long enough that we can see developing trends in both remote sensing and modeling communities, allowing us to speculate about the future and how the community will approach aerosol remote sensing twenty years from now. We anticipate technology that will replace today’s standard multi-wavelength radiometers with hyperspectral and/or polarimetry all viewing in multiple angles.These will be supported by advanced active sensors with the ability to measure profiles of aerosol extinction in addition to backscatter. The result will be greater insight into aerosol particle properties. Algorithms will move from being primarily physically-based to include an increasing degree of Machine Learning methods, but physically-based techniques will not go extinct. However, the practice of applying algorithms to a single sensor will be in decline. Retrieval algorithms will encompass multiple sensors and all available ground measurements into a unifying framework, and these inverted products will be ingested directly into assimilation systems, becoming “cyborgs”: half observations, half model. In twenty years we will see a true democratization in space with nations large and small, private organizations and commercial entities of all sizes launching space sensors. With this increasing amount of data and aerosol products available, there will be a lot of bad data. User communities will organize to set standards and the large national space agencies will lead the effort to maintain quality by deploying and maintaining validation ground networks and focused field experiments. Through it all, interest will remain high in the global aerosol system and how that system affects climate, clouds, precipitation and dynamics, air quality, the environment and public health, transport of pathogens and fertilization of ecosystems, and how these processes are adapting to a changing climate.

aerosol remote sensing↗
NASA NTRS2022

Hybrid Model Based Approaches for Systems Health Management and Prognostics

This is a previously approved and published presentation. To accurately predict the future state of any system, it is required to possess knowledge of its current health state and future operational conditions. Present achievements of data-driven algorithms in regression of complex nonlinear functions and classification tasks have generated a growing interest in artificial intelligence for industrial applications. Complex multi-physics models as well as digital twins, once purely built on physics and corresponding simplified lumped parameter iterations, can now benefit from machine learning algorithms to mitigate the lack of understanding of some complex behavior. Given models of the current and future system behavior, a general approach of model-based prognostics can solve the prediction problem and further decision-making. In principle, data-driven approaches can replace expensive experimental test-setups as well as reduce the number of simulations needed to explore, e.g., the parametric space of a multi-parameter model. Nonetheless, the limitations of pure data-driven methods came to light rather quickly, at least for some industries. In many industrial applications, data acquisition is costly, and the volume of data that can be collected does not satisfy the requirements for effective model training and cross-validation. Therefore, some recent works in the area of machine learning is focusing on blending physics with data-driven algorithms, thus mitigating the drawbacks of the two approaches and emphasizing respective advantages. Partial physical knowledge of the problem can aid the learning process by “guiding” the algorithm towards efficient solutions that satisfy the physics driving the system behavior. The result is a hybrid modeling approach combining physical knowledge as well data-driven methods to develop a unified hybrid approach. A hybrid framework for fusing information from physics-based performance models along with deep learning algorithms for prognostics of complex safety-critical systems is presented. In this framework, physics-based performance models infer unobservable model parameters related to the system's components health solving a calibration problem in the deep learning approach.

Prognostics↗
DOE OSTI2024

Predicting Li-ion Battery Performance for Impurity-doped NMC Cathodes Using Deep Learning

With the electric vehicle (EV) market expansion and the energy sector's shift towards electrification, the demand for battery metals, including lithium (Li), cobalt (Co), and nickel (Ni), is set to surpass supply. A critical knowledge gap exists in the purity standards for battery precursors and the impact of impurities on battery performance. Addressing this, our study employs a Deep Machine Learning (DL) based multi-objective optimization approach to interpret the relationship between metal impurities in domestic battery resources and their effects on battery performance. We analyze experimental data from Li-ion batteries with NMC (Nickel-Manganese-Cobalt oxide) cathodes over 1000 cycles, representing approximately ~6-8 months of operation, to establish a baseline of performance without impurities. Leveraging this data, we develop a Physics-Informed Deep Learning (PIDL) framework to extend our findings to cases that include metal impurities (e.g., Fe, Cu, Al) ranging from (0.001 - 0.01) %, respectively. By incorporating physics-based features, our PIDL model can accurately estimate the performance of NMC cathodes doped with various metal impurities to provide rapid design decisions. This research paves the way for informed decisions in Li-ion battery material design and optimization, ensuring the sustainable growth of the EV market and the broader energy sector.

25 ENERGY STORAGE↗
DOE OSTI2023

A multifidelity deep operator network approach to closure for multiscale systems

Projection-based reduced order models (PROMs) have shown promise in representing the behavior of multiscale systems using a small set of generalized (or latent) variables. Despite their success, PROMs can be susceptible to inaccuracies, even instabilities, due to the improper accounting of the interaction between the resolved and unresolved scales of the multiscale system (known as the closure problem). In the current work, we interpret closure as a multifidelity problem and use a multifidelity deep operator network (DeepONet) framework to address it. In addition, to enhance the stability and/or accuracy of the multifidelity-based closure, we employ the recently developed ``in-the-loop" training approach from the literature on coupling physics and machine learning models. The resulting approach is tested on shock advection for the one-dimensional viscous Burgers equation and vortex merging for the two-dimensional Navier-Stokes equations. Furthermore, the numerical experiments show significant improvement of the predictive ability of the closure-corrected PROM over the un-corrected one both in the interpolative and the extrapolative regimes.

42 ENGINEERING↗
DOE OSTI2022

Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication

Machine learning and artificial intelligence (ML/AI) are rapidly becoming an indispensable part of physics research, with applications ranging from theory and materials prediction to high-throughput data analysis. In parallel, the recent successes in applying ML/AI methods for autonomous systems from robotics through self-driving cars to organic and inorganic synthesis are generating enthusiasm for the potential of these techniques to enable automated and autonomous experiment in imaging. Here, we discuss recent progress in application of machine learning methods in scanning transmission electron microscopy and scanning probe microscopy, from applications such as data compression and exploratory data analysis to physics learning to atomic fabrication.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Hypothesis testing via AI: Generating physically interpretable models of scientific data with machine learning (Full Technical Report)

Deep learning has demonstrated an exceptional ability to solve complex tasks (an engineering success); however, it has done so at the expense of the ability to generate new knowledge (a scientific failure). We propose an alternative framework—entitled Deep Symbolic Regression (DSR)—in which artificial neural networks (NNs) rapidly generate hypotheses about physical relationships among inputs. This framework bypasses the need to interpret an NN altogether, while still leveraging the representational power of deep learning. The resulting models are tractable mathematical expressions, which are inherently and readily human interpretable and can provide insights into underlying physical phenomena. Further, we fold this methodology into the scientific process by allowing the scientist to directly integrate a priori knowledge and beliefs to accelerate learning. We demonstrate this methodology on symbolic regression—the problem of rediscovering underlying expressions describing a dataset—and achieve state-of-the-art performance across a wide variety of symbolic regression problems. Further, we generalize our DSR framework to apply to the more general class of symbolic optimization problems, in which one seeks to optimize a sequence of symbols or “tokens” under a black-box reward function. Examples of other symbolic optimization problems include neural architecture search and computational antibody design. Our generalized tool, Deep Symbolic Optimization (DSO), has been demonstrated on the task of learning symbolic control policies for reinforcement learning environments, and has been adopted as an enabling capability for computational antibody design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Investigating the effects of precise mass measurements of Ru and Pd isotopes on machine learning mass modeling

Atomic masses are a foundational quantity in our understanding of nuclear structure, astrophysics, and fundamental symmetries. The longstanding goal of creating a predictive global model for the binding energy of a nucleus remains a significant challenge, however, and prompts the need for precise measurements of atomic masses to serve as anchor points for model developments. We present precise mass measurements of neutron-rich Ru and Pd isotopes performed at the Californium Rare Isotope Breeder Upgrade facility at Argonne National Laboratory using the Canadian Penning Trap mass spectrometer. The masses of 108 Ru, 110 Ru, and 116 Pd were measured to a relative mass precision $\delta$⁢$m/m$ ≈ 10 -8 via the phase-imaging ion-cyclotron-resonance technique, and represent an improvement of approximately an order of magnitude over previous measurements. Further, these mass data were used in conjunction with the physically interpretable machine learning (PIML) model, which uses a mixture density neural network to model mass excesses via a mixture of Gaussian distributions. The effects of our new mass data on a Bayesian-updating of a PIML model are presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Estimation of sensor measurement errors in reactor coolant systems using multi-sensor fusion

A nuclear power plant is typically instrumented with a variety of sensors to continually monitor its variables, and their sensor’s measurements may be used to assess the plant state and initiate safety actions, if needed. Errors in sensor measurements, due to factors such as calibration drifts, critically affect such state assessments. Here, we address a problem of estimating sensor errors using physics-informed machine learning methods that use measurements collected under known plant conditions. For a given sensor, we propose an information fusion method that uses measurements from other sensors to estimate its output assuming it is error-free and provides its difference from an actual measurement as an error estimate. We present the ensemble of trees and support vector machine fusers, and evaluate their performance using measurements collected over an emulated test loop of a pressurized water reactor. The plant variables are related to each other through the underlying physical laws under inertial constraints that place bounds on their derivatives, which analytically justify the applicability of machine learning methods for computing these fusers. Under twenty scenarios, we assess their sensor error estimates for pressure sensors of the heat exchanger of a reactor’s primary coolant system. Multiple types of errors are captured by both fusers under externally induced calibration drifts, blockages, minor leaks and air gaps in sensing lines, and electromagnetic interference; the root mean square error of the estimation of error is under 2.2% percent of the maximum measurement. We present generalization equations, in the framework of statistical learning theory, for these methods that characterize the confidence probability that the estimation error is bounded by a specified parameter in future test scenarios.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Transforming U.S. Particle Physics Education: A Snowmass 2021 Study

The pursuit of knowledge in particle physics requires constant learning. As new tools become available, new theories are developed, and physicists search for new answers with ever-evolving methods. However, it is the case that formal educational systems serve as the primary training grounds for particle physicists. Graduate school (and undergraduate school to a lesser extent) is where researchers learn most of the technical skills required for research, develop scientific problem-solving abilities, learn how to establish themselves in their field, and begin developing their career. It is unfortunate, then, that the skills gained by physicists during their formal education are often mismatched with the skills actually required for a successful career in physics. We performed a survey of the U.S. particle physics community to determine the missing elements of graduate and undergraduate education and to gauge how to bridge these gaps. In this contributed paper, part of the 2021-22 Snowmass Community Planning Exercise, we report the results of this survey. We also recommend several specific community actions to improve the quality of particle physics education; the "community" here refers to physics departments, national labs, professional societies, funding agencies, and individual physicists.

Bitter, O.↗
DOE OSTI2021

Uncovering turbulent plasma dynamics via deep learning from partial observations

One of the most intensely studied aspects of magnetic confinement fusion is edge plasma turbulence which is critical to reactor performance and operation. Drift-reduced Braginskii two-fluid theory has for decades been widely applied to model boundary plasmas with varying success. Towards better understanding edge turbulence in both theory and experiment, we demonstrate that a novel multi-network physics-informed deep learning framework constrained by partial differential equations can accurately learn turbulent fields consistent with the two-fluid theory from partial observations of electron pressure which is not otherwise possible using conventional equilibrium models. This technique presents a novel paradigm for the advanced design of plasma diagnostics and validation of magnetized plasma turbulence theories in challenging thermonuclear environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Incorporation of Physics Phenomenology into an Adaptive Algorithm Framework (Final Report)

We attempt to incorporate prior physics knowledge into a machine learning architecture at an applied application level (empirical) as opposed to the level of fundamental physics (first principles). The purpose of this work is to allow for the application of methods of physics-informed machine learning to a broad range of national security problems, while enhancing the trust in machine-learned models by decreasing the “black box” nature of such methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Predicting biomass comminution: Physical experiment, population balance model, and deep learning

An extended population balance model (PBM) and a deep learning-based enhanced deep neural operator (DNO+) model are introduced for predicting particle size distribution (PSD) of comminuted biomass through a large knife mill. Experimental tests using corn stalks with varied moisture contents, mill blade speeds, and discharge screen sizes are conducted to support model development. A novel mechanism in the extended PBM allows for including additional input parameters such as moisture content, which is not possible in the original PBM. The DNO+ model can include influencing factors of different data types such as moisture content and discharge screen size, which significantly extends the engineering applicability of the standard DNO model that only admits feed PSD and outcome PSD. Test results show that both models are remarkably accurate in the calibration or training parameter space and can be used as surrogate models to provide effective guidance for biomass preprocessing design.

09 BIOMASS FUELS↗
DOE OSTI2022

AF2Complex predicts direct physical interactions in multimeric proteins with deep learning

Abstract Accurate descriptions of protein-protein interactions are essential for understanding biological systems. Remarkably accurate atomic structures have been recently computed for individual proteins by AlphaFold2 (AF2). Here, we demonstrate that the same neural network models from AF2 developed for single protein sequences can be adapted to predict the structures of multimeric protein complexes without retraining. In contrast to common approaches, our method, AF2Complex, does not require paired multiple sequence alignments. It achieves higher accuracy than some complex protein-protein docking strategies and provides a significant improvement over AF-Multimer, a development of AlphaFold for multimeric proteins. Moreover, we introduce metrics for predicting direct protein-protein interactions between arbitrary protein pairs and validate AF2Complex on some challenging benchmark sets and the E. coli proteome. Lastly, using the cytochrome c biogenesis system I as an example, we present high-confidence models of three sought-after assemblies formed by eight members of this system.

59 BASIC BIOLOGICAL SCIENCES↗