Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Physics Informed Machine Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Data Science and Machine Learning in Education

The growing role of data science (DS) and machine learning (ML) in high-energy physics (HEP) is well established and pertinent given the complex detectors, large data, sets and sophisticated analyses at the heart of HEP research. Moreover, exploiting symmetries inherent in physics data have inspired physics-informed ML as a vibrant sub-field of computer science research. HEP researchers benefit greatly from materials widely available materials for use in education, training and workforce development. They are also contributing to these materials and providing software to DS/ML-related fields. Increasingly, physics departments are offering courses at the intersection of DS, ML and physics, often using curricula developed by HEP researchers and involving open software and data used in HEP. In this white paper, we explore synergies between HEP research and DS/ML education, discuss opportunities and challenges at this intersection, and propose community activities that will be mutually beneficial.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Uncovering New Physics in the Cosmic Microwave Background: Developing Novel Theoretical Models and Machine-Learning-Powered Constraints

The search for evidence of new physics via its signatures in the cosmos is a cornerstone goal of the Office of High Energy Physics in the DOE Office of Science. Indeed, the current concordance cosmological model provides intriguing hints for beyond-the-standard-model (BSM) physics, such as dark matter and dark energy. Recently, a potential breakdown has appeared in this model, which could be initial evidence toward a further important revision in our fundamental theoretical understanding of cosmology. This breakdown is reflected in disagreements between inferences of the current expansion rate of the universe, H 0 (the Hubble constant), based on indirect, cosmological data (e.g., from the early universe) and based on direct, local measurements. Despite significant effort, a compelling new concordance cosmological model has yet to be found; achieving significant progress on this front was the first major focus of the project. Theoretical considerations indicate that if the observational discrepancies are not due to systematic errors, they strongly suggest new physics operating in the redshift range just prior to recombination, when cosmic microwave background (CMB) photons last scattered. Crucially, almost all such models produce unique signatures in the CMB temperature and polarization power spectra, which will be measured with unprecedented precision by ongoing and upcoming experiments, including the DOE-supported CMB-S4 project. However, these subtle hints of new physics must be uncovered from beneath a swath of Galactic and extragalactic foreground contamination. Current CMB analysis methods, although powerful, do not optimally infer the CMB power spectrum in the presence of non-Gaussian foregrounds. There is thus scope for theoretical improvement in this foundational challenge of cosmological inference, which formed the second major focus of the project. The primary objectives of the project were two-fold: (1) to develop new theoretical models in cosmology that can restore concordance amongst the full suite of cosmological data sets, thereby potentially providing evidence of novel BSM physics; (2) to develop new theoretical machinery to enable significant sensitivity improvements in searches for new physics in cosmology, particularly via the CMB power spectrum. The two objectives are intertwined, as the analysis methodology improvements in (2) will enable the tightest possible constraints on the signatures of new physics predicted by the novel scenarios in (1). The theoretical approaches to restore concordance focused on models involving novel scalar field dynamics in the pre-recombination universe (the “early dark energy” scenario and modifications thereof), as well as couplings between this field and other components in the standard cosmological model, such as dark matter. We also studied a model featuring a generalization of the decaying dark matter scenario, in which a sub-component of dark matter converts into dark radiation at late times in cosmic history. While these ideas are mostly driven by phenomenological considerations, this tactic has proven extremely successful in cosmology throughout the past few decades, including in the early history of evidence for dark matter and dark energy. The new theoretical machinery envisioned in (2) is undergirded by developments in signal processing and machine learning, which will enable improvements in CMB power spectrum estimation in the presence of non-Gaussian foreground contaminants. In turn, this will yield optimal sensitivity in searches for new physics in the CMB, by maximizing the cosmological information that is extracted from this observable. The most ambitious outcome of this work would be the construction of a new cosmological model that restores concordance amongst data sets. Although the individual models studied here did not fully achieve that goal, significant progress in narrowing down the model space was made, as described below. Moreover, the outcome of the methodological improvements in (2) will significantly impact a wide range of theoretical cosmology, by enabling the tightest possible constraints on any model that leaves novel signatures in the CMB temperature and polarization power spectra.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Where’s Swimmy?: Mining unique color features buried in galaxies by deep anomaly detection using Subaru Hyper Suprime-Cam data

Abstract We present the Swimmy (Subaru WIde-field Machine-learning anoMalY) survey program, a deep-learning-based search for unique sources using multicolored (grizy) imaging data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). This program aims to detect unexpected, novel, and rare populations and phenomena, by utilizing the deep imaging data acquired from the wide-field coverage of the HSC-SSP. This article, as the first paper in the Swimmy series, describes an anomaly detection technique to select unique populations as “outliers” from the data-set. The model was tested with known extreme emission-line galaxies (XELGs) and quasars, which consequently confirmed that the proposed method successfully selected $\sim\!\! 60\%$–$70\%$ of the quasars and $60\%$ of the XELGs without labeled training data. In reference to the spectral information of local galaxies at z = 0.05–0.2 obtained from the Sloan Digital Sky Survey, we investigated the physical properties of the selected anomalies and compared them based on the significance of their outlier values. The results revealed that XELGs constitute notable fractions of the most anomalous galaxies, and certain galaxies manifest unique morphological features. In summary, deep anomaly detection is an effective tool that can search rare objects, and, ultimately, unknown unknowns with large data-sets. Further development of the proposed model and selection process can promote the practical applications required to achieve specific scientific goals.

Astronomy & Astrophysics↗
DOE OSTI2023

Performance analysis and comparison of data-driven models for predicting indoor temperature in multi-zone commercial buildings

Building thermal models, which characterize the properties of a building’s envelope and thermal mass, are essential for accurate indoor temperature and cooling/heating demand prediction. Because of their flexibility and ease of use, data-driven models are increasingly used. Here, this study compared and analyzed the performance of gray-box (resistance-capacitance) and black-box (recurrent neural network) models for predicting indoor air temperature in a real multi-zone commercial building. The developed resistance-capacitance model served as a benchmark model for which full sets of temporal data and building information were used as inputs. The recurrent neural network models were trained and tested assuming various available types and amounts of temporal data and known building physical information to investigate the effects of data and information availability. Feature importance analysis was conducted to select the key variables for different prediction targets under different scenarios. This research provides guidance in selecting an appropriate building thermal response modeling method based on the measured data availability, building physical information, and application.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRSDate not supplied

Pushing the Limits of Aquatic Remote Sensing: Synthetic Data and Deep Learning for Fast Inverse Emulation of A Coupled Ocean-Atmosphere Radiative Transfer Model

The inversion of electromagnetic information to physical and biological properties of the water column is a notoriously difficult problem, yet fundamental to our ability of understanding aquatic processes on large time and space scales. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will discuss research integrating advanced biological and radiative modeling, high-end computation, and machine learning to develop a portable global processor for simultaneous retrieval of atmosphere and water optics for diverse aquatic systems from the open and coastal ocean to optically extreme inland waters and harmful algal blooms. We will discuss some of the basic concepts behind the forward modeling approach including DEAP, the novel Distributed Equivalent Algal Populations model, for developing large spectral libraries of aquatic particle optics to aid in our ability to distinguish phytoplankton functional types (PFTs) and inorganic material, as well as other factors which enable comprehensive modeling from the benthos to top-of-atmosphere (TOA). This information is being used to understand how we can leverage next-generation deep learning methods for maximum information retrieval and rapid image processing, while also providing capabilities to identify minimum sensor spectral requirements necessary for certain aquatic applications. Further, I will touch on how we envision this research to enable the aquatic community for science discovery and how we are moving closer towards the capability for high-fidelity global analysis of aquatic ecosystems.

Jeremy Alan Kravitz↗
DOE OSTI2022

GeoThermalCloud: Machine Learning for Geothermal Resource Exploration

Geothermal is a renewable energy source that can provide reliable and flexible electricity generation for the world. In the past decade, the U.S. Geological Survey's resource assessments, Play Fairway Analyses (PFA), and GeoVision report by the U.S. Department of Energy's Geothermal Technologies Office provided insights on enormous untapped potential for geothermal energy to contribute to the U.S. domestic energy needs. The past studies identified that geothermal resources without surface expression (e.g., blind/hidden hydrothermal systems) comprise a huge potential. These blind systems can significantly increase power generation. But a primary challenge is locating and quantifying these hidden resources, which do not have any thermal manifestations on the surface. PFA has successfully identified some blind systems in the western USA (e.g., specific locations in the Great Basin region within Nevada). However, a comprehensive search for these blind systems can be time-consuming, expensive, and resource-intensive with a low probability of success. Accelerated discovery of these blind resources is needed with growing energy needs and higher chances of exploration success. Recent advances in machine learning (ML) have shown promise in shortening the timeline for this discovery. This paper presents a novel ML-based methodology for geothermal exploration towards PFA applications. Our methodology is provided through our open-source ML framework called GeoThermalCloud \url{https://github.com/SmartTensors/GeoThermalCloud.jl}. GeoThermalCloud uses a series of unsupervised, supervised, and physics-informed ML methods available in SmartTensors AI platform \url{https://github.com/SmartTensors}. Here, the presented analyses are performed using our unsupervised ML algorithm called NMF$k$, which is available in the SmartTensors AI platform. Our ML algorithm facilitates the discovery of new phenomena, hidden patterns, and mechanisms that helps us to make informed decisions. Moreover, the GeoThermalCloud enhances the collected PFA data and discovers signatures representative of geothermal resources. Through GeoThermalCloud, we were able to identify hidden patterns in the geothermal field data needed for the efficient discovery of blind systems. Crucial geothermal signatures often overlooked in traditional PFA are extracted using GeoThermalCloud and analyzed by the subject matter experts to provide ML-enhanced PFA, which is informative for efficient exploration. We applied our ML methodology on various open-source geothermal datasets within the U.S. (some of these are collected by past PFA work), and the results provide valuable insights on resource types within those explored regions. This ML-enhanced workflow makes GeoThermalCloud attractive for the geothermal community to improve existing datasets and extract valuable information often unnoticed during geothermal exploration.

machine learning (ML), geothermal energy↗
DOE OSTI2023

Quantum Chemistry-Driven Machine Learning Approach for the Prediction of the Surface Tension and Speed of Sound in Ionic Liquids

Ionic liquids (ILs) have unique solvent properties and have thus garnered significant interest. However, exhaustive experimental determination of the physicochemical properties of ILs is unrealistic due to the large structural diversity of anions and cations, their high cost, the requirements of elevated temperature and pressure, and the time required. To circumvent these experimental costs, computational approaches to accurately calculate these properties have emerged. Here in the present study, we present a demonstration of two machine learning (ML) models for the prediction of two critical IL physical properties, the surface tension and the speed of sound, across a wide range of temperatures and pressures. The models make use of molecular descriptors derived from the COSMO-RS, a quantum chemical-based model. The ML models show excellent agreement with experimental observations, with an R2 value of 0.96–0.99 and RMSE of 1.71 mN/m and 16.12 m/s for the surface tension and speed of sound, respectively. This work paves the way for the development of COSMO-RS-informed ML models for the prediction of IL properties which can help to further optimize and accelerate technology development for ILs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

AIACHNE's contribution for Nuclear Energy Agency Working Party on International Nuclear Data Evaluation Co-operation Subgroup 50

The AIACHNE (AI/ML Informed cAlifornium CHi Nuclear data Experiment) project aims at designing an experiment for the 252 Cf Prompt Fission Neutron Spectrum (PFNS) that explores systematic biases in an experimental database retrieved from the EXFOR databases. To that end, machine learning (ML) methods were applied to pint-point measurement features likely related to bias. From that information, we selected a feature that should be explored by the AIACHNE experiment. Measurement features are metadata encapsulating all pertinent information about the physical measurement and analysis techniques. Examples are, for instance, what neutron and fission detectors were used for the physical metadata, and what background reduction techniques were employed for analysis techniques. Such metadata were retrieved both from EXFOR entries as well as the literature of data sets described in detail in Reference 2 (at the end of the article).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

MULTI-LEADER: MULTI-source LEarning-Accelerated Design of high-Efficiency multi-stage compRessor (Final Technical Report)

The objective of MULTI-LEADER is to cut design costs by 80% while generating more energy-efficient designs of multi-stage compressors by developing and implementing novel machine learning (ML) techniques, which enable faster and fewer design iterations, improved solver performance, and concurrent multi-disciplinary design. Current industrial practices for the design of multi-stage compressors involve simulation-based design optimization with successive levels of model fidelity, iteratively evaluated between distinct disciplines, one stage at a time to tackle the high dimensional design variations. This project addresses these key design challenges: (1) concurrent optimization of multiple stages under many non-linear constraints; (2) multitude of evaluation of high-fidelity and expensive solvers and their gradients during optimization convergence in high-dimensional design; (3) multi-disciplinary design to maximize aerodynamic performance while guaranteeing structural integrity and additive manufacturability; (4) utilization of multiple fidelity of solvers with disparate parameterization and modeling assumptions. MULTI-LEADER achieved more than 5x speed up in detailed design of more energy-efficient compressors via these machine learning (ML) innovations: (i) rapid design surrogates by multi-source learning from diverse fidelities across multiple disciplines, (ii) physics-constrained data-augmented modeling for improved empiricism, (iii) generative manifold embedding for high dimensional concurrent design without gradient information; (iv) budget-constrained fidelity-adaptive sampling towards fewer design iterations.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Differentiable physics-enabled closure modeling for Burgers’ turbulence

Abstract Data-driven turbulence modeling is experiencing a surge in interest following algorithmic and hardware developments in the data sciences. We discuss an approach using the differentiable physics paradigm that combines known physics with machine learning to develop closure models for Burgers’ turbulence. We consider the one-dimensional Burgers system as a prototypical test problem for modeling the unresolved terms in advection-dominated turbulence problems. We train a series of models that incorporate varying degrees of physical assumptions on an a posteriori loss function to test the efficacy of models across a range of system parameters, including viscosity, time, and grid resolution. We find that constraining models with inductive biases in the form of partial differential equations that contain known physics or existing closure approaches produces highly data-efficient, accurate, and generalizable models, outperforming state-of-the-art baselines. Addition of structure in the form of physics information also brings a level of interpretability to the models, potentially offering a stepping stone to the future of closure modeling.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Lessons Learned in the Application of Machine Learning Techniques to Air Traffic Management

There is an increasing interest in applying methods based on Machine Learning Techniques (MLT) to problems in Air Traffic Management (ATM). The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large databases. This paper reviews the current-state-of-the art in applying MLT to aviation operations, its promises and challenges. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The promises and challenges in applying MLT to ATM is traced through three examples based on the authors’ experience, each separated by a decade, to show the influence of data and feature selection in the successful application of MLT to ATM. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Machine Learning Techniques↗
DOE OSTI2024

Process damping identification using Bayesian learning and time domain simulation

Process damping can provide improved machining productivity by increasing the stability limit at low spindle speeds. However, existing methods for identifying process damping models experimentally require specialized setups and/or multiple cutting tests. While the phenomenon is well known, the modeling challenges limit pre-process parameter selection that leverages the potential increases in material removal rates. This paper proposes a physics-informed Bayesian method that can identify the cutting force and process damping models from a limited set of test cuts without requiring direct measurements of cutting force or vibration. The method uses time domain simulation to incorporate process damping and provide a basis for test selection. Here, new strategies for efficient sampling and dimensionality reduction are applied to lower computation time and minimize the effect of model error. The proposed method is demonstrated and the identified cutting and damping force coefficients are compared to values obtained using machining tests and least-squares fitting.

42 ENGINEERING↗
DOE OSTI2023

Novel machine-learning method for spin classification of neutron resonances

The performance of nuclear reactors and other nuclear systems depends on a precise understanding of the neutron interaction cross sections for materials used in these systems. These cross sections exhibit resonant structure whose shape is determined in part by the angular-momentum quantum numbers of the resonances. The correct assignment of the quantum numbers of neutron resonances is, therefore, paramount. In this project, we apply machine learning to automate the quantum number assignments using only the resonances' energies and widths and not relying on detailed transmission or capture measurements. The classifier used for quantum number assignment is trained using stochastically generated resonance sequences whose distributions mimic those of real data. Here we explore the use of several physics-motivated features for training our classifier. These features amount to out-of-distribution tests of a given resonance's widths and resonance-pair spacings. We pay special attention to situations where either capture widths cannot be trusted for classification purposes or where there is insufficient information to classify resonances by the total spin J. We demonstrate the efficacy of our classification approach using simulated and actual 52 Cr resonance data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

Ensemble-based simulation and learning (ESnL) has long been used in hydrology for parameter inference, but computational demands of process-based ESnL can be quite high. To address this issue, we propose a deep neural operator learning approach. Neural operators are generic machine learning algorithms that can learn functional mappings between infinite-dimensional spaces, providing a highly flexible tool for scientific machine learning. Our approach is built upon DeepONet, a specific deep neural operator, and is designed to address several common problems in hydrology, namely, model parameter estimation, prediction at ungaged locations, and uncertainty quantification. Here we demonstrate the effectiveness of our DeepONet-based workflow using an existing large model ensemble created for an eastern U.S. watershed that is instrumented with 10 streamflow gages. Results suggest DeepONet achieves high efficiency in learning an ML surrogate model from the model ensemble, with the modified Kling-Gupta Efficiency exceeding 0.9 on holdout test sets. Parameter inference, carried out using the trained DeepONet surrogate model and genetic algorithm, also yields robust results. Additionally, we formulate and train a separate DeepONet model for physics-informed, seq-to-seq streamflow forecasting, which further reduces biases in the pre-trained DeepONet surrogate model. While this study focuses primarily on a single watershed, our approach is general and may be extended to enable learning from model ensembles across multiple basins or models. Thus, this research represents a significant contribution to the application of hybrid machine learning in hydrology.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Learning PDFs through interpretable latent representations in Mellin space

Representing the parton distribution functions (PDFs) of the proton and other hadrons through flexible, high-fidelity parametrizations has been a long-standing goal of particle physics phenomenology. This is particularly true since the chosen parametrization methodology can play an influential role in the ultimate PDF uncertainties as extracted in QCD global analyses; these, in turn, are often determinative of the reach of experiments at the LHC and other facilities to nonstandard physics, including at large 𝑥, where parametrization effects can be significant. In this study, we explore a series of encoder-decoder machine-learning (ML) models with various neural-network topologies as efficient means of reconstructing PDFs from meaningful information stored in an interpretable latent space. Given recent effort to pioneer synergies between QCD analyses and lattice-gauge calculations, we formulate a latent representation based on the behavior of PDFs in Mellin space, i.e., their integrated moments, and test the ability of various models to decode PDFs from this information faithfully. We introduce a numerical package, PDFdecoder, which implements several encoder-decoder models to reconstruct PDFs with high fidelity and use this end-to-end tool to explore how such neural-network-based models might connect PDF parametrizations to underlying properties like their Mellin moments. We additionally dissect patterns of learned correlations between encoded Mellin moments and reconstructed PDFs that suggest opportunities for further improvements to ML-based approaches to PDF parametrizations and uncertainty quantification.

Machine learning↗
DOE OSTI2023

Supporting Risk-informed Decision-making During Reactor Accidents

Uncertainty in severe accident evolution and outcome is driven by event bifurcations that represent distinctive challenges to defensive layers and tend to promote the emergence of discrete classes of core damage and accident risk. This discrete set of "attractor" states arise from the complex networks of competing physical phenomena and conditional event cascades occurring as the overall system degrades – a process that yields increasing degrees of freedom and accident progression pathways. Characterization of these event spaces has proven elusive to more traditional data interrogation methods, but proves tractable by application of more advanced data collection and machine learning approaches. Through application of these approaches we demonstrate a conceptual framework that enables real-time/robust, risk-informed decision-making support to improve accident mitigation and encourage “graceful exits” during low probability, extreme events limiting accident consequences. In this analysis, we simulated over 8,000 short-term station blackout (STSBO) accidents with the state-of-the-art integral severe accident code, MELCOR, and demonstrate the potential for ML approaches to predict simulation outcomes. We chose to pair ML tools with interpretable and mechanistic event trees for the considered STSBO accident space to predict the likelihood of future event paths along the tree. In addition to the current state of the system, we use information from recent trajectories of temperature, pressure, and other physical features, combining both the current state and past trajectories to forecast future event paths. Finally, we simulate the random injection of variable amounts of water to quantify the efficacy of available actions at reducing risks along the many branches in the event tree. We identify scenarios and windows of opportunity to mitigate risk as well as scenarios in which such actions are unlikely to alter the accident end-state.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Characterizing the flux effect on the irradiation embrittlement of reactor pressure vessel steels using machine learning

In-service exposure to high-energy neutrons embrittles reactor pressure vessel (RPV) steels. An increase in the yield stress (Δσ y ) results in a corresponding increase in the brittle to ductile transition temperature (ΔT c ). Most existing models underpredict ΔT c at higher fluence following accelerated irradiations in test reactors. High fluence, up to 10 20 n/cm 2 in some cases, will be reached over extended RPV vessel operation of 80 years, or more, at low service flux. Embrittlement has been extensively studied in accelerated, higher flux test reaction irradiations. However, the use of test reactor data naturally raises the question of flux effects. Here, this study used a machine learning approach trained on a set of hardening data, covering a wide range of flux, fluence, and steel compositions to determine the interactive effects of both irradiation and material variables on Δσ y . The analysis included machine learning-based cross-plots of the variable dependence of Δσ y for six core steels (i.e., CM6, LC, LD, LG, LH, and LI), with controlled differences in their Cu and Ni contents. A primary objective is to evaluate an effective to actual fluence (Φt e /Φt) ratio, as a function of flux, fluence, and steel composition. This is information critical to properly use intermediate flux-high fluence data in calibrating a low flux-high fluence embrittlement model. The predicted Φt e /Φt is reasonably consistent with estimates previously derived from a physics-based solute recombination trap model.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Recent developments in the PySCF program package

PySCF is a Python-based general-purpose electronic structure platform that supports first-principles simulations of molecules and solids as well as accelerates the development of new methodology and complex computational workflows. Here, we explain the design and philosophy behind PySCF that enables it to meet these twin objectives. With several case studies, we show how users can easily implement their own methods using PySCF as a development environment. We then summarize the capabilities of PySCF for molecular and solid-state simulations. Finally, we describe the growing ecosystem of projects that use PySCF across the domains of quantum chemistry, materials science, machine learning, and quantum information science.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗