Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “physical learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Predicting Lightning Initiation using Deep Learning

Lightning occurrence presents safety challenges to people and property. The main challenge with lightning safety is that the majority of guidance is reactive. In other words, lightning has to have already occurred nearby before a person will respond and take shelter. Further, most injuries or fatalities occur as the storm approaches, or as it's moving away, when rainfall may not be present at the time of the flash. Thus, this project develops a physically-based deep learning model to produce lightning probabilities out to 15 minutes. The deep learning model combines a Convolutional Neural Network (CNN) with a Long Short-Term Memory (LSTM) network to capture both the spatial and temporal evolution of storms to predict the probability that lightning initiation will occur in the next 15 minutes. The model combines radar reflectivity, correlation coefficient and differential reflectivity to inferred storm hydrometer type and precipitation phase, which aids in the identification of electrification processes. The model is trained with data from the Geostationary Lightning Mapper (GLM), which is a near infrared sensor onboard the GOES-R series of satellites that measures optical brightness from lightning. This presentation will provide an overview of the project.

Andrew T White↗

Quasi-Classical Trajectory Calculation of Rate Constants Using an Ab Initio Trained Machine Learning Model (aML-MD) with Multifidelity Data

Machine learning (ML) provides a great opportunity for the construction of models with improved accuracy in classical molecular dynamics (MD). However, the accuracy of a ML trained model is limited by the quality and quantity of the training data. Generating large sets of accurate ab initio training data can require significant computational resources. Furthermore, inconsistent or incompatible data with different accuracies obtained using different methods may lead to biased or unreliable ML models that do not accurately represent the underlying physics. Recently, transfer learning showed its potential for avoiding these problems as well as for improving the accuracy, efficiency, and generalization of ML models using multifidelity data. In this work, ab initio trained ML-based MD (aML-MD) models are developed through transfer learning using DFT and multireference data from multiple sources with varying accuracy within the Deep Potential MD framework. Further, the accuracy of the force field is demonstrated by calculating rate constants for the H + HO 2 → H 2 + 3 O 2 reaction using quasi-classical trajectories. We show that the aML-MD model with transfer learning can accurately predict the rate constants while reducing the computational cost by more than five times compared to the use of more expensive quantum chemistry training data sets. Hence, the aML-MD model with transfer learning shows great potential in using multifidelity data to reduce the computational cost involved in generating the training set for these potentials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Impact of Domain Knowledge on the Property Prediction of Specialized Machine Learning Models

Developing transferable machine learning models is trending in data-driven materials research. However, how to apply such models to a specific research domain remains unclear. Here, in this work, we choose high-entropy materials as a platform with a specialized data set containing 145,323 DFT-relaxed materials. This data set is used to explore the role of domain-specific knowledge in training effective models. Our tests with three representative graph neural network architectures indicate the model complexity has much smaller influence on performance than the data itself. Specifically, the consideration of low-energy atomic ordering, structures with diverse elemental coverage, and high-order interactions significantly influences the model performance. We also find that domain knowledge-driven sampling can greatly enhance unsupervised learning techniques. This research highlights that developing specialized data sets is more beneficial than further complicating deep learning architectures. Additionally, physics-inspired sampling algorithms are crucially needed for better machine learning models for a specific materials research domain.

36 MATERIALS SCIENCE↗

Exploring the Capabilities of a Machine Learning Algorithm to Detect Space Weather-Significant Emerging Active Regions

Active regions are a source of various phenomena responsible for Space Weather disturbances; therefore, developing a technology for early warning about upcoming magnetic activity is crucial to mitigate its impact. However, observational limitations and the high nonlinearity of processes associated with the accumulation of magnetic flux and its interaction with the surrounding plasma during the emergence through the convection zone make early activity detection a challenging problem. To address these challenges, we developed a physics-driven machine learning model that allows us to detect active regions (ARs) before they become visible on the solar surface by analyzing the power spectra of acoustic oscillations observed by the SDO/HMI instrument. This study is based on a time series of Doppler shift maps of 31x31-degree areas tracked with the Carrington rotation rate for four days before and after the emergence. The Doppler shift time series are processed into the oscillation power maps for four frequency ranges and accompanied by line-of-sight magnetograms and the continuum intensity maps from SDO/HMI. The resulting data are converted into a 1D time series representing the mean temporal variations of these quantities. The redacted time series are used as input to predict AR emergence using the Long Short Term Memory (LSTM) method. The training of the LSTM model is based on 40 ARs, which includes an independent analysis for each sub region that exhibits AR emergence or remains quiet. The emergence of magnetic flux (defined as a decrease of the continuum intensity) was detected with the developed LSTM algorithm from 5 to 48 hours before the reported time by NOAA. The developed model is capable of pointing to the time and location of active region formation. In this presentation, we discuss reasons that impact how early in advance the model can identify the upcoming activity and the possibility of improving the current predictive skills and steps to transition to the operational forecast.

Heliophysics↗

Quantum optimal control of superconducting qubits based on machine-learning characterization

Implementing fast and high-fidelity quantum operations using open-loop quantum optimal control relies on having an accurate model of the quantum dynamics. Any deviations between this model and the complete dynamics of the device, such as the presence of spurious modes or pulse distortions, can degrade the performance of optimal controls in practice. Here, we propose an experimentally simple approach to realize optimal quantum controls tailored to the device parameters and environment while specifically characterizing this quantum system. Concretely, we use physics-inspired machine learning to infer an accurate model of the dynamics from experimentally available data and then optimize our experimental controls on this trained model. We show the power and feasibility of this approach by optimizing arbitrary single-qubit operations in detailed numerical simulations of a superconducting transmon qubit. Furthermore, we demonstrate that this framework produces an accurate description of the device dynamics under arbitrary controls, together with the precise pulses achieving arbitrary single-qubit gates with a high fidelity of ∼99.99%.

Artificial neural networks↗

Deep Electric Field Predictions by Drift-Reduced Braginskii Theory with Plasma-Neutral Interactions Based on Experimental Images of Boundary Turbulence

We present 2-dimensional turbulent electric field calculations via physics-informed deep learning consistent with (i) drift-reduced Braginskii theory under the framework of an axisymmetric fusion plasma with purely toroidal field and (ii) experimental estimates of the fluctuating electron density and temperature on open field lines obtained from analysis of gas puff imaging of a discharge on the Alcator C-Mod tokamak. The inclusion of effects from the locally puffed atomic helium on particle and energy sources within the reduced plasma turbulence model are found to strengthen correlations between the electric field and electron pressure. The neutrals are also directly associated with broadening the distribution of turbulent field amplitudes and increasing ${\bf E \times B}$ shearing rates. As a result, this demonstrates a novel approach in plasma experiments by solving for nonlinear dynamics consistent with partial differential equations and data without encoding explicit boundary nor initial conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Extracting forces from noisy dynamics in dusty plasmas

Extracting environmental forces from noisy data is a common yet challenging task in complex physical systems. Machine learning (ML) represents a robust approach to this problem, yet is mostly tested on simulated data with known parameters. Here we use supervised ML to extract the electrostatic, dissipative, and stochastic forces acting on micron-sized charged particles levitated in an argon plasma (dusty plasma). By tracking the sub-pixel motion of particles in subsequent images, we successfully estimated these forces from their random motion. The experiments contained important sources of non-Gaussian noise, such as drift and pixel-locking, representing a data mismatch from methods used to analyze simulated data with purely Gaussian noise. Our model was trained on simulated particle trajectories that included all of these artifacts, and used more than 100 dynamical and statistical features, resulting in a prediction with 50\% better accuracy than conventional methods. Lastly, in systems with two interacting particles, the model provided non-contact measurements of the particle charge and Debye length in the plasma environment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Recent Improvements in the National Solar Radiation Database (NSRDB)

The National Solar Radiation Database (NSRDB) has significantly evolved since the first release of the point source database in 1993. The NSRDB has been widely used by the solar energy industry to provide long-term time-series solar resource data for various project phases. The NSRDB represents the state of the art in the satellite-based estimation of solar resource information and uses a unique physics-based modeling approach that allows improvements in accuracy with the deployment of the next-generation geostationary satellites. This poster provides an overview of (1) the improved spatiotemporal resolution; (2) on-demand services and their applications; (3) future Improvements, such as a new direct normal irradiance model and new methods to gap-fill missing data using physics-guided machine learning; (4) data quality; and (5) data dissemination.

MATHEMATICS AND COMPUTING,SOLAR ENERGY↗

Lithium-ion battery physics and statistics-based state of health model

A pseudo-2d model using COMSOL Multiphysics® software is developed to simulate performance and performance degradation of Li-ion batteries consisting of layered and olivine cathodes with graphite anode when subjected to peak shaving grid service. Multiple degradation pathways are considered, including solid electrolyte interphase (SEI) formation and breakdown at the anode, cathode dissolution and its synergistic effect on SEI formation at the anode. The model is validated by simulating commercial cylindrical cell performance. A global model is developed to simulate performance across all chemistries, along with individual chemistry models using global model parameters as initial values. There is good agreement between these models for various optimization parameters such as SEI equilibrium potential, cathode dissolution exchange current density, solvent diffusivity in the SEI and SEI ionic conductivity. To circumvent time constraints related to the COMSOL model, a 0d global model is developed which fits data well and provides more clarity on differences in cathode dissolution exchange current density. Again, good agreement for various optimization parameters is obtained among the COMSOL global & individual chemistry models and the 0-d model. The lessons learned from the physics-based model is used to develop a top down statistics-based model using current, voltage and anode volumetric change per mole lithium intercalated, along with their interactions as degradation predictors. This model predicts out of sample degradation for multiple grid services and electric vehicle drive cycle with high accuracy and provides the pathway to develop an efficient battery management system combining machine learning and findings from physics-based computationally intensive algorithms.

Crawford, Aladsair J.↗

Development and Evaluation of a General Drag Model for Gas-Solid Flows via Deep Learning

This project presents the development and evaluation of a general drag model for gas–solid multiphase flows using deep learning techniques. A comprehensive database of more than 4,000 experimental and numerical data points for spherical and non spherical particles was compiled, incorporating geometric features such as sphericity, aspect ratio, and orientation. Several predictive approaches—including traditional em pirical correlations, machine learning, and deep neural networks—were benchmarked, with the proposed Drag Coefficient Correlation-aided Deep Neural Network (DCC DNN) demonstrating superior accuracy. To account for particle–particle interactions, additional drag data were generated using CFD-based simulations of packed and flu idized beds, leading to the development of a retrained model capable of incorporat ing volume fraction effects. Integration of the trained model with the MFiX CFD solver was achieved using FTorch, enabling drag predictions during discrete element method (DEM) simulations. Validation against experimental data for single particles and fluidized beds confirmed the model’s improved predictive ability, particularly for non-spherical geometries. While the model performed strongly under fluidized con ditions, limitations remained in unfluidized regimes, suggesting a need for expanded datasets. Overall, this study demonstrates the feasibility of combining deep learning with physics-informed CFD to improve drag modeling for gas–solid flows, with promis ing implications for scaling multiphase simulations in industrial applications.

42 ENGINEERING↗

Data-driven predictions of complex organic mixture permeation in polymer membranes

Membrane-based organic solvent separations are rapidly emerging as a promising class of technologies for enhancing the energy efficiency of existing separation and purification systems. Polymeric membranes have shown promise in the fractionation or splitting of complex mixtures of organic molecules such as crude oil. Determining the separation performance of a polymer membrane when challenged with a complex mixture has thus far occurred in an ad hoc manner, and methods to predict the performance based on mixture composition and polymer chemistry are unavailable. Here, we combine physics-informed machine learning algorithms (ML) and mass transport simulations to create an integrated predictive model for the separation of complex mixtures containing up to 400 components via any arbitrary linear polymer membrane. We experimentally demonstrate the effectiveness of the model by predicting the separation of two crude oils within 6-7% of the measurements. Integration of ML predictors of diffusion and sorption properties of molecules with transport simulators enables for the rapid screening of polymer membranes prior to physical experimentation for the separation of complex liquid mixtures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multioutput Convolutional Neural Network for Improved Parameter Extraction in Time-Resolved Electrostatic Force Microscopy Data

Time-resolved scanning probe microscopy methods, like time-resolved electrostatic force microscopy (trEFM), enable imaging of dynamic processes ranging from ion motion in batteries to electronic dynamics in microstructured thin film semiconductors for solar cells. Reconstructing the underlying physical dynamics from these techniques can be challenging due to the interplay of cantilever physics with the actual transient kinetics of interest in the resulting signal. Previously, quantitative trEFM used empirical calibration of the cantilever or feed-forward neural networks trained on simulated data to extract the physical dynamics of interest. Both these approaches are limited by interpreting the underlying signal as a single exponential function, which serves as an approximation but does not adequately reflect many realistic systems. Here, we present a multi-branched, multi-output convolutional neural network (CNN) that uses the trEFM signal in addition to the physical cantilever parameters as input. The trained CNN accurately extracts parameters describing both single-exponential and bi-exponential underlying functions, and more accurately reconstructs real experimental data in the presence of noise. This article demonstrates an application of physics-informed machine learning to complex signal processing tasks, enabling more efficient and accurate analysis of trEFM.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Physics-informed neural networks for inverse problems in nano-optics and metamaterials

In this paper, we employ the emerging paradigm of physics-informed neural networks (PINNs) for the solution of representative inverse scattering problems in photonic metamaterials and nano-optics technologies. In particular, we successfully apply mesh-free PINNs to the difficult task of retrieving the effective permittivity parameters of a number of finite-size scattering systems that involve many interacting nanostructures as well as multi-component nanoparticles. Our methodology is fully validated by numerical simulations based on the finite element method (FEM). The development of physics-informed deep learning techniques for inverse scattering can enable the design of novel functional nanostructures and significantly broaden the design space of metamaterials by naturally accounting for radiation and finite-size effects beyond the limitations of traditional effective medium theories.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantifying Energetic and Entropic Pathways in Molecular Systems

When examining dynamics occurring at nonzero temperatures, both energy and entropy must be taken into account to describe activated barrier crossing events. Furthermore, good reaction coordinates need to be constructed to describe different metastable states and the transition mechanisms between them. Here we use a physics-based machine learning method called state predictive information bottleneck (SPIB) to find nonlinear reaction coordinates for three systems of varying complexity. SPIB is able to correctly predict an entropic bottleneck for an analytical flat-energy double-well system and identify the entropy- and energy-dominated pathways for an analytical four-well system. Lastly, for a simulation of benzoic acid permeation through a lipid bilayer, SPIB is able to discover the entropic and energetic barriers to the permeation process. Given these results, we thus establish that SPIB is a reasonable and robust method for finding the important entropy, energy, and enthalpy barriers in physical systems, which can then be used to enhance the understanding and sampling of different activated mechanisms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Geothermal well testing pressure prediction by using a hybrid transformer model system: FORGE well use case

Geothermal has huge potential to become an indispensable component in achieving the goal of sustainable energy economy, given its capability to provide consistent baseload power to the electric grid. Injection tests are crucial in geothermal energy system as they naturally help to evaluate reservoir properties, understand fluid flow and even enhance reservoir performance. In this research, we developed a hybrid model system that integrates machine learning (ML) regression, a physics-based mathematical model, and transformer deep learning. Trained and validated using FORGE injection test dataset, this system can forecast the pressure variations both upward and downward over time. The pressure prediction achieved prediction accuracy within 3-6% variance of true pressure values. The system can significantly save time and reduce costs by testing only a few cycles and then using model predictions for further analysis, instead of conducting additional real injection cycle tests. The developed model system also holds promise for designing injection test processes and maintaining well production in geothermal energy. Presented at the IMAGE ‘25 Conference led by Shell.

FORGE↗

Chemically Enabled CO 2 -Enhanced Oil Recovery in Multi-Porosity, Hydrothermally Altered Carbonates in the Southern Michigan Basin - Task 2 Topical Report

This attachment A is a detailed Topical Report for Task 2 (Advanced Field Characterization and Machine Learning Based Data Integration) under the project "Chemically Enabled CO 2 -Enhanced Oil Recovery in Multi-Porosity, Hydrothermally Altered Carbonates in the Southern Michigan Basin." The overall project activity and finding, including the field pilot testing of CO 2 injection are summarized in the companion Final Technical Report The Advanced Field Characterization and Machine Learning Based Data Integration task (Task 2) involved a systematic geologic characterization of the Trenton-Black River (TBR) play in the SMB which included the development of comprehensive datasets, advanced data analytics, risk assessment, and piggyback field characterization. These activities aimed to address the complex carbonate systems by evaluating the extent of fractures, dolomitization, facies, and reservoir properties with the primary objective of informing the static and dynamic modeling, field injection test, and providing input into the development strategy plan. The task was divided into four subtasks: • Subtask 2.1 – Data compilation, review, and analysis • Subtask 2.2 – Risk Assessment • Subtask 2.3 – Advanced Field Characterization • Subtask 2.4 – Integrated Physics-Based Machine Learning and Advanced Data Analytics

02 PETROLEUM↗