Engineering PapersSearch

SEARCH · Engineering Papers

Results for “differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Inferring Plant Acclimation and Improving Model Generalizability With Differentiable Physics‐Informed Machine Learning of Photosynthesis

Net photosynthesis (A N ) is a key component of the global carbon cycle influencing climate feedback over decadal scales. Although plant acclimation to environmental changes can modify A N , traditional vegetation models in Earth system models (ESMs) often rely on plant functional type (PFT)-specific parameterizations or simplified acclimation assumptions limiting generalizability across time, space, and PFTs. In this study, we developed a differentiable photosynthesis model to learn the environmental dependencies of V c,max25 (maximum carboxylation rate at 25°C, representing photosynthetic capacity), as this genre of hybrid physics-informed machine learning can seamlessly train neural networks and process-based equations together. Compared to PFT-specific parameterization of V c,max25 , learning the environment dependencies of key photosynthetic parameters improved model spatiotemporal generalizability. Applying environmental acclimation to V c,max25 led to substantial variations in global mean A N indicating the need to address acclimation in ESMs. The model effectively captured multivariate observations (V c,max25 , A N , and stomatal conductance (g s )) simultaneously with multivariate constraints, improving generalization across space and PFTs. It also learned sensible acclimation relationships of V c,max25 to different environmental conditions. The model explained more than 54%, 57%, and 62% of the variance of A N , g s , and V c,max25 , respectively, presenting a first global-scale spatial test benchmark of A N and g s . These results highlight the potential for differentiable modeling to enhance process-based modules in ESMs and effectively leverage information from large, multivariate data sets.

54 ENVIRONMENTAL SCIENCES

High‐Resolution National‐Scale Water Modeling Is Enhanced by Multiscale Differentiable Physics‐Informed Machine Learning

Abstract The National Water Model (NWM) is a key tool for flood forecasting, planning, and water management. Key challenges facing the NWM include calibration and parameter regionalization when confronted with big data. We present two novel versions of high‐resolution (∼37 km 2 ) differentiable models (a type of hybrid model): one with implicit, unit‐hydrograph‐style routing and another with explicit Muskingum‐Cunge routing in the river network. The former predicts streamflow at basin outlets whereas the latter presents a discretized product that seamlessly covers rivers in the conterminous United States (CONUS). Both versions use neural networks to provide a multiscale parameterization and process‐based equations to provide a structural backbone, which were trained simultaneously (“end‐to‐end”) on 2,807 basins across the CONUS and evaluated on 4,997 basins. Both versions show great potential to elevate future NWM performance for extensively calibrated as well as ungauged sites: the median daily Nash‐Sutcliffe efficiency of all 4,997 basins is improved to around 0.68 from 0.48 of NWM3.0. As they resolve spatial heterogeneity, both versions greatly improved simulations in the western CONUS and also in the Prairie Pothole Region, a long‐standing modeling challenge. The Muskingum‐Cunge version further improved performance for basins >10,000 km 2 . Overall, our results show how neural‐network‐based parameterizations can improve NWM performance for providing operational flood predictions while maintaining interpretability and multivariate outputs. The modeling system supports the Basic Model Interface (BMI), which allows seamless integration with the next‐generation NWM. We also provide a CONUS‐scale hydrologic data set for further evaluation and use.

Song, Yalan [Civil and Environmental Engineering T

Flow annealed importance sampling bootstrap meets differentiable particle physics

High-energy physics requires the generation of large numbers of simulated data samples from complex but analytically tractable distributions called matrix elements. Surrogate models, such as normalizing flows, are gaining popularity for this task due to their computational efficiency. We adopt an approach based on flow annealed importance sampling bootstrap (FAB) that evaluates the differentiable target density during training and helps avoid the costly generation of training data in advance. We show that FAB reaches higher sampling efficiency with fewer target evaluations in high dimensions in comparison to other methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Chemical aspects of the formation of the solar system

Application of Alfven's theory for the formation of the solar system and the constraints imposed by the chemical composition of space materials are discussed with reference to chemical processes involved in the formation of the solar system. Evidence for the chemical properties of the space medium and the chemical consequences of the postulated physical differentiation processes are outlined, and interpretations based on structure and composition of meteorite material are indicated. A large range of topics, including processes involving chemical differentiation, temperature effects, and isotope fractionation, are examined.

Arrhenius, G.

The Dark Target Algorithm for Observing the Global Aerosol System: Past, Present and Future

The Dark Target aerosol algorithm was developed to exploit the information content available from the observations of Moderate-Resolution Imaging Spectroradiometers (MODIS), to better characterize the global aerosol system. The algorithm is based on measurements of the light scattered by aerosols toward a space-borne sensor against the backdrop of relatively dark Earth scenes, thus giving rise to the name “Dark Target”. Development required nearly a decade of research that included application of MODIS airborne simulators to provide test beds for proto-algorithms and analysis of existing data to form realistic assumptions to constrain surface reflectance and aerosol optical properties. This research in itself played a significant role in expanding our understanding of aerosol properties, even before Terra MODIS launch. Contributing to that understanding were the observations and retrievals of the growing Aerosol Robotic Network (AERONET) of sun-sky radiometers, which has walked hand-in-hand with MODIS and the development of other aerosol algorithms, providing validation of the satellite-retrieved products after launch. The MODIS Dark Target products prompted advances in Earth science and applications across subdisciplines such as climate, transport of aerosols, air quality, and data assimilation systems. Then, as the Terra and Aqua MODIS sensors aged, the challenge was to monitor the effects of calibration drifts on the aerosol products and to differentiate physical trends in the aerosol system from artefacts introduced by instrument characterization. Our intention is to continue to adapt and apply the well-vetted Dark Target algorithms to new instruments, including both polar-orbiting and geosynchronous sensors. The goal is to produce an uninterrupted time series of an aerosol climate data record that begins at the dawn of the 21st century and continues indefinitely into the future.

Aerosol

Random operator equations in mathematical physics. I

Stochastic differential equations objectives, limitations and restrictive assumptions in physical problems, discussing electromagnetic wave propagation in random continuum or random dAlembertian operator

Adomian, G.

A physics-constrained neural ordinary differential equations approach for robust learning of stiff chemical kinetics

The high computational cost associated with solving for detailed chemistry poses a significant challenge for predictive computational fluid dynamics (CFD) simulations of turbulent reacting flows. While deep learning techniques have been explored to develop faster surrogate models, they often fail to integrate reliably with CFD solvers. This instability arises because traditional deep learning approaches optimize for training error without ensuring compatibility with ordinary differential equation (ODE) solvers, resulting in accumulation of errors over time. Recently, neuralODE (NODE) based approaches have been shown to be a promising technique to emulate and accelerate detailed chemistry computations. Here, in the present work, we extend this NODE framework for stiff chemical kinetics by incorporating mass conservation constraints directly into the loss function during training. This ensures that the total mass as well as the individual elemental species masses are conserved in an a-posteriori manner. Proof-of-concept studies are performed with the novel physics-constrained NODE (PC-NODE) approach for homogeneous autoignition of hydrogen-air mixture over a range of composition and thermodynamic conditions. It is demonstrated that the PC-NODE framework not only improves the physical consistency of the resulting data-driven model with respect to mass conservation criteria, but also improves training efficiency. PC-NODE is shown to achieve 2–100× speedup relative to the hydrogen-air detailed chemical mechanism depending on the type of the ODE solver (implicit or explicit) used during autoregressive inference tests. Lastly, a-posteriori studies are performed wherein the trained PC-NODE model is coupled with a CFD solver. It is shown that higher accuracy is achieved with PC-NODE relative to the purely data-driven NODE approach. Moreover, PC-NODE also exhibits robustness and generalizability to unseen initial conditions from within (interpolative capability) as well as outside (extrapolative capability) the training regime.

computational combustion

Progress in end-to-end optimization of fundamental physics experimental apparata with differentiable programming

In this article we examine recent developments in the research area concerning the creation of end-to-end models for the complete optimization of measuring instruments. The models we consider rely on differentiable programming methods and on the specification of a software pipeline including all factors impacting performance — from the data-generating processes to their reconstruction and the inference on the parameters of interest — along with the careful specification of a utility function well aligned with the end goals of the experiment. Building on previous studies originated within the MODE Collaboration, we focus specifically on applications involving instruments for particle physics experimentation, as well as industrial and medical applications that share the detection of radiation as their data-generating mechanism. This report illustrates the most recent advancements in the area, and outlines, for each of the discussed applications as well as for automatic differentiation itself, ongoing and future work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND

Hyperbolic vacua in Minkowski space

Families of Lorentz, but not Poincare, invariant vacua are constructed for a massless scalar field in 4D Minkowski space. These are generalizations of the Rindler vacuum with a larger symmetry group. Explicit expressions are given as squeezed excitations of the Poincare vacuum. The effective reduced vacua on the 3D hyperbolic de Sitter slices are the well-known de Sitter α-vacua with antipodal singularities in the Wightman function. Several special interesting cases are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC

Rare Lepton Decays and Differentiable Hadronization Models - From Signatures of New Physics to Data-driven Event Generation

This dissertation is partitioned into two parts: phenomenological studies focused on rare lepton decays as probes of heavy and light new physics, and the development of differentiable, data-driven hadronization models. Part I develops the phenomenology of new physics signatures stemming from rare charged lepton flavor violating decays probed by experiments at the intensity frontier. These include interactions mediated by both high-scale effective operators and light new physics, manifesting in multi-lepton final states ($\mu \to 5e$), elastic nuclear transitions ($\mu \to e$ conversion), baryon-number-violating muon capture, and time-dependent signals from ultralight dark matter ($\mu \to e \phi, \tau \to \ell \phi$). Part II develops two distinct strategies for advancing differentiable and data-driven hadronization models. One involves comprehensive reweighting frameworks for hadronization that enable efficient uncertainty estimation, facilitate parameter tuning, and interface naturally with differentiable programming paradigms. The other introduces machine-learning-based methods for extracting microscopic fragmentation dynamics directly from macroscopic observables through the deformation of existing models -- effectively providing solutions to the inverse problem of hadronization. Altogether, these studies advance the interpretability, flexibility, and precision of theoretical predictions for both high-intensity and high-energy experiments.

Menzo, Tony [Cincinnati U.] (ORCID:000000022013457

Differentiable multiphase flow model for physics-informed machine learning in reservoir pressure management

Accurate subsurface reservoir pressure control is extremely challenging due to geological heterogeneity and multiphase fluid-flow dynamics. Predicting behavior in this setting relies on high-fidelity physics-based simulations that are computationally expensive. Yet, the uncertain, heterogeneous properties that control these flows make it necessary to perform many of these expensive simulations, which is often prohibitive. To address these challenges, we introduce a physics-informed machine learning workflow that couples a fully differentiable multiphase flow simulator, which is implemented in the DPFEHM framework with a convolutional neural network (CNN). The CNN learns to predict fluid extraction rates from heterogeneous permeability fields to enforce pressure limits at critical reservoir locations. By incorporating transient multiphase flow physics into the training process, our method enables more practical and accurate predictions for realistic injection-extraction scenarios compared to previous works. To speed up training, we pretrain the model on single-phase, steady-state simulations and then finetune it on full multiphase scenarios, which dramatically reduces the computational cost. We demonstrate that high-accuracy training can be achieved with fewer than three thousand full-physics multiphase flow simulations – compared to previous estimates requiring up to ten million. This drastic reduction in the number of simulations is achieved by leveraging transfer learning from much less expensive single phase simulations.

25 ENERGY STORAGE

Plasma proteomic biomarkers of physical frailty in heart failure: a propensity score matched discovery-based pilot study

Background: Physical frailty is highly prevalent in heart failure (HF), but we lack an understanding of the underlying pathophysiology. Proteomics evaluation of plasma samples may elucidate potential mechanisms and biomarkers of physical frailty in HF. We aimed to identify plasma proteomic biomarkers that are differentially expressed between physically frail and non physically frail adults with HF. Methods: This was a secondary analysis of a subset of data and plasma samples from a study of frailty among patients with New York Heart Association (NYHA) Functional Classification I-IV HF. Physical frailty was measured using the Frailty Phenotype Criteria. Propensity score matching was used to match pairs of physically frail (n = 20) vs. non-physically frail (n = 20) patients on clinical characteristics. Plasma samples were processed using a sensitive liquid chromatography mass spectrometry platform, utilizing a multiplexed tandem mass tag-labeled quantitative proteomics approach. Differentially expressed proteins were quantified individually using paired t tests with associated log fold change of 0.3 and Fisher’s combined p values. Results: The sample (n = 40) was 62.8±16.9 years old, 58% female, and 55% NYHA Class III/IV. Proteomics analysis revealed 7 proteins differentially expressed using full differential criteria: matrix metalloproteinase-14 was downregulated in frailty, and copine-1, low affinity immunoglobulin gamma Fc region receptor III-A and III-B, probable non-functional immunoglobulin kappa variable 2D-24, glutathione S-transferase Mu 1, and argininosuccinate lyase were upregulated in frailty. Conclusions: Proteomic biomarkers related to the immune system, stress response, and detoxification were differentially expressed between physically frail and non-physically frail adults with HF.

Biomarkers

On the dependence of solar flare X-ray spectral line intensity ratios of highly ionized sulfur, calcium, and iron on electron temperature, differential emission measure, and atomic physics

This paper focuses on what can be learned about the emission measure distribution and certain atomic physics parameters from spectral lines of highly ionized ions of sulfur, calcium, and iron that appear in solar flare spectra. The particular lines chosen for analysis allow the electron temperature to be determined independently of the assumption of ionization equilibrium. An attempt is made to find emission measure models based on selected functional dependences of emission measure on temperature that reproduce the observed temperatures deduced from spectral line ratios as well as the relative intensities of resonance lines of different elements.

Doschek, G. A.