Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Hyperbolic vacua in Minkowski space

Families of Lorentz, but not Poincare, invariant vacua are constructed for a massless scalar field in 4D Minkowski space. These are generalizations of the Rindler vacuum with a larger symmetry group. Explicit expressions are given as squeezed excitations of the Poincare vacuum. The effective reduced vacua on the 3D hyperbolic de Sitter slices are the well-known de Sitter α-vacua with antipodal singularities in the Wightman function. Several special interesting cases are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Physics-informed machine learning with differentiable programming for heterogeneous underground reservoir pressure management

Abstract Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO $$_2$$ 2 sequestration and wastewater injection. Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface. The heterogeneity typically requires high-fidelity physics-based models to make predictions on CO $$_2$$ 2 fate. Furthermore, characterizing the heterogeneity accurately is fraught with parametric uncertainty. Accounting for both, heterogeneity and uncertainty, makes this a computationally-intensive problem challenging for current reservoir simulators. To tackle this, we use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization at critical reservoir locations. We use DPFEHM framework, which has trustworthy physics based on the standard two-point flux finite volume discretization and is also automatically differentiable like machine learning models. Our physics-informed machine learning framework uses convolutional neural networks to learn an appropriate extraction rate based on the permeability field. We also perform a hyperparameter search to improve the model’s accuracy. Training and testing scenarios are executed to evaluate the feasibility of using physics-informed machine learning to manage reservoir pressures. We constructed and tested a sufficiently accurate simulator that is 400 000 times faster than the underlying physics-based simulator, allowing for near real-time analysis and robust uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Rare Lepton Decays and Differentiable Hadronization Models - From Signatures of New Physics to Data-driven Event Generation

This dissertation is partitioned into two parts: phenomenological studies focused on rare lepton decays as probes of heavy and light new physics, and the development of differentiable, data-driven hadronization models. Part I develops the phenomenology of new physics signatures stemming from rare charged lepton flavor violating decays probed by experiments at the intensity frontier. These include interactions mediated by both high-scale effective operators and light new physics, manifesting in multi-lepton final states ($\mu \to 5e$), elastic nuclear transitions ($\mu \to e$ conversion), baryon-number-violating muon capture, and time-dependent signals from ultralight dark matter ($\mu \to e \phi, \tau \to \ell \phi$). Part II develops two distinct strategies for advancing differentiable and data-driven hadronization models. One involves comprehensive reweighting frameworks for hadronization that enable efficient uncertainty estimation, facilitate parameter tuning, and interface naturally with differentiable programming paradigms. The other introduces machine-learning-based methods for extracting microscopic fragmentation dynamics directly from macroscopic observables through the deformation of existing models -- effectively providing solutions to the inverse problem of hadronization. Altogether, these studies advance the interpretability, flexibility, and precision of theoretical predictions for both high-intensity and high-energy experiments.

Menzo, Tony [Cincinnati U.] (ORCID:000000022013457↗
DOE OSTI2023

Physics-embedded inverse analysis with algorithmic differentiation for the earth’s subsurface

Abstract Inverse analysis has been utilized to understand unknown underground geological properties by matching the observational data with simulators. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented with embedded physics and a technique known as algorithmic differentiation. We use a physics-embedded generative model, which takes statistically simple parameters as input and outputs subsurface properties (e.g., permeability or P-wave velocity), that embeds physical knowledge of the subsurface properties into inverse analysis and improves its performance. We tested the application of this approach on four geologic problems: two heterogeneous hydraulic conductivity fields, a hydraulic fracture network, and a seismic inversion for P-wave velocity. This physics-embedded inverse analysis approach consistently characterizes these geological problems accurately. Furthermore, the excellent performance in matching the observational data demonstrates the reliability of the proposed method. Moreover, the application of algorithmic differentiation makes this an easy and fast approach to inverse analysis when dealing with complicated geological structures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Differentiable multiphase flow model for physics-informed machine learning in reservoir pressure management

Accurate subsurface reservoir pressure control is extremely challenging due to geological heterogeneity and multiphase fluid-flow dynamics. Predicting behavior in this setting relies on high-fidelity physics-based simulations that are computationally expensive. Yet, the uncertain, heterogeneous properties that control these flows make it necessary to perform many of these expensive simulations, which is often prohibitive. To address these challenges, we introduce a physics-informed machine learning workflow that couples a fully differentiable multiphase flow simulator, which is implemented in the DPFEHM framework with a convolutional neural network (CNN). The CNN learns to predict fluid extraction rates from heterogeneous permeability fields to enforce pressure limits at critical reservoir locations. By incorporating transient multiphase flow physics into the training process, our method enables more practical and accurate predictions for realistic injection-extraction scenarios compared to previous works. To speed up training, we pretrain the model on single-phase, steady-state simulations and then finetune it on full multiphase scenarios, which dramatically reduces the computational cost. We demonstrate that high-accuracy training can be achieved with fewer than three thousand full-physics multiphase flow simulations – compared to previous estimates requiring up to ten million. This drastic reduction in the number of simulations is achieved by leveraging transfer learning from much less expensive single phase simulations.

25 ENERGY STORAGE↗
DOE OSTI2023

A multifidelity deep operator network approach to closure for multiscale systems

Projection-based reduced order models (PROMs) have shown promise in representing the behavior of multiscale systems using a small set of generalized (or latent) variables. Despite their success, PROMs can be susceptible to inaccuracies, even instabilities, due to the improper accounting of the interaction between the resolved and unresolved scales of the multiscale system (known as the closure problem). In the current work, we interpret closure as a multifidelity problem and use a multifidelity deep operator network (DeepONet) framework to address it. In addition, to enhance the stability and/or accuracy of the multifidelity-based closure, we employ the recently developed ``in-the-loop" training approach from the literature on coupling physics and machine learning models. The resulting approach is tested on shock advection for the one-dimensional viscous Burgers equation and vortex merging for the two-dimensional Navier-Stokes equations. Furthermore, the numerical experiments show significant improvement of the predictive ability of the closure-corrected PROM over the un-corrected one both in the interpolative and the extrapolative regimes.

42 ENGINEERING↗
DOE OSTI2022

Reactivity Coefficient Measurements and Sensitivity Studies [Abstract]

Nuclear data validation is often performed today using criticality measurements. The gold standard for criticality measurements is the International Criticality Safety Benchmark Experiment Project (ICSBEP). The validation specifically focuses on the effective multiplication factor (k eff ). K eff is a relatively easy parameter to infer and has reduced uncertainty due to being at or above critical. However, while k eff is a well-documented parameter with detailed sensitivity and uncertainty analysis, it cannot be used as a standalone metric to determine inaccuracies in nuclear data (e.g., cross section data, PFNS, nu), which is based on theory, physics, and differential measurements. The Experiments Underpinned by Computational Learning for Improvements in nuclear Data (EUCLID) project aims to identify compensating errors in specific nuclear data by optimally designing experiments that are sensitive to a suite of measurement parameters beyond k eff . By identifying how each parameter's nuclear data sensitivity differs from others, experiments can be designed to constrain questionable nuclear data. One sensitivity that is of particular interest to this project includes reactivity coefficient sensitivities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Neutron elastic and inelastic cross section measurements on silicon from 0.8--8 MeV

Neutron elastic and inelastic scattering differential cross sections were measured at angles between 30° and 155° with incident neutron energies between 0.8 and 8 MeV. The measured differential scattering cross sections are compared to existing measurements and the ENDF/B-VIII.0, the JEFF-3.3, and the JENDL-4.0 data evaluations, as well as theoretical calculations from the TALYS-1.95 nuclear reaction code. Our results are reasonably well described by values from the ENDF/B-VIII.0 and JEFF-3.3 compilations. However, below 4 MeV, our backward-angle elastic scattering results tend to be lower than database/calculated values, suggesting that less recoil damage would occur than expected. Above 6 MeV, larger backward-angle cross sections are observed suggesting the opposite. Deexcitation γ rays produced in the inelastic scattering process were also studied for neutron energies between 1.9 and 4.5 MeV. Inelastic neutron scattering cross sections deduced from 28 Si(n,n1γ) γ-ray projection cross sections confirm our 28 Si(n,n1) results. To the extent that data from GELINA and our experimental results can be compared, we have excellent agreement between the inelastic neutron scattering cross sections.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Plasma proteomic biomarkers of physical frailty in heart failure: a propensity score matched discovery-based pilot study

Background: Physical frailty is highly prevalent in heart failure (HF), but we lack an understanding of the underlying pathophysiology. Proteomics evaluation of plasma samples may elucidate potential mechanisms and biomarkers of physical frailty in HF. We aimed to identify plasma proteomic biomarkers that are differentially expressed between physically frail and non physically frail adults with HF. Methods: This was a secondary analysis of a subset of data and plasma samples from a study of frailty among patients with New York Heart Association (NYHA) Functional Classification I-IV HF. Physical frailty was measured using the Frailty Phenotype Criteria. Propensity score matching was used to match pairs of physically frail (n = 20) vs. non-physically frail (n = 20) patients on clinical characteristics. Plasma samples were processed using a sensitive liquid chromatography mass spectrometry platform, utilizing a multiplexed tandem mass tag-labeled quantitative proteomics approach. Differentially expressed proteins were quantified individually using paired t tests with associated log fold change of 0.3 and Fisher’s combined p values. Results: The sample (n = 40) was 62.8±16.9 years old, 58% female, and 55% NYHA Class III/IV. Proteomics analysis revealed 7 proteins differentially expressed using full differential criteria: matrix metalloproteinase-14 was downregulated in frailty, and copine-1, low affinity immunoglobulin gamma Fc region receptor III-A and III-B, probable non-functional immunoglobulin kappa variable 2D-24, glutathione S-transferase Mu 1, and argininosuccinate lyase were upregulated in frailty. Conclusions: Proteomic biomarkers related to the immune system, stress response, and detoxification were differentially expressed between physically frail and non-physically frail adults with HF.

Biomarkers↗
DOE OSTI2023

Transformative Technology for FLASH Radiation Therapy

The general concept of radiation therapy used in conventional cancer treatment is to increase the therapeutic index by creating a physical dose differential between tumors and normal tissues through precision dose targeting, image guidance, and radiation beams that deliver a radiation dose with high conformality, e.g., protons and ions. However, the treatment and cure are still limited by normal tissue radiation toxicity, with the corresponding side effects. A fundamentally different paradigm for increasing the therapeutic index of radiation therapy has emerged recently, supported by preclinical research, and based on the FLASH radiation effect. FLASH radiation therapy (FLASH-RT) is an ultra-high-dose-rate delivery of a therapeutic radiation dose within a fraction of a second. Experimental studies have shown that normal tissues seem to be universally spared at these high dose rates, whereas tumors are not. While dose delivery conditions to achieve a FLASH effect are not yet fully characterized, it is currently estimated that doses delivered in less than 200 ms produce normal-tissue-sparing effects, yet effectively kill tumor cells. Despite a great opportunity, there are many technical challenges for the accelerator community to create the required dose rates with novel compact accelerators to ensure the safe delivery of FLASH radiation beams.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

FLASSH 1.0: Thermal scattering law evaluation and cross section generation for reactor physics applications

The Full Law Analysis Scattering System Hub (FLASSH) is a modern, advanced code which evaluates the thermal scattering law (TSL) along with accompanying cross sections. FLASSH features generalized methods which accommodate any material structure. Historical approximations including the incoherent and cubic approximations have been removed. Instead, the latest release of FLASSH features advanced physics options including distinct corrections (1-phonon contributions) and non-cubic formulations. The non-cubic elastic and inelastic contributions are necessary to accurately evaluate 1-phonon contributions. Both non-cubic and 1-phonon calculations require high-density sampling of the various scattering directions. Optimization and parallelization of these routines were therefore necessary to produce results in a reasonable timeframe. With these notable improvements to the generalized TSL, FLASSH 1.0 meets benchmark requirements, demonstrating noticeable agreement with experiment for both TSLs and the resulting integrated cross sections. Additional features including a graphical user interface (GUI), plotting diagnostics, and formatted output options including ACE files allow users to complete a TSL evaluation with minimal input and maximum flexibility. The user GUI creates input files for FLASSH, reducing user error and also providing built-in error checks. Autofill options and suggested input values help make TSL evaluation accessible to novice users. The FLASSH code is compiled to run on both Windows and Linux platforms with automatic parallelization. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Design of a neutral thermal scattering (NeTS) module for hydrogen in light water

The accurate representation of thermal scattering law (TSL) data is integral to the design and characterization of many modern nuclear systems, particularly those using light water as a moderator/coolant. As a material-dependent distribution over energy-momentum phase space, the TSL may exhibit a variety of unique and relevant conditional (e.g., temperature, pressure) and compositional (e.g., porosity, stoichiometry, radiation damage) dependencies. Currently, there are various approaches to incorporate temperature dependence, which is especially important in coupled neutronic-thermal hydraulic simulations. In each approach, there is an inherent tradeoff between memory consumption and accuracy. Some techniques require tens to hundreds of MBs or more, while others fail to reproduce the underlying data to within 10% error over the considered input domain, despite having a reduced storage burden. This work aims to address both sides of the tradeoff simultaneously by implementing a novel deep learning (DL) approach to TSL representation. The neural thermal scattering (NeTS) concept, which is amenable to an arbitrary number of dependencies, is demonstrated via the inclusion of temperature dependence into a highly compact, highly accurate functional form of the multi- variate TSL (i.e., S(α, β, T)) for hydrogen in light water. Resulting storage requirements are on the order of 100 kB, and median and maximum percent deviations are on the order of 0.1% and 1%, respectively. These measures represent a step improvement over previous techniques. Notably, the developed neural network and feature methodology build on those employed in prior work on beryllium oxide. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Machine Learning to Select Experiments Driven by Fundamental Science and Applications for Targeted Nuclear Data Improvement

This work describes a blueprint for a process that accelerates progress in science by quantitatively answering the following question: What is the optimal combination of fundamental-science and application-driven experiments to maximally reduce pertinent data uncertainties? Answering this question entails solving a high-dimensional and complex optimization problem that is best solved with advanced statistic techniques often classified as machine learning. We apply this process within the framework of nuclear data with the aim to select an experiment combination that will reduce uncertainties in 239 Pu nuclear data for neutron energies between 1 and 600 keV. In this field, fundamental-physics driven data, called differential, look at one nuclear physics observable at a time. They are contrasted to application-driven, integral, data where one or few resulting values inform a broad set of nuclear data across several nuclides and energies. The candidates for integral experiments are criticality measurements that were refined by a genetic algorithm to be maximally sensitive to 239 Pu fission cross sections in the desired energy range. Twenty-three candidate differential experiments were investigated and span multiple nuclear physics observables (e.g., total, capture cross sections) for isotopes appearing in the integral experiments. The optimal combination among these candidate experiments was investigated via generalized least squares fitting, augmented with Gaussian processes to ameliorate statistical irregularities in data, and the D-optimality criterion. The latter evaluates for each pair of candidates the joint reduction in uncertainties of all 12200 nuclear data appearing in the integral experiments compared to the knowledge we have from 168 past experiments, theory, and nuclear data. We chose as differential measurements those that investigate 63 Cu and 239 Pu total cross sections, based on D-optimality rank and feasibility constraints. Two integral (criticality) experiments were selected: An experiment with Al 2 ⁢O 3 and graphite interleaved with Pu and a thick Cu reflector explores 1–30 keV, while we target the 30–600 keV range with an experiment that swaps boron in place of graphite with a different geometry.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Differentiable modelling to unify machine learning and physical models for geosciences

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. Here, in this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

58 GEOSCIENCES↗
DOE OSTI2024

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES↗
DOE OSTI2024

Physics-informed State-space Neural Networks for transport phenomena

This work introduces Physics -informed State -space neural network Models (PSMs), a novel solution to achieving real-time optimization, flexibility, and fault tolerance in autonomous systems, particularly in transportdominated systems such as chemical, biomedical, and power plants. Traditional data -driven methods fall short due to a lack of physical constraints like mass conservation; PSMs address this issue by training deep neural networks with sensor data and physics -informing using components' Partial Differential Equations (PDEs), resulting in a physics -constrained, end -to -end differentiable forward dynamics model. Further, through two in silico experiments - a heated channel and a cooling system loop - we demonstrate that PSMs offer a more accurate approach than a purely data -driven model. In the former experiment, PSMs demonstrated significantly lower average root -mean -square errors across test datasets compared to a purely data -driven neural network, with reductions of 44 %, 48 %, and 94 % in predicting pressure, velocity, and temperature, respectively. Beyond accuracy, PSMs demonstrate a compelling multitask capability, making them highly versatile. In this work, we showcase two: supervisory control of a nonlinear system through a sequentially updated state -space representation and the proposal of a diagnostic algorithm using residuals from each of the PDEs. The former demonstrates PSMs' ability to handle constant and time -dependent constraints, while the latter illustrates their value in system diagnostics and fault detection.

42 ENGINEERING↗