Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Progress in end-to-end optimization of fundamental physics experimental apparata with differentiable programming

In this article we examine recent developments in the research area concerning the creation of end-to-end models for the complete optimization of measuring instruments. The models we consider rely on differentiable programming methods and on the specification of a software pipeline including all factors impacting performance — from the data-generating processes to their reconstruction and the inference on the parameters of interest — along with the careful specification of a utility function well aligned with the end goals of the experiment. Building on previous studies originated within the MODE Collaboration, we focus specifically on applications involving instruments for particle physics experimentation, as well as industrial and medical applications that share the detection of radiation as their data-generating mechanism. This report illustrates the most recent advancements in the area, and outlines, for each of the discussed applications as well as for automatic differentiation itself, ongoing and future work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Hyperbolic vacua in Minkowski space

Families of Lorentz, but not Poincare, invariant vacua are constructed for a massless scalar field in 4D Minkowski space. These are generalizations of the Rindler vacuum with a larger symmetry group. Explicit expressions are given as squeezed excitations of the Poincare vacuum. The effective reduced vacua on the 3D hyperbolic de Sitter slices are the well-known de Sitter α-vacua with antipodal singularities in the Wightman function. Several special interesting cases are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Physics-informed machine learning with differentiable programming for heterogeneous underground reservoir pressure management

Abstract Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO $$_2$$ 2 sequestration and wastewater injection. Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface. The heterogeneity typically requires high-fidelity physics-based models to make predictions on CO $$_2$$ 2 fate. Furthermore, characterizing the heterogeneity accurately is fraught with parametric uncertainty. Accounting for both, heterogeneity and uncertainty, makes this a computationally-intensive problem challenging for current reservoir simulators. To tackle this, we use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization at critical reservoir locations. We use DPFEHM framework, which has trustworthy physics based on the standard two-point flux finite volume discretization and is also automatically differentiable like machine learning models. Our physics-informed machine learning framework uses convolutional neural networks to learn an appropriate extraction rate based on the permeability field. We also perform a hyperparameter search to improve the model’s accuracy. Training and testing scenarios are executed to evaluate the feasibility of using physics-informed machine learning to manage reservoir pressures. We constructed and tested a sufficiently accurate simulator that is 400 000 times faster than the underlying physics-based simulator, allowing for near real-time analysis and robust uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗

Rare Lepton Decays and Differentiable Hadronization Models - From Signatures of New Physics to Data-driven Event Generation

This dissertation is partitioned into two parts: phenomenological studies focused on rare lepton decays as probes of heavy and light new physics, and the development of differentiable, data-driven hadronization models. Part I develops the phenomenology of new physics signatures stemming from rare charged lepton flavor violating decays probed by experiments at the intensity frontier. These include interactions mediated by both high-scale effective operators and light new physics, manifesting in multi-lepton final states ($\mu \to 5e$), elastic nuclear transitions ($\mu \to e$ conversion), baryon-number-violating muon capture, and time-dependent signals from ultralight dark matter ($\mu \to e \phi, \tau \to \ell \phi$). Part II develops two distinct strategies for advancing differentiable and data-driven hadronization models. One involves comprehensive reweighting frameworks for hadronization that enable efficient uncertainty estimation, facilitate parameter tuning, and interface naturally with differentiable programming paradigms. The other introduces machine-learning-based methods for extracting microscopic fragmentation dynamics directly from macroscopic observables through the deformation of existing models -- effectively providing solutions to the inverse problem of hadronization. Altogether, these studies advance the interpretability, flexibility, and precision of theoretical predictions for both high-intensity and high-energy experiments.

Menzo, Tony [Cincinnati U.] (ORCID:000000022013457↗

Physics-embedded inverse analysis with algorithmic differentiation for the earth’s subsurface

Abstract Inverse analysis has been utilized to understand unknown underground geological properties by matching the observational data with simulators. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented with embedded physics and a technique known as algorithmic differentiation. We use a physics-embedded generative model, which takes statistically simple parameters as input and outputs subsurface properties (e.g., permeability or P-wave velocity), that embeds physical knowledge of the subsurface properties into inverse analysis and improves its performance. We tested the application of this approach on four geologic problems: two heterogeneous hydraulic conductivity fields, a hydraulic fracture network, and a seismic inversion for P-wave velocity. This physics-embedded inverse analysis approach consistently characterizes these geological problems accurately. Furthermore, the excellent performance in matching the observational data demonstrates the reliability of the proposed method. Moreover, the application of algorithmic differentiation makes this an easy and fast approach to inverse analysis when dealing with complicated geological structures.

54 ENVIRONMENTAL SCIENCES↗

Differentiable multiphase flow model for physics-informed machine learning in reservoir pressure management

Accurate subsurface reservoir pressure control is extremely challenging due to geological heterogeneity and multiphase fluid-flow dynamics. Predicting behavior in this setting relies on high-fidelity physics-based simulations that are computationally expensive. Yet, the uncertain, heterogeneous properties that control these flows make it necessary to perform many of these expensive simulations, which is often prohibitive. To address these challenges, we introduce a physics-informed machine learning workflow that couples a fully differentiable multiphase flow simulator, which is implemented in the DPFEHM framework with a convolutional neural network (CNN). The CNN learns to predict fluid extraction rates from heterogeneous permeability fields to enforce pressure limits at critical reservoir locations. By incorporating transient multiphase flow physics into the training process, our method enables more practical and accurate predictions for realistic injection-extraction scenarios compared to previous works. To speed up training, we pretrain the model on single-phase, steady-state simulations and then finetune it on full multiphase scenarios, which dramatically reduces the computational cost. We demonstrate that high-accuracy training can be achieved with fewer than three thousand full-physics multiphase flow simulations – compared to previous estimates requiring up to ten million. This drastic reduction in the number of simulations is achieved by leveraging transfer learning from much less expensive single phase simulations.

25 ENERGY STORAGE↗

A multifidelity deep operator network approach to closure for multiscale systems

Projection-based reduced order models (PROMs) have shown promise in representing the behavior of multiscale systems using a small set of generalized (or latent) variables. Despite their success, PROMs can be susceptible to inaccuracies, even instabilities, due to the improper accounting of the interaction between the resolved and unresolved scales of the multiscale system (known as the closure problem). In the current work, we interpret closure as a multifidelity problem and use a multifidelity deep operator network (DeepONet) framework to address it. In addition, to enhance the stability and/or accuracy of the multifidelity-based closure, we employ the recently developed ``in-the-loop" training approach from the literature on coupling physics and machine learning models. The resulting approach is tested on shock advection for the one-dimensional viscous Burgers equation and vortex merging for the two-dimensional Navier-Stokes equations. Furthermore, the numerical experiments show significant improvement of the predictive ability of the closure-corrected PROM over the un-corrected one both in the interpolative and the extrapolative regimes.

42 ENGINEERING↗

Plasma proteomic biomarkers of physical frailty in heart failure: a propensity score matched discovery-based pilot study

Background: Physical frailty is highly prevalent in heart failure (HF), but we lack an understanding of the underlying pathophysiology. Proteomics evaluation of plasma samples may elucidate potential mechanisms and biomarkers of physical frailty in HF. We aimed to identify plasma proteomic biomarkers that are differentially expressed between physically frail and non physically frail adults with HF. Methods: This was a secondary analysis of a subset of data and plasma samples from a study of frailty among patients with New York Heart Association (NYHA) Functional Classification I-IV HF. Physical frailty was measured using the Frailty Phenotype Criteria. Propensity score matching was used to match pairs of physically frail (n = 20) vs. non-physically frail (n = 20) patients on clinical characteristics. Plasma samples were processed using a sensitive liquid chromatography mass spectrometry platform, utilizing a multiplexed tandem mass tag-labeled quantitative proteomics approach. Differentially expressed proteins were quantified individually using paired t tests with associated log fold change of 0.3 and Fisher’s combined p values. Results: The sample (n = 40) was 62.8±16.9 years old, 58% female, and 55% NYHA Class III/IV. Proteomics analysis revealed 7 proteins differentially expressed using full differential criteria: matrix metalloproteinase-14 was downregulated in frailty, and copine-1, low affinity immunoglobulin gamma Fc region receptor III-A and III-B, probable non-functional immunoglobulin kappa variable 2D-24, glutathione S-transferase Mu 1, and argininosuccinate lyase were upregulated in frailty. Conclusions: Proteomic biomarkers related to the immune system, stress response, and detoxification were differentially expressed between physically frail and non-physically frail adults with HF.

Biomarkers↗

Transformative Technology for FLASH Radiation Therapy

The general concept of radiation therapy used in conventional cancer treatment is to increase the therapeutic index by creating a physical dose differential between tumors and normal tissues through precision dose targeting, image guidance, and radiation beams that deliver a radiation dose with high conformality, e.g., protons and ions. However, the treatment and cure are still limited by normal tissue radiation toxicity, with the corresponding side effects. A fundamentally different paradigm for increasing the therapeutic index of radiation therapy has emerged recently, supported by preclinical research, and based on the FLASH radiation effect. FLASH radiation therapy (FLASH-RT) is an ultra-high-dose-rate delivery of a therapeutic radiation dose within a fraction of a second. Experimental studies have shown that normal tissues seem to be universally spared at these high dose rates, whereas tumors are not. While dose delivery conditions to achieve a FLASH effect are not yet fully characterized, it is currently estimated that doses delivered in less than 200 ms produce normal-tissue-sparing effects, yet effectively kill tumor cells. Despite a great opportunity, there are many technical challenges for the accelerator community to create the required dose rates with novel compact accelerators to ensure the safe delivery of FLASH radiation beams.

43 PARTICLE ACCELERATORS↗

On the dependence of solar flare X-ray spectral line intensity ratios of highly ionized sulfur, calcium, and iron on electron temperature, differential emission measure, and atomic physics

This paper focuses on what can be learned about the emission measure distribution and certain atomic physics parameters from spectral lines of highly ionized ions of sulfur, calcium, and iron that appear in solar flare spectra. The particular lines chosen for analysis allow the electron temperature to be determined independently of the assumption of ionization equilibrium. An attempt is made to find emission measure models based on selected functional dependences of emission measure on temperature that reproduce the observed temperatures deduced from spectral line ratios as well as the relative intensities of resonance lines of different elements.

Doschek, G. A.↗

Physical association and functional interaction between beta1 integrin and CD98 on human T lymphocytes

CD98 is a cell surface protein previously characterized as a cell activation marker, an amino acid transporter, and has recently been implicated in integrin-related functions. Integrins are cell surface proteins, important for homotypic cell aggregation, cell adhesion, and coactivation of T lymphocytes. We have previously shown that the anti-CD98 mAb 80A10, when coimmobilized with anti-CD3 mAb OKT3, is able to mediate human T cell coactivation that is inhibited by anti-beta1 integrin specific mAb 18D3. These results indicated a functional association of CD98 and beta1 integrin signaling but left open the question of a physical association. We now show the induction of homotypic aggregation through CD98 among human T cells and this aggregation was inhibited by anti-beta1 integrin mAb. Therefore, CD98-dependent lymphocyte proliferation and adhesion may involve integrins. Competitive binding assays and fluorescence colocalization analysis suggested that CD98 and beta1 integrin were physically associated. Differential extraction techniques and immunoprecipitations provided the first evidence that the alpha4beta1 integrin and CD98 are specifically associated on human T lymphocytes.

NASA Discipline Cell Biology↗

Machine Learning to Select Experiments Driven by Fundamental Science and Applications for Targeted Nuclear Data Improvement

This work describes a blueprint for a process that accelerates progress in science by quantitatively answering the following question: What is the optimal combination of fundamental-science and application-driven experiments to maximally reduce pertinent data uncertainties? Answering this question entails solving a high-dimensional and complex optimization problem that is best solved with advanced statistic techniques often classified as machine learning. We apply this process within the framework of nuclear data with the aim to select an experiment combination that will reduce uncertainties in 239 Pu nuclear data for neutron energies between 1 and 600 keV. In this field, fundamental-physics driven data, called differential, look at one nuclear physics observable at a time. They are contrasted to application-driven, integral, data where one or few resulting values inform a broad set of nuclear data across several nuclides and energies. The candidates for integral experiments are criticality measurements that were refined by a genetic algorithm to be maximally sensitive to 239 Pu fission cross sections in the desired energy range. Twenty-three candidate differential experiments were investigated and span multiple nuclear physics observables (e.g., total, capture cross sections) for isotopes appearing in the integral experiments. The optimal combination among these candidate experiments was investigated via generalized least squares fitting, augmented with Gaussian processes to ameliorate statistical irregularities in data, and the D-optimality criterion. The latter evaluates for each pair of candidates the joint reduction in uncertainties of all 12200 nuclear data appearing in the integral experiments compared to the knowledge we have from 168 past experiments, theory, and nuclear data. We chose as differential measurements those that investigate 63 Cu and 239 Pu total cross sections, based on D-optimality rank and feasibility constraints. Two integral (criticality) experiments were selected: An experiment with Al 2 ⁢O 3 and graphite interleaved with Pu and a thick Cu reflector explores 1–30 keV, while we target the 30–600 keV range with an experiment that swaps boron in place of graphite with a different geometry.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Differentiable modelling to unify machine learning and physical models for geosciences

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. Here, in this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

58 GEOSCIENCES↗