Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Niche-DE: niche-differential gene expression analysis in spatial transcriptomics data identifies context-dependent cell-cell interactions

Existing methods for analysis of spatial transcriptomic data focus on delineating the global gene expression variations of cell types across the tissue, rather than local gene expression changes driven by cell-cell interactions. We propose a new statistical procedure called niche-differential expression (niche-DE) analysis that identifies cell-type-specific niche-associated genes, which are differentially expressed within a specific cell type in the context of specific spatial niches. We further develop niche-LR, a method to reveal ligand-receptor signaling mechanisms that underlie niche-differential gene expression patterns. Niche-DE and niche-LR are applicable to low-resolution spot-based spatial transcriptomics data and data that is single-cell or subcellular in resolution.

59 BASIC BIOLOGICAL SCIENCES↗

Differential ability of three bee species to move genes via pollen

Since the release of genetically engineered (GE) crops, there has been increased concern about the introduction of GE genes into non-GE fields of a crop and their spread to feral or wild cross-compatible relatives. More recently, attention has been given to the differential impact of distinct pollinators on gene flow, with the goal of developing isolation distances associated with specific managed pollinators. To examine the differential impact of bee species on gene movement, we quantified the relationship between the probability of getting a GE seed in a pod, and the order in which a flower was visited, or the cumulative distance traveled by a bee in a foraging bout. We refer to these relationships as ‘seed curves’ and compare these seeds curves among three bee species. The experiments used Medicago sativa L. plants carrying three copies of the glyphosate resistance (GR) allele as pollen donors (M. sativa is a tetraploid), such that each pollen grain carried the GR allele, and conventional plants as pollen recipients. Different foraging metrics, including the number of GR seeds produced over a foraging bout, were also quantified and contrasted among bee species. The lowest number of GR seeds set per foraging bout, and the GR seeds set at the shortest distances, were produced following leafcutting bee visits. In contrast, GR seeds were found at the longest distances following bumble bee visits. Values for honey bees were intermediate. The ranking of bee species based on seed curves correlated well with field-based gene flow estimates. Thus, differential seed curves of bee species, which describe patterns of seed production within foraging bouts, translated into distinct abilities of bee species to move genes at a landscape level. Bee behavior at a local scale (foraging bout) helps predict gene flow and the spread of GE genes at the landscape scale.

59 BASIC BIOLOGICAL SCIENCES↗

Federated Learning and Differential Privacy: What might AI-Enhanced co-design of microelectronics learn?

Data is a valuable commodity, and it is often dispersed over multiple entities. Sharing data or models created from the data is not simple due to concerns regarding security, privacy, ownership, and model inversion. This limitation in sharing can hinder model training and development. Federated learning can enable data or model sharing across multiple entities that control local data without having to share or exchange the data themselves. Differential privacy is a conceptual framework that brings strong mathematical guarantee for privacy protection and helps provide a quantifiable privacy guarantee to any data or models shared. The concepts of federated learning and differential privacy are introduced along with possible connections. Lastly, some open discussion topics on how federated learning and differential privacy can tied to AI-Enhanced co-design of microelectronics are highlighted.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Differential geometric approaches to momentum-based formulations for fluids [Slides]

This SAND report documents CIS Late Start LDRD Project 22-0311, "Differential geometric approaches to momentum-based formulations for fluids". The project primarily developed geometric mechanics formulations for momentum-based descriptions of nonrelativistic fluids, utilizing a differential geometry/exterior calculus treatment of momentum and a space+time splitting. Specifically, the full suite of geometric mechanics formulations (variational/Lagrangian, Lie-Poisson Hamiltonian and Curl-Form Hamiltonian) were developed in terms of exterior calculus using vector-bundle valued differential forms. This was done for a fairly general version of semi-direct product theory sufficient to cover a wide range of both neutral and charged fluid models, including compressible Euler, magnetohydrodynamics and Euler-Maxwell. As a secondary goal, this project also explored the connection between geometric mechanics formulations and the more traditional Godunov form (a hyperbolic system of conservation laws). Unfortunately, this stage did not produce anything particularly interesting, due to unforeseen technical difficulties. There are two publications related to this work currently in preparation, and this work will be presented at SIAM CSE 23, at which the PI is organizing a mini-symposium on geometric mechanics formulations and structure-preserving discretizations for fluids. The logical next step is to utilize the exterior calculus based understanding of momentum coupled with geometric mechanics formulations to develop (novel) structure-preserving discretizations of momentum. This is the main subject of a successful FY23 CIS LDRD "Structure-preserving discretizations for momentum-based formulations of fluids".

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

First Measurement of Differential Charged Current Quasielastic-like $\nu_\mu$–Argon Scattering Cross Sections In Kinematic Imbalance Variables With The MicroBooNE Detector

We report the first measurement of flux-integrated multi-differential cross sections for charged-current events with muon neutrinos scattering on argon with solely a muon and a single proton in the final state as a function of kinematic imbalance variables. The measurement was carried out using the Booster Neutrino Beam at Fermi National Accelerator Laboratory within the MicroBooNE Liquid Argon Time Projection Chamber detector with an exposure of 6.79 × 10 20 protons on target. Events were selected to enhance the contribution of charged-current mesonless interactions with one proton detected in the final state. The data discussed here are reported in terms of multidifferential cross sections in kinematic imbalance variables, which are generally sensitive to nuclear effects. The double-differential results in these variables can provide an excellent handle to disentagle specific nuclear aspects not easily isolated via single differential cross sections. Our results pave a path towards identifying regions of the phase-space where future interaction modeling development and Monte Carlo neutrino generator tuning efforts should concentrate. EVENT SELECTION Neutrino oscillation measurements aim to extract neutrino mixing angles, mass differences, the value of the chargeparity violating phase in the lepton sector, and to search for new physics beyond the Standard Model [1, 2]. For that to be achieved, an unprecedented understanding of neutrino-argon interactions is of utmost importance since a growing number of neutrino oscillation experiments employ Liquid Argon Time Projector Chamber (LArTPC) neutrino detectors [3–6]. The accuracy to which these experiments can extract neutrino oscillation parameters requires a good understanding of the neutrino energy. Experimentally, this energy is deduced from the measured kinetic energies of particles that are emitted following the neutrino interaction in the detector. The kinematic properties of such finalstate particles reflect complex dynamics due to nuclear and initial-state effects of the interaction [7]. However, certain categories of nuclear effects can be isolated by variables built specifically to characterize the degeneracy between such effects [8–10]. This note reports cross sections in kinematic variables sensitive to nuclear effects using events with one detected muon with momentum 0.1 < pµ < 1.2 GeV/c, and exactly one proton with 0.3 < pp < 1 GeV/c. This signal definition includes events with any number of protons below 300 MeV/c, neutrons at any momenta, and charged pions with momentum lower than 70 MeV/c. This choice is guided by the fact that their experimental signature of correlated muon-proton pairs is fairly straightforward to reconstruct [11–22]. Such events primarily originate from chargedcurrent (CC) neutrino-nucleon quasielastic (QE) scattering interactions where the neutrino removes a single intact nucleon from the nucleus without producing any additional particles. This definition can also include contributions from interactions that lead to the production of additional particles that are absent from the final state due to nuclear effects, such as pion absorption, or have momenta that are below the experimental detection threshold.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Towards reverse mode automatic differentiation of Kokkos-based codes

Derivative computation is a key component of optimization, sensitivity analysis, uncertainty quantification, and the solving of nonlinear problems. Automatic differentiation (AD) is a powerful technique for evaluating such derivatives, and in recent years, has been integrated into programming environments such as Jax, PyTorch, and TensorFlow to support derivative computations needed for training of machine learning models, facilitating wide-spread use of these technologies. The C++ language has become the de facto standard for scientific computing due to numerous factors, yet language complexity has made the wide-spread adoption of AD technologies for C++ difficult, hampering the incorporation of powerful differentiable programming approaches into C++ scientific simulations. This is exacerbated by the increasing emergence of architectures, such as GPUs, with limited memory capabilities and requiring massive thread-level concurrency. C++ AD tools must effectively use these environments to bring novel scientific simulations to next-generation DOE experimental and observational facilities. In this project, we investigated source transformation-based automatic differentiation using LLVM compiler infrastructure to automatically generate portable and efficient gradient computations of Kokkos-based code. We have demonstrated that our proposed strategy is feasible by investigating the usage of a prototype LLVM-based source transformation tool to generate gradients of simple functions made of sequences of simple Kokkos parallel regions. Speedups of up to 500x compared to Sacado were observed on NVIDIA V100 GPU.

97 MATHEMATICS AND COMPUTING↗

Lectures on Lie Group Analysis: Solving Differential Equations Using Symmetries

These notes are meant to be a supplemental reference for the beginner Lie Group Analyst. It is assumed that the reader has a basic concept of the fundamentals of Lie Group Theory (LGT), e.g. has seen the derivation of the infinitesimal generator and understands the mathematical meaning behind invariance. An excellent reference is Albright et al., “Symmetry Analysis of Differential Equations: A Primer,”. The reader is urged to read at least the first three chapters of that document to be able to follow the outset of Chapter 2 of this document. The reader should also have a general understanding of calculus, ordinary differential equations, and partial differential equations.

97 MATHEMATICS AND COMPUTING↗

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

High-precision quantum algorithms for partial differential equations

Quantum computers can produce a quantum encoding of the solution of a system of differential equations exponentially faster than a classical algorithm can produce an explicit description. However, while high-precision quantum algorithms for linear ordinary differential equations are well established, the best previous quantum algorithms for linear partial differential equations (PDEs) have complexity poly(1/ϵ), where ϵ is the error tolerance. By developing quantum algorithms based on adaptive-order finite difference methods and spectral methods, we improve the complexity of quantum algorithms for linear PDEs to be poly(d,log(1/ϵ)), where d is the spatial dimension. Our algorithms apply high-precision quantum linear system algorithms to systems whose condition numbers and approximation errors we bound. We develop a finite difference algorithm for the Poisson equation and a spectral algorithm for more general second-order elliptic equations.

97 MATHEMATICS AND COMPUTING↗

Koopman-based Differentiable Predictive Control for the Dynamics-Aware Economic Dispatch Problem

The dynamics-aware economic dispatch (DED) problem embeds low-level generator dynamics and operational constraints to enable near real-time scheduling of generation units in a power network. DED produces a more dynamic supervisory control policy than traditional economic dispatch (T-ED) that reduces overall generation costs. However, the incorporation of differential equations that govern the system dynamics makes DED an optimization problem that is computationally prohibitive to solve. In this work, we present a new data-driven approach based on differentiable programming to efficiently obtain offline parametric solutions to the underlying DED problem. In particular, we employ the recently proposed differentiable predictive control (DPC) for offline learning of explicit neural control policies based on identified Koopman operator (KO) model of the system dynamics. We demonstrate the high solution quality and five orders of magnitude computational-time savings of the DPC method over the original optimization-based DED approach on a 9-bus test power grid network.

King, Ethan↗

Site-Differentiated Iron–Sulfur Cluster Ligation Affects Flavin-Based Electron Bifurcation Activity

Electron bifurcation is an elegant mechanism of biological energy conversion that effectively couples three different physiologically relevant substrates. As such, enzymes that perform this function often play critical roles in modulating cellular redox metabolism. One such enzyme is NADH-dependent reduced-ferredoxin: NADP+ oxidoreductase (NfnSL), which couples the thermodynamically favorable reduction of NAD+ to drive the unfavorable reduction of ferredoxin from NADPH. The interaction of NfnSL with its substrates is constrained to strict stoichiometric conditions, which ensures minimal energy losses from non-productive intramolecular electron transfer reactions. However, the determinants for this are not well understood. One curious feature of NfnSL is that both initial acceptors of bifurcated electrons are unique iron–sulfur (FeS) clusters containing one non-cysteinyl ligand each. The biochemical impact and mechanistic roles of site-differentiated FeS ligands are enigmatic, despite their incidence in many redox active enzymes. Herein, we describe the biochemical study of wild-type NfnSL and a variant in which one of the site-differentiated ligands has been replaced with a cysteine. Results of dye-based steady-state kinetics experiments, substrate-binding measurements, biochemical activity assays, and assessments of electron distribution across the enzyme indicate that this site-differentiated ligand in NfnSL plays a role in maintaining fidelity of the coordinated reactions performed by the two electron transfer pathways. Given the commonality of these cofactors, our findings have broad implications beyond electron bifurcation and mechanistic biochemistry and may inform on means of modulating the redox balance of the cell for targeted metabolic engineering approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Differential Accumulation of Misfolded Prion Strains in Natural Hosts of Prion Diseases

Prion diseases, also known as transmissible spongiform encephalopathies (TSEs), are a group of neurodegenerative protein misfolding diseases that invariably cause death. TSEs occur when the endogenous cellular prion protein (PrP C ) misfolds to form the pathological prion protein (PrP Sc ), which templates further conversion of PrP C to PrP Sc , accumulates, and initiates a cascade of pathologic processes in cells and tissues. Different strains of prion disease within a species are thought to arise from the differential misfolding of the prion protein and have different clinical phenotypes. Different strains of prion disease may also result in differential accumulation of PrP Sc in brain regions and tissues of natural hosts. Here, we review differential accumulation that occurs in the retinal ganglion cells, cerebellar cortex and white matter, and plexuses of the enteric nervous system in cattle with bovine spongiform encephalopathy, sheep and goats with scrapie, cervids with chronic wasting disease, and humans with prion diseases. By characterizing TSEs in their natural host, we can better understand the pathogenesis of different prion strains. This information is valuable in the pursuit of evaluating and discovering potential biomarkers and therapeutics for prion diseases.

59 BASIC BIOLOGICAL SCIENCES↗

A guide to the design of the virtual element methods for second- and fourth-order partial differential equations

Here we discuss the design and implementation details of two conforming virtual element methods for the numerical approximation of two partial differential equations that emerge in phase-field modeling of fracture propagation in elastic material. The two partial differential equations are: (i) a linear hyperbolic equation describing the momentum balance and (ii) a fourth-order elliptic equation modeling the damage of the material. Inspired by, we develop a new conforming VEM for the discretization of the two equations, which is implementation-friendly, i.e., different terms can be implemented by exploiting a single projection operator. We use C 0 and C 1 virtual elements for the second-and fourth-order partial differential equation, respectively. For both equations, we review the formulation of the virtual element approximation and discuss the details pertaining the implementation.

42 ENGINEERING↗

Battery models, systems, and methods using robust fail-safe iteration free approach for solving differential algebraic equations

Battery models using robust fail-safe iteration free approach for solving Differential Algebraic Equations, and associated systems and methods are disclosed. In one embodiment, a method includes generating a model of the rechargeable battery; determining one or more initial conditions for one or more algebraic variables of the model using a solver; holding differential variables of the model static by a switch function while determining the one or more initial conditions; applying the initial conditions to the model by the switch function; and determining one or more parameters for the rechargeable battery by solving the algebraic and differential equations.

25 ENERGY STORAGE↗

Rare Lepton Decays and Differentiable Hadronization Models - From Signatures of New Physics to Data-driven Event Generation

This dissertation is partitioned into two parts: phenomenological studies focused on rare lepton decays as probes of heavy and light new physics, and the development of differentiable, data-driven hadronization models. Part I develops the phenomenology of new physics signatures stemming from rare charged lepton flavor violating decays probed by experiments at the intensity frontier. These include interactions mediated by both high-scale effective operators and light new physics, manifesting in multi-lepton final states ($\mu \to 5e$), elastic nuclear transitions ($\mu \to e$ conversion), baryon-number-violating muon capture, and time-dependent signals from ultralight dark matter ($\mu \to e \phi, \tau \to \ell \phi$). Part II develops two distinct strategies for advancing differentiable and data-driven hadronization models. One involves comprehensive reweighting frameworks for hadronization that enable efficient uncertainty estimation, facilitate parameter tuning, and interface naturally with differentiable programming paradigms. The other introduces machine-learning-based methods for extracting microscopic fragmentation dynamics directly from macroscopic observables through the deformation of existing models -- effectively providing solutions to the inverse problem of hadronization. Altogether, these studies advance the interpretability, flexibility, and precision of theoretical predictions for both high-intensity and high-energy experiments.

Menzo, Tony [Cincinnati U.] (ORCID:000000022013457↗

Handling Iterative Solvers in an Algorithmic Differentiation Framework Using Implicit Methods

Differentiable programming is a powerful concept as it enables the seemly propagation of gradients through functions, algorithms, and/or whole physics simulations. These gradients are useful for a wide variety of applications, including sensitivity studies and machine learning, but one of particular interest is optimization. Gradient-based optimization, enabled through automatic/algorithmic differentiation (AD), can be used on predictive physical models to efficiently optimize a set of design variables. AD methods are a particularly promising approach to complex physics simulations because they can be shown to scale well with an increasing number of design variables; however, care must be taken when coupling between different models or different states of a single model.

algorithmic differentiation↗

Calibration of elastoplastic constitutive model parameters from full-field data with automatic differentiation-based sensitivities

Here, we present a framework for calibration of parameters in elastoplastic constitutive models that is based on the use of automatic differentiation (AD). The model calibration problem is posed as a partial differential equation-constrained optimization problem where a finite element (FE) model of the coupled equilibrium equation and constitutive model evolution equations serves as the constraint. The objective function quantifies the mismatch between the displacement predicted by the FE model and full-field digital image correlation data, and the optimization problem is solved using gradient-based optimization algorithms. Forward and adjoint sensitivities are used to compute the gradient at considerably less cost than its calculation from finite difference approximations. Through the use of AD, we need only to write the constraints in terms of AD objects, where all of the derivatives required for the forward and inverse problems are obtained by appropriately seeding and evaluating these quantities. We present three numerical examples that verify the correctness of the gradient, demonstrate the AD approach's parallel computation capabilities via application to a large-scale FE model, and highlight the formulation's ease of extensibility to other classes of constitutive models.

42 ENGINEERING↗

Uncertainty Quantification Enabled by Automatic Differentiation for Hydrodynamic Simulation of Shock‐to‐Detonation Transition in High Explosives

Quantifying the effects of uncertainty in a reactive burn model on the run-to-detonation time in high explosives (HEs) provides a robust methodology for assessing the probability of an HE failing the IHE qualification standard. Moreover, uncertainty quantification helps evaluate whether the model calibration accurately represents data outside the calibration set. This study uses a specialized hydrodynamic simulation code for modeling detonation to determine the run-to-detonation time of the HE PBX 9502 for various impact velocities. To quickly approximate uncertainties in the model, a surrogate was constructed using a Taylor series expansion centered at the mean of the input parameters. To obtain the sensitivities required for constructing the Taylor series, HYP-percomplex Automatic Differentiation (HYPAD) was implemented. HYPAD is a methodology for infusing existing codes with automatic differentiation capabilities by augmenting variables with one or more imaginary units to compute step-size independent partial derivatives. These derivatives are accurate to machine precision with respect to the implemented numerical algorithm, meaning their accuracy reflects that of the underlying method (e.g., integration or discretization schemes). Using reduced order modeling techniques, the mean and standard deviation of the run-to-detonation time of a shock within PBX 9502 were computed for a number of initial impact velocities. A weighted least squares regression was then performed to obtain a best fit curve and prediction interval for the computed statistics. Historical data points from explosively driven wedge tests were utilized to validate the prediction interval, ensuring its reliability in predicting future outcomes. With this prediction interval and a known safety constraint curve, the most probable point of failure and the probability of failure for the HE PBX 9502 were determined.

97 MATHEMATICS AND COMPUTING↗