Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

WeakIdent: Weak formulation for identifying differential equation using narrow-fit and trimming

Data-driven identification of differential equations is an interesting but challenging problem, especially when the given data are corrupted by noise. When the governing differential equation is a linear combination of various differential terms, the identification problem can be formulated as solving a linear system, with the feature matrix consisting of linear and nonlinear terms multiplied by a coefficient vector. This product is equal to the time derivative term, and thus generates dynamical behaviors. The goal is to identify the correct terms that form the equation to capture the dynamics of the given data. We propose a general and robust framework to recover differential equations using a weak formulation with two new mechanisms, narrow-fit and trimming, for both ordinary and partial differential equations (ODEs and PDEs). The weak formulation facilitates an efficient and robust way to handle noise, and two new mechanisms, narrow-fit and trimming, improve the coefficient support and value recoveries respectively. For each sparsity level, Subspace Pursuit is utilized to find an initial set of support from the large dictionary. Then, we focus on highly dynamic regions (rows of the feature matrix), and error normalize the feature matrix in the narrow-fit step. The support is further updated via trimming the terms that contribute the least. Finally, the support set of features with the smallest Cross-Validation error is chosen as the result. A comprehensive set of numerical experiments are presented for both systems of ODEs and PDEs with various noise levels. The proposed method gives a robust recovery of the coefficients, and a significant denoising effect which can handle up to 100% noise-to-signal ratio for some equations. We compare the proposed method with several state-of-the-art algorithms for the recovery of differential equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Source-to-Source Automatic Differentiation of OpenMP Parallel Loops

This article presents our work toward correct and efficient automatic differentiation of OpenMP parallel worksharing loops in forward and reverse mode. Automatic differentiation is a method to obtain gradients of numerical programs, which are crucial in optimization, uncertainty quantification, and machine learning. The computational cost to compute gradients is a common bottleneck in practice. For applications that are parallelized for multicore CPUs or GPUs using OpenMP, one also wishes to compute the gradients in parallel. Here, we propose a framework to reason about the correctness of the generated derivative code, from which we justify our OpenMP extension to the differentiation model. We implement this model in the automatic differentiation tool Tapenade and present test cases that are differentiated following our extended differentiation procedure. Performance of the generated derivative programs in forward and reverse mode is better than sequential, although our reverse mode often scales worse than the input programs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Surface analysis insight note: Differentiation methods applicable to noisy data for determination of sp2‐ versus sp3‐hybridization of carbon allotropes and AES signal strengths

The derivatives of the spectra are commonly used for quantification in Auger Electron Spectroscopy (AES) spectra, while the derivative of the KLL C Auger line has proven to be valuable in obtaining a measure of the relative proportions of sp 2 ‐ and sp 3 ‐hybridization using the D‐parameter in both AES and X‐ray Photoelectron Spectroscopy (XPS). Differentiation of X‐ray Photoelectron Spectroscopy (XPS) and Auger Electron Spectroscopy (AES) spectra by numerical means is presented and illustrated for polymeric, such as PEEK and Nylon, as well as for graphitic materials including highly ordered pyrolytic graphite and graphene oxide. The most commonly available Savitzky–Golay method is explained mathematically and developed through the case of constructing a 5‐point quadratic polynomial convolution kernel suitable for differentiating spectra of adequate signal to noise. The concept of differentiation of spectra where signal to noise is less than adequate is also developed. Two alternative strategies to Savitzky–Golay differentiation are presented, which fit curves to data that allow derivatives to be obtained where Savitzky–Golay would otherwise fail. These alternative methods involve constructing a parametric curve that fits data over the entire energy interval of interest. Derivatives of spectra are then obtained by differentiating these parametric curves directly. A comparison of results for different materials for which specific sp 2 ‐ vs sp 3 ‐hybridized carbon proportions are of interest is used to emphasize the importance of characterizing methods used to differentiate spectra and understanding the characteristics of instrumentation used to measure spectra. The case for using Principal Component Analysis noise reduction with C KLL spectra is made for spectra collected from a heterogeneous graphene oxide sample.

Fairley, Neal↗
DOE OSTI2021

Extracellular IL-37 promotes osteogenic and odontogenic differentiation of human dental pulp stem cells via autophagy

The osteogenic and odontogenic differentiation of dental pulp stem cells (DPSCs) contribute to restoration and regeneration of dental tissue. Previous study indicated that interleukin-37 (IL-37) was an anti-inflammatory factor that affected other pro-inflammatory signals. The aim of this study was to explore the effects of IL-37 on the differentiation of DPSCs. DPSCs were cultured in growth medium with different concentrations of IL-37. We selected the optimal concentration for the following experiments by alkaline phosphatase (ALP) activity analysis, quantitative reverse-transcription polymerase chain reaction (qRT-PCR) and Western blot. Cell counting kit assay (CCK-8) and 5-Ethynyl-2-Deoxyuridine (EdU) assay were conducted to assess the effects of IL-37 on the proliferation of DPSCs. ALP activity assay and staining, alizarin red S (ARS) staining, qRT‐PCR, Western blot as well as immunofluorescence staining were conducted to assess differentiation ability of DPSCs. Western blot, immunofluorescence staining and transmission electron microscopy (TEM) were utilized to examine cell autophagy. Results showed that IL-37 enhanced the osteogenic and odontogenic differentiation ability of DPSCs with no significant influence on the proliferation of DPSCs. Autophagy in DPSCs was activated by IL-37. Activation of autophagy enhanced osteogenesis and odontogenesis of DPSCs, whereas inhibition of autophagy suppressed DPSCs osteogenic and odontogenic differentiation. In conclusion, IL-37 increased osteogenic and odontogenic differentiation via autophagy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Differentiable modelling to unify machine learning and physical models for geosciences

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. Here, in this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

58 GEOSCIENCES↗
DOE OSTI2026

Study of fully coupled three-dimensional envelope instability using automatic differentiation

Automatic differentiation is a powerful tool for computing derivatives of simulation results with respect to given parameters. In this Letter, we have applied this tool to investigate the instability of a dynamical system governed by 21 ordinary differential equations. This second-order instability (named envelope instability) is driven by space-charge effects and has a significant impact on the operational regimes of particle accelerators. Our study delves into the three-dimensional envelope instability, incorporating both transverse and longitudinal coupling. Conventionally, analyzing this complex system would necessitate solving 441 ordinary differential equations, which is computationally intractable. However, by employing automatic differentiation, we were able to track only 21 equations. This approach allowed us to uncover an additional instability stopband, which arises from space-charge-induced coupling and has not been reported in previous studies. This research highlights the significant advantages of automatic differentiation in analyzing complicated dynamical systems involving a large number of ordinary differential equations.

Qiang, Ji [Lawrence Berkeley National Laboratory (↗
DOE OSTI2021

Informing nuclear physics via machine learning methods with differential and integral experiments

Information from differential nuclear-physics experiments and theory is often too uncertain to accurately define nuclear-physics observables such as cross sections or energy spectra. Integral experimental data, representing the applications of these observables, are often more precise but depend simultaneously on too many of them to unambiguously identify issues in the observable with human expert analysis alone. Here, we explore how we can leverage physics knowledge gained from differential experimental data, nuclear theory, integral experiments, and neutron-transport calculations to better understand nuclear-physics observables in the context of the application area represented by integral experiments. We support this task with machine-learning methods to discern trends in a large amount of convoluted data. Differential and integral information was used in an analysis augmented by the random forest and the Shapley additive explanations metric. We chose as an application area one that is represented by criticality measurements and pulsed-sphere neutron-leakage spectra. We show one representative example ( 241 Pu fission observables) where the combination of differential and integral information allowed to resolve issues in data representing these observables. As a starting point, the machine learning (ML) algorithms highlighted several observables as leading potentially to bias in simulating integral experiments. Differential information, paired with sensitivity to integral quantities, allowed us then to pinpoint one specific observable ( 241 Pu fission cross section) as the main driver of bias. The comparison to integral experiments, on the other hand, allowed us to indicate a likely reliable experiment among several discrepant ones for this observables. In other cases (e.g., 239 Pu observables), we were not able to resolve the confounding introduced by integral experiments but instead highlighted the need for targeted new experiments and theory developments to better constrain the nuclear-physics space for the application area represented by integral experiments. We were able to combine information from differential experimental data, nuclear-physics theory, integral experiments, and neutron-transport simulations of the latter experiments with the help of the random forest algorithm and expert judgment. This combination of knowledge allows to improve our description of nuclear-physics observables as applied to a particular application area.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

The Memory Scaling of Reverse-Mode Differentiation in Particle Accelerator Simulations with Space Charge

The recent development of differentiable simulation codes for particle accelerators has enabled gradient-based workflows that promise finer control and more realistic modeling of accelerator facilities. However, when using reverse-mode automatic differentiation, the memory usage continuously increases during the simulation, and can potentially exceed the available hardware memory - especially when costly space charge computation is included. To study the memory requirements for differentiable simulations, we have implemented space charge in Cheetah, a PyTorch-based beam tracking code that supports reverse-mode differentiation. We find that the memory usage for reverse-mode differentiation grows linearly with the number of macroparticles and cells, and that it is proportional to the number of space charge kicks involved in the simulation. This general scaling can be used to evaluate whether a given differentiable simulation is feasible given hardware memory constraints.

Dhamrait, Arjun↗
DOE OSTI2024

Regularized Differentiation for Bioburden Density Estimation in Planetary Protection

In this paper, we propose and investigate the performance of two novel shrinkage estimators for bioburden density estimation in planetary protection. The estimators are based on the regularized differentiation of a cumulative count of colony forming units collected throughout the data collecting session or the life cycle of the entire mission. The regularized differentiation recasts the problem of bioburden density estimation as a linear least squares problem. The least squares problem is then solved through regularization techniques, such as truncated singular value decomposition and penalized least squares. The regularization is necessary to avoid noise amplification during the differentiation of noisy data. The two regularization estimators are compared with four other commonly used estimators to simultaneously evaluate the means of multivariable independent Poisson distributions: the maximum likelihood, noninformative Bayes estimator with Jeffreys prior, Empirical Bayes using conjugate gamma-Poisson model with gamma parameters selected by method of moments, and the Clevenson-Zidek estimator. It is shown through computer-simulated data that the regularized differentiation based on ridge regression has the smallest mean-squared error among all estimators. The analysis of shrinkage mechanism implemented by regularized differentiation is performed, and it is shown that the regularized differentiation amounts to performing a weighted averaging of all the samples. The weights are determined by the regularization parameter automatically selected by the L-curve technique. Since the method of least squares makes no distributional assumptions about the data, it presents an attractive technique for bioburden density estimation when there are concerns about the misspecification of the distributional model. The paper concludes with the analysis of the bioburden data collected during InSight mission and directions for future work.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Chapter 4 - Recent Advances in Identification of Differential Equations from Noisy Data: IDENT Review

Differential equations and numerical methods are extensively used to model various real-world phenomena in science and engineering. With modern developments, we aim to find the underlying differential equation from a single observation of time-dependent data. If we assume that the differential equation is a linear combination of various linear and nonlinear differential terms, then the identification problem can be formulated as solving a linear system. The goal then reduces to finding the optimal coefficient vector that best represents the time derivative of the given data. We review some recent works on the identification of differential equations. We find some common themes for the improved accuracy: (i) The formulation of linear system with proper denoising is important, (ii) how to utilize sparsity and model selection to find the correct coefficient support needs careful attention, and (iii) there are ways to improve the coefficient recovery. We present an overview and analysis of recent developments on the topic.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Co-benefits of subnationally differentiated carbon pricing policies in China: Alleviation of heavy PM 2.5 pollution and improvement in environmental equity

Carbon policies differentiated according to regional disparities have been recognized and recommended. However, the air quality co-benefits of differentiated policies remain unclear. Here we combine a multi-regional dynamic computable general equilibrium (CGE) model and an extend response surface model (ERSM) to investigate the impact of nationally uniform and subnationally differentiated carbon pricing policies on fine particulate matter (PM 2.5 ) concentrations in China. All policies examined lead to the same accumulated national CO 2 emissions (2020–2050), with the 2030 emissions attaining China's national abatement target. We find that, when subnational policies differentiated according to provincial PM 2.5 concentrations are implemented, the higher-than-average carbon price over more polluted provinces results in twice as much reduction in CO 2 and air pollutant emissions in 2050 as the national policy. As a result, the subnational policies cause larger PM 2.5 concentration reductions in these provinces (9%–18%) than the national policy (7%–11%). Also, the subnational policies eliminate high PM 2.5 exposure of over 45 μg/m 3 which 12% people suffer from under the national policy. Overall, the subnational policies substantially reduce regional disparity in PM 2.5 pollution and hence improve environmental equity. The results suggest that subnationally differentiated carbon policies are a promising instrument to mitigate severe pollution and promote environmental equity.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Redox and mineral controls on Fe and Ti isotopic fractionations during calc-alkaline magmatic differentiation

Titanium and Fe isotopic compositions of lavas from a calc-alkaline differentiation suite and corresponding mineral separates from the Rindjani Volcano, Indonesia show that Fe and Ti isotopic fractionations between minerals and melts are lower than those recorded in other suites at all stages of differentiation. Here, the limited isotopic fractionation for Ti is likely due to low-Ti magnetite and clinopyroxene being the dominant carriers of Ti in Rindjani lavas, as these minerals are thought to have limited equilibrium Ti isotopic fractionation relative to silicate magmas. Other magmatic differentiation suites controlled by removal of Ti-rich magnetite and characterized by a lesser role of clinopyroxene have larger Ti isotopic fractionations. This effect is an indirect consequence of the elevated Fe 3+ /Fe 2+ ratio of calc-alkaline magmas such as Rindjani, which promotes Fe 3+ incorporation into magnetite at the expense of Fe 2+ -Ti 4+ pairs, such that increased oxygen fugacity will subdue Ti isotopic fractionation in global magmatic series. Similarly, we find negligible Fe isotopic fractionation in Rindjani bulk rocks and mineral separates, unlike previous studies. This is also likely due to the oxidized nature of the Rindjani differentiation suite, which leads to similar Fe 3+ /Fe 2+ ratios in melt and minerals and decreases overall mineral-melt Fe fractionation factors. Paired Ti and Fe isotopic analyses may therefore represent a powerful tool to assess oxygen fugacity during differentiation, independent from Fe 3+ determinations of erupted samples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A review of preserving privacy in data collected from buildings with differential privacy

Significant amounts of data are collected in buildings. While these data have great potential for maximizing the energy efficiency of buildings in general, only a small portion of the data are accessible to researchers, government, and industry for analyses. Concerns about privacy are one of the major barriers prohibiting access to these data. Privacy preservation techniques are generally applied to this problem not only to preserve underlying privacy but also to improve the usefulness of data. Among various privacy preserving techniques, differential privacy has become one of the more popular solutions since its introduction in 2006. Differential privacy is a mathematical measure for protecting privacy so that one's privacy cannot be incurred by participating in a database. Additionally, although significant research improvements have been made for more than a decade, applying differential privacy to data collected in buildings is still an immature field of study. Because implementing differential privacy on a certain use case is not straightforward and can be achieved with various configurations, it is important to understand variation of configurations with different use cases around data collected from buildings. This literature review aims to introduce what has been done to implement differential privacy in data collected in buildings, and to discuss associated challenges and potential future research opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Analysis of ionizing radiation induced DNA damage response in human adult stem cells and differentiated neurons

Findings of neurodegenerative features associated with human radiosensitive syndromes such as Ataxia telangiectasia suggest that DNA repair efficiency is crucial for maintaining the functional integrity of central nervous system. To gain a better understanding of ionizing radiation (IR) induced DNA damage response in undifferentiated and differentiated neural cell types and to evaluate the role of ATM in DNA double strand break (DSB) repair, an in vitro human neural cell differentiation model system was utilized in this study. As compared to adult stem cells, differentiated neurons displayed an attenuated DSB repair response (as judged by the persistence of 53BP1 foci) after IR exposure and the attenuation was even more pronounced in stem cells and neurons after suppression of ATM (Ataxia Telangiectasia Mutated) gene product suggesting the importance of ATM for an optimal DSB repair efficiency in human neural cell types. In corroboration with an attenuated DNA damage response, a sharp decline in the expression levels of several DSB repair genes was observed in neurons. Furthermore, our results suggest that cellular differentiation modulates the expression of several genes thereby compromising the DSB repair fidelity in post mitotic neurons. Further studies are required to verify whether or not ATM mediated exacerbation of DNA repair deficiency in differentiated neurons leads to neurodegeneration.

53 binding protein 1↗
DOE OSTI2021

Down-regulation of A3AR signaling by IL-6-induced GRK2 activation contributes to Th17 cell differentiation

Highlights: • Cyclic AMP-PKA signaling is involved in Th17 cell differentiation. • IL-6 stimulation triggers the internalization of A{sub 3}AR and promotes cAMP production in T cells. • IL-6 induces A{sub 3}AR internalization in a GRK2 dependent manner. • GRK2 is a potential therapeutic target for treating Th17 driving immune diseases. IL-6-triggered Th17 cell expansion is responsible for the pathogenesis of many immune diseases including rheumatoid arthritis (RA). Traditionally, IL-6 induces Th17 cell differentiation through JAK-STAT3 signaling. In the present work, PKA inhibition reduces in vitro induction of Th17 cells, while IL-6 stimulation of T cells facilitates the internalization of A{sub 3}AR and increased cAMP production in a GRK2 dependent manner. Inhibition of GRK2 by paroxetine (PAR) or genetic depletion of GRK2 restored A{sub 3}AR distribution and prevented Th17 cell differentiation. Furthermore, in vivo PAR treatment effectively reduced the splenic Th17 cell proportion in a rat model of collagen-induced arthritis (CIA) which was accompanied by a significant improvement in clinical manifestations. These results indicate that IL-6-induced Th17 cell differentiation not only occurs through JAK-STAT3-RORγt but is also mediated through GRK2-A{sub 3}AR-cAMP-PKA-CREB/ICER-RORγt. This elucidates the significance of GRK2-controlled cAMP signaling in the differentiation of Th17 cells and its potential application in treating Th17-driven immune diseases such as RA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Automatic Differentiation in MetaPhysicL and Its Applications in MOOSE

Efficient solution via Newton’s method of nonlinear systems of equations requires an accurate representation of the Jacobian, corresponding to the derivatives of the component residual equations with respect to the degrees of freedom. In practice these systems of equations often arise from spatial discretization of partial differential equations used to model physical phenomena. These equations may involve domain motion or material equations that are complex functions of the systems’ degrees of freedom. Computing the Jacobian by hand in these situations is arduous and prone to error. Finite difference approximations of the Jacobian or its action are prone to truncation error, especially in multiphysics settings. Symbolic differentiation packages may be used, but often result in an excessive number of terms in realistic model scenarios. An alternative to symbolic and numerical differentiation is automatic differentiation (AD), which propagates derivatives with every elementary operation of a computer program, corresponding to continual application of the chain rule. Automatic differentiation offers the guarantee of an exact Jacobian at a relatively small overhead cost. In this work, we outline the adoption of AD in the Multiphysics Object Oriented Simulation Environment (MOOSE) via the MetaPhysicL package. We describe the application of MOOSE’s AD capability to several sets of physics that were previously infeasible to model via hand-coded or Jacobian-free simulation techniques, including arbitrary Lagrangian-Eulerian and level-set simulations of laser melt pools, phase-field simulations with free energies provided through neural networks, and metallic nuclear fuel simulations that require inner Newton loop calculation of nonlinear material properties.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Differentiable Simulation of a Liquid Argon Time Projection Chamber

Liquid argon time projection chambers (LArTPCs) are widely used in particle detection for their tracking and calorimetric capabilities. The particle physics community actively builds and improves high-quality simulators for such detectors in order to develop physics analyses in a realistic setting. The ability of these simulators to mimic real, measured data is limited by the modeling of the physical detectors used for data collection. This modeling can be improved by performing dedicated calibration measurements. Conventional approaches calibrate individual detector parameters or processes one at a time. However, the impact of detector processes is entangled, making this a poor description of the underlying physics. We introduce a differentiable simulator that enables a gradient-based optimization, allowing for the first time a simultaneous calibration of all detector parameters. We describe the procedure of making a differentiable simulator, highlighting the challenges of retaining the physics quality of the standard, non-differentiable version while providing meaningful gradient information. We further discuss the advantages and drawbacks of using our differentiable simulator for calibration. Finally, we provide a starting point for extensions to our approach, including applications of the differentiable simulator to physics analysis pipelines.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Automatic Differentiation of C++ Codes on Emerging Manycore Architectures with Sacado

Automatic differentiation (AD) is a well-known technique for evaluating analytic derivatives of calculations implemented on a computer, with numerous software tools available for incorporating AD technology into complex applications. However, a growing challenge for AD is the efficient differentiation of parallel computations implemented on emerging manycore computing architectures such as multicore CPUs, GPUs, and accelerators as these devices become more pervasive. In this work, we explore forward mode, operator overloading-based differentiation of C++ codes on these architectures using the widely available Sacado AD software package. In particular, we leverage Kokkos, a C++ tool providing APIs for implementing parallel computations that is portable to a wide variety of emerging architectures. Here we describe the challenges that arise when differentiating code for these architectures using Kokkos, and two approaches for overcoming them that ensure optimal memory access patterns as well as expose additional dimensions of fine-grained parallelism in the derivative calculation. We describe the results of several computational experiments that demonstrate the performance of the approach on a few contemporary CPU and GPU architectures. We then conclude with applications of these techniques to the simulation of discretized systems of partial differential equations.

97 MATHEMATICS AND COMPUTING↗