Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A differentiable simulation package for performing inference of synchrotron-radiation-based diagnostics

The direction of particle accelerator development is ever-increasing beam quality, currents and repetition rates. This poses a challenge to traditional diagnostics that directly intercept the beam due to the mutual destruction of both the beam and the diagnostic. An alternative approach is to infer beam parameters non-invasively from the synchrotron radiation emitted in bending magnets. However, inferring the beam distribution from a measured radiation pattern is a complex and computationally expensive task. To address this challenge we present SYRIPY ( SYnchrotron Radiation In PYthon ), a software package intended as a tool for performing inference of synchrotron-radiation-based diagnostics. SYRIPY has been developed using PyTorch , which makes it both differentiable and able to leverage the high performance of GPUs, two vital characteristics for performing statistical inference. The package consists of three modules: a particle tracker, Lienard–Wiechert solver and Fourier optics propagator, allowing start-to-end simulation of synchrotron radiation detection to be carried out. SYRIPY has been benchmarked against SRW , the prevalent numerical package in the field, showing good agreement and up to a 50× speed improvement. Finally, we have demonstrated how SYRIPY can be used to perform Bayesian inference of beam parameters using stochastic variational inference.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

A Semi-Analytical Solution Approach for Solving Constant-Coefficient First-Order Partial Differential Equations

Simulation and control of many dynamic systems involve solving partial differential equations (PDE). This letter proposes a semi-analytical solution (SAS) approach for fast and high-quality solution of first-order PDEs. The region of interest of the studied PDE is divided into a grid, and an SAS is derived for each grid cell in the form of the multivariate polynomials, of which the coefficients are identified using initial value and boundary value conditions. The solutions are solved in a “time-stepping” manner, i.e. within one time step, the coefficients of the SAS are identified and the initial value of the next time step is evaluated. This approach achieves a significantly larger grid cell than the widely used finite difference method, and thus enhances the computational efficiency significantly. Furthermore, the simulation result on the natural gas pipeline model demonstrates the advantages of SAS in accuracy and computational efficiency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Dynamic Parameter Estimation with Physics-based Neural Ordinary Differential Equations

Accurate estimation of dynamic parameters of gen-erators is crucial to building a reliable model for dynamical studies and reliable operation of the power system. This paper develops a physics-based neural ordinary differential equations (ODE) approach to learn the parameters of generator dynamic model using phasor measurement units (PMU) data. We design a physics-based neural network to represent the swing equations of the power system dynamics. A loss function is defined as the difference between dynamic simulation results from the physics-based neural networks and pseudo PMU measurements. The parameters of generator dynamic model are iteratively updated using the neural ODEs and the adjoint method. By exploiting the mini-batch scheme in neural ODE training, the parameter estimation performance is significantly improved. Numerical study results on a 3-machine 9-bus system show that the proposed algorithm outperforms state-of-the-art baseline method in both computation time and dynamic parameter estimation accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Optimization of Distribution Feeder Topology: A Differential Programming Learning Approach

This paper presents a gradient based method for optimizing distribution feeder network topology under load un- certainty. We recast the optimal network reconfiguration problem as a learning problem where edge weights of a graph are learned to produce an optimized spanning tree for a distribution network. Using recent methods published on differentiable programming, we provide a data driven method for learning these weights. We test our method on 100 variations of an IEEE 15-bus test system. Our results show that our method outperforms more traditional mathematical programming-based approaches.

differentiable programming↗
DOE OSTI2021

The UPR regulator IRE1 promotes balanced organ development by restricting TOR-dependent control of cellular differentiation in Arabidopsis

Proteostasis of the endoplasmic reticulum (ER) is controlled by sophisticated signaling pathways that are collectively called the unfolded protein response (UPR) and are initiated by specialized ER membrane-associated sensors. The evidence that complete loss-of-function mutations of the most conserved of the UPR sensors, inositol-requiring enzyme 1 (IRE1), dysregulates tissue growth and development in metazoans and plants raises the fundamental question as to how IRE1 is connected to organismal growth. To address this question, we interrogated the Arabidopsis primary root, an established model for organ development, using the tractable Arabidopsis IRE1 mutant ire1a ire1b, which has marked root development defects in the absence of exogenous stress. We demonstrate that IRE1 is required to reach maximum rates of cell elongation and root growth. We also established that in the actively growing ire1a ire1b mutant root tips the Target of Rapamycin (TOR) kinase, a widely conserved pro-growth regulator, is hyperactive, and that, unlike cell proliferation, the rate of cell differentiation is enhanced in ire1a ire1b in a TOR-dependent manner. By functionally connecting two essential growth regulators, these results underpin a novel and critical role of IRE1 in organ development and indicate that, as cells exit an undifferentiated state, IRE1 is required to monitor TOR activity to balance cell expansion and maturation during organ biogenesis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Fully quantum algorithm for mesoscale fluid simulations with application to partial differential equations

Fluid flow simulations marshal our most powerful computational resources. In many cases, even this is not enough. Quantum computers provide an opportunity to speed up traditional algorithms for flow simulations. We show that lattice-based mesoscale numerical methods can be executed as efficient quantum algorithms due to their statistical features. This approach revises a quantum algorithm for lattice gas automata to reduce classical computations and state preparation at every time step. For this, the algorithm approximates the qubit relative phases and subtracts them at the end of each time step. Phases are evaluated using the iterative phase estimation algorithm and subtracted using single-qubit rotation phase gates. Further, this method optimizes the quantum resource required and makes it more appropriate for near-term quantum hardware. We also demonstrate how the checkerboard deficiency that the D1Q2 scheme presents can be resolved using the D1Q3 scheme. The algorithm is validated by simulating two canonical partial differential equations: the diffusion and Burgers' equations on different quantum simulators. We find good agreement between quantum simulations and classical solutions for the presented algorithm.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Anonymization of Network Traces Data through Condensation-based Differential Privacy

Network traces are considered a primary source of information to researchers, who use them to investigate research problems such as identifying user behavior, analyzing network hierarchy, maintaining network security, classifying packet flows, and much more. However, most organizations are reluctant to share their data with a third party or the public due to privacy concerns. Therefore, data anonymization prior to sharing becomes a convenient solution to both organizations and researchers. Although several anonymization algorithms are available, few of them allow sufficient privacy (organization need), acceptable data utility (researcher need), and efficient data analysis at the same time. This article introduces a condensation-based differential privacy anonymization approach that achieves an improved tradeoff between privacy and utility compared to existing techniques and produces anonymized network trace data that can be shared publicly without lowering its utility value. Our solution also does not incur extra computation overhead for the data analyzer. A prototype system has been implemented, and experiments have shown that the proposed approach preserves privacy and allows data analysis without revealing the original data even when injection attacks are launched against it. When anonymized datasets are given as input to graph-based intrusion detection techniques, they yield almost identical intrusion detection rates as the original datasets with only a negligible impact.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Power System Frequency Dynamics Modeling, State Estimation, and Control using Neural Ordinary Differential Equations (NODEs) and Soft Actor-Critic (SAC) Machine Learning Approaches

With the global energy transition of the electric power system, grid control, supervision, and protection is becoming more challenging. With the increasing integration of renewable energy sources (RES), the system dynamics are changing, causing traditional power system dynamic modeling with swing equation-based modeling approaches to fail. Additionally, the converter-dominated power grid is decreasing the system inertia, making the power system more fragile to the frequency swings. This paper first investigates and compares the application of a model-based Kalman filter state estimation approach with (i) a model-free machine learning approach --- neural ordinary differential equations (NODEs) --- and (ii) a data-driven system identification (SysId) approach to model and infer critical state values of the power system frequency dynamics. Then a model predictive control (MPC) framework is compared to a model-free Soft Actor-Critic (SAC) reinforcement learning (RL) control algorithm in providing efficient fast frequency response (FFR) to the power system frequency dynamics. The approaches are compared in terms of their performance goals as well as their per-timestep computational efficiency. Furthermore, the comparative study for state estimation shows that for the model-free requirement, both NODEs and SysId can provide accurate state estimates; however, with increasing model complexity, NODEs can be a better choice for model identification. Similarly, the results from the FFR comparative study show that the SAC RL-based FFR, once trained, outperforms MPC with better control signals and faster computation time, making the SAC RL-based FFR better option for providing FFR to the power system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

SDA: a symbolic differential algebra package in C++

Truncated Power Series Algebra (TPSA), or Differential Algebra (DA), is a well-established tool in accelerator physics, commonly used for generating high-order maps of dynamic systems, as well as in symplectic tracking, normal form analysis, verified integration, optimization, and fast multipole methods. This package is the first to perform symbolic DA computations, enabling traceability of initial condition contributions and runtime reduction for repeated DA calculations, potentially expanding DA’s applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Understanding machine learning approaches for partial differential equations

Recent works in computational physics have been successful in the super-resolution of numerical solutions of partial differential equations (PDEs) via neural networks. In this paper we explore the possibilities and limitations of the data-driven discretization approach implemented by Bar-Sinai et. al., while contrasting it with a simpler yet weaker approach utilizing the nangs Python library. The results demonstrate what neural network parameters optimize accuracy and performance, as well as what conditions on PDEs are necessary to maintain convergence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Differential Gene Expression in Host Ubiquitination Processes in Childhood Malarial Anemia

Background: Malaria remains one of the leading global causes of childhood morbidity and mortality. In holoendemic Plasmodium falciparum transmission regions, such as western Kenya, severe malarial anemia [SMA, hemoglobin (Hb) < 6.0 g/dl] is the primary form of severe disease. Ubiquitination is essential for regulating intracellular processes involved in innate and adaptive immunity. Although dysregulation in ubiquitin molecular processes is central to the pathogenesis of multiple human diseases, the expression patterns of ubiquitination genes in SMA remain unexplored. Methods: To examine the role of the ubiquitination processes in pathogenesis of SMA, differential gene expression profiles were determined in Kenyan children ( n = 44, aged <48 mos) with either mild malarial anemia (M l MA; Hb ≥9.0 g/dl; n = 23) or SMA (Hb <6.0 g/dl; n = 21) using the Qiagen Human Ubiquitination Pathway RT 2 Profiler PCR Array containing a set of 84 human ubiquitination genes. Results: In children with SMA, 10 genes were down-regulated ( BRCC3 , FBXO3 , MARCH5 , RFWD2 , SMURF2 , UBA6 , UBE2A , UBE2D1 , UBE2L3 , UBR1 ), and five genes were up-regulated ( MDM2 , PARK2 , STUB1 , UBE2E3 , UBE2M ). Enrichment analyses revealed Ubiquitin-Proteasomal Proteolysis as the top disrupted process, along with altered sub-networks involved in proteasomal, protein, and ubiquitin-dependent catabolic processes. Conclusion: Collectively, these novel results show that protein coding genes of the ubiquitination processes are involved in the pathogenesis of SMA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Ghrelin Modulates Differential Expression of Genes Relevant to Immune Activities and Antimicrobial Peptides in Primary Head Kidney Cells of Rainbow Trout ( Oncorhynchus mykiss )

Ghrelin is a peptide hormone/cytokine that regulates metabolic processes and plays essential roles in the immune system. To evaluate the immunomodulatory actions of ghrelin isoforms in rainbow trout (RT), an in vitro model was utilized with primary cells isolated from fish head kidney (HKD). These RT-HKD cells were treated with synthetic rainbow trout ghrelin and its truncated isoform, desVRQ-ghrelin, over time (0, 2, 4, and 24 h). Reverse transcriptase-coupled qPCR was used to measure the differential expression patterns of genes relevant to various immune processes and genes of antimicrobial peptides. Ghrelin isoform treatments resulted in functional perturbations that displayed overlapping and divergent patterns of gene expression. The differing actions between the two ghrelin isoforms on various assessed genes, and at differing time points, suggested that the two analogs may activate unique pathways, thereby eliciting distinct responses in fish immunity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A High-Throughput MEMS-Based Differential Scanning Calorimeter for Direct Thermal Characterization of Antibodies

Calorimeters, which can be used for rapid thermal characterization of biomolecules, are getting intense attention in drug development. This paper presents a novel MEMS-based differential scanning calorimeter (DSC) for direct thermal characterization of protein samples. The DSC consisted of a pair of temperature sensors made by vanadium oxide (VOx) film with a temperature coefficient of resistivity of –0.025/K at 300 K, a microfluidic device with high thermal insulation (2.8 K/mW), and a Peltier heater for linear temperature scanning. The DSC exhibited high sensitivity (6.1 µV/µW), low noise (0.4 µW), high scanning rate (45 K/min), and low sample consumption volume (0.63 µL). The MEMS DSC was verified by measuring the temperature-induced denaturation of lysozyme at different pH, and then used to study the thermal stability of a monoclonal antibody (mAb), an antigen-binding fragment (Fab), and a dual variable domain immunoglobulin (DVD-Ig) at pH = 6. The results showed that lysozyme is a stable protein in the pH range of 4.0–8.0. The protein stability study revealed that the transition temperatures of the intact Fab fragment, mAb, and DVD proteins were comparable with conformational stability results obtained using conventional commercial DSC. These studies demonstrated that the MEMS DSC is an effective tool for directly understanding the thermal stability of antibodies in a high-throughput and low-cost manner compared to conventional calorimeters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Two-Scale Neural Networks for Partial Differential Equations with Small Parameters

We propose a two-scale neural network method for solving partial differential equations (PDEs) with small parameters using physics-informed neural networks (PINNs). We directly incorporate the small parameters into the architecture of neural networks. The proposed method enables solving PDEs with small parameters in a simple fashion, without adding Fourier features or other computationally taxing searches of truncation parameters. Various numerical examples demonstrate reasonable accuracy in capturing features of large derivatives in the solutions caused by small parameters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Reducing Sample Loss in Measurement of Heat of Vaporization of Ethanol/Gasoline Blends by Differential Scanning Calorimetry/Thermogravimetric Analysis

Higher gasoline Heat of Vaporization (HOV) can enable higher compression-ratio direct injection spark ignition engines by providing evaporative cooling that effectively increases fuel knock resistance. Methods to directly measure this fuel property in complex gasoline samples are not well developed. The objective of the present study was to further improve a Differential Scanning Calorimetry/Thermogravimetric Analyzer (DSC/TGA) method to measure the total and partial HOV of gasoline. Ten market gasoline samples were chosen to have a wide range of properties to assess the method's capability across the entire volatility range with an emphasis on understanding how well the method captures the initial 10 percent (%) of sample evaporation and how much sample is left unevaporated at the end of the experiment. Modifications to the sample preparation/introduction method as well as to the instrument itself were made to reduce initial sample losses which included measurements of the HOV at 10 degrees C and 5 degrees C (in a cold chamber) as well as under (uncontrolled) ambient conditions. Experimental results from the DSC/TGA were compared to calculated total HOV results based on Detailed Hydrocarbon Analysis (DHA). Results from the two methods agreed very well with the difference being 5% or less in almost every case. In addition, the repeatability of the method was investigated by analyzing samples in triplicate at the three temperatures investigated. One valuable conclusion from the study was that the lower temperatures of 10 degrees C and 5 degrees C enabled more reproducible measurements for both total and partial HOV. This improved precision may be caused by the fact that temperature control in the cold chamber was more reliable than the ambient laboratory temperature control. Additionally, cold chamber experiments, due to ergonomic limitations, did not allow for the use of a lid on the sample pan. The reproducibility of the evaporation rate was found to be highly dependent on the pan/lid fit which can vary significantly such that elimination of the lid improved measurement precision while operation at sub-ambient temperature slowed the evaporation rate. Results detailing sample preparation and instrument modifications as well as a detailed comparison of total and partial HOV results are presented.

ADVANCED PROPULSION SYSTEMS,BIOMASS FUELS↗
DOE OSTI2021

Revisiting matrix-based inversion of scanning mobility particle sizer (SMPS) and humidified tandem differential mobility analyzer (HTDMA) data

Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package for applying Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ∼ 1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPSs) and humidified tandem differential mobility analyzers (HTDMAs). Inversion of SMPS size distributions reported in this work builds upon the freely available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ∼ 200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data while also accounting for multiply charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Marine Laboratory during the CalWater 2/ACAPEX campaign and co-located SMPS and HTDMA data collected at the US Department of Energy observatory located at the Southern Great Plains site in Oklahoma, USA. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely available, general, and domain-independent and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

POSTER: Automatic Differentiation of Parallel Loops with Formal Methods

The accompanying poster to this short paper presents a combination of reverse mode AD and formal methods to enable efficient differentiation of (or backpropagation through) shared-memory parallel code. Compared to the state of the art, our approach can more often avoid the need for atomic updates or private data copies during the parallel derivative computation, even in the presence of unstructured or data-dependent data access patterns. This is achieved by gathering information about the memory access patterns from the input program, which is assumed to be correctly parallelized. This information is then used to build a model of assertions in a theorem prover, which can be used to check the safety of shared memory accesses during the parallel derivative computation

Automatic Differentiation↗