Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Deep Learning Explicit Differentiable Predictive Control Laws for Buildings

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging from explicit nonlinear model predictive control (MPC). Contrary to approximate MPC, DPC does not require supervision by an expert controller. Instead, a system dynamics model is learned from a small dataset of recorded observations of the perturbed system's dynamics and the control law is optimized offline by interaction with the learned system model. The DPC method is based on two sequential steps, i) system identification using a constrained neural state-space model, and ii) optimization of an explicit control law parametrized by another neural network in closed-loop simulation with the identified neural state-space model. The combination of a differentiable closed-loop system and penalty methods for constraint handling of system outputs and inputs allows us to optimize the control law's parameters directly by backpropagating economic MPC loss through the learned system model. By incorporating domain knowledge and leveraging established techniques from optimal control, our method leverages deep neural networks as nonlinear function approximators for system identification and control while avoiding concomitant costs of intractably large datasets, and computationally expensive over-parametrized models. The scalability, data efficiency, and constrained optimal control capability of the proposed DPC method are demonstrated in simulation using a multi-zone building emulator.

Drgona, Jan↗

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗

Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equations

Physics-informed neural networks have emerged as an alternative method for solving partial differential equations. However, for complex problems, the training of such networks can still require high-fidelity data which can be expensive to generate. To reduce or even eliminate the dependency on high-fidelity data, we propose a novel multi-fidelity architecture which is based on a feature space shared by the low- and high-fidelity solutions. In the feature space, the projections of the low-fidelity and high-fidelity solutions are adjacent by constraining their relative distance. The feature space is represented with an encoder and its mapping to the original solution space is effected through a decoder. In conclusion, the proposed multi-fidelity approach is validated on forward and inverse problems for steady and unsteady problems described by partial differential equations.

97 MATHEMATICS AND COMPUTING↗

Differential Ligation Alters Electronic State and Coupling Signals of Iron-Sulfur Clusters in Flavin-Based Electron Bifurcation

Flavin-based electron bifurcation (FBEB) is employed by microorganisms for controlling pools of redox equivalents by reversibly splitting electron pairs into high- and low-energy levels from an initial midpoint potential. Our ability to harness this phenomenon is crucial for biocatalytic design which is limited by our understanding of energy coupling in the bifurcation system. In Pyrococcus furiosus, FBEB is carried out by the NADH-dependent ferredoxin:NADP+-oxidoreductase (NfnSL), coupling the uphill reduction of ferredoxin in NfnL to the downhill reduction of NAD+ in NfnS from oxidation of NADPH. Flanking the bifurcating flavin are two site-differentiated iron-sulfur clusters; the nearest is a glutamate-ligated [4Fe-4S] cluster in NfnL. Recent biochemical experiments substituting the native glutamate with cysteine led to loss of coupling between the uphill and downhill pathways, in contrast to the tight thermodynamic coupling in the native system. To understand how this decoupling is biochemically manifested by the cysteine-substituted [4Fe-4S] in NfnL, we employed electron paramagnetic resonance (EPR) spectroscopy to identify changes in electronic architecture and square wave voltammetry (SWV) to probe thermodynamic shifts produced by the substitution. We observed notable g-value shifts in the EPR for the cysteine-substituted iron-sulfur cluster in addition to significant downward shifts in the redox potential, as well as the disappearance of several low-field signals observed in the native NfnSL complex. These results suggest the site-differentiated glutamate residue facilitates higher spin states in the [4Fesingle bond4S] cluster to bridge energetic gaps in electron transfer to the bifurcating flavin in the native complex, preventing unwanted short-circuiting seen in the cysteine-substituted complex.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Understanding latent timescales in neural ordinary differential equation models of advection-dominated dynamical systems

The neural ordinary differential equation (ODE) framework has shown considerable promise in recent years in developing highly accelerated surrogate models for complex physical systems characterized by partial differential equations (PDEs). For PDE-based systems, state-of-the-art neural ODE strategies leverage a two-step procedure to achieve this acceleration: a nonlinear dimensionality reduction step provided by an autoencoder, and a time integration step provided by a neural-network based model for the resultant latent space dynamics (the neural ODE). This work explores the applicability of such autoencoder-based neural ODE strategies for PDEs in which advection terms play a critical role. More specifically, alongside predictive demonstrations, physical insight into the sources of model acceleration (i.e., how the neural ODE achieves its acceleration) is the scope of the current study. Such investigations are performed by quantifying the effects of both autoencoder and neural ODE components on latent system time-scales using eigenvalue analysis of dynamical system Jacobians. To this end, the sensitivity of various critical training parameters – de-coupled versus end-to-end training, latent space dimensionality, and the role of training trajectory length, for example – to both model accuracy and the discovered latent system timescales is quantified. Furthermore, this work specifically uncovers the key role played by the training trajectory length (the number of rollout steps in the loss function during training) on the latent system timescales: larger trajectory lengths correlate with an increase in limiting neural ODE time-scales, and optimal neural ODEs are found to recover the largest time-scales of the full-order (ground-truth) system. Demonstrations are performed across fundamentally different unsteady fluid dynamics configurations influenced by advection: (1) the Kuramoto–Sivashinsky equations (2) Hydrogen-Air channel detonations (the compressible reacting Navier–Stokes equations with detailed chemistry), and (3) 2D Atmospheric flow.

Advection-dominated dynamical systems↗

First measurement of polarized spin-density matrix elements and differential cross sections dσ/dt in ω photoproduction off the proton for 2.7 < Eγ < 5.2 GeV using CLAS at Jefferson Lab

We report on the differential cross sections dσ/dt, the unpolarized spin-density matrix elements ρ 00 0 , ρ 1 − 1 0 , Re ρ 10 0 , and the first extraction of the polarized elements Im ρ 10 3 , Im ρ 1 − 1 3 for the reaction γp → pω using the CLAS spectrometer at Jefferson Laboratory. The ω mesons were detected in their dominant charged decay mode, ω → π + π − π 0 , and all t-dependent results are presented in a fine binning for incident photon energies between 2.73 and 5.16 GeV (corresponding to the center-of-mass energy range W ∈ [ 2.45, 3.25 ] GeV). All matrix elements are first measurements for − t > 0.6 GeV2. Moreover, differential cross sections dσ/d(cos Θ c . m . ω ) and the corresponding angle-dependent unpolarized spin-density matrix elements in the Adair frame are presented for the incident photon energy range 1.56–3.80 GeV (corresponding to W ∈ [ 1.95, 2.83 ] GeV). These new ω photoproduction data are consistent with earlier CLAS results but extend the energy range well beyond the nucleon resonance region into the Regge regime. The comparison with Regge-theory-based model predictions shows that the new data impose more stringent constraints on our understanding of ω photoproduction.

Hu, T.↗

MUSTN1 is an indispensable factor in the proliferation, differentiation and apoptosis of skeletal muscle satellite cells in chicken

The yield and quality of the skeletal muscle are important economic traits in livestock and poultry production. The musculoskeletal embryonic nuclear protein 1 (MUSTN1) gene has been shown to be associated with embryonic development, postnatal growth, bone and skeletal muscle regeneration; however, its function in the skeletal muscle development of chicken remains unclear. Therefore, in this study, we observed that the expression level of MUSTN1 increased in conjunction with the proliferation of chicken skeletal muscle satellite cells (SMSCs). Knockdown of MUSTN1 in SMSCs downregulated the expression of cell proliferation genes as Pax7, CDK-2 and differentiation-relate genes including MyoD, MyoG, MyHC and MyH1B, whereas it upregulates the expression of cell apoptosis gene (Caspase-3) (P < 0.05). However, the combined analysis of CCK-8 and EdU showed that the cell vitality and EdU-positive cells of the si-MUSTN1 transfected group were significantly lower than those of the negative siRNA group (P < 0.05). In addition, the knockdown of MUSTN1 significantly increased the cell population in the G0/G1 phase and significantly decreased the cell population in the G2/M phase (P < 0.05), whereas the overexpression of MUSTN1 showed opposite effect. Taken together, our findings indicates that MUSTN1 is an important molecular factor that is responsible for regulating muscle growth and development in chickens, particularly, proliferation and differentiation of SMSCs.

60 APPLIED LIFE SCIENCES↗

Structure and dynamics of magneto-inertial, differentially rotating laboratory plasmas

We present a detailed characterization of the structure and evolution of differentially rotating plasmas driven on the MAGPIE pulsed-power generator (1.4 MA peak current, 240 ns rise time). The experiments were designed to simulate physics relevant to accretion discs and jets on laboratory scales. A cylindrical aluminium wire array Z pinch enclosed by return posts with an overall azimuthal off-set angle was driven to produce ablation plasma flows that propagate inwards in a slightly off-radial trajectory, injecting mass, angular momentum and confining ram pressure to a rotating plasma column on the axis. However, the plasma is free to expand axially, forming a collimated, differentially rotating axial jet that propagates at ${\approx }100\,{\rm km}\,{\rm s}^{-1}$ . The density profile of the jet corresponds to a dense shell surrounding a low-density core, which is consistent with the centrifugal barrier effect being sustained along the jet's propagation. We show analytically that, as the rotating plasma accretes mass, conservation of mass and momentum implies plasma radial growth scaling as $r \propto t^{1/3}$ . As the characteristic moment of inertia increases, the rotation velocity is predicted to decrease and settle on a characteristic value ${\approx }20\,{\rm km}\,{\rm s}^{-1}$ . We find that both predictions are in agreement with Thomson scattering and optical self-emission imaging measurements.

Valenzuela-Villaseca, V. (ORCID:0000000167721441)↗

Strong Differential Monovalent Anion Selectivity in Narrow Diameter Carbon Nanotube Porins

Inner pores of carbon nanotubes combine extremely fast water transport and ion selectivity that could potentially be useful for high-performance water desalination and separation applications. In this study, we used dye-quenching halide assays and stopped-flow spectrometry to determine intrinsic permeability of three small monovalent halide anions (chloride, bromide, iodide) and one pseudohalide anion (thiocyanate) through narrow 0.8 nm-diameter carbon nanotube porins (CNTPs). These measurements revealed unexpectedly strong differential ion selectivity with permeabilities of different ions varying by up to two orders of magnitude. Removal of the negative charge from the nanotube entrance increased anion permeability by only a relatively small factor, indicating that electrostatic repulsion was not a major determinant of CNTP selectivity. First principle molecular dynamics simulations revealed that the origin of this strong differential ion selectivity is partial dehydration of anions upon entry into the narrow CNTP channels.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Differentiable, Learnable, Regionalized Process-Based Models With Multiphysical Outputs can Approach State-Of-The-Art Hydrologic Prediction Accuracy

Predictions of hydrologic variables across the entire water cycle have significant value for water resources management as well as downstream applications such as ecosystem and water quality modeling. Recently, purely data-driven deep learning models like long short-term memory (LSTM) showed seemingly insurmountable performance in modeling rainfall runoff and other geoscientific variables, yet they cannot predict untrained physical variables and remain challenging to interpret. Here, we show that differentiable, learnable, process-based models (called δ models here) can approach the performance level of LSTM for the intensively observed variable (streamflow) with regionalized parameterization. We use a simple hydrologic model HBV as the backbone and use embedded neural networks, which can only be trained in a differentiable programming framework, to parameterize, enhance, or replace the process-based model's modules. Without using an ensemble or post-processor, δ models can obtain a median Nash-Sutcliffe efficiency of 0.732 for 671 basins across the USA for the Daymet forcing data set, compared to 0.748 from a state-of-the-art LSTM model with the same setup. For another forcing data set, the difference is even smaller: 0.715 versus 0.722. Meanwhile, the resulting learnable process-based models can output a full set of untrained variables, for example, soil and groundwater storage, snowpack, evapotranspiration, and baseflow, and can later be constrained by their observations. Both simulated evapotranspiration and fraction of discharge from baseflow agreed decently with alternative estimates. The general framework can work with models with various process complexity and opens up the path for learning physics from big data.

54 ENVIRONMENTAL SCIENCES↗

Inferring Plant Acclimation and Improving Model Generalizability With Differentiable Physics‐Informed Machine Learning of Photosynthesis

Net photosynthesis (A N ) is a key component of the global carbon cycle influencing climate feedback over decadal scales. Although plant acclimation to environmental changes can modify A N , traditional vegetation models in Earth system models (ESMs) often rely on plant functional type (PFT)-specific parameterizations or simplified acclimation assumptions limiting generalizability across time, space, and PFTs. In this study, we developed a differentiable photosynthesis model to learn the environmental dependencies of V c,max25 (maximum carboxylation rate at 25°C, representing photosynthetic capacity), as this genre of hybrid physics-informed machine learning can seamlessly train neural networks and process-based equations together. Compared to PFT-specific parameterization of V c,max25 , learning the environment dependencies of key photosynthetic parameters improved model spatiotemporal generalizability. Applying environmental acclimation to V c,max25 led to substantial variations in global mean A N indicating the need to address acclimation in ESMs. The model effectively captured multivariate observations (V c,max25 , A N , and stomatal conductance (g s )) simultaneously with multivariate constraints, improving generalization across space and PFTs. It also learned sensible acclimation relationships of V c,max25 to different environmental conditions. The model explained more than 54%, 57%, and 62% of the variance of A N , g s , and V c,max25 , respectively, presenting a first global-scale spatial test benchmark of A N and g s . These results highlight the potential for differentiable modeling to enhance process-based modules in ESMs and effectively leverage information from large, multivariate data sets.

54 ENVIRONMENTAL SCIENCES↗

Sulfate differentially stimulates but is not respired by diverse anaerobic methanotrophic archaea

Abstract Sulfate-coupled anaerobic oxidation of methane (AOM) is a major methane sink in marine sediments. Multiple lineages of anaerobic methanotrophic archaea (ANME) often coexist in sediments and catalyze this process syntrophically with sulfate-reducing bacteria (SRB), but the potential differences in ANME ecophysiology and mechanisms of syntrophy remain unresolved. A humic acid analog, anthraquinone 2,6-disulfonate (AQDS), could decouple archaeal methanotrophy from bacterial sulfate reduction and serve as the terminal electron acceptor for AOM (AQDS-coupled AOM). Here in sediment microcosm experiments, we examined variations in physiological response between two co-occurring ANME-2 families (ANME-2a and ANME-2c) and tested the hypothesis of sulfate respiration by ANME-2. Sulfate concentrations as low as 100 µM increased AQDS-coupled AOM nearly 2-fold matching the rates of sulfate-coupled AOM. However, the SRB partners remained inactive in microcosms with sulfate and AQDS and neither ANME-2 families respired sulfate, as shown by their cellular sulfur contents and anabolic activities measured using nanoscale secondary ion mass spectrometry. ANME-2a anabolic activity was significantly higher than ANME-2c, suggesting that ANME-2a was primarily responsible for the observed sulfate stimulation of AQDS-coupled AOM. Comparative transcriptomics showed significant upregulation of ANME-2a transcripts linked to multiple ABC transporters and downregulation of central carbon metabolism during AQDS-coupled AOM compared to sulfate-coupled AOM. Surprisingly, genes involved in sulfur anabolism were not differentially expressed during AQDS-coupled AOM with and without sulfate amendment. Collectively, this data indicates that ANME-2 archaea are incapable of respiring sulfate, but sulfate availability differentially stimulates the growth and AOM activity of different ANME lineages.

59 BASIC BIOLOGICAL SCIENCES↗

Learning emergent partial differential equations in a learned emergent space

We propose an approach to learn effective evolution equations for large systems of interacting agents. This is demonstrated on two examples, a well-studied system of coupled normal form oscillators and a biologically motivated example of coupled Hodgkin-Huxley-like neurons. For such types of systems there is no obvious space coordinate in which to learn effective evolution laws in the form of partial differential equations. In our approach, we accomplish this by learning embedding coordinates from the time series data of the system using manifold learning as a first step. In these emergent coordinates, we then show how one can learn effective partial differential equations, using neural networks, that do not only reproduce the dynamics of the oscillator ensemble, but also capture the collective bifurcations when system parameters vary. The proposed approach thus integrates the automatic, data-driven extraction of emergent space coordinates parametrizing the agent dynamics, with machine-learning assisted identification of an emergent PDE description of the dynamics in this parametrization.

97 MATHEMATICS AND COMPUTING↗

Ecological trade-offs drive phenotypic and genetic differentiation of Arabidopsis thaliana in Europe

Plant diversity is shaped by trade-offs between traits related to competitive ability, propagule dispersal, and stress resistance. However, we still lack a clear understanding of how these trade-offs influence species distribution and population dynamics. In Arabidopsis thaliana , recent genetic analyses revealed a group of cosmopolitan genotypes that successfully recolonized Europe from its center after the last glaciation, excluding older (relict) lineages from the distribution except for their north and south margins. Here, we tested the hypothesis that cosmopolitans expanded due to higher colonization ability, while relicts persisted at the margins due to higher tolerance to competition and/or stress. We compared the phenotypic and genetic differentiation between 71 European genotypes originating from the center, and the south and north margins. We showed that a trade-off between plant fecundity and seed mass shapes the differentiation of A. thaliana in Europe, suggesting that the success of the cosmopolitan groups could be explained by their high dispersal ability. However, at both north and south margins, we found evidence of selection for alleles conferring low dispersal but highly competitive and stress-resistance abilities. This study sheds light on the role of ecological trade-offs as evolutionary drivers of the distribution and dynamics of plant populations.

59 BASIC BIOLOGICAL SCIENCES↗

Systematic Comparison of High-throughput Single-Cell and Single-Nucleus Transcriptomes during Cardiomyocyte Differentiation

A comprehensive reference map of all cell types in the human body is necessary for improving our understanding of fundamental biological processes and in diagnosing and treating disease. High-throughput single-cell RNA sequencing techniques have emerged as powerful tools to identify and characterize cell types in complex and heterogeneous tissues. However, extracting intact cells from tissues and organs is often technically challenging or impossible, for example in heart or brain tissue. Single-nucleus RNA sequencing provides an alternative way to obtain transcriptome profiles of such tissues. To systematically assess the differences between high-throughput single-cell and single-nuclei RNA-seq approaches, we compared Drop-seq and DroNc-seq, two microfluidic-based 3' RNA capture technologies that profile total cellular and nuclear RNA, respectively, during a time course experiment of human induced pluripotent stem cells (iPSCs) differentiating into cardiomyocytes. Clustering of timeseries transcriptomes from Drop-seq and DroNc-seq revealed six distinct cell types, five of which were found in both techniques. Furthermore, single-cell trajectories reconstructed from both techniques reproduced expected differentiation dynamics. We then applied DroNc-seq to postmortem heart tissue to test its performance on heterogeneous human tissue samples. Our data confirm that DroNcseq yields similar results to Drop-seq on matched samples and can be successfully used to generate reference maps for the human cell atlas.

59 BASIC BIOLOGICAL SCIENCES↗

The inheritance of anthracnose (Colletotrichum sublineola) resistance in sorghum differential lines QL3 and IS18760

Anthracnose caused by the fungal pathogen C. sublineola is an economically important constraint on worldwide sorghum production. The most effective strategy to safeguard yield is through the introgression of resistance alleles. This requires elucidation of the genetic basis of the different resistance sources that have been identified. In this study, 223 recombinant inbred lines (RILs) derived from crossing anthracnose-differentials QL3 (96 RILs) and IS18760 (127 RILs) with the common susceptible parent PI609251 were evaluated at four field locations in the United States (Florida, Georgia, Texas, and Puerto Rico) for their anthracnose resistance response. Both RIL populations were highly susceptible to anthracnose in Florida and Georgia, while in Puerto Rico and Texas they were segregating for anthracnose resistance response. A genome scan using a composite linkage map of 982 single nucleotide polymorphisms (SNPs) detected two genomic regions of 4.31 and 0.85 Mb on chromosomes 4 and 8, respectively, that explained 10–27% of the phenotypic variation in Texas and Puerto Rico. In parallel, a subset of 43 RILs that contained 67% of the recombination events were evaluated against anthracnose pathotypes from Arkansas (2), Puerto Rico (2) and Texas (4) in the greenhouse. A genome scan showed that the 7.57 Mb region at the distal end of the short arm of chromosome 5 is associated with the resistance response against the pathotype AMP-048 from Arkansas. Comparative analysis identified the genomic region on chromosome 4 overlaps with an anthracnose resistance locus identified in another anthracnose-differential line, SC414-12E, indicating this genomic region is of interest for introgression in susceptible sorghum germplasm. Candidate gene analysis for the resistance locus on chromosome 5 identified an R -gene cluster that has high similarity to another R -gene cluster associated with anthracnose resistance on chromosome 9.

59 BASIC BIOLOGICAL SCIENCES↗

Physics-informed machine learning with differentiable programming for heterogeneous underground reservoir pressure management

Abstract Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO $$_2$$ 2 sequestration and wastewater injection. Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface. The heterogeneity typically requires high-fidelity physics-based models to make predictions on CO $$_2$$ 2 fate. Furthermore, characterizing the heterogeneity accurately is fraught with parametric uncertainty. Accounting for both, heterogeneity and uncertainty, makes this a computationally-intensive problem challenging for current reservoir simulators. To tackle this, we use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization at critical reservoir locations. We use DPFEHM framework, which has trustworthy physics based on the standard two-point flux finite volume discretization and is also automatically differentiable like machine learning models. Our physics-informed machine learning framework uses convolutional neural networks to learn an appropriate extraction rate based on the permeability field. We also perform a hyperparameter search to improve the model’s accuracy. Training and testing scenarios are executed to evaluate the feasibility of using physics-informed machine learning to manage reservoir pressures. We constructed and tested a sufficiently accurate simulator that is 400 000 times faster than the underlying physics-based simulator, allowing for near real-time analysis and robust uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗