Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gradient information”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Performance of a Natural Gas Solid Oxide Fuel Cell System With and Without Carbon Capture

The fuel cell program at the United States Department of Energy (DOE) National Energy Technology Laboratory (NETL) is focused on the development of low-cost, highly efficient, and reliable fossil-fuel-based solid oxide fuel cell (SOFC) power systems that can generate environmentally-friendly electric power with at least 90 percent carbon capture. NETL’s SOFC technology development roadmap is aligned with near-term market opportunities in the distributed generation sector to validate and advance the technology while paving the way for utility-scale natural gas (NG)- and coal-derived synthesis gas-fueled applications via progressively larger system demonstrations. The present study represents a part of a series of system evaluations being carried out at NETL to aid in prioritizing technological advances along research pathways to the realization of utility-scale SOFC systems, a transformational goal of the fuel cell program. In particular, the system performance of utility-scale NG fuel cell (NGFC) systems with and without carbon dioxide (CO2) capture is presented. The NGFC system analyzed features an external auto-thermal reformer (ATR) feeding the fuel to the SOFC system consisting of planar anode-supported SOFC with separated anode and cathode off-gas streams. In systems with CO2 capture, an air separation unit (ASU) is used to provide the oxygen for the ATR and for the combustion of unutilized fuel in the SOFC anode exhaust along with a CO2 purification unit to provide a nearly pure CO2 stream suitable for transport for usage in enhanced oil recovery operations or for storage in underground saline formations. Remaining thermal energy in the exhaust gases is recovered in a bottoming steam Rankine cycle while supplying any process heat requirements. A reduced order model (ROM) developed at the Pacific Northwest National Laboratory (PNNL) is used to predict the SOFC performance. The ROM, while being computationally effective for system studies, provides other detailed information about the state of the stack, such as the internal temperature gradient, generally not available from simple performance models often used to represent the SOFC. Such additional information can be important in system optimization studies to preclude operation under off-design conditions that can adversely impact overall system reliability. The NGFC system performance was analyzed by varying salient system parameters, including the percent of internal (to the SOFC module) NG reformation—ranging from 0 to 100 percent—fuel utilization, and current density. The impact of advances in underlying SOFC technology on electrical performance was also explored.

solid oxide fuel cell (SOFC), natural gas fuel cel↗

Extending Parsimonious Bayesian Inference

Parsimonious Bayesian inference is a theoretical framework for efficient data assimilation that seeks to balance increased consistency between predictions and training data against corresponding increases in model complexity. Within this framework, over-training is understood as optimization that encodes excessive information within model parameters while only achieving small improvements between predictions and training data. This project aims to develop practical methods of limiting excess model information during optimization. One key observation is that practical heuristics for parsimonious learning in high-dimensions must balance expressivity, i.e. the ability of the model to capture diverse predictions with only a few non-zero parameters, against discoverability, i.e. the ability to train the model with gradient-based optimization and drive parameters to low information states. As such, we developed logical activation functions that are able to adaptively approximate arbitrary truth tables that define Boolean logic operations within a probabilistic framework. These functions have demonstrated the ability to learn exclusive disjunction (XOR) and conditioned disjunction (if [condition] then [result_if_true] else [result_if_false]) within a single layer of a neural network. To efficiently exploit these activation functions to drive parsimonious learning required several other advances within the domain of variational inference. The most efficient form of complexity suppression is structured sparsification, driving most model parameters to zero while achieving the structural coherence among nonzeros needed for bandwidth reduction. Such models are not only far more efficient at suppressing information-theoretic complexity, they also reduce the other forms of complexity (computations, communication, storage, and the number of dependencies needed to evaluate predictions). Aiming to support enhanced sparsification, this project examined new approaches to high-dimensional variational inference that allow us to calibrate and control parameter uncertainty during optimization. By identifying which parameters can sustain sparsifying perturbations with little impact on prediction quality, we can develop better pruning strategies by framing them as approximate Bayesian inference. These advances also open paths to mitigate concerns with deploying advanced learning methods in resource-constrained environments, such as running models on power-limited or communication-limited devices.

97 MATHEMATICS AND COMPUTING↗

A Scalable Gradient Free Method for Bayesian Experimental Design with Implicit Models

Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods have difficulties in efficiently estimating the posterior distribution and maximizing the mutual information (MI) between data and parameters. Recent work proposed the use of gradient ascent to maximize a lower bound on MI to deal with these issues. However, the approach requires a sampling path to compute the pathwise gradient of the MI lower bound with respect to the design variables, and such a pathwise gradient is usually inaccessible for implicit models. In this paper, we propose a novel approach that leverages recent advances in stochastic approximate gradient ascent incorporated with a smoothed variational MI estimator for efficient and robust BED. Without the necessity of pathwise gradients, our approach allows the design process to be achieved through a unified procedure with an approximate gradient for implicit models. Several experiments show that our approach outperforms baseline methods, and significantly improves the scalability of BED in high-dimensional problems.

Zhang, Jiaxin↗

MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained via gradient-based minimization of a nonlinear least squares objective. While the vast majority of state-of-the-art assumes hierarchical connections between information sources, our approach works with flexibly structured information sources that may not admit a strict hierarchy. The formulation has two advantages: (1) increased data efficiency due to parsimonious multifidelity networks that can be tailored to the application; and (2) no constraints on the training data—we can combine noisy, non-nested evaluations of the information sources. Finally, numerical examples ranging from synthetic to physics-based computational mechanics simulations indicate the error in our approach can be orders-of-magnitude smaller, particularly in the low-data regime, than single-fidelity and hierarchical multifidelity approaches.

97 MATHEMATICS AND COMPUTING↗

An Online Joint Optimization–Estimation Architecture for Distribution Networks

Here in this article, we propose an optimal joint optimization-estimation architecture for distribution networks, which jointly solves the optimal power flow (OPF) problem and static state estimation (SE) problem through an online gradient-based feedback algorithm. The main objective is to enable a fast and timely interaction between the OPF decisions and state estimators with limited sensor measurements. First, convergence and optimality of the proposed algorithm are analytically established. Then, the proposed gradient-based algorithm is modified by introducing statistical information of the inherent estimation and linearization errors for an improved and robust performance of the online OPF decisions. Overall, the proposed method eliminates the traditional separation of operation and monitoring, where optimization and estimation usually operate at distinct layers and different time scales. Hence, it enables a computationally affordable, efficient, and robust online operational framework for distribution networks under time-varying settings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data for “Tree root nutrient uptake kinetics vary with nutrient availability, environmental conditions, and root traits: A global analysis”

This data package contains data and code used in the paper “Tree root nutrient uptake kinetics vary with nutrient availability, environmental conditions, and root traits: A global analysis”. The central product is a global dataset of root inorganic nutrient uptake rates and kinetics parameters covering temperate, boreal, and sub/tropical tree species, representing a collection of nutrient uptake data from published studies. This dataset enables tree investigation of root nutrient uptake rates across species, space, and experimental conditions. The data can also be combined with supplementary data on root and soil traits or with external datasets (e.g. R scripts contained within use data from FRED 3.0; (Iversen et al., 2021)). Contained within is the main nutrient data “uptake_data.csv” as well as 4 additional .csv files that link uptake data to supplementary measurements, source references, taxonomic information, and additional nutrient uptake measurements across nutrient gradients, and 1 .csv file that records meta-analysis results for plotting with the R scripts. There are seven R scripts that support data analysis and creation of the figures in the related publication.

54 ENVIRONMENTAL SCIENCES↗

hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty

Bayesian inference provides a systematic framework for integration of data with mathematical models to quantify the uncertainty in the solution of the inverse problem. However, the solution of Bayesian inverse problems governed by complex forward models described by partial differential equations (PDEs) remains prohibitive with black-box Markov chain Monte Carlo (MCMC) methods. We present hIPPYlib-MUQ, an extensible and scalable software framework that contains implementations of state-of-the art algorithms aimed to overcome the challenges of high-dimensional, PDE-constrained Bayesian inverse problems. These algorithms accelerate MCMC sampling by exploiting the geometry and intrinsic low-dimensionality of parameter space via derivative information and low rank approximation. The software integrates two complementary open-source software packages, hIPPYlib and MUQ. hIPPYlib solves PDE-constrained inverse problems using automatically-generated adjoint-based derivatives, but it lacks full Bayesian capabilities. MUQ provides a spectrum of powerful Bayesian inversion models and algorithms, but expects forward models to come equipped with gradients and Hessians to permit large-scale solution. By combining these two complementary libraries, we created a robust, scalable, and efficient software framework that realizes the benefits of each and allows us to tackle complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering disciplines. To illustrate the capabilities of hIPPYlib-MUQ, we present a comparison of a number of MCMC methods available in the integrated software on several high-dimensional Bayesian inverse problems. These include problems characterized by both linear and nonlinear PDEs, various noise models, and different parameter dimensions. The results demonstrate that large (~ 50×) speedups over conventional black box and gradient-based MCMC algorithms can be obtained by exploiting Hessian information (from the log-posterior), underscoring the power of the integrated hIPPYlib-MUQ framework.

97 MATHEMATICS AND COMPUTING↗

Energy cost of localization of relational quantum information

Entanglement of spatially separated quantum states is usually defined with respect to a reference frame provided by some external observer. Thus, if one wishes to localize the quantum information within a spatially separated entangled state, one must enact an entanglement extraction protocol also defined with respect to that external frame. Entanglement extraction for Gaussian ground states in such an external frame construction has been shown to require a minimum energy and is hence an interesting process for gravitational physics, where examinations of localization vs energy cost have a long history. General covariance, however, precludes dependence on external frames. In order to enact an extraction protocol in a generally covariant theory, dependence on the external reference frame must first be removed and the states made relational. Here, we examine the implementation of an extraction protocol for Gaussian states, whose center of mass and relational degrees of freedom are entangled, in a relational toy model where translation invariance stands in for full diffeomorphism invariance. Constructing fully relational states and the corresponding extraction/localization can, in principle, be done in two ways. External frame position information can be removed through 𝐺-twirling over translations or one can spontaneously break the translation symmetry via the gradient of an auxiliary field, or 𝑍-model. We determine the energetics of quantum information localization after the states have been made fully relational via both the 𝐺-twirl and 𝑍-model. We also show one can obtain the 𝐺-twirl construction from a 𝑍-model as a limit of positive operator valued measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

From subsidies to stressors: Positively skewed ecological gradients alter biological responses to nutrients in streams

Abstract Subsidy–stress gradients offer a useful framework for understanding ecological responses to perturbation and may help inform ecological metrics in highly modified systems. Historic, region‐wide shifts from bottomland hardwood forest to row crop agriculture can cause positively skewed impact gradients in alluvial plain ecoregions, resulting in tolerant organisms that typically exhibit a subsidy response (increased abundance in response to environmental stressors) shifting to a stress response (declining abundance at higher concentrations). As a result, observed biological tolerance in modified ecosystems may differ from less modified regions, creating significant challenges for detecting biological responses to restoration efforts. Using the agriculturally dominated Mississippi Alluvial Plain (MAP) ecoregion in Mississippi, USA, as a case study, we tested the hypothesis that macroinvertebrate taxa that typically display a subsidy response to nutrient enrichment in less modified ecoregions (i.e., nutrient‐tolerance) shift to a stress response to increasing nutrients in highly modified watersheds with elevated baseline nutrient conditions (i.e., nutrient intolerance). The abundance and diversity of MAP‐specific intolerant taxa identified with threshold indicator taxa analysis were either unresponsive or exhibited a subsidy response to increasing nutrients in less modified ecoregions in Mississippi with less land alteration and lower nutrient concentrations, but declined at higher concentrations, providing evidence for a stress response to elevated nutrients in the MAP. Additionally, MAP‐specific tolerant and intolerant taxa richness responded to increased nutrients predictably and consistently across space and time within the MAP. However, in MAP streams, elevated specific conductance was predicted to dampen the response of tolerant and intolerant taxa richness to increasing nutrient concentrations, highlighting the importance of considering multistressor interactions when interpreting biological data. Lastly, we demonstrate the efficacy of this approach with sediment bacterial communities characterized with amplicon sequencing, which lack sufficient life history characteristics necessary for the development of multimetric indices. Both macroinvertebrate and bacterial communities responded similarly to increasing nutrient concentrations, suggesting DNA‐based approaches may provide an efficient biological assessment tool for monitoring water quality improvements in highly modified watersheds.

DeVilbiss, Stephen E. [U.S. Geological Survey Lowe↗

Three-Dimensional Analysis of Particle Distribution on Filter Layers inside N95 Respirators by Deep Learning

The global COVID-19 pandemic has changed many aspects of daily lives. Wearing personal protective equipment, especially respirators (face masks), has become common for both the public and medical professionals, proving to be effective in preventing spread of the virus. Nevertheless, a detailed understanding of respirator filtration-layer internal structures and their physical configurations is lacking. Here, we report three-dimensional (3D) internal analysis of N95 filtration layers via X-ray tomography. Using deep learning methods, we uncover how the distribution and diameters of fibers within these layers directly affect contaminant particle filtration. The average porosity of the filter layers is found to be 89.1%. Contaminants are more efficiently captured by denser fiber regions, with fibers <1.8 μm in diameter being particularly effective, presumably because of the stronger electric field gradient on smaller diameter fibers. This study provides critical information for further development of N95-type respirators that combine high efficiency with good breathability.

42 ENGINEERING↗

Monitored Fluctuating Hydrodynamics

We introduce a hydrodynamic framework for describing monitored classical stochastic processes. We study the conditional ensembles for these monitored processes—i.e., we compute spacetime correlation functions conditioned on a fixed, typical measurement record. In the presence of global symmetries we show that these conditional ensembles can undergo measurement-induced “sharpening” phase transitions as a function of the monitoring rate; moreover, even weak monitoring can give rise to novel critical phases, derived entirely from a classical perspective. We give a simple hydrodynamic derivation of the known “charge-fuzzy phase” for weakly monitored diffusive many-body quantum systems. We show that although the unmonitored symmetric and asymmetric exclusion processes are in different universality classes of transport, the fluctuations in their conditional ensembles flow to the same fixed point with emergent relativistic invariance under monitoring. On the other hand, weakly monitored systems with non-Abelian symmetries enter a novel strongly coupled fixed point with nontrivial dynamical exponent, which we characterize. Our formalism naturally accounts for monitoring general observables, such as currents or density gradients, and allows for a direct calculation of information-theoretic diagnostics of sharpening transitions, including the Shannon entropy of the measurement record.

classical statistical mechanics↗

Trustworthy Physics-Informed Deep Learning for Predictive Scientific Computing

This project has developed powerful trustworthy physics-informed deep learning (TPiDL) models and methods to fundamentally enhance the scale and power of computational modeling in the scientific and engineering domains. Deep learning (DL) has radically advanced the state-of-the-art in machine learning, computer vision, natural language processing, and also scientific computing. Nevertheless, progress has been driven almost entirely by empirical observations, hacks, and tricks. Under the support of this project, the graph operator learning tools and advanced trustworthy physical informed neural networks have been developed. In addition, stochastic gradient replica-exchange Markov Chain Monte Carlo (MCMC) sampling algorithms have been designed to quantify the uncertainties and speed up the training of large-scale neural networks.

97 MATHEMATICS AND COMPUTING↗

Geographic patterns and determinants of antibiotic resistomes in coastal sediments across complex ecological gradients

Coastal areas are highly influenced by terrestrial runoffs and anthropogenic disturbances, commonly leading to ecological gradients from bay, nearshore, to offshore areas. Although the occurrence and distribution of sediment antibiotic resistome are explored in various coastal environments, little information is available regarding geographic patterns and determinants of coastal sediment antibiotic resistomes across ecological gradients at the regional scale. Here, using high-throughput quantitative PCR, we investigated the geographic patterns of 285 antibiotic resistance genes (ARGs) in coastal sediments across a ~ 200 km scale in the East China Sea. Sediment bacterial communities and physicochemical properties were characterized to identify the determinants of sediments antibiotic resistome. Higher richness and abundance of ARGs were detected in the bay samples compared with those in nearshore and offshore samples, and significant negative correlations between the richness and/or abundance of ARGs and the distance to coastline (DTC) were identified, whereas different types of ARGs showed inconsistency in their relationships with DTC. The composition of antibiotic resistome showed significant correlations with nutrition-related variables (including NH 4 + -N, NO 3 − -N, and total phosphorus) and metals/metalloid (including As, Cu, Ni, and Zn), suggesting that terrestrial disturbances largely shape the antibiotic resistome. The Bipartite network showed strong associations between ARGs and mobile genetic elements (MGEs), and Partial Least Squares Path Modeling further revealed that terrestrial disturbance strength (as indicated by DTC) directly affected abiotic environmental conditions and bacterial community composition, and indirectly affected antibiotic resistome via MGEs. These findings provide insights into regional variability of sediment antibiotic resistome and its shaping path across complex ecological gradients, highlighting terrestrial disturbances as determinative forces in shaping coastal sediment antibiotic resistomes.

Xiong, Shangling↗

A Comprehensive Analysis of PINNs for Power System Transient Stability

The integration of machine learning in power systems, particularly in stability and dynamics, addresses the challenges brought by the integration of renewable energies and distributed energy resources (DERs). Traditional methods for power system transient stability, involving solving differential equations with computational techniques, face limitations due to their time-consuming and computationally demanding nature. This paper introduces physics-informed Neural Networks (PINNs) as a promising solution for these challenges, especially in scenarios with limited data availability and the need for high computational speed. PINNs offer a novel approach for complex power systems by incorporating additional equations and adapting to various system scales, from a single bus to multi-bus networks. Our study presents the first comprehensive evaluation of physics-informed Neural Networks (PINNs) in the context of power system transient stability, addressing various grid complexities. Additionally, we introduce a novel approach for adjusting loss weights to improve the adaptability of PINNs to diverse systems. Our experimental findings reveal that PINNs can be efficiently scaled while maintaining high accuracy. Furthermore, these results suggest that PINNs significantly outperform the traditional ode45 method in terms of efficiency, especially as the system size increases, showcasing a progressive speed advantage over ode45.

97 MATHEMATICS AND COMPUTING↗

A Comprehensive Analysis of PINNs for Power System Transient Stability

The integration of machine learning in power systems, particularly in stability and dynamics, addresses the challenges brought by the integration of renewable energies and distributed energy resources (DERs). Traditional methods for power system transient stability, involving solving differential equations with computational techniques, face limitations due to their time-consuming and computationally demanding nature. This paper introduces physics-informed Neural Networks (PINNs) as a promising solution for these challenges, especially in scenarios with limited data availability and the need for high computational speed. PINNs offer a novel approach for complex power systems by incorporating additional equations and adapting to various system scales, from a single bus to multi-bus networks. Our study presents the first comprehensive evaluation of physics-informed Neural Networks (PINNs) in the context of power system transient stability, addressing various grid complexities. Additionally, we introduce a novel approach for adjusting loss weights to improve the adaptability of PINNs to diverse systems. Our experimental findings reveal that PINNs can be efficiently scaled while maintaining high accuracy. Furthermore, these results suggest that PINNs significantly outperform the traditional ode45 method in terms of efficiency, especially as the system size increases, showcasing a progressive speed advantage over ode45.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Confronting the water potential information gap

Water potential directly controls the function of leaves, roots and microbes, and gradients in water potential drive water flows throughout the soil–plant–atmosphere continuum. Notwithstanding its clear relevance for many ecosystem processes, soil water potential is rarely measured in situ, and plant water potential observations are generally discrete, sparse, and not yet aggregated into accessible databases. These gaps limit our conceptual understanding of biophysical responses to moisture stress and inject large uncertainty into hydrologic and land-surface models. Here, we outline the conceptual and predictive gains that could be made with more continuous and discoverable observations of water potential in soils and plants. We discuss improvements to sensor technologies that facilitate in situ characterization of water potential, as well as strategies for building new networks that aggregate water potential data across sites. Here, we end by highlighting novel opportunities for linking more representative site-level observations of water potential to remotely sensed proxies. Together, these considerations offer a road map for clearer links between ecohydrological processes and the water potential gradients that have the ‘potential’ to substantially reduce conceptual and modelling uncertainties.

58 GEOSCIENCES↗

Coastal-Urban-Rural Atmospheric Gradient Experiment (CoURAGE) Science Plan

Understanding the mechanisms governing the urban atmospheric environment is critical for informing urban populations regarding the impacts of climate change and associated mitigation and adaptation measures. Earth system (climate and weather) models have not yet been adapted to provide accurate predictions of climate and weather variability within cities, nor do they provide well-tested representations of the impacts of urban systems on the atmospheric environment. These limitations are largely due to limited field data available for testing and development of these models. We will deploy the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s first Mobile Facility (AMF1) to the mid-Atlantic region surrounding the city of Baltimore for the Coast-Urban-Rural Atmospheric Gradient Experiment (CoURAGE). This deployment will create a four-node regional atmospheric observatory network including Baltimore and its three primary surrounding environments – rural, urban, and bay. CoURAGE investigators will study the interactions among the Earth’s surface, the atmospheric boundary layer, aerosols and atmospheric composition, clouds, radiation, and precipitation at each site, and examine how the spatial gradients across the region interact to create the climate conditions in Baltimore. This study will determine the degree to which Baltimore’s atmospheric environment depends on interactive feedbacks in the atmospheric system and the degree to which conditions in Baltimore depend on the surrounding environment. Some topics of interest include how urban land management exacerbates heat waves, the impact of regional mesoscale winds (nocturnal jet, bay breeze) on urban air pollution and cloud cover, and the impact of the urban heat island and aerosol production on heavy precipitation events. Understanding this integrated coast-urban-rural system quantitatively and with good accuracy and precision is critical to informing climate adaptation and mitigation efforts in the city of Baltimore. The understanding gained should be applicable to many similar coastal, mid-latitude urban centers. Another important objective of CoURAGE is to improve the representation of the climate of coastal cities in Earth systems models (ESMs). CoURAGE investigators will use the observations to test current ESMs, identify weaknesses and work towards improved simulations of this complex environment. The ARM core facility will be deployed in the city of Baltimore, complementing the Baltimore Social-Environmental Collaborative (BSEC), a DOE urban integrated field laboratory (UIFL). Ancillary sites will be deployed to rural Maryland northwest of Baltimore, and to the southern end of Kent Island within Chesapeake Bay. The fourth node will be a long-term atmospheric observatory operated in Beltsville, Maryland by Howard University and the Maryland Department of the Environment. Measurements will be conducted for one year, starting in December of 2024. There will be two intensive operational periods (IOPs), one in summer and one in winter, when the ancillary sites will be enhanced with additional balloon launches, tethered balloon system (TBS) operation, and added atmospheric composition measurements.

54 ENVIRONMENTAL SCIENCES↗

STEM Ptychographic Holography of Electric and Magnetic Potentials

The development of fast an efficient direct electron imaging detectors have enabled the advancement of phase-imaging techniques in STEM such as iterative ptychography. As beneficial as these techniques are to imaging phase objects, the information recorded in the raw data is due to phase gradients across the probe, so it can be challenging to reconstruct slowly varying phase at lower spatial frequencies such as those induced by electric or magnetic potentials within the specimen. STEM holography [1,2] is an interferometric 4D-STEM technique where electrons in the beam are coherently divided into a superposition of two or more spatially separated probes which are then scanned over the specimen. For example, in a two-beam superposition, the two probes form overlapping bright field discs at the detector which then interfere (left of Fig. 1). Furthermore, if one probe passes through vacuum while the other transmits through the specimen, the resulting relative phase shift can be measured by recording shifts in the interference pattern. STEM holography is thus directly sensitive to the phase of the probe relative to the reference beam, and this phase can be measured regardless of the convergence angle of the probe, unlike single beam ptychography.

Biological Sciences↗