Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization

In this paper, we propose a novel hardware accelerator for GCN inference called I-GCN that significantly improves data locality and reduces unnecessary computation through a new online graph restructuring algorithm we refer to as islandization. The proposed algorithm finds clusters of nodes with strong internal but weak external connections. The islandization process yields two major benefits. First, by processing islands rather than individual nodes, there is better on-chip data reuse and fewer off-chip memory accesses. Second, there is less redundant computation as aggregation for common/shared neighbors in an island can be reused. The parallel search, identification, and leverage of graph islands are all handled purely in hardware at runtime working in an incremental pipelined manner. This is done without any preprocessing of the graph data or adjustment of the GCN model structure.

Geng, Tong↗
NASA NTRS2014

The Kinematic and Microphysical Control of Lightning Rate, Extent and NOX Production

The Deep Convective Clouds and Chemistry (DC3) experiment seeks to quantify the relationship between storm physics, lightning characteristics and the production of nitrogen oxides via lightning (LNOx). The focus of this study is to investigate the kinematic and microphysical control of lightning properties, particularly those that may govern LNOx production, such as flash rate, type and extent across Alabama during DC3. Prior studies have demonstrated that lightning flash rate and type is correlated to kinematic and microphysical properties in the mixed-phase region of thunderstorms such as updraft volume and graupel mass. More study is required to generalize these relationships in a wide variety of storm modes and meteorological conditions. Less is known about the co-evolving relationship between storm physics, morphology and three-dimensional flash extent, despite its importance for LNOx production. To address this conceptual gap, the NASA Lightning Nitrogen Oxides Model (LNOM) is applied to North Alabama Lightning Mapping Array (NALMA) and Vaisala National Lightning Detection Network(TM) (NLDN) observations following ordinary convective cells through their lifecycle. LNOM provides estimates of flash rate, flash type, channel length distributions, lightning segment altitude distributions (SADs) and lightning NOx production profiles. For this study, LNOM is applied in a Lagrangian sense to multicell thunderstorms over Northern Alabama on two days during DC3 (21 May and 11 June 2012) in which aircraft observations of NOx are available for comparison. The LNOM lightning characteristics and LNOX production estimates are compared to the evolution of updraft and precipitation properties inferred from dual-Doppler and polarimetric radar analyses applied to observations from a nearby radar network, including the UAH Advanced Radar for Meteorological and Operational Research (ARMOR). Given complex multicell evolution, particular attention is paid to storm morphology, cell mergers and possible dynamical, microphysical and electrical interaction of individual cells when testing various hypotheses.

Carey, Lawrence↗
NASA NTRS2014

A Corrected Formulation of the Multilayer Model (MLM) for Inferring Gaseous Dry Deposition to Vegetated Surfaces

The Multilayer Model (MLM) has been used for many years to infer dry deposition fluxes from measured trace species concentrations and standard meteorological measurements for national networks in the U.S., including the U.S. Environmental Protection Agency's Clean Air Status and Trends Network (CASTNet). MLM utilizes a resistance analogy to calculate deposition velocities appropriate for whole vegetative canopies, while employing a multilayer integration to account for vertically varying meteorology, canopy morphology and radiative transfer within the canopy. However, the MLM formulation, as it was originally presented and as it has been subsequently employed, contains a non-physical representation related to the leaf-level quasi-laminar boundary layer resistance that affects the calculation of the total canopy resistance. In this note, the non-physical representation of the canopy resistance as originally formulated in MLM is discussed and a revised, physically consistent, formulation is suggested as a replacement. The revised canopy resistance formulation reduces estimates of HNO3 deposition velocities by as much as 38% during mid-day as compared to values generated by the original formulation. Inferred deposition velocities for SO2 and O3 are not significantly altered by the change in formulation (less than 3%). Inferred deposition loadings of oxidized and total nitrogen from CASTNet data may be reduced by 10-20% and 5-10%, respectively, for the Eastern U. S. when employing the revised formulation of MLM as compared to the original formulation.

vegetated surfaces↗
DOE OSTI2024

A framework for strategic discovery of credible neural network surrogate models under uncertainty

The widespread integration of deep neural networks in developing data-driven surrogate models for high-fidelity simulations of complex physical systems highlights the critical necessity for robust uncertainty quantification techniques and credibility assessment methodologies, ensuring the reliable deployment of surrogate models in consequential decision-making. Here, this study presents the Occam Plausibility Algorithm for surrogate models (OPAL-surrogate), providing a systematic framework to uncover predictive neural network-based surrogate models within the large space of potential models, including various neural network classes and choices of architecture and hyperparameters. The framework is grounded in hierarchical Bayesian inferences and employs model validation tests to evaluate the credibility and prediction reliability of the surrogate models under uncertainty. Leveraging these principles, OPAL-surrogate introduces a systematic and efficient strategy for balancing the trade-off between model complexity, accuracy, and prediction uncertainty. The effectiveness of OPAL-surrogate is demonstrated through two modeling problems, including the deformation of porous materials for building insulation and turbulent combustion flow for ablation of solid fuels within hybrid rocket motors.

42 ENGINEERING↗
DOE OSTI2023

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗
DOE OSTI2025

Designing an Optimal Sensor Network via Minimizing Information Loss

Optimal experimental design is a classic topic in statistics, with many well-studied problems, applications, and solutions. The design problem we study is the placement of sensors to monitor spatiotemporal processes, explicitly accounting for the temporal dimension in our modeling and optimization. We observe that recent advancements in computational sciences often yield large datasets based on physics-based simulations, which are rarely leveraged in experimental design. We introduce a novel model-based sensor placement criterion, along with a highly-efficient optimization algorithm, which integrates physics-based simulations and Bayesian experimental design principles to identify sensor networks that “minimize information loss” from simulated data. Our technique relies on sparse variational inference and (separable) Gauss-Markov priors, and thus may adapt many techniques from Bayesian experimental design. We validate our method through a case study monitoring air temperature in Phoenix, Arizona, using state-of-the-art physics-based simulations. Our results show our framework to be superior to random or quasi-random sampling, particularly with a limited number of sensors. We conclude by discussing practical considerations and implications of our framework, including more complex modeling tools and real-world deployments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Inferring the Thermal History of the Intergalactic Medium from the Properties of the Hydrogen and Helium Lyα Forest

The filamentary network of intergalactic medium (IGM) gas that gives origin to the Lyα forest in the spectra of distant quasars encodes information on the physics of structure formation and the early thermodynamics of diffuse baryonic material. Here we use a massive suite of more than 400 high-resolution cosmological hydrodynamical simulations run with the Graphics Processing Unit–accelerated code Cholla to study the IGM at high spatial resolution maintained over the entire computational volume. The simulations capture a wide range of possible IGM thermal histories by varying the photoheating and photoionizing background produced by star-forming galaxies and active galactic nuclei. A statistical comparison of synthetic spectra with the observed 1D flux power spectra of hydrogen at redshifts 2.2 ≤ z ≤ 5.0 and with the helium Lyα opacity at redshifts 2.4 < z < 2.9 tightly constrains the photoionization and photoheating history of the IGM. By leveraging the constraining power of the available Lyα forest data to break model degeneracies, we find that the IGM experienced two main reheating events over 1.2 Gyr of cosmic time. For our best-fit model, hydrogen reionization completes by z R ≈ 6.0 with a first IGM temperature peak of T 0 ≃ 1.3 × 10 4 K and is followed by the reionization of He ii that completes by z R ≈ 3.0 and yields a second temperature peak of T 0 ≃ 1.4 × 10 4 K. We discuss how our results can be used to obtain information on the timing and the sources of hydrogen and helium reionization.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1990

3-D components of a biological neural network visualized in computer generated imagery. II - Macular neural network organization

Computer-assisted reconstructions of small parts of the macular neural network show how the nerve terminals and receptive fields are organized in 3-dimensional space. This biological neural network is anatomically organized for parallel distributed processing of information. Processing appears to be more complex than in computer-based neural network, because spatiotemporal factors figure into synaptic weighting. Serial reconstruction data show anatomical arrangements which suggest that (1) assemblies of cells analyze and distribute information with inbuilt redundancy, to improve reliability; (2) feedforward/feedback loops provide the capacity for presynaptic modulation of output during processing; (3) constrained randomness in connectivities contributes to adaptability; and (4) local variations in network complexity permit differing analyses of incoming signals to take place simultaneously. The last inference suggests that there may be segregation of information flow to central stations subserving particular functions.

Ross, Muriel D.↗
NASA NTRS2007

Variations in Stratospheric Inorganic Chlorine Between 1991 and 2006

So how quickly will the ozone hole recover? This depends on how quickly the chlorine content (Cl2) of the atmosphere will decline. The ozone hole forms over the Antarctic each southern spring (September and October). The extremely small ozone amounts in the ozone hole are there because of chemical reactions of ozone with chlorine. This chlorine originates largely from industrially produced chlorofluorocarbon (CFC) compounds. An international agreement, the Montreal Protocol, is drastically reducing the amount of chlorine-containing compounds that we are releasing into the atmosphere. To be able to attribute changes in stratospheric ozone to changes in chlorine we need to know the distribution of atmospheric chlorine. However, due to a lack of continuous observations of all the key chlorine gases, producing a continuous time series of stratospheric chlorine has not been achieved to date. We have for the first time devised a technique to make a 17-year time series for stratospheric chlorine that uses the long time series of HCl observations made from several space borne instruments and a neural network. The neural networks allow us to both inter-calibrate the various HCl instruments and to infer the total amount of atmospheric chlorine from HCl. These new estimates of Cl, provide a much needed critical test for current global models that currently predict significant differences in both Cl(sub y) and ozone recovery. These models exhibit differences in their projection of the recovery time and our chlorine content time series will help separate the good from the bad in these projections.

Lary, D. J.↗
NASA NTRS2019

Trends and Seasonal Variability of Atmospheric NO2 and HNO3 Concentrations Across Three Major African Biomes Inferred from Long-Term Series of Ground-Based and Satellite Measurements

In the framework of the INDAAF (International Network to study Deposition and Atmospheric chemistry in AFrica) programme, part of the ACTRIS (Aerosols, Clouds, and Trace gases Research InfraStructure), European Research Infrastructure for the long-term observation of Aerosol, Cloud, and Trace gases, this paper aims to study trends and seasonal variability of surface atmospheric NO2 and HNO3 concentrations, and OMI (Ozone Monitoring Instrument) NO2 over 6 sites in tropical Africa. Sites are located in west and central Africa to represent the major African biomes: dry savanna (Banizoumbou, Niger and Katibougou, Mali), wet savanna (Djougou, Benin and Lamto, Côte d’Ivoire) and forest (Bomassa, Republic of Congo and Zoétélé, Cameroon). Ground-based NO2 and HNO3 concentrations were obtained over the period 1998–2015 using INDAAF passive samplers at a monthly basis, and NO2 Vertical Column Densities (VCDs) from OMI for a 1-degree grid cell around each sites were obtained from 2005 to 2015. Mean annual NO2 concentrations ranged from 2.3 plus or minus 1.2 to 0.9 plus or minus 0.4 parts per billion (ppb) from dry savannas to forests, representing a north-south gradient. In dry savannas, we observe two concentration peaks of NO2 appearing at the beginning and the end of the wet season both for ground-based and satellite measurements, whereas at wet savannas and forest sites, NO2 concentrations are highest in the dry season. The seasonality of surface NO2 observations provide further evidence for a large role of microbial soil NOx emissions in dry savannas and of biomass burning NOx emissions in wet savanna and forest sites. Mean annual HNO3 concentrations ranged from 0.4 to 0.5 ppb in dry and wet savannas to 0.2 to 0.3 ppb in forest. In dry ecosystems, higher HNO3 concentrations are measured in the early wet season, consistent with NO2 results. The analysis of a long-term dataset of surface O3 concentrations indicates that HNO3 production can mainly be explained by the photo-oxidation of NOx. Mann-Kendall and Seasonal Kendall statistical tests showed that NO2 surface concentrations have a significant decreasing seasonal and annual trends at multiple sites (p-value less than 0.05) ranging from -2.96 percent per year (at Zoétélé) to -0.64 percent per year (at Banizoumbou). HNO3 results indicate no trends except at Bomassa (1.07 percent per year). The decreasing NO2 ground-based concentration trends observed in wet savannas sites are correlated with OMI NO2 decreasing trends at these sites. Trends obtained for NO2 concentrations in wet savanna and forest ecosystems are consistent with trends of NOₓ biomass burning emissions.

Trends↗
DOE OSTI2021

Autoencoders on FPGAs for real-time, unsupervised new physics detection at 40 MHz at the Large Hadron Collider

In this paper, we show how to adapt and deploy anomaly detection algorithms based on deep autoencoders, for the unsupervised detection of new physics signatures in the extremely challenging environment of a real-time event selection system at the Large Hadron Collider (LHC). We demonstrate that new physics signatures can be enhanced by three orders of magnitude, while staying within the strict latency and resource constraints of a typical LHC event filtering system. This would allow for collecting datasets potentially enriched with high-purity contributions from new physics processes. Through per-layer, highly parallel implementations of network layers, support for autoencoder-specific losses on FPGAs and latent space based inference, we demonstrate that anomaly detection can be performed in as little as $80\,$ns using less than 3% of the logic resources in the Xilinx Virtex VU9P FPGA. Opening the way to real-life applications of this idea during the next data-taking campaign of the LHC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Three-dimensional reconstruction of inertial confinement fusion hot-spot plasma from x-ray and nuclear diagnostics on OMEGA

Multidimensional effects degrade the neutron yield and the compressed areal density of laser-direct-drive inertial confinement fusion implosions of layered deuterium–tritium cryogenic targets on the OMEGA Laser System with respect to 1D radiation-hydrodynamic simulation predictions. A comprehensive physics-informed 3D reconstruction effort is under way to infer hot-spot and shell conditions at stagnation from four x-ray and seven neutron detectors distributed around the OMEGA target chamber. Neutron diagnostics, providing measurements of the neutron yield, hot-spot flow velocity, and apparent ion-temperature distribution, are used to infer the mode-1 perturbation at stagnation. The x-ray imagers record the shape of the hot-spot plasma to diagnose mode-1 and mode-2 perturbations. A deep-learning convolutional neural network trained on an extensive set of 3D radiation-hydrodynamic simulations is used to interpret the x-ray and nuclear measurements to infer the 3D profiles of the hot-spot plasma conditions and the amount of laser energy coupled to the hot-spot plasma. A 3D simulation database shows that larger mode-1 asymmetries are correlated with higher hot-spot flow velocities and reduced laser-energy coupling and neutron yield. Three-dimensional hot-spot reconstructions from x-ray measurements indicate that higher amounts of residual kinetic energy are correlated with higher measured hot-spot flow velocities, consistent with 3D simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Renewable energy integration and system operation challenge: control and optimization of millions of devices

The electric power infrastructure, originally designed and built on large-scale power plants, is evolving into a more resilient power generation and delivery system in which millions of smaller units of distributed energy generation resources units will be installed in sub-transmission and distribution networks. In order to control, manage and optimize the future grid, a hierarchical design is presented in this chapter which enables the distributed control on grid edge while inheriting the existing centralized control structure. This layered design of large-scale power system operation and control uses the following principle: reactive power control is treated as a primary control for voltage stability, and the real power control is primarily a grid-level control but can also be a supplementary control for voltage support in the case of insufficient reactive power control capacity. For the purpose of active control and operation at the distribution level, a recursive power network model is derived from nodal injection and branch power flow models. Based on the model, the proposed algorithms of hierarchical control, grid-edge inference and dynamic hosting allowance are developed and presented for multi-level controlled operation. And, a co-simulation architecture of integrated T&D system is presented to validate and demonstrate the feasibility and scalability of proposed algorithms.

Xu, Ying↗
DOE OSTI2025

Emulation With Uncertainty Quantification of Regional Sea‐Level Change Caused by the Antarctic Ice Sheet

Abstract Projecting regional sea‐level change under various climate‐change scenarios typically involves running forward simulations of the Earth's gravitational, rotational and deformational (GRD) response to ice‐mass change, which requires substantial computational cost if applied to probabilistic frameworks requiring thousands to millions of samples. Here we build emulators of regional sea‐level change at 27 coastal locations, due to the GRD effects associated with future Antarctic Ice Sheet mass change over the 21st century. The emulators are evaluated against a numerical sea‐level model applied to an ensemble of ice‐sheet model simulations of the Antarctic Ice Sheet through 2100. We build a physics‐based emulator using a recent sensitivity kernel approach and compare it to machine learning based emulators (neural network and conditional variational autoencoder methods). In order to quantify uncertainty, we derive well‐calibrated prediction intervals for regional sea‐level change via split‐conformal inference and linear regression, and show that Monte Carlo dropout does not yield well‐calibrated uncertainties in this instance. We also demonstrate substantial gains in computational efficiency using both the physics‐based emulator and neural networks in comparison to the numerical model for the complete regional sea‐level solution. Overall, we find the physics‐based emulator modestly outperforms the machine learning emulators for this problem.

58 GEOSCIENCES↗
DOE OSTI2023

Evaluation of global teleconnections in CMIP6 climate projections using complex networks

In climatological research, the evaluation of climate models is one of the central research subjects. As an expression of large-scale dynamical processes, global teleconnections play a major role in interannual to decadal climate variability. Their realistic representation is an indispensable requirement for the simulation of climate change, both natural and anthropogenic. Therefore, the evaluation of global teleconnections is of utmost importance when assessing the physical plausibility of climate projections. We present an application of the graph-theoretical analysis tool δ-MAPS, which constructs complex networks on the basis of spatio-temporal gridded data sets, here sea surface temperature and geopotential height at 500 hPa. Complex networks complement more traditional methods in the analysis of climate variability, like the classification of circulation regimes or empirical orthogonal functions, assuming a new non-linear perspective. While doing so, a number of technical tools and metrics, borrowed from different fields of data science, are implemented into the δ-MAPS framework in order to overcome specific challenges posed by our target problem. Those are trend empirical orthogonal functions (EOFs), distance correlation and distance multicorrelation, and the structural similarity index. δ-MAPS is a two-stage algorithm. In the first place, it assembles grid cells with highly coherent temporal evolution into so-called domains. In a second step, the teleconnections between the domains are inferred by means of the non-linear distance correlation. We construct 2 unipartite and 1 bipartite network for 22 historical CMIP6 climate projections and 2 century-long coupled reanalyses (CERA-20C and 20CRv3). Potential non-stationarity is taken into account by the use of moving time windows. The networks derived from projection data are compared to those from reanalyses. Our results indicate that no single climate projection outperforms all others in every aspect of the evaluation. But there are indeed models which tend to perform better/worse in many aspects. Differences in model performance are generally low within the geopotential height unipartite networks but higher in sea surface temperature and most pronounced in the bipartite network representing the interaction between ocean and atmosphere.

58 GEOSCIENCES↗
NASA NTRS2019

Using Deep Learning to Automate Inference of Meteoroid Pre-Entry Properties

Properly assessing the asteroid threat depends on the knowledge of asteroid pre-entry parameters, such as size, velocity, mass, density, and strength. Although a vast number of possible bodies to study exist, such characterization of asteroid populations is currently limited by substantial costs associated with space rendezvous missions and rare meteorite findings. As asteroids fragment, ablate, and decelerate in the atmosphere, they emit light detectable by ground-based and space-borne instruments. Earth’s atmosphere, thus, becomes an accessible laboratory that enables impactor risk assessments by facilitating inference of the pre-entry parameters. These asteroid pre-entry conditions are typically deduced by modeling the entry and breakup physics that best reproduce the observed light or energy deposition curve. However, this process requires extensive manual trial-and-error of uncertain modeling parameters. Automating meteor modeling and inference would improve property distributions used in risk assessments and enable population characterization as more light curves become more readily available through the presence of space assets and ground-based camera networks. We previously developed a genetic algorithm to automate meteor modeling by using the fragment-cloud model (FCM) to search for the values of the FCM input parameters (e.g., diameter) that generate energy deposition profiles that match the observed one. Now, we apply deep learning to infer asteroid diameter, velocity, and density from observed energy deposition curves. We trained and tested our neural network models with synthetic energy deposition curves modeled using the FCM rubble pile implementation. We present an application of a 1D convolutional neural network and compare its performance to other attempted regressors and machine learning techniques, such as a fully connected neural network and Random Forest regression, to demonstrate its capabilities. We validate our model weights and approach using the Chelyabinsk, Tagish Lake, Benešov, Košice, and Lost City meteors.

Tarano, Ana Maria↗
DOE OSTI2024

Fast and Flexible Inference Framework for Continuum Reverberation Mapping Using Simulation-based Inference with Deep Learning

Continuum reverberation mapping (CRM) of active galactic nuclei (AGN) monitors multiwavelength variability signatures to constrain accretion disk structure and supermassive black hole (SMBH) properties. The upcoming Vera Rubin Observatory’s Legacy Survey of Space and Time will survey tens of millions of AGN over the next decade, with thousands of AGN monitored with almost daily cadence in the deep drilling fields. However, existing CRM methodologies often require long computation time and are not designed to handle such large amounts of data. In this paper, we present a fast and flexible inference framework for CRM using simulation-based inference (SBI) with deep learning to estimate SMBH properties from AGN light curves. We use a long short-term memory summary network to reduce the high dimensionality of the light curve data and then use a neural density estimator to estimate the posterior of SMBH parameters. Using simulated light curves, we find SBI can produce more accurate SMBH parameter estimation with 10 3 –10 5 times speed up in inference efficiency compared to traditional methods. The SBI framework is particularly suitable for wide-field CRM surveys as the light curves will have identical observing patterns, which can be incorporated into the SBI simulation. We explore the performance of our SBI model on light curves with irregular-sampled, realistic observing cadence and alternative variability characteristics to demonstrate the flexibility and limitation of the SBI framework.

79 ASTRONOMY AND ASTROPHYSICS↗