Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Evidence for Langmuir Oscillations and a Low Density Cavity in the Venus Magnetotail

We report the discovery of Langmuir oscillations in a very low plasma density region in the Venus magnetotail. These waves are observed more often at 30 kHz, but also at 5.4 kHz indicating densities as low as 0.3/cu cm in the central tail lobe. The Langmuir probe on board the Pioneer Venus Orbiter cannot resolve such a low plasma density. We use the magnetic field strength and the assumption of total pressure balance to infer the electron temperature as a test of the Langmuir wave interpretation. By investigating the spatial distribution of this wave activity we find that the plasma cavity is ordered in a coordinate system defined by the interplanetary magnetic field and is found at either side of the central tail current sheet.

Ho, C. M.↗
NASA NTRS2017

Mineralogical Characterization of Fe-Bearing AGB and Supernova Silicate Grains From the Queen Alexandra Range 99177 Meteorite

Spectroscopic observations of the circumstellar envelopes of evolved O-rich stars indicate the dust is mostly amorphous silicate with olivine-like compositions. Spectral modeling suggests these grains are Fe-rich [Mg/(Mg+Fe) ~0.5], but it is not known whether the Fe is distributed within the silicate matrix or exists as metal inclusions. In contrast, the crystalline silicates are inferred to be extremely Mg-rich [Mg/(Mg+Fe) > 0.95]. The mineralogies and chemical compositions of dust in supernova (SN) remnants are not as well constrained, but abundant silicates of olivine-like and enstatite-like compositions have been fit to the infrared emission features. Silicates in the interstellar medium (ISM) are >99% amor-phous and Fe-bearing. The dearth of crystalline silicates in the ISM requires that some amorphization or destruction mechanisms process these grains.

Nguyen, A. N.↗
DOE OSTI2024

Analytic Neural Network Gaussian Process Enabled Chance-Constrained Voltage Regulation for Active Distribution Systems with PVs, Batteries and EVs

This paper proposes an analytic neural network Gaussian process (NNGP)-based chance-constrained real-time voltage regulation method for active distribution systems with photovoltaics (PVs), batteries, and electric vehicles (EVs). NNGP can utilize historical measurement data to achieve real-time probabilistic node voltage estimation through Bayesian inference. Then, NNGP is fully analytically embedded into the optimal power flow model to perform voltage regulation and adapt to various topological changes. The uncertainties of voltage estimations are easily considered via the chance constraint, and it has been shown that the adoption of this chance constraint can significantly improve the reliability of voltage regulation under various scenarios. The comparison results with other methods, carried out on a real 759-node distribution system located in western Colorado, U.S., show that the proposed method can achieve accurate voltage estimation across different topologies and reliably perform voltage regulation considering PVs, batteries, and EVs.

active distribution systems↗
DOE OSTI2021

Electron-beam energy reconstruction for neutrino oscillation measurements

Neutrinos exist in one of three types or ‘flavours’—electron, muon and tau neutrinos—and oscillate from one flavour to another when propagating through space. This phenomena is one of the few that cannot be described using the standard model of particle physics (reviewed in ref. 1), and so its experimental study can provide new insight into the nature of our Universe (reviewed in ref. 2). Neutrinos oscillate as a function of their propagation distance (L) divided by their energy (E). Therefore, experiments extract oscillation parameters by measuring their energy distribution at different locations. As accelerator-based oscillation experiments cannot directly measure E, the interpretation of these experiments relies heavily on phenomenological models of neutrino–nucleus interactions to infer E. Here we exploit the similarity of electron–nucleus and neutrino–nucleus interactions, and use electron scattering data with known beam energies to test energy reconstruction methods and interaction models. We find that even in simple interactions where no pions are detected, only a small fraction of events reconstruct to the correct incident energy. More importantly, widely used interaction models reproduce the reconstructed energy distribution only qualitatively and the quality of the reproduction varies strongly with beam energy. This shows both the need and the pathway to improve current models to meet the requirements of next-generation, high-precision experiments such as Hyper-Kamiokande (Japan) and DUNE (USA).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inference

In this work, we present two neural network approaches that approximate the solutions of static and dynamic conditional optimal transport (COT) problems. Both approaches enable conditional sampling and conditional density estimation, which are core tasks in Bayesian inference—particularly in the simulation-based (“likelihood-free”) setting. Our methods represent the target conditional distribution as a transformation of a tractable reference distribution. Obtaining such a transformation, chosen here to be an approximation of the COT map, is computationally challenging even in moderate dimensions. To improve scalability, our numerical algorithms use neural networks to parameterize candidate maps and further exploit the structure of the COT problem. Our static approach approximates the map as the gradient of a partially input convex neural network. It uses a novel numerical implementation to increase computational efficiency compared to state-of-the-art alternatives. Our dynamic approach approximates the conditional optimal transport via the flow map of a regularized neural ODE; compared to the static approach, it is slower to train but offers more modeling choices and can lead to faster sampling. We demonstrate both algorithms numerically, comparing them with competing state-of-the-art approaches, using benchmark datasets and simulation-based Bayesian inverse problems.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1979

Determination of the ground albedo and the index of absorption of atmospheric particulates by remote sensing. I - Theory

A statistical technique is developed for inferring the optimum values of the ground albedo and the effective imaginary term of the complex refractive index of atmospheric particulates. The procedure compares measurements of the ratio of the hemispheric diffuse to directly transmitted solar flux density at the earth's surface with radiative transfer computations of the same as suggested by Herman et al. (1975). A detailed study is presented which shows the extent to which the ratio of diffuse to direct solar radiation is sensitive to many of the radiative transfer parameters. Results indicate that the optical depth and size distribution of atmospheric aerosol particles are the two parameters which uniquely specify the radiation field to the point where ground albedo and index of absorption can be inferred. Varying the real part of the complex refractive index of atmospheric particulates as well as their vertical distribution is found to have a negligible effect on the diffuse-direct ratio. The statistical procedure utilizes a semi-analytic gradient search method from least-squares theory and includes a detailed error analysis.

King, M. D.↗
NASA NTRSDate not supplied

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗
NASA NTRS1982

The 18 May 1980 eruption of Mount St. Helens: The nature of the eruption, with an atmospheric perspective

Mount St. Helens erupted somewhat less than 0.5 cu km of magma (dense rock equivalent) on May 18, 1980. The May 18 event was usually violent. As much 35% of the volume of the airfall material fell outside of the 2.5 mm isopach, which encloses about 88,000 sq km. This extraordinary dispersive power was transmitted by an eruption column which reached heights of more than 20 km. There was a lateral blast (or surge) of unusually large dimensions associated with the onset of the eruption. The magma is dacitic in composition and had a low ( 500 ppm) sulfur content. Distal ashes contain much nonmagmatic (lithic) material, but smaller ( 50 microns m) particles are mostly finely divided magmatic dacite. The grain size distributions of the ash are multimodal, frequently with peaks at 90, 25, and 10 microns. The finer populations fell out faster than their terminal velocities as simple particles would suggest. It is inferred that large proportions of the fine ash fell out as composite particles. This condition greatly reduces the atmospheric burden of silicate particles. Some of the unusual aspects (violence, intense surges, multimodal grain size distributions, lithic content of the ashes) of the eruption may be due to its phreatomagmatic character. The hydrothermal system above the magma may have infiltrated the magma body at the onset of the eruption. An "overprint" of the geochemistry of this hydrothermal system on the geochemistry of the magmatic gas system is likely. One important feature is that reduced gas species may be much more abundant than in many eruptions. Another is that fine ash may form aggregates more readily.

Rose, W. I., Jr.↗
NASA NTRS2003

Intelligent Machines in the 21st Century: Automating the Processes of Inference and Inquiry

The last century saw the application of Boolean algebra toward the construction of computing machines, which work by applying logical transformations to information contained in their memory. The development of information theory and the generalization of Boolean algebra to Bayesian inference have enabled these computing machines. in the last quarter of the twentieth century, to be endowed with the ability to learn by making inferences from data. This revolution is just beginning as new computational techniques continue to make difficult problems more accessible. However, modern intelligent machines work by inferring knowledge using only their pre-programmed prior knowledge and the data provided. They lack the ability to ask questions, or request data that would aid their inferences. Recent advances in understanding the foundations of probability theory have revealed implications for areas other than logic. Of relevance to intelligent machines, we identified the algebra of questions as the free distributive algebra, which now allows us to work with questions in a way analogous to that which Boolean algebra enables us to work with logical statements. In this paper we describe this logic of inference and inquiry using the mathematics of partially ordered sets and the scaffolding of lattice theory, discuss the far-reaching implications of the methodology, and demonstrate its application with current examples in machine learning. Automation of both inference and inquiry promises to allow robots to perform science in the far reaches of our solar system and in other star systems by enabling them to not only make inferences from data, but also decide which question to ask, experiment to perform, or measurement to take given what they have learned and what they are designed to understand.

Knuth, Kevin H.↗
DOE OSTI2023

Seeing through noise in power laws

Despite widespread claims of power laws across the natural and social sciences, evidence in data is often equivocal. Modern data and statistical methods reject even classic power laws such as Pareto’s law of wealth and the Gutenberg–Richter law for earthquake magnitudes. We show that the maximum-likelihood estimators and Kolmogorov–Smirnov (K-S) statistics in widespread use are unexpectedly sensitive to ubiquitous errors in data such as measurement noise, quantization noise, heaping and censorship of small values. This sensitivity causes spurious rejection of power laws and biases parameter estimates even in arbitrarily large samples, which explains inconsistencies between theory and data. We show that logarithmic binning by powers of λ > 1 attenuates these errors in a manner analogous to noise averaging in normal statistics and that λ thereby tunes a trade-off between accuracy and precision in estimation. Binning also removes potentially misleading within-scale information while preserving information about the shape of a distribution over powers of λ, and we show that some amount of binning can improve sensitivity and specificity of K-S tests without any cost, while more extreme binning tunes a trade-off between sensitivity and specificity. We therefore advocate logarithmic binning as a simple essential step in power-law inference.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

DLHub: Simplifying publication, discovery, and use of machine learning models in science

Machine Learning (ML) has become a critical tool enabling new methods of analysis and driving deeper understanding of phenomena across scientific disciplines. There is a growing need for "learning systems" to support various phases in the ML lifecycle. While others have focused on supporting model development, training, and inference, few have focused on the unique challenges inherent in science, such as the need to publish and share models and to serve them on a range of available computing resources. In this paper, we present the Data and Learning Hub for science (DLHub), a learning system designed to support these use cases. Specifically, DLHub enables publication of models, with descriptive metadata, persistent identifiers, and flexible access control. It packages arbitrary models into portable servable containers, and enables low-latency, distributed serving of these models on heterogeneous compute resources. In this work, we show that DLHub supports low-latency model inference comparable to other model serving systems including TensorFlow Serving, SageMaker, and Clipper, and improved performance, by up to 95%, with batching and memoization enabled. We also show that DLHub can scale to concurrently serve models on 500 containers. Finally, we describe five case studies that highlight the use of DLHub for scientific applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Collapsar Gamma-Ray Bursts Grind Their Black Hole Spins to a Halt

Abstract The spin of a newly formed black hole (BH) at the center of a massive star evolves from its natal value due to two competing processes: accretion of gas angular momentum that increases the spin and extraction of BH angular momentum by outflows that decreases the spin. Ultimately, the final, equilibrium spin is set by a balance between both processes. In order for the BH to launch relativistic jets and power aγ-ray burst (GRB), the BH magnetic field needs to be dynamically important. Thus, we consider the case of a magnetically arrested disk (MAD) driving the spin evolution of the BH. By applying the semianalytic MAD BH spin evolution model of Lowell et al. to collapsars, we show that if the BH accretes ∼20% of its initial mass, its dimensionless spin inevitably reaches small values,a≲ 0.2. For such spins, and for mass accretion rates inferred from collapsar simulations, we show that our semianalytic model reproduces the energetics of typical GRB jets,L jet ∼ 10 50 erg s −1 . We show that our semianalytic model reproduces the nearly constant power of typical GRB jets. If the MAD onset is delayed, this allows powerful jets at the high end of the GRB luminosity distribution,L jet ∼ 10 52 erg s −1 , but the final spin remains low,a≲ 0.3. These results are consistent with the low spins inferred from gravitational wave detections of binary BH mergers. In a companion paper by Gottlieb et al., we use GRB observations to constrain the natal BH spin to bea≃ 0.2.

Astronomy & Astrophysics↗
NASA NTRS2017

Structure in the 3D Galaxy Distribution. III. Fourier Transforming the Universe: Phase and Power Spectra

We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited sample of the Sloan Digital Sky Survey redshift survey. The direct unbinned transform yields a complex 3D data cube quite similar to that from the Fast Fourier Transform of finely binned galaxy positions. In both cases, deconvolution of the sampling window function yields estimates of the true transform. Simple power spectrum estimates from these transforms are roughly consistent with those using more elaborate methods. The complex Fourier transform characterizes spatial distributional properties beyond the power spectrum in a manner different from (and we argue is more easily interpreted than) the conventional multipoint hierarchy. We identify some threads of modern large-scale inference methodology that will presumably yield detections in new wider and deeper surveys.

Galaxies↗
DOE OSTI2021

Assessment of filtered cameras for quantitative 2D analysis of divertor conditions during detachment in JET L-mode plasmas

We report that estimates for 2D distributions of electron temperature, T e , electron density, n e , and atomic deuterium density, n o , in the JET divertor volume have been inferred from deuterium Balmer line intensity ratios obtained from tomographic reconstructions of divertor camera measurements. This enables also investigation of ionization, S ion , and recombination, S rec , rates. The analysis shows a decrease of T e to 0.5–1.0 eV throughout the outer divertor during detachment in low-confinement (L-mode) plasmas. Simultaneously, the high-n e region and the n 0 distribution in the outer divertor are observed to elongate and shift from the outer strike point towards the X-point. The observations are in qualitative agreement and follow the same sequence with modelling predictions of EDGE2D-EIRENE simulations of a density scan. While the method was found to provide good representation of the evolution of volumetric recombination during detachment, in agreement with the simulations, the movement of the ionization front upstream could not be followed due to lack of spatial overlap between the ionization region and the necessary emission distributions. Consequently, the representation of the ionization conditions and the particle balance in the detached outer divertor are compromised.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Bayesian calibration of bubble size dynamics applied to CO 2 gas fermenters

To accelerate the scale-up of gaseous CO 2 fermentation reactors, computational models need to predict gas-to-liquid mass transfer which requires capturing the bubble size dynamics, i.e. bubble breakup and coalescence. However, the applicability of existing models beyond air–water mixtures remains to be established. Here, an inverse modeling approach, accelerated with a neural network surrogate, calibrates the breakup and coalescence closure models, that are used in class methods for population balance modeling (PBM). The calibration is performed based on experimental results obtained in a CO 2 -air–water-coflowing bubble column reactor. Bayesian inference is used to account for noise in the experimental dataset and bias in the simulation results. To accurately capture gas holdup and interphase mass transfer, the results show that the breakage rate needs to be increased by one order of magnitude. In conclusion, the inferred model parameters are then used on a separate configuration and shown to also improve bubble size distribution predictions.

09 BIOMASS FUELS↗
DOE OSTI2024

Particle control via cryopumping and its impact on the edge plasma profiles of Alcator C-Mod

At the high n e proposed for high-field fusion reactors, it is uncertain whether ionization, as opposed to plasma transport, will be most influential in determining n e at the pedestal and separatrix. A database of Alcator C-Mod discharges is analyzed to evaluate the impact of source modification via cryopumping. The database contains similarly-shaped H-modes at fixed I P = 0.8 MA and B t = 5.4 T, spanning a large range in P net and ionization. Measurements from an edge Thomson scattering system are combined with those from a midplane-viewing Ly α camera to evaluate changes to n e and T e in response to changes in ionization rates, S ion ∙ $n^{sep}_e$ and $T^{ped}_e$ are found to be most sensitive to changes to $S^{sep}_{ion}$, as opposed to $n^{ped}_e$ and $T^{sep}_e$. Dimensionless quantities, namely α MHD and v*, are found to regulate attainable pedestal values. Select discharges at different values of P net and in different pumping configurations are analyzed further using SOLPS-ITER. It is determined that changes to plasma transport coefficients are required to self-consistently model both plasma and neutral edge dynamics. Pumping is found to modify the poloidal distribution of atomic neutral density, n 0 , along the separatrix, increasing n 0 at the active X-point. Opaqueness to neutrals from high n e in the divertor is found to play a role in mediating neutral penetration lengths and hence, the poloidal distribution of neutrals along the separatrix. Pumped discharges thus require a larger particle diffusion coefficient than that inferred purely from 1D experimental profiles at the outer midplane.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

36 MATERIALS SCIENCE↗