Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Revisiting stellar properties of star-forming galaxies with stellar and nebular spectral modelling

Spectral synthesis is a powerful tool for interpreting the physical properties of galaxies by decomposing their spectral energy distributions (SEDs) into the main luminosity contributors (e.g. stellar populations of distinct age and metallicity or ionised gas). However, the impact nebular emission has on the inferred properties of star-forming (SF) galaxies has been largely overlooked over the years, with unknown ramifications to the current understanding of galaxy evolution. The objective of this work is to estimate the relations between stellar properties (e.g. total mass, mean age, and mean metallicity) of SF galaxies by simultaneously fitting the stellar and nebular continua and comparing them to the results derived through the more common purely stellar spectral synthesis approach. The main galaxy sample from SDSS DR7 was analysed with two distinct population synthesis codes: FADO, which estimates self-consistently both the stellar and nebular contributions to the SED, and the original version of STARLIGHT, as representative of purely stellar population synthesis codes. Differences between codes regarding average mass, mean age and mean metallicity values can go as high as ~0.06 dex for the overall population of galaxies and ~0.12 dex for SF galaxies (galaxies with EW(Hα) > 3 Å), with the most prominent difference between both codes in the two populations being in the light-weighted mean stellar age. FADO presents a broader range of mean stellar ages and metallicities for SF galaxies than STARLIGHT, with the latter code preferring metallicity solutions around the solar value (Z ⊙ = 0.02). A closer look into the average light- and mass-weighted star formation histories of intensively SF galaxies (EW(Hα) > 75 Å) reveals that the light contributions of simple stellar populations (SSPs) younger than ≤10 7 (10 9 ) years in STARLIGHT are higher by ~5.41% (9.11%) compared to FADO. Moreover, FADO presents higher light contributions from SSPs with metallicity ≤ Z ⊙ /200 (Z ⊙ /50) of around 8.05% (13.51%) when compared with STARLIGHT. This suggests that STARLIGHT is underestimating the average light-weighted age of intensively SF galaxies by up to ~0.17 dex and overestimating the light-weighted metallicity by up to ~0.13 dex compared to FADO (or vice versa). The comparison between the average stellar properties of passive, SF and intensively SF galaxy samples also reveals that differences between codes increase with increasing EW(Hα) and decreasing total stellar mass. Moreover, comparing SF results from FADO in a purely stellar mode with the previous results qualitatively suggests that differences between codes are primarily due to mathematical and statistical differences and secondarily due to the impact of the nebular continuum modelling approach (or lack thereof). However, it is challenging to adequately quantify the relative role of each factor since they are likely interconnected. This work finds indirect evidence that a purely stellar population synthesis approach negatively impacts the inferred stellar properties (e.g. mean age and mean metallicity) of galaxies with relatively high star formation rates (e.g. dwarf spirals, ‘green peas’, and starburst galaxies). In turn, this can bias interpretations of fundamental relations such as the mass-age or mass-metallicity, which are factors worth bearing in mind in light of future high-resolution spectroscopic surveys at higher redshifts (e.g. MOONS and 4MOST-4HS).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

A Conditional Autoencoder for Galaxy Photometric Parameter Estimation

Astronomical photometric surveys routinely image billions of galaxies, and traditionally infer the parameters of a parametric model for each galaxy. This approach has served us well, but the computational expense of deriving a full posterior probability distribution function is a challenge for increasingly ambitious surveys. In this paper, we use deep learning methods to characterize galaxy images, training a conditional autoencoder on mock data. The autoencoder can reconstruct and denoise galaxy images via a latent space engineered to include semantically meaningful parameters, such as brightness, location, size, and shape. Our model recovers galaxy fluxes and shapes on mock data with a lower variance than the Hyper Suprime-Cam photometry pipeline, and returns reasonable answers even for inputs outside the range of its training data. When applied to data in the training range, the regression errors on all extracted parameters are nearly unbiased with a variance near the Cramr-Rao bound.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

White Dwarf Binaries across the H-R Diagram

We created the APOGEE-GALEX-Gaia catalog to study white dwarf (WD) binaries. This database aims to create a minimally biased sample of WD binary systems identified from a combination of GALEX, Gaia, and APOGEE data to increase the number of WD binaries with orbital parameters and chemical compositions. We identify 3414 sources as WD binary candidates, with nondegenerate companions of spectral types between F and M, including main-sequence stars, main-sequence binaries, subgiants, sub-subgiants, red giants, and red clump stars. Among our findings are (a) a total of 1806 systems having inferred WD radii R < 25 R ⊕ , which constitute a more reliable group of WD binary candidates within the main sample; (b) a difference in the metallicity distribution function between WD binary candidates and the control sample of most luminous giants (M H < -3.0); (c) the existence of a population of sub-subgiants with WD companions; (d) evidence for shorter periods in binaries that contain WDs compared to those that do not, as shown by the cumulative distributions of APOGEE radial velocity shifts; (e) evidence for systemic orbital evolution in a sample of 252 WD binaries with orbital periods, based on differences in the period distribution between systems with red clump, main-sequence binary, and sub-subgiant companions and systems with main-sequence or red giant companions; and (f) evidence for chemical enrichment during common envelope (CE) evolution, shown by lower metallicities in wide WD binary candidates (P > 100 days) compared to post-CE (P < 100 days) WD binary candidates.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model – Application to realistic N -body simulations

ABSTRACT Photometric galaxy surveys constitute a powerful cosmological probe but rely on the accurate characterization of their redshift distributions using only broad-band imaging, and can be very sensitive to incomplete or biased priors used for redshift calibration. A hierarchical Bayesian model has recently been developed to estimate those from the robust combination of prior information, photometry of single galaxies, and the information contained in the galaxy clustering against a well-characterized tracer population. In this work, we extend the method so that it can be applied to real data, developing some necessary new extensions to it, especially in the treatment of galaxy clustering information, and we test it on realistic simulations. After marginalizing over the mapping between the clustering estimator and the actual density distribution of the sample galaxies, and using prior information from a small patch of the survey, we find the incorporation of clustering information with photo-z’s tightens the redshift posteriors and overcomes biases in the prior that mimic those happening in spectroscopic samples. The method presented here uses all the information at hand to reduce prior biases and incompleteness. Even in cases where we artificially bias the spectroscopic sample to induce a shift in mean redshift of $\Delta \bar{z} \approx 0.05,$ the final biases in the posterior are $\Delta \bar{z} \lesssim 0.003.$ This robustness to flaws in the redshift prior or training samples would constitute a milestone for the control of redshift systematic uncertainties in future weak lensing analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning model. However, it remains notoriously challenging to inference GCNs over large graph datasets, limiting their application to large real-world graphs and hindering the exploration of deeper and more sophisticated GCN graphs. This is because real-world graphs can be extremely large and sparse. Furthermore, the node degree of GCNs tends to follow the power-law distribution and therefore have highly irregular adjacency matrices, resulting in prohibitive inefficiencies in both data processing and movement and thus substantially limiting the achievable GCN acceleration efficiency. To this end, this paper proposes the first GCN algorithm and accelerator Co-Design framework dubbed GCoD which can largely alleviate the aforementioned GCN irregularity and boost GCNs' inference efficiency. Specifically, on the algorithm level, GCoD integrates a divide and conquer GCN training strategy that polarizes the graphs to be either denser or sparser in local neighborhoods without compromising the model accuracy, resulting in graph adjacency matrices that (mostly) have merely two levels of workload and enjoys largely enhanced regularity and thus ease of acceleration. On the hardware level, we further develop a dedicated two-pronged accelerator with a separated engine to process each of the aforementioned workloads, further boosting the overall utilization and acceleration efficiency. Extensive experiments and ablation studies validate that our GCoD consistently outperforms state-of-the-art designs in terms of accelerator efficiency while maintaining or even improving the task accuracy. Additionally, we visualize GCoD trained graph adjacency matrices to better understand its advantages. All codes and pre-trained models will be released upon acceptance.

You, Haoran↗
DOE OSTI2023

Toward an Autonomous Workflow for Single Crystal Neutron Diffraction

The operation of the neutron facility relies heavily on beamline scientists. Some experiments can take one or two days with experts making decisions along the way. Leveraging the computing power of HPC platforms and AI advances in image analyses, here we demonstrate an autonomous workflow for the single-crystal neutron diffraction experiments. The workflow consists of three components: an inference service that provides real-time AI segmentation on the image stream from the experiments conducted at the neutron facility, a continuous integration service that launches distributed training jobs on Summit to update the AI model on newly collected images, and a frontend web service to display the AI tagged images to the expert. Ultimately, the feedback can be directly fed to the equipment at the edge in deciding the next-step experiment without requiring an expert in the loop. With the analyses of the requirements and benchmarks of the performance for each component, this effort serves as the first step toward an autonomous workflow for real-time experiment steering at ORNL neutron facilities.

Yin, Junqi↗
DOE OSTI2023

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

HEPCloud Operations at Fermilab—The First Five Years

The HEPCloud Facility at Fermilab has now been in production operation for five years. This facility is a unified provisioning gateway to US high performance computing centers, including NERSC, OLCF, and ALCF, other large supercomputers run by the NSF, and commercial clouds. HEPCloud delivers hundreds of millions of core-hours yearly for CMS. HEPCloud also serves other Fermilab experiments including DUNE, Mu2e, Muon g-2, and NOvA. In this paper we present the practical considerations of operating a distributed facility such as HEPCloud. We also mention some of the interesting research and development that HEPCloud has been used for including GPU-based machine learning inference servers, and tests of Quantum Computing.

Timm, Steven [Fermilab]↗
DOE OSTI2020

Collaborative investigation of the internal flow and near-nozzle flow of an eight-hole gasoline injector (Engine Combustion Network Spray G)

The internal details of fuel injectors have a profound impact on the emissions from gasoline direct injection engines. However, the impact of injector design features is not currently understood, due to the difficulty in observing and modeling internal injector flows. Gasoline direct injection flows involve moving geometry, flash boiling, and high levels of turbulent two-phase mixing. In order to better simulate these injectors, five different modeling approaches have been employed to study the engine combustion network Spray G injector. Here these simulation results have been compared to experimental measurements obtained, among other techniques, with X-ray diagnostics, allowing the predictions to be evaluated and critiqued. The ability of the models to predict mass flow rate through the injector is confirmed, but other features of the predictions vary in their accuracy. The prediction of plume width and fuel mass distribution varies widely, with volume-of-fluid tending to overly concentrate the fuel. All the simulations, however, seem to struggle with predicting fuel dispersion and by inference, jet velocity. This shortcoming of the predictions suggests a need to improve Eulerian modeling of dense fuel jets.

ECN↗
DOE OSTI2020

Keck/NIRC2 L’-band Imaging of Jovian-mass Accreting Protoplanets around PDS 70

We present L’-band imaging of the PDS 70 planetary system with Keck/NIRC2 using the new infrared pyramid wave front sensor. We detected both PDS 70 b and c in our images, as well as the front rim of the circumstellar disk. After subtracting off a model of the disk, we measured the astrometry and photometry of both planets. Placing priors based on the dynamics of the system, we estimated PDS 70 b to have a semimajor axis of 20{sub −4}{sup +3} au and PDS 70 c to have a semimajor axis of 34{sub −6}{sup +12} au (95% credible interval). We fit the spectral energy distribution (SED) of both planets. For PDS 70 b, we were able to place better constraints on the red half of its SED than previous studies and inferred the radius of the photosphere to be 2–3 R {sub Jup}. The SED of PDS 70 c is less well constrained, with a range of total luminosities spanning an order of magnitude. With our inferred radii and luminosities, we used evolutionary models of accreting protoplanets to derive a mass of PDS 70 b between 2 and 4 M {sub Jup} and a mean mass accretion rate between 3 × 10{sup −7} and 8 × 10{sup −7} M {sub Jup}/yr. For PDS 70 c, we computed a mass between 1 and 3 M {sub Jup} and mean mass accretion rate between 1 × 10{sup −7} and 5 × 10{sup −7} M {sub Jup}/yr. The mass accretion rates imply dust accretion timescales short enough to hide strong molecular absorption features in both planets’ SEDs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data

ABSTRACT Cosmological analyses of galaxy surveys rely on knowledge of the redshift distribution of their galaxy sample. This is usually derived from a spectroscopic and/or many-band photometric calibrator survey of a small patch of sky. The uncertainties in the redshift distribution of the calibrator sample include a contribution from shot noise, or Poisson sampling errors, but, given the small volume they probe, they are dominated by sample variance introduced by large-scale structures. Redshift uncertainties have been shown to constitute one of the leading contributions to systematic uncertainties in cosmological inferences from weak lensing and galaxy clustering, and hence they must be propagated through the analyses. In this work, we study the effects of sample variance on small-area redshift surveys, from theory to simulations to the COSMOS2015 data set. We present a three-step Dirichlet method of resampling a given survey-based redshift calibration distribution to enable the propagation of both shot noise and sample variance uncertainties. The method can accommodate different levels of prior confidence on different redshift sources. This method can be applied to any calibration sample with known redshifts and phenotypes (i.e. cells in a self-organizing map, or some other way of discretizing photometric space), and provides a simple way of propagating prior redshift uncertainties into cosmological analyses. As a worked example, we apply the full scheme to the COSMOS2015 data set, for which we also present a new, principled SOM algorithm designed to handle noisy photometric data. We make available a catalogue of the resulting resamplings of the COSMOS2015 galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Modeling Kilonova Light Curves: Dependence on Nuclear Inputs

The mergers of binary neutron stars, as well as black hole–neutron star systems, are expected to produce an electromagnetic counterpart that can be analyzed to infer the element synthesis that occurred in these events. We investigate one source of uncertainties pertinent to lanthanide-rich outflows: the nuclear inputs to rapid neutron capture nucleosynthesis calculations. We begin by examining 32 different combinations of nuclear inputs: eight mass models, two types of spontaneous fission rates, and two types of fission daughter product distributions. We find that such nuclear physics uncertainties typically generate at least one order of magnitude uncertainty in key quantities such as the nuclear heating (one and a half orders of magnitude at 1 day post-merger), the bolometric luminosity (one order of magnitude at 5 days post-merger), and the inferred mass of material from the bolometric luminosity (factor of 8 when considering the 8–10 day region). Since particular nuclear processes are critical for determining the electromagnetic signal, we provide tables of key nuclei undergoing β-decay, α-decay, and spontaneous fission important for heating at different times, identifying decays that are common among the many nuclear input combinations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Learning-Accelerated ADMM for Distributed DC Optimal Power Flow

We suggest a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions. Using previous observations of ADMM trajectories for a given system under varying load, the method trains a recurrent neural network (RNN) to predict the converged values of dual and consensus variables. Given a new realization of system load, a small number of initial ADMM iterations is taken as input to infer the converged values and directly inject them into the iteration. We empirically demonstrate that the online injection of these values into the ADMM iteration accelerates convergence by a significant factor for partitioned 14-, 118-and 2848-bus test systems under differing load scenarios. The proposed method has several advantages: it maintains the security of private decision variables inherent in consensus ADMM; inference is fast and so may be used in online settings; RNN-generated predictions can dramatically improve time to convergence but, by construction, can never result in infeasible ADMM subproblems; it can be easily integrated into existing software implementations. While we focus on the ADMM formulation of distributed DC-OPF in this paper, the ideas presented are naturally extended to other distributed optimization problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Learning-Accelerated ADMM for Distributed DC Optimal Power Flow

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions. Using previous observations of ADMM trajectories for a given system under varying load, the method trains a recurrent neural network (RNN) to predict the converged values of dual and consensus variables. Given a new realization of system load, a small number of initial ADMM iterations is taken as input to infer the converged values and directly inject them into the iteration. We empirically demonstrate that the online injection of these values into the ADMM iteration accelerates convergence by a significant factor for partitioned 14-, 118- and 2848-bus test systems under differing load scenarios. The proposed method has several advantages: it maintains the security of private decision variables inherent in consensus ADMM; inference is fast and so may be used in online settings; RNN-generated predictions can dramatically improve time to convergence but, by construction, can never result in infeasible ADMM subproblems; it can be easily integrated into existing software implementations. While we focus on the ADMM formulation of distributed DC-OPF in this paper, the ideas presented are naturally extended to other distributed optimization problems.

alternating direction method of multipliers↗
DOE OSTI2024

Robust inference of the Galactic Centre gamma-ray excess spatial properties

ABSTRACT The gamma-ray Fermi-LAT Galactic Centre excess (GCE) has puzzled scientists for over 15 yr. Despite ongoing debates about its properties, and especially its spatial distribution, its nature remains elusive. We scrutinize how the estimated spatial morphology of this excess depends on models for the Galactic diffuse emission, focusing particularly on the extent to which the Galactic plane and point sources are masked. Our main aim is to compare a spherically symmetric morphology – potentially arising from the annihilation of dark matter (DM) particles – with a boxy morphology – expected if faint unresolved sources in the Galactic bulge dominate the excess emission. Recent claims favouring a DM-motivated template for the GCE are shown to rely on a specific Galactic bulge template, which performs worse than other templates for the Galactic bulge. We find that a non-parametric model of the Galactic bulge derived from the VISTA Variables in the Via Lactea survey results in a significantly better fit for the GCE than DM-motivated templates. This result is independent of whether a galprop-based model or a more non-parametric ring-based model is used to describe the diffuse Galactic emission. This conclusion remains true even when additional freedom is added in the background models, allowing for non-parametric modulation of the model components and substantially improving the fit quality. When adopted, optimized background models provide robust results in terms of preference for a boxy bulge morphology for the GCE, regardless of the mask applied to the Galactic plane.

Astronomy & Astrophysics↗
DOE OSTI2023

Intergalactic magnetic field studies by means of γ -ray emission from GRB 190114C

The presence of delayed GeV emission after a strong transient, such as a gamma-ray burst (GRB), in the very-high energy (VHE) E > 100 GeV band can be the signature of a nonzero magnetic field in the intergalactic medium. Here we used a synchrotron self-Compton multiwavelength model to infer an analytical description of the intrinsic VHE spectrum (corrected for absorption by the extragalactic background light) of GRB 190114C to predict the light curves and spectral energy distributions of the delayed emission with Monte Carlo simulations for different intergalactic magnetic field (IGMF) configurations (strengths B = 8 × 10 -21 G, 10 -20 G, 3 × 10 -20 G and correlation length $\lambda$ > 1 Mpc), and compared them with the Fermi Large Area Telescope (Fermi LAT) limits computed for several exposure times. We found that the Fermi LAT is not sensitive enough to constrain any IGMF strengths using GRB 190114C.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A Bayesian Approach for Statistical–Physical Bulk Parameterization of Rain Microphysics. Part I: Scheme Description

A novel framework is proposed for the bulk parameterization of rain microphysics: the Bayesian Observationally Constrained Statistical–Physical Scheme (BOSS). It is designed to facilitate direct constraint by observations using Bayesian inference. BOSS combines existing process-level microphysical knowledge with flexible process rate formulations and parameters constrained by observations within a Bayesian framework. Furthermore, using a raindrop size distribution (DSD) normalization method that relates DSD moments to one another via generalized power series, generalized multivariate power expressions are derived for the microphysical process rates as functions of a set of prognostic DSD moments. The scheme is flexible and can utilize any number and combination of prognostic moments and any number of terms in the process rate formulations. This means that both uncertainty in parameter values and structural uncertainty associated with the process rate formulations can be investigated systematically, which is not possible using traditional schemes. In this paper, BOSS is compared to two- and three-moment versions of a traditional bulk rain microphysics scheme (denoted as MORR). It is demonstrated that some process formulations in MORR are analytically equivalent to the generalized power expressions in BOSS using one or two terms, while others are not. BOSS is able to replicate the behavior of MORR in idealized one-dimensional rainshaft tests, but with a much more flexible and systematic design. Part II of this study describes the application of BOSS to derive rain microphysical process rates and posterior parameter distributions in Bayesian experiments using Markov chain Monte Carlo sampling constrained by synthetic observations.

58 GEOSCIENCES↗
DOE OSTI2024

Hierarchical Bayesian modeling for Inverse Uncertainty Quantification of system thermal-hydraulics code using critical flow experimental data

The best estimate plus uncertainty methodology in nuclear system thermal-hydraulic studies necessitates a comprehensive understanding of uncertainties in system code predictions. The forward uncertainty quantification (UQ) process involves the propagation of input uncertainties through the computational models to obtain uncertainties in the outputs. To this end, achieving an accurate estimation of input uncertainties is important, which is the focus of inverse UQ (IUQ). Traditionally, research in Bayesian IUQ within the nuclear engineering domain has largely relied on single-level Bayesian inference. While being effective for relatively small datasets, this approach encounters limitations for cases with large datasets. The use of a single-level model may prove inefficient, as the resultant posterior distributions can significantly differ when distinct subsets of data are employed. To address this issue, we employ an hierarchical Bayesian model for IUQ. Furthermore, this approach involves organizing observations into different groups based on the test conditions, thereby accommodating varying calibration parameters across these distinct groups. In this study, we developed and implemented a hierarchical Bayesian IUQ method to consider the grouping effect of critical flow measurement data from various geometries. Comparing the outcomes of IUQ under different selections of test data using hierarchical Bayesian IUQ against those obtained from single-level Bayesian IUQ, the forward propagation of hierarchical Bayesian IUQ results demonstrates a notably improved agreement with the experimental data.

42 ENGINEERING↗