Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Off-the-shelf deep learning is not enough, and requires parsimony, Bayesianity, and causality

Abstract Deep neural networks (‘deep learning’) have emerged as a technology of choice to tackle problems in speech recognition, computer vision, finance, etc. However, adoption of deep learning in physical domains brings substantial challenges stemming from the correlative nature of deep learning methods compared to the causal, hypothesis driven nature of modern science. We argue that the broad adoption of Bayesian methods incorporating prior knowledge, development of solutions with incorporated physical constraints and parsimonious structural descriptors and generative models, and ultimately adoption of causal models, offers a path forward for fundamental and applied research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Sampling lattices in semi-grand canonical ensemble with autoregressive machine learning

Calculating thermodynamic potentials and observables efficiently and accurately is key for the application of statistical mechanics simulations to materials science. However, naive Monte Carlo approaches, on which such calculations are often dependent, struggle to scale to complex materials in many state-of-the-art disciplines such as the design of high entropy alloys or multi-component catalysts. To address this issue, we adapt sampling tools built upon machine learning-based generative modeling to the materials space by transforming them into the semi-grand canonical ensemble. Furthermore, we show that the resulting models are transferable across wide ranges of thermodynamic conditions and can be implemented with any internal energy model U, allowing integration into many existing materials workflows. We demonstrate the applicability of this approach to the simulation of benchmark systems (AgPd, CuAu) that exhibit diverse thermodynamic behavior in their phase diagrams. Finally, we discuss remaining challenges in model development and promising research directions for future improvements.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Real-space chirality from crystalline topological defects in the Kitaev spin liquid

We show that certain crystalline topological defects in the gapless Kitaev honeycomb spin liquid model generate a chirality and Majorana fermion orbital magnetization that depends in a universal manner on their emergent flux. Focusing on 5–7 dislocations as building blocks, consisting of pentagon and heptagon disclinations, we identify the Kitaev bond label configurations that preserve solvability. By computing two formulations of local markers M(r) we find that the 5 and 7 lattice defects generate a real-space contribution to Chern number and an associated Majorana fermion orbital magnetization proportional to M(r). The sign of the M(r) contribution from each 5/7 defect, i.e. its q M = ± 1 chirality, is determined by the defect Frank angle sign F and emergent gauge field flux W = ± i through the expression q M = − iFW. Remarkably, though lattice curvature and torsion can interplay with the surrounding gapless background to modify the profile of M(r), its sign q M is determined locally, implying that crystalline defects in the Kitaev spin liquid can generate a robust and observable chirality.

Magnetic properties and materials↗
DOE OSTI2024

Boreal–Arctic wetland methane emissions modulated by warming and vegetation activity

Abstract Wetland methane (CH 4 ) emissions over the Boreal–Arctic region are vulnerable to climate change and linked to climate feedbacks, yet understanding of their long-term dynamics remains uncertain. Here, we upscaled and analysed two decades (2002–2021) of Boreal–Arctic wetland CH 4 emissions, representing an unprecedented compilation of eddy covariance and chamber observations. We found a robust increasing trend of CH 4 emissions (+8.9%) with strong inter-annual variability. The majority of emission increases occurred in early summer (June and July) and were mainly driven by warming (52.3%) and ecosystem productivity (40.7%). Moreover, a 2 °C temperature anomaly in 2016 led to the highest recorded annual CH 4 emissions (22.3 Tg CH 4 yr −1 ) over this region, driven primarily by high emissions over Western Siberian lowlands. However, current-generation models from the Global Carbon Project failed to capture the emission magnitude and trend, and may bias the estimates in future wetland CH 4 emission driven by amplified Boreal–Arctic warming and greening.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Limited-angle computed tomography with deep image and physics priors

Computed tomography is a well-established x-ray imaging technique to reconstruct the three-dimensional structure of objects. It has been used extensively in a variety of fields, from diagnostic imaging to materials and biological sciences. One major challenge in some applications, such as in electron or x-ray tomography systems, is that the projections cannot be gathered over all the angles due to the sample holder setup or shape of the sample. This results in an ill-posed problem called the limited angle reconstruction problem. Typical image reconstruction in this setup leads to distortion and artifacts, thereby hindering a quantitative evaluation of the results. To address this challenge, we use a generative model to effectively constrain the solution of a physics-based approach. Our approach is self-training that can iteratively learn the nonlinear mapping from partial projections to the scanned object. Because our approach combines the data likelihood and image prior terms into a single deep network, it is computationally tractable and improves performance through an end-to-end training. We also complement our approach with total-variation regularization to handle high-frequency noise in reconstructions and implement a solver based on alternating direction method of multipliers. We present numerical results for various degrees of missing angle range and noise levels, which demonstrate the effectiveness of the proposed approach.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Physics-embedded inverse analysis with algorithmic differentiation for the earth’s subsurface

Abstract Inverse analysis has been utilized to understand unknown underground geological properties by matching the observational data with simulators. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented with embedded physics and a technique known as algorithmic differentiation. We use a physics-embedded generative model, which takes statistically simple parameters as input and outputs subsurface properties (e.g., permeability or P-wave velocity), that embeds physical knowledge of the subsurface properties into inverse analysis and improves its performance. We tested the application of this approach on four geologic problems: two heterogeneous hydraulic conductivity fields, a hydraulic fracture network, and a seismic inversion for P-wave velocity. This physics-embedded inverse analysis approach consistently characterizes these geological problems accurately. Furthermore, the excellent performance in matching the observational data demonstrates the reliability of the proposed method. Moreover, the application of algorithmic differentiation makes this an easy and fast approach to inverse analysis when dealing with complicated geological structures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Integration of machine learning with neutron scattering for the Hamiltonian tuning of spin ice under pressure

Quantum materials research requires co-design of theory with experiments and involves demanding simulations and the analysis of vast quantities of data, usually including pattern recognition and clustering. Artificial intelligence is a natural route to optimise these processes and bring theory and experiments together. Here, we propose a scheme that integrates machine learning with high-performance simulations and scattering measurements, covering the pipeline of typical neutron experiments. Our approach uses nonlinear autoencoders trained on realistic simulations along with a fast surrogate for the calculation of scattering in the form of a generative model. We demonstrate this approach in a highly frustrated magnet, Dy 2 Ti 2 O 7 , using machine learning predictions to guide the neutron scattering experiment under hydrostatic pressure, extract material parameters and construct a phase diagram. Our scheme provides a comprehensive set of capabilities that allows direct integration of theory along with automated data processing and provides on a rapid timescale direct insight into a challenging condensed matter system.

36 MATERIALS SCIENCE↗
DOE OSTI2022

PolyODENet: Deriving mass-action rate equations from incomplete transient kinetics data

Kinetics of a reaction network that follows mass-action rate laws can be described with a system of ordinary differential equations (ODEs) with polynomial right-hand side. However, it is challenging to derive such kinetic differential equations from transient kinetic data without knowing the reaction network, especially when the data are incomplete due to experimental limitations. We introduce a program, PolyODENet, toward this goal. Based on the machine-learning method Neural ODE, PolyODENet defines a generative model and predicts concentrations at arbitrary time. As such, it is possible to include unmeasurable intermediate species in the kinetic equations. Importantly, we have implemented various measures to apply physical constraints and chemical knowledge in the training to regularize the solution space. Here, using simple catalytic reaction models, we demonstrate that PolyODENet can predict reaction profiles of unknown species and doing so even reveal hidden parts of reaction mechanisms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

A new synthetic correlation electron cyclotron emission diagnostic for validating nonlinear gyrokinetic simulations of electron temperature turbulence

To validate nonlinear gyrokinetic simulations of electron temperature turbulence, the experimental correlation electron cyclotron emission (CECE) measurements are to be compared using a synthetic CECE diagnostic, which generates modeled CECE measurement quantities by implementing realistic measurement parameters (e.g., spatial and wavenumber resolutions, radial location, etc.) to nonlinear gyrokinetic simulations. In this work, we calculate the radial and vertical spatial and wavenumber transfer functions, which are defined by the electron cyclotron emission emissivity radial profile and vertical probing antenna pattern, respectively. These transfer functions are applied to nonlinear gyrokinetic simulations of electron temperature turbulence using the continuum gyrokinetic code. A simultaneous comparison of the experimental electron temperature turbulence power spectrum and root-mean-square (RMS) level, as well as the radial correlation length with the new synthetic CECE diagnostic at a core location ρ ∼ 0.75 in an L-mode DIII-D tokamak plasma, is presented. Here, the preliminary result shows that the synthetic CECE output underestimates the RMS level by ∼42% and overestimates the radial correlation length by ∼40%.

Cyclotron radiation↗
DOE OSTI2024

Chaotic neural dynamics facilitate probabilistic computations through sampling

Cortical neurons exhibit highly variable responses over trials and time. Theoretical works posit that this variability arises potentially from chaotic network dynamics of recurrently connected neurons. Here, we demonstrate that chaotic neural dynamics, formed through synaptic learning, allow networks to perform sensory cue integration in a sampling-based implementation. We show that the emergent chaotic dynamics provide neural substrates for generating samples not only of a static variable but also of a dynamical trajectory, where generic recurrent networks acquire these abilities with a biologically plausible learning rule through trial and error. Furthermore, the networks generalize their experience in the stimulus-evoked samples to the inference without partial or all sensory information, which suggests a computational role of spontaneous activity as a representation of the priors as well as a tractable biological computation for marginal distributions. These findings suggest that chaotic neural dynamics may serve for the brain function as a Bayesian generative model.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Field-level reconstruction from foreground-contaminated 21-cm maps

Current and upcoming 21-cm experiments will soon be able to map 21-cm spatial fluctuations in three dimensions for a wide range of redshifts. However, bright foreground contamination and the nature of radio interferometry create significant challenges, making it difficult to access rich cosmological information from the Fourier modes that lie within the “foreground wedge”. Here, in this work, we introduce two approaches aiming to reconstruct the full 21-cm density field, including the missing modes in the wedge: (a) a field-level inference under an effective field theory (EFT) framework; (b) a diffusion-based deep generative model trained on simulations. Under the EFT framework, we implement a fully differentiable forward model that maps the initial conditions of matter fluctuations to the observed, foreground-filtered 21-cm maps. This enables a gradient-based sampler to simultaneously sample the initial conditions and bias parameters, allowing a physically motivated mode reconstruction. Alternatively, we apply a variational diffusion model to perform 21-cm density reconstruction at the map level. Our model is trained on semi-numerical simulations over a wide range of astrophysical parameters. Our results from both approaches should provide improved cosmological constraints from the field level and also enable cross-correlation between experiments that have little or no overlapping modes.

cosmological perturbation theory↗
DOE OSTI2024

Robust anomaly detection for particle physics using multi-background representation learning

Abstract Anomaly, or out-of-distribution, detection is a promising tool for aiding discoveries of new particles or processes in particle physics. In this work, we identify and address two overlooked opportunities to improve anomaly detection (AD) for high-energy physics. First, rather than train a generative model on the single most dominant background process, we build detection algorithms using representation learning from multiple background types, thus taking advantage of more information to improve estimation of what is relevant for detection. Second, we generalize decorrelation to the multi-background setting, thus directly enforcing a more complete definition of robustness for AD. We demonstrate the benefit of the proposed robust multi-background AD algorithms on a high-dimensional dataset of particle decays at the Large Hadron Collider.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Discriminative versus generative approaches to simulation-based inference

Most of the fundamental, emergent, and phenomenological parameters of particle and nuclear physics are determined through parametric template fits. Simulations are used to populate histograms which are then matched to data. This approach is inherently lossy, since histograms are binned and low-dimensional. Deep learning has enabled unbinned and high-dimensional parameter estimation through neural likelihood(-ratio) estimation. We compare two approaches for neural simulation-based inference (NSBI): one based on discriminative learning (classification) and one based on generative modeling. These two approaches are directly evaluated on the same datasets, with a similar level of hyperparameter optimization in both cases. In addition to a Gaussian dataset, we study NSBI using a Higgs boson dataset from the FAIR Universe Challenge. We find that both the direct likelihood and likelihood ratio estimation are able to effectively extract parameters with reasonable uncertainties. For the numerical examples and within the set of hyperparameters studied, we found that the likelihood ratio method is more accurate and/or precise. Both methods have a significant spread from the network training and would require ensembling or other mitigation strategies in practice.

high energy physics↗
DOE OSTI2026

pop-cosmos : redshifts and physical properties of KiDS-1000 galaxies

ABSTRACT Principled Bayesian inference of galaxy properties has not previously been performed for wide-area weak-lensing surveys with millions of sources. We address this gap by applying the pop-cosmos generative model to perform spectral energy distribution (SED) fitting for 4 million KiDS (Kilo-Degree Survey)-1000 galaxies. Calibrated on deep COSMOS2020 photometric data, pop-cosmos specifies a physically motivated prior over the galaxy population up to $z \simeq 6$ in stellar population synthesis (SPS) parameter space. Using the Speculator SPS emulator with GPU (graphics processing unit)-accelerated Markov Chain Monte Carlo sampling, we perform full posterior inference at 8.2 GPU seconds per galaxy, obtaining joint constraints on galaxy redshifts and physical properties. We validate photometric redshifts against $\sim \!185\,\!000$ KiDS galaxies cross-matched to Dark Energy Spectroscopic Instrument Data Release 1 spectroscopic samples, achieving low bias ($2\times 10^{-3}$), scatter ($\sigma _{\mathrm{MAD}}=0.03$), and outlier fraction (3.2 per cent) for the Bright Galaxy Survey, with comparable performance (bias $3\times 10^{-2}$, $\sigma _{\mathrm{MAD}}=0.05$, 1.0 per cent outliers) for luminous red galaxies (LRGs). Within the LRG sample, we identify massive, dusty, star-forming contaminants at $z \simeq 0.4$ satisfying standard colour selections for quenched populations. We infer trends in stellar mass, star formation, metallicity, and dust across five tomographic redshift bins consistent with established scaling relations. Using specific star formation rate constraints, we identify $\sim$7 per cent of KiDS-1000 galaxies as quenched, versus 37 per cent implied by conservative colour cuts. This enables the construction of weak-lensing samples defined by physical properties while mitigating intrinsic alignment systematics and preserving statistical power. Our analysis validates pop-cosmos out of sample, establishing it as a scalable approach for galaxy evolution and cosmological analyses with photometric surveys.

Halder, Anik [Institute of Astronomy and Kavli Ins↗
DOE OSTI2020

Probing nuclear effects with neutrino-induced charged-current neutral pion production

We study neutrino-induced charged-current (CC) $\pi^0$ production on carbon nuclei using events with fully imaged final-state proton-$\pi^0$ systems. Novel use of final-state correlations based on transverse kinematic imbalance enable the first measurements of the struck nucleon's Fermi motion, of the intranuclear momentum transfer (IMT) dynamics, and of the final-state hadronic momentum configuration in neutrino pion production. Event distributions are presented for i) the momenta of neutrino-struck neutrons below the Fermi surface, ii) the direction of missing transverse momentum characterizing the strength of IMT, and iii) proton-pion momentum imbalance with respect to the lepton scattering plane. The observed Fermi motion and IMT strength are compared to the previous MINERvA measurement of neutrino CC quasielastic-like production. The measured shapes and absolute rates of these distributions, as well as the cross-section asymmetries show tensions with predictions from current neutrino generator models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Flow-based likelihoods for non-Gaussian inference

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based generative models, a class of models that can capture complex distributions by transforming a simple base distribution through layers of nonlinearities. We call these flow-based likelihoods (FBL). We analyze the accuracy and precision of the reconstructed likelihoods on mock Gaussian data, and show that simply gauging the quality of samples drawn from the trained model is not a sufficient indicator that the true likelihood has been learned. We nevertheless demonstrate that the likelihood can be reconstructed to a precision equal to that of sampling error due to a finite sample size. We then apply FBLs to mock weak lensing convergence power spectra, a cosmological observable that is significantly non-Gaussian (NG). We find that the FBL captures the NG signatures in the data extremely well, while other commonly used data-driven likelihoods, such as Gaussian mixture models and independent component analysis, fail to do so. This suggests that works that have found small posterior shifts in NG data with data-driven likelihoods such as these could be underestimating the impact of non-Gaussianity in parameter constraints. By introducing a suite of tests that can capture different levels of NG in the data, we show that the success or failure of traditional data-driven likelihoods can be tied back to the structure of the NG in the data. Here, unlike other methods, the flexibility of the FBL makes it successful at tackling different types of NG simultaneously. Because of this, and consequently their likely applicability across datasets and domains, we encourage their use for inference when sufficient mock data are available for training.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Nonequilibrium effects on stability of hybrid stars with first-order phase transitions

The stability of hybrid stars with first-order phase transitions as determined by calculating fundamental radial oscillation modes is known to differ from the predictions of the widely used Bardeen-Thorne-Meltzer criterion. We consider the effects of out-of-chemical-equilibrium physics on the radial modes and hence stability of these objects. For a barotropic equation of state, this is done by allowing the adiabatic sound speed to differ from the equilibrium sound speed. We show that doing so extends the stable branches of stellar models, allowing stars with rapid phase transitions to support stable higher-order stellar multiplets similarly to stars with multiple slow phase transitions. We also derive a new junction condition to impose on the oscillation modes at the phase transition. Termed the reactive condition, it is physically motivated, consistent with the generalized junction conditions between two phases, and has the common rapid and slow conditions as limiting cases. Unlike the two common cases, it can only be applied to nonbarotropic stars. Here, we apply this junction condition to hybrid stellar models generated using a two-phase equation of state consisting of nuclear matter with unpaired quark matter at high densities joined by a first-order phase transition and show that, like in the slow limiting case, stars that are classically unstable are stabilized by a finite chemical reaction speed.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

First-principles characterization of the magnetic properties of Cu 2 (OH) 3 Br

Low-dimensional spin-1/2 transition metal oxides and oxyhalides continue to be at the forefront of research investigating nonclassical phases such as quantum spin liquids. In this work, we examine the magnetic properties of the oxyhalide Cu 2 (OH) 3 Br in the botallackite structure using first-principles density functional theory, linear spin-wave theory, and exact diagonalization calculations. This quasi-two-dimensional system consists of Cu 2+ S = 1/2 moments arranged on a distorted triangular lattice. Our exact diagonalization calculations, which rely on a first-principles-based magnetic model, generate spectral functions consistent with inelastic neutron scattering data. By performing computational experiments to disentangle the chemical and steric effects of the halide ions, we find that the dominant effect of the halogen ions is steric in the Cu 2 (OH) 3 X series of compounds.

36 MATERIALS SCIENCE↗