SEARCH · Engineering Papers

Results for “generator model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

All sources NASA NTRS DOE OSTI

DOE OSTI2024

A new synthetic correlation electron cyclotron emission diagnostic for validating nonlinear gyrokinetic simulations of electron temperature turbulence

To validate nonlinear gyrokinetic simulations of electron temperature turbulence, the experimental correlation electron cyclotron emission (CECE) measurements are to be compared using a synthetic CECE diagnostic, which generates modeled CECE measurement quantities by implementing realistic measurement parameters (e.g., spatial and wavenumber resolutions, radial location, etc.) to nonlinear gyrokinetic simulations. In this work, we calculate the radial and vertical spatial and wavenumber transfer functions, which are defined by the electron cyclotron emission emissivity radial profile and vertical probing antenna pattern, respectively. These transfer functions are applied to nonlinear gyrokinetic simulations of electron temperature turbulence using the continuum gyrokinetic code. A simultaneous comparison of the experimental electron temperature turbulence power spectrum and root-mean-square (RMS) level, as well as the radial correlation length with the new synthetic CECE diagnostic at a core location ρ ∼ 0.75 in an L-mode DIII-D tokamak plasma, is presented. Here, the preliminary result shows that the synthetic CECE output underestimates the RMS level by ∼42% and overestimates the radial correlation length by ∼40%.

Cyclotron radiation↗

DOE OSTI2024

Chaotic neural dynamics facilitate probabilistic computations through sampling

Cortical neurons exhibit highly variable responses over trials and time. Theoretical works posit that this variability arises potentially from chaotic network dynamics of recurrently connected neurons. Here, we demonstrate that chaotic neural dynamics, formed through synaptic learning, allow networks to perform sensory cue integration in a sampling-based implementation. We show that the emergent chaotic dynamics provide neural substrates for generating samples not only of a static variable but also of a dynamical trajectory, where generic recurrent networks acquire these abilities with a biologically plausible learning rule through trial and error. Furthermore, the networks generalize their experience in the stimulus-evoked samples to the inference without partial or all sensory information, which suggests a computational role of spontaneous activity as a representation of the priors as well as a tractable biological computation for marginal distributions. These findings suggest that chaotic neural dynamics may serve for the brain function as a Bayesian generative model.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Field-level reconstruction from foreground-contaminated 21-cm maps

Current and upcoming 21-cm experiments will soon be able to map 21-cm spatial fluctuations in three dimensions for a wide range of redshifts. However, bright foreground contamination and the nature of radio interferometry create significant challenges, making it difficult to access rich cosmological information from the Fourier modes that lie within the “foreground wedge”. Here, in this work, we introduce two approaches aiming to reconstruct the full 21-cm density field, including the missing modes in the wedge: (a) a field-level inference under an effective field theory (EFT) framework; (b) a diffusion-based deep generative model trained on simulations. Under the EFT framework, we implement a fully differentiable forward model that maps the initial conditions of matter fluctuations to the observed, foreground-filtered 21-cm maps. This enables a gradient-based sampler to simultaneously sample the initial conditions and bias parameters, allowing a physically motivated mode reconstruction. Alternatively, we apply a variational diffusion model to perform 21-cm density reconstruction at the map level. Our model is trained on semi-numerical simulations over a wide range of astrophysical parameters. Our results from both approaches should provide improved cosmological constraints from the field level and also enable cross-correlation between experiments that have little or no overlapping modes.

cosmological perturbation theory↗

DOE OSTI2024

Robust anomaly detection for particle physics using multi-background representation learning

Abstract Anomaly, or out-of-distribution, detection is a promising tool for aiding discoveries of new particles or processes in particle physics. In this work, we identify and address two overlooked opportunities to improve anomaly detection (AD) for high-energy physics. First, rather than train a generative model on the single most dominant background process, we build detection algorithms using representation learning from multiple background types, thus taking advantage of more information to improve estimation of what is relevant for detection. Second, we generalize decorrelation to the multi-background setting, thus directly enforcing a more complete definition of robustness for AD. We demonstrate the benefit of the proposed robust multi-background AD algorithms on a high-dimensional dataset of particle decays at the Large Hadron Collider.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Discriminative versus generative approaches to simulation-based inference

Most of the fundamental, emergent, and phenomenological parameters of particle and nuclear physics are determined through parametric template fits. Simulations are used to populate histograms which are then matched to data. This approach is inherently lossy, since histograms are binned and low-dimensional. Deep learning has enabled unbinned and high-dimensional parameter estimation through neural likelihood(-ratio) estimation. We compare two approaches for neural simulation-based inference (NSBI): one based on discriminative learning (classification) and one based on generative modeling. These two approaches are directly evaluated on the same datasets, with a similar level of hyperparameter optimization in both cases. In addition to a Gaussian dataset, we study NSBI using a Higgs boson dataset from the FAIR Universe Challenge. We find that both the direct likelihood and likelihood ratio estimation are able to effectively extract parameters with reasonable uncertainties. For the numerical examples and within the set of hyperparameters studied, we found that the likelihood ratio method is more accurate and/or precise. Both methods have a significant spread from the network training and would require ensembling or other mitigation strategies in practice.

high energy physics↗

DOE OSTI2026

pop-cosmos : redshifts and physical properties of KiDS-1000 galaxies

ABSTRACT Principled Bayesian inference of galaxy properties has not previously been performed for wide-area weak-lensing surveys with millions of sources. We address this gap by applying the pop-cosmos generative model to perform spectral energy distribution (SED) fitting for 4 million KiDS (Kilo-Degree Survey)-1000 galaxies. Calibrated on deep COSMOS2020 photometric data, pop-cosmos specifies a physically motivated prior over the galaxy population up to $z \simeq 6$ in stellar population synthesis (SPS) parameter space. Using the Speculator SPS emulator with GPU (graphics processing unit)-accelerated Markov Chain Monte Carlo sampling, we perform full posterior inference at 8.2 GPU seconds per galaxy, obtaining joint constraints on galaxy redshifts and physical properties. We validate photometric redshifts against $\sim \!185\,\!000$ KiDS galaxies cross-matched to Dark Energy Spectroscopic Instrument Data Release 1 spectroscopic samples, achieving low bias ($2\times 10^{-3}$), scatter ($\sigma _{\mathrm{MAD}}=0.03$), and outlier fraction (3.2 per cent) for the Bright Galaxy Survey, with comparable performance (bias $3\times 10^{-2}$, $\sigma _{\mathrm{MAD}}=0.05$, 1.0 per cent outliers) for luminous red galaxies (LRGs). Within the LRG sample, we identify massive, dusty, star-forming contaminants at $z \simeq 0.4$ satisfying standard colour selections for quenched populations. We infer trends in stellar mass, star formation, metallicity, and dust across five tomographic redshift bins consistent with established scaling relations. Using specific star formation rate constraints, we identify $\sim$7 per cent of KiDS-1000 galaxies as quenched, versus 37 per cent implied by conservative colour cuts. This enables the construction of weak-lensing samples defined by physical properties while mitigating intrinsic alignment systematics and preserving statistical power. Our analysis validates pop-cosmos out of sample, establishing it as a scalable approach for galaxy evolution and cosmological analyses with photometric surveys.

Halder, Anik [Institute of Astronomy and Kavli Ins↗

DOE OSTI2020

Probing nuclear effects with neutrino-induced charged-current neutral pion production

We study neutrino-induced charged-current (CC) $\pi^0$ production on carbon nuclei using events with fully imaged final-state proton-$\pi^0$ systems. Novel use of final-state correlations based on transverse kinematic imbalance enable the first measurements of the struck nucleon's Fermi motion, of the intranuclear momentum transfer (IMT) dynamics, and of the final-state hadronic momentum configuration in neutrino pion production. Event distributions are presented for i) the momenta of neutrino-struck neutrons below the Fermi surface, ii) the direction of missing transverse momentum characterizing the strength of IMT, and iii) proton-pion momentum imbalance with respect to the lepton scattering plane. The observed Fermi motion and IMT strength are compared to the previous MINERvA measurement of neutrino CC quasielastic-like production. The measured shapes and absolute rates of these distributions, as well as the cross-section asymmetries show tensions with predictions from current neutrino generator models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Flow-based likelihoods for non-Gaussian inference

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based generative models, a class of models that can capture complex distributions by transforming a simple base distribution through layers of nonlinearities. We call these flow-based likelihoods (FBL). We analyze the accuracy and precision of the reconstructed likelihoods on mock Gaussian data, and show that simply gauging the quality of samples drawn from the trained model is not a sufficient indicator that the true likelihood has been learned. We nevertheless demonstrate that the likelihood can be reconstructed to a precision equal to that of sampling error due to a finite sample size. We then apply FBLs to mock weak lensing convergence power spectra, a cosmological observable that is significantly non-Gaussian (NG). We find that the FBL captures the NG signatures in the data extremely well, while other commonly used data-driven likelihoods, such as Gaussian mixture models and independent component analysis, fail to do so. This suggests that works that have found small posterior shifts in NG data with data-driven likelihoods such as these could be underestimating the impact of non-Gaussianity in parameter constraints. By introducing a suite of tests that can capture different levels of NG in the data, we show that the success or failure of traditional data-driven likelihoods can be tied back to the structure of the NG in the data. Here, unlike other methods, the flexibility of the FBL makes it successful at tackling different types of NG simultaneously. Because of this, and consequently their likely applicability across datasets and domains, we encourage their use for inference when sufficient mock data are available for training.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Nonequilibrium effects on stability of hybrid stars with first-order phase transitions

The stability of hybrid stars with first-order phase transitions as determined by calculating fundamental radial oscillation modes is known to differ from the predictions of the widely used Bardeen-Thorne-Meltzer criterion. We consider the effects of out-of-chemical-equilibrium physics on the radial modes and hence stability of these objects. For a barotropic equation of state, this is done by allowing the adiabatic sound speed to differ from the equilibrium sound speed. We show that doing so extends the stable branches of stellar models, allowing stars with rapid phase transitions to support stable higher-order stellar multiplets similarly to stars with multiple slow phase transitions. We also derive a new junction condition to impose on the oscillation modes at the phase transition. Termed the reactive condition, it is physically motivated, consistent with the generalized junction conditions between two phases, and has the common rapid and slow conditions as limiting cases. Unlike the two common cases, it can only be applied to nonbarotropic stars. Here, we apply this junction condition to hybrid stellar models generated using a two-phase equation of state consisting of nuclear matter with unpaired quark matter at high densities joined by a first-order phase transition and show that, like in the slow limiting case, stars that are classically unstable are stabilized by a finite chemical reaction speed.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

First-principles characterization of the magnetic properties of Cu 2 (OH) 3 Br

Low-dimensional spin-1/2 transition metal oxides and oxyhalides continue to be at the forefront of research investigating nonclassical phases such as quantum spin liquids. In this work, we examine the magnetic properties of the oxyhalide Cu 2 (OH) 3 Br in the botallackite structure using first-principles density functional theory, linear spin-wave theory, and exact diagonalization calculations. This quasi-two-dimensional system consists of Cu 2+ S = 1/2 moments arranged on a distorted triangular lattice. Our exact diagonalization calculations, which rely on a first-principles-based magnetic model, generate spectral functions consistent with inelastic neutron scattering data. By performing computational experiments to disentangle the chemical and steric effects of the halide ions, we find that the dominant effect of the halogen ions is steric in the Cu 2 (OH) 3 X series of compounds.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Weakly Supervised Event Classification Using Imperfect Real-world PMU Data with Scarce Labels

This paper studies event classification using imperfect real-world phasor measurement unit (PMU) data with scarce event types (labels). By investigating the real-world PMU data, it is observed that most real-world PMU data's event type is unknown, which makes it challenging to directly use such dataset to build event classifiers as existing classification techniques require high-quality training data with known event type (i.e., label). To address this challenge, a weakly supervised learning based event classification approach is developed, which can use noisy and low-quality PMU data for the training. First, data quality issues are fixed using data preprocessing techniques and then event features are constructed from the PMU data. Using these features, a series of labeling functions are learnt to generate initial estimates of the labels of large amounts of unlabeled PMU data. As the labeling functions are learnt using the same data with scarce labels, the label estimates from the labeling functions can be correlated, noisy, and bias. To enhance these initial estimates, a generative model is developed to characterize the dependencies among the estimated labels, based on which better labels are obtained for training event classifiers. Numerical experiments using the real-world dataset from the Western Interconnection of the U.S. power transmission grid show that the proposed weakly supervised event classifier trained using the dataset with only 5% labeled data can achieve 78.4% classification accuracy.

Liu, Yunchuan↗

DOE OSTI2022

Making Invisible Visible: Data-Driven Seismic Inversion With Spatio-Temporally Constrained Data Augmentation

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of obtaining data through expensive physical experiments, instruments, and simulations, data augmentation techniques for scientific applications have emerged as a new direction for obtaining scientific data recently. However, existing data augmentation techniques originating from computer vision yield physically unacceptable data samples that are not helpful for the domain problems that we are interested in. In this article, we develop new data augmentation techniques based on convolutional neural networks. Specifically, our generative models leverage different physics knowledge (such as governing equations, observable perception, and physics phenomena) to improve the quality of the synthetic data. To validate the effectiveness of our data augmentation techniques, we apply them to solve a subsurface seismic full-waveform inversion using simulated CO 2 leakage data. Our interest is to invert for subsurface velocity models associated with very small CO 2 leakage. We validate the performance of our methods using comprehensive numerical tests. Here via comparison and analysis, we show that data-driven seismic imaging can be significantly enhanced by using our data augmentation techniques. Particularly, the imaging quality has been improved by 15% in test scenarios of general-sized leakage and 17% in small-sized leakage when using an augmented training set obtained with our techniques.

58 GEOSCIENCES↗

DOE OSTI2025

Identification of short-range ordering motifs in semiconductors

Chemical short-range ordering is expected to be a key factor for tuning the electronic structure of semiconductors. However, experimental evidence of short-range ordering is still lacking due to the challenge of characterizing atomic-scale ordering motifs. Here, we determined the presence of short-range order in a ternary GeSiSn semiconductor system using advanced energy-filtered four-dimensional scanning transmission electron microscopy and large-scale atomistic models generated by a machine learning neuroevolution potential of first-principles accuracy. This approach revealed preferred ordering of different atomic species with the dominant occurrence of Si–Ge–Sn triplets. Our findings not only confirmed the presence of short-range order but also directly revealed the actual atomic structure, demonstrating the potential for informed atomic order–based band engineering as a third degree of freedom beyond composition and strain tuning.

Vogl, Lilian M. [University of California Berkeley↗

DOE OSTI2025

ProteinTuneRL

ProteinTuneRL is a framework designed to harness the power of reinforcement learning for advanced protein design. The project enables fine-tuning of generative models to explore and optimize protein sequences with tailored structural and functional properties.

Landajuela Larma, Mikel [Lawrence Livermore Nation↗

DOE OSTI2025

GAN-BH

Generative Modeling for Black Hole Astrophysics

Lim, Hyun [Los Alamos National Laboratory]↗

DOE OSTI2025

CalyxFlow

CalyxFlow is a lightweight agentic artificial intelligent workflow. This workflow demonstrates the use of AI LLMs to generate modeling and simulation inputs for a scientific simulation and manage execution and analysis of a suite of simulations.

Shipman, Galen↗

DOE OSTI2024

Diabatic Eddy Forcing Increases Persistence and Opposes Propagation of the Southern Annular Mode in MERRA-2

Abstract As a dominant mode of jet variability on subseasonal time scales, the Southern Annular Mode (SAM) provides a window into how the atmosphere can produce internal oscillations on longer-than-synoptic time scales. While SAM’s existence can be explained by dry, purely barotropic theories, the time scale for its persistence and propagation is set by a lagged interaction between barotropic and baroclinic mechanisms, making the exact physical mechanisms challenging to identify and to simulate, even in latest generation models. By partitioning the eddy momentum flux convergence in MERRA-2 using an eddy–mean flow interaction framework, we demonstrate that diabatic processes (condensation and radiative heating) are the main contributors to SAM’s persistence in its stationary regime, as well as the key for preventing propagation in this regime. In SAM’s propagating regime, baroclinic and diabatic feedbacks also dominate the eddy–jet feedback. However, propagation is initiated by barotropic shifts in upper-level wave breaking and then sustained by a baroclinic response, leading to a roughly 60-day oscillation period. This barotropic propagation mechanism has been identified in dry, idealized models, but here we show evidence of this mechanism for the first time in reanalysis. The diabatic feedbacks on SAM are consistent with modulation of the storm-track latitude by SAM, altering the emission temperature and cloud cover over individual waves. Therefore, future attempts to improve the SAM time scale in models should focus on the storm-track location, as well as the roles of the cloud and moisture parameterizations. Significance Statement As they circumnavigate the planet, the tropospheric jet streams slowly drift north and south over about 30 days, longer than the normal limit of weather prediction. Understanding the source of this “memory” could improve our knowledge of how the atmosphere organizes itself and our ability to make long-term forecasts. Current theories have identified several possible internal atmospheric interactions responsible for this memory. Yet most of the theories for understanding the jets’ behavior assume that this behavior is only weakly influenced by atmospheric water vapor. We show that this assumption is not enough to understand jet persistence. Instead, clouds and precipitation are more important contributors in reanalysis data than internal “dry” mechanisms to this memory of the Southern Hemisphere jet.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

The Essential Role of Westerly Wind Bursts in ENSO Dynamics and Extreme Events Quantified in Model “Wind Stress Shaving” Experiments

Abstract Westerly wind bursts (WWBs)—brief but strong westerly wind anomalies in the equatorial Pacific—are believed to play an important role in El Niño–Southern Oscillation (ENSO) dynamics, but quantifying their effects is challenging. Here, we investigate the cumulative effects of WWBs on ENSO characteristics, including the occurrence of extreme El Niño events, via modified coupled model experiments within Community Earth System Model (CESM1) in which we progressively reduce the impacts of wind stress anomalies associated with model-generated WWBs. In these “wind stress shaving” experiments we limit momentum transfer from the atmosphere to the ocean above a preset threshold, thus “shaving off” wind bursts. To reduce the tropical Pacific mean state drift, both westerly and easterly wind bursts are removed, although the changes are dominated by WWB reduction. As we impose progressively stronger thresholds, both ENSO amplitude and the frequency of extreme El Niño decrease, and ENSO becomes less asymmetric. The warming center of El Niño shifts westward, indicating less frequent and weaker eastern Pacific (EP) El Niño events. Removing most wind burst–related wind stress anomalies reduces ENSO mean amplitude by 22%. The essential role of WWBs in the development of extreme El Niño events is highlighted by the suppressed eastward migration of the western Pacific warm pool and hence a weaker Bjerknes feedback under wind shaving. Overall, our results reaffirm the importance of WWBs in shaping the characteristics of ENSO and its extreme events and imply that WWB changes with global warming could influence future ENSO.

Meteorology & Atmospheric Sciences↗