SEARCH · Engineering Papers

Results for “normalizing flows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2025

High-dimensional maximum-entropy phase space tomography

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the reconstruction, but it is typically infeasible in high-dimensional spaces. In this paper, I review two recent approaches to high-dimensional entropy maximization. The first approach utilizes differentiable simulations and a class of generative models known as normalizing flows, whereas the second approach employs the method of Lagrange multipliers and Markov Chain Monte Carlo (MCMC) sampling. My aim is to provide a short explanation of each method using a common notation. I conclude by mentioning several unsolved problems in phase space tomography.

Hoover, Austin [ORNL] (ORCID:0000000153136962)↗

DOE OSTI2025

Hierarchical Bayesian Modeling for Cosmology: Can NPE reliably replace MCMC?

Hierarchical neural posterior estimation has its place Hierarchical Bayesian Modeling (HBM) combined with MCMC algorithms has been shown to provide more robust and accurate inference for real-world phenomena in which nature takes a nested form. However, MCMC-based inference can be computationally expensive, and its performance often suffers for complex posterior geometries. These costs are especially pertinent for HBM. Studies have recently demonstrated the potential for a flexible, expressive, and amortized hierarchical neural posterior estimator (HNPE) built on Normalizing Flows. These studies have mostly been performed on simple datasets, or they focus on a single parameter from each level of the hierarchy. A systematic study analyzing how both hierarchical methods compare for more complex and realistic datasets is necessary before applying HNPE for scientific measurements. Here, we re-explore the theory behind HNPE and conduct comparative numerical experiments of HNPE and MCMC-based HBM methods on real and synthetic data, including strong gravitational lensing simulations. In particular, we use a suite of diagnostics to show trade-offs in terms of accuracy, precision, time to train or sample, reproducibility, and the need for expert domain knowledge. Especially for higher dimensional and complex posteriors, HNPE is expected to drastically improve on time for inference, accuracy, and precision with an upfront training time cost.

Hur, Rachel [Chicago U.] (ORCID:000900089890445X)↗

DOE OSTI2026

An Iterative Machine Learning Framework for Event Classification and Monte Carlo Tuning in SpinQuest

The E1039/SpinQuest experiment at Fermi National Accelerator Laboratory uses a 120~GeV proton beam from the Main Injector incident on transversely polarized proton and deuteron targets, using $NH_3$ and $ND_3$, respectively. In addition to measuring the Sivers asymmetry in Drell--Yan $pp$ and $pd$ scattering from sea quarks, SpinQuest will study transverse-spin effects, particularly the transverse single-spin asymmetry (TSSA) in $J/\psi$ production. The angular distributions from the $J/\psi$ decay could play an important role in understanding the gluon contribution to the proton spin structure. However, before extracting these angular distributions, it is necessary to isolate signal events originating from the target from events produced by other sources and from the combinatorial background. To effectively and accurately classify the target events, it is important to ensure that the simulated events are properly tuned to the experimental physics channels. We have introduced an iterative technique to match simulated and experimental events and to classify the physics channels using deep neural networks and a generative model based on normalizing flows.

Hossain, Forhad [Virginia U. (main)] (ORCID:000000↗

DOE OSTI2026

The DREAMS Project: Disentangling the Impact of Halo-to-Halo Variance and Baryonic Feedback on Milky Way Dark Matter Speed Distributions

Dark matter direct detection experiments require information about the local dark matter speed distribution to produce constraints on dark matter candidates, or infer their properties in the event of a discovery. In this paper, we analyze how the uncertainty in the dark matter speed distribution near the Sun is affected by baryonic feedback, halo-to-halo variance, and halo mass. To do so, we harness the statistical power of the new DREAMS cold dark matter simulation suite, which is comprised of 1024 zoom-in Milky Way–mass halos with varied initial conditions as well as cosmological and astrophysical parameters. Applying a normalizing flows emulator to these simulations, we find that the uncertainty in the local dark matter speed distribution is dominated by halo-to-halo variance and, to a lesser extent, uncertainty in host halo mass. Uncertainties in supernova and black hole feedback (from the IllustrisTNG model in this case) are negligible in comparison. Using the DREAMS suite, we present a state-of-the-art prediction for the dark matter speed distribution in the Milky Way. Although the standard halo model is contained within the uncertainty of this prediction, individual galaxies may have distributions that differ from it. Lastly, we apply our DREAMS results to the XENON1T experiment and demonstrate that the astrophysical uncertainties are comparable to the experimental ones, solidifying previous results in the literature obtained with a smaller sample of simulated Milky Way–mass halos.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Learning the generating functional for variance reduction in lattice QCD

The generating functional in quantum field theory provides the natural framework for constructing correlation functions as derivatives with respect to source operators. We present a methodology that leverages machine-learned normalizing flows to reduce the variance of arbitrary $N$-point correlation functions of bosonic operators in lattice gauge field theory calculations by encoding a representation of the generating functional. We show that it is possible to systematically approach noiseless estimators of correlation functions in this framework. We demonstrate this methodology with applications to calculations of glueball correlation functions and Wilson loops in Quantum Chromodynamics and Yang-Mills theory. The results show up to three orders of magnitude variance reduction.

Abbott, Ryan [Columbia U.] (ORCID:0000000258778005↗

DOE OSTI2026

Probabilistic Inference of Low-Surface-Brightness Galaxy Morphological Parameters Using Simulation-Based Inference

Low-surface-brightness galaxies (LSBGs) are diffuse, often dark-matter-dominated systems whose faintness makes their structural parameters difficult to measure reliably in wide-field imaging surveys. Robust parameter inference, including uncertainty quantification, is important for population studies and for comparisons with models of galaxy formation, as future surveys are expected to produce increasingly large samples of diffuse galaxies. In practice, LSBG profile modeling is sensitive to sky- background errors, masking choices, contaminating background sources, and the computational cost of obtaining posterior-level uncertainties for large samples. Motivated by these questions, we develop a simulation-based inference (SBI) framework for estimating posterior distributions of LSBG morphological parameters from simulated galaxy images. Using PyImfit, we generate DES-like single-Sersic profile LSBG images with known position angle, ellipticity, Sersic index, effective surface brightness, and effective radius. We then train a normalizing-flow-based neural posterior estimator using the sbi package to infer these parameters from the simulated images. For isolated simulated galaxies, the SBI posterior recovers the true input parameters, produces posterior predictive residuals consistent with the assumed noise model, and shows good empirical calibration in a DES-motivated test regime. We also compare SBI with PyImfit-based MCMC inference and find broadly comparable posterior constraints, while SBI enables substantially faster posterior sampling after training. Finally, we test robustness to compact background contaminants. A model trained only on isolated galaxies produces undercovered posteriors on contaminated images, whereas training on simulations with variable contaminant positions and fluxes improves calibration across contaminated test sets. These results demonstrate the promise of SBI for scalable, uncertainty-aware LSBG morphology inference, while emphasizing that posterior reliability strongly depends on whether training simulations include relevant observational complications.

Batbayar, Bilguun [U. Chicago (main)]↗

DOE OSTI2024

Anomaly detection with flow-based fast calorimeter simulators

Recently, several normalizing flow-based deep generative models have been proposed to accelerate the simulation of calorimeter showers. Using caloflow as an example, we show that these models can simultaneously perform unsupervised anomaly detection with no additional training cost. As a demonstration, we consider electromagnetic showers initiated by one (background) or multiple (signal) photons. The caloflow model is designed to generate single-photon showers, but it also provides access to the shower likelihood. We use this likelihood as an anomaly score and study the showers tagged as being unlikely. As expected, the tagger struggles when the signal photons are nearly collinear but is otherwise effective. This approach is complementary to a supervised classifier trained on only specific signal models using the same low-level calorimeter inputs. While the supervised classifier is also highly effective at unseen signal models, the unsupervised method is more sensitive in certain regions, and, thus, we expect that the ultimate performance will require a combination of these approaches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Multi-head physics-informed neural networks for learning functional priors and uncertainty quantification

In numerous applications, the integration of prior knowledge and historical information is essential, particularly for tasks requiring the solution of ordinary or partial differential equations (ODEs/PDEs) in data-sparse or noisy environments. For instance, achieving accurate solutions to time-dependent PDEs with limited initial condition measurements necessitates an effective strategy for embedding prior knowledge. Hard-parameter sharing architectures in neural networks (NNs) have demonstrated success in both traditional and scientific machine learning domains, facilitating the learning of informative representations. Here, in this study, we introduce a novel, yet efficient, method to enhance physics-informed neural networks (PINNs) by incorporating a multi-head structure that enables the learning of functional priors from both empirical data and governing physical laws. This prior information can then be used to address data sparsity and high-level noise in solving ODE/PDE problems with uncertainty quantification (UQ). The approach, termed Multi-Head PINN (MH-PINN), consists of a shared body NN and multiple head NNs, each corresponding to an individual PINN instance. Our framework for functional prior learning is carried out in two stages: (1) training the MH-PINNs to develop a shared body NN alongside multiple head NNs, and (2) employing these trained head NNs to estimate a prior distribution through a normalizing flow-based density estimator. The learned functional prior can then be applied as a regularization mechanism in deterministic contexts or as an informative prior within a Bayesian inference framework, aiding in the resolution of subsequent ODE/PDE tasks. We evaluate the efficacy of MH-PINNs across five benchmark problems, including a high-dimensional parametric PDE, all characterized by data sparsity or substantial noise levels. Our findings reveal that MH-PINNs deliver accurate solutions and robust UQ, demonstrating adaptability across a range of complex and challenging scenarios.

Bayesian inference↗

DOE OSTI2026

A Full-Induction Magnetohydrodynamics Solver for Liquid Metal Fusion Blankets in Vertex-CFD

Multiphysics modeling of liquid metal fusion blankets, which produce tritium and convert energy of neutrons created via fusion reactions into heat, is crucial for predicting performance, ensuring structural integrity, and optimizing energy production. While traditional blanket modeling of liquid metal flows during normal steady operating conditions commonly employs the inductionless approximation of the magnetohydrodynamics (MHD) equations, transient scenarios, when the plasma-confining magnetic field varies on millisecond time scales, require a full-induction MHD approach that dynamically evolves the magnetic field via the time-dependent induction equation. This paper presents the formulation, implementation, and initial verification of a full-induction MHD solver integrated within the open-source Vertex-CFD framework, which aims to achieve tight multiphysics coupling, a flexible software design enabling easy extension and addition of physics models, and performance portability across computing platforms. The solver utilizes finite element spatial discretization, implicit Runge–Kutta time integration, and an inexact Newton method to solve the resulting discrete nonlinear system, leveraging Trilinos packages for efficient computation. Verification against selected benchmark problems demonstrates accuracy and robustness of the solver. Furthermore, when the solver is applied to an idealized blanket model in 2.5D and full 3D, results obtained with Vertex-CFD are in good agreement with recently published quasi-2D simulations. These findings establish a computational foundation for future simulations of transient MHD phenomena in liquid metal blankets with Vertex-CFD, and open avenues for future extensions and performance optimizations.

Endeve, Eirik [ORNL] (ORCID:0000000312519507)↗

DOE OSTI2024

Validation of the stochastic inversion algorithm for acoustic travel-time tomography: a large eddy simulation study

Acoustic tomography (AT) is explored as a remote sensing technique to obtain instantaneous snapshots of temperature and velocity fluctuations for wind energy applications. This study integrates Large Eddy Simulation (LES) with the Stochastic Inversion (SI) method to validate the algorithm’s capacity for accurate reconstruction of atmospheric fluctuations. The initial findings demonstrate the efficacy of the method in accurately capturing the predominant flow structures. Normalized L2 error evaluations further inform the algorithm’s precision, with errors accentuated in less sampled peripheral regions. The results underscore the method’s promise as a non-intrusive observational tool, with ongoing development poised to improve its precision and reliability.

17 WIND ENERGY↗

DOE OSTI2025

Characterizing falling particle curtain receivers at commercially relevant scales: Research Performance Progress Report (RPPR-1)

Sandia will construct a cold flow receiver test platform in order to characterize falling particle curtain receivers at commercially relevant scales. While Sandia has extensive experience in R&D of falling particle curtain receivers, most have been at pilot scale and smaller - on the order of 1 MW th with characteristic dimensions of nominally 1-2 m to adequately collect solar energy from the heliostat field at the National Solar Thermal Test Facility (NSTTF). However, scaling up receivers to commercially relevant scales (25 MW th and above) will require a thorough understanding of particle curtain dynamics at larger scales, especially longer drop heights, for design certainty. The goal of this project will be to construct a cold falling particle curtain test rig capable of simulating particle characteristics that are expected in a commercial scale CSP plant, namely the drop height, curtain thickness, and particle mass flow rate (normalized by length of curtain). This will enable data collection on curtain opacity and spread, both of which are correlated to receiver efficiency and reliable construction, for commercially relevant scales. It will also permit validation of numerical models that will enable detailed receiver characterization and design past currently validated scales.

14 SOLAR ENERGY↗

DOE OSTI2025

Characterizing falling particle curtain receivers at commercially relevant scales: Research Performance Progress Report (RPPR-1)

Sandia will construct a cold flow receiver test platform in order to characterize falling particle curtain receivers at commercially relevant scales. While Sandia has extensive experience in R&D of falling particle curtain receivers, most have been at pilot scale and smaller - on the order of 1 MWth with characteristic dimensions of nominally 1-2 m to adequately collect solar energy from the heliostat field at the National Solar Thermal Test Facility (NSTTF). However, scaling up receivers to commercially relevant scales (25 MWth and above) will require a thorough understanding of particle curtain dynamics at larger scales, especially longer drop heights, for design certainty. The goal of this project will be to construct a cold falling particle curtain test rig capable of simulating particle characteristics that are expected in a commercial scale CSP plant, namely the drop height, curtain thickness, and particle mass flow rate (normalized by length of curtain). This will enable data collection on curtain opacity and spread, both of which are correlated to receiver efficiency and reliable construction, for commercially relevant scales. It will also permit validation of numerical models that will enable detailed receiver characterization and design past currently validated scales.

14 SOLAR ENERGY↗

DOE OSTI2024

Mechanical and Thermal Forcing for Upslope Flows and Cumulus Convection over the Sierras de Córdoba

Abstract The upslope flow processes affecting the vertical extent of orographic cumulus convection are examined using observations from the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign. Specifically, clear air returns from the U.S. Department of Energy (DOE) second-generation C-band scanning Atmospheric Radiation Measurement (ARM) precipitation radar (CSAPR2) are used to characterize the structure and variability of the ridge-normal (i.e., up/downslope) flow components, which transport mass to the crest of Argentina’s Sierras de Córdoba and contribute to convective initiation. Data are compiled for the entire CACTI period (October–April), including days with clear skies, shallow cumuli, cumulus congestus, and deep convection. To examine shared variability among >70 000 radar scans, we use (i) a principal component analysis (PCA) to isolate modes of variability in the upslope flow and (ii) composite analysis based on convective outcomes, determined from GOES-16 satellite observations. These data are contextualized with observed surface sensible heat fluxes, thermodynamic profiles, and synoptic-scale analysis. Results indicate distinct thermally and mechanically forced upslope flow modes, modulated by diurnal heating and synoptic-scale variations, respectively. In some instances, there is a superposition of thermal and mechanical forcing, yielding either deeper or shallower upslope flow. The composite analyses based on satellite data show that successively deeper convective outcomes are associated with successively deeper upslope flow layers that more readily transport mass to the ridge crest in conjunction with lower lifting condensation levels, facilitating convective initiation. These results help to isolate the forcing mechanisms for orographic convection and thus provide a foundation for parameterizing orographic convective processes in coarse resolution models.

Meteorology & Atmospheric Sciences↗

DOE OSTI2026

Velocity-space Origins of the Pressure–Strain Interaction in Multipopulation Distributions and Its Application to Magnetic Reconnection

A forefront research question is how energy evolves in weakly collisional plasmas for which departures from local thermodynamic equilibrium (LTE) are significant. The standard approach is studying the terms in the non-LTE energy evolution equation derived by taking the second moment of the Boltzmann equation, but the resultant fluid metrics do not retain information about which particles at which velocities drive energy evolution. A widely studied channel for internal energy density evolution is the pressure–strain interaction. Here, we employ the kinetic pressure–strain, a phase-space diagnostic whose velocity-space integral recovers the pressure–strain interaction to disambiguate the contributions to the pressure–strain interaction from disparate particle populations in composite phase-space densities. We develop phase-space analogs of the pressure–strain interaction decompositions to provide the phase-space origins of normal versus sheared flow. We introduce the “kinetic strain-rate” tensor, the phase-space analog of the strain-rate tensor, which we argue is needed to interpret the phase-space origins of the pressure–strain interaction. To demonstrate the utility of these quantities, we investigate them for composite electron distributions near the electron diffusion region in two-dimensional particle-in-cell simulations of antiparallel symmetric magnetic reconnection. We find that the phase-space-based diagnostics isolate the roles of distinct populations. These results contribute to a growing body of work providing new methods for quantifying phase-space energy evolution for a broad array of processes, from magnetic reconnection to collisionless shocks and turbulence, opening new pathways for answering longstanding problems of particle energization in weakly collisional plasmas.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Particle removal from a flat surface using a translating bounded vortex flow

A bounded vortex flow is a hydrodynamic approach for removal of particles from a surface without scattering the particles onto nearby surfaces. The bounded vortex flow field is generated by a nozzle that combines azimuthally tilted jets arranged in a circular pattern and a central suction port. When the nozzle face is directed toward an ‘impingement surface’, the flow develops a wall-normal intake vortex below the suction outlet, which causes high shear stress on the impingement surface. When particles are present on the impingement surface, the high shear stress causes particles to roll along the surface and to be lifted off the surface and transported up the core of the wall-normal vortex into the suction outlet. In typical applications, the nozzle would be translated along the impingement surface to clean particles from the surface. The current paper reports on an experimental study of the effect of nozzle translation on the effectiveness of the bounded vortex flow field for particle mitigation. The effectiveness of particle mitigation was examined as a function of flow rate through the nozzle, particle size, and nozzle translation velocity relative to the impingement surface. As a result, numerical computations are used to relate the flow rate to the maximum shear stress on the impingement surface, which is then used to theoretically predict onset of particle motion.

42 ENGINEERING↗

DOE OSTI2024

High-Order Wall-Modeled Large-Eddy Simulation of High-Lift Configuration

This paper presents the assessment of several recent enhancements for a high-order wall-modeled large-eddy simulation (WMLES) approach and demonstrates order independence with a fixed data exchange location in the wall model. The two enhancements include the use of isotropic tetrahedral elements to improve accuracy and an explicit subgrid-scale model, the Vreman model, to improve accuracy and robustness. The [Formula: see text] study focused on the high-lift Common Research Model (HL-CRM) at the angle of attack of 19.57 deg, a benchmark problem from the 4th AIAA High-Lift Prediction Workshop. Solution polynomial orders of [Formula: see text], and 5 were used in the study. The study demonstrated [Formula: see text] independence in integrated forces, pitch moment, velocity profile in the wall-normal direction, and surface flow topology. It also showed that a [Formula: see text] order of at least 3 ([Formula: see text]) was needed to correctly predict the external inviscid flow and the surface flow topology. Thereafter, [Formula: see text] simulations over several other angles of attack demonstrated that the high-order WMLES approach can correctly predict the maximum lift and flow separation regions for HL-CRM with about 40 million degrees of freedom (DOF) compared to at least 250 million DOF required by second-order methods.

Engineering↗

DOE OSTI2025

Experimental and theoretical evidence of universality in superfluid vortex reconnections

The minimum separation between reconnecting vortices in fluids and superfluids obeys a universal scaling law with respect to time. The prereconnection and the postreconnection prefactors of this scaling law are different, a property related to irreversibility and to energy transfer and dissipation mechanisms. In the present work, we determine the temperature dependence of these prefactors in superfluid helium from experiments and a numeric model which fully accounts for the coupled dynamics of the superfluid vortex lines and the thermal normal fluid component. At all temperatures, we observe a pre- and postreconnection asymmetry similar to that observed in other superfluids and in classical viscous fluids, indicating that vortex reconnections display a universal behavior independent of the small-scale regularizing dynamics. We also numerically show that each vortex reconnection event represents a sudden injection of energy in the normal fluid. Finally we argue that in a turbulent flow, these punctuated energy injections can sustain the normal fluid in a perturbed state, provided that the density of superfluid vortices is large enough.

Reconnections↗

DOE OSTI2026

Near-Real-Time Statistical Analysis and Visualization of Streamflow from a Deep-Learning Rainfall-Runoff Model

Near-real-time (NRT) streamflow data are critical importance for timely water resources management. Here, we developed an open-source tool, FlowStats, for NRT streamflow analysis and visualization in Germany, based on NRT meteorological data from the German Weather Service and simulated streamflow from a long short-term memory neural network (LSTM). The LSTM model achieved very good overall performance, median NSE of 0.80 for the test period across 1,479 catchments. FlowStats provides options for deriving various streamflow statistics, from normal and abnormal streamflow detection to drought and flood analyses. An example analysis from FlowStats revealed widespread below-normal to extreme low-flow conditions across Germany from March to May 2025, which weakened from June to September 2025. Drought analysis for September 2025 highlighted severe to extreme drought conditions in northwestern Germany, while flood classifications indicated that high-flow events occurred in southwestern Germany. FlowStats can be used for various hydrological assessments to support water resources management.

Hydrological modeling↗