Engineering PapersSearch

SEARCH · Engineering Papers

Results for “ensembles”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence

Observable-projected ensembles

Measurements in many-body quantum systems can generate non-trivial phenomena, such as preparation of long-range entangled states, dynamical phase transitions, or measurement-altered criticality. Here, we introduce a new measurement scheme that produces an ensemble of mixed states in a subsystem, obtained by measuring a local Hermitian observable on part of its complement. We refer to this as the observable-projected ensemble . Unlike standard projected ensembles-where pure states are generated by projective measurements on the complement-our approach involves projective partial measurements of specific observables. This setup has two main advantages: theoretically, it is amenable to analytical computations, especially within conformal field theories. Experimentally, it requires only a linear number of measurements, rather than an exponential one, to probe the properties of the ensemble. As a first step in exploring the observable-projected ensemble, we investigate its entanglement properties in conformal field theory and perform a detailed analysis of the free compact boson.

Milekhin, Alexey [California Institute of Technolo

CO 2 storage site characterization using ensemble-based approaches with deep generative models

Estimating spatially distributed properties such as permeability from available sparse measurements is a great challenge in efficient subsurface CO 2 storage operations. In this paper, a deep generative model that can accurately capture complex subsurface structure is tested with an ensemble-based inversion method for accurate and accelerated characterization of CO 2 storage sites. We chose Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) for its realistic reservoir property representation and Ensemble Smoother with Multiple Data Assimilation (ES-MDA) for its robust data fitting and uncertainty quantification capability. WGAN-GP are trained to generate high-dimensional permeability fields from a low-dimensional latent space and ES-MDA then updates the latent variables by assimilating available measurements. Several subsurface site characterization examples including Gaussian, channelized, and fractured reservoirs are used to evaluate the accuracy and computational efficiency of the proposed method and the main features of the unknown permeability fields are characterized accurately with reliable uncertainty quantification. Furthermore, the estimation performance is compared with a widely-used variational, i.e., optimization-based, inversion approach, and the proposed approach outperforms the variational inversion method in several benchmark cases. We explain such superior performance by visualizing the objective function in the latent space: because of nonlinear and aggressive dimension reduction via generative modeling, the objective function surface becomes extremely complex while the ensemble approximation can smooth out the multi-modal surface during the minimization. This suggests that the ensemble-based approach works well over the variational approach when combined with deep generative models at the cost of forward model runs unless convergence-ensuring modifications are implemented in the variational inversion.

42 ENGINEERING

Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

Ensemble-based simulation and learning (ESnL) has long been used in hydrology for parameter inference, but computational demands of process-based ESnL can be quite high. To address this issue, we propose a deep neural operator learning approach. Neural operators are generic machine learning algorithms that can learn functional mappings between infinite-dimensional spaces, providing a highly flexible tool for scientific machine learning. Our approach is built upon DeepONet, a specific deep neural operator, and is designed to address several common problems in hydrology, namely, model parameter estimation, prediction at ungaged locations, and uncertainty quantification. Here we demonstrate the effectiveness of our DeepONet-based workflow using an existing large model ensemble created for an eastern U.S. watershed that is instrumented with 10 streamflow gages. Results suggest DeepONet achieves high efficiency in learning an ML surrogate model from the model ensemble, with the modified Kling-Gupta Efficiency exceeding 0.9 on holdout test sets. Parameter inference, carried out using the trained DeepONet surrogate model and genetic algorithm, also yields robust results. Additionally, we formulate and train a separate DeepONet model for physics-informed, seq-to-seq streamflow forecasting, which further reduces biases in the pre-trained DeepONet surrogate model. While this study focuses primarily on a single watershed, our approach is general and may be extended to enable learning from model ensembles across multiple basins or models. Thus, this research represents a significant contribution to the application of hybrid machine learning in hydrology.

54 ENVIRONMENTAL SCIENCES

The Importance of an Ensemble Approach for Modeling Aerosol‐Convection Interactions

Aerosol-convection interactions modulate cloud microphysics, thermodynamics, and updraft intensity, contributing to climate-scale aerosol-radiative forcing. However, quantifying aerosol indirect effects in mixed-phase deep convection remains challenging due to uncertainties in parameterized physics and initial conditions driving nonlinear evolution of convective processes. This study investigates the convective updraft sensitivity to random initial temperature perturbations using an idealized ensemble modeling framework informed by in situ thermodynamic and aerosol observations from the DOE TRACER field campaign. We analyze the impact of small-scale initial perturbations on updraft velocity and supersaturation, and determine the ensemble size required to minimize stochastic internal variability. Results show that minor thermodynamic perturbations can produce updraft variability comparable to aerosol-induced changes reported in prior work. An ensemble of 10 members sufficiently reduces variability, enabling robust investigation of aerosol-related updraft invigoration and informing the design of future ensemble-based aerosol-convection interaction studies in environments with significant spatiotemporal mesoscale thermodynamic and aerosol heterogeneity.

aerosol-convection interactions

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data

Portable, heterogeneous ensemble workflows at scale using libEnsemble

libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator–simulator–allocator paradigm, where generators produce input for simulators, simulators evaluate those inputs, and allocators decide whether and when a simulator or generator should be called. The generator steers the ensemble based on simulation results. Generators may, for example, apply methods for numerical optimization, machine learning, or statistical calibration. libEnsemble communicates between a manager and workers. Flexibility is provided through multiple manager–worker communication substrates each of which has different benefits. These include Python’s multiprocessing, mpi4py, and TCP. Multisite ensembles are supported using Balsam or Globus Compute. We overview the unique characteristics of libEnsemble as well as current and potential interoperability with other packages in the workflow ecosystem. We highlight libEnsemble’s dynamic resource features: libEnsemble can detect system resources, such as available nodes, cores, and GPUs, and assign these in a portable way. These features allow users to specify the number of processors and GPUs required for each simulation; and resources will be automatically assigned on a wide range of systems, including Frontier, Aurora, and Perlmutter. Such ensembles can include multiple simulation types, some using GPUs and others using only CPUs, sharing nodes for maximum efficiency. We also describe the benefits of libEnsemble’s generator–simulator coupling, which easily exposes to the user the ability to cancel, and portably kill, running simulations based on models that are updated with intermediate simulation output. We demonstrate libEnsemble’s capabilities, scalability, and scientific impact via a Gaussian process surrogate training problem for the longitudinal density profile at the exit of a plasma accelerator stage. In conclusion, the study uses gpCAM for the surrogate model and employs either Wake-T or WarpX simulations, highlighting efficient use of resources that can easily extend to exascale.

Dynamic ensembles

Boundary-induced classical generalized Gibbs ensemble with angular momentum

We investigate how confinement geometry leads to the emergence of a Generalized Gibbs Ensemble (GGE) in classical systems. Unlike the standard Gibbs ensemble, the GGE includes additional conserved quantities, such as angular momentum, that arise from boundary-induced symmetries. Using analytical arguments based on the maximum entropy principle, we show that circular boundaries preserve angular momentum and drive the system toward a chiral, non-ergodic GGE that violates time-reversal symmetry. This ensemble differs fundamentally from the Gibbs case, producing near-boundary condensation and revealing how geometry alone can alter thermal equilibration. To quantify these effects, we introduce an order parameter measuring deviations from Gibbs behavior and demonstrate that conventional Monte Carlo methods must incorporate angular momentum conservation under such conditions. Our study highlights how geometric constraints shape non-equilibrium statistical ensembles and lead to subtle departures from the Bohr-van Leeuwen theorem. These predictions are validated through detailed simulations of confined classical hard-disk gases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC

Production of High Yield, Ultra‐Shallow Nitrogen‐Vacancy Centre Ensembles Through High Purity Forming gas Annealing

Dense, ultra‐shallow (<10 nm from the surface) ensembles of nitrogen‐vacancy (NV) centers in diamond are sought‐after for realising practical quantum sensing at the nanoscale. However, these ensembles typically suffer from reduced NV creation efficiency and spin coherence compared to their deeper and bulk counterparts. Consequently, most demonstrations in the literature to date have been restricted to using single NV centers with atypical coherence and charge stability properties not achievable across entire ensembles. Here, in this work, we demonstrate that controlled annealing in a high purity forming gas atmosphere improves near‐surface NV formation efficiency to over 20%. This environment preserves a high quality hydrogen termination throughout the anneal, avoiding material etching over many hours at temperatures up to 1100°C and possibly helping to suppress vacancy out‐diffusion. We show that high temperature annealing is especially vital for improving spin properties in high density, ultra‐shallow implanted samples due to the localised damage profiles produced. By allowing the formation of high yield NV ensembles with improved spin properties, the optimised forming gas anneal can facilitate the reliable production of more sensitive diamond sensors than have previously been accessible.

Healey, Alexander J. [Royal Melbourne Institute of

A novel conditional generative model for efficient ensemble forecasts of state variables in large-scale geological carbon storage

Integrating monitoring data to efficiently update reservoir pressure and CO 2 plume distribution forecasts presents a significant challenge in geological carbon storage (GCS) applications. Inverse modeling techniques are commonly used to fuse observational data and refine reservoir model parameters, thereby improving state variable forecasts. However, these techniques often rely on linear or Gaussian assumptions, which can limit their effectiveness in accurately predicting state variables. Moreover, simulating large-scale three-dimensional (3D) GCS problems is computationally expensive, making iterative runs in inverse problems prohibitive. To address these challenges, we propose a conditional generative model utilizing the score-based diffusion method for real-time 3D pressure and saturation field distribution predictions. Our approach involves solving the score function with a mini-batch-based Monte Carlo estimator to generate labeled data. This data is subsequently employed to train a fully connected neural network, enabling it to learn the conditional sample generator within a supervised learning framework. This method enables the rapid generation of a large ensemble of predictions, facilitating comprehensive uncertainty quantification of state variables. Here we applied our method to forecast the dynamic 3D distributions of pressure and saturation fields over a 30-year injection period. The statistical assessment with low root mean square error (RMSE) values demonstrates that our method can accurately predict the spatiotemporal distributions of both pressure and saturation fields. Moreover, the developed conditional generative model shows high computational efficiency by generating 100 ensemble forecasts of 3D state variables in less than 10 min. The consistency between ensemble averages and ground truth values further illustrates the model’s capability to capture state variable dynamics during the CO 2 plume injection process. Notably, the ground truth values fall within the ensemble forecasts, indicating that our uncertainty quantification effectively captures variability and potential noise in the observations. Thus, the developed conditional generative model proves to be a more efficient, accurate, and practical tool for GCS applications, facilitating timely risk analysis and informed decision-making.

58 GEOSCIENCES

Determining the Ensemble N -Representability of Reduced Density Matrices

The N-representability problem for reduced density matrices remains a fundamental challenge in electronic structure theory. Following our previous work that employs a unitary-evolution algorithm based on an adaptive derivative-assembled pseudo-Trotter variational quantum algorithm to probe pure-state N-representability of reduced density matrices [J. Chem. Theory Comput. 2024, 20, 9968], in this work we propose a practical framework for determining the ensemble N-representability of a p-body matrix. This is accomplished using a purification strategy that embeds an ensemble state into a pure state defined on an extended Hilbert space, such that the reduced density matrices of the purified state reproduce those of the original ensemble. By iteratively applying variational unitaries to an initial purified state, the proposed algorithm minimizes the Hilbert-Schmidt distance between its p-body reduced density matrix and a specified target p-body matrix, which serves as a measure of the N-representability of the target. This methodology facilitates both error correction of defective ensemble reduced density matrices and quantum-state reconstruction on a quantum computer, offering a route for density-matrix refinement. We validate the algorithm with numerical simulations on systems of two, three, and four electrons in both simple models as well as molecular systems at finite temperature, demonstrating its robustness.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Evaluating Extreme Storm Events in an Ensemble of High‐Resolution Projections

This study uses different downscaling techniques and reference observations to investigate the characteristics of extreme storm events over the conterminous United States in historical and a projected future scenario. While previous studies agree on the projected changes in intensity and frequency of precipitation extremes, there is a lack of consensus regarding how their size will change in response to an increase in radiative forcing. Moreover, the influence of different downscaling techniques on their characteristics has not been thoroughly examined. This study employs an ensemble of high‐resolution projections derived from six CMIP6 GCMs, using dynamical, statistical and artificial intelligence based downscaling techniques and two reference observations. Overall, we find noticeable differences in the size, average depth, and total precipitation volume of these storms among the climate ensembles in the historical period. Despite these differences in the historical period, we find consistent future changes across various ensembles. We find a robust projected increase in storm size during Winter and Spring but a decrease in size during Summer in the East. Nevertheless, irrespective of changes in their size, extreme storms are projected to intensify across all the ensembles and seasons.

Rastogi, Deeksha [Oak Ridge National Laboratory (O

Ligand efficacy shifts a nuclear receptor conformational ensemble between transcriptionally active and repressive states

Abstract Nuclear receptors (NRs) are thought to dynamically alternate between transcriptionally active and repressive conformations, which are stabilized upon ligand binding. Most NR ligand series exhibit limited bias, primarily consisting of transcriptionally active agonists or neutral antagonists, but not repressive inverse agonists—a limitation that restricts understanding of the functional NR conformational ensemble. Here, we report a NR ligand series for peroxisome proliferator-activated receptor gamma (PPARγ) that spans a pharmacological spectrum from repression (inverse agonism) to activation (agonism) where subtle structural modifications switch compound activity. While crystal structures provide snapshots of the fully repressive state, NMR spectroscopy and conformation-activity relationship analysis reveals that compounds within the series shift the PPARγ conformational ensemble between transcriptionally active and repressive conformations that are natively populated in the apo/ligand-free ensemble. Our findings reveal a molecular framework for minimal chemical modifications that enhance PPARγ inverse agonism and elucidate their influence on the dynamic PPARγ conformational ensemble.

Science & Technology - Other Topics

Inverse design of photonic surfaces via multi fidelity ensemble framework and femtosecond laser processing

We demonstrate a multi-fidelity (MF) machine learning ensemble framework for the inverse design of photonic surfaces, trained on a dataset of 11,759 samples that we fabricate using high throughput femtosecond laser processing. The MF ensemble combines an initial low fidelity model for generating design solutions, with a high fidelity model that refines these solutions through local optimization. The combined MF ensemble can generate multiple disparate sets of laser-processing parameters that can each produce the same target input spectral emissivity with high accuracy (root mean squared errors < 2%). SHapley Additive exPlanations analysis shows transparent model interpretability of the complex relationship between laser parameters and spectral emissivity. Finally, the MF ensemble is experimentally validated by fabricating and evaluating photonic surface designs that it generates for improved efficiency energy harvesting devices. Our approach provides a powerful tool for advancing the inverse design of photonic surfaces in energy harvesting applications.

97 MATHEMATICS AND COMPUTING

Spin squeezing in an ensemble of nitrogen–vacancy centres in diamond

Spin-squeezed states provide a seminal example of how the structure of quantum mechanical correlations can be controlled to produce metrologically useful entanglement. These squeezed states have been demonstrated in a wide variety of quantum systems ranging from atoms in optical cavities to trapped ion crystals. By contrast, despite their numerous advantages as practical sensors, spin ensembles in solid-state materials have yet to be controlled with sufficient precision to generate targeted entanglement such as spin squeezing. Here we report the experimental demonstration of spin squeezing in a solid-state spin system. Our experiments are performed on a strongly interacting ensemble of nitrogen–vacancy colour centres in diamond at room temperature, and squeezing (−0.50 ± 0.13 dB) below the noise of uncorrelated spins is generated by the native magnetic dipole–dipole interaction between nitrogen–vacancy centres. To generate and detect squeezing in a solid-state spin system, we overcome several challenges. First, we develop an approach, using interaction-enabled noise spectroscopy, to characterize the quantum projection noise in our system without directly resolving the spin probability distribution. Second, noting that the random positioning of spin defects severely limits the generation of spin squeezing, we implement a pair of strategies aimed at isolating the dynamics of a relatively ordered sub-ensemble of nitrogen–vacancy centres. Furthermore, our results open the door to entanglement-enhanced metrology using macroscopic ensembles of optically active spins in solids.

Atomic and molecular physics

Spin squeezing of macroscopic nuclear spin ensembles

Spin squeezing has been explored in atomic systems as a tool for quantum sensing, improving experimental sensitivity beyond the spin standard quantum limit for certain measurements. To optimize absolute metrological sensitivity, it is beneficial to consider macroscopic spin ensembles, such as nuclear spins in solids and liquids. Coupling a macroscopic spin ensemble to a parametrically-modulated resonant circuit can create collective spin squeezing by generating spin correlations mediated by the circuit. We analyze the squeezing dynamics in the presence of decoherence and finite spin polarization, showing that achieving 7 dB spin squeezing is feasible in several nuclear spin systems. The metrological benefit of squeezing a macroscopic spin ensemble lies in the suppression of technical noise sources in the spin detection system relative to the spin projection noise. This expands the experimental sensitivity bandwidth when searching for signals of unknown frequency and can improve the resonant signal-to-noise ratio. Squeezing macroscopic spin ensembles may prove to be a useful technique for fundamental physics experiments aimed at detecting spin interactions with oscillating background fields, such as ultralight dark matter. Published by the American Physical Society 2025

Boyers, Eric

Ensemble Simulations on Leadership Computing Systems

Scientific productivity can be enhanced through workflow management tools, relieving large High Performance Computing (HPC) system users from the tedious tasks of scheduling and designing the complex computational execution of scientific applications. This paper presents a study on the usage of ensemble workflow tools to accelerate science using the Summit and Frontier supercomputing systems. The research aims to connect science domain simulations using Oak Ridge Leadership Computing Facility (OLCF) supercomputing platforms with ensemble workflow methods in order to accelerate HPC-enabled discovery and boost scientific impact. We present the coupling, porting and optimization of Radical-Cybertools on three applications: Chroma, NAMD and LAMMPS. The tools augment traditional HPC monolithic runs with a pilot scheduler. Lessons-learned are discussed for physics, biology and materials science applications. We discuss intrinsic limitations of coupling and porting ensemble workflow tools to applications that run on large HPC systems. The origins of technical challenges and their solutions developed during the implementation process are discussed. Data management strategies, OLCF’s policies for ensembles, and natively supported workflow tools are also summarized.

Georgiadou, Antigoni [ORNL] (ORCID:000000020977631