Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗

Spin squeezing of macroscopic nuclear spin ensembles

Spin squeezing has been explored in atomic systems as a tool for quantum sensing, improving experimental sensitivity beyond the spin standard quantum limit for certain measurements. To optimize absolute metrological sensitivity, it is beneficial to consider macroscopic spin ensembles, such as nuclear spins in solids and liquids. Coupling a macroscopic spin ensemble to a parametrically-modulated resonant circuit can create collective spin squeezing by generating spin correlations mediated by the circuit. We analyze the squeezing dynamics in the presence of decoherence and finite spin polarization, showing that achieving 7 dB spin squeezing is feasible in several nuclear spin systems. The metrological benefit of squeezing a macroscopic spin ensemble lies in the suppression of technical noise sources in the spin detection system relative to the spin projection noise. This expands the experimental sensitivity bandwidth when searching for signals of unknown frequency and can improve the resonant signal-to-noise ratio. Squeezing macroscopic spin ensembles may prove to be a useful technique for fundamental physics experiments aimed at detecting spin interactions with oscillating background fields, such as ultralight dark matter. Published by the American Physical Society 2025

Boyers, Eric↗

Pairing a Global Optimization Algorithm with EXAFS to Characterize Lanthanide Structure in Solution

Ensemble-average sampling of structures from ab initio molecular dynamics (AIMD) simulations can be used to predict theoretical extended X-ray absorption fine structure (EXAFS) signals that closely match experimental spectra. However, AIMD simulations are time-consuming and resource-intensive, particularly for solvated lanthanide ions, which often form multiple nonrigid geometries with high coordination numbers. Here, to accelerate the characterization of lanthanide structures in solution, we employed the Northwest Potential Energy Surface Search Engine (NWPEsSe), an adaptive-learning global optimization algorithm, to efficiently screen first-shell structures. As case studies, we examine two systems: Eu(NO 3 ) 3 dissolved in acetonitrile with a terpyridine ligand (terpyNO 2 ), and Nd(NO 3 ) 3 dissolved in acetonitrile. The theoretical spectra for structures identified by NWPEsSe were compared to both experimental and AIMD-derived EXAFS spectra. The NWPEsSe algorithm successfully identified the proper solvation structure for both Eu(NO 3 ) 3 (terpyNO 2 ) and Nd(NO 3 )(acetonitrile) 3 , with the calculated EXAFS signals closely matching the experimental spectra for the Eu-ligand complex and showing good similarity for the Nd salt; the better agreement with the ligand-containing structure is attributed to a less dynamic coordination environment due to the rigid ligand. The key advantage of the global optimization algorithm lies in its ability to sample the coordination environment across the potential energy surface and reduce the time required to identify structures from generally a month to within a week. Additionally, this approach is versatile and can be adapted to characterize main-group metal complexes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning with Gradient-Based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints

Gekko is an optimization suite in Python that solves optimization problems involving mixed-integer, nonlinear, and differential equations. The purpose of this study is to integrate common Machine Learning (ML) algorithms such as Gaussian Process Regression (GPR), support vector regression (SVR), and artificial neural network (ANN) models into Gekko to solve data based optimization problems. Uncertainty quantification (UQ) is used alongside ML for better decision making. These methods include ensemble methods, model-specific methods, conformal predictions, and the delta method. An optimization problem involving nuclear waste vitrification is presented to demonstrate the benefit of ML in this field. ML models are compared against the current partial quadratic mixture (PQM) model in an optimization problem in Gekko. GPR with conformal uncertainty was chosen as the best substitute model as it had a lower mean squared error of 0.0025 compared to 0.018 and more confidently predicted a higher waste loading of 37.5 wt% compared to 34 wt%. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches. Future works with these tools include expanding them with other regression models and UQ methods, and exploration into other optimization problems or dynamic control.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

GrainNN: A neighbor-aware long short-term memory network for predicting microstructure evolution during polycrystalline grain formation

High fidelity simulations of grain formation in alloys are an indispensable tool for process-to-mechanical-properties characterization. Such simulations, however, can be computationally expensive as they require fine spatial and temporal discretizations. Their cost becomes an obstacle to parametric studies and ensemble runs and ultimately makes downstream tasks like optimal control and uncertainty quantification challenging. To enable such downstream tasks, we introduce GrainNN, an efficient and accurate reduced-order model for epitaxial grain growth in additive manufacturing conditions. GrainNN is a sequence-to-sequence long-short-term-memory (LSTM) deep neural network that evolves the dynamics of manually crafted features. Its innovations are (1) an attention mechanism with grain-microstructure-specific transformer architecture; and (2) an overlapping combination of several clones of the network to generalize to grain configurations that are different from those used for training. This design enables GrainNN to predict grain formation for unseen physical parameters, grain number, domain size and geometry. Furthermore, GrainNN not only reconstructs the quantities of interest but also can be pointwise accurate. In our numerical experiments, we use a polycrystalline phase field method to both generate the training data and assess GrainNN. For multiparametric, ensemble simulations with many grains, GrainNN can be orders of magnitude faster than phase field simulations, while delivering 5%–15% pointwise error. Additionally, this speedup includes the cost of the phase field simulations for generating training data.

36 MATERIALS SCIENCE↗

Bias-Adjustment Methods for Future Subdaily Precipitation Extremes Consistent Across Durations

Model output from climate projections often requires bias-adjustment to compensate for systematic model errors. A bias-adjustment method for extreme precipitation intensity is proposed that preserves the scaling equation for different accumulation levels from hourly to daily, using intensity-duration-frequency (IDF) modeling. A validation is performed within a pseudo-reality setting, based on hourly precipitation from 28 regional climate model projections of the EURO-CORDEX ensemble over Belgium. The scaling-based adjustment methods improve upon previous methods, an optimal method is identified, and, analytical quantile mapping methods must be avoided due to three identified problems. The ensemble mean of the adjusted extreme precipitation intensity obeys the above-mentioned scale-invariance property, which is consistent with observed extreme intensities. We thus show that IDF modeling provides added value in the context of bias-adjustment, and, that the particular IDF model proposed balances well between accuracy and the preservation of desired properties such as scale invariance and consistency among rainfall durations.

54 ENVIRONMENTAL SCIENCES↗

Autocalibration of the E3SM Version 2 Atmosphere Model Using a PCA-Based Surrogate for Spatial Fields

Global Climate Model tuning (calibration) is a tedious and time-consuming process, with high-dimensional input and output fields. Experts typically tune by iteratively running climate simulations with hand-picked values of tuning parameters. Many, in both the statistical and climate literature, have proposed alternative calibration methods, but most are impractical or difficult to implement. We present a practical, robust, and rigorous calibration approach on the atmosphere-only model of the Department of Energy's Energy Exascale Earth System Model (E3SM) version 2. Our approach can be summarized into two main parts: (a) the training of a surrogate that predicts E3SM output in a fraction of the time compared to running E3SM, and (b) gradient-based parameter optimization. To train the surrogate, we generate a set of designed ensemble runs that span our input parameter space and use polynomial chaos expansions on a reduced output space to fit the E3SM output. We use this surrogate in an optimization scheme to identify values of the input parameters for which our model best matches gridded spatial fields of climate observations. To validate our choice of parameters, we run E3SMv2 with the optimal parameter values and compare prediction results to expertly-tuned simulations across 45 different output fields. This flexible, robust, and automated approach is straightforward to implement, and we demonstrate that the resulting model output matches present day climate observations as well or better than the corresponding output from expert tuned parameter values, while considering high-dimensional output and operating in a fraction of the time.

54 ENVIRONMENTAL SCIENCES↗

Signal amplification in a solid-state sensor through asymmetric many-body echo

Electronic spins of nitrogen–vacancy centres in diamond constitute a promising system for micro- and nanoscale magnetic sensing, because of their operation under ambient conditions, ease of placement in close proximity to sensing targets and biological compatibility. At high densities, the electronic spins interact through dipolar coupling, which typically limits but can also potentially enhance sensing performance. Here we report the experimental demonstration of many-body signal amplification in a solid-state, room-temperature quantum sensor. Our approach uses time-reversed two-axis-twisting interactions, engineered through dynamical control of the quantization axis and Floquet engineering in a two-dimensional ensemble of nitrogen–vacancy centres. We observe that optimal amplification occurs when the backward evolution time equals twice the forward evolution time, in sharp contrast to the conventional Loschmidt echo. These observations can be understood as resulting from an underlying time-reversed mirror symmetry of the microscopic dynamics, providing key insights into signal amplification and opportunities for practical entanglement-enhanced quantum sensing.

quantum information↗

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling.

The recent growth in multifidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a high-fidelity model. In this paper we provide two contributions: (1) we utilize an ensemble estimator to account for uncertainties in the optimal weights of approximate control variate (ACV) approaches and derive lower bounds on the number of samples required to guarantee variance reduction; and (2) we extend an existing multifidelity importance sampling (MFIS) scheme to leverage control variates. Our approach directly addresses a limitation of many multifidelity sampling strategies that require the usage of pilot samples to estimate covariances. As such we make significant progress towards both increasing the practicality of approximate control variates—for instance, by accounting for the effect of pilot samples—and using multifidelity approaches more effectively for estimating low-probability events. The numerical results indicate our hybrid MFIS-ACV estimator achieves up to 50% improvement in variance reduction over the existing state-of-the-art MFIS estimator, which had already shown an outstanding convergence rate compared to the Monte Carlo method, on several problems of computational mechanics.

97 MATHEMATICS AND COMPUTING↗

Deep Generative Modeling of Periodic Variable Stars Using Physical Parameters

The ability to generate physically plausible ensembles of variable sources is critical to the optimization of time domain survey cadences and the training of classification models on data sets with few to no labels. Traditional data augmentation techniques expand training sets by reenvisioning observed exemplars, seeking to simulate observations of specific training sources under different (exogenous) conditions. Unlike fully theory-driven models, these approaches do not typically allow principled interpolation nor extrapolation. Moreover, the principal drawback of theory-driven models lies in the prohibitive computational cost of simulating source observables from ab initio parameters. In this work, we propose a computationally tractable machine learning approach to generate realistic light curves of periodic variables capable of integrating physical parameters and variability classes as inputs. Our deep generative model, inspired by the transparent latent space generative adversarial networks, uses a variational autoencoder (VAE) architecture with temporal convolutional network layers, trained using the OGLE-III optical light curves and physical characteristics (e.g., effective temperature and absolute magnitude) from Gaia DR2. A test using the temperature–shape relationship of RR Lyrae demonstrates the efficacy of our generative “physics-enhanced latent space VAE” (PELS-VAE) model. Such deep generative models, serving as nonlinear nonparametric emulators, present a novel tool for astronomers to create synthetic time series over arbitrary cadences.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulating excited-state complex ensembles: Fluorescence and solvatochromism in amine-arene exciplexes

Exciplexes are excited-state complexes formed as a result of partial charge transfer from the donor to the acceptor species when one moiety of the donor–acceptor pair is electronically excited. The arene–amine exciplex formed between oligo-(p-phenylene) (OPP) and triethylamine (TEA) is of interest in the catalytic photoreduction of CO2 because it can compete with complete electron transfer to the OPP catalyst. Therefore, formation of the exciplex can hinder the generation of a radical anion OPP·− necessary for subsequent CO2 reduction. We report an implementation of a workflow automating quantum-chemistry calculations that generate and characterize an ensemble of structures to represent this exciplex state. We use FireWorks, Pymatgen, and Custodian Python packages for high-throughput ensemble generation. The workflow includes time-dependent density functional theory optimization, verification of excited-state minima, and exciplex characterization with natural transition orbitals, exciton analysis, excited-state Mulliken charges, and energy decomposition analysis. Fluorescence spectra computed for these ensembles using Boltzmann-weighted contributions of each structure agree better with experiment than our previous calculations based on a single representative exciplex structure [Kron et al., J. Phys. Chem. A 126, 2319–2329 (2022)]. The ensemble description of the exciplex state also reproduces an experimentally observed red shift of the emission spectrum of [OPP-4–TEA]* relative to [OPP-3–TEA]*. The workflow developed here streamlines otherwise labor-intensive calculations that would require significant user involvement and intervention.

Chemistry↗

The performance of ensemble-based free energy protocols in computing binding affinities to ROS1 kinase

Optimization of binding affinities for compounds to their target protein is a primary objective in drug discovery. Herein we report on a collaborative study that evaluates a set of compounds binding to ROS1 kinase. We use ESMACS (enhanced sampling of molecular dynamics with approximation of continuum solvent) and TIES (thermodynamic integration with enhanced sampling) protocols to rank the binding free energies. The predicted binding free energies from ESMACS simulations show good correlations with experimental data for subsets of the compounds. Consistent binding free energy differences are generated for TIES and ESMACS. Although an unexplained overestimation exists, we obtain excellent statistical rankings across the set of compounds from the TIES protocol, with a Pearson correlation coefficient of 0.90 between calculated and experimental activities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scalable Bayesian optimization with randomized prior networks

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment. Bayesian Optimization (BO) techniques are known to be effective in tackling global optimization problems using a relatively small number objective function evaluations, but their performance suffers when dealing with high-dimensional outputs. To overcome the major challenge of dimensionality, here we propose a deep learning framework for BO and sequential decision making based on bootstrapped ensembles of neural architectures with randomized priors. Using appropriate architecture choices, we show that the proposed framework can approximate functional relationships between design variables and quantities of interest, even in cases where the latter take values in high-dimensional vector spaces or even infinite-dimensional function spaces. In the context of BO, we augmented the proposed probabilistic surrogates with re-parameterized Monte Carlo approximations of multiple-point (parallel) acquisition functions, as well as methodological extensions for accommodating black-box constraints and multi-fidelity information sources. We test the proposed framework against state-of-the-art methods for BO and demonstrate superior performance across several challenging tasks with high-dimensional outputs, including a constrained multi-fidelity optimization task involving shape optimization of rotor blades in turbo-machinery.

97 MATHEMATICS AND COMPUTING↗

Inferring safety critical events from vehicle kinematics in naturalistic driving environment: Application of deep learning Algorithms

Advances in sensing technology has enabled the collection of countless terabytes of second-by-second kinematics data. Such data provides opportunities for real-time monitoring of driving behavior and identification of safety critical events (SCEs) including crashes and near crashes. The concept of volatility is relevant in this context, which identifies instability and erratic variations in driving behavior prior to involvement in SCEs. This study utilized vehicle kinematics from a large-scale naturalistic driving data to develop a deep learning approach based on 1D convolutional neural networks (CNN) for inferring SCEs. The data are unique in the sense that such accurate pre-crash data at high fidelity are not available in traditional crash repositories. This study contributes to the literature by providing a first attempt at predicting responses to SCEs by developing deep learning-based CNN architectures using novel driving volatility based kinematic thresholds for a sample of 9553 events. The key contribution lies in developing a volatility-based CNN input layout that is acceptable to CNN schemes and represents the motion kinematics such as speed, acceleration and volatility measures. Several 1D-CNN architectures were developed using layers, numbers of convolutions, layer patterns, and kernels. Shallow and deep architectures were tested, revealing higher accuracy of shallow architectures in detecting SCEs. The optimal number of epochs were identified using an early stopping method while the CNN performance was improved by increasing the number of epochs. The ensemble CNN had the highest predictive accuracy of 95.6% for detection of crashes and near crashes, which was 2.5% higher than the optimal CNN using 20% hold out test data. The ensemble CNN also outperformed classical machine learning models and model performance reported in past studies on detection of SCEs. Finally, these results have implications for identification of safety hotspots and providing real-time alerts and warnings in connected and highly automated vehicle environment including society of automotive engineers levels 3–5.

42 ENGINEERING↗

Equation‐Free Surrogate Modeling of Geophysical Flows at the Intersection of Machine Learning and Data Assimilation

Abstract There is a growing interest in developing data‐driven reduced‐order models for atmospheric and oceanic flows that are trained on data obtained either from high‐resolution simulations or satellite observations. The data‐driven models are non‐intrusive in nature and offer significant computational savings compared to large‐scale numerical models. These low‐dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation (DA) to produce accurate state estimates. This paper aims at exploring an equation‐free surrogate modeling approach at the intersection of machine learning and DA in Earth system modeling. With this objective, we introduce an end‐to‐end non‐intrusive reduced‐order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential DA. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short‐term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 data set. Our results indicate that the NIROM is stable for long‐term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by almost one order of magnitude by the DEnKF algorithm.

Pawar, Suraj↗

Enhancing Biomass Productivity by Forecast‐Informed Pond Operations

ABSTRACT Microalgal cultivation for biofuels and proteins holds significant promise but faces challenges in achieving economically viable biomass productivity under variable environmental conditions. This study introduces a forecast‐informed pond operation (FIPO) system that uses numerical weather prediction (NWP) ensemble forecasts and the biomass assessment tool (BAT) to optimize daily dilution rates for enhanced biomass production. In contrast to the current practice, where fixed dilution rates are based on operator experience, the FIPO system determines the optimal dilution rate based on future weather forecasts and biomass growth conditions. Our experiments validate the effectiveness of FIPO in both short‐ and long‐term growth scenarios. In short‐term experiments, FIPO increased biomass production by 21.3% compared to batch growth and 7.4% over fixed dilution (60% every 3 days) operations. The NWP forecast‐informed operations achieved biomass production nearly identical to that using perfect weather forecasts, highlighting the accuracy of current NWP forecasts for guiding pond operations. In long‐term experiments, FIPO resulted in biomass production increases of 13.3% and 17.8% compared to two fixed dilution rates (60% every 3 days and 20% daily). These findings underscore the viability of using NWP forecasts to optimize microalgal cultivation systems. By adjusting daily dilution rates in response to forecasted weather, operators can achieve higher biomass yields and mitigate risks associated with environmental variability. This study provides a foundation for future research and practical applications in commercial‐scale microalgal production.

Yan, Hongxiang [Energy and Environment Directorate↗

CO (2) Electroreduction on Borated Copper Surfaces: Boron Active Sites, Not Copper

Boron-doped copper has recently emerged as an active and stable catalyst for the electrochemical reduction of CO 2 to value-added C 2 products. Here, in this work, we develop a realistic model of CO electroreduction on surface borides of copper under operational conditions, taking into account the effects of electrode potential, electrolyte environment, and pH. We study the possible reconstruction of the electrocatalyst surface using grand canonical DFT and global optimization to obtain a potential-dependent grand canonical ensemble description of metastable, hydrogen-covered catalyst surfaces. Two key surface configurations, low H coverage (LC, −0.6 V SHE ) and high H coverage (HC, −0.8 V SHE ), dominate this ensemble, with the former being kinetically persistent and C 2 selective under strongly reducing conditions. Nonmetallic boron sites on the surface copper boride are found to bind CO more strongly than copper sites, and mechanistic investigation of CO electroreduction pathways presents a surprisingly unconventional case of boron-centered reactivity in contrast to typical copper-centered reactivity. Neighboring boron sites present along boron chains on the surface copper boride are found to facilitate C−C coupling, thereby driving the high C 2 selectivity of this electrocatalyst.

boron-doped copper↗

Engineering quantum-coherent defects: The role of substrate miscut in chemical vapor deposition diamond growth

The engineering of defects in diamond, particularly nitrogen-vacancy (NV) centers, is important for many applications in quantum science. A materials science approach based on chemical vapor deposition (CVD) growth of diamond and in situ nitrogen doping is a promising path toward tuning and optimizing the desired properties of the embedded defects. Herein, with the coherence of the embedded defects in mind, we explore the effects of substrate miscut on the diamond growth rate, nitrogen density, and hillock defect density, and we report an optimal angle range for the purposes of engineering coherent ensembles of NV centers in diamond according to our growth parameters. We provide a model that quantitatively describes hillock nucleation in the step-flow regime of CVD growth, shedding insight on the physics of hillock formation. We also report significantly enhanced incorporation of nitrogen at hillock defects, opening the possibility for templating hillock-defect-localized NV center ensembles for quantum applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗