Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Optimizing ensemble NV − spin properties of fluorescent diamond microparticles by systematic low pressure high temperature annealing

Low pressure high temperature annealing is a means for driving nitrogen and defect diffusion in diamond to reduce internal lattice damage without the need for technically complicated high-pressure cells. Herein, we perform a systematic time (5, 15, and 30 min) and temperature (1200 °C–1800 °C) study of effects of low-pressure high temperature annealing on photoluminescence, spin concentrations, and spin relaxation properties of NV centers in ca. 3 μm synthetic type 1b diamond particles. Annealing in the temperature range of ca. 1400 °C–1700 °C for even 5 min leads to a higher optically detected magnetic resonance contrast as compared to standard annealing at 900 °C for 2 h. Particles annealed at 1700 °C for 5 min exhibit a contrast close to about 13% as compared to about 9% for those annealed at 900 °C for 2 h. A reduction in the zero-field splitting strain parameter from E ≈ 4.5 MHz to ≈ 2.5 MHz and spectral linewidth from Δν ≈ 7 MHz to ≈ 4 MHz are observed even after 5 min annealing at 1700 °C. Improvements in these spectral parameters resulted in a roughly 2-fold reduction in the noise level of temperature monitoring experiment utilizing an ensemble of NV centers in the particles. Annealing in the temperature range of 1600 °C for 15 or 30 min or 1700 °C for 5 min resulted in NV T 1 relaxation times approaching ca. 5 ms typically observed for bulk diamond. Quantitative electron paramagnetic resonance (EPR) allowed for estimations of thermal activation energies of paramagnetic center annihilation. Monitoring the primary defect concentration (P1 and other defects with half integer spins) and utilizing second order kinetic modeling, an activation energy of 3.63 ± 0.28 eV was estimated. Alternatively, using the NV half field EPR signal and first order kinetic modeling, a similar activation energy 3.89 ± 0.29 eV was estimated.

NV centers↗
DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗
DOE OSTI2022

Third international challenge to model the medium- to long-range transport of radioxenon to four Comprehensive Nuclear-Test-Ban Treaty monitoring stations

In 2015 and 2016, atmospheric transport modeling challenges were conducted in the context of the Comprehensive Nuclear-Test-Ban Treaty (CTBT) verification, however, with a more limited scope with respect to emission inventories, simulation period and number of relevant samples (i.e., those above the Minimum Detectable Concentration (MDC)) involved. Therefore, a more comprehensive atmospheric transport modeling challenge was organized in 2019. Stack release data of Xe-133 were provided by the Institut National des Radioéléments/IRE (Belgium) and the Canadian Nuclear Laboratories/CNL (Canada) and accounted for in the simulations over a three (mandatory) or six (optional) months period. Best estimate emissions of additional facilities (radiopharmaceutical production and nuclear research facilities, commercial reactors or relevant research reactors) of the Northern Hemisphere were included as well. Model results were compared with observed atmospheric activity concentrations at four International Monitoring System (IMS) stations located in Europe and North America with overall considerable influence of IRE and/or CNL emissions for evaluation of the participants’ runs. Participants were prompted to work with controlled and harmonized model set-ups to make runs more comparable, but also to increase diversity. It was found that using the stack emissions of IRE and CNL with daily resolution does not lead to better results than disaggregating annual emissions of these two facilities taken from the literature if an overall score for all stations covering all valid observed samples is considered. A moderate benefit of roughly 10% is visible in statistical scores for samples influenced by IRE and/or CNL to at least 50% and there can be considerable benefit for individual samples. Effects of transport errors, not properly characterized remaining emitters and long IMS sampling times (12–24 h) undoubtedly are in contrast to and reduce the benefit of high-quality IRE and CNL stack data. Complementary best estimates for remaining emitters push the scores up by 18% compared to just considering IRE and CNL emissions alone. Despite the efforts undertaken the full multi-model ensemble built is highly redundant. An ensemble based on a few arbitrary runs is sufficient to model the Xe-133 background at the stations investigated. The effective ensemble size is below five. An optimized ensemble at each station has on average slightly higher skill compared to the full ensemble. However, the improvement (maximum of 20% and minimum of 3% in RMSE) in skill is likely being too small for being exploited for an independent period.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Early events in G-quadruplex folding captured by time-resolved small-angle X-ray scattering

Abstract Time-resolved small-angle X-ray experiments are reported here that capture and quantify a previously unknown rapid collapse of the unfolded oligonucleotide as an early step in the folding of hybrid 1 and hybrid 2 telomeric G-quadruplex structures. The rapid collapse, initiated by a pH jump, is characterized by an exponential decrease in the radius of gyration from 24.3 to 12.6 Å. The collapse is monophasic and is complete in <600 ms. Additional hand-mixing pH-jump kinetic studies show that slower kinetic steps follow the collapse. The folded and unfolded states at equilibrium were further characterized by SAXS studies and other biophysical tools, showing that G4 unfolding was complete at alkaline pH, but not in LiCl solution as is often claimed. The SAXS Ensemble Optimization Method analysis reveals models of the unfolded state as a dynamic ensemble of flexible oligonucleotide chains with a variety of transient hairpin structures. These results suggest a G4 folding pathway in which a rapid collapse, analogous to molten globule formation seen in proteins, is followed by a confined conformational search within the collapsed particle to form the native contacts ultimately found in the stable folded form.

Biochemistry & Molecular Biology↗
DOE OSTI2020

Protein folding from heterogeneous unfolded state revealed by time-resolved X-ray solution scattering

One of the most challenging tasks in biological science is to understand how a protein folds. In theoretical studies, the hypothesis adopting a funnel-like free-energy landscape has been recognized as a prominent scheme for explaining protein folding in views of both internal energy and conformational heterogeneity of a protein. Despite numerous experimental efforts, however, comprehensively studying protein folding with respect to its global conformational changes in conjunction with the heterogeneity has been elusive. Here we investigate the redox-coupled folding dynamics of equine heart cytochrome c (cyt-c) induced by external electron injection by using time-resolved X-ray solution scattering. A systematic kinetic analysis unveils a kinetic model for its folding with a stretched exponential behavior during the transition toward the folded state. With the aid of the ensemble optimization method combined with molecular dynamics simulations, we found that during the folding the heterogeneously populated ensemble of the unfolded state is converted to a narrowly populated ensemble of folded conformations. These observations obtained from the kinetic and the structural analyses of X-ray scattering data reveal that the folding dynamics of cyt-c accompanies many parallel pathways associated with the heterogeneously populated ensemble of unfolded conformations, resulting in the stretched exponential kinetics at room temperature. This finding provides direct evidence with a view to microscopic protein conformations that the cyt-c folding initiates from a highly heterogeneous unfolded state, passes through still diverse intermediate structures, and reaches structural homogeneity by arriving at the folded state.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Global fire modelling and control attributions based on the ensemble machine learning and satellite observations

Contemporary fire dynamics is one of the most complex and least understood land surface phenomena. Global fire controls related to climate, vegetation, and anthropogenic activity are usually intertwined, and difficult to disentangle in a quantitative way. Here, we leveraged an ensemble of five machine learning (ML) models and multiple satellite-based observations to conduct global fire modeling for three fire metrics (burned area, fire number, and fire size), and quantified driving mechanisms underlying annual fire changes in a spatially resolved manner for the period 2003–2019. Ensemble learning is a meta-approach that combines multiple ML predictions to improve accuracy, robustness, and generalization performance. We found that the optimized ensemble ML well reproduced annual dynamics of global burned area (R 2 = 0.90, P < 0.001), total fire numbers (R 2 = 0.86, P < 0.001), and averaged fire size (R 2 = 0.70, P < 0.001). Additionally, the ensemble ML captured key spatial patterns of multi-year mean magnitudes, annual variabilities, anomalies, and trends for different fire metrics. Our ML-based fire attributions further highlighted the dominant role of enhanced anthropogenic activity in reducing global burned area (–1.9 Mha/yr, P < 0.01), followed by climate control (–1.3 Mha/yr, P < 0.01) and insignificant positive vegetation control (0.4 Mha/yr, P = 0.60). Spatially, climate dominated a much larger burned area (53.7%) than human (23.4%) or vegetation control (22.9%); however, the counteracting effects from regional wetting and drying trends weakened the net climate impacts on global burned area. The fire number and fire size exhibited similar spatial control patterns with burned area; globally, however, fire number tended to be more affected by climate while fire size more influenced by human activities. Overall, our study confirmed the feasibility and efficiency of ensemble ML in global fire modeling and subsequent control attributions, providing a better understanding of contemporary fire regimes and contributing to robust fire projections in a changing environment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Avatar Tools

Supervised machine learning is the process of using past experience to predict the future. "Ensembles" are a machine-learning meta-method that can be applied to most machine learning algorithms. Ensembles generally greatly improve accuracy, reduce or remove most of the design issues presented by machine learning, and are admirably suited to parallel and distributed computation. The Avatar Tools codes are an implementation of ensembles specifically for decision trees. Some features that distinguish Avatar Tools from other "ensembles for decision trees" codes are: (1) Does the bookkeeping necessary for out of bag (OOB) validation. (2) Can use OOB validation to automatically determine optimal ensemble size. (3) Provides an MPI-based parallel implementation, for distributed operation. (4) Provides convenient tools for cross-validation, to assess the accuracy provided by a training set. SAND2020-3858 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Siefert, Christopher↗
DOE OSTI2020

Efficient Ensemble-Based Stochastic Gradient Methods for Optimization Under Geological Uncertainty

Ensemble-based stochastic gradient methods, such as the ensemble optimization (EnOpt) method, the simplex gradient (SG) method, and the stochastic simplex approximate gradient (StoSAG) method, approximate the gradient of an objective function using an ensemble of perturbed control vectors. These methods are increasingly used in solving reservoir optimization problems because they are not only easy to parallelize and couple with any simulator but also computationally more efficient than the conventional finite-difference method for gradient calculations. In this work, we show that EnOpt may fail to achieve sufficient improvement of the objective function when the differences between the objective function values of perturbed control variables and their ensemble mean are large. On the basis of the comparison of EnOpt and SG, we propose a hybrid gradient of EnOpt and SG to save on the computational cost of SG. We also suggest practical ways to reduce the computational cost of EnOpt and StoSAG by approximating the objective function values of unperturbed control variables using the values of perturbed ones. We first demonstrate the performance of our improved ensemble schemes using a benchmark problem. Results show that the proposed gradients saved about 30–50% of the computational cost of the same optimization by using EnOpt, SG, and StoSAG. As a real application, we consider pressure management in carbon storage reservoirs, for which brine extraction wells need to be optimally placed to reduce reservoir pressure buildup while maximizing the net present value. Results show that our improved schemes reduce the computational cost significantly.

58 GEOSCIENCES↗
DOE OSTI2025

Spotlight: efficient automated global optimization in rietveld analysis of diffraction data

Performing reliable Rietveld analysis on tens or hundreds of powder diffraction datasets from parametric or time-resolved experiments often poses a bottleneck in extracting meaningful results from the data. While automated analysis of data has recently been demonstrated, high temperature annealing studies, during which phase transformations occur and lattice parameters may change due to repartitioning of elements, are prime examples where automation by a simple phase identification from a database of room temperature structures or automation by sequential refinements is likely to fail. To enable reliable, efficient, automated Rietveld analysis, we present a Python package named Spotlight , building on established Rietveld packages such as MAUD, GSAS , or GSAS-II , which extends the refinement of best fit parameters to a global optimization using an ensemble of optimizers leveraging hierarchical parallel execution on high-performance computing clusters. Spotlight further enables the efficient design of refinement plans through the iterative automated machine-learning of a surrogate for the refinement on which the global optimizations are performed until results from the surrogate converge to the response surface data. We demonstrate Spotlight with the analysis of uranium molybdenum and Ti–6Al–4V datasets, as well as in two open-source tutorials analyzing aluminium oxide and lead sulphate.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Optimal Power Management of Battery Energy Storage Systems via Ensemble Kalman Inversion

Optimal power management of battery energy storage systems (BESS) is crucial for their safe and efficient operation. Numerical optimization techniques are frequently utilized to solve the optimal power management problems. However, these techniques often fall short of delivering real-time solutions for large-scale BESS due to their computational complexity. To address this issue, this paper proposes a computationally efficient approach. We introduce a new set of decision variables called power-sharing ratios corresponding to each cell, indicating their allocated power share from the output power demand. We then formulate an optimal power management problem to minimize the system-wide power losses while ensuring compliance with safety, balancing, and power supply-demand match constraints. To efficiently solve this problem, a parametrized control policy is designed and leveraged to transform the optimal power management problem into a parameter estimation problem. We then implement the ensemble Kalman inversion to estimate the optimal parameter set. The proposed approach significantly reduces computational requirements due to 1) the much lower dimensionality of the decision parameters and 2) the estimation treatment of the optimal power management problem. Finally, we conduct extensive simulations to validate the effectiveness of the proposed approach. The results show promise in accuracy and computation time compared with explored numerical optimization techniques.

Farakhor, Amir↗
DOE OSTI2022

Using ensembles and distillation to optimize the deployment of deep learning models for the classification of electronic cancer pathology reports

One of the goals of the Surveillance, Epidemiology, and End Results (SEER) program is to estimate incidence, prevalence, and mortality of all cancers. To that end, cancer registries across the country maintain a massive database of cancer pathology reports which contain rich information to understand cancer trends. However, these reports are stored in the form of unstructured text, and human annotators are required to read and extract relevant information. In this article, we show that existing deep learning models for automating information extraction from cancer pathology reports can be significantly improved by using ensemble model distillation. We found that by training multiple predictive models and transferring their knowledge to a single, low-resource model, we can reduce the number of highly confident wrong predictions. Our results show that our implemented methods could save 1000s of manual annotation hours.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Nanoscale solid-state nuclear quadrupole resonance spectroscopy using depth-optimized nitrogen-vacancy ensembles in diamond

Nuclear magnetic resonance (NMR) and nuclear quadrupole resonance (NQR) spectroscopy of bulk quantum materials have provided insight into phenomena, such as quantum phase criticality, magnetism, and superconductivity. With the emergence of nanoscale 2D materials with magnetic phenomena, inductively detected NMR and NQR spectroscopy are not sensitive enough to detect the smaller number of spins in nanomaterials. The nitrogen-vacancy (NV) center in diamond has shown promise in bringing the analytic power of NMR and NQR spectroscopy to the nanoscale. However, due to depth-dependent formation efficiency of the defect centers, noise from surface spins, band bending effects, and the depth dependence of the nuclear magnetic field, there is ambiguity regarding the ideal NV depth for surface NMR of statistically polarized spins. In this work, we prepared a range of shallow NV ensemble layer depths and determined the ideal NV depth by performing NMR spectroscopy on statistically polarized 19 F in Fomblin oil on the diamond surface. We found that the measurement time needed to achieve a signal-to-noise ratio of 3 using XY8-N noise spectroscopy has a minimum at an NV ensemble depth of 5.5 ± 1.5 nm for ensembles activated from 100 ppm nitrogen concentration. To demonstrate the sensing capabilities of NV ensembles, we perform NQR spectroscopy on the 11 B of hexagonal boron nitride flakes. We compare our best diamond to previous work with a single NV and find that this ensemble provides a shorter measurement time with excitation diameters as small as 4 μm. Furthermore, this analysis provides ideal conditions for further experiments involving NMR/NQR spectroscopy of 2D materials with magnetic properties.

2D materials↗
DOE OSTI2026

Gradient-informed Hamiltonian Monte Carlo for multicomponent CALPHAD model optimization and uncertainty quantification

CALPHAD model parameter optimization is inherently challenging due to non-smooth objective functions, high-dimensional parameter spaces, and the need for uncertainty quantification (UQ). Traditional weighted nonlinear least squares approaches are computationally efficient but local, whereas black-box global optimizers and ensemble Markov Chain Monte Carlo (MCMC) methods provide broader exploration at substantial computational cost. The objective of this work is to combine the global exploration capability of gradient-informed Hamiltonian Monte Carlo – specifically the No-U-Turn Sampler (NUTS) – with local deterministic refinement using BFGS to efficiently optimize multicomponent CALPHAD models with minimal manual intervention. Analytic gradients are computed via the Jansson derivative framework. The methodology is demonstrated on the Cr—Fe binary system and extended to the Cr—Fe—Ni ternary system with 32 degrees of freedom. For Cr—Fe, NUTS achieves comparable or superior optimality relative to ensemble MCMC while requiring over an order-of-magnitude fewer likelihood evaluations. Parameter uncertainties are quantified through NUTS sampling and propagated to thermodynamic observables using local expansion, demonstrating a novel modular approach that combines binary and ternary parameter subsets without requiring global relaxation. These results establish gradient-informed exploration as a scalable strategy for multicomponent CALPHAD optimization and provide a practical route towards efficient higher-order database development with quantified uncertainty.

36 MATERIALS SCIENCE↗