SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Advanced Semi-Supervised Learning With Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1990

Ensemble Monte Carlo characterization of graded Al(x)Ga(1-x)As heterojunction barriers

The current-voltage characteristics of graded Al(x)Ga(1-x)As heterojunction barriers were investigated using a self-consistent ensemble Monte Carlo method. Results are presented for barriers with two doping levels (10 to the 15th/cu cm and 10 to the 17th/cu cm) and two barrier heights (100 and 265 meV). It was found that the lower barrier structure exhibited little rectification at room temperature at both doping levels, while the higher barrier exhibited considerable rectification. The structures with the lower doping value exhibited a smaller current in both forward and reverse regions, due to space-charge effect. The results of studies of the energy and momentum distribution functions along the barrier indicate that the assumption of drifted Maxwellian distribution used in energy-momentum models is not justified for Gamma valley electrons.

Kamoua, R.↗

NASA NTRS2007

Aerosol Measurements of the Fine and Ultrafine Particle Content of Lunar Regolith

We report the first quantitative measurements of the ultrafine (20 to 100 nm) and fine (100 nm to 20 m) particulate components of Lunar surface regolith. The measurements were performed by gas-phase dispersal of the samples, and analysis using aerosol diagnostic techniques. This approach makes no a priori assumptions about the particle size distribution function as required by ensemble optical scattering methods, and is independent of refractive index and density. The method provides direct evaluation of effective transport diameters, in contrast to indirect scattering techniques or size information derived from two-dimensional projections of high magnification-images. The results demonstrate considerable populations in these size regimes. In light of the numerous difficulties attributed to dust exposure during the Apollo program, this outcome is of significant importance to the design of mitigation technologies for future Lunar exploration.

Greenberg, Paul S.↗

NASA NTRS2014

Use of an OSSE to Evaluate Background Error Covariances Estimated by the 'NMC Method'

The NMC method has proven utility for prescribing approximate background-error covariances required by variational data assimilation systems. Here, untunedNMCmethod estimates are compared with explicitly determined error covariances produced within an OSSE context by exploiting availability of the true simulated states. Such a comparison provides insights into what kind of rescaling is required to render the NMC method estimates usable. It is shown that rescaling of variances and directional correlation lengths depends greatly on both pressure and latitude. In particular, some scaling coefficients appropriate in the Tropics are the reciprocal of those in the Extratropics. Also, the degree of dynamic balance is grossly overestimated by the NMC method. These results agree with previous examinations of the NMC method which used ensembles as an alternative for estimating background-error statistics.

Data Assimilation↗

NASA NTRSDate not supplied

Comparison of Wind-Tunnel and Flight Unsteady Pressure Environments for the Ares I-X Flight Test Vehicle

Wind-tunnel testing of highly-instrumented rigid models is the current standard for the estimation of unsteady environments acting on a launch vehicle during ascent. However, uncertainties are present in how well these constant condition wind-tunnel data model the unsteady environments for a full-scale launch vehicle during accelerating flight. The Ares I-X wind-tunnel and flight tests provided rich data sets for comparative analysis that have been used to develop answers to the question of tunnel-to-flight validity and uncertainty. In this paper, additional comparisons are presented for the unsteady pressure data acquired during wind-tunnel and flight testing to describe current methods that are used to evaluate preflight predictions. Utilizing these methods to generate ensembles of flight-comparable realizations from wind-tunnel data is shown to yield fluctuating magnitudes and spectra that compare well with flight data for the Ares I-X flight test vehicle throughout the transonic flight regime.

buffet↗

NASA NTRSDate not supplied

Comparison of Wind-Tunnel and Flight Unsteady Pressure Environments for the Ares I-X Flight Test Vehicle

buffet↗

DOE OSTI2023

Constraining AGN Torus Sizes with Optical and Mid-infrared Ensemble Structure Functions

We propose a new method to constrain the size of the dusty torus in broad-line active galactic nuclei (AGNs) using optical and mid-infrared (MIR) ensemble structure functions (SFs). Because of the geometric dilution of the torus, the MIR response to optical continuum variations has suppressed variability with respect to the optical that depends on the geometry (e.g., size, orientation, opening angle) of the torus. More extended tori have steeper MIR SFs with respect to the optical SFs. We demonstrate the feasibility of this SF approach using simulated AGN light curves and a geometric torus model. While it is difficult to use SFs to constrain the orientation and opening angle due to the insensitivity of the SF on these parameters, the size of the torus can be well determined. Applying this method to the ensemble SFs measured for 587 SDSS quasars, we measure a torus R–L relation of $\mathrm{log}\,{R}_{\mathrm{eff}}(\mathrm{pc})={0.51}_{-0.04}^{+0.04}\times \mathrm{log}({{L}}_{\mathrm{bol}}/{10}^{46}\,\mathrm{erg}\ {{\rm{s}}}^{-1})-{0.38}_{-0.01}^{+0.01}$ in the WISE W1 band and sizes ~1.4 times larger in the W2 band, which are in good agreement with dust reverberation mapping measurements. Compared with the reverberation mapping technique, the SF method is much less demanding in data quality and can be applied to any optical+MIR light curves for which a lag measurement may not be possible, as long as the variability process and torus structure are stationary. While this SF method does not extract all information contained in the light curves (i.e., the transfer function), it provides an intuitive interpretation for the observed trends of AGN MIR SFs compared with optical SFs.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1980

Project FIRES - Firefighters Integrated Response Equipment System. Volume 3: Protective Ensemble Design and Procurement Specification, Phase 1B

Each of the subsystems comprising the protective ensemble for firefighters is described. These include: (1) the garment system which includes turnout gear, helmets, faceshields, coats, pants, gloves, and boots; (2) the self-contained breathing system; (3) the lighting system; and (4) the communication system. The design selection rationale is discussed and the drawings used to fabricate the prototype ensemble are provided. The specifications presented were developed using the requirements and test method of the protective ensemble standard. Approximate retail prices are listed.

Abeles, F. J.↗

DOE OSTI2021

SINGLE: Atomic-resolution structure identification of nanocrystals by graphene liquid cell EM

Analysis of the three-dimensional (3D) structures of nanocrystals with solution-phase transmission electron microscopy is beginning to reveal their unique physiochemical properties. We developed a “one-particle Brownian 3D reconstruction method” based on imaging of ensembles of colloidal nanocrystals using graphene liquid cell electron microscopy. Projection images of differently rotated nanocrystals are acquired using a direct electron detector with high temporal (<2.5 ms) resolution and analyzed to obtain an ensemble of 3D reconstructions. Here, we introduce computational methods required for successful atomic-resolution 3D reconstruction: (i) tracking of the individual particles throughout the time series, (ii) subtraction of the interfering background of the graphene liquid cell, (iii) identification and rejection of low-quality images, and (iv) tailored strategies for 2D/3D alignment and averaging that differ from those used in biological cryo–electron microscopy. Our developments are made available through the open-source software package SINGLE.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Avoiding pitfalls in molecular simulation of vapor sorption: Example of propane and isobutane in metal–organic frameworks for adsorption cooling applications

This study introduces recommendations for conducting molecular simulations of vapor adsorption, with an emphasis on enhancing the accuracy, reproducibility, and comparability of results. The first aspect we address is consistency in the implementation of some details of typical molecular models, including tail corrections and cutoff distances, due to their significant influence on generated data. We highlight the importance of explicitly calculating the saturation pressures at relevant temperatures using methods such as Gibbs ensemble Monte Carlo simulations and illustrate some pitfalls in extrapolating saturation pressures using this method. For grand canonical Monte Carlo (GCMC) simulations, the input fugacity is usually calculated using an equation of state, which often requires the critical parameters of the fluid. We show the importance of using critical parameters derived from the simulation with the same model to ensure internal consistency between the simulated explicit adsorbate phase and the implicit bulk phase in GCMC. We show the advantages of presenting isotherms on a relative pressure scale to facilitate easier comparison among models and with experiment. Extending these guidelines to a practical case study, we evaluate the performance of various isoreticular metal–organic frameworks (MOFs) in adsorption cooling applications. This includes examining the advantages of using propane and isobutane as working fluids and identifying MOFs with a superior performance.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Quantifying sensitivity in numerical weather prediction-modeled offshore wind speeds through an ensemble modeling approach

A decade of research has shown that numerical weather prediction (NWP)-modeled wind speeds can be highly sensitive to the inputs and setups within the NWP model. For wind resource characterization applications, this sensitivity is often addressed by constructing a range of setups and selecting the one that best validates against observations. However, this approach is not possible in areas that lack high-quality hub height observations, especially offshore wind areas. In such cases, techniques to quantify and disseminate confidence in NWP-modeled wind speeds in the absence of observations are needed. We address this need in the present study and propose best practices for quantifying the spread in NWP-modeled wind speeds. We implement an ensemble approach in which we consider 24 different setups to the Weather Research and Forecasting (WRF) model. We construct the ensemble by considering variations in WRF version, WRF namelist, atmospheric forcing, and sea surface temperature (SST) forcing. Our analysis finds that the standard deviation produces more consistent estimates compared to the interquartile range and tends to be the more conservative estimator for ensemble variability. We further find that model spread increases closer to the surface and on shorter time scales. In conclusion, we explore methods to attribute total ensemble variability to the different ensemble components (e.g., atmospheric forcing and SST product) and find that contributions by components also vary depending on time scale. We anticipate that the methods and results presented in this paper will provide a reasonable foundation for further research into ensemble-based wind resource data sets.

17 WIND ENERGY↗

DOE OSTI2024

Resolving local ordering and structure in Mn x Ge 1- x Te alloys through thermodynamic ensembles of pair distribution functions

Characterizing local bonding environments in complex materials is essential for understanding and optimizing their properties. Equally as important is the ability to predict local motifs as a function of synthesis conditions, enhancing chemists’ ability to design properties into materials. In this study, we present an approach to leverage statistical mechanics to generate temperature- and energy-informed ensemble averaged pair distribution functions (PDFs). This method, which we have named Thermodynamic Ensemble Averages of PDFs for Ordering and Transformations (TEAPOT), utilizes density functional theory (DFT) to relax supercells while incorporating energetic penalties for local order, enabling accurate and computationally efficient analysis of local structure. We apply this method to the neutron PDF measurements of the pseudobinary MnTe–GeTe (MGT) alloy, demonstrating its capability to resolve complex local distortions and chemical ordering. Our results reveal detailed insights into phase transformations and local distortions driven by Mn substitution. For compositions that globally present as rock salt, our analysis reveals that Ge coordination geometry is heavily impacted by synthesis temperature. We propose that high temperature synthesis conditions promote a lowered Ge polyhedra distortion, promoting high charge carrier mobility due to the alignment of local and global structure. Incorporating statistical mechanics and computation into experimental analysis thus guides synthesis of tailored local structure.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Bundling measures for food systems transformation: a global, multimodel assessment

Background Current food systems leave one in ten individuals at risk of hunger while driving unsustainable environmental impacts. Inaction risks further exacerbating negative impacts on both human and planetary health. These challenges emerge from complex system interactions, requiring approaches that engage with this complexity and consider how transformation measures interact across food systems. We aimed to quantify the magnitude and uncertainty of the impacts of key food systems transformation measures both individually and in a bundle using an ensemble of global economic models. Methods In this global multimodel assessment, we applied an ensemble of ten state-of-the-art global economic models to evaluate the potential of four key measures in transforming food systems: increasing agricultural productivity, halving food loss and waste, shifting towards healthier diets, and economy-wide climate mitigation policies aligned with limiting warming to 1·5°C. The scenarios used a middle-of-the-road shared socioeconomic pathway for population and gross domestic product growth, climate impact data from Jägermeyr and colleagues, Thornton and colleagues, and Nelson and colleagues, and dietary targets based on the EAT–Lancet healthy reference diet, with model simulations conducted from 2020 to 2050. We then assessed the effect of these measures in isolation and in combination in a bundled scenario. To further understand the interactions between these measures, we conducted a decomposition analysis that distinguishes between the individual effects of a measure (effect when implemented alone), total effects (its contribution within the bundle), and interaction effects (the difference between total and individual effects). This approach aimed to show complementarities and trade-offs that emerge when multiple measures are implemented simultaneously. Findings Our analysis showed that individual measures in isolation are insufficient to achieve high-level environmental objectives and might generate unintended consequences. In contrast, bundling measures produces co-benefits: avoiding 50% of projected agricultural greenhouse gas emissions by 2050 and almost 20% of anticipated land conversion, while moderating food price increases associated with ambitious climate change mitigation policies. Our decomposition analysis further shows that measures can have varying effects across different dimensions. Although dietary shifts and climate mitigation policies are the largest drivers of environmental benefits (each contributing to a median decline of >10 percentage points in non-CO 2 emissions and 5 percentage points in agricultural land use globally), productivity improvements and reducing food loss and waste play essential roles in moderating price increases (each contributing to a median decline of >5 percentage points in average prices). Interpretation This study highlights the importance of implementing coordinated approaches to food system transformation and climate change mitigation rather than relying on isolated interventions. Comprehensive transformation requires understanding how supply-side and demand-side changes can interact with climate mitigation policies, enabling policy makers to design intervention packages that maximise benefits while minimising trade-offs across environmental, economic, and social dimensions.

Sundiang, Marina [Cornell Univ., Ithaca, NY (Unite↗

DOE OSTI2025

Learning and discovering multiple solutions using physics-informed neural networks with random initialization and deep ensemble

In this work we explore the capability of physics-informed neural networks (PINNs) to discover multiple solutions. Many real-world phenomena governed by nonlinear differential equations (DEs), such as fluid flow, exhibit multiple solutions under the same conditions, yet capturing this solution multiplicity remains a significant challenge. A key difficulty lies in providing appropriate initial conditions or guesses, as widely used time-marching schemes and Newton’s method are highly sensitive to these choices when solving complex computational problems. While machine learning models, particularly PINNs, have shown promise in solving DEs, their ability to capture multiple solutions remains underexplored. In this work, we propose a simple and practical approach using PINNs to learn and discover multiple solutions. We first demonstrate that PINNs, when combined with random initialization and deep ensemble method—originally developed for uncertainty quantification—can effectively uncover multiple solutions to nonlinear ordinary and partial DEs. Although training large ensembles of PINNs may appear computationally demanding, this can be done efficiently using vectorization techniques supported by modern deep learning frameworks, allowing many networks to be trained simultaneously. Our approach highlights the critical role of initialization in shaping solution diversity, addressing an often-overlooked aspect of machine learning for scientific computing. Furthermore, we propose utilizing PINN-generated solutions as initial conditions or initial guesses for conventional numerical solvers to enhance accuracy and efficiency in capturing multiple solutions. Extensive numerical experiments, including the Allen–Cahn equation and cavity flow, where our approach successfully identifies both stable and unstable solutions, validate the effectiveness of our method. These findings establish a general and efficient framework for addressing solution multiplicity in nonlinear DEs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Machine-learning accelerated geometry optimization in molecular simulation

Geometry optimization is an important part of both computational materials and surface science because it is the path to finding ground state atomic structures and reaction pathways. These properties are used in the estimation of thermodynamic and kinetic properties of molecular and crystal structures. This process is slow at the quantum level of theory because it involves an iterative calculation of forces using quantum chemical codes such as density functional theory (DFT), which are computationally expensive and which limit the speed of the optimization algorithms. It would be highly advantageous to accelerate this process because then one could do either the same amount of work in less time or more work in the same time. Here, we provide a neural network (NN) ensemble based active learning method to accelerate the local geometry optimization for multiple configurations simultaneously. We illustrate the acceleration on several case studies including bare metal surfaces, surfaces with adsorbates, and nudged elastic band for two reactions. In all cases, the accelerated method requires fewer DFT calculations than the standard method. In addition, we provide an Atomic Simulation Environment (ASE)-optimizer Python package to make the usage of the NN ensemble active learning for geometry optimization easier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Estimators and Fusers for Fiber Delay Estimation Using Environmental Measurements

The properties of deployed network fiber are affected by environmental factors due to their exposure to the elements. Particularly for quantum networks, the resultant delay variations may have significant impacts due to the extreme sensitivity of synchronization, coincidence counting, and other critical operations. In this paper, the delays of 15 km aerial-inground fiber connections are measured, and effects due to temperature, humidity and wind speed are analyzed over multiple periods spanning four seasons of a year. Machine learning methods are first utilized to reveal surprisingly pronounced effects of humidity on the delay, in addition to the expected temperature and its seasonal variations. Estimator and fusion methods are developed to estimate the delay using temperature, humidity and wind speed measurements, by utilizing smooth Gaussian Process Regression (GPR) and nonsmooth Ensemble of Trees (EOT) methods. Measurements from winter and summer periods are temporally fused using twelve different methods, and eight methods provide estimates for the delay throughout the year with median test errors under 1.28%. The results reveal distinct temperature-humidity trends across the seasons, and the ability of estimator and temporal fusion methods to exploit them for estimating the delay. These results constitute a case study of machine learning analytical results, wherein generalization equations explain the performance of various estimator and fuser methods.

Rao, Nageswara [ORNL] (ORCID:0000000234085941)↗

DOE OSTI2020

Multilevel Monte Carlo Predictions of First Passage Times in Three-Dimensional Discrete Fracture Networks: A Graph-Based Approach

In this paper, we present a method combining multilevel Monte Carlo (MLMC) and a graph-based primary subnetwork identification algorithm to provide estimates of the mean and variance of the distribution of first passage times in fracture media at significantly lower computational cost than standard Monte Carlo (MC) methods. Simulations of solute transport are performed using a discrete fracture network (DFN), and instead of using various grid resolutions for levels in the MLMC, which is standard practice in MLMC, we identify a hierarchy of subnetworks in the DFN based on the shortest topological paths through the network using a graph-based method. While the mean of these ensembles is of critical importance, the variance is also essential in fractured media where uncertainty is an overarching theme, and understanding variability across an ensemble is a requirement for safety assessments. The method provides good estimates of the mean and variance at two orders of magnitude lower computational cost than MC.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗