Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Local indistinguishability and incompleteness of entangled orthogonal bases: Method to generate two-element locally indistinguishable ensembles

Highlights: • Local indistinguishability of orthogonal quantum states. • Bipartite and multipartite quantum ensembles. • Unextendible entangled bases and uncompletable entangled bases. • Two-element locally indistinguishable quantum ensembles. • Multiparty unextendible entangled bases with unextendibility in all partitions. We relate the phenomenon of local indistinguishability of orthogonal states with the properties of unextendibility and uncompletability of entangled bases for bipartite and multipartite quantum systems. We prove that all two-qubit unextendible entangled bases are of size three and they cannot be perfectly distinguished by separable measurements. We identify a method of constructing two-element orthogonal ensembles, based on the concept of unextendible entangled bases, that can potentially lead to information sharing applications. Two-element ensembles form the fundamental unit of ensembles, and yet does not offer locally indistinguishable ensembles for pure state elements. Going over to mixed states does open this possibility, but can be difficult to identify. The method provided using unextendible entangled bases can be used for their systematic generation. In multipartite systems, we find a class of unextendible entangled bases for which the unextendibility property remains conserved across all bipartitions. We also identify nonlocal operations, local implementation of which require entangled resource states from a higher-dimensional quantum system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1989

Laser transit anemometer software development program

Algorithms were developed for the extraction of two components of mean velocity, standard deviation, and the associated correlation coefficient from laser transit anemometry (LTA) data ensembles. The solution method is based on an assumed two-dimensional Gaussian probability density function (PDF) model of the flow field under investigation. The procedure consists of transforming the data ensembles from the data acquisition domain (consisting of time and angle information) to the velocity space domain (consisting of velocity component information). The mean velocity results are obtained from the data ensemble centroid. Through a least squares fitting of the transformed data to an ellipse representing the intersection of a plane with the PDF, the standard deviations and correlation coefficient are obtained. A data set simulation method is presented to test the data reduction process. Results of using the simulation system with a limited test matrix of input values is also given.

Abbiss, John B.↗
NASA NTRS1995

Experimental studies of the properties of 'simulated' upstream turbulence using a statistical multipoint method

In this report we present a different approach to the multipoint measurement of magnetic fields and plasma. This is called the multi-spacecraft ensemble technique (MET), essentially free of process restrictions, such as linearity and stationarity. We comprehensively discuss the other conditions and limitations intrinsic to this statistical method. We also show the results of the application of the ensemble method to the synthetic data obtained from a hybrid simulation in the region upstream of a quasi-parallel shock. The important implications of the above approach for the CLUSTER mission are discussed.

Orlowski, D. S.↗
DOE OSTI2024

Hyperspectral Detection of the Fluorescence Shift between Chirality-Sorted Empty and Water-Filled Single-Wall Carbon Nanotube Enantiomers

Single-wall carbon nanotubes (SWCNTs) have extraordinary electronic and optical properties that depend strongly on their exact chiral structure and their interaction with their inner and outer environment. The fluorescence (PL) of semiconducting SWCNTs, for instance, will shift depending on the molecules with which the SWCNT’s hollow core is filled. These interaction-induced shifts are challenging to resolve on the ensemble level in samples containing a mixture of different filling contents due to the relatively large inhomogeneous line width of the ensemble SWCNT PL compared to the size of these shifts. To circumvent this inhomogeneous broadening, single-tube spectroscopy and hyperspectral imaging are often applied, which until now required time-consuming statistical studies. Here, we present hyperspectral PL microscopy combined with automated SWCNT segmenting based on either principal component analysis or a convolutional neural network, capable of both spatially and spectrally resolving the PL along the length of many individual SWCNTs at the same time and automatically fitting peak positions and line widths of individual SWCNTs. The methodology is demonstrated by accurately determining the emission shifts and line widths of thousands of left- and right-handed empty and water-filled SWCNTs coated with a chiral surfactant, resulting in four statistical distributions which cannot be resolved in ensemble spectroscopy of unsorted samples. The results demonstrate a robust method to quickly probe ensemble properties with single-enantiomer spectral resolution. Moreover, it promises to be an absolute quantitative method to characterize the relative abundances of SWCNTs with different handedness or filling content in macroscopic samples, simply by counting individual species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Uncertainty quantification in machine learning for engineering design and health prognostics: A tutorial

On top of machine learning (ML) models, uncertainty quantification (UQ) functions as an essential layer of safety assurance that could lead to more principled decision making by enabling sound risk assessment and management. The safety and reliability improvement of ML models empowered by UQ has the potential to significantly facilitate the broad adoption of ML solutions in high-stakes decision settings, such as healthcare, manufacturing, and aviation, to name a few. In this tutorial, we aim to provide a holistic lens on emerging UQ methods for ML models with a particular focus on neural networks and the applications of these UQ methods in tackling engineering design as well as prognostics and health management problems. Towards this goal, we start with a comprehensive classification of uncertainty types, sources, and causes pertaining to UQ of ML models. Next, we provide a tutorial-style description of several state-of-the-art UQ methods: Gaussian process regression, Bayesian neural network, neural network ensemble, and deterministic UQ methods focusing on spectral-normalized neural Gaussian process. Established upon the mathematical formulations, we subsequently examine the soundness of these UQ methods quantitatively and qualitatively (by a toy regression example) to examine their strengths and shortcomings from different dimensions. Then, we review quantitative metrics commonly used to assess the quality of predictive uncertainty in classification and regression problems. Afterward, we discuss the increasingly important role of UQ of ML models in solving challenging problems in engineering design and health prognostics. In conclusion, two case studies with source codes available on GitHub are used to demonstrate these UQ methods and compare their performance in the life prediction of lithium-ion batteries at the early stage (case study 1) and the remaining useful life prediction of turbofan engines (case study 2).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

New, improved analysis of correlation ECE data to accurately determine turbulent electron temperature spectra and magnitudes (invited)

Turbulent electron temperature fluctuation measurement using a correlation electron cyclotron emission (CECE) radiometer has become an important diagnostic for studying energy transport in fusion plasmas, and its use is widespread in tokamaks (DIII-D, ASDEX Upgrade, Alcator C-Mod, Tore Supra, EAST, TCV, HL-2A, etc.). The CECE diagnostic typically performs correlation analysis between two closely spaced (within the turbulent correlation length) ECE channels that are dominated by uncorrelated thermal noise emission. This allows electron temperature fluctuations embedded in the thermal noise to be revealed and fluctuation level and spectra determined. We have demonstrated a new, improved CECE coherency-based analysis for calculating the temperature fluctuation frequency spectrum and level, which has been verified both numerically through the simulation of synthetic ECE radiometer data and through analysis of experimental data from the CECE system on DIII-D. The new formulation places coherency-based analysis on a firm foundational footing and corrects some currently published methodologies. This new method accurately accounts for bias error in the coherence function and correctly calculates noise levels for a fixed data record length. It provides excellent accuracy in determining temperature fluctuation level (e.g., <10% error) even for a small realization number in the ensemble average. The method also has a smaller uncertainty (i.e., error bar) in the power spectrum when compared to the more standard cross-power method when evaluated at low coherency. Direct calculation of system noise level using correlation between randomized intermediate frequency signals is recommended.

Wang, G. (ORCID:0000000225739827)↗
DOE OSTI2026

Uncertainty guided online ensemble for non-stationary data streams in fusion science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior with distribution drifts, resulted by both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with such non-stationary data streams. Online learning techniques have been leveraged in other domains, however it has been largely unexplored for fusion applications. In this paper, we investigate online learning for continuous adaptation to drifting data streams in the prediction of Toroidal Field (TF) coils deflection at the DIII-D fusion facility. We further address the short-term performance degradation inherent to standard online learning, which arises because ground truth is unavailable at prediction time. To mitigate this issue, we propose an uncertainty-guided online ensemble framework. The method leverages the Deep Gaussian Process Approximation (DGPA) for calibrated uncertainty estimation and uses these uncertainty measures to guide a meta-algorithm that aggregates predictions from learners trained over different historical horizons. Our results show that online learning reduces prediction error by 80% compared to a static model. The online ensemble and the proposed uncertainty-guided ensemble further reduce error by approximately 6%, and 10% respectively, relative to standard single-model online learning, while also providing calibrated uncertainty estimates to support operational decision-making.

AI↗
DOE OSTI2022

Physics-Informed Gaussian Process Regression for States Estimation and Forecasting in Power Grids

Real-time state estimation and forecasting are critical for the efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian process regression (GPR), parameterized models for the prior statistics are fit by maximizing the marginal likelihood of observed data. In the PhI-GPR method, we propose to compute the prior statistics offline by solving stochastic differential equations (SDEs) governing the power grid dynamics. The short-term forecast of a power grid system dominated by wind generation is complicated by the stochastic nature of the wind and the resulting uncertainty in wind mechanical power. Here, we assume that the power grid dynamics are governed by swing equations, with the wind mechanical power fluctuating randomly in time. We solve these equations for the mean and covariances of the power grid states using the Monte Carlo simulation method. We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate observed and unobserved states. For the considered problem, PhI-GPR has computational advantages over the ensemble Kalman filter (EnKF) method: In PhI-GPR, ensembles are computed offline and independently of the data acquisition process, whereas for EnFK, ensembles are computed online with data acquisition, rendering real-time forecast more challenging. We also demonstrate that the PhI-GPR forecast is more accurate than the EnKF forecast when the random mechanical wind power is non-Markovian. In contrast, the two methods produce similar forecasts for the Markovian mechanical wind power. For observed states, we show that PhI-GPR provides a forecast comparable to the standard data-driven GPR; both forecasts are significantly more accurate than the autoregressive integrated moving average (ARIMA) forecast. We also show that the ARIMA forecast is more sensitive to observation frequency and measurement errors than the PhI-GPR forecast.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Characterizing the Reproducibility of Noisy Quantum Circuits

The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

High dimensional predictions of suicide risk in 4.2 million US Veterans using ensemble transfer learning

We present an ensemble transfer learning method to predict suicide from Veterans Affairs (VA) electronic medical records (EMR). A diverse set of base models was trained to predict a binary outcome constructed from reported suicide, suicide attempt, and overdose diagnoses with varying choices of study design and prediction methodology. Each model used twenty cross-sectional and 190 longitudinal variables observed in eight time intervals covering 7.5 years prior to the time of prediction. Ensembles of seven base models were created and fine-tuned with ten variables expected to change with study design and outcome definition in order to predict suicide and combined outcome in a prospective cohort. The ensemble models achieved c-statistics of 0.73 on 2-year suicide risk and 0.83 on the combined outcome when predicting on a prospective cohort of ~4.2 M veterans. The ensembles rely on nonlinear base models trained using a matched retrospective nested case-control (Rcc) study cohort and show good calibration across a diversity of subgroups, including risk strata, age, sex, race, and level of healthcare utilization. In addition, a linear Rcc base model provided a rich set of biological predictors, including indicators of suicide, substance use disorder, mental health diagnoses and treatments, hypoxia and vascular damage, and demographics. Similar content being viewed by others

60 APPLIED LIFE SCIENCES↗
NASA NTRS2024

Multi-Agency Ensemble Forecast of Wildfire Air Quality in the United States: Toward Community Consensus of Early Warning

Wildfires pose increasing risks to human health and properties in North America. Due to large uncertainties in fire emission, transport, and chemical transformation, it remains challenging to accurately predict air quality during wildfire events, hindering our collective capability to issue effective early warnings to protect public health and welfare. Here we present a new real-time Hazardous Air Quality Ensemble System (HAQES) by leveraging various wildfire smoke forecasts from three U.S. federal agencies (NOAA, NASA, and Navy). Compared to individual models, the HAQES ensemble forecast significantly enhances forecast accuracy. To further enhance forecasting performance, a weighted ensemble forecast approach was introduced and tested. Compared to the unweighted ensemble mean, the multilinear regression weighted ensemble reduced fractional bias by 34% in the major fire regions, false alarm rate by 72%, and increased hit rate by 17%. Finally, we improved the weighted ensemble using quantile regression and weighted regression methods to enhance the forecast of extreme air quality events. The advanced weighted ensemble increased the PM2.5 exceedance hit rate by 55% compared to the ensemble mean. Our findings provide insights into the development of advanced ensemble forecast methods for wildfire air quality, offering a practical way to enhance decision-making support to protect public health.

Yunyao Li↗
DOE OSTI2023

Modeling Intercalation Chemistry with Multiredox Reactions by Sparse Lattice Models in Disordered Rocksalt Cathodes

Modern battery materials can contain many elements with substantial site disorder, and their configurational state has been shown to be critical for their performance. The intercalation voltage profile is a critical parameter to evaluate the performance of energy storage. The application of commonly used cluster expansion techniques to model the intercalation thermodynamics of such systems ab initio is challenged by the combinatorial increase in configurational degrees of freedom as the number of species grows. Such challenges necessitate the efficient generation of lattice models without overfitting and proper sampling of the configurational space under the requirement of charge balance in ionic systems. In this work, we introduce a combined approach that addresses these challenges by (1) constructing a robust cluster expansion Hamiltonian using the sparse regression technique, including -norm regularization and structural hierarchy; and (2) implementing semigrand-canonical Monte Carlo to sample charge-balanced ionic configurations using the table-exchange method and an ensemble average approach. These techniques are applied to a disordered rocksalt oxyfluoride (LMNOF) that is part of a family of promising earth-abundant cathode materials. The simulated voltage profile is found to be in good agreement with experimental data and particularly provides a clear demonstration of the and oxygen contributions to the redox potential as a function of content.

25 ENERGY STORAGE↗
DOE OSTI2023

Computational investigation of hysteresis and phase equilibria of n-alkanes in a metal-organic framework with both micropores and mesopores

Abstract Adsorption hysteresis is a phenomenon related to phase transitions that can impact applications such as gas storage and separations in porous materials. Computational approaches can greatly facilitate the understanding of phase transitions and phase equilibria in porous materials. In this work, adsorption isotherms for methane, ethane, propane, and n-hexane were calculated from atomistic grand canonical Monte Carlo (GCMC) simulations in a metal-organic framework having both micropores and mesopores to better understand hysteresis and phase equilibria between connected pores of different size and the external bulk fluid. At low temperatures, the calculated isotherms exhibit sharp steps accompanied by hysteresis. As a complementary simulation method, canonical (NVT) ensemble simulations with Widom test particle insertions are demonstrated to provide additional information about these systems. The NVT+Widom simulations provide the full van der Waals loop associated with the sharp steps and hysteresis, including the locations of the spinodal points and points within the metastable and unstable regions that are inaccessible to GCMC simulations. The simulations provide molecular-level insight into pore filling and equilibria between high- and low-density states within individual pores. The effect of framework flexibility on adsorption hysteresis is also investigated for methane in IRMOF-1.

36 MATERIALS SCIENCE↗
NASA NTRS2006

Efficient Agent-Based Cluster Ensembles

Numerous domains ranging from distributed data acquisition to knowledge reuse need to solve the cluster ensemble problem of combining multiple clusterings into a single unified clustering. Unfortunately current non-agent-based cluster combining methods do not work in a distributed environment, are not robust to corrupted clusterings and require centralized access to all original clusterings. Overcoming these issues will allow cluster ensembles to be used in fundamentally distributed and failure-prone domains such as data acquisition from satellite constellations, in addition to domains demanding confidentiality such as combining clusterings of user profiles. This paper proposes an efficient, distributed, agent-based clustering ensemble method that addresses these issues. In this approach each agent is assigned a small subset of the data and votes on which final cluster its data points should belong to. The final clustering is then evaluated by a global utility, computed in a distributed way. This clustering is also evaluated using an agent-specific utility that is shown to be easier for the agents to maximize. Results show that agents using the agent-specific utility can achieve better performance than traditional non-agent based methods and are effective even when up to 50% of the agents fail.

Agogino, Adrian↗
DOE OSTI2021

Simulated effects of sample size and grain neighborhood on the modeling of extreme value fatigue response

Assessing the size of representative volume elements (RVEs) for fatigue-related applications is challenging. A RVE relevant to random microstructure requires a volume of material that is sufficiently large to capture the grain/phase heterogeneity that captures all statistical moments of the distribution of the driving force for fatigue crack formation at “hot spot” grains. Consequently, the large size of a microstructure RVE required to study fatigue phenomena is largely computationally intractable and difficult to explore. A more realistic objective in this work is to systematically study, as a function of the size of a statistical sample of microstructure, trends towards convergence of the simulated distribution of driving force for fatigue crack formation. Our present work accordingly leverages the recently developed open-source PRISMS-Fatigue framework to examine the trends in convergence of extreme value distributions (EVD) of Fatigue Indicator Parameters (FIPs) in progressively larger polycrystalline microstructure realizations of FCC Al alloy 7075-T6 using crystal plasticity finite element method simulations. The results are compared to the traditional method in which ensembles of statistical volume elements (SVEs) are simulated to build up statistics intended to approximate those associated with a larger volume of material. The convergence of EVDs with increase of size of a SVE of microstructure is closely related to the extent of grain nearest neighbor (NN) interactions. Accordingly, the sensitivity of the local micromechanical response at hot spot grains is quantitatively investigated by systematically varying the orientations of NN grains. Results indicate that SVEs with cubic crystallographic texture tend towards convergence of the EVD of FIPs with tens of thousands of grains while the random and rolled textures require larger volumes. Simple relationships based on microstructure parameters (e.g., Schmid Factor, grain size, NN misorientation) do not completely correlate to fatigue hot spot grains. Finally, the sensitivity of the extreme value fatigue response at hot spot grains extends to the 3rd NN when a single neighborhood grain orientation is altered.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Joint state-parameter estimation for the reduced fracture model via the united filter

Here, in this paper, we introduce an effective United Filter method for jointly estimating the solution state and physical parameters in flow and transport problems within fractured porous media. Fluid flow and transport in fractured porous media are critical in subsurface hydrology, geophysics, and reservoir geomechanics. Reduced fracture models, which represent fractures as lower-dimensional interfaces, enable efficient multi-scale simulations. However, reduced fracture models also face accuracy challenges due to modeling errors and uncertainties in physical parameters such as permeability and fracture geometry. To address these challenges, we propose a United Filter method, which integrates the Ensemble Score Filter (EnSF) for state estimation with the Direct Filter for parameter estimation. EnSF, based on a score-based diffusion model framework, produces ensemble representations of the state distribution without deep learning. Meanwhile, the Direct Filter, a recursive Bayesian inference method, estimates parameters directly from state observations. The United Filter combines these methods iteratively: EnSF estimates are used to refine parameter values, which are then fed back to improve state estimation. Numerical experiments demonstrate that the United Filter method surpasses the state-of-the-art Augmented Ensemble Kalman Filter, delivering more accurate state and parameter estimation for reduced fracture models. This framework also provides a robust and efficient solution for PDE-constrained inverse problems with uncertainties and sparse observations.

Bayesian inference↗
DOE OSTI2020

Identification of major moisture sources across the Mediterranean Basin

We employ a Lagrangian based moisture back trajectory method on an ensemble of four reanalysis datasets to provide a comprehensive understanding of moisture sources over the Mediterranean land region (30° N–49.5° N and 9.75° W–61.5° E) at seasonal timescales for 1980–2013 period. Using a source region between 10° S–71.35° N along the latitude and 80° W–84.88° E along the longitude that is subdivided into ten complimentary sub-regions, our analyses is able to backtrack up to > 90% of seasonal precipitation at each grid point within the target region. Our results indicate a significant role of moisture advected from the North Atlantic and Mediterranean Sea, and locally recycled moisture over the target region in shaping the spatial organization of seasonal precipitation. However, a clear east–west contrast is witnessed in determining the relative importance of each of these major moisture sources where the North Atlantic dictates the moisture supply over the western Mediterranean while moisture from Mediterranean Sea and local recycling play a key role over the eastern Mediterranean. Our analyses also demonstrate a major footprint of the North Atlantic Oscillation (NAO) on precipitation variability over the Mediterranean land as dynamic and thermodynamic anomalies during the negative phase of NAO match with those during wet years and vice versa. The findings reported here are generally consistent across the four reanalysis datasets. Overall, this study establishes the relative roles of adjacent and far-off oceanic and terrestrial evaporative sources over the Mediterranean land and should help in understanding the drivers of precipitation variability and change at varying timescales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Sequential ensemble transform for Bayesian inverse problems

In this work, we present the Sequential Ensemble Transform (SET) method, an approach for generating approximate samples from a Bayesian posterior distribution. The method explores the posterior distribution by solving a sequence of discrete optimal transport problems to produce a series of transport plans which map prior samples to posterior samples. We prove that the sequence of Dirac mixture distributions produced by the SET method converges weakly to the true posterior as the sample size approaches infinity. Furthermore, our numerical results indicate that, when compared to standard Sequential Monte Carlo (SMC) methods, the SET approach is more robust to the choice of Markov mutation kernels and requires less computational efforts to reach a similar accuracy when used to explore complex posterior distributions. Finally, we describe adaptive schemes that allow to completely automate the use of the SET method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗