Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Global Carbon Budget 1800-2018 Loss of Additional Sink Capacity and Present Transient Difference

A dataset of two global carbon fluxes: the loss of additional sink capacity (LASC) and present versus transient difference (PTD). The loss of additional sink capacity is the loss of indirect anthropogenic sink capacity in land ecosystems caused by the loss of ecosystems that can increase carbon in response to changing environments, primarily forests. The present transient difference refers to the direct anthropogenic flux in land ecosystems (from land cover and land use change) and the difference in that flux when calculated assuming "present day" (actually more like 1980) ecosystem carbon stocks or when calculated assuming transient carbon stocks (i.e. caused by environmental change). In this dataset, the LASC and PTD fluxes were calculated using the TRENDY ensemble of Dynamic Global Vegetation Models (DGVMs; Sitch et al., 2024) following the methods described therein and in Obermeier et al. (2021). For further details see Obermeier et al. (2021), Friedlingstein et al. (2019), Sitch et al. (2024), and Walker et al. (2025). The dataset includes ensemble means and standard deviations for annual fluxes, fluxes cumulated annually over the whole time period, and cumulated since 1959. These data were originally collected to compare different approaches (DGVMs versus bookkeeping models) for estimating land use and land cover change (LULCC) emissions (Obermeier et al. 2021). More recently, and similarly, these data were used to harmonize the estimates of the direct and indirect anthropogenic fluxes in the global carbon cycle and to recalculate the global carbon budget (Walker et al., 2025).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

coh3

CoH3 (CoH ver.3) is an optical model, exciton pre-equilibrium, and Hauser-Feshbach statistical model code, which calculates nuclear reaction cross sections for medium to heavy targets in the keV to MeV energy region. This program is written in standard C++, divided into approximately 200 source and header files. CoH solves the Schroedinger equation for optical potentials defined in the code, and calculates differential elastic scattering, reaction, and total cross sections, for neutron, proton, deuteron, triton, 3He, and alpha-particle. Deformed optical potentials are solved with the coupled-channels method, in which the ground state rotational band members, or vibrational phonon states are coupled. The optical model gives particle transmission coefficients that are fed into the statistical model calculations. CoH includes the pre-equilibrium model (exciton model), the direct/semidirect capture model, and the multi-stage Hauser-Feshbach statistical decay with width fluctuation correction based on the Gaussian orthogonal ensemble. For weakly coupled levels, the DWBA (distorted wave Born approximation) method is used to calculate the direct inelastic scattering process to the excited states.

Kawano, Toshihiko↗
DOE OSTI2021

Scalable statistical inference of photometric redshift via data subsampling

Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for bigger problems. But full probabilistic statistical models often outperform other models in quantifying uncertainties associated with model predictions. We develop a data-driven statistical modeling framework that combines the uncertainties from an ensemble of statistical models learned on smaller subsets of data carefully chosen to account for imbalances in the input space. We demonstrate this method on a photometric redshift estimation problem in cosmology, which seeks to infer a distribution of the redshift—the stretching effect in observing the light of far-away galaxies—given multivariate color information observed for an object in the sky. Our proposed method performs balanced partitioning, graph-based data subsampling across the partitions, and training of an ensemble of Gaussian process models.

data subsampling↗
NASA NTRS1980

Project FIRES. Volume 4: Prototype Protective Ensemble Qualification Test Report, Phase 1B

The qualification testing of a prototype firefighter's protective ensemble is documented. Included are descriptions of the design requirements, the testing methods, and the test apparatus. The tests include measurements of individual subsystem characteristics in areas relating to both physical testing, such as heat, flame, impact penetration and human factors testing, such as dexterity, grip, and mobility. Also, measurements related to both physical and human factors testing of the complete ensemble, such as water protection, metabolic expenditures, and compatibility are considered.

Abeles, F. J.↗
DOE OSTI2022

Hybrid quantum-classical simulations of magic angle spinning dynamic nuclear polarization in very large spin systems

Solid-state nuclear magnetic resonance can be enhanced using unpaired electron spins with a method known as dynamic nuclear polarization (DNP). Fundamentally, DNP involves ensembles of thousands of spins, a scale that is difficult to match computationally. This scale prevents us from gaining a complete understanding of the spin dynamics and applying simulations to design sample formulations. We recently developed an ab initio model capable of calculating DNP enhancements in systems of up to ~1000 nuclei; however, this scale is insufficient to accurately simulate the dependence of DNP enhancements on radical concentration or magic angle spinning (MAS) frequency. We build on this work by using ab initio simulations to train a hybrid model that makes use of a rate matrix to treat nuclear spin diffusion. We show that this model can reproduce the MAS rate and concentration dependence of DNP enhancements and build-up time constants. Finally, we then apply it to predict the DNP enhancements in core–shell metal-organic-framework nanoparticles and reveal new insights into the composition of the particles’ shells.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1987

Conditionally-averaged structures in wall-bounded turbulent flows

The quadrant-splitting and the wall-shear detection techniques were used to obtain ensemble-averaged wall layer structures. The two techniques give similar results for Q4 events, but the wall-shear method leads to smearing of Q2 events. Events were found to maintain their identity for very long times. The ensemble-averaged structures scale with outer variables. Turbulence producing events were associated with one dominant vortical structure rather than a pair of counter-rotating structures. An asymmetry-preserving averaging scheme was devised that allowed a picture of the average structure which more closely resembles the instantaneous one, to be obtained.

Guezennec, Yann G.↗
DOE OSTI2024

Sequential Kalman tuning of the t -preconditioned Crank-Nicolson algorithm: efficient, adaptive and gradient-free inference for Bayesian inverse problems

Ensemble Kalman Inversion (EKI) has been proposed as an efficient method for the approximate solution of Bayesian inverse problems with expensive forward models. However, when applied to the Bayesian inverse problem EKI is only exact in the regime of Gaussian target measures and linear forward models. Here, in this work we propose embedding EKI and Flow Annealed Kalman Inversion, its normalizing flow (NF) preconditioned variant, within a Bayesian annealing scheme as part of an adaptive implementation of the t-preconditioned Crank-Nicolson (tpCN) sampler. The tpCN sampler differs from standard pCN in that its proposal is reversible with respect to the multivariate t-distribution. The more flexible tail behaviour allows for better adaptation to sampling from non-Gaussian targets. Within our Sequential Kalman Tuning (SKT) adaptation scheme, EKI is used to initialize and precondition the tpCN sampler for each annealed target. The subsequent tpCN iterations ensure particles are correctly distributed according to each annealed target, avoiding the accumulation of errors that would otherwise impact EKI. We demonstrate the performance of SKT for tpCN on three challenging numerical benchmarks, showing significant improvements in the rate of convergence compared to adaptation within standard SMC with importance weighted resampling at each temperature level, and compared to similar adaptive implementations of standard pCN. The SKT scheme applied to tpCN offers an efficient, practical solution for solving the Bayesian inverse problem when gradients of the forward model are not available. Code implementing the SKT schemes for tpCN is available at https://github.com/RichardGrumitt/KalmanMC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Combining Emergent Constraints for Climate Sensitivity

A method is proposed for combining information from several emergent constraints into a probabilistic estimate for a climate sensitivity proxy Y such as equilibrium climate sensitivity (ECS). The method is based on fitting a multivariate Gaussian PDF for Y and the emergent constraints using an ensemble of global climate models (GCMs); it can be viewed as a form of multiple linear regression of Y on the constraints. The method accounts for uncertainties in sampling this multidimensional PDF with a small number of models, for observational uncertainties in the constraints, and for overconfidence about the correlation of the constraints with the climate sensitivity. Its general form (Method C) accounts for correlations between the constraints. Method C becomes less robust when some constraints are too strongly related to each other; this can be mitigated using regularization approaches such as ridge regression. An illuminating special case, Method U, neglects any correlations between constraints except through their mutual relationship to the climate proxy; it is more robust to small GCM sample size and is appealingly interpretable. These methods are applied to ECS and the climate feedback parameter using a previously published set of 11 possible emergent constraints derived from climate models in the Coupled Model Intercomparison Project (CMIP). The ±2σ posterior range of ECS for Method C with no overconfidence adjustment is 4.3 ± 0.7 K. For Method U with a large overconfidence adjustment, it is 4.0 ± 1.3 K. This study adds confidence to past findings that most constraints predict higher climate sensitivity than the CMIP mean.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Distilling Knowledge from Ensembles of Cluster-Constrained-Attention Multiple-Instance Learners for Whole Slide Image Classification

The peculiar nature of whole slide imaging (WSI), digitizing conventional glass slides to obtain multiple high resolution images which capture microscopic details of a patient’s histopathological features, has garnered increased interest from the computer vision research community over the last two decades. Given the unique computational space and time complexity inherent to gigapixel-size whole slide image data, researchers have proposed novel machine learning algorithms to aid in the performance of diagnostic tasks in clinical pathology. One effective algorithm represents a Whole slide image as a bag of smaller image patches, which can be represented as low-dimension image patch embeddings. Weakly supervised deep-learning methods, such as cluster-constrained-attention multiple instance learning (CLAM), have shown promising results when combined with image patch embeddings. While traditional ensemble classifiers yield improved task performance, such methods come with a steep cost in model complexity. Through knowledge distillation, it is possible to retain some performance improvements from an ensemble, while minimizing costs to model complexity. In this work, we implement a weakly supervised ensemble using clustering-constrained-attention multiple-instance learners (CLAM), which uses attention and instance-level clustering to identify task salient regions and feature extraction in whole slides. By applying logit-based and attention-based knowledge distillation, we show it is possible to retain some performance improvements resulting from the ensemble at zero cost to model complexity.

Alamudun, Folami↗
NASA NTRS1998

Ensembles of radial basis function networks for spectroscopic detection of cervical precancer

The mortality related to cervical cancer can be substantially reduced through early detection and treatment. However, current detection techniques, such as Pap smear and colposcopy, fail to achieve a concurrently high sensitivity and specificity. In vivo fluorescence spectroscopy is a technique which quickly, noninvasively and quantitatively probes the biochemical and morphological changes that occur in precancerous tissue. A multivariate statistical algorithm was used to extract clinically useful information from tissue spectra acquired from 361 cervical sites from 95 patients at 337-, 380-, and 460-nm excitation wavelengths. The multivariate statistical analysis was also employed to reduce the number of fluorescence excitation-emission wavelength pairs required to discriminate healthy tissue samples from precancerous tissue samples. The use of connectionist methods such as multilayered perceptrons, radial basis function (RBF) networks, and ensembles of such networks was investigated. RBF ensemble algorithms based on fluorescence spectra potentially provide automated and near real-time implementation of precancer detection in the hands of nonexperts. The results are more reliable, direct, and accurate than those achieved by either human experts or multivariate statistical algorithms.

Cervix Neoplasms/pathology↗
DOE OSTI2021

Galaxy Zoo DECaLS: Detailed visual morphology measurements from volunteers and deep learning for 314,000 galaxies

We present Galaxy Zoo DECaLS: detailed visual morphological classifications for Dark Energy Camera Legacy Survey images of galaxies within the SDSS DR8 footprint. Deeper DECaLS images (r = 23.6 versus r = 22.2 from SDSS) reveal spiral arms, weak bars, and tidal features not previously visible in SDSS imaging. To best exploit the greater depth of DECaLS images, volunteers select from a new set of answers designed to improve our sensitivity to mergers and bars. Galaxy Zoo volunteers provide 7.5 million individual classifications over 314 000 galaxies. 140 000 galaxies receive at least 30 classifications, sufficient to accurately measure detailed morphology like bars, and the remainder receive approximately 5. All classifications are used to train an ensemble of Bayesian convolutional neural networks (a state-of-the-art deep learning method) to predict posteriors for the detailed morphology of all 314 000 galaxies. We use active learning to focus our volunteer effort on the galaxies which, if labelled, would be most informative for training our ensemble. When measured against confident volunteer classifications, the trained networks are approximately 99 per cent accurate on every question. Morphology is a fundamental feature of every galaxy; our human and machine classifications are an accurate and detailed resource for understanding how galaxies evolve.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2013

Direct Simulation of Extinction in a Slab of Spherical Particles

The exact multiple sphere superposition method is used to calculate the coherent and incoherent contributions to the ensemble-averaged electric field amplitude and Poynting vector in systems of randomly positioned nonabsorbing spherical particles. The target systems consist of cylindrical volumes, with radius several times larger than length, containing spheres with positional configurations generated by a Monte Carlo sampling method. Spatially dependent values for coherent electric field amplitude, coherent energy flux, and diffuse energy flux, are calculated by averaging of exact local field and flux values over multiple configurations and over spatially independent directions for fixed target geometry, sphere properties, and sphere volume fraction. Our results reveal exponential attenuation of the coherent field and the coherent energy flux inside the particulate layer and thereby further corroborate the general methodology of the microphysical radiative transfer theory. An effective medium model based on plane wave transmission and reflection by a plane layer is used to model the dependence of the coherent electric field on particle packing density. The effective attenuation coefficient of the random medium, computed from the direct simulations, is found to agree closely with effective medium theories and with measurements. In addition, the simulation results reveal the presence of a counter-propagating component to the coherent field, which arises due to the internal reflection of the main coherent field component by the target boundary. The characteristics of the diffuse flux are compared to, and found to be consistent with, a model based on the diffusion approximation of the radiative transfer theory.

spheres↗
DOE OSTI2023

Atomistic learning in the electronically grand-canonical ensemble

Abstract A strategy is presented for the machine-learning emulation of electronic structure calculations carried out in the electronically grand-canonical ensemble. The approach relies upon a dual-learning scheme, where both the system charge and the system energy are predicted for each image. The scheme is shown to be capable of emulating basic electrochemical reactions at a range of potentials, and coupling it with a bootstrap-ensemble approach gives reasonable estimates of the prediction uncertainty. The method is also demonstrated to accelerate saddle-point searches, and to extrapolate to systems with one to five water layers. We anticipate that this method will allow for larger length- and time-scale simulations necessary for electrochemical simulations.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Spatial pattern of lake evaporation increases under global warming linked to regional hydroclimate change

Abstract Lakes are critical natural resources that are vulnerable to climate change. In a warmer climate, lake evaporation is projected to increase globally, but with substantial variation between regions. Here, based on ensemble projections of climate and lake models and an attribution method, we show that future lake evaporation increase is strongly modulated by regional hydroclimate change. Specifically, a drying hydroclimate will amplify evaporation increase by enlarging surface vapor pressure deficit and reducing cloud shortwave reflection. Future lake evaporation increase is amplified in tropical America, the Mediterranean and Southeast China with drier future hydroclimates, and dampened in high latitudes and the Tibetan Plateau with wetter future hydroclimates. Such spatially coupled changes in lake evaporation and hydroclimate have important implications on regional lake water balance and volume change, which can aggravate water scarcity and flood risks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Penalized ensemble Kalman filters for high dimensional non-linear systems

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the well-known Kalman filter. However, its performance can suffer when the ensemble size is smaller than the state space, as is often necessary for computationally burdensome models. This scenario means that the empirical estimate of the state covariance is not full rank and possibly quite noisy. To solve this problem in this high dimensional regime, we propose a computationally fast and easy to implement algorithm called the penalized ensemble Kalman filter (PEnKF). Under certain conditions, it can be theoretically proven that the PEnKF will be accurate (the estimation error will converge to zero) despite having fewer ensemble members than state dimensions. Further, as contrasted to localization methods, the proposed approach learns the covariance structure associated with the dynamical system. These theoretical results are supported with simulations of several non-linear and high dimensional systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2003

Project trades model for complex space missions

A Project Trades Model (PTM) is a collection of tools/simulations linked together to rapidly perform integrated system trade studies of performance, cost, risk, and mission effectiveness. An operating PTM captures the interactions between various targeted systems and subsystems through an exchange of computed variables of the constituent models. Selection and implementation of the order, method of interaction, model type, and envisioned operation of the ensemble of tools rpresents the key system engineering challenge of the approach. This paper describes an approach to building a PTM and using it to perform top-level system trades for a complex space mission. In particular, the PTM discussed here is for a future Mars mission involving a large rover.

web services↗
NASA NTRS2009

Advances in Land Data Assimilation at the NASA Goddard Space Flight Center

Research in land surface data assimilation has grown rapidly over the last decade. In this presentation we provide a brief overview of key research contributions by the NASA Goddard Space Flight Center (GSFC). The GSFC contributions to land assimilation primarily include the continued development and application of the Land Information System (US) and the ensemble Kalman filter (EnKF). In particular, we have developed a method to generate perturbation fields that are correlated in space, time, and across variables and that permit the flexible modeling of errors in land surface models and observations, along with an adaptive filtering approach that estimates observation and model error input parameters. A percentile-based scaling method that addresses soil moisture biases in model and observational estimates opened the path to the successful application of land data assimilation to satellite retrievals of surface soil moisture. Assimilation of AMSR-E surface soil moisture retrievals into the NASA Catchment model provided superior surface and root zone assimilation products (when validated against in situ measurements and compared to the model estimates or satellite observations alone). The multi-model capabilities of US were used to investigate the role of subsurface physics in the assimilation of surface soil moisture observations. Results indicate that the potential of surface soil moisture assimilation to improve root zone information is higher when the surface to root zone coupling is stronger. Building on this experience, GSFC leads the development of the Level 4 Surface and Root-Zone Soil Moisture (L4_SM) product for the planned NASA Soil-Moisture-Active-Passive (SMAP) mission. A key milestone was the design and execution of an Observing System Simulation Experiment that quantified the contribution of soil moisture retrievals to land data assimilation products as a function of retrieval and land model skill and yielded an estimate of the error budget for the SMAP L4_SM product. Terrestrial water storage observations from GRACE satellite system were also successfully assimilated into the NASA Catchment model and provided improved estimates of groundwater variability when compared to the model estimates alone. Moreover, satellite-based land surface temperature (LST) observations from the ISCCP archive were assimilated using a bias estimation module that was specifically designed for LST assimilation. As with soil moisture, LST assimilation provides modest yet statistically significant improvements when compared to the model or satellite observations alone. To achieve the improvement, however, the LST assimilation algorithm must be adapted to the specific formulation of LST in the land model. An improved method for the assimilation of snow cover observations was also developed. Finally, the coupling of LIS to the mesoscale Weather Research and Forecasting (WRF) model enabled investigations into how the sensitivity of land-atmosphere interactions to the specific choice of planetary boundary layer scheme and land surface model varies across surface moisture regimes, and how it can be quantified and evaluated against observations. The on-going development and integration of land assimilation modules into the Land Information System will enable the use of GSFC software with a variety of land models and make it accessible to the research community.

Reichle, Rolf↗
NASA NTRS2023

Observational Constraints Reduce Model Spread but Not Uncertainty in Global Wetland Methane Emission Estimates

The recent rise in atmospheric methane (CH 4 ) concentrations accelerates climate change and offsets mitigation efforts. Although wetlands are the largest natural CH 4 source, estimates of global wetland CH 4 emissions vary widely among approaches taken by bottom-up (BU) process-based biogeochemical models and top-down (TD) atmospheric inversion methods. Here, we integrate in situ measurements, multi-model ensembles, and a machine learning upscaling product into the International Land Model Benchmarking system to examine the relationship between wetland CH 4 emission estimates and model performance. We find that using better-performing models identified by observational constraints reduces the spread of wetland CH 4 emission estimates by 62% and 39% for BU- and TD-based approaches, respectively. However, global BU and TD CH 4 emission estimate discrepancies increased by about 15% (from 31 to 36 TgCH 4 year −1 ) when the top 20% models were used, although we consider this result moderately uncertain given the unevenly distributed global observations. Our analyses demonstrate that model performance ranking is subject to benchmark selection due to large inter-site variability, highlighting the importance of expanding coverage of benchmark sites to diverse environmental conditions. We encourage future development of wetland CH 4 models to move beyond static benchmarking and focus on evaluating site-specific and ecosystem-specific variabilities inferred from observations.

Kuang-Yu Chang↗