Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Catalytic Activity of an Ensemble of Sites for CO 2 Hydrogenation to Methanol on a ZrO 2 -on-Cu Inverse Catalyst

The significant increase in CO 2 emissions from heavy fossil fuel utilization has raised serious concerns, highlighting the need for effective methods to convert CO 2 into value-added chemicals. Here, in this work, we report a computational investigation on the catalytic activity of ZrO 2 -on-Cu inverse catalysts for CO 2 hydrogenation to methanol, considering highly dispersed ZrO 2 trimers on Cu (111). Such clusters present a large ensemble of formate-containing configurations, Zr 3 O n (OH) m (OCHO) l , making the evaluation of the catalytic activity very challenging. We found that the sites on the various catalyst configurations exhibit markedly different activities for formate hydrogenation, despite their similar free energy and composition. To understand these differences in reactivity, we examined the structural and electronic nature of the low free-energy catalyst configurations and identified that the energy of the lowest unoccupied orbital of the reacting formate, modified by its binding with the catalytic site, is a descriptor for the reaction energy of the formate hydrogenation step. From there, we screened an ensemble of catalyst structures using this descriptor to predict highly active metastable catalyst configurations and computed the reaction pathways and transition states for formate hydrogenation. From this investigation, we distinguished reactive from nonreactive sites and formate species on the ZrO 2 /Cu inverse catalyst based on structural and electronic features. We showed that rare metastable configurations control the activity. Additionally, an efficient method for examining the reactivity of a large number of coexisting catalyst structures was developed.

catalysts↗
DOE OSTI2022

MISPR : an open-source package for high-throughput multiscale molecular simulations

Computational tools provide a unique opportunity to study and design optimal materials by enhancing our ability to comprehend the connections between their atomistic structure and functional properties. However, designing materials with tailored functionalities is complicated due to the necessity to integrate various computational-chemistry software (not necessarily compatible with one another), the heterogeneous nature of the generated data, and the need to explore vast chemical and parameter spaces. The latter is especially important to avoid bias in scattered data points-based models and derive statistical trends only accessible by systematic datasets. Here, we introduce a robust high-throughput multi-scale computational infrastructure coined MISPR (Materials Informatics for Structure–Property Relationships) that seamlessly integrates classical molecular dynamics (MD) simulations with density functional theory (DFT). By enabling high-performance data analytics and coupling between different methods and scales, MISPR addresses critical challenges arising from the needs of automated workflow management and data provenance recording. The major features of MISPR include automated DFT and MD simulations, error handling, derivation of molecular and ensemble properties, and creation of output databases that organize results from individual calculations to enable reproducibility and transparency. In this work, we describe fully automated DFT workflows implemented in MISPR to compute various properties such as nuclear magnetic resonance chemical shift, binding energy, bond dissociation energy, and redox potential with support for multiple methods such as electron transfer and proton-coupled electron transfer reactions. The infrastructure also enables the characterization of large-scale ensemble properties by providing MD workflows that calculate a wide range of structural and dynamical properties in liquid solutions. MISPR employs the methodologies of materials informatics to facilitate understanding and prediction of phenomenological structure–property relationships, which are crucial to designing novel optimal materials for numerous scientific applications and engineering technologies.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluating the performance of random forest and iterative random forest based methods when applied to gene expression data

Gene-to-gene networks, such as Gene Regulatory Networks (GRN) and Predictive Expression Networks (PEN) capture relationships between genes and are beneficial for use in downstream biological analyses. There exists multiple network inference tools to produce these gene-to-gene networks from matrices of gene expression data. Random Forest-Leave One Out Prediction (RF-LOOP) is a method that has been shown to be efficient at producing these gene-to-gene networks, frequently known as GEne Network Inference with Ensemble of trees (GENIE3). Random Forest can be replaced in this process by iterative Random Forest (iRF), which performs variable selection and boosting. Here we validate that iterative Random Forest-Leave One Out Prediction (iRF-LOOP) produces higher quality networks than GENIE3 (RF-LOOP). We use both synthetic and empirical networks from the Dialogue for Reverse Engineering Assessment and Methods (DREAM) Challenges by Sage Bionetworks, as well as two additional empirical networks created from Arabidopsis thaliana and Populus trichocarpa expression data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Mapping variations of redshift distributions with probability integral transforms

We present a method for mapping variations between probability distribution functions and apply this method within the context of measuring galaxy redshift distributions from imaging survey data. This method, which we name PITPZ for the probability integral transformations it relies on, uses a difference in curves between distribution functions in an ensemble as a transformation to apply to another distribution function, thus transferring the variation in the ensemble to the latter distribution function. This procedure is broadly applicable to the problem of uncertainty propagation. In the context of redshift distributions, for example, the uncertainty contribution due to certain effects can be studied effectively only in simulations, thus necessitating a transfer of variation measured in simulations to the redshift distributions measured from data. We illustrate the use of PITPZ by using the method to propagate photometric calibration uncertainty to redshift distributions of the Dark Energy Survey Year 3 weak lensing source galaxies. For this test case, we find that PITPZ yields a lensing amplitude uncertainty estimate due to photometric calibration error within 1 per cent of the truth, compared to as much as a 30 per cent underestimate when using traditional methods.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Matrix Approach to Accelerate Spin-Up of CLM5

Numerical models have been developed to investigate and understand responses of biogeochemical cycle to global changes. Steady state, when a system is in dynamic equilibrium, is generally required to initialize these model simulations. However, the spin-up process that is used to achieve steady state pose a great burden to computational resources, limiting the efficiency of global modeling analysis on biogeochemical cycles. This study introduces a new Semi-Analytical Spin-Up (SASU) to tackle this grand challenge. We applied SASU to Community Land Model version 5 and examined its computational efficiency and accuracy. At the Brazil site, SASU is computationally 7 times more efficient than (or saved up to 86% computational cost in comparison with) the traditional native dynamics (ND) spin-up to reach the same steady state. Globally, SASU is computationally 8 times more efficient than the accelerated decomposition spin-up and 50 times more efficient than ND. In summary, SASU achieves the highest computational efficiency for spin-up on site and globally in comparison with other spin-up methods. It is generalizable to wide biogeochemical models and thus makes computationally costly studies (e.g., parameter perturbation ensemble analysis and data assimilation) possible for a better understanding of biogeochemical cycle under climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

27 AlNMR chemical shift of Al(OH)$^{-}_{4}$ calculated from first principles: Assessment of error cancellation in chemically distinct reference and target systems

Predicting accurate nuclear magnetic resonance chemical shieldings relies upon cancellation of different types of errors between the theoretically calculated shielding constant of the analyte of interest and the reference. Often, the intrinsic error in computed shieldings due to basis sets, approximations in the Hamiltonian, description of the wave function, and dynamic effects is nearly identical between the analyte and reference, yet if the electronic structure or sensitivity to local environment differs dramatically, this cannot be taken for granted. Detailed prior work has examined the octahedral trivalent cation Al(H 2 O)$^{3+}_{6}$, accounting for ab initio intrinsic errors. However, the use of this species as a reference for the chemically distinct tetrahedral anion Al(OH)$^{-}_{4}$ requires an understanding of how these errors cancel, in order to define the limits of accurately predicting 27 Al chemical shielding in Al(OH)$^{-}_{4}$. In this work, we estimate the absolute shielding of the 27 Al nucleus in Al(OH)$^{-}_{4}$ at the coupled cluster level (515.1± 5.3 ppm). Shielding sensitivity to the choice of method approximation and atomic basis sets used has been evaluated. Solvent and thermal effects are assessed through ensemble averaging techniques using ab-initio molecular dynamics. The contribution of each type of intrinsic error is assessed for the Al(H 2 O)$^{3+}_{6}$ and Al(OH)$^{-}_{4}$ ions, revealing significant differences that fundamentally hamper the ability to accurately calculate the 27 Al chemical shift of Al(OH)$^{-}_{4}$ from first principles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Calculating adsorption isotherms using the two-phase thermodynamic method and molecular dynamics simulations

We describe the calculation of adsorption isotherms from molecular dynamics simulations based on the two-phase thermodynamic (2PT) model. The 2PT model developed for bulk fluid phases treats the gas-like components as hard spheres (HSs), which correctly recovers the limiting behaviors of unconfined fluids. We showed that this treatment, however, does not always lead to the correct zero-loading behavior in strongly confining systems. For methane adsorption into zeolite MFI, the HS reference state underestimates entropy by up to 20% at low loadings and leads to an order-of-magnitude increase in the adsorption onset pressure. To fix these issues, we propose the use of ideal adsorbed gas (IAG) as the gas reference model, the properties of which can be computed using the Widom insertion method on an empty adsorbent. We further describe three routes to compute adsorption isotherms from the Helmholtz free energy at different loadings. Comparing against established Monte Carlo (MC) methods, we found that the adsorption isotherms obtained using the IAG reference state agrees to within 40%, which corresponds to deviations of <5% in adsorption free energy. The isotherms calculated using the HS reference state underestimate the adsorption uptake at low to medium loadings in strongly confining systems, but its accuracy improves at higher loadings and as the pore size increases relative to the sorbate diameter. The methods described here provide an alternative approach for computing adsorption isotherms when MC simulations in an open ensemble are undesirable and enable a direct comparison of computed adsorption thermodynamics with experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Analytical integration of the tractions induced by non-singular dislocations on an arbitrary shaped triangular quadratic element

Here, an analytical model is proposed to evaluate the nodal force induced by a segment of dislocation upon an arbitrary shaped triangular element. This calculation is required in hybrid methods that associate dislocation dynamics to boundary or finite element to solve simultaneously the evolution of large ensembles of dislocations with complex boundary conditions. Nodal forces are defined as the triple integration of the unbalanced traction field induced by a straight dislocation upon the surface of the element. Following our previous approach (Queyreau et al 2014 Modelling Simul. Mater. Sci. Eng. 22 035004) on a simpler geometry and in the case of linear isotropic elasticity, triple integrals are solved by sequences of integration by parts that exhibit recurrence relations. The traction field is defined and finite everywhere even at the core of dislocations, thanks to the use of the non-singular stress expression formulated by Cai et al (2006 J. Mech. Phys. Solids 54 561–587). The nodal force expressions can be used when considering both a single convolution or double convolution of the Green's function with the core distribution. A solution is also proposed for the case of a semi-infinite segment through the study of the asymptotic behavior of the analytical expressions. The proposed approach is exact and very computationally efficient. The choice of an arbitrary shaped triangular element and quadratic shape functions allow the consideration of complex geometries and comply with automatic meshing procedures. These analytical expressions could also be employed to estimate dislocation interactions with interfaces.

42 ENGINEERING↗
DOE OSTI2022

Continental United States may lose 1.8 petagrams of soil organic carbon under climate change by 2100

Abstract Aims High‐resolution information on soils’ vulnerability to climate‐induced soil organic carbon (SOC) loss can enable environmental scientists, land managers, and policy makers to develop targeted mitigation strategies. This study aims to estimate baseline and decadal changes in continental US surface SOC stocks under future emission scenarios. Location Continental United States. Time period 2014–2100. Methods We used recent SOC field observations ( n = 6,213 sites), environmental factors ( n = 32), and an ensemble machine learning (ML) approach to estimate baseline SOC stocks in surface soils across the continental United States at 100‐m spatial resolution, and decadal changes under the projected climate scenarios of Coupled Model Intercomparison Project Phase Six (CMIP6) earth system models (ESMs). Results Baseline SOC projections from ML approaches captured more than 50% of variability in SOC observations, whereas ESMs represented only 6–16% of observed SOC variability. ML estimates showed a mean total loss of 1.8 Pg C from US surface soils under the high‐emission scenario by 2100, whereas ESMs showed no significant change in SOC stocks with wide variation among ESMs. Both ML and ESM predictions agree on the direction of SOC change (net emissions or sequestration) across 46–51% of continental US land area. These differences are attributable to the high‐resolution site‐specific data used in the ML models compared to the relatively coarse grid represented in CMIP6 ESMs. Main conclusions Our high‐resolution estimates of baseline SOC stocks, identification of key environmental controllers, and projection of SOC changes from US land cover types under future climate scenarios suggest the need for high‐resolution simulations of SOC in ESMs to represent the heterogeneity of SOC. We found that the SOC change is sensitive to key soil related factors (e.g. soil drainage and soil order) that have not been historically considered as input parameters in ESMs, because currently more than 95% variability in the SOC of CMIP6 ESMs is controlled by net primary productivity, temperature, and precipitation. Using additional environmental factors to estimate the baseline SOC stocks and predict the future trajectory of SOC change can provide more accurate results.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1972

Determination of bulk properties of tropical cloud clusters from large scale heat and moisture budgets, appendix B

The bulk properties of tropical cloud clusters, as the vertical mass flux, the excess temperature, and moisture and the liquid water content of the clouds, are determined from a combination of the observed large-scale heat and moisture budgets over an area covering the cloud cluster, and a model of a cumulus ensemble which exchanges mass, heat, vapor and liquid water with the environment through entrainment and detrainment. The method also provides an understanding of how the environmental air is heated and moistened by the cumulus convection. An estimate of the average cloud cluster properties and the heat and moisture balance of the environment, obtained from 1956 Marshall Islands data, is presented.

Yanai, M.↗
NASA NTRS2013

Simultaneous Estimation of Model State Variables and Observation and Forecast Biases Using a Two-Stage Hybrid Kalman Filter

In this paper, we present a two-stage hybrid Kalman filter to estimate both observation and forecast bias in hydrologic models, in addition to state variables. The biases are estimated using the discrete Kalman filter, and the state variables using the ensemble Kalman filter. A key issue in this multi-component assimilation scheme is the exact partitioning of the difference between observation and forecasts into state, forecast bias and observation bias updates. Here, the error covariances of the forecast bias and the unbiased states are calculated as constant fractions of the biased state error covariance, and the observation bias error covariance is a function of the observation prediction error covariance. In a series of synthetic experiments, focusing on the assimilation of discharge into a rainfall-runoff model, it is shown that both static and dynamic observation and forecast biases can be successfully estimated. The results indicate a strong improvement in the estimation of the state variables and resulting discharge as opposed to the use of a bias-unaware ensemble Kalman filter. Furthermore, minimal code modification in existing data assimilation software is needed to implement the method. The results suggest that a better performance of data assimilation methods should be possible if both forecast and observation biases are taken into account.

Data Assimilation↗
NASA NTRS2017

Aerosol EnKF at GMAO

In the GEOS near real-time system, as well as in MERRA-2 which is the latest reanalysis produced at NASAs Global Modeling and Assimilation Office(GMAO), the assimilation of aerosol observations is performed by means of a so-called analysis splitting method. In line with the transition of the GEOS meteorological data assimilation system to a hybrid Ensemble-Variational formulation, we are updating the aerosol component of our assimilation system to an ensemble square root filter(EnSRF; Whitaker and Hamill (2002)) type of scheme.We present a summary of our preliminary results of the assimilation of column integrated aerosol observations (Aerosol Optical Depth; AOD) using an Ensemble Square Root Filters (EnSRF) scheme and the ensemble members produced routinely by the meteorological assimilation.

MERRA-2 EnSRF↗
DOE OSTI2021

Unleashing the Power of Industrial Big Data through Scalable Manual Labeling

Big Data plays a central role in the remarkable results achieved by Machine Learning (ML) and especially Deep Learning (DL) in the recent years. However, the difficulty in obtaining a reasonable amount of labeled samples limits ML/DL application in various domains, including industrial equipment and system monitoring. In this paper the need for methods that turn manual labeling into a scalable process is highlighted. A real world problem is analyzed for which weak supervision methods, successfully employed in other domains, did not produce acceptable results. An alternative approach based on clustering ensembles is described and tested, achieving good performance.

Paes Leao, Bruno↗
DOE OSTI2022

QRF4P-NRT: Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates Using Quantile Regression Forests

Accurate and reliable near-real-time satellite precipitation estimation is of great importance for operational large-scale flood forecasting and drought monitoring. The state-of-the-art precipitation post-processing model is based on a deterministic approach to construct relationships between satellites estimates and ground observations. We propose a probabilistic postprocessor, the Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates using Quantile Regression Forests (QRF4P-NRT), based on quantile modeling, yielding both deterministic and probabilistic predictions. The experimental design incorporates different solutions of near-real-time predictors to further improve the model performance. Using the Integrated Multi-satellitE Retrievals Early Run for Global Precipitation Measurement Mission (IMERG-E) product as an example, we illustrate that the proposed method significantly improves the overall quality of the raw IMERG-E and is also superior to the bias-corrected product (IMERG Final Run, IMERG-F) at daily scale in a complex mountain basin. Evaluations of the corrected IMERG-E, raw IMERG-E, and IMERG-F using ground observation show that the corrected IMERG-E improves correlation coefficients (0.7), mean error (-0.14 mm/day) and root mean square error (3.3 mm/day) relative to the raw IMERG-E (0.31, -0.72 and 5.5 mm/day) and IMERG-F (0.34, -0.09 and 6.0 mm/day). The error decomposition further confirms that the QRF4P-NRT improves on the various deficiencies of the raw IMERG-E product. The ensemble assessment also demonstrates that the quantile outputs provide reliable prediction spread and sharp prediction intervals. The promising results indicate the great potential of the proposed method for probabilistic post-processing for near-real-time satellite precipitation estimates, and for further applications such as hydrological ensemble forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Operator learning for energy-efficient building ventilation control with computational fluid dynamics simulation of a real-world classroom

Energy-efficient ventilation control plays an important role in reducing building energy consumption while ensuring occupant health and comfort. While Computational Fluid Dynamics (CFD) simulations provide detailed and physically accurate representations of indoor airflow, their high computational cost limits their use in real-time building control. In this work, we present a neural operator learning framework that combines the physical accuracy of CFD with the computational efficiency of machine learning to enable building ventilation control with the high-fidelity fluid dynamics models. Our method jointly optimizes the airflow supply rates and vent angles to reduce energy use and adhere to air quality constraints. We train an ensemble of neural operator transformer models to learn the mapping from building control actions to airflow fields using high-resolution CFD data. This learned neural operator is then embedded in an optimization-based control framework for building ventilation control. Experimental results show that our approach achieves significant energy savings compared to maximum airflow rate control, rule-based control, as well as data-driven control methods using spatially averaged CO 2 prediction and deep learning–based reduced-order models, while consistently maintaining safe indoor air quality. These results highlight the practicality and scalability of our method in maintaining energy efficiency and indoor air quality in real-world buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Crystal Orientation and Defect Mapping in Electron-Beam-Sensitive Zeolites with Near-Axis Transmission Kikuchi Diffraction

Porous materials are vital in catalysis, energy conversion, and environmental remediation. Understanding structural heterogeneity in zeolites is key to linking synthesis, framework intergrowths, and catalytic performance, yet current methods for phase identification and spatial mapping lack sufficient resolution or throughput. We present a high-throughput approach using near-axis transmission Kikuchi diffraction in a scanning electron microscope, achieving high phase and spatial resolution for electron-beam-sensitive zeolites, including ZSM-5 and, for the first time, Zeolite A. Here, this method enables direct visualization of intergrowth features that critically affect catalytic and adsorption behavior, bridging the gap between ensemble-averaged X-ray diffraction and high-resolution but low-throughput transmission electron microscopy. Combining nanoscale mapping with statistical sampling is highly suited for machine-learning pipelines guiding new structure function understanding and could be extended to other beam-sensitive porous materials such as metal–organic or covalent–organic frameworks.

crystallography↗
DOE OSTI2021

A consensus-based ensemble approach to improve transcriptome assembly

Systems-level analyses, such as differential gene expression analysis, co-expression analysis, and metabolic pathway reconstruction, depend on the accuracy of the transcriptome. Multiple tools exist to perform transcriptome assembly from RNAseq data. However, assembling high quality transcriptomes is still not a trivial problem. This is especially the case for non-model organisms where adequate reference genomes are often not available. Different methods produce different transcriptome models and there is no easy way to determine which are more accurate. Furthermore, having alternative-splicing events exacerbates such difficult assembly problems. While benchmarking transcriptome assemblies is critical, this is also not trivial due to the general lack of true reference transcriptomes. In this study, we first provide a pipeline to generate a set of the simulated benchmark transcriptome and corresponding RNAseq data. Using the simulated benchmarking datasets, we compared the performance of various transcriptome assembly approaches including both de novo and genome-guided methods. The results showed that the assembly performance deteriorates significantly when alternative transcripts (isoforms) exist or for genome-guided methods when the reference is not available from the same genome. To improve the transcriptome assembly performance, leveraging the overlapping predictions between different assemblies, we present a new consensus-based ensemble transcriptome assembly approach, ConSemble. Without using a reference genome, ConSemble using four de novo assemblers achieved an accuracy up to twice as high as any de novo assemblers we compared. When a reference genome is available, ConSemble using four genome-guided assemblies removed many incorrectly assembled contigs with minimal impact on correctly assembled contigs, achieving higher precision and accuracy than individual genome-guided methods. Furthermore, ConSemble using de novo assemblers matched or exceeded the best performing genome-guided assemblers even when the transcriptomes included isoforms. We thus demonstrated that the ConSemble consensus strategy both for de novo and genome-guided assemblers can improve transcriptome assembly. The RNAseq simulation pipeline, the benchmark transcriptome datasets, and the script to perform the ConSemble assembly are all freely available from: http://bioinfolab.unl.edu/emlab/consemble/.

59 BASIC BIOLOGICAL SCIENCES↗