Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating Multimodel Ensemble Seasonal Climate Forecasts on Rangeland Plant Production in the California Annual Grassland

Seasonal precipitation and temperature directly affect total plant production in the California Annual Grassland (CAG). Technological advances have resulted in skillful seasonal climate forecasts (i.e., significant correlations between actual and forecasted climate), which could be input into plant production models to inform stocking and other rangeland management decisions. This study presents a procedure for forecasting plant production in the CAG ecosystem to predict annual plant production for grazing, restoration, or other rangeland management practices using a combination of historical gridMET climate data and seasonal hindcasts (i.e., retrospective forecasts, from the North American Multi-Model Ensemble program). Further, the results of this study first confirmed high forecast skill, throughout the growing season at all sites. We also identified skillful plant production forecasts across most of the growing season at two sites and in three of the seven forecasting months at one study site. Forecasting climate and end-of-year plant production across the growing season at three CAG sites allowed us to identify the places and times in the growing season when forecasting might be most helpful in informing management decisions. Integrating plant production forecasting into rangeland management practices could significantly improve rangeland management outcomes. These procedures provide a user guide for creating plant production forecasts for any given area of interest and may be applicable across a wide range of other agricultural and rangeland management systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Predicting battery capacity from impedance at varying temperature and state of charge using machine learning

Prediction of battery health from electrochemical impedance spectroscopy (EIS) data can enable rapid measurement of battery state in real-world applications without using additional sensors or time-consuming performance measurements. However, deconvoluting the effect of capacity, state of charge, and temperature on EIS response is complicated analytically. Here, various machine-learning models, such as linear, Gaussian process, random forest, and artificial neural network regression, are utilized to predict capacity from EIS using hundreds of capacity, direct current (DC) resistance, and EIS measurements recorded under varying conditions of health, temperature, and state of charge (SOC). Several feature extraction and selection methods from traditional electrochemical analysis and statistical modeling are explored using machine-learning pipelines. EIS data from just two frequencies can accurately predict capacity, and interrogation shows that the optimal set of frequencies is not usually intuitive. Best results are achieved with an ensemble model, which predicts battery capacity with a mean absolute error of 1.9% on data from unobserved cells.

25 ENERGY STORAGE↗
DOE OSTI2023

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Threefold reduction of modeled uncertainty in direct radiative effects over biomass burning regions by constraining absorbing aerosols

Absorbing aerosols emitted from biomass burning (BB) greatly affect the radiation balance, cloudiness, and circulation over tropical regions. Assessments of these impacts rely heavily on the modeled aerosol absorption from poorly constrained global models and thus exhibit large uncertainties. By combining the AeroCom model ensemble with satellite and in situ observations, we provide constraints on the aerosol absorption optical depth (AAOD) over the Amazon and Africa. Our approach enables identification of error contributions from emission, lifetime, and MAC (mass absorption coefficient) per model, with MAC and emission dominating the AAOD errors over Amazon and Africa, respectively. In addition to primary emissions, our analysis suggests substantial formation of secondary organic aerosols over the Amazon but not over Africa. Furthermore, we find that differences in direct aerosol radiative effects between models decrease by threefold over the BB source and outflow regions after correcting the identified errors. This highlights the potential to greatly reduce the uncertainty in the most uncertain radiative forcing agent.

09 BIOMASS FUELS↗
DOE OSTI2026

Rational design of heterogeneous single-site catalysts via surface organometallic chemistry

Single-site heterogeneous catalysts offer an attractive route to unite the molecular precision of homogeneous catalysis with the durability and practical advantages of solids. Surface organometallic chemistry (SOMC) provides a particularly powerful strategy for this purpose by grafting molecular precursors onto tailored surfaces and converting support functionalities into ligand environments for isolated metal centers. As a result, SOMC brings the language and logic of coordination chemistry to heterogeneous catalysis, where the support becomes an integral part of the active site coordination sphere. This Review surveys recent progress in the rational design of SOMC-derived single-site catalysts, with emphasis on synthetic routes, post synthetic transformations, and the deliberate tuning of catalytic behavior through metal-support interactions. Discussions are made on how support identity, hydroxyl topology, acidity, and redox activity shape the geometry, electronic structure, and oxidation state of supported metal sites, as well as how these factors determine activity, selectivity, and stability. We also examine a central limitation of these systems: despite their molecularly informed design, supported single sites often exist as structurally distributed ensembles rather than uniform species, particularly on amorphous supports. This site heterogeneity, along with catalyst dynamics under operating conditions, remains a major barrier to definitive structure-activity relationships. Therefore, emerging approaches that combine advanced characterization, first-principles modeling, ensemble kinetics, and machine learning to resolve active-site structure and guide catalyst development are highlighted. Together, these advances position SOMC as a versatile coordination chemistry framework for the predictive design of heterogeneous catalysts with well-defined molecularly tailored active sites.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Addressing uncertainty in genome-scale metabolic model reconstruction and analysis

The reconstruction and analysis of genome-scale metabolic models constitutes a powerful systems biology approach, with applications ranging from basic understanding of genotype-phenotype mapping to solving biomedical and environmental problems. However, the biological insight obtained from these models is limited by multiple heterogeneous sources of uncertainty, which are often difficult to quantify. Here we review the major sources of uncertainty and survey existing approaches developed for representing and addressing them. A unified formal characterization of these uncertainties through probabilistic approaches and ensemble modeling will facilitate convergence towards consistent reconstruction pipelines, improved data integration algorithms, and more accurate assessment of predictive capacity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Quantifying the Known Unknown: Including Marine Sources of Greenhouse Gases in Climate Modeling

Researchers have recently estimated that Arctic submarine permafrost currently traps 60 billion tons of methane and contains 560 billion tons of organic carbon in seafloor sediments and soil, a giant pool of carbon with potentially large feedbacks on the climate system. Unlike terrestrial permafrost, the submarine permafrost system has remained a “known unknown” because of the difficulty in acquiring samples and measurements. Consequently, this potentially large carbon stock never yet considered in global climate models or policy discussions, represents a real wildcard in our understanding of Earth’s climate. This report summarizes our group’s effort at developing a numerical modeling framework designed to produce a first-of-its-kind estimate of Arctic methane gas releases from the marine sediments to the water column, and potentially to the atmosphere, where positive climate feedback may occur. Newly developed modeling capability supported by the Laboratory Directed Research and Development (LDRD) program at Sandia National Laboratories now gives us the ability to probabilistically map gas distribution and quantity in the seabed by using a hybrid approach of geospatial machine learning, and predictive numerical thermodynamic ensemble modeling. The novelty in this approach is its ability to produce maps of useful data in regions that are only sparsely sampled, a common challenge in the Arctic, and a major obstacle to progress in the past. By applying this model to the circum-Arctic continental shelves and integrating the flux of free gas from in situ methanogenesis and dissociating gas hydrates from the sediment column under climate forcing, we can provide the most reliable estimate of a spatially and temporally varying source term for greenhouse gas flux that can be used by global oceanographic circulation and Earth system models (such as DOE’s E3SM). The result will allow us to finally tackle the wildcard of the submarine permafrost carbon system, and better inform us about the severity of future national security threats that sustained climate change poses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Remote effects of Tibetan Plateau spring land temperature on global subseasonal to seasonal precipitation prediction and comparison with effects of sea surface temperature: the GEWEX/LS4P Phase I experiment

The prediction skill for precipitation anomalies in late spring and summer months—a significant component of extreme climate events—has remained stubbornly low for years. This paper presents a new idea that utilizes information on boreal spring land surface temperature/subsurface temperature (LST/SUBT) anomalies over the Tibetan Plateau (TP) to improve prediction of subsequent summer droughts/floods over several regions over the world, East Asia and North America in particular. The work was performed in the framework of the GEWEX/LS4P Phase I (LS4P-I) experiment, which focused on whether the TP LST/SUBT provides an additional source for subseasonal-to-seasonal (S2S) predictability. The summer 2003, when there were severe drought/flood over the southern/northern part of the Yangtze River basin, respectively, has been selected as the focus case. With the newly developed LST/SUBT initialization method, the observed surface temperature anomaly over the TP has been partially produced by the LS4P-I model ensemble mean, and 8 hotspot regions in the world were identified where June precipitation is significantly associated with anomalies of May TP land temperature. Consideration of the TP LST/SUBT effect has produced about 25–50% of observed precipitation anomalies in most hotspot regions. The multiple models have shown more consistency in the hotspot regions along the Tibetan Plateau-Rocky Mountain Circumglobal (TRC) wave train. The mechanisms for the LST/SUBT effect on the 2003 drought over the southern part of the Yangtze River Basin are discussed. For comparison, the global SST effect has also been tested and 6 regions with significant SST effects were identified in the 2003 case, explaining about 25–50% of precipitation anomalies over most of these regions. This study suggests that the TP LST/SUBT effect is a first-order source of S2S precipitation predictability, and hence it is comparable to that of the SST effect. With the completion of the LS4P-I, the LS4P-II has been launched and the LS4P-II protocol is briefly presented.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Sensor Reduction for Diversion Detection in a Realistic Heat Pipe Microreactor Using Supervised Machine Learning

Microreactors are designed as a smaller, cheaper, and safer alternative to traditional nuclear power plants. Their non-traditional characteristics and prospect of mass production and deployment will likely require new approaches to nuclear safeguards. The primary proliferation concern with microreactors is the diversion of fuel material. Such diversion may produce measurable defects in key physical attributes like neutron flux, which may in turn be detectable using machine learning models. Preliminary work has demonstrated this ability for modeled nominal and diversion scenarios using large quantities of energy integrated neutron flux data. In practice, the number of available sensors for such measurements will be limited and energy integrated flux information will not be available. This work explores the ability of tree-based gradient boosted ensemble models to classify a given microreactor core is nominal or diversion, and determine the number of fuel pins diverted in the case of diversion with reduced numbers of sensors and more realistic detector responses. Classification accuracy of greater than 98% and regression errors as low as 5% of the total number of fuel pins were achieved with as few as 15 sensors, compared to 99% and 4.1% with a maximum of 240 sensors.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Domain knowledge-informed, process-mapping AI graph for designing Fe-based alloys

<span style="font-family: Calibri, sans-serif; font-size: 12pt;">Continuous improvement in efficiency of a power plant relies on designing materials for use at increasingly higher temperature and/or pressure, for 100,000s hours of operation. Due to complexity, non-linearity and high-dimensionality of the problem, traditional Machine Learning (ML) approaches require unreasonably large datasets for the data-driven model development. Science-based material and process engineering complements hard data with, sometimes soft and intuitive, empirical domain knowledge. Artificial Intelligence (AI) was used in this study to incorporate such knowledge into computational graph architecture (process-mimicking artificial neuron design, causal layer and graph structures, ensemble modeling of latent states) and learning procedures (variable transformation, fuzzy physics pre-training and freezing of deep layers, virtual microstructure representation, and adversarial multi-objective optimization). The first alloys design pathways suggested by the AI tool (pyroMind) passed a preliminary engineering review on soundness and transparency.</span>

Romanov, Vyacheslav↗
DOE OSTI2021

Evaluating Variable‐Resolution CESM Over China and Western United States for Use in Water‐Energy Nexus and Impacts Modeling

Abstract Climate models are critical tools to study earth system processes and are often further downscaled to provide refined‐resolution data sets for regional water‐energy impact analyses. In this study, the Variable‐Resolution Community Earth System Model (VR‐CESM), a new dynamical downscaling method, is employed to generate 1/8° simulations for China and the western United States over 1970–2006. Precipitation, temperature, snowpack, radiation, and wind speed are compared with two 1° global climate models, regional climate model ensemble, and reference data sets to evaluate their fidelity. Simulated precipitation skill is dependent upon the reference data sets used, a slight (<+10%) and spatially consistent wet bias in China during summer and the western United States during winter. Precipitation bias in VR‐CESM is the smallest among models and demonstrates the added value provided by resolution refinement. However, temperature biases are generally greater than precipitation due to more complicated interactions among processes. VR‐CESM simulates +2°C warm bias in the low‐elevation regions in China but −2°C cold bias in mountains. However, DJF cold bias (−2.23°C to−3.37°C) and JJA warm bias (+1.13°C to +1.87°C) exist in the western United States. The modeling skills of precipitation and temperature at various topographies are similar in the two evaluated regions. The cold bias was likely affected by downward shortwave radiation deficit (−15%) and slow bias of surface wind speeds (−16% to −29%). Despite the wet and cold bias, snow water equivalent and snow cover are underestimated in mountains. We conclude that VR‐CESM outperforms other models evaluated and provides the best estimation of downscaled climate model data for water‐energy studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The Arctic LDRD project: What happened?

This presentation overviews results from the 2019 LDRD Reserve project “Diagnosing near-future changes in Arctic sea ice and ocean conditions” and a follow-up 2020 CSES Rapid Response project “Multi- Model Risk Assessment for Arctic Navigability.” We analyzed Arctic simulations from 4 CMIP6 model ensembles (E3SM, CESM-CAM, CESM-WACCM and CESM-DPLE), comparing them with observations. We then applied a machine-learning approach using copulas to produce joint probabilities of adverse conditions along potential shipping transit routes through the Arctic. Here we compare and contrast the different models and examine the utility of the copula approach applied to these data sets.

58 GEOSCIENCES↗
DOE OSTI2024

Tropical Interbasin Interaction as Effective Predictors of Late-Spring Precipitation Variability in the Southern Great Plains

Abstract The southern Great Plains experience fluctuating precipitation extremes that significantly impact agriculture and water management. Despite ongoing efforts to enhance forecast accuracy, the underlying causes of these climatic phenomena remain inadequately understood. This study elucidates the relative influence of the tropical Pacific and Atlantic basins on April–May–June precipitation variability in this region. Our partial ocean assimilation experiments using the Community Earth System Model unveil the prominent role of interbasin interaction, with the Pacific and Atlantic contributing approximately 70% and 30%, respectively, to these interbasin contrasts. Our statistical analyses suggest that these tropical interbasin contrasts could serve as a more reliable indicator for late-spring precipitation anomalies than El Niño–Southern Oscillation. The conclusions are reinforced by analyses of seven climate forecasting systems within the North American Multi-Model Ensemble, offering an optimistic outlook for enhancing real-time forecasting of late-spring precipitation in the southern plains. However, the current predictive skills of the interbasin contrasts across the prediction systems are hindered by the lower predictability of the tropical Atlantic Ocean, pointing to the need for future research to refine climate prediction models further. Significance Statement Agriculture and infrastructure in the southern plains face challenges from severe late-spring precipitation extremes. Traditional predictors like El Niño–Southern Oscillation (ENSO) lose effectiveness during the critical spring-to-summer transition, creating a forecasting gap. This study introduces the concept of tropical interbasin interactions, known to enhance seasonal predictability for late-spring precipitation in the southern plains. Novel climate model experiments highlight contributions from the tropical Pacific and Atlantic, offering a promising predictability that potentially surpasses the limitations of ENSO-based predictions. These outcomes hold the potential for developing operational forecasts of late-spring precipitation anomalies in the southern plains, enabling proactive risk management.

Chikamoto, Yoshimitsu↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models: Preprint

Uncertainty visualization is a key component in translating important insights from ensemble data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models for computationally expensive simulations, users can interact with more aspects of data spaces than ever before. However, the integration of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble visualization↗
DOE OSTI2025

A structured framework for predicting sustainable aviation fuel properties using liquid-phase FTIR and machine learning

Sustainable aviation fuels have the potential to improve efficiency, reduce emissions, and enhance energy security. To help identify viable sustainable aviation fuels and accelerate research, machine learning models have been developed to predict relevant physicochemical properties. However, many models have limited applicability, leverage data from complex analytical techniques with confined spectral ranges, or use feature decomposition methods that offer limited interpretability. Using liquid-phase Fourier Transform Infrared (FTIR) spectra, this study presents a structured method for creating accurate and interpretable property prediction models for neat molecules, aviation fuels, and blends. Liquid FTIR spectra can be collected quickly and consistently, offering high reliability, sensitivity, and component specificity using less than 2 ml of sample. The method first decomposes FTIR spectra into fundamental building blocks using non-negative matrix factorization (NMF) to enable scientific analysis of FTIR spectra attributes and fuel properties. The NMF features are then used to create five ensemble models for predicting final boiling point, flash point, freezing point, density at 15°C, and kinematic viscosity at -20°C. All models were trained using experimental property data from neat molecules, aviation fuels, and blends. The models accurately predict key properties across a broad range of neat molecules and representative fuels and blends, while enabling interpretation of relationships between compositional elements, such as functional groups or chemical classes, and their resulting properties. This demonstrates strong potential to support sustainable aviation fuel research and development. The models and data are available on an interactive web tool.

Fourier transform infrared spectroscopy↗
DOE OSTI2022

Increases in Future AR Count and Size: Overview of the ARTMIP Tier 2 CMIP5/6 Experiment

Abstract The Atmospheric River (AR) Tracking Method Intercomparison Project (ARTMIP) is a community effort to systematically assess how the uncertainties from AR detectors (ARDTs) impact our scientific understanding of ARs. This study describes the ARTMIP Tier 2 experimental design and initial results using the Coupled Model Intercomparison Project (CMIP) Phases 5 and 6 multi‐model ensembles. We show that AR statistics from a given ARDT in CMIP5/6 historical simulations compare remarkably well with the MERRA‐2 reanalysis. In CMIP5/6 future simulations, most ARDTs project a global increase in AR frequency, counts, and sizes, especially along the western coastlines of the Pacific and Atlantic oceans. We find that the choice of ARDT is the dominant contributor to the uncertainty in projected AR frequency when compared with model choice. These results imply that new projects investigating future changes in ARs should explicitly consider ARDT uncertainty as a core part of the experimental design.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Flower‐Type Organized Trade‐Wind Cumulus: A Multi‐Day Lagrangian Large Eddy Simulation Intercomparison Study

Shallow cumulus cloud fields in subtropical marine trade wind environments, particularly over the tropical Atlantic Ocean, show distinct organizational patterns. Among these, Flower‐type clouds are characterized by expansive stratiform cloud patches surrounded by regions of scattered convection. The objectives of this study were (a) to construct a case study of a time period during the EUREC 4 A/ATOMIC field campaign when Flower‐type organization was observed, (b) to evaluate the fidelity of a multi‐model ensemble of large eddy simulations of that case, and (c) to analyze the interaction between cloud and precipitation processes and mesoscale organization in the simulations. The simulations follow a quasi‐Lagrangian trajectory, allowing mesoscale features to develop over time in a domain that follows the boundary‐layer airmass. The results show a broad agreement in simulated thermodynamic properties across different LES codes, with Flower‐type cloud patches appearing within hours of each other. The consensus among models is consistent with observations made during the EUREC 4 A/ATOMIC field campaign on the specific day of interest. The cloud structure reveals three distinct peaks in the joint probability densities of cloud base and cloud top height, with the dominant peak at any given time influenced by the stage of cloud organization. The simulated cloud system evolution reveals consistent occurrence of maxima in liquid water path and rain rate before Flower reaches its maximum length scale. Targeted sensitivity tests reveal a weak relationship between Cloud Droplet Number concentration and the extent/degree/type of organization.

EUREC4A↗
DOE OSTI2021

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗