SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

All sources NASA NTRS DOE OSTI

DOE OSTI2025

DeepHyper: A Python Package for Massively Parallel Hyperparameter Optimization in Machine Learning

Machine learning models are increasingly applied across scientific disciplines, yet their effectiveness often hinges on heuristic decisions—such as data transformations, training strategies, and model architectures—that are not learned by the models themselves. Automating the selection of these heuristics and analyzing their sensitivity is crucial for building robust and efficient learning workflows. DeepHyper addresses this challenge by democratizing hyperparameter optimization, providing accessible tools to streamline and enhance machine learning workflows from a laptop to the largest supercomputer in the world. Building on top of hyperparameter optimization, it unlocks new capabilities around ensembles of models for improved accuracy and uncertainty quantification. All of these organized around efficient parallel computing.

ensemble↗

DOE OSTI2020

The Evolving Distribution of Relative Humidity Conditional Upon Daily Maximum Temperature in a Warming Climate

Abstract The impacts of heat waves in a warming climate depend not only on changing temperatures but also on changing humidity. Using 35 simulations from the Community Earth System Model Large Ensemble (CESM LENS), we investigate the long‐term evolution of the joint distribution of summer relative humidity (RH) and daily maximum temperature ( Tmax ) near four U.S. cities (New York City, Chicago, Phoenix, and New Orleans) under the high‐emissions Representative Concentration Pathway (RCP) 8.5. We estimate the conditional quantiles of RH given Tmax with quantile regression models, using functions of temperature for each city in July for three time periods (1990–2005, 2026–2035, and 2071–2080). Quality‐of‐fit diagnostics indicate that these models accurately estimate conditional quantiles for each city. As expected, each quantile of Tmax increases from 1990–2005 to 2071–2080, while mean RH decreases modestly. Conditional upon a fixed quantile of Tmax , the median and high quantiles of RH decrease, while those of the Heat Index (HI) and dew point both increase. This result suggests that, despite a modest decrease in median relative humidity, heat stress measured by metrics considering both humidity and temperature in a warming climate will increase faster than that measured by temperatures alone would indicate. For a fixed Tmax , the high quantiles of RH (and thus of HI and dew point) increase from 1990–2005 to 2071–2080 in all four cities. This result suggests that the heat stress of a day at a given Tmax will increase in a warming climate due to the increase of RH.

Yuan, Jiacan↗

NASA NTRS2003

Simulated KWAJEX Convective Systems Using a 2D and 3D Cloud Resolving Model and Their Comparisons with Radar Observations

The 1999 Kwajalein Atoll field experiment (KWAJEX), one of several major TRMM (Tropical Rainfall Measuring Mission) field experiments, has successfully obtained a wealth of information and observation data on tropical convective systems over the western Central Pacific region. In this paper, clouds and convective systems that developed during three active periods (Aug 7-12, Aug 17-21, and Aug 29-Sep 13) around Kwajalein Atoll site are simulated using both 2D and 3D Goddard Cumulus Ensemble (GCE) models. Based on numerical results, the clouds and cloud systems are generally unorganized and short lived. These features are validated by radar observations that support the model results. Both the 2D and 3D simulated rainfall amounts and their stratiform contribution as well as the heat, water vapor, and moist static energy budgets are examined for the three convective episodes. Rainfall amounts are quantitatively similar between the two simulations, but the stratiform contribution is considerably larger in the 2D simulation. Regardless of dimension, fo all three cases, the large-scale forcing and net condensation are the two major physical processes that account for the evolution of the budgets with surface latent heat flux and net radiation solar and long-wave radiation)being secondary processes. Quantitative budget differences between 2D and 3D as well as between various episodes will be detailed.Morover, simulated radar signatures and Q1/Q2 fields from the three simulations are compared to each other and with radar and sounding observations.

Shie, Chung-Lin↗

DOE OSTI2021

Trade-offs between individual and ensemble forecasts of an emerging infectious disease

Probabilistic forecasts play an indispensable role in answering questions about the spread of newly emerged pathogens. However, uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among alternative model structures and assumptions. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about human mobility, spatiotemporal variation in transmission potential, and the number of virus introductions. We found that which model assumptions had the most ensemble weight changed through time. We additionally identified a trade-off whereby some individual models outperformed ensemble models early in the epidemic, but on average the ensembles outperformed all individual models. Our results suggest that multiple models spanning uncertainty across alternative assumptions are necessary to obtain robust forecasts for emerging infectious diseases.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2006

Precipitation processes developed during TOGA COARE (1992), GATE (1974), SCSMEX (1998), and KWAJEX (1999): 3D Cloud Resolving Model Simulation

Real clouds and cloud systems are inherently three-dimensional (3D). Because of the limitations in computer resources, however, most cloud-resolving models (CRMs) today are still two-dimensional (2D). A few 3D CRMs have been used to study the response of clouds to large-scale forcing. In these 3D simulations, the model domain was small, and the integration time was 6 hours. Only recently have 3D experiments been performed for multi-day periods for tropical cloud systems with large horizontal domains at the National Center for Atmospheric Research (NCAR), NOAA GFDL, the U.K. Met. Office, Colorado State University and NASA Goddard Space Flight Center. An improved 3D Goddard Cumulus Ensemble (GCE) model was recently used to simulate periods during TOGA COARE (December 19-27, 1992), GATE (september 1-7, 1974), SCSMEX (May 18-26, June 2-11, 1998) and KWAJEX (August 7-13, August 18-21, and August 29-September 12, 1999) using a 512 by 512 km domain and 41 vertical layers. The major objectives of this paper are: (1) to identify the differences and similarities in the simulated precipitation processes and their associated surface and water energy budgets in TOGA COARE, GATE, KWAJEX, and SCSMEX, and (2) to asses the impact of microphysics, radiation budget and surface fluxes on the organization of convection in tropics.

Tao, W.-K.↗

DOE OSTI2024

OT Operational Anomaly Detection (OAD) T&D + DER

The growth of utility-scale renewable energy resources, distributed energy resources (DER), and transportation electrification has increased uncertainty and cybersecurity risks in power grids. The Purdue Enterprise Reference Architecture model which is widely adopted by the utility industry is now insufficient to protect the power grid against cyber-attacks. There is a need to identify what cybersecurity model is effective on Energy Management System (EMS), Advanced Distribution Management System (ADMS), and DER Management System (DERMS) to address the fundamental cybersecurity challenges in the age of increasing renewable energy and DER share as well as consumer participation in the electric energy industry. The next generation of cybersecurity model for OT network should be able to detect inside attackers, mitigate the cybersecurity risks arising from the new grid participants including DER aggregators, electric vehicle owners, and behind-the-meter consumers outside the utility company, and develop the strategy to trust consumer measurement data. This panel will discuss the challenges and pathways for the development of an ensemble cybersecurity model based on predictive state estimation to detect cybersecurity anomalies in OT network including EMS, ADMS, and DERMS.

cybersecurity↗

NASA NTRS2010

Forced and Unforced Variability of Twentieth Century North American Droughts and Pluvials

Research on the forcing of drought and pluvial events over North America is dominated by general circulation model experiments that often have operational limitations (e.g., computational expense, ability to simulate relevant processes, etc). We use a statistically based modeling approach to investigate sea surface temperature (SST) forcing of the twentieth century pluvial (1905-1917) and drought (1932-1939, 1948-1957, 1998-2002) events. A principal component (PC) analysis of Palmer Drought Severity Index (PDSI) from the North American Drought Atlas separates the drought variability into five leading modes accounting for 62% of the underlying variance. Over the full period spanning these events (1900-2005), the first three PCs significantly correlate with SSTs in the equatorial Pacific (PC 1), North Pacific (PC 2), and North Atlantic (PC 3), with spatial patterns (as defined by the empirical orthogonal functions) consistent with our understanding of North American drought responses to SST forcing. We use a large ensemble statistical modeling approach to determine how successfully we can reproduce these drought/pluvial events using these three modes of variability. Using Pacific forcing only (PCs 1-2), we are able to reproduce the 1948-1957 drought and 1905-1917 pluvial above a 95% random noise threshold in over 90% of the ensemble members; the addition of Atlantic forcing (PCs 1-2-3) provides only marginal improvement. For the 1998-2002 drought, Pacific forcing reproduces the drought above noise in over 65% of the ensemble members, with the addition of Atlantic forcing increasing the number passing to over 80%. The severity of the drought, however, is underestimated in the ensemble median, suggesting this drought intensity can only be achieved through internal variability or other processes. Pacific only forcing does a poor job of reproducing the 1932-1939 drought pattern in the ensemble median, and less than one third of ensemble members exceed the noise threshold (28%). Inclusion of Atlantic forcing improves the ensemble median drought pattern and nearly doubles the number of ensemble members passing the noise threshold (52%). Even with the inclusion of Atlantic forcing, the intensity of the simulated 1932-1939 drought is muted, and the drought itself extends too far into the southwest and southern Great Plains. To an even greater extent than the 1998-2002 drought, these results suggest much of the variance in the 1932-1939 drought is dependent on processes other than SST forcing. This study highlights the importance of internal noise and non SST processes for hydroclimatic variability over North America, complementing existing research using general circulation models.

Cook, Benjamin I.↗

DOE OSTI2022

Precipitation trends determine future occurrences of compound hot–dry events

Compound hot–dry events—co-occurring hot and dry extremes—frequently cause damages to human and natural systems, often exceeding separate impacts from heatwaves and droughts. Strong increases in the occurrence of these events are projected with warming, but associated uncertainties remain large and poorly understood. Here, using climate model large ensembles, we show that mean precipitation trends exclusively modulate the future occurrence of compound hot–dry events over land. This occurs because local warming will be large enough that future droughts will always coincide with at least moderately hot extremes, even in a 2°C warmer world. By contrast, precipitation trends are often weak and equivocal in sign, depending on the model, region and internal climate variability. Therefore, constraining regional precipitation trends will also constrain future compound hot–dry events. These results help to assess future frequencies of other compound extremes characterized by strongly different trends in the drivers.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2012

A Comparison of Perturbed Initial Conditions and Multiphysics Ensembles in a Severe Weather Episode in Spain

Ensembles of numerical model forecasts are of interest to operational early warning forecasters as the spread of the ensemble provides an indication of the uncertainty of the alerts, and the mean value is deemed to outperform the forecasts of the individual models. This paper explores two ensembles on a severe weather episode in Spain, aiming to ascertain the relative usefulness of each one. One ensemble uses sensible choices of physical parameterizations (precipitation microphysics, land surface physics, and cumulus physics) while the other follows a perturbed initial conditions approach. The results show that, depending on the parameterizations, large differences can be expected in terms of storm location, spatial structure of the precipitation field, and rain intensity. It is also found that the spread of the perturbed initial conditions ensemble is smaller than the dispersion due to physical parameterizations. This confirms that in severe weather situations operational forecasts should address moist physics deficiencies to realize the full benefits of the ensemble approach, in addition to optimizing initial conditions. The results also provide insights into differences in simulations arising from ensembles of weather models using several combinations of different physical parameterizations.

severe weather↗

DOE OSTI2022

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗

DOE OSTI2021

Adaptive resource allocation for surrogate modeling of systems comprised of multiple disciplines with varying fidelity

We present an adaptive algorithm for constructing surrogate models for integrated systems composed of a set of coupled components. With this goal we introduce ‘coupling’ variables with a priori unknown distributions that allow approximations of each component to be built independently. Once built, the surrogates of the components are combined and used to predict system-level quantities of interest (QoI) at a fraction of the cost of interrogating the full system model. We use a greedy experimental design procedure, based upon a modification of Multi-Index Stochastic Collocation (MISC), to minimize the error of the combined surrogate. This is achieved by refining each component surrogate in accordance with its relative contribution to error in the approximation of the system-level QoI. Our adaptation of MISC is a multi-fidelity procedure that can leverage ensembles of models of varying cost and accuracy, for one or more components, to produce estimates of system-level QoI. Several numerical examples demonstrate the efficacy of the proposed approach on systems involving feed-forward and feedback coupling. For a fixed computational budget, the proposed algorithm is able to produce approximations that are orders of magnitude more accurate than approximations that treat the integrated system as a black-box.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2010

Integrating Enhanced Grace Terrestrial Water Storage Data Into the U.S. and North American Drought Monitors

NASA's Gravity Recovery and Climate Experiment (GRACE) satellites measure time variations nf the Earth's gravity field enabling reliable detection of spatio-temporal variations in total terrestrial water storage (TWS), including ground water. The U.S. and North American Drought Monitors are two of the premier drought monitoring products available to decision-makers for assessing and minimizing drought impacts, but they rely heavily on precipitation indices and do not currently incorporate systematic observations of deep soil moisture and groundwater storage conditions. Thus GRACE has great potential to improve the Drought Monitors hy filling this observational gap. Horizontal, vertical and temporal disaggregation of the coarse-resolution GRACE TWS data has been accomplished by assimilating GRACE TWS anomalies into the Catchment Land Surface Model using ensemble Kalman smoother. The Drought Monitors combine several short-term and long-term drought indices and indicators expressed in percentiles as a reference to their historical frequency of occurrence for the location and time of year in question. To be consistent, we are in the process of generating a climatology of estimated soil moisture and ground water based on m 60-year Catchment model simulation which will subsequently be used to convert seven years of GRACE assimilated fields into soil moisture and groundwater percentiles. for systematic incorporation into the objective blends that constitute Drought Monitor baselines. At this stage we provide a preliminary evaluation of GRACE assimilated Catchment model output against independent datasets including soil moisture observations from Aqua AMSR-E and groundwater level observations from the U.S. Geological Survey's Groundwater Climate Response Network.

Housborg, Rasmus↗

NASA NTRS2008

Evaluation of Long-Term Cloud-Resolving Model Simulations Using Satellite Radiance Observations and Multi-Frequency Satellite Simulators

This paper proposes a methodology known as the Tropical Rainfall Measuring Mission (TRMM) Triple-Sensor Three-step Evaluation Framework (T3EF) for the systematic evaluation of precipitating cloud types and microphysics in a cloud-resolving model (CRM). T3EF utilizes multi-frequency satellite simulators and novel statistics of multi-frequency radiance and backscattering signals observed from the TRMM satellite. Specifically, T3EF compares CRM and satellite observations in the form of combined probability distributions of precipitation radar (PR) reflectivity, polarization-corrected microwave brightness temperature (Tb), and infrared Tb to evaluate the candidate CRM. T3EF is used to evaluate the Goddard Cumulus Ensemble (GCE) model for cases involving the South China Sea Monsoon Experiment (SCSMEX) and Kwajalein Experiment (KWAJEX). This evaluation reveals that the GCE properly captures the satellite-measured frequencies of different precipitating cloud types in the SCSMEX case but underestimates the frequencies of deep convective and deep stratiform types in the KWAJEX case. Moreover, the GCE tends to simulate excessively large and abundant frozen condensates in deep convective clouds as inferred from the overestimated GCE-simulated radar reflectivities and microwave Tb depressions. Unveiling the detailed errors in the GCE s performance provides the best direction for model improvements.

Matsui, Toshihisa↗

DOE OSTI2022

The temperature-dependent conformational ensemble of SARS-CoV-2 main protease (M pro )

The COVID-19 pandemic, instigated by the SARS-CoV-2 coronavirus, continues to plague the globe. The SARS-CoV-2 main protease, or M pro , is a promising target for the development of novel antiviral therapeutics. Previous X-ray crystal structures of M pro were obtained at cryogenic temperature or room temperature only. Here we report a series of high-resolution crystal structures of unliganded M pro across multiple temperatures from cryogenic to physiological, and another at high humidity. We interrogate these data sets with parsimonious multiconformer models, multi-copy ensemble models, and isomorphous difference density maps. Our analysis reveals a perturbation-dependent conformational landscape for M pro , including a mobile zinc ion interleaved between the catalytic dyad, mercurial conformational heterogeneity at various sites including a key substrate-binding loop, and a far-reaching intramolecular network bridging the active site and dimer interface. Our results may inspire new strategies for antiviral drug development to aid preparation for future coronavirus pandemics.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2004

The Impact of Model Configuration and Large-Scale, Upper-Level Forcing on CRM- Simulated Convective Systems

Real clouds and cloud systems are inherently three-dimensional (3D). Because of the limitations in computer resources, however, most cloud-resolving models (CRMs) today are still two-dimensional (2D, see a brief review by Tao 2003). Only recently have 3D experiments been performed for multi-day periods for tropical cloud systems with large horizontal domains at the National Center for Atmospheric Research, at NOAA GFDL, at the U. K. Met. Office, at Colorado State University and at NASA Goddard Space Flight Center (Tao 2003). At Goddard, a 3D Goddard Cumulus Ensemble (GCE) model was used to simulate periods during TOGA COARE (December 19-27, 1992), GATE (September 1-7, 1974), SCSMEX (June 2-11, 1998), ARM (June 26-30, 1997) and KWAJEX (August 7-13, August 18-21, and August 29-September 12, 1999) using a 512 by 512 km domain (with 2-km resolution). The results indicate that surface precipitation and latent heating profiles are similar between the 2D and 3D GCE model simulations. However, there are difference in radiation, surface fluxes and precipitation characteristics. The 2D GCE model was used to perform a long-term integration on ARM/GCSS case 4 (22 days at the ARM Southern Great Plains site in March 2000). Preliminary results showed a large temperature bias in the upper troposphere that had not been seen in previous tropical cases. The major objectives of this paper are: (1) to determine the sensitivities to model configuration (i.e., 2D in west-east, south-north or 3D), (2) to identify the differences and similarities in the organization and entrainment rates of convection between 2D- and 3D-simulated ARM cloud systems, and (3) assess the impact of upper tropospheric forcing on tropical and ARM case 4 cases.

Tao, W.-K.↗

NASA NTRS2004

The Impact of Model Configuration and Large-Scale, Upper-Level Forcing on CRM-Simulated Convective Systems

Real clouds and cloud systems are inherently three-dimensional (3D). Because of the limitations in computer resources, however, most cloud-resolving models (CRMs) today are still two-dimensional (2D, see a brief review by Tao 2003). Only recently have 3D experiments been performed for multi-day periods for tropical cloud systems with large horizontal domains at the National Center for Atmospheric Research, at NOAA GFDL, at the U. K. Met. Office, at Colorado State University and at NASA Goddard Space Flight Center (Tao 2003). At Goddard, a 3D Goddard Cumulus Ensemble (GCE) model was used to simulate periods during TOGA COARE (December 19-27, 1992), GATE (September 1-7, 1974), SCSMEX (June 2-11, 1998), ARM (June 26-30, 1997) and KWAJEX (August 7-13, August 18-21, and August 29-September 12, 1999) using a 512 km domain (with 2-kilometer resolution). The results indicate that surface precipitation and latent heating profiles are similar between the 2D and 3D GCE model simulations. However, there are difference in radiation, surface fluxes and precipitation characteristics. The 2D GCE model was used to perform a long-term integration on ARM/GCSS case 4 (22 days at the ARM southern Great Plains site in March 2000). Preliminary results showed a large temperature bias in the upper troposphere that had not been seen in previous tropical cases. The major objectives of this paper are: (1) to determine the sensitivities to model configuration (ie., 2D in west-east, south-north or 3D), (2) to identify the differences and similarities in the organization and entrainment rates of convection between 2D- and 3D-simulated ARM cloud systems, and (3) assess the impact of upper tropospheric forcing on tropical and ARM case 4 cases.

Tao, W.-K.↗

NASA NTRS2020

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗

NASA NTRS2006

A Multi-scale Modeling System: Developments, Applications and Critical Issues

A multi-scale modeling framework (MMF), which replaces the conventional cloud parameterizations with a cloud-resolving model (CRM) in each grid column of a GCM, constitutes a new and promising approach. The MMF can provide for global coverage and two-way interactions between the CRMs and their parent GCM. The GCM allows global coverage and the CRM allows explicit simulation of cloud processes and their interactions with radiation and surface processes. A new MMF has been developed that is based the Goddard finite volume GCM (fvGCM) and the Goddard Cumulus Ensemble (GCE) model. This Goddard MMF produces many features that are similar to another MMF that was developed at Colorado State University (CSU), such as an improved .surface precipitation pattern, better cloudiness, improved diurnal variability over both oceans and continents, and a stronger, propagating Madden-Julian oscillation (MJO) compared to their parent GCMs using conventional cloud parameterizations. Both MMFs also produce a precipitation bias in the western Pacific during Northern Hemisphere summer. However, there are also notable differences between two MMFs. For example, the CSU MMF simulates less rainfall over land than its parent GCM. This is why the CSU MMF simulated less overall global rainfall than its parent GCM. The Goddard MMF overestimates global rainfall because of its oceanic component. Some critical issues associated with the Goddard MMF are presented in this paper.

Tao, Wei-Kuo↗