Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Assessment of Arctic and Antarctic Sea Ice Predictability in CMIP5 Decadal Hindcasts

This paper examines the ability of coupled global climate models to predict decadal variability of Arctic and Antarctic sea ice. We analyze decadal hindcasts/predictions of 11 Coupled Model Intercomparison Project Phase 5 (CMIP5) models. Decadal hindcasts exhibit a large multimodel spread in the simulated sea ice extent, with some models deviating significantly from the observations as the predicted ice extent quickly drifts away from the initial constraint. The anomaly correlation analysis between the decadal hindcast and observed sea ice suggests that in the Arctic, for most models, the areas showing significant predictive skill become broader associated with increasing lead times. This area expansion is largely because nearly all the models are capable of predicting the observed decreasing Arctic sea ice cover. Sea ice extent in the North Pacific has better predictive skill than that in the North Atlantic (particularly at a lead time of 3-7 years), but there is a reemerging predictive skill in the North Atlantic at a lead time of 6-8 years. In contrast to the Arctic, Antarctic sea ice decadal hindcasts do not show broad predictive skill at any timescales, and there is no obvious improvement linking the areal extent of significant predictive skill to lead time increase. This might be because nearly all the models predict a retreating Antarctic sea ice cover, opposite to the observations. For the Arctic, the predictive skill of the multi-model ensemble mean outperforms most models and the persistence prediction at longer timescales, which is not the case for the Antarctic. Overall, for the Arctic, initialized decadal hindcasts show improved predictive skill compared to uninitialized simulations, although this improvement is not present in the Antarctic.

sea ice↗
NASA NTRS2010

Impact of Damping Uncertainty on SEA Model Response Variance

Statistical Energy Analysis (SEA) is commonly used to predict high-frequency vibroacoustic levels. This statistical approach provides the mean response over an ensemble of random subsystems that share the same gross system properties such as density, size, and damping. Recently, techniques have been developed to predict the ensemble variance as well as the mean response. However these techniques do not account for uncertainties in the system properties. In the present paper uncertainty in the damping loss factor is propagated through SEA to obtain more realistic prediction bounds that account for both ensemble and damping variance. The analysis is performed on a floor-equipped cylindrical test article that resembles an aircraft fuselage. Realistic bounds on the damping loss factor are determined from measurements acquired on the sidewall of the test article. The analysis demonstrates that uncertainties in damping have the potential to significantly impact the mean and variance of the predicted response.

Schiller, Noah↗
NASA NTRS2002

Impact of Soil Moisture Initialization on Seasonal Weather Prediction

The potential role of soil moisture initialization in seasonal forecasting is illustrated through ensembles of simulations with the NASA Seasonal-to-Interannual Prediction Project (NSIPP) model. For each boreal summer during 1997-2001, we generated two 16-member ensembles of 3-month simulations. The first, "AMIP-style" ensemble establishes the degree to which a perfect prediction of SSTs would contribute to the seasonal prediction of precipitation and temperature over continents. The second ensemble is identical to the first, except that the land surface is also initialized with "realistic" soil moisture contents through the continuous prior application (within GCM simulations leading up to the start of the forecast period) of a daily observational precipitation data set and the associated avoidance of model drift through the scaling of all surface prognostic variables. A comparison of the two ensembles shows that soil moisture initialization has a statistically significant impact on summertime precipitation and temperature over only a handful of continental regions. These regions agree, to first order, with regions that satisfy three conditions: (1) a tendency toward large initial soil moisture anomalies, (2) a strong sensitivity of evaporation to soil moisture, and (3) a strong sensitivity of precipitation to evaporation. The degree to which the initialization improves forecasts relative to observations is mixed, reflecting a critical need for the continued development of model parameterizations and data analysis strategies.

Koster, Randal D.↗
NASA NTRS2020

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗
NASA NTRSDate not supplied

Ensemble Cancer Risk Model for Astronaut Risk Assessment

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

Lisa C Simonsen↗
NASA NTRS2009

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.↗
NASA NTRS1973

Statistical mechanics of negative temperature states

The dynamics of two-dimensional interacting line vortices is identical to that of the two-dimensional electrostatic guiding center plasma. Both are Hamiltonian systems and are therefore susceptible to statistical mechanical treatments. The predictions of the microcanonical ensemble are explored for this system. Interest focuses primarily on the regime of total positive interaction energy, which should be above the Onsager negative temperature threshold. Calculations of the probability distribution for a component by means of the central limit theorem are carried out in the manner of Khinchin. The probability distribution of a component reduced to the usual Gibbs distribution in the regime of positive temperatures, and is still explicitly calculable for negative temperatures. The negative temperature states are neither quiescent nor spatially uniform. Expressions for the temperature are explicitly provided in terms of the total particle energy and particle number. A BBGKY hierarchy can be derived for both temperature regimes. Numerical simulations involving solutions of the equations of motion of 4008 particles are presented.

Montgomery, D. C.↗
NASA NTRS2012

Assessment of the APCC Coupled MME Suite in Predicting the Distinctive Climate Impacts of Two Flavors of ENSO during Boreal Winter

Forecast skill of the APEC Climate Center (APCC) Multi-Model Ensemble (MME) seasonal forecast system in predicting two main types of El Nino-Southern Oscillation (ENSO), namely canonical (or cold tongue) and Modoki ENSO, and their regional climate impacts is assessed for boreal winter. The APCC MME is constructed by simple composite of ensemble forecasts from five independent coupled ocean-atmosphere climate models. Based on a hindcast set targeting boreal winter prediction for the period 19822004, we show that the MME can predict and discern the important differences in the patterns of tropical Pacific sea surface temperature anomaly between the canonical and Modoki ENSO one and four month ahead. Importantly, the four month lead MME beats the persistent forecast. The MME reasonably predicts the distinct impacts of the canonical ENSO, including the strong winter monsoon rainfall over East Asia, the below normal rainfall and above normal temperature over Australia, the anomalously wet conditions across the south and cold conditions over the whole area of USA, and the anomalously dry conditions over South America. However, there are some limitations in capturing its regional impacts, especially, over Australasia and tropical South America at a lead time of one and four months. Nonetheless, forecast skills for rainfall and temperature over East Asia and North America during ENSO Modoki are comparable to or slightly higher than those during canonical ENSO events.

Jeong, Hye-In↗
NASA NTRS1999

Seasonal Predictions with the GEOS GCM

A number of ensembles of seasonal forecasts have recently been completed as part of NASA's Seasonal to Interannual Prediction Project (NSIPP). The focus is on the extratropical response of the atmosphere to observed Surface Sea Temperature (SST) anomalies during boreal winter. The prediction experiments consist of nine forecasts starting from slightly different initial conditions for each year of the 15 year period 1981-95, employing version 2 of the Goddard Earth Observing System (GEOS) atmospheric Global Circulation Models (GCM). The initial conditions are obtained from the NASA GEOS-1 reanalysis data. Comparisons with a companion set of six long-term simulations with observed SST (starting in 1978, so they have no memory of the initial conditions for the periods of interest) are used to assess the relative contributions of the initial conditions and SST anomalies to forecast skill ranging from daily to seasonal time scales. The ensembles are used to isolate the signal, and to assess the nature of the inherent variability (noise) of the forecasts.

Schubert, Siegfried↗
NASA NTRS1999

Seasonal Prediction with the GEOS GCM

A number of ensembles of seasonal forecasts have recently been completed as part of NASA's Seasonal to Interannual Prediction Project (NSIPP). The focus is on the extratropical response of the atmosphere to observed SST anomalies during boreal winter. Each prediction consists of nine forecasts starting from slightly different initial conditions. Forecasts are done for every winter from 1981 to 1995 using Version 2 of the GEOS GCM. Comparisons with six long-term integrations (1978-1995) using the same model are used to separate the contributions of initial and boundary conditions to forecast skill. The forecasts also allow us to isolate the SSt forced response (the signal) from the atmosphere's natural variability (the noise).

Suarez, Max↗
NASA NTRS2018

Physics-Based Approach to Predict the Solar Activity Cycles

Observations of the complex highly non-linear dynamics of global turbulent flows and magnetic fields are currently available only from Earth-side observations. Recent progress in helioseismology has provided us some additional information about the subsurface dynamics, but its relation to the magnetic field evolution is not yet understood. These limitations cause uncertainties that are difficult take into account, and perform proper calibration of dynamo models. The current dynamo models have also uncertainties due to the complicated turbulent physics of magnetic field generation, transport and dissipation. Because of the uncertainties in both observations and theory, the data assimilation approach is natural way for the solar cycle prediction and estimating uncertainties of this prediction. I will discuss the prediction results for the upcoming Solar Cycle 25 and their uncertainties and affect of Ensemble Kalman Filter parameters to resulting predictions.

Physics-Based↗
NASA NTRS1991

Strong plasma turbulence in the earth's electron foreshock

A quantitative model is developed to account for the distribution in magnitude and location of the intense plasma waves observed in the earth's electron foreshock given the observed rms levels of waves. In this model, nonlinear strong-turbulence effects cause solitonlike coherent wave packets to form and decouple from incoherent background beam-excited weak turbulence, after which they convect downstream with the solar wind while collapsing to scales as short as 100 m and fields as high as 2 V/m. The existence of waves with energy densities above the strong-turbulence wave-collapse threshold is inferred from observations from IMP 6 and ISEE 1 and quantitative agreement is found between the predicted distribution of fields in an ensemble of such wave packets and the actual field distribution observed in situ by IMP 6. Predictions for the polarization of plasma waves and the bandwidth of ion-sound waves are also consistent with the observations. It is shown that strong-turbulence effects must be incorporated in any comprehensive theory of the propagation and evolution of electron beams in the foreshock. Previous arguments against the existence of strong turbulence in the foreshock are refuted.

Robinson, P. A.↗
NASA NTRS2010

Aerosol Observability and Predictability: From Research to Operations for Chemical Weather Forecasting. Lagrangian Displacement Ensembles for Aerosol Data Assimilation

A challenge common to many constituent data assimilation applications is the fact that one observes a much smaller fraction of the phase space that one wishes to estimate. For example, remotely sensed estimates of the column average concentrations are available, while one is faced with the problem of estimating 3D concentrations for initializing a prognostic model. This problem is exacerbated in the case of aerosols because the observable Aerosol Optical Depth (AOD) is not only a column integrated quantity, but it also sums over a large number of species (dust, sea-salt, carbonaceous and sulfate aerosols. An aerosol transport model when driven by high-resolution, state-of-the-art analysis of meteorological fields and realistic emissions can produce skillful forecasts even when no aerosol data is assimilated. The main task of aerosol data assimilation is to address the bias arising from inaccurate emissions, and Lagrangian misplacement of plumes induced by errors in the driving meteorological fields. As long as one decouples the meteorological and aerosol assimilation as we do here, the classic baroclinic growth of error is no longer the main order of business. We will describe an aerosol data assimilation scheme in which the analysis update step is conducted in observation space, using an adaptive maximum-likelihood scheme for estimating background errors in AOD space. This scheme includes e explicit sequential bias estimation as in Dee and da Silva. Unlikely existing aerosol data assimilation schemes we do not obtain analysis increments of the 3D concentrations by scaling the background profiles. Instead we explore the Lagrangian characteristics of the problem for generating local displacement ensembles. These high-resolution state-dependent ensembles are then used to parameterize the background errors and generate 3D aerosol increments. The algorithm has computational complexity running at a resolution of 1/4 degree, globally. We will present the result of assimilating AOD retrievals from MODIS (on both Aqua and TERRA satellites) from AERONET for validation. The impact on the GEOS-5 Aerosol Forecasting will be fully documented.

da Silva, Arlindo↗
NASA NTRS2020

Analyzing the Impact of CryoSat-2 Ice Thickness Initialization on Seasonal Arctic Sea Ice Prediction

Twin 5-month seasonal forecast experiments are performed to predict the September 2018 minimum ice extent using the fully coupled Navy Earth System Prediction Capability (ESPC). In the control run, ensemble forecasts are initialized from the operational US Navy Global Ocean Forecasting System (GOFS) 3.1 for the ocean and sea ice but do not assimilate ice thickness data. Another set of forecasts are initialized from the same GOFS 3.1 fields but with sea ice thickness derived from CryoSat-2 (CS2). The Navy ESPC ensemble mean September 2018 minimum sea ice extent initialized with GOFS 3.1 ice thickness was over-predicted by 0.68 M sq.km (5.27 M sq.km) versus the ensemble set of forecasts initialized with CS2 ice thickness that had an error of 0.40 M sq.km (4.99 M sq.km), a 56% reduction in error. The September mean Integrated Ice Edge Error (IIEE) shows a 19% improvement for the entire Arctic with the CS2 data versus the control run. Comparison against Upward Looking Sonar (ULS) ice thickness in the Beaufort Sea reveals a lower bias and RMSE with the CS2 forecasts at all three moorings. Ice concentration at these locations is also improved, but neither set of experiments show ice free conditions as observed at moorings A and D.

time-lagged ensembles↗
NASA NTRS2016

The NASA Severe Thunderstorm Observations and Regional Modeling (NASA STORM) Project

The NASA Severe Storm Thunderstorm Observations and Regional Modeling(NASA STORM) project enhanced NASA’s severe weather research capabilities, building upon existing Earth Science expertise at NASA Marshall Space Flight Center (MSFC). During this project, MSFC extended NASA’s ground-based lightning detection capacity to include a readily deployable lightning mapping array (LMA). NASA STORM also enabled NASA’s Short-term Prediction and Research Transition (SPoRT) to add convection allowing ensemble modeling to its portfolio of regional numerical weather prediction (NWP) capabilities. As a part of NASA STORM, MSFC developed new open-source capabilities for analyzing and displaying weather radar observations integrated from both research and operational networks. These accomplishments enabled by NASA STORM are a step towards enhancing NASA’s capabilities for studying severe weather and positions them for any future NASA related severe storm field campaigns.

modeling↗
NASA NTRS2020

Designing an Optimal Ensemble Strategy for GMAO S2S Forecast System

GMAO Sub/Seasonal prediction system (S2S) is being readied for a major upgrade to GEOS-S2S Version 3. An important factor in successful extended range forecast is the definition of an ensemble For initialization of the ensemble we propose a combination of lagged and burst initial conditions. We plan to run a relatively large ensemble of 40 members for sub-seasonal forecast (up to 3 months), at which point we sub-sample the ensemble, and continue the forecast with 10 members (up to 12 months). Here we present the results of the extensive testing of various ways to generate the perturbations to the initial conditions and the validation of the stratified sampling strategy we chose.To generate perturbations for the burst ensemble members we used scaled differences of pairs of analysis states separated by 1-10 days, randomly chosen from a corresponding season. We considered perturbing separately only the atmospheric fields or only the ocean or both of the forecast initial conditions. Considering varying separation times between the analysis states, we were able to produce perturbations sampling various modes of variability. Focusing on the ENSO SST indices, we found that all types of perturbations are important for the ensemble spread.Our ensemble size for sub-seasonal forecasts was determined as to maximize the skill of predicting some of the leading modes of boreal winter atmospheric modes, NAO, PNA and AO. It is not feasible to run equally large ensemble for seasonal forecasts. Using a stratified sampling procedure we can identify the emerging directions of error growth. By comparing the stratified ensemble with randomly sampled ensemble of the same size, we were able to show that the former better estimates the mean of the original large ensemble.

Borovikov, Anna↗
NASA NTRS1998

A Monte Carlo Uncertainty Analysis of Ozone Trend Predictions in a Two Dimensional Model

We use Monte Carlo analysis to estimate the uncertainty in predictions of total O3 trends between 1979 and 1995 made by the Goddard Space Flight Center (GSFC) two-dimensional (2D) model of stratospheric photochemistry and dynamics. The uncertainty is caused by gas-phase chemical reaction rates, photolysis coefficients, and heterogeneous reaction parameters which are model inputs. The uncertainty represents a lower bound to the total model uncertainty assuming the input parameter uncertainties are characterized correctly. Each of the Monte Carlo runs was initialized in 1970 and integrated for 26 model years through the end of 1995. This was repeated 419 times using input parameter sets generated by Latin Hypercube Sampling. The standard deviation (a) of the Monte Carlo ensemble of total 03 trend predictions is used to quantify the model uncertainty. The 34% difference between the model trend in globally and annually averaged total O3 using nominal inputs and atmospheric trends calculated from Nimbus 7 and Meteor 3 total ozone mapping spectrometer (TOMS) version 7 data is less than the 46% calculated 1 (sigma), model uncertainty, so there is no significant difference between the modeled and observed trends. In the northern hemisphere midlatitude spring the modeled and observed total 03 trends differ by more than 1(sigma) but less than 2(sigma), which we refer to as marginal significance. We perform a multiple linear regression analysis of the runs which suggests that only a few of the model reactions contribute significantly to the variance in the model predictions. The lack of significance in these comparisons suggests that they are of questionable use as guides for continuing model development. Large model/measurement differences which are many multiples of the input parameter uncertainty are seen in the meridional gradients of the trend and the peak-to-peak variations in the trends over an annual cycle. These discrepancies unambiguously indicate model formulation problems and provide a measure of model performance which can be used in attempts to improve such models.

Considine, D. B.↗