Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Towards a flexible framework for community-wide ensemble forecasting tailored for major space environment impacts

To build continuously improving space weather predictive capabilities based on science and enable assessments and rapid implementations of advances in research into source-to-impact modelling systems we need: to assemble parts of the puzzle by solving problems focused on specific physical domains; to identify essential space environment quantities (ESEQs) passed between domains and linked to impacts; evaluate modeling capabilities for each ESEQ; connect all validated solutions from space weather origins on the sun to impacts on humans and critical infrastructure; to design displays for ensemble predictions tailored for major space weather user groups; to build a collaborative environment for efficient sharing of information and capabilities (models/data/expertise) and collaborative development. The presentation will overview existing community-wide space weather forecasting frameworks and research-to-operations pipelines and discuss opportunities to build a collaborative plug-and-play platform for interconnecting predictive capabilities developed under different space weather programs.

space weather↗

Towards A Flexible Framework for Community-Wide Ensemble Forecasting Tailored for Major Space Environment Impacts

To build continuously improving space weather predictive capabilities based on science and enable assessments and rapid implementations of advances in research into source-to-impact modelling systems we need: to assemble parts of the puzzle by solving problems focused on specific physical domains; to identify essential space environment quantities (ESEQs) passed between domains and linked to impacts; evaluate modeling capabilities for each ESEQ; connect all validated solutions from space weather origins on the sun to impacts on humans and critical infrastructure; to design displays for ensemble predictions tailored for major space weather user groups; to build a collaborative environment for efficient sharing of information and capabilities (models/data/expertise) and collaborative development. The presentation will overview existing community-wide space weather forecasting frameworks and research-to-operations pipelines and discuss opportunities to build a collaborative plug-and-play platform for interconnecting predictive capabilities developed under different space weather programs.

space weather↗

Adaptive Fault Detection on Liquid Propulsion Systems with Virtual Sensors: Algorithms and Architectures

Prior to the launch of STS-119 NASA had completed a study of an issue in the flow control valve (FCV) in the Main Propulsion System of the Space Shuttle using an adaptive learning method known as Virtual Sensors. Virtual Sensors are a class of algorithms that estimate the value of a time series given other potentially nonlinearly correlated sensor readings. In the case presented here, the Virtual Sensors algorithm is based on an ensemble learning approach and takes sensor readings and control signals as input to estimate the pressure in a subsystem of the Main Propulsion System. Our results indicate that this method can detect faults in the FCV at the time when they occur. We use the standard deviation of the predictions of the ensemble as a measure of uncertainty in the estimate. This uncertainty estimate was crucial to understanding the nature and magnitude of transient characteristics during startup of the engine. This paper overviews the Virtual Sensors algorithm and discusses results on a comprehensive set of Shuttle missions and also discusses the architecture necessary for deploying such algorithms in a real-time, closed-loop system or a human-in-the-loop monitoring system. These results were presented at a Flight Readiness Review of the Space Shuttle in early 2009.

Matthews, Bryan L.↗

Structure and Parameter Uncertainty in Centennial Projections of Forest Community Structure and Carbon Cycling

Secondary forest regrowth shapes community succession and biogeochemistry for decades, including in the Upper Great Lakes region. Vegetation models encapsulate our understanding of forest function, and whether models can reproduce multi‐decadal succession patterns is an indication of our ability to predict forest responses to future change. We test the ability of a vegetation model to simulate C cycling and community composition during 100 years of forest regrowth following stand‐replacing disturbance, asking (a) Which processes and parameters are most important to accurately model Upper Midwest forest succession? (b) What is the relative importance of model structure versus parameter values to these predictions? We ran ensembles of the Ecosystem Demography model v2.2 with different representations of processes important to competition for light. We compared the magnitude of structural and parameter uncertainty and assessed which sub‐model–parameter combinations best reproduced observed C fluxes and community composition. On average, our simulations underestimated observed net primary productivity (NPP) and leaf area index (LAI) after 100 years and predicted complete dominance by a single plant functional type (PFT). Out of 4,000 simulations, only nine fell within the observed range of both NPP and LAI, but these predicted unrealistically complete dominance by either early hardwood or pine PFTs. A different set of seven simulations were ecologically plausible but under‐predicted observed NPP and LAI. Parameter uncertainty was large; NPP and LAI ranged from ~0% to >200% of their mean value, and any PFT could become dominant. The two parameters that contributed most to uncertainty in predicted NPP were plant–soil water conductance and growth respiration, both unobservable empirical coefficients. We conclude that (a) parameter uncertainty is more important than structural uncertainty, at least for ED‐2.2 in Upper Midwest forests and (b) simulating both productivity and plant community composition accurately without physically unrealistic parameters remains challenging for demographic vegetation models.

canopy radiative transfer↗

Medium range lagged average forecasts

In this work, the application of the lagged average forecasting (LAF) technique to operational forecasts of the ECMWF is reported. The ECMWF data consist of two 100-day samples of 10-day forecasts of 500-mb geopotential height for winter 1980/81 and summer 1981. the LAF ensemble includes the latest operational forecast, and also forecast for the same verification time started one or more days earlier than the latest one. The focus is on the following two issues: (1) does ensemble averaging improve forecast skill and (2) is the dispersion of the ensemble useful in predicting forecast skill. The LAF technique was used to produce 3, 5, 7, 8, and 9 day forecasts of the 500-mb height field. The results show that the statistically filtered LAF is a marked improvment upon the operational forecast after 5 days. It is found that on a global scale, forecast skill is weakly correlated with the dispersion of the ensemble, as measured by the rms difference between the operational forecast and the statistically filtered LAF.

Dalcher, Amnon↗

Experimental investigation of self-induced transparency and pulse delay in ruby.

We have investigated the self-induced transparency effect in ruby over a range of input energies which range from linear absorption to full transparency. The transmission, pulse delay, and pulse broadening were studied as a function of input energy. The transition region is narrower than that found in similar studies of the CO2/SF6 system; this is consistent with predictions based on ensembles of two-level systems. Included are the first pulse-delay and pulse-broadening curves to be obtained for the ruby system.

Asher, I. M.↗

Performance of Soviet and US hydrogen masers

The frequencies of Soviet- and U.S.-built hydrogen masers located at the Smithsonian Astrophysical Observatory and at the United States Naval Observatory (USNO) were compared with each other and, via Global Positioning System (GPS) common-view measurements, with three primary frequency-reference scales. The best masers were found to have fractional frequency stabilities as low as 6 times 10(exp -16) for averaging times of approximately 10(exp 4) s. Members of the USNO maser ensemble provided frequency prediction better than 1 times 10(exp 14) for periods up to a few weeks. The frequency residuals of these masers, after removal of frequency drift and rate of change of drift, had stabilities of a few parts in 10(exp -15), with serveral masers achieving residual stabilities well below 1 times 10(exp -15) for intervals from 10(exp 5)s to 2 times 10(exp 6)s. The fractional frequency drifts of the 13 masers studied, relative to the primary reference standards, ranged from -0.2 times 10(exp -15)/day to +9.6 times 10(exp -15)/day.

Uljanov, Adolph A.↗

The evolution of voids in the adhesion approximation

We apply the adhesion approximation to study the formation and evolution of voids in the universe. Our simulations-carried out using 128(exp 3) particles in a cubical box with side 128 Mpc-indicate that the void spectrum evolves with time and that the mean void size in the standard Cosmic Background Explorer Satellite (COBE)-normalized cold dark matter (CDM) model with H(sub 50) = 1 scals approximately as bar D(z) = bar D(sub zero)/(1+2)(exp 1/2), where bar D(sub zero) approximately = 10.5 Mpc. Interestingly, we find a strong correlation between the sizes of voids and the value of the primordial gravitational potential at void centers. This observation could in principle, pave the way toward reconstructing the form of the primordialpotential from a knowledge of the observed void spectrum. Studying the void spectrum at different cosmological epochs, for spectra with a built in k-space cutoff we find that the number of voids in a representative volume evolves with time. The mean number of voids first increases until a maximum value is reached (indicating that the formation of cellular structure is complete), and then begins to decrease as clumps and filaments erge leading to hierarchical clustering and the subsequent elimination of small voids. The cosmological epoch characterizing the completion of cellular structure occurs when the length scale going nonlinear approaches the mean distance between peaks of the gravitaional potential. A central result of this paper is that voids can be populated by substructure such as mini-sheets and filaments, which run through voids. The number of such mini-pancakes that pass through a given void can be measured by the genus characteristic of an individual void which is an indicator of the topology of a given void in intial (Lagrangian) space. Large voids have on an average a larger measure than smaller voids indicating more substructure within larger voids relative to smaller ones. We find that the topology of individual voids is strongly epoch dependent, with void topologies generally simplifying with time. This means that as voids grow older they become progressively more empty and have less structure within them. We evaluate the genus measure both for individual voids as well as for the entire ensemble of voids predicted by CDM model. As a result we find that the topology of voids when taken together with the void spectrum is a very useful statistical indicator of the evolution of the structure of the universe on large scales.

Sahni, Varun↗

An Inverse Chance-constrained Approach to the Calibration of Robust Models

This paper proposes a strategy to calibrate computational models according to uncertain input-output data. To this end, uncertainty in the data is first quantified by creating adversarial data sets. Samples drawn from such sets are then mapped from the input-output space to the parameter space using an inverse mapping. This mapping minimizes the collective output spread of an ensemble of point predictions while satisfying a set of individual data-matching requirements. The distribution of the resulting parameter points, which often exhibits strong parameter dependencies, is then modeled using sliced-normals. The chance-constrained formulation used to learn this distribution enables the analyst to trade-off a greater likelihood for most of the data against a lower likelihood for some of the data thereby relaxing the conservatism of the calibrated model. This formulation not only neglects the worst-performing quantiles of each adversarial distribution but also eliminates the potentially serious effects that outliers might have on the resulting model. This calibration approach not only has a considerably lower computational cost than the standard forward approach but it also allows for the identification of suitable distribution classes, which in turn yield better calibrated models.

Calibration↗

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗

Interactive Vegetation Phenology, Soil Moisture, and Monthly Temperature Forecasts

The time scales that characterize the variations of vegetation phenology are generally much longer than those that characterize atmospheric processes. The explicit modeling of phenological processes in an atmospheric forecast system thus has the potential to provide skill to subseasonal or seasonal forecasts. We examine this possibility here using a forecast system fitted with a dynamic vegetation phenology model. We perform three experiments, each consisting of 128 independent warm-season monthly forecasts: 1) an experiment in which both soil moisture states and carbon states (e.g., those determining leaf area index) are initialized realistically, 2) an experiment in which the carbon states are prescribed to climatology throughout the forecasts, and 3) an experiment in which both the carbon and soil moisture states are prescribed to climatology throughout the forecasts. Evaluating the monthly forecasts of air temperature in each ensemble against observations, as well as quantifying the inherent predictability of temperature within each ensemble, shows that dynamic phenology can indeed contribute positively to subseasonal forecasts, though only to a small extent, with an impact dwarfed by that of soil moisture.

Seasonal Forecasting↗

Boreal Winter Predictions with the GEOS-2 GCM: The Role of Boundary Forcing and Initial Conditions

Ensembles of atmospheric General Circulation Model (GCM) seasonal forecasts and long-term simulations (1980-94) are analyzed to assess the controlling influences of boundary forcing and memory of the initial conditions. Both the forecasts and simulations are carried out with version 2 of the Goddard Earth Observing System (GEOS-2) GCM forced with observed sea surface temperatures (SSTs). While much of the focus is on the seasonal time scale (January- March) and the Pacific North American (PNA) region, we also present results for other regions, shorter time scales, and other known modes of variability in the northern hemisphere extratropics. Forecasts of indices of some of the key large-scale modes of variability show that there is considerable variability in skill between different regions of the Northern Hemisphere. The eastern North Atlantic region has the poorest long lead forecast skill showing no skill beyond about 10 days. Skillful seasonal forecasts are primarily confined to the wave-like ENSO response emanating from the tropical Pacific. In the Northern Hemisphere, this is associated with the well-known Pacific/North American (PNA) pattern. Memory of the initial conditions is the major factor leading to skillful extratropical forecasts of lead time less than one month, while SST forcing is the only factor at the seasonal time scale. SST forcing contributes to skillful forecasts at sub- seasonal time scales only over the PNA region. The GEOS-2 GCM produces average (1980-94) signal to noise ratios which are less than one everywhere in the extratropics, except for the subtropical Pacific where they approach 1.5. When confined to the ENSO years, the maximum signal to noise ratios occur in the PNA region where they exceed three. An assessment of the sampling distribution of the forecasts suggests the model's ENSO response is very likely too weak. These results show some sensitivity to the uncertainties in the estimates of the SST forcing fields. In the North Pacific region, the sensitivity to SST forcing manifests itself primarily as changes in the variability of the PNA response, underscoring the need for an ensemble approach to the seasonal prediction problem.

Chang, Yehui↗

A numerical model study of long-term planetary wave predictability

A numerical model was developed to study planetary wave behavior over periods up to 4 months under the influences of stochastic and diffusive forcing by synoptic scale motions and of sea surface temperature anomalies. The model is suitable for Monte Carlo experiments which provide ensemble mean and variance predictions and permit the response to heating anomalies to be partly separated from random variability. The model incorporates the linear-balanced dynamical equations for wind at two tropospheric levels and temperature at one level. The model atmosphere is forced by semiempirical January heating linearly dependent on local air temperature. Topography and the lower boundary layer are represented by vertical motion and drag functions, respectively, of the lower level wind. The linear phase speeds of Rossby waves are modified to reflect the effect of the stratosphere.

Wobus, R. L.↗

Exploring the Utility of Machine Learning-Based Passive Microwave Brightness Temperature Data Assimilation over Terrestrial Snow in High Mountain Asia

This study explores the use of a support vector machine (SVM) as the observation operator within a passive microwave brightness temperature data assimilation framework (herein SVM-DA) to enhance the characterization of snow water equivalent (SWE) over High Mountain Asia (HMA). A series of synthetic twin experiments were conducted with the NASA Land Information System (LIS) at a number of locations across HMA. Overall, the SVM-DA framework is effective at improving SWE estimates (~70% reduction in RMSE relative to the Open Loop) for SWE depths less than 200 mm during dry snowpack conditions. The SVM-DA framework also improves SWE estimates in deep, wet snow (~45% reduction in RMSE) when snow liquid water is well estimated by the land surface model, but can lead to model degradation when snow liquid water estimates diverge from values used during SVM training. In particular, two key challenges of using the SVM-DA framework were observed over deep, wet snowpacks. First, variations in snow liquid water content dominate the brightness temperature spectral difference (TB) signal associated with emission from a wet snowpack, which can lead to abrupt changes in SWE during the analysis update. Second, the ensemble of SVM-based predictions can collapse (i.e., yield a near-zero standard deviation across the ensemble) when prior estimates of snow are outside the range of snow inputs used during the SVM training procedure. Such a scenario can lead to the presence of spurious error correlations between SWE and TB, and as a consequence, can result in degraded SWE estimates from the analysis update. These degraded analysis updates can be largely mitigated by applying rule-based approaches. For example, restricting the SWE update when the standard deviation of the predicted TB is greater than 0.05 K helps prevent the occurrence of filter divergence. Similarly, adding a thin layer (i.e., 5 mm) of SWE when the synthetic TB is larger than 5 K can improve SVM-DA performance in the presence of a precipitation dry bias. The study demonstrates that a carefully constructed SVM-DA framework cognizant of the inherent limitations of passive microwave-based SWE estimation holds promise for snow mass data assimilation.

Kwon, Yonghwan↗

An Ensemble Investigation of the Causes for Regional Air-Quality Model Critical Load Exceedances Prediction Variability in European and North American Domains Using Diagnostics From Phase 4 of the Air Quality Model Evaluation International Initiative

We summarize tentative findings from multi air quality model ensembles for the years 2009 and 2010 in Europe (EU), and 2010 and 2016 in North America (NA), under AQMEII-4. The model predictions of sulphur and nitrogen deposition were used to estimate exceedances of critical loads for acidification and eutrophication, to show the extent to which the ensemble members agree in the magnitude and the trend of ecologically meaningful impacts. Model exceedance variability was analyzed using AQMEII-4 diagnostics. Evaluation against concentration and wet deposition observations, coupled with these diagnostics, identified specific process representations as the causes for variability between model predictions and for reduced model performance. All models predicted reductions in ecosystem acidification impacts in North America between the years 2010 and 2016, in accord with SO2 emissions reduction legislation which started in 2010 (SO2 SIP) However, all models in EU and NA domains had net negative biases for wet deposition of sulphur and nitrogen relative to observations. The wet S deposition average mean bias for the NA ensemble was -0.17 eq ha-1 d-1, and for the EU ensemble -1.15 eq ha-1 d-1. The NA daily wet deposition average mean bias for NH4+ was -0.37 eq ha-1d-1; EU -1.19 eq ha-1 d-1. The daily NA wet NO3- deposition average mean bias was -0.24 eq ha-1d-1; EU -0.69 eq ha-1 d-1. The members of the ensemble diverged (factor of 10) in their North American predictions for Ndep and consequently their eutrophication exceedances. The models with the highest eutrophication predictions also predicted the highest levels of gas-phase ammonia dry deposition (standard deviation of ammonia dry deposition flux across ensemble members was larger than the ensemble average). These models also had negative biases of predicted ammonia concentrations; average mean biases of -0.63 (satellite NH3) and -0.85 ppbv (surface NH3) compared to ensemble averages of -0.30 and -0.34 ppbv. Diagnostics showed that these differences resulted from the manner in which bidirectional ammonia fluxes were parameterized within these models. The second largest source of NA eutrophication prediction variability were models with positive biases in particulate ammonium and nitrate concentrations, and higher particle nitrogen deposition levels ( particle ammonium concentration bias +0.35 ug m-3; ensemble bias +0.15 ug m-3). We believe two factors may have led to these latter overestimates: higher levels of fine mode particle nitrate formation compared to other models (due to the use of an inorganic heterogeneous chemistry algorithm which did not take base cation chemistry into account), and updates to particle dry deposition velocities carried out in the absence of concurrent updates to wet scavenging algorithms. The relative importance of dry gas, dry particulate, and wet deposition towards total sulphur and nitrogen deposition totals differed between EU and North American domains, though all models had negative biases in wet deposition as noted above. Parallel and subsequent work suggests that multiphase hydrometeor scavenging may improve model wet deposition performance. An increased research focus is recommended for four model processes: multiphase hydrometeor scavenging, ammonia bidirectional fluxes, base cation chemistry and emissions, and particle dry deposition.

regional air-quality model↗