Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Modeling Weather Impact on Airport Arrival Miles-in-Trail Restrictions

When the demand for either a region of airspace or an airport approaches or exceeds the available capacity, miles-in-trail (MIT) restrictions are the most frequently issued traffic management initiatives (TMIs) that are used to mitigate these imbalances. Miles-intrail operations require aircraft in a traffic stream to meet a specific inter-aircraft separation in exchange for maintaining a safe and orderly flow within the stream. This stream of aircraft can be departing an airport, over a common fix, through a sector, on a specific route or arriving at an airport. This study begins by providing a high-level overview of the distribution and causes of arrival MIT restrictions for the top ten airports in the United States. This is followed by an in-depth analysis of the frequency, duration and cause of MIT restrictions impacting the Hartsfield-Jackson Atlanta International Airport (ATL) from 2009 through 2011. Then, machine-learning methods for predicting (1) situations in which MIT restrictions for ATL arrivals are implemented under low demand scenarios, and (2) days in which a large number of MIT restrictions are required to properly manage and control ATL arrivals are presented. More specifically, these predictions were accomplished by using an ensemble of decision trees with Bootstrap aggregation (BDT) and supervised machine learning was used to train the BDT binary classification models. The models were subsequently validated using data cross validation methods. When predicting the occurrence of arrival MIT restrictions under low demand situations, the model was able to achieve over all accuracy rates ranging from 84% to 90%, with false alarm ratios ranging from 10% to 15%. In the second set of studies designed to predict days on which a high number of MIT restrictions were required, overall accuracy rates of 80% were achieved with false alarm ratios of 20%. Overall, the predictions proposed by the model give better MIT usage information than what has been currently provided under current day operations. Traffic flow managers can use these predictions to identify potential MIT restrictions to eliminate (e.g., those occurring during low arrival demand periods), and to determine the days in which a significant number of restrictions may be required

Operation↗

A Phenomenon-Based Decomposition of Model-Based Estimates of Boreal Winter ENSO Variability

Climate models are now routinely being used to simulate and predict climate variability on time scales ranging from sub-seasonal to seasonal and longer. As such, there are now long histories of such simulations and predictions spanning multiple decades and multiple ensemble members, both of which are crucial for separating climate signal from climate noise. A key focus of such runs has been the El Niño-Southern Oscillation (ENSO), spurred by recent improvements in our ability to predict such events, though questions remain as to how well climate models do beyond simply always predicting the “canonical” atmospheric response to an ENSO event—something simple statistical models already do reasonably well. This is a critical issue that needs addressing, given the importance of event-to-event differences for predicting regional impacts of ENSO teleconnections, and the need to justify the expense of running sophisticated climate models. Unfortunately, current diagnostic tools are not well suited for quantifying the different sources of variability associated with specific phenomena such as ENSO. More generally, while much effort has focused on addressing model bias, less has been done to address errors in second moment statistics—an issue whose importance is gaining increased attention particularly as we build climate prediction systems capable of taking advantage of forecasts of opportunity—a capability that requires reliable estimates of forecast uncertainty. In this report, we outline a phenomenon-based statistical decomposition of climate variance(in essence a detailed variance budget)that is specifically tailored to address the above questions by separating the variability (both the signal and noise) into that tied to the long-term average impact of a particular phenomenon(the composite mean) and the event-to-event(E2E) variability about the composite mean. In addition, we provide related decompositions of the correlations that allow us to quantify how much of the agreement with observations (the skill) comes from the composite mean as opposed to from the E2Evariability. As an example, we present the results of such a decomposition for ENSO based on simulations with the GEOS atmospheric general circulation model (AGCM), with a focus on the monthly mean impacts over North America during boreal winter(December –March). Here we take advantage of existing GEOS AGCM simulations that were produced as companion simulations to MERRA-2for the period 1980-2016. Comparisons are made throughout with MERRA-2.

ENSO↗

Assimilation of AERONET and MODIS AOT Observations Using Variational and Ensemble Data Assimilation Methods and Its Impact on Aerosol Forecasting Skill

Data assimilation of Aerosol Robotic Network (AERONET) and Moderate Resolution Imaging Spectroradiometer (MODIS) aerosol optical thickness (AOT) for aerosol forecasting was tested within the Navy Aerosol Analysis Prediction System (NAAPS) framework, using variational and ensemble data assimilation methods. Navy aerosol forecasting currently makes use of a deterministic NAAPS simulation coupled to Navy Variational Data Assimilation System for aerosol optical depth, a two-dimensional variational data assimilation system, for MODIS AOT assimilation. An ensemble version of NAAPS (ENAAPS) coupled to an ensemble adjustment Kalman filter (EAKF) from the Data Assimilation Research Testbed was recently developed, allowing for a range of data assimilation and forecasting experiments to be run with deterministic NAAPS and ENAAPS. The main findings are that the EAKF, with its flow-dependent error covariances, makes better use of sparse observations such as AERONET AOT. Assimilating individual AERONET observations in the two-dimensional variational system can increase the analysis errors when observations are located in high AOT gradient regions. By including AERONET with MODIS AOT assimilation, the magnitudes of peak aerosol events (AOT> 1) were better captured with improved temporal variability, especially in India and Asia where aerosol prediction is a challenge. Assimilating AERONET AOT with MODIS had little impact on the 24 h forecast skill compared to MODIS assimilation only, but differences were found downwind of AERONET sites. The 24 h forecast skill was approximately the same for forecasts initialized with analyses from AERONET AOT assimilation alone compared to MODIS assimilation, particularly in regions where the AERONET network is dense; including the United States and Europe, indicating that AERONET could serve as a backup observation network for over-land synoptic-scale aerosol events.

Rubin, Juli I.↗

Modelling climate change impacts on maize yields under low nitrogen input conditions in sub‐Saharan Africa

Smallholder farmers in sub‐Saharan Africa (SSA) currently grow rainfed maize with limited inputs including fertilizer. Climate change may exacerbate current production constraints. Crop models can help quantify the potential impact of climate change on maize yields, but a comprehensive multimodel assessment of simulation accuracy and uncertainty in these low‐input systems is currently lacking. We evaluated the impact of varying [CO2], temperature and rainfall conditions on maize yield, for different nitrogen (N) inputs (0, 80, 160 kg N/ha) for five environments in SSA, including cool subhumid Ethiopia, cool semi‐arid Rwanda, hot subhumid Ghana and hot semi‐arid Mali and Benin using an ensemble of 25 maize models. Models were calibrated with measured grain yield, plant biomass, plant N, leaf area index, harvest index and in‐season soil water content from 2‐year experiments in each country to assess their ability to simulate observed yield. Simulated responses to climate change factors were explored and compared between models. Calibrated models reproduced measured grain yield variations well with average relative root mean square error of 26%, although uncertainty in model prediction was substantial (CV = 28%). Model ensembles gave greater accuracy than any model taken at random. Nitrogen fertilization controlled the response to variations in [CO2], temperature and rainfall. Without N fertilizer input, maize (i) benefited less from an increase in atmospheric [CO2], (ii) was less affected by higher temperature or decreasing rainfall and (iii) was more affected by increased rainfall because N leaching was more critical. The model inter-comparison revealed that simulation of daily soil N supply and N leaching plays a crucial role in simulating climate change impacts for low-input systems. Climate change and N input interactions have strong implications for the design of robust adaptation practices across SSA, because the impact of climate change will be modified if farmers intensify maize production with more mineral fertilizer.

Crop simulation model↗

Quasiparticle-ensemble theory for a normal Fermi liquid.

A quasiparticle ensemble ( Q ensemble) is constructed in which the number of quasiparticles with momentum k in the ensemble is conserved. The thermodynamic properties of this ensemble are related to those of the grand canonical ensemble. By comparison with explicit microscopic predictions of the theory, it is shown that this formulation is necessary if the third law of thermodynamics is to be satisfied, and that in this case, the Landau theory of a Fermi liquid follows as a natural consequence.

Quantum mechanics↗

Determination of longitudinal aerodynamic derivatives using flight data from an icing research aircraft

A flight test was performed with the NASA Lewis Research Center's DH-6 icing research aircraft. The purpose was to employ a flight test procedure and data analysis method, to determine the accuracy with which the effects of ice on aircraft stability and control could be measured. For simplicity, flight testing was restricted to the short period longitudinal mode. Two flights were flown in a clean (baseline) configuration, and two flights were flown with simulated horizontal tail ice. Forty-five repeat doublet maneuvers were performed in each of four test configurations, at a given trim speed, to determine the ensemble variation of the estimated stability and control derivatives. Additional maneuvers were also performed in each configuration, to determine the variation in the longitudinal derivative estimates over a wide range of trim speeds. Stability and control derivatives were estimated by a Modified Stepwise Regression (MSR) technique. A measure of the confidence in the derivative estimates was obtained by comparing the standard error for the ensemble of repeat maneuvers, to the average of the estimated standard errors predicted by the MSR program. A multiplicative relationship was determined between the ensemble standard error, and the averaged program standard errors. In addition, a 95 percent confidence interval analysis was performed for the elevator effectiveness estimates, C sub m sub delta e. This analysis identified the speed range where changes in C sub m sub delta e could be attributed to icing effects. The magnitude of icing effects on the derivative estimates were strongly dependent on flight speed and aircraft wing flap configuration. With wing flaps up, the estimated derivatives were degraded most at lower speeds corresponding to that configuration. With wing flaps extended to 10 degrees, the estimated derivatives were degraded most at the higher corresponding speeds. The effects of icing on the changes in longitudinal stability and control derivatives were adequately determined by the flight test procedure and the MSR analysis method discussed herein.

Ranaudo, R. J.↗

Determination of longitudinal aerodynamic derivatives using flight data from an icing research aircraft

A flight test was performed with the NASA Lewis Research Center's DH-6 icing research aircraft. The purpose was to employ a flight test procedure and data analysis method, to determine the accuracy with which the effects of ice on aircraft stability and control could be measured. For simplicity, flight testing was restricted to the short period longitudinal mode. Two flights were flown in a clean (baseline) configuration, and two flights were flown with simulated horizontal tail ice. Forty-five repeat doublet maneuvers were performed in each of four test configurations, at a given trim speed, to determine the ensemble variation of the estimated stability and control derivatives. Additional maneuvers were also performed in each configuration, to determine the variation in the longitudinal derivative estimates over a wide range of trim speeds. Stability and control derivatives were estimated by a Modified Stepwise Regression (MSR) technique. A measure of the confidence in the derivative estimates was obtained by comparing the standard error for the ensemble of repeat maneuvers, to the average of the estimated standard errors predicted by the MSR program. A multiplicative relationship was determined between the ensemble standard error, and the averaged program standard errors. In addition, a 95 percent confidence interval analysis was performed for the elevator effectiveness estimates, C sub m sub delta e. This analysis identified the speed range where changes in C sub m sub delta e could be attributed to icing effects. The magnitude of icing effects on the derivative estimates were strongly dependent on flight speed and aircraft wing flap configuration. With wing flaps up, the estimated derivatives were degraded most at lower speeds corresponding to that configuration. With wing flaps extended to 10 degrees, the estimated derivatives were degraded most at the higher corresponding speeds. The effects of icing on the changes in longitudinal stability and control derivat

Ranaudo, R. J.↗

A Practical Philosophy of Complex Climate Modelling

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project (CMIP).We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naive predictions. The framework we use for making inferences about reality using simulations is naturally Bayesian (in an informal sense), and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work.

complex simulation↗

The Effects of Uncertainty in Initial CME Input Parameters on Deflection, Rotation, Bz, and Arrival Time Predictions

Understanding the effects of coronal mass ejections (CMEs) requires knowing if and when they will impact and their properties upon impact. Of particular importance is the strength of a CME's southward magnetic field component (Bz ). Kay et al. (2013, https://doi:10.1088/0004-637X/775/1/5, 2015, https://doi:10.1088/948 0004-637X/805/2/168) have shown that the simplified analytic model Forecasting a CME's Altered Trajectory (ForeCAT) can reproduce the deflection and rotation of CMEs. Kay, Gopalswamy, Reinard, and Opher (2017, https://doi.org/10.3847/1538-4357/835/2/117) introduced ForeCAT In situ Data Observer, which uses ForeCAT results to simulate magnetic field profiles. ForeCAT In situ Data Observer reproduces the in situ observations on roughly hourly time scales, suggesting that these models could be extremely useful for predictions of Bz . However, as with all models, both models are sensitive to their input parameters, which may not be precisely known for predictions. We explore this sensitivity using ensembles having small changes in the initial latitude, longitude, and orientation of the erupting CME. We explore the effects of different background magnetic field models and find that the changes in deflection and rotation resulting from the uncertainty in the initial parameters tend to exceed the changes from dierent magnetic backgrounds. The range in the in situ proles tends to scale with the range in the deflection and rotation. We also consider a simple arrival time model using ForeCAT results and nd an average absolute error of only 3 hr. We show that an uncertainty in the CME position of 8.1 ± 6.9 leads to variations of 6 hr in the arrival time. This measure depends strongly on the location of impact within the CME with the arrival time changing less for impacts near the nose.

Kay, Christina D.↗

Comparison of Wind-Tunnel and Flight Unsteady Pressure Environments for the Ares I-X Flight Test Vehicle

Wind-tunnel testing of highly-instrumented rigid models is the current standard for the estimation of unsteady environments acting on a launch vehicle during ascent. However, uncertainties are present in how well these constant condition wind-tunnel data model the unsteady environments for a full-scale launch vehicle during accelerating flight. The Ares I-X wind-tunnel and flight tests provided rich data sets for comparative analysis that have been used to develop answers to the question of tunnel-to-flight validity and uncertainty. In this paper, additional comparisons are presented for the unsteady pressure data acquired during wind-tunnel and flight testing to describe current methods that are used to evaluate preflight predictions. Utilizing these methods to generate ensembles of flight-comparable realizations from wind-tunnel data is shown to yield fluctuating magnitudes and spectra that compare well with flight data for the Ares I-X flight test vehicle throughout the transonic flight regime.

buffet↗

A Novel Machine Learning Method for Surface PM2.5 Estimations from Geostationary Satellites

Particulate matter (PM) with a diameter of less or equal to 2.5 μm, known as PM , affects human health as it penetrates the respiratory system. The Environmental Protection Agency (EPA) measures the atmospheric concentration of PM using air quality monitors stationed throughout the Continental United States (CONUS). Such measurements are points on a spatial domain and therefore, might not be representative of the air quality at nearby areas considering that the composition of the atmosphere is highly variable from place to place. Satellite based AOD permits a spatially uniform means of estimating PM and new geostationary satellites provide high temporal and spatial resolution estimation of AOD. However, the concentration of PM is non-linearly dependent on other atmospheric parameters that include relative humidity, temperature, and height of the planetary boundary layer. This information may be estimated at similar spatial and temporal resolutions as AOD from numerical modeling such as from the National Oceanic and Atmospheric Administration’s (NOAA) High Resolution Rapid Refresh (HRRR) model which resolves near real-time atmospheric conditions over the CONUS. The estimation of PM concentration is a multi-parametric problem that considers the effect of temporal dependencies among the different parameters. Deep learning approaches are appropriate for such complex estimation problems as they intrinsically capture relations among multiple non-linear parameters. This study compares deep-learning methods to traditional regression analysis to demonstrate the capabilities of these methods in predicting PM2.5 concentrations. Additionally, a novel ensemble learning approach is employed to identify scientific processes that could further improve the estimation of PM concentration. Utilizing Long Short-Term Memory (LSTM) neural networks, which are suitable for multivariate time series estimation problems as they are capable of learning long-term dependencies, individual models are created for each EPA station and trained on the aforementioned dataset collocated over each station. Individual station models are merged if the model's performance is improved by reducing the root mean squared error (RMSE) metric. This ensemble training method ultimately reduces the RMSE value. Evaluation of these results provide insights into physical processes and related observable parameters that may contribute to PM concentrations. Identified parameters evaluated to be statistically different between the merged and unmerged models are expected to improve overall performance. These new parameters are then utilized for reevaluation of the deep learning methods with an extreme gradient boosting model with an RMSE of 5.5 providing the best results.

George Priftis↗

Comparison of Wind-Tunnel and Flight Unsteady Pressure Environments for the Ares I-X Flight Test Vehicle

Wind-tunnel testing of highly-instrumented rigid models is the current standard for the estimation of unsteady environments acting on a launch vehicle during ascent. However, uncertainties are present in how well these constant condition wind-tunnel data model the unsteady environments for a full-scale launch vehicle during accelerating flight. The Ares I-X wind-tunnel and flight tests provided rich data sets for comparative analysis that have been used to develop answers to the question of tunnel-to-flight validity and uncertainty. In this paper, additional comparisons are presented for the unsteady pressure data acquired during wind-tunnel and flight testing to describe current methods that are used to evaluate preflight predictions. Utilizing these methods to generate ensembles of flight-comparable realizations from wind-tunnel data is shown to yield fluctuating magnitudes and spectra that compare well with flight data for the Ares I-X flight test vehicle throughout the transonic flight regime.

buffet↗

Landslide Hazard is Projected to Increase Across High Mountain Asia

High Mountain Asia has long been known as a hotspot for landslide risk, and studies have suggested that landslide hazard is likely to increase in this region over the coming decades. Extreme precipitation may become more frequent, with a nonlinear response relative to increasing global temperatures. However, these changes are geographically varied. This article maps probable changes to landslide hazard, as shown by a landslide hazard indicator (LHI) derived from downscaled precipitation and temperature. In order to capture the nonlinear response of slopes to extreme precipitation, a simple machine-learning model was trained on a database of landslides across High Mountain Asia to develop a regional LHI. This model was applied to statistically downscaled data from the 30 members of the Seamless System for Prediction and Earth System Research large ensembles to produce a range of possible outcomes under the Shared Socioeconomic Pathways 2-4.5 and 5-8.5. The LHI reveals that landslide hazard will increase in most parts of High Mountain Asia. Absolute increases will be highest in already hazardous areas such as the Central Himalaya, but relative change is greatest on the Tibetan Plateau. Even in regions where landslide hazard declines by year 2100, it will increase prior to the mid-century mark. However, the seasonal cycle of landslide occurrence will not change greatly across High Mountain Asia. Although substantial uncertainty remains in these projections, the overall direction of change seems reliable. These findings highlight the importance of continued analysis to inform disaster risk reduction strategies for stakeholders across High Mountain Asia.

Thomas A Stanley↗

En route noise levels from propfan test assessment airplane

The en route noise test was designed to characterize propagation of propfan noise from cruise altitudes to the ground. In-flight measurements of propfan source levels and directional patterns were made by a chase plane flying in formation with the propfan test assessment (PTA) airplane. Ground noise measurements were taken during repeated flights over a distributed microphone array. The microphone array on the ground was used to provide ensemble-averaged estimates of mean flyover noise levels, establish confidence limits for those means, and measure propagation-induced noise variability. Even for identical nominal cruise conditions, peak sound levels for individual overflights varied substantially about the average, particularly when overflights were performed on different days. Large day-to-day variations in peak level measurements appeared to be caused by large day-to-day differences in propagation conditions and tended to obscure small variations arising from operating conditions. A parametric evaluation of the sensitivity of this prediction method to weather measurement and source level uncertainties was also performed. In general, predictions showed good agreement with measurements. However, the method was unable to predict short-term variability of ensemble-averaged data within individual overflights. Although variations in absorption appear to be the dominant factor in variations of peak sound levels recorded on the ground, accurate predictions of those levels require that a complete description of operational conditions be taken into account. The comprehensive and integrated methods presented in this paper have adequately predicted ground-measured sound levels. On average, peak sound levels were predicted within 3 dB for each of the three different cruise conditions.

Garber, Donald P.↗

Exploring Coupled Land-Atmosphere Carbon Dynamics and Seasonal Carbon Forecast Skill

Terrestrial biosphere is an integral part of the climate system and plays a vital role in controlling the dynamics of the Earth’s carbon cycle. In this talk, I will present recent efforts to explore coupled land-atmosphere carbon dynamics and seasonal carbon cycle predictability. First, by imposing an idealized spring drought in coupled land‐atmosphere ensemble simulations, we investigated the impact of a regional drought on land and atmospheric carbon. Through the drought-induced impact on remote meteorology, the capability of the land’s carbon uptake is altered in both the drought area and the adjacent areas. The induced anomalies of the atmospheric CO2 extend to an area up to three times of that of the imposed drought, which suggests that atmospheric transport needs to be considered in the interpretation of the drought impact on carbon anomalies. Increase in column‐averaged monthly CO2 is at the edge of the uncertainty from single soundings of current greenhouse gas observing satellites. Secondly, the seasonal carbon forecast skill was explored using NASA’s subseasonal-to-seasonal (S2S) ensemble forecast and terrestrial biosphere model. The result demonstrates an ability to accurately predict spring-summer carbon uptake in the Northern Hemisphere mid and high latitude land at multi-month leads. The prediction skill appears to be achieved by accurate forecasts of snow removal timing, which provides a latent predictability to the forecast system, and by proper initialization of carbon and nitrogen states. Additionally, I will briefly discuss other ongoing research to improve hydrometeorological prediction by integrating biogeochemical processes, to evaluate forecast skill of wildfire carbon, and to apply subseasonal forecasts to water resources management.

Eunjee Lee↗

Using Ensemble Decisions and Active Selection to Improve Low-Cost Labeling for Multi-View Data

This paper seeks to improve low-cost labeling in terms of training set reliability (the fraction of correctly labeled training items) and test set performance for multi-view learning methods. Co-training is a popular multiview learning method that combines high-confidence example selection with low-cost (self) labeling. However, co-training with certain base learning algorithms significantly reduces training set reliability, causing an associated drop in prediction accuracy. We propose the use of ensemble labeling to improve reliability in such cases. We also discuss and show promising results on combining low-cost ensemble labeling with active (low-confidence) example selection. We unify these example selection and labeling strategies under collaborative learning, a family of techniques for multi-view learning that we are developing for distributed, sensor-network environments.

machine learning↗

Algorithmic information theory and the hidden variable question

The admissibility of certain nonlocal hidden-variable theories are explained via information theory. Consider a pair of Stern-Gerlach devices with fixed nonparallel orientations that periodically perform spin measurements on identically prepared pairs of electrons in the singlet spin state. Suppose the outcomes are recorded as binary strings l and r (with l sub n and r sub n denoting their n-length prefixes). The hidden-variable theories considered here require that there exists a recursive function which may be used to transform l sub n into r sub n for any n. This note demonstrates that such a theory cannot reproduce all the statistical predictions of quantum mechanics. Specifically, consider an ensemble of outcome pairs (l,r). From the associated probability measure, the Shannon entropies H sub n and H bar sub n for strings l sub n and pairs (l sub n, r sub n) may be formed. It is shown that such a theory requires that the absolute value of H bar sub n - H sub n be bounded - contrasting the quantum mechanical prediction that it grow with n.

Fuchs, Christopher↗