Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Forecasting atmospheric angular momentum and length-of-day using operational meteorological models

Forecasts of zonal wind fields produced by the medium-range forecast model of the U.S. National Meteorological Center are used to create predictions of the atmosphere's angular momentum at lead times of 1-10 days. The skill of these forecasts, which are of interest to those concerned with monitoring changes in the length-of-day for navigational purposes, is assessed, and the regions in the atmosphere that contribute most importantly to forecast errors are identified.

Rosen, R. D.↗

The value of NDBC observations during March 1993's 'Storm of the Century'

National Data Buoy Center (NDBC) observations from the western Gulf of Mexico Provided several early indications of more rapid cyclogenesis on 12 March 1993 than was forecast by numerical weather prediction (NWP) models. Observations demostrated a closed circulation with gale-force winds shortly after the storm entered the Gulf of Mexico. Pressure measurements at two buoys off the Texas coast were 4-6 hPa lower than the 12-h NWP forecasts, a significant forecast error. Observations from NDBC's moored buoys and Coastal-Marine Automated Network stations revealed that the developing storm was significantly deeper than was indicated on the National Meteorological Center's automated surface analyses. Ocean wave observations reveal some of the steepest waves NDBC has ever measured, indicating phenomenonal wave growth and a high potential for damage to vessels and structures. A warm eddy caused sea surface temperatures (SST) to be several degrees above normal under the track of the storm, creating a strong SST gradient to the north. This provided ample energy and strengthened the baroclinity. NDBC observations showed the eddy to be somewhat larger and warmer than indicated by the most recent National Hurricane Center analysis. This event demonstrates the tremendous value of NDBC marine observations for accurately detecting the occurrence and strength of coastal cyclogenesis events.

Gilhousen, David B.↗

Multilevel Algorithm for Atmospheric Data Assimilation

A multiscale algorithm for the problem of optimal statistical interpolation of observed data has been developed. This problem includes the calculation of the vector of the 'analyzed' (best estimated) atmosphere flow field w(sup a) by the formula: w(sup a) = w(sup f) + P(sup f) H(sup T) y, where the quantity y is defined by the equation (H P(sup f) H(sup T) + R)y = w(sup o) - H w(sup f), using the given model forecast first guess w(sup f) and the vector of observations w(sup o); H is an interpolation operator from the regular grid to the observation network, P(sup f) is the forecast error covariance matrix, and R is the observation error covariance matrix. At this initial stage the case of univariate analysis of single level radiosonde height data is considered. The matrix R is assumed to be diagonal, and the matrix P(sup f) is assumed to be given by the formula P(sub ij)(sup f) = sigma(sub i)(sup f) mu(sub ij) sigma(sub j)(sub f), where mu(sub ij) is a smooth, decreasing function of the distance between the i-th and the j-th points. In this paper we describe a multiscale iterative process based on a multiresolution, simultaneous displacement technique and a localized variational calculation of iteration parameters.

Brandt, Achi↗

Reconstruction of the 1997/1998 El Nino from TOPEX/POSEIDON and TOGA/TAO Data Using a Massively Parallel Pacific-Ocean Model and Ensemble Kalman Filter

Two massively parallel data assimilation systems in which the model forecast-error covariances are estimated from the distribution of an ensemble of model integrations are applied to the assimilation of 97-98 TOPEX/POSEIDON altimetry and TOGA/TAO temperature data into a Pacific basin version the NASA Seasonal to Interannual Prediction Project (NSIPP)ls quasi-isopycnal ocean general circulation model. in the first system, ensemble of model runs forced by an ensemble of atmospheric model simulations is used to calculate asymptotic error statistics. The data assimilation then occurs in the reduced phase space spanned by the corresponding leading empirical orthogonal functions. The second system is an ensemble Kalman filter in which new error statistics are computed during each assimilation cycle from the time-dependent ensemble distribution. The data assimilation experiments are conducted on NSIPP's 512-processor CRAY T3E. The two data assimilation systems are validated by withholding part of the data and quantifying the extent to which the withheld information can be inferred from the assimilation of the remaining data. The pros and cons of each system are discussed.

Keppenne, C. L.↗

The GEOS Ozone Data Assimilation System: Design and Validation

An ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center to provide global three-dimensional analyzed ozone mixing ratio and total column ozone. The Total Ozone Mapping Spectrometer (TOMS) total column ozone and the Solar Backscatter Ultraviolet (SBUV) or SBUV/2 partial ozone profile data are assimilated. The analyzed winds from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) drive the ozone transport. Following every transport model timestep, the model prediction is combined with the observations using a global, physical-space based, statistical analysis scheme. Due to the smaller size of the ozone system than that of a global meteorological data assimilation system, new statistical analysis methodology, including anisotropic and flow-dependent forecast error correlation models, can be implemented and tested in the ozone system more easily. Sample results from the winter 1992 validation period are presented. There is a close agreement between the analyzed fields and the independent observations from ozone sondes and the Halogen Occultation Experiment (HALOE).

Stajner, I.↗

The Computational Complexity, Parallel Scalability, and Performance of Atmospheric Data Assimilation Algorithms

The computational complexity of algorithms for Four Dimensional Data Assimilation (4DDA) at NASA's Data Assimilation Office (DAO) is discussed. In 4DDA, observations are assimilated with the output of a dynamical model to generate best-estimates of the states of the system. It is thus a mapping problem, whereby scattered observations are converted into regular accurate maps of wind, temperature, moisture and other variables. The DAO is developing and using 4DDA algorithms that provide these datasets, or analyses, in support of Earth System Science research. Two large-scale algorithms are discussed. The first approach, the Goddard Earth Observing System Data Assimilation System (GEOS DAS), uses an atmospheric general circulation model (GCM) and an observation-space based analysis system, the Physical-space Statistical Analysis System (PSAS). GEOS DAS is very similar to global meteorological weather forecasting data assimilation systems, but is used at NASA for climate research. Systems of this size typically run at between 1 and 20 gigaflop/s. The second approach, the Kalman filter, uses a more consistent algorithm to determine the forecast error covariance matrix than does GEOS DAS. For atmospheric assimilation, the gridded dynamical fields typically have More than 10(exp 6) variables, therefore the full error covariance matrix may be in excess of a teraword. For the Kalman filter this problem can easily scale to petaflop/s proportions. We discuss the computational complexity of GEOS DAS and our implementation of the Kalman filter. We also discuss and quantify some of the technical issues and limitations in developing efficient, in terms of wall clock time, and scalable parallel implementations of the algorithms.

Lyster, Peter M.↗

Evaluation of Improved Pushback Forecasts Derived from Airline Ground Operations Data

Accurate and timely predictions of airline pushbacks can potentially lead to improved performance of automated decision-support tools for airport surface traffic, thus reducing the variability and average duration of costly airline delays. One factor which affects the realization of these benefits is the level of uncertainty inherent in the turn processes. To characterize this inherent uncertainty, three techniques are developed for predicting time-to-go until pushback as a function of available ground-time; elapsed ground-time; and the status (not-started/in-progress/completed) of individual turn processes (cleaning, fueling, etc.). These techniques are tested against a large and detailed dataset covering approximately l0(exp 4) real-world turn operations obtained through collaboration with Deutsche Lufthansa AG. Even after the dataset is filtered to obtain a sample of turn operations with minimal uncertainty, the standard deviation of forecast error for all three techniques is lower-bounded away from zero, indicating that turn operations have a significant stochastic component. This lower-bound result shows that decision-support tools must be designed to incorporate robust mechanisms for coping with pushback demand stochasticity, rather than treating the pushback demand process as a known deterministic input.

Carr, Francis↗

Diverse Applications of Occultation Data in Ozone Assimilation

Ozone profiles from solar occultation instruments provide invaluable information that can be used to evaluate the quality of assimilated ozone fields, from case studies to long-term phenomena. Occultation data can also be applied to include physical constraints while developing components of an assimilation system. Conversely, assimilation of occultation data can help in their validation, and it provides a framework for evaluation of the impact of occultation data on constraining global ozone fields within models. We illustrate these diverse applications by a series of examples using the ozone assimilation system at NASA/Goddard. In a case study, low ozone in the lower stratosphere due to transport of air from the Tropics to northern high latitudes that was captured by assimilation of Aura Microwave Limb Sounder (MLS) and Solar Backscatter Ultraviolet (SBUV) data, was found to agree with SAGE III data. For long-term monitoring, the quality of a multi-year SBUV-only assimilation was evaluated using monthly-mean time series of POAM, HALOE, and SAGE I1 data. We found realism in the representation of the annual cycle in ozone and in some aspects of interannual variability. Assimilation of POAM data was shown to improve the representation of lower stratospheric ozone, especially over Antarctica. More recently, we assimilated ILAS II ozone data in order to help in their validation. Solar occultation data are used to estimate parameters in a new model for forecast error variances that is being developed. These examples demonstrate the importance of occultation data for ozone assimilation, and potential of assimilation to increase the impact and the value of occultation data.

Markowitz, A.↗

The Impact of Trajectory Prediction Uncertainty on Air Traffic Controller Performance and Acceptability

A Human-In-The-Loop air traffic control simulation investigated the impact of uncertainties in trajectory predictions on NextGen Trajectory-Based Operations concepts, seeking to understand when the automation would become unacceptable to controllers or when performance targets could no longer be met. Retired air traffic controllers staffed two en route transition sectors, delivering arrival traffic to the northwest corner-post of Atlanta approach control under time-based metering operations. Using trajectory-based decision-support tools, the participants worked the traffic under varying levels of wind forecast error and aircraft performance model error, impacting the ground automations ability to make accurate predictions. Results suggest that the controllers were able to maintain high levels of performance, despite even the highest levels of trajectory prediction errors.

trajectory prediction uncertainty↗

Using Remotely Sensed Information for Near Real-Time Landslide Hazard Assessment

The increasing availability of remotely sensed precipitation and surface products provides a unique opportunity to explore how landslide susceptibility and hazard assessment may be approached at larger spatial scales with higher resolution remote sensing products. A prototype global landslide hazard assessment framework has been developed to evaluate how landslide susceptibility and satellite-derived precipitation estimates can be used to identify potential landslide conditions in near-real time. Preliminary analysis of this algorithm suggests that forecasting errors are geographically variable due to the resolution and accuracy of the current susceptibility map and the application of satellite-based rainfall estimates. This research is currently working to improve the algorithm through considering higher spatial and temporal resolution landslide susceptibility information and testing different rainfall triggering thresholds, antecedent rainfall scenarios, and various surface products at regional and global scales.

remote sensing↗

Introducing Multisensor Satellite Radiance-Based Evaluation for Regional Earth System Modeling

Earth System modeling has become more complex, and its evaluation using satellite data has also become more difficult due to model and data diversity. Therefore, the fundamental methodology of using satellite direct measurements with instrumental simulators should be addressed especially for modeling community members lacking a solid background of radiative transfer and scattering theory. This manuscript introduces principles of multisatellite, multisensor radiance-based evaluation methods for a fully coupled regional Earth System model: NASA-Unified Weather Research and Forecasting (NU-WRF) model. We use a NU-WRF case study simulation over West Africa as an example of evaluating aerosol-cloud-precipitation-land processes with various satellite observations. NU-WRF-simulated geophysical parameters are converted to the satellite-observable raw radiance and backscatter under nearly consistent physics assumptions via the multisensor satellite simulator, the Goddard Satellite Data Simulator Unit. We present varied examples of simple yet robust methods that characterize forecast errors and model physics biases through the spatial and statistical interpretation of various satellite raw signals: infrared brightness temperature (Tb) for surface skin temperature and cloud top temperature, microwave Tb for precipitation ice and surface flooding, and radar and lidar backscatter for aerosol-cloud profiling simultaneously. Because raw satellite signals integrate many sources of geophysical information, we demonstrate user-defined thresholds and a simple statistical process to facilitate evaluations, including the infrared-microwave-based cloud types and lidar/radar-based profile classifications.

Planetary Boundary Layer↗

A Realization of Bias Correction Method in the GMAO Coupled System

Over the past several decades, a tremendous effort has been made to improve model performance in the simulation of the climate system. The cold or warm sea surface temperature (SST) bias in the tropics is still a problem common to most coupled ocean atmosphere general circulation models (CGCMs). The precipitation biases in CGCMs are also accompanied by SST and surface wind biases. The deficiencies and biases over the equatorial oceans through their influence on the Walker circulation likely contribute the precipitation biases over land surfaces. In this study, we introduce an approach in the CGCM modeling to correct model biases. This approach utilizes the history of the model's short-term forecasting errors and their seasonal dependence to modify model's tendency term and to minimize its climate drift. The study shows that such an approach removes most of model climate biases. A number of other aspects of the model simulation (e.g. extratropical transient activities) are also improved considerably due to the imposed pre-processed initial 3-hour model drift corrections. Because many regional biases in the GEOS-5 CGCM are common amongst other current models, our approaches and findings are applicable to these other models as well.

Chang, Yehui↗

Evaluation of Integrated Demand Management Looking into Strategic & Tactical Flow Management

The motivation behind Integrated Demand Management (IDM) research is to explore possible improvements to United States National Airspace System (NAS) performance that could be realized through procedural integration of strategic traffic flow management capabilities, such as the Collaborative Trajectory Options Program (CTOP), and tactical capabilities, such as Time Based Flow Management (TBFM). An initial IDM concept for clear weather operations was developed and evaluated for potential benefits, including efficiency, delay reduction, predictability and throughput, and to identify any major issues that might represent a showstopper for a fielded application. Newark Liberty International Airport (EWR) arrival operations provided a use case for concept development. EWR uses miles-in-trail (MIT) metering to regulate demand into TBFM during high volume operations, and short-haul flights are often penalized with excessive, last-minute ground delays when the overhead stream is saturated. IDM addresses this problem by replacing MIT conditioning with CTOP to better manage the demand delivery to the TBFM entry points. A quasi-real time high-fidelity simulation that would normally involve participants was conducted using heuristic-based procedures that mimicked operators behaviors instead. Five total conditions were compared: two baseline conditions with MIT delivery to TBFM entry points using two different TBFM settings; and three IDM conditions: one with airborne speed control using an Required Time of Arrival (RTA) capability, a second without RTA, and a third with no wind forecast errors. Results suggest that the IDM concept can deliver traffic more efficiently by shifting the delays from airborne to ground for both RTA and non-RTA conditions, while maintaining a target throughput rate. The results also suggest that with good predictability of airport capacity, excessive TBFM ground delay can be minimized by applying more strategic CTOP delay, increasing predictability for the airline operators. Overall, the results indicate that the implementation of an IDM concept under clear weather conditions can improve NAS system performance. Future IDM research aims to expand the concept to address demandcapacity imbalance d severe weather.

Time-Based Flow Management (TBFM)↗

Non-Gaussian Ensemble Filtering and Adaptive Inflation for Soil Moisture Data Assimilation

The rank histogram filter (RHF) and the ensemble Kalman filter (EnKF) are assessed for soil moisture estimation using perfect model (identical twin) synthetic data assimilation experiments. The primary motivation is to gauge the impact on analysis quality attributable to the consideration of non-Gaussian forecast error distributions. Using the NASA Catchment land surface model, the two filters are compared at 18 globally-distributed single-catchment locations for a 10-year experiment period. It is shown that both filters yield adequate estimates of soil moisture, with the RHF having a small but significant performance advantage. Most notably, the RHF systematically increases the normalized information contribution (NIC) score of the mean absolute bias by 0.05 over that of the EnKF for surface, root-zone and profile soil moisture. The RHF also increases the NIC score for the anomaly correlation of surface soil moisture by 0.02 over that of the EnKF (at a 5% significance level). Results also demonstrate that the performance of both filters is somewhat improved when the ensemble priors are adaptively inflated to offset the negative effects of systematic errors.

Soil moisture↗

A High-Performance Computing Predictive GNSS Performance Monitor for Autonomous Air Vehicles in Urban Environments

This report offers analysis and design insights for leveraging High-Performance Computing (HPC) to predict line-of-sight (LOS) Global Navigation Satellite System (GNSS) availability in a city. This work is motivated by the emerging fields of Advanced and Urban Air Mobility (AAM/UAM), where regulatory authorities are seeking city-scale, meter-resolution risk forecasting in order to safely integrate new flight missions with existing urban life and infrastructure. This work addresses the technical challenge of efficiently computing urban GNSS satellite visibility to predict GNSS performance metrics under these requirements. We present a new HPC-optimized shadow casting algorithm variant as a ray-based approach to forecasting satellite visibility. We apply this algorithm variant in a software-defined prognostic service which generates a GNSS navigation risk-correlated map as a path planning-style potential field. We detail dominant computational burdens, viable simplifying assumptions, and different algorithmic implementations, intending to demonstrate a baseline of computation time needed by each stage in such a service. We conclude by analyzing the prototype service’s prediction accuracy compared to receiver data from Corpus Christi, Texas. This informs design trade-offs along the dimensions of hardware, computation time, and tolerable forecasting error (including proportions of false positives and false negatives).

GNSS↗

Complementary Roles of LEO and GEO IR Sounders in NWP Evaluated using an OSSE Framework

The United States is currently preparing for the next-generation weather satellite program. Building off the multi-decadal successes of the Low-Earth Orbit (LEO) infrared (IR) sounder program, NOAA and NASA are planning for the Geostationary eXtended Observations (GeoXO) Sounder (GXS) that will join international counterparts to form a global ring from geosynchronous orbit (GEO). To address questions about the complementarities and roles of these two platform types in the context of numerical weather prediction (NWP) and forecast accuracy, NASA’s Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework was used to test their impact individually and in concert. Analyses, forecasts, and forecast sensitivity-based observations impact (FSOI) are examined. Overall, each has a role in forecast error reduction with the most beneficial impacts occurring when both LEO and GEO sounders are used together to address the needs of global skill and targeted regional weather phenomena.

Erica Mcgrath-Spangler↗

Non-Gaussian Ensemble Filtering and Adaptive Inflation for Soil Moisture Data Assimilation

The rank histogram filter (RHF) and the ensemble Kalman filter (EnKF) are assessed for soil moisture estimation using perfect model (identical twin) synthetic data assimilation experiments. The primary motivation is to gauge the impact on analysis quality attributable to the consideration of non-Gaussian forecast error distributions. Using the NASA Catchment land surface model, the two filters are compared at 18 globally distributed single-catchment locations for a 10-yr experiment period. It is shown that both filters yield adequate estimates of soil moisture, with the RHF having a small but significant performance advantage. Most notably, the RHF consistently increases the normalized information contribution (NIC) score of the mean absolute bias by 0.05 over that of the EnKF for surface, root-zone, and profile soil moisture. The RHF also increases the NIC score for the anomaly correlation of surface soil moisture by 0.02 over that of the EnKF (at a 5% significance level). Results additionally demonstrate that the performance of both filters is somewhat improved when the ensemble priors are adaptively inflated to offset the negative effects of systematic errors.

Rolf Reichle↗

Probabilistic Look-ahead Contingency Analysis Integration with Commercial Tool and Practical Data

This paper presents an initial effort of integrating a smart sampling-based probabilistic look-ahead contingency analysis algorithm with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool as a proof-of-concept for a seamless research tool integration using real world large-scale grid data. With the increasing impact of random forces such as variable generation and load, their stochastic behaviors cannot be ignored. However, the current practices are still dominated by deterministic tools. They are becoming increasingly inadequate for the future grid. The developed look-ahead contingency analysis algorithm incorporates forecast errors of variable energy and load to address the challenges brought by the increasing uncertainty of power system. The algorithm can reveal the potential violations caused by the variance of variable energy and load that are not normally detected by traditional deterministic approaches. To test its performance under practical environments ( real data with real commercial tool), significant efforts have been made to prepare test cases, modify GE EMS tool, and adapt an extreme value distribution algorithm to analyze the GE EMS’s violation-only outputs. The test results clearly demonstrate the effectiveness of the developed algorithm as new transformer violations that were not previously detected have been identified. This performance provides better situational awareness to engineers for their decision-making process under uncertainty. Moreover, with the discussion of computational performance and future work, this paper has shown a clear path for integrating the probabilistic algorithm with commercial tools to make us better equipped for the changing power system.

Modeling and simulation of power systems, constrai↗