Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Observation of Absorbing Aerosols Above Clouds over the South-East Atlantic Ocean from the Geostationary Satellite SEVIRI – Part 1: Method Description and Sensitivity

High temporal resolution observations from satellites have a great potential for studying the impact of biomass burning aerosols and clouds over the South East Atlantic Ocean (SEAO). This paper presents a method developed to retrieve simultaneously aerosol and cloud properties in aerosol above cloud conditions from the geostationary instrument Meteosat Second Generation/Spinning Enhanced Visible and Infrared Imager (MSG/SEVIRI). The above-cloud Aerosol Optical Thickness (AOT), the Cloud Optical Thickness (COT) and the Cloud droplet Effective Radius (CER) are derived from the spectral contrast and the magnitude of the signal measured in three channels in the visible to shortwave infrared region. The impact of the absorption from atmospheric gases on the satellite signal is corrected by applying transmittances calculated using the water vapour profiles from a Met Office forecast model. The sensitivity analysis shows that a 10% error on the humidity profile leads to an 18.5% bias on the above-cloud AOT, which highlights the importance of an accurate atmospheric correction scheme. In situ measurements from the CLARIFY-2017 airborne field campaign are used to constrain the aerosol size distribution and refractive index that is assumed for the aforementioned retrieval algorithm. The sensitivities in the retrieved AOT, COT and CER to the aerosol model assumptions are assessed. Between 09:00-15:00 UTC, an uncertainty of 40% is estimated on the above-cloud AOT, which is dominated by the sensitivity of the retrieval to the single scattering albedo. The absorption AOT is less sensitive to the aerosol assumptions with an uncertainty generally lower than 17% between 09:00-15:00 UTC. Outside of that time range, as the scattering angle decreases, the sensitivity of the AOT and the absorption AOT to the aerosol model increases. The retrieved cloud properties are only weakly sensitive to the aerosol model assumptions throughout the day, with biases lower than 6% on the COT and 3% on the CER. The stability of the retrieval over time is analysed. For observations outside of the backscattering glory region, the time-series of the aerosol and cloud properties are physically consistent, which confirms the ability of the retrieval to monitor the temporal evolution of aerosol above cloud events over the SEAO.

Peers, Fanny↗
NASA NTRS2019

Sub-Picometer Dynamic Measurements of a Diffuse Surface

Future space observatory missions are forecasting the need for sensing and controlling wave front error and system alignment stability to picometer scale. Picometer stability performance demands precision knowledge of the mirror and metering structure materials to the same degree. A high-speed electronic speckle pattern interferometer was designed and built to demonstrate measurements of both static and dynamic responses of picometer amplitudes in materials of diffuse surface subjected to very low energy disturbances. This paper describes the details of a test to impart a dynamic disturbance of picometer scale and measure the response of a composite material.The results of the test are also reported and show conclusively that sub-picometer scale effects can be accurately measured in an open test environment outside a vacuum chamber.

Saif, Babak↗
NASA NTRS2019

Observation of absorbing aerosols above clouds over the south-east Atlantic Ocean from the geostationary satellite SEVIRI – Part 1: Method description and sensitivity

High-temporal-resolution observations from satellites have a great potential for studying the impact of biomass burning aerosols and clouds over the south-east Atlantic Ocean (SEAO). This paper presents a method developed to simultaneously retrieve aerosol and cloud properties in aerosol above-cloud conditions from the geostationary instrument Meteosat Second Generation/Spinning Enhanced Visible and Infrared Imager (MSG/SEVIRI). The above-cloud aerosol optical thickness (AOT), the cloud optical thickness (COT) and the cloud droplet effective radius (CER) are derived from the spectral contrast and the magnitude of the signal measured in three channels in the visible to shortwave infrared region. The impact of the absorption from atmospheric gases on the satellite signal is corrected by applying transmittances calculated using the water vapour profiles from a Met Office forecast model. The sensitivity analysis shows that a 10 % error on the humidity profile leads to an 18.5 % bias on the above-cloud AOT, which highlights the importance of an accurate atmospheric correction scheme. In situ measurements from the CLARIFY-2017 airborne field campaign are used to constrain the aerosol size distribution and refractive index that is assumed for the aforementioned retrieval algorithm. The sensitivities in the retrieved AOT, COT and CER to the aerosol model assumptions are assessed. Between 09:00 and 15:00 UTC, an uncertainty of 40 % is estimated on the above-cloud AOT, which is dominated by the sensitivity of the retrieval to the single-scattering albedo. The absorption AOT is less sensitive to the aerosol assumptions with an uncertainty generally lower than 17 % between 09:00 and 15:00 UTC. Outside of that time range, as the scattering angle decreases, the sensitivity of the AOT and the absorption AOT to the aerosol model increases. The retrieved cloud properties are only weakly sensitive to the aerosol model assumptions throughout the day, with biases lower than 6 % on the COT and 3 % on the CER. The stability of the retrieval over time is analysed. For observations outside of the backscattering glory region, the time series of the aerosol and cloud properties are physically consistent, which confirms the ability of the retrieval to monitor the temporal evolution of aerosol above-cloud events over the SEAO.

cloud properties↗
NASA NTRS2020

Integrated Multi-satellite Evaluation for the Global Precipitation Measurement: Impact of Precipitation Types on Spaceborne Precipitation Estimation

An integrated multi-sensor assessment is proposed as a novel approach to advance satellite precipitation validation in order to provide users and algorithm developers with an assessment adequately coping with the varying performances of merged satellite precipitation estimates. Gridded precipitation rates retrieved from space sensors with quasi-global coverage feed numerous applications ranging from water budget studies to forecasting natural hazards caused by extreme events. Characterizing the error structure of satellite precipitation products is recognized as a major issue for the usefulness of these estimates. The Global Precipitation Measurement (GPM) mission aims at unifying precipitation measurements from a constellation of low-earth orbiting (LEO) sensors with various capabilities to detect, classify and quantify precipitation. They are used in combination with geostationary observations to provide gridded precipitation accumulations. The GPM Core Obser­vatory satellite serves as a calibration reference for consistent precipitation retrieval algorithms across the constellation. The propagation of QPE uncertainty from LEO active/passive microwave (PMW) precipitation estimates to gridded QPE is addressed in this study, by focusing on the impact of precipitation typology on QPE from the Level-2 GPM Core Observatory Dual-frequency Precipitation Radar (DPR) to the Microwave Imager (GMI) to Level-3 IMERG precipitation over the Conterminous U.S. A high-resolution surface precipitation used as a consistent reference across scales is derived from the ground radar-based Multi-Radar/Multi­Sensor. While the error structure of the DPR, GMI and subsequent IMERG is complex because of the interaction of various error factors, systematic biases related to precipitation typology are consistently quantified across products. These biases display similar features across Level-2 and Level-3, highlighting the need to better resolve precipitation typology from space and the room for improvement in global­scale precipitation estimates. The integrated analysis and framework proposed herein applies more generally to precipitation estimates from sensors and error sources affecting low-earth orbiting satellites and derived gridded products.

Pierre-Emmanuel Kirstette↗
NASA NTRS2012

Comparison of TRMM 2A25 Products Version 6 and Version 7 with NOAA/NSSL Ground Radar-Based National Mosaic QPE

Characterization of the error associated to satellite rainfall estimates is a necessary component of deterministic and probabilistic frameworks involving spaceborne passive and active microwave measurements for applications ranging from water budget studies to forecasting natural hazards related to extreme rainfall events. We focus here on the error structure of Tropical Rainfall Measurement Mission (TRMM) Precipitation Radar (PR) quantitative precipitation estimation (QPE) at ground. The problem was addressed in a previous paper by comparison of 2A25 version 6 (V6) product with reference values derived from NOAA/NSSL's ground radar-based National Mosaic and QPE system (NMQ/Q2). The primary contribution of this study is to compare the new 2A25 version 7 (V7) products that were recently released as a replacement of V6. This new version is considered superior over land areas. Several aspects of the two versions are compared and quantified including rainfall rate distributions, systematic biases, and random errors. All analyses indicate V7 is an improvement over V6.

Kirstetter, Pierre-Emmanuel↗
NASA NTRS2011

Toward a Framework for Systematic Error Modeling of NASA Spaceborne Radar with NOAA/NSSL Ground Radar-Based National Mosaic QPE

Characterization of the error associated to satellite rainfall estimates is a necessary component of deterministic and probabilistic frameworks involving space-born passive and active microwave measurement") for applications ranging from water budget studies to forecasting natural hazards related to extreme rainfall events. We focus here on the error structure of NASA's Tropical Rainfall Measurement Mission (TRMM) Precipitation Radar (PR) quantitative precipitation estimation (QPE) at ground. The problem is addressed by comparison of PR QPEs with reference values derived from ground-based measurements using NOAA/NSSL ground radar-based National Mosaic and QPE system (NMQ/Q2). A preliminary investigation of this subject has been carried out at the PR estimation scale (instantaneous and 5 km) using a three-month data sample in the southern part of US. The primary contribution of this study is the presentation of the detailed steps required to derive trustworthy reference rainfall dataset from Q2 at the PR pixel resolution. It relics on a bias correction and a radar quality index, both of which provide a basis to filter out the less trustworthy Q2 values. Several aspects of PR errors arc revealed and quantified including sensitivity to the processing steps with the reference rainfall, comparisons of rainfall detectability and rainfall rate distributions, spatial representativeness of error, and separation of systematic biases and random errors. The methodology and framework developed herein applies more generally to rainfall rate estimates from other sensors onboard low-earth orbiting satellites such as microwave imagers and dual-wavelength radars such as with the Global Precipitation Measurement (GPM) mission.

Kirstettier, Pierre-Emmanual↗
NASA NTRS1986

Statistical corrections to numerical predictions. IV

The National Meteorological Center Barotropic-Mesh Model has been used to test a statistical correction procedure, designated as M-II, that was developed in Schemm et al. (1981). In the present application, statistical corrections at 12 h resulted in significant reductions of the mean-square errors of both vorticity and the Laplacian of thickness. Predictions to 48 h demonstrated the feasibility of applying corrections at every 12 h in extended forecasts. In addition to these improvements, however, the statistical corrections resulted in a shift of error from smaller to larger-scale motions, improving the smallest scales dramatically but deteriorating the largest scales. This effect is shown to be a consequence of randomization of the residual errors by the regression equations and can be corrected by spatially high-pass filtering the field of corrections before they are applied.

Schemm, Jae-Kyung↗
NASA NTRS2007

Recent Theoretical Advances in Analysis of AIRS/AMSU Sounding Data

AIRS was launched on EOS Aqua on May 4,2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. This paper describes the AIRS Science Team Version 5.0 retrieval algorithm. Starting in early 2007, the Goddard DAAC will use this algorithm to analyze near real time AIRS/AMSU observations. These products are then made available to the scientific community for research purposes. The products include twice daily measurements of the Earth's three dimensional global temperature, water vapor, and ozone distribution as well as cloud cover. In addition, accurate twice daily measurements of the earth's land and ocean temperatures are derived and reported. Scientists use this important set of observations for two major applications. They provide important information for climate studies of global and regional variability and trends of different aspects of the earth's atmosphere. They also provide information for researchers to improve the skill of weather forecasting. A very important new product of the AIRS Version 5 algorithm is accurate case-by-case error estimates of the retrieved products. This heightens their utility for use in both weather and climate applications. These error estimates are also used directly for quality control of the retrieved products. Version 5 also allows for accurate quality controlled AIRS only retrievals, called "Version 5 AO retrievals" which can be used as a backup methodology if AMSU fails. Examples of the accuracy of error estimates and quality controlled retrieval products of the AIRS/AMSU Version 5 and Version 5 AO algorithms are given, and shown to be significantly better than the previously used Version 4 algorithm. Assimilation of Version 5 retrievals are also shown to significantly improve forecast skill, especially when the case-by-case error estimates are utilized in the data assimilation process.

Susskind, Joel↗
NASA NTRS2017

Impact of Archeomagnetic Field Model Data on Modern Era Geomagnetic Forecasts

A series of geomagnetic data assimilation experiments have been carried out to demonstrate the impact of assimilating archeomagnetic data via the CALS3k.4 geomagnetic field model from the period between 10 and 1590 CE. The assimilation continues with the gufm1 model from 1590 to 1990 and CM4 model from 1990 to 2000 as observations, and comparisons between these models and the geomagnetic forecasts are used to determine an optimal maximum degree for the archeomagnetic observations, and to independently estimate errors for these observations. These are compared with an assimilation experiment that uses the uncertainties provided with CALS3k.4. Optimal 20 year forecasts in 1990 are found when the Gauss coefficients up to degree 3 are assimilated. In addition we demonstrate how a forecast and observation bias correction scheme could be used to reduce bias in modern era forecasts. Initial experiments show that this approach can reduce modern era forecast biases by as much as 50 percent.

Tangborn, Andrew↗
NASA NTRS2004

Exploring New Pathways in Precipitation Assimilation

Precipitation assimilation poses a special challenge in that the forward model for rain in a global forecast system is based on parameterized physics, which can have large systematic errors that must be rectified to use precipitation data effectively within a standard statistical analysis framework. We examine some key issues in precipitation assimilation and describe several exploratory studies in assimilating rainfall and latent heating information in NASA's global data assimilation systems using the forecast model as a weak constraint. We present results from two research activities. The first is the assimilation of surface rainfall data using a time-continuous variational assimilation based on a column model of the full moist physics. The second is the assimilation of convective and stratiform latent heating retrievals from microwave sensors using a variational technique with physical parameters in the moist physics schemes as a control variable. We will show the impact of assimilating these data on analyses and forecasts. Among the lessons learned are (1) that the time-continuous application of moisture/temperature tendency corrections to mitigate model deficiencies offers an effective strategy for assimilating precipitation information, and (2) that the model prognostic variables must be allowed to directly respond to an improved rain and latent heating field within an analysis cycle to reap the full benefit of assimilating precipitation information. of microwave radiances versus retrieval information in raining areas, and initial efforts in developing ensemble techniques such as Kalman filter/smoother for precipitation assimilation. Looking to the future, we discuss new research directions including the assimilation

Hou, Arthur↗
NASA NTRS2013

A Single-column Model Ensemble Approach Applied to the TWP-ICE Experiment

Single-column models (SCM) are useful test beds for investigating the parameterization schemes of numerical weather prediction and climate models. The usefulness of SCM simulations are limited, however, by the accuracy of the best estimate large-scale observations prescribed. Errors estimating the observations will result in uncertainty in modeled simulations. One method to address the modeled uncertainty is to simulate an ensemble where the ensemble members span observational uncertainty. This study first derives an ensemble of large-scale data for the Tropical Warm Pool International Cloud Experiment (TWP-ICE) based on an estimate of a possible source of error in the best estimate product. These data are then used to carry out simulations with 11 SCM and two cloud-resolving models (CRM). Best estimate simulations are also performed. All models show that moisture-related variables are close to observations and there are limited differences between the best estimate and ensemble mean values. The models, however, show different sensitivities to changes in the forcing particularly when weakly forced. The ensemble simulations highlight important differences in the surface evaporation term of the moisture budget between the SCM and CRM. Differences are also apparent between the models in the ensemble mean vertical structure of cloud variables, while for each model, cloud properties are relatively insensitive to forcing. The ensemble is further used to investigate cloud variables and precipitation and identifies differences between CRM and SCM particularly for relationships involving ice. This study highlights the additional analysis that can be performed using ensemble simulations and hence enables a more complete model investigation compared to using the more traditional single best estimate simulation only.

numerical weather forecasting↗
NASA NTRS2008

The Super Tuesday Outbreak: Forecast Sensitivities to Single-Moment Microphysics Schemes

Forecast precipitation and radar characteristics are used by operational centers to guide the issuance of advisory products. As operational numerical weather prediction is performed at increasingly finer spatial resolution, convective precipitation traditionally represented by sub-grid scale parameterization schemes is now being determined explicitly through single- or multi-moment bulk water microphysics routines. Gains in forecasting skill are expected through improved simulation of clouds and their microphysical processes. High resolution model grids and advanced parameterizations are now available through steady increases in computer resources. As with any parameterization, their reliability must be measured through performance metrics, with errors noted and targeted for improvement. Furthermore, the use of these schemes within an operational framework requires an understanding of limitations and an estimate of biases so that forecasters and model development teams can be aware of potential errors. The National Severe Storms Laboratory (NSSL) Spring Experiments have produced daily, high resolution forecasts used to evaluate forecast skill among an ensemble with varied physical parameterizations and data assimilation techniques. In this research, high resolution forecasts of the 5-6 February 2008 Super Tuesday Outbreak are replicated using the NSSL configuration in order to evaluate two components of simulated convection on a large domain: sensitivities of quantitative precipitation forecasts to assumptions within a single-moment bulk water microphysics scheme, and to determine if these schemes accurately depict the reflectivity characteristics of well-simulated, organized, cold frontal convection. As radar returns are sensitive to the amount of hydrometeor mass and the distribution of mass among variably sized targets, radar comparisons may guide potential improvements to a single-moment scheme. In addition, object-based verification metrics are evaluated for their utility in gauging model performance and QPF variability.

Molthan, Andrew L.↗
NASA NTRS2001

Assimilation of Cloud- and Land-Affected TOVS/ATOVS Level 1B Radiances in DAO's Next Generation Finite-Volume Data Assimilation System

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office (DAO) at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR, and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. In this talk we will focus on the assimilation of data from the (Advanced) TIROS Operational Vertical Sounder (ATOVS), with emphasis on the impact of cloud- and land-affected level 1B radiances. Recently, it has been shown that the use of observations from satellite-borne microwave and infrared radiometers in data assimilation systems consistently increases forecast skill. Considerable effort has been expended over the past two decades, particularly with the (Advanced) TIROS Operational Vertical Sounder (ATOVS), to achieve this result. The positive impact on forecast skill has resulted from improvements in quality control algorithms, systematic error correction schemes, and more sophisticated data assimilation algorithms. Despite these advances, there are still many issues regarding the use of satellite data in data assimilation systems that remain unresolved. In particular, most operational centers still do not assimilate cloud- and land-affected TOVS data. In this study, we evaluate the impact of assimilating cloud-and land-affected TOVS/ATOVS level 1B data in DAO's next generation fvDAS, using a 1D variational scheme. We will discuss the impact of these data on both tropospheric and stratospheric forecasts, as well as on the general aspects of the earth climate system.

Joiner, J.↗
NASA NTRS2020

Building a standardized Observing System Simulation Experiment (OSSE) framework for Mars

We advocate that the Decadal Survey recommends the NASA Science Mission Directorate to develop a rigorous Observing System Simulation Experiment (OSSE) framework for Mars, to optimize future atmospheric observations. Atmospheric conditions on Mars are a potential hazard source for landing missions. Errors in the estimates of atmospheric density profiles, inadequate knowledge of wind vertical structure and dust concentration as a function of height are likely causes of uncertainty at the landing site on the order of kilometers. An operational real-time weather forecasting capability for Mars would reduce such uncertainties, carrying enormous benefits to future robotic missions, and would be an invaluable prerequisite for human missions.A real-time forecasting capability relies upon three fundamental components: a critical mass of observing systems, a data assimilation system (DAS), and a global forecast model. The DAS allows the model to ingest the data effectively, optimizing the observational information content,and transforming them into a gridded representation of the atmosphere at a given time, called an ‘analysis’. The analysis is the best estimate of the atmospheric state for that time, and also represents a set of ‘initial conditions’ from which a global model can be initialized, to predict a future state of the atmosphere. The connection between analysis and forecast represents the foundation of modern weather forecasting. However, from the point of view of a forecast system,not all observations are equally impactful, partially because of the problem of “observational error correlation”, one important research topic in data assimilation development. For the Earth, partly due to the spontaneous and deregulated development of observations and forecast capabilities worldwide for more than half a century,the use of observations in contemporary operational forecast systems is suboptimal, with many potentially useful data being underutilized. On the contrary, Mars atmospheric scientists are in the unique situation of designing the next-generation observing systems by learning from the experience gathered on the Earth, so as to assure that the future instruments are specifically optimized to give the maximum benefit to a future weather forecast capability.An immensely powerful tool that has been firmly established by atmospheric scientists on the Earth is represented by a properly designed OSSE framework. A realistic OSSE framework cannot only quantify the benefit of future data types, be them surface based or space borne, but can also help design and optimize an entire observational network. Furthermore, OSSEs can provide deep insights into an atmosphere’s behavior, by addressing conceptual problems of its intrinsic predictability and delineating the regions or features of the atmosphere which are more sensitive to additional data and would benefit from a denser sampling. The difficulties posed by OSSEs are fundamentally different for Earth and Mars. For Earth, the enormous data volume imposes a tremendous constraint on any innovation in the observing systems: it is very hard for a single sensor to impact the skill. For Mars, the problem is the opposite: almost any additional instrument will exert some impact. However, OSSEs can help to evaluate the cost/benefit for every sensor and suggest optimal data configuration and density.The purpose of this white paper is to provide an introduction to a rigorously designed OSSE framework, explain the underlying problems and challenges, and engage the Mars community to collaborate with Earth Atmospheric scientists in order to develop a joint-OSSE framework for Mars with the largest consensual basis possible. An OSSE infrastructure would increase the understanding of the Martian atmosphere, would help NASA to optimize instrument specifications and orbit choice, providing the maximium benefit for a given expenditure of resources, and could even help establishing a roadmap for a future real-time weather forecasting capability.

Oreste Reale↗
NASA NTRS1984

Software reliability: Additional investigations into modeling with replicated experiments

The effects of programmer experience level, different program usage distributions, and programming languages are explored. All these factors affect performance, and some tentative relational hypotheses are presented. An analytic framework for replicated and non-replicated (traditional) software experiments is presented. A method of obtaining an upper bound on the error rate of the next error is proposed. The method was validated empirically by comparing forecasts with actual data. In all 14 cases the bound exceeded the observed parameter, albeit somewhat conservatively. Two other forecasting methods are proposed and compared to observed results. Although demonstrated relative to this framework that stages are neither independent nor exponentially distributed, empirical estimates show that the exponential assumption is nearly valid for all but the extreme tails of the distribution. Except for the dependence in the stage probabilities, Cox's model approximates to a degree what is being observed.

Nagel, P. M.↗
NASA NTRS1983

Predictability of planetary waves - Interhemispheric differences and the effects of stationary forcing

An attempt is made to determine the way in which errors appear in the ultralong waves of numerical weather prediction models, as well as the means by which such errors may be alleviated. Such efforts to improve the numerical forecasting of planetary waves derive their importance from the fact that energetic large scale phenomena are the basis for prospective improvements in extended range forecasting. A simple, linear, quasi-geostrophic and barotropic model is presently used in real data forecast simulations to explore, in an idealized context, several effects that may clarify discrepancies betweeen predictability theory and the performance of current numerical weather prediction models. Attention is given to the degree to which discrepancies may be accounted for by linear theory.

Roads, J. O.↗
NASA NTRS1997

Measurement of Geopotential Heights by GPS Radio Occultation

Geopotential heights of constant pressure surfaces are retrieved from global positioning system (GPS) radio occultation data. In order to assess accuracy a subset of data obtained by GPS/MET during spring 1995 and summer 1995 are compared to the output of the European Centre for Medium-Range Weather Forecasts (ECMWF) global model. The root-mean-square measurement error is 20 m throughout the upper troposphere and lower stratosphere. Furthermore, the ECMWF global model contains enhanced errors in the southeast Pacific. In probing the data for potential utility in climate studies, a Bayesian interpolation technique is used to map the geopotential height fields in the upper troposphere during the summer. Despite limitations of the GPS/MET data set the global average 300-mbar geopotential height over a 2-week period in summer 1995 is determined with an accuracy of 7 m. By obtaining greater coverage and partially resolving synoptic variability, a future constellation of 16 orbiting receivers could obtain global average geopotential height estimates in the upper troposphere with an accuracy of 1 m each day. Accuracy would be somewhat worse for regional studies, except in the tropics where synoptic variability is depressed.

Leroy, Stephen S.↗