Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Instrumentation and First Results of the Reflected Solar Demonstration System for the Climate Absolute Radiance and Refractivity Observatory

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) mission key goals include enabling observation of high accuracy long-term climate change trends, use of these observations to test and improve climate forecasts, and calibration of operational and research sensors. The spaceborne instrument suites include a reflected solar spectroradiometer, emitted infrared spectroradiometer, and radio occultation receivers. The requirement for the RS instrument is that derived reflectance must be traceable to Sl standards with an absolute uncertainty of <0.3% and the error budget that achieves this requirement is described in previo1L5 work. This work describes the Solar/Lunar Absolute Reflectance Imaging Spectroradiometer (SOLARIS), a calibration demonstration system for RS instrument, and presents initial calibration and characterization methods and results. SOLARIS is an Offner spectrometer with two separate focal planes each with its own entrance aperture and grating covering spectral ranges of 320-640, 600-2300 nm over a full field-of-view of 10 degrees with 0.27 milliradian sampling. Results from laboratory measurements including use of integrating spheres, transfer radiometers and spectral standards combined with field-based solar and lunar acquisitions are presented. These results will be used to assess the accuracy and repeatability of the radiometric and spectral characteristics of SOLARIS, which will be presented against the sensor-level requirements addressed in the CLARREO RS instrument error budget.

McCorkel, Joel↗

Improving Assimilated Global Climate Data Using TRMM and SSM/I Rainfall and Moisture Data

Current global analyses contain significant errors in primary hydrological fields such as precipitation, evaporation, and related cloud and moisture in the tropics. Work has been underway at NASA's Data Assimilation Office to explore the use of TRMM and SSM/I-derived rainfall and total precipitable water (TPW) data in global data assimilation to directly constrain these hydrological parameters. We found that assimilating these data types improves not only the precipitation and moisture estimates but also key climate parameters directly linked to convection such as the outgoing longwave radiation, clouds, and the large-scale circulation in the tropics. We will present results showing that assimilating TRMM and SSM/I 6-hour averaged rain rates and TPW estimates significantly reduces the state-dependent systematic errors in assimilated products. Specifically, rainfall assimilation improves cloud and latent heating distributions, which, in turn, improves the cloudy-sky radiation and the large-scale circulation, while TPW assimilation reduces moisture biases to improve radiation in clear-sky regions. Rainfall and TPW assimilation also improves tropical forecasts beyond 1 day.

Hou, Arthur Y.↗

TRMM Data Assimilation at NASA

Current global analyses contain significant errors in primary hydrological fields such as precipitation, evaporation, and related cloud and moisture in the tropics. Work has been underway at NASA's Data Assimilation Office to explore the use of Tropical Rainfall Measuring Mission (TRMM) and Special Sensor Microwave Imager (SSM/I)-derived rainfall and total precipitable water (TPW) data in global data assimilation to directly constrain these hydrological parameters. We found that assimilating these data types improves not only the precipitation and moisture estimates but also key climate parameters directly linked to convection such as the outgoing longwave radiation, clouds, and the large-scale circulation in the tropics. We will present results showing that assimilating TRMM and SSM/I 6-hour averaged rain rates and TPW estimates significantly reduces the state-dependent systematic errors in assimilated products. Specifically, rainfall assimilation improves cloud and latent heating distributions, which, in turn, improves the cloudy-sky radiation and the large-scale circulation, while TPW assimilation reduces moisture biases to improve radiation in clear-sky regions. Rainfall and TPW assimilation also improves tropical forecasts beyond I day.

Hou, Arthur Y.↗

Cockpit automation - In need of a philosophy

Concern has been expressed over the rapid development and deployment of automatic devices in transport aircraft, due mainly to the human interface and particularly the role of automation in inducing human error. The paper discusses the need for coherent philosophies of automation, and proposes several approaches: (1) flight management by exception, which states that as long as a crew stays within the bounds of regulations, air traffic control and flight safety, it may fly as it sees fit; (2) exceptions by forecasting, where the use of forecasting models would predict boundary penetration, rather than waiting for it to happen; (3) goal-sharing, where a computer is informed of overall goals, and subsequently has the capability of checking inputs and aircraft position for consistency with the overall goal or intentions; and (4) artificial intelligence and expert systems, where intelligent machines could mimic human reason.

Wiener, E. L.↗

NOAA/NASA/DOD Workshop on Satellite Data Assimilation

A workshop on the assimilation of satellite sounding information using global forecast and climate models was held at College Park, MD, 23-25 August 1999. Topics discussed included: comparisons of assimilations of satellite retrievals versus satellite-observed radiances, planning for the use of advanced infrared sounders, the use of satellite sounding data affected by land surfaces, radiative transfer issues, and error characteristics of models and observations. The workshop concluded with a number of general and specific recommendations to advance the state of the art of assimilation of satellite sounding data.

Errico, Ronald M.↗

Verification of the SMAP Level-4 Soil Moisture Analysis Using Rainfall Observations in Australia

Global, 3-hourly, 9-km resolution soil moisture estimates are available with a mean latency of ~2.5 days from the NASA Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product. These estimates are based on the assimilation of SMAP radiometer brightness temperature (Tb) observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. Routine monitoring of the L4_SM system's assimilation diagnostics revealed occasionally large observation-minus-forecast Tb differences across eastern central Australia that resulted in large analysis increments (or adjustments) of the model forecast soil moisture. Because this region lacks in situ soil moisture measurements, we developed an alternative approach to assess the veracity of the soil moisture analysis increments in the L4_SM system. Using regional gauge-based precipitation data, we demonstrate that the L4_SM soil moisture increments are correlated with errors in the L4_SM precipitation forcing, suggesting that the SMAP Tb observations contribute valuable information to the L4_SM soil moisture estimates.

Reichle, R.↗

Status and Progress of All-Sky Hyperspectral IR Radiance Assimilation in GEOS

The majority of hyperspectral infrared radiance observations that peak in the lower and mid-troposphere have been excluded from the assimilation in the operational GEOS by the cloud detection scheme. The significance and challenges of assimilating these cloud-affected observations have attracted the attention of the research community, encouraged by the progress in utilizing all-sky microwave radiances affected by clouds and precipitation in many data assimilation systems, including GEOS. While the Global Modeling and Assimilation Office (GMAO) has made significant progress on the assimilation of cloud-cleared infrared radiances, this parallel study marks the first effort to directly assimilate cloud-affected hyperspectral infrared radiances in the GEOS. This initial study is focused on CrIS-FSR wa:wqter-vapor channels. The capability of the GEOS model and CRTM in simulating infrared radiances affected by clouds has been evaluated, and the all-sky brightness temperature Jacobians with respect to temperature, specific humidity, and hydrometeors are examined closely in varying cloud conditions. With hydrometeor control variables in the GEOS, several important aspects of all-sky IR radiance assimilation are investigated. The symmetric cloud effects are assessed for their robustness when used as the cloud proxy in observation error modeling that incorporates the inter-channel correlations with error situation dependency on the amount of cloud. The effective radius, bias correction and quality control processes will also be adapted to accommodate modifications necessary for all-sky infrared assimilation before comprehensive four-dimensional ensemble-variational(4dEnVar) experiments are conducted to assess their impacts on the analysis and forecast performance of GEOS.

Wei Gu↗

The Impact of All-Sky Hyperspectral Infrared Radiance Assimilation on the Simulation and Forecast of Hurricane Sally in GEOS

Hyperspectral infrared (IR) radiance observations have been one of the major data sources assimilated in the data assimilation system over the last 20 years. However, observations peaking in the lower and mid-troposphere are underutilized in clear-sky radiance data assimilation as the quality control procedure removes a significant portion of cloud-affected observations from the assimilation. To include these cloud-affected observations, one approach is to assimilate them directly under all-sky conditions. The framework for all-sky assimilation of hyperspectral IR radiance observations has been developed in GEOS. The preliminary evaluation of simulated cloud-affected IR observations has been conducted, along with the corresponding sensitivities with respect to all hydrometeors. The symmetric cloud effect has been used as a cloud proxy in the observation error modeling, providing a balanced representation that mitigates the discrepancies between observations and model simulations for IR all-sky assimilation. The observation errors vary for different cloud conditions and have been modeled as cloud amount dependent and inter-channel correlated. Preliminary evaluation of model simulations for IR all-sky assimilation indicates that the simulated brightness temperature tends to have broader structures and lacks small-scale details. Excessive clouds generated by the model are also observed. To address this issue, Hurricane Sally (2020), which formed near the Bahamas, is used as a case study. Several cloud overlap schemes and cloud lookup tables (LUTs), along with other important aspects of all-sky IR radiance assimilation, will be evaluated and tested, aiming to improve the impact on Hurricane Sally's simulation and forecast.

Wei Gu↗

Matching Observations to Model Resolution for Future Weather and Climate Applications

High spatial resolution sounding observations will improve initialization and assimilation into the next generation forecast models and validation of the next generation of climate models. One such advanced sounder concept for low earth orbit is the Advanced Remote-sensing Imaging Emission Spectrometer (ARIES) which proposes to provide highvspatial hyperspectral resolution observations in the mid to longwave infrared. This paper explores the effects of spatial resolution on the errors expected from the combined use of models and observations for representing scene information. We calculate the frequency response of the instrument and model and determine the error at any given spatial frequency. The results show that it is vital to have observations match the spatial resolution of models to minimize the uncertainty in the representation of the scene contents.

spatial resolution↗

Grid Resolution Study over Operability Space for a Mach 1.7 Low Boom External Compression Inlet

This paper presents a statistical methodology whereby the probability limits associated with CFD grid resolution of inlet flow analysis can be determined which provide quantitative information on the distribution of that error over the specified operability range. The objectives of this investigation is to quantify the effects of both random (accuracy) and systemic (biasing) errors associated with grid resolution in the analysis of the Lockheed Martin Company (LMCO) N+2 Low Boom external compression supersonic inlet. The study covers the entire operability space as defined previously by the High Speed Civil Transport (HSCT) High Speed Research (HSR) program goals. The probability limits in terms of a 95.0% confidence interval on the analysis data were evaluated for four ARP1420 inlet metrics, namely (1) total pressure recovery (PFAIP), (2) radial hub distortion (DPH/P), (3) ) radial tip distortion (DPT/P), and (4) ) circumferential distortion (DPC/P). In general, the resulting +/-0.95 delta Y interval was unacceptably large in comparison to the stated goals of the HSCT program. Therefore, the conclusion was reached that the "standard grid" size was insufficient for this type of analysis. However, in examining the statistical data, it was determined that the CFD analysis results at the outer fringes of the operability space were the determining factor in the measure of statistical uncertainty. Adequate grids are grids that are free of biasing (systemic) errors and exhibit low random (precision) errors in comparison to their operability goals. In order to be 100% certain that the operability goals have indeed been achieved for each of the inlet metrics, the Y+/-0.95 delta Y limit must fall inside the stated operability goals. For example, if the operability goal for DPC/P circumferential distortion is ≤0.06, then the forecast Y for DPC/P plus the 95% confidence interval on DPC/P, i.e. +/-0.95 delta Y, must all be less than or equal to 0.06.

Grid↗

Quantifying the benefits of improved satellite remote-sensing observations for inverse modeling of NOx and NMVOC emissions

This study aims to demonstrate the benefits of using novel high spatiotemporal retrieval products from newer satellites for top-down emission estimates of nitrogen oxides (NO x ) and non-methane volatile organic compounds (NMVOCs) for the summer of 2019 over the contiguous United States. Recent satellite retrievals have not only advanced spatiotemporal resolution but also greatly reduced error and uncertainty due to reduced noise in the retrievals compared to spaceborne sensors launched in the past. We applied inverse modeling techniques using tropospheric nitrogen dioxide (NO 2 ) and formaldehyde (H-CHO) column retrieval products from the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) in conjunction with the Weather Research Forecast and Community Multiscale Air Quality Modeling system (WRF-CMAQ). In order to provide a better representation of background chemical composition and avoid misalignment of emission adjustment, we applied monthly scaling factors for ozone (O 3 ) and CO boundary concentrations in addition to the inclusion of lightning and aviation emissions. Satellite-constrained NO x and NMVOCs posterior emissions showed a mitigated discrepancy between observed and modeled columns. The improvement in the model performance was greater when using TROPOMI, primarily benefiting from reduced errors/biases of the satellite retrievals that enabled us to explore corresponding changes in O 3 concentrations and production sensitivity regimes using the ratio of H-CHO and NO 2 .

remote sensing↗

Unstructured Grid Adaptation: Status, Potential Impacts, and Recommended Investments Toward CFD Vision 2030

Unstructured grid adaptation is a powerful tool to control discretization error for Computational Fluid Dynamics (CFD). It has enabled key increases in the accuracy, automation, and capacity of some fluid simulation applications. Slotnick et al. provides a number of case studies in the CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences to illustrate the current state of CFD capability and capacity. The authors forecast the potential impact of emerging High Performance Computing (HPC) environments forecast in the year 2030 and identify that mesh generation and adaptivity continue to be significant bottlenecks in the CFD work flow. These bottlenecks may persist because very little government investment has been targeted in these areas. To motivate investment, the impacts of improved grid adaptation technologies are identified. The CFD Vision 2030 Study roadmap and anticipated capabilities in complementary disciplines are quoted to provide context for the progress made in grid adaptation in the past fifteen years, current status, and a forecast for the next fifteen years with recommended investments. These investments are specific to mesh adaptation and impact other aspects of the CFD process. Finally, a strategy is identified to diffuse grid adaptation technology into production CFD work flows.

Park, Michael A.↗

Analysis and forecast experiments incorporating satellite soundings and cloud and water vapor drift wind information

A system for assimilating conventional meteorological data and satellite-derived data in order to produce four-dimensional gridded data sets of the primary atmospheric variables used for updating limited area forecast models is described. The basic principles of a data assimilation scheme as proposed by Lorenc (1984) are discussed. The design of the system and its incremental assimilation cycles are schematically presented. The assimilation system was tested using radiosonde, buoy, VAS temperature, dew point, gradient wind data, cloud drift, and water vapor motion data. The rms vector errors for the data are analyzed.

Goodman, Brian M.↗

Tropospheric and stratospheric wind profiling with a direct detection Doppler lidar

The Space Physics Research Laboratory at the University of Michigan has been operating a direct detection, high resolution Doppler Lidar (HRDL) to measure winds in the boundary layer, free troposphere and lower stratosphere. A direct detection Doppler lidar measures the Doppler shift of the aerosol or Rayleigh backscattered signal, from which the wind velocity vector can be retrieved (Benedetti-Michelangeli et al, 1972, 1974; Chanin et al., 1989; Abreu et al., 1992). The system components are shown. The transmitting system is a Continuum NY-60 Nd:YAG laser frequency doubled to a wavelength of 532 nm. The laser is injection seeded for single line mode operation yielding a linewidth of 0.0045 cm(exp -1) (135 MHz) with excellent shot-to-shot frequency stability. The laser produces 60 mJ pulses and operates at a 50 Hz repetition rate for an effective output power of 3.0 W. A description of the University of Michigan's Doppler lidar is given with examples of wind profiles for the boundary layer, free troposphere, and for the lower stratosphere. The system provides a reliable method of remotely measuring the wind. The wind error is smallest in regions of high aerosols. The system also produces aerosol extinction profiles versus altitude which can be determined by the shape of the spectra. The system has been installed in a trailor so that measurements can be made for field campaigns. Winds and aerosol data are available immediately at the site for use in forecasting.

Abreu, Vincent J.↗

Technical Report Series on Global Modeling and Data Assimilation: Soil Moisture Active Passive (SMAP) Project Assessment Report for the Beta-Release L4_SM Data Product - Volume 40

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public beta release scheduled for 30 October 2015. The primary objective of the beta release is to allow users to familiarize themselves with the data product before the validated product becomes available. The beta release also allows users to conduct their own assessment of the data and to provide feedback to the L4_SM science data product team. The assessment of the L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 1 validation and supports the beta release of the data. The validation against sparse network measurements and the evaluation of the assimilation diagnostics address Stage 2 validation criteria by expanding the assessment to regional and global scales.

ubRMSE↗

Subjective evaluation of the combined influence of satellite temperature sounding data and increased model resolution on numerical weather forecasting

The present evaluation is concerned with (1) the significance of prognostic differences resulting from the inclusion of satellite-derived temperature soundings, (2) how specific differences between the SAT and NOSAT prognoses evolve, and (3) comparison of two experiments using the Goddard Laboratory for Atmospheric Sciences general circulation model. The subjective evaluation indicates that the beneficial impact of sounding data is enhanced with increased resolution. It is suggested that satellite sounding data posses valuable information content which at times can correct gross analysis errors in data sparse regions.

Atlas, R.↗

Parametric Cost Modeling of Space Missions Using the Develop New Projects (DMP) Implementation Process

This paper presents an overview of a parametric cost model that has been built at JPL to estimate costs of future, deep space, robotic science missions. Due to the recent dramatic changes in JPL business practices brought about by an internal reengineering effort known as develop new products (DNP), high-level historic cost data is no longer considered analogous to future missions. Therefore, the historic data is of little value in forecasting costs for projects developed using the DNP process. This has lead to the development of an approach for obtaining expert opinion and also for combining actual data with expert opinion to provide a cost database for future missions. In addition, the DNP cost model has a maximum of objective cost drivers which reduces the likelihood of model input error. Version 2 is now under development which expands the model capabilities, links it more tightly with key design technical parameters, and is grounded in more rigorous statistical techniques. The challenges faced in building this model will be discussed, as well as it's background, development approach, status, validation, and future plans.

Rosenberg, Leigh↗

Soil Moisture Active Passive (SMAP) Project Assessment Report for Version 4 of the L4_SM Data Product

This report provides an assessment of Version 4 of the SMAP Level 4 Surface and Root Zone Soil Moisture (L4_SM) product, released on 14 June 2018. The assessment includes comparisons of L4_SM soil moisture and temperature estimates with in situ measurements from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product, including observation-minus-forecast (O-F) brightness temperature residuals and soil moisture analysis increments.Together, the core validation site comparisons and the statistics of the assimilation diagnostics areconsidered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid-cell scale of the data product.The Version 4 L4_SM product benefits from an improved land surface modeling system and from retrospective surface meteorological forcing data that are as consistent as possible with the present-day datain terms of their climatology. Specifically, the model changes include revised parameters and parameterizations for (i) the surface energy balance, (ii) recharge from below of the model's surface excess reservoir, and (iii) the snow depletion curve. Updated ancillary inputs include improved datasets for landcover, topography, and vegetation height. The Version 4 algorithm further includes a revised approach to precipitation corrections that improves the precipitation climatology in Africa and the high-latitudes. Moreover, for system calibration the model is forced retrospectively with MERRA-2 reanalysis data, which are more consistent with the near-real time GEOS forward processing (FP) data used during the SMAP period than the retrospective GEOS data that were available for previous L4_SM versions. An analysis of the time-average surface and root zone soil moisture shows that the global pattern ofarid and humid regions is captured by the Version 4 L4_SM estimates. Owing to the changes in the landsurface modeling system, surface soil moisture is typically drier by several volumetric percent in Version 4 compared to Version 3, whereas root zone soil moisture is wetter in Version 4 in some regions and drierin others. Because of these climatological differences, the Version 3 and Version 4 products should not be combined into a single dataset for use in applications.Results from the core validation site comparisons indicate that Version 4 of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the RMSE after removal of the long-term mean difference (ubRMSE). The overall ubRMSE of the 3-hourly L4_SM dataat the 9 km scale is 0.039 m3 m-3 for surface soil moisture and 0.029 m3 m-3 for root zone soil moisture,below the 0.04 m3 m-3 requirement. The L4_SM estimates are an improvement over estimates from a model-only Nature Run version 7.2 (NRv7.2), which demonstrates the beneficial impact of the SMAP brightness temperature data. Overall, L4_SM surface and root zone soil moisture estimates are more skillful than NRv7.2 estimates, with statistically significant improvements at the 5% level for surface soil moisture R and anomaly R values. Results from comparisons of the L4_SM product to i

Reichle, Rolf H.↗