SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Abstract. There is growing interest in data-driven weather prediction (DDWP), e.g., using convolutional neural networks such as U-NET that are trained on data from models or reanalysis. Here, we propose three components, inspired by physics, to integrate with commonly used DDWP models in order to improve their forecast accuracy. These components are (1) a deep spatial transformer added to the latent space of U-NET to capture rotation and scaling transformation in the latent space for spatiotemporal data, (2) a data-assimilation (DA) algorithm to ingest noisy observations and improve the initial conditions for next forecasts, and (3) a multi-time-step algorithm, which combines forecasts from DDWP models with different time steps through DA, improving the accuracy of forecasts at short intervals. To show the benefit and feasibility of each component, we use geopotential height at 500 hPa (Z500) from ERA5 reanalysis and examine the short-term forecast accuracy of specific setups of the DDWP framework. Results show that the spatial-transformer-based U-NET (U-STN) clearly outperforms the U-NET, e.g., improving the forecast skill by 45 %. Using a sigma-point ensemble Kalman (SPEnKF) algorithm for DA and U-STN as the forward model, we show that stable, accurate DA cycles are achieved even with high observation noise. This DDWP+DA framework substantially benefits from large (O(1000)) ensembles that are inexpensively generated with the data-driven forward model in each DA cycle. The multi-time-step DDWP+DA framework also shows promise; for example, it reduces the average error by factors of 2–3. These results show the benefits and feasibility of these three components, which are flexible and can be used in a variety of DDWP setups. Furthermore, while here we focus on weather forecasting, the three components can be readily adopted for other parts of the Earth system, such as ocean and land, for which there is a rapid growth of data and need for forecast and assimilation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Characterizing NWP Model Errors Using Doppler-Lidar Measurements of Recurrent Regional Diurnal Flows: Marine-Air Intrusions into the Columbia-River Basin

Ground-based Doppler-lidar instrumentation provides atmospheric wind data at dramatically improved accuracies and spatial/temporal resolutions. These capabilities have provided new insights into atmospheric flow phenomena, but they also should have a strong role in NWP model improvement. Insight into the nature of model errors can be gained by studying recurrent atmospheric flows, here a regional summertime diurnal sea breeze and subsequent marine-air intrusion into the arid interior of Oregon-Washington, where these winds are an important windenergy resource. These marine intrusions were sampled by three scanning Doppler lidars in the Columbia-River Basin as part of the Second Wind Forecast Improvement Project (WFIP2), using data from summer 2016. Lidar time-height cross sections of wind speed identified eight days when the diurnal-flow cycle, (peak wind speeds at midnight, afternoon minima) was obvious and strong. Eight-day composite time-height cross sections of lidar wind speeds are used to validate those generated by the operational NCEP-HRRR model. HRRR simulated the diurnal wind cycle, but produced errors in the timing of onset and significant errors due to a premature nighttime demise of the intrusion flow, producing low-bias errors of 6 m s-1 . Day-to-day and in the composite, whenever a marine intrusion occurred, HRRR made these same errors. The errors occurred under a range of gradient wind conditions indicating that they resulted from the misrepresentation of physical processes within a limited region around the measurement locations. Because of their generation within a limited geographical area, field-measurement programs can be designed to find and address the sources of these NWP errors.

Banta, Robert M.↗

NASA NTRS1999

Improved Stratospheric Temperature Retrievals for Climate Reanalysis

The Data Assimilation Office (DAO) is embarking on plans to generate a twenty year reanalysis data set of climatic atmospheric variables. One of the focus points will be in the evaluation of the dynamics of the stratosphere. The Stratospheric Sounding Unit (SSU), flown as part of the TIROS Operational Vertical Sounder (TOVS), is one of the primary stratospheric temperature sensors flown consistently throughout the reanalysis period. Seven unique sensors made the measurements over time, with individual instrument characteristics that need to be addressed. The stratospheric temperatures being assimilated across satellite platforms will profoundly impact the reanalysis dynamical fields. To attempt to quantify aspects of instrument and retrieval bias we are carefully collecting and analyzing all available information on the sensors, their instrument anomalies, forward model errors and retrieval biases. For the retrieval of stratospheric temperatures, we adapted the minimum variance approach of Jazwinski (1970) and Rodgers (1976) and applied it to the SSU soundings. In our algorithm, the state vector contains an initial guess of temperature from a model six hour forecast provided by the Goddard EOS Data Assimilation System (GEOS/DAS). This is combined with an a priori covariance matrix, a forward model parameterization, and specifications of instrument noise characteristics. A quasi-Newtonian iteration is used to obtain convergence of the retrieved state to the measurement vector. This algorithm also enables us to analyze and address the systematic errors associated with the unique characteristics of the cell pressures on the individual SSU instruments and the resolving power of the instruments to vertical gradients in the stratosphere. The preliminary results of the improved retrievals and their assimilation as well as baseline calculations of bias and rms error between the NESDIS operational product and col-located ground measurements will be presented.

Rokke, L.↗

DOE OSTI2020

Wave-by-Wave Forecasting via Assimilation of Marine Radar Data

Abstract This work describes a phase-resolving wave-forecasting algorithm that is based on the assimilation of marine radar image time series. The algorithm is tested against synthetic data and field observations. The algorithm couples X-band marine radar observations with a phase-resolving wave model that uses the linear mild slope equations for reconstruction of water surface elevations over a large domain of O (km) and a prescribed time window of O (min). The reconstruction also enables wave-by-wave forecasting through forward propagation in space and time. Marine radar image time series provide the input wave observations through a previously given relationship between backscatter intensity and the radial component of the sea surface slope. The algorithm assimilates the wave slope information into the model via a best-fit wave source function at the boundary that minimizes the slope reconstruction error over an annular region at the outer ranges of the radar images. The wave model is then able to propagate the waves across a polar domain to a location of interest at nearer ranges. The constraints on the method for achieving real-time forecasting are identified, and the algorithm is verified against synthetic data and tested using field observations.

Engineering↗

DOE OSTI2022

Forecasted Dynamic Line Ratings for Regional Transmission Lines

This report was prepared for the Wind Energy Technology Office for the FY 2022, quarter 3 deliverable. This details the use of forecasted dynamic line rating as an improvement over static rating for three transmission lines in three regions of interest. A selection of wind plants across Idaho, the Columbia River Gorge and offshore wind in the NYSERDA territory were modeled for their concurrent cooling effects for dynamic line rating. Regional transmission lines for the wind plant interconnections were determined and a CFD domain was created to determine local wind flows over the lines. A dynamic line rating for each of the lines was calculated for both weather observation data and HRRR model forecast data. The comparison of peaks in the wind power production were compared to the DLR peaks. It was determined that for shorter regional transmission lines, the effect of concurrent cooling that commonly occur with gen-tie lines were still valid. Concurrent cooling effects drop as the length of the regional transmission lines increase in distance from the wind plants. In addition, the accuracy of the forecasted ampacity to the weather observation data for ampacity was assessed. In general, the accuracy was best for the INL region with the NOAA-maintained sites. The Columbia River Gorge and Long Island sites showed similar levels of accuracy for the forecasted DLR. The accuracy levels were around 11% for the INL region, 15% for Columbia River Gorge and 7% for New York Long Island. The higher error for the Columbia Gorge region is likely due to the sparse availability of weather stations available, whereas both the INL site and Long Island are well instrumented.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1991

An assessment of VAS-derived retrievals and parameters used in thunderstorm forecasting

VAS satellite retrievals and derived parameters used in forecasting severe local storms were evaluated against corresponding radiosonde values. VAS products were also compared with the first-guess input to the retrieval algorithm. The evaluation methodology was to pair each radiosonde observation with the closest VAS retrieval within 50 km during a four-month period in 1986. VAS temperatures agreed closely with radiosonde values; dewpoints showed less agreement. Sounding differences were poorly correlated with the number of pixels from which the retrievals were prepared. VAS discrepancies usually were not well correlated with first-guess errors. Horizontal gradients of VAS products were stronger than those from radiosondes. VAS precipitable water agreed better with ground truth than did dewpoints at individual levels, but VAS thicknesses were not much improved. Results for severe storms forecasting parameters indicated that discrepancies increased with the amount of manipulation required during computation. The lifted index showed the best agreement; positive bouyant energy showed poor comparisons.

Fuelberg, Henry E.↗

NASA NTRS2002

Impact of Mineral Aerosol on TOVS Temperature and Moisture Retrievals

Mineral aerosols can absorb significant radiation in the infrared spectrum. Consequently, there may be errors in TIROS Operational Vertical Sounder (TOVS) retrieved temperature and moisture profiles in regions of heavy dust loading. We first investigate the potential error in the temperature retrievals and secondly attempt to account for radiative effects of the dust in retrievals. Information on the dust concentrations and size distribution is from the Goddard Chemistry Aerosol Transport model (GOCART). Aerosol optical parameters are calculated from mie scattering theory assuming a composition of pure illite. We used the cloud-clearing DAO TOVS retrieval system of Joiner and Rokke (2000). It is incorporated into the Data Assimilation Office (DAO) Finite Volume Data Assimilation System (NDAS). The advantage of this approach is that the first guess temperature profile used in the TOVS retrieval are forecasted temperatures from the previous assimilated time period. The operational DAO fvDAS was run for 10 days during June 2001 during a period of dust outbreaks off the coast of Africa over the Atlantic. The observed minus the forecast (O-F) brightness temperature at each TOVS channel is a measure of the accuracy of the retrieval. Since there was no account of dust during this operational run, a dependence of O-F on the estimated atmospheric dust concentrations from GOCART indicates that the dust is contaminating the TOVS retrievals. Channels that measure the surface temperature, lower tropospheric temperature and moisture show this dependence. There are errors in the retrieved brightness temperature of a half a degree or more during heavy dust loading conditions. The forecasted brightness temperature is always greater than the observed value. The radiative transfer module used in the DAO TOVS retrieval system was modified to account for dust. We calculate the sensitivity of the brightness temperature of the TOVS channels to the dust concentrations in GOCART assuming pure illite. For most channels the observed relationship between O-F and dust concentrations in GOCART is consistent with these calculated sensitivities. The fvDAS run was repeated using the modified DAO TOVS retrieval system that accounts for dust. Preliminary results from this run show that there are significant effects on the retrieved surface temperature and tropospheric moisture.

Weaver, Clark↗

NASA NTRS2019

The WRF Lightning Forecasting Algorithm: Sensitivities to Microphysics and Boundary Layer Physics Schemes

As with WRF model simulated convection in general, LFA output is sensitive to cloud and PBL physics. WRF convection is also sensitive to model initialization uncertainties and unresolved errors.  Large sensitivity exists in HRRR-like Thompson microphysics and PBL, for which original LFA calibration constant needs to be multiplied by 1.13 to give proper FRD amplitudes. Thompson microphysics scheme also shows poorest correlations relative to reference data, suggesting low predictability of HRRR LFA output. Need to validate HRRR LFA against GLM observations.

weather prediction↗

DOE OSTI2025

Artificial intelligence time series forecasting for feed-forward laser stabilization

Laser plasma accelerators, typically operating at 1–10 Hz repetition rates, have the ability to produce high-quality electron beams in compact, all-optical-driven configurations, with the electron beams uniquely suited for a wide variety of accelerator-based applications. However, fluctuations and drifts in the laser delivery to the meter-scaled and below plasma target (the electron beam source) will translate into electron beam source variations that can limit their utility for demanding applications like light sources or linear colliders. Commercially available active feedback laser stabilization systems are intrinsically bandwidth limited due to their integration with multi-inch corrective mirror mounts which minimizes their effectiveness. In this manuscript, we present a Neural Network time series forecaster that can predict laser position fluctuations of the laser delivery to the final target well ahead of a future laser shot. The Root-Mean-Square-Error (RMSE) of the prediction accuracy was < 2 μ m for a 1 / e 2 beam radius of 34 μ m . Our feed-forward approach serves as a first-step in circumventing the bandwidth limitations imposed by the currently available stabilization systems since it allows for mirrors to be moved into position ahead of time to offset the predicted future position drift. This will help advance laser plasma accelerator research by providing greater robustness and stability needed for its applications.

Berger, Curtis↗

DOE OSTI2024

Cluster cosmology without cluster finding

ABSTRACT We propose that observations of supermassive galaxies contain cosmological statistical constraining power similar to conventional cluster cosmology, and we provide promising indications that the associated systematic errors are comparably easier to control. We consider a fiducial spectroscopic and stellar mass complete sample of galaxies drawn from the Dark Energy Spectroscopic Instrument (DESI) and forecast how constraints on Ωm–σ8 from this sample will compare with those from number counts of clusters based on richness λ. At fixed number density, we find that massive galaxies offer similar constraints to galaxy clusters. However, a mass-complete galaxy sample from DESI has the potential to probe lower halo masses than standard optical cluster samples (which are typically limited to λ ≳ 20 and Mhalo ≳ 1013.5 M⊙ h−1); additionally, it is straightforward to cleanly measure projected galaxy clustering wp for such a DESI sample, which we show can substantially improve the constraining power on Ωm. We also compare the constraining power of M*-limited samples to those from larger but mass-incomplete samples [e.g. the DESI Bright Galaxy Survey (BGS) sample]; relative to a lower number density M*-limited samples, we find that a BGS-like sample improves statistical constraints by 60 per cent for Ωm and 40 per cent for σ8, but this uses small-scale information that will be harder to model for BGS. Our initial assessment of the systematics associated with supermassive galaxy cosmology yields promising results. The proposed samples have a ∼10 per cent satellite fraction, but we show that cosmological constraints may be robust to the impact of satellites. These findings motivate future work to realize the potential of supermassive galaxies to probe lower halo masses than richness-based clusters and to potentially avoid persistent systematics associated with optical cluster finding.

(cosmology): large-scale structure of Universe↗

NASA NTRS2010

Use of Quality Controlled AIRS Temperature Soundings to Improve Forecast Skill

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. Also included are the clear column radiances used to derive these products which are representative of the radiances AIRS would have seen if there were no clouds in the field of view. All products also have error estimates. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an rms error of 1K, and layer precipitable water with an rms error of 20 percent, in cases with up to 90 percent effective cloud cover. The products are designed for data assimilation purposes for the improvement of numerical weather prediction, as well as for the study of climate and meteorological processes. With regard to data assimilation, one can use either the products themselves or the clear column radiances from which the products were derived. The AIRS Version 5 retrieval algorithm is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates for retrieved quantities and clear column radiances, and the use of these error estimates for Quality Control. The temperature profile error estimates are used to determine a case-by-case characteristic pressure pbest, down to which the profile is considered acceptable for data assimilation purposes. The characteristic pressure p(sub best) is determined by comparing the case dependent error estimate (delta)T(p) to the threshold values (Delta)T(p). The AIRS Version 5 data set provides error estimates of T(p) at all levels, and also profile dependent values of pbest based on use of a Standard profile dependent threshold (Delta)T(p). These Standard thresholds were designed as a compromise between optimal use for data assimilation purposes, which requires highest accuracy (tighter Quality Control), and climate purposes, which requires more spatial coverage (looser Quality Control). Subsequent research using Version 5 sounding and error estimates showed that tighter Quality Control performs better for data assimilation proposes, while looser Quality Control better spatial coverage) performs better for climate purposes. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 degree latitude x 0.67 degree longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates (delta)T(p) were used as the uncertainty for each measurement in the data assimilation process.

Susskind, Joel↗

DOE OSTI2023

Advanced Tritium Process Analytics and Optimization via a Digital Twin, SRNL-TR-2023-00550

Improving the process knowledge and understanding of TCAP can be achieved by incorporating advanced tools. This project addresses “Advanced analytics for modeling, forecasting, & optimization of the tritium refinement process” and is being applied to the TCAP process. The value of digitization and advanced analytics for TCAP data are tracking of gas mixtures & inventories is presently a manual effort that is rather cumbersome. Incorporating some automation into the data capture will reduce errors and storing data in an accessible database that can be used for tracking as well as process improvements. In addition, the database approach will enable longer term history to be maintained rather than the current practice of deleting data after six months. The digitized and automated data will allow for models to be developed for the process and will enable the forecasting and optimization.

Korinko, Paul S.↗

DOE OSTI2026

Simulation budgeting for hybrid effective field theories

In this work, we forecast the number of, and requirements on, N-body simulations needed to train hybrid effective field theory (HEFT) emulators for a range of use cases, using a hybrid of HMcode and perturbation theory as a surrogate model. Our accuracy goals, determined with careful consideration of statistical and systematic uncertainties, are 1% accurate in the high-likelihood range of cosmological parameters, and 2% accurate over a broader parameter space volume for k < 1 h Mpc -1 and z < 3. Focusing in part on the 8-parameter w 0 w a CDM+ m ν cosmological model, we find that < 225 simulations are required to meet our error goals over our wide parameter space, including models with rapidly evolving dark energy, given our simulation and emulator recommendations. For a more restricted parameter space volume, as few as 80 simulations are sufficient. We additionally present simulation forecasts for example use cases, and make the code used in our analyses publicly available. These results offer practical guidance for efficient emulator design and simulation budgeting in future cosmological analyses.

cosmological parameters from LSS↗

DOE OSTI2024

Redshift-dependent RSD bias from intrinsic alignment with DESI Year 1 spectra

ABSTRACT We estimate the redshift-dependent, anisotropic clustering signal in the Dark Energy Spectroscopic Instrument (DESI) Year 1 Survey created by tidal alignments of Luminous Red Galaxies (LRGs) and a selection-induced galaxy orientation bias. To this end, we measured the correlation between LRG shapes and the tidal field with DESI’s Year 1 redshifts, as traced by LRGs and Emission-Line Galaxies. We also estimate the galaxy orientation bias of LRGs caused by DESI’s aperture-based selection, and find it to increase by a factor of seven between redshifts 0.4−1.1 due to redder, fainter galaxies falling closer to DESI’s imaging selection cuts. These effects combine to dampen measurements of the quadrupole of the correlation function (ξ2) caused by structure growth on scales of 10–80 h−1 Mpc by about 0.15 per cent for low redshifts (0.4 < z < 0.6) and 0.8 per cent for high (0.8 < z < 1.1), a significant fraction of DESI’s error budget. We provide estimates of the ξ2 signal created by intrinsic alignments that can be used to correct this effect, which is necessary to meet DESI’s forecasted precision on measuring the growth rate of structure. While imaging quality varies across DESI’s footprint, we find no significant difference in this effect between imaging regions in the Legacy Imaging Survey.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1976

Experiments with the fourth order GISS general circulation model

The new GISS GCM with 4th order conservative horizontal finite difference is briefly described. A simple forecast performed with real initial data indicates a significant increase in skill with respect to standard 2nd order GISS GCM. The improvement is limited by other sources of errors, especially poor initial data and vertical truncation. It is estimated that with a 4th order - 200 km grid model, errors introduced by horizontal truncation will be negligible for about a week for most synoptic scales (wavelengths larger than 1000 km).

Kalnay-Rivas, E.↗

NASA NTRS2001

AVHRR-Based Polar Pathfinder Products: Evaluation, Enhancement and Transition to MODIS

The Advanced Very High Resolution Radiometer (AVHRR)-Based Polar Pathfinder (APP) products include calibrated AVHRR channel data, surface temperatures, albedo, satellite scan and solar geometries, and cloud mask, all composited into twice-per-day images, and daily averaged fields of sea ice motion, for regions poleward of 50 latitude. Our general goals under this grant: (1) Quantify the APP accuracy and sources of error by comparing Pathfinder products with field measurements; (2) Determine the consistency of mean fields and trends in comparison with longer time series of available station data and forecast model output; (3) Investigate the consistency of the products between the different AVHRR instruments over the 1982-present period of the NOAA program; and (4) Compare and annual cycle of the APP products with MODIS to establish a baseline for extending Pathfinder-type products into the new ESE period.

Fowler, Charles↗

NASA NTRS2015

Monitoring Changes of Tropical Extreme Rainfall Events Using Differential Absorption Barometric Radar (DiBAR)

This work studies the potential of monitoring changes in tropical extreme rainfall events such as tropical storms from space using a Differential-absorption BArometric Radar (DiBAR) operating at 50-55 gigahertz O2 absorption band to remotely measure sea surface air pressure. Air pressure is among the most important variables that affect atmospheric dynamics, and currently can only be measured by limited in-situ observations over oceans. Analyses show that with the proposed radar the errors in instantaneous (averaged) pressure estimates can be as low as approximately 5 millibars (approximately 1 millibar) under all weather conditions. With these sea level pressure measurements, the forecasts, analyses and understanding of these extreme events in both short and long time scales can be improved. Severe weathers, especially hurricanes, are listed as one of core areas that need improved observations and predictions in WCRP (World Climate Research Program) and NASA Decadal Survey (DS) and have major impacts on public safety and national security through disaster mitigation. Since the development of the DiBAR concept about a decade ago, our team has made substantial progress in advancing the concept. Our feasibility assessment clearly shows the potential of sea surface barometry using existing radar technologies. We have developed a DiBAR system design, fabricated a Prototype-DiBAR (P-DiBAR) for proof-of-concept, conducted lab, ground and airborne P-DiBAR tests. The flight test results are consistent with our instrumentation goals. Observational system simulation experiments for space DiBAR performance show substantial improvements in tropical storm predictions, not only for the hurricane track and position but also for the hurricane intensity. DiBAR measurements will lead us to an unprecedented level of the prediction and knowledge on tropical extreme rainfall weather and climate conditions.

Lin, Bing↗

NASA NTRS2016

Remote Sensing Global Surface Air Pressure Using Differential Absorption BArometric Radar (DiBAR)

Tropical storms and severe weathers are listed as one of core events that need improved observations and predictions in World Meteorological Organization and NASA Decadal Survey (DS) documents and have major impacts on public safety and national security. This effort tries to observe surface air pressure, especially over open seas, from space using a Differential-absorption BArometric Radar (DiBAR) operating at the 50-55 gigahertz O2 absorption band. Air pressure is among the most important variables that affect atmospheric dynamics, and currently can only be measured by limited in-situ observations over oceans. Analyses show that with the proposed space radar the errors in instantaneous (averaged) pressure estimates can be as low as approximately 4 millibars (approximately 1 millibar under all weather conditions). With these sea level pressure measurements, the forecasts of severe weathers such as hurricanes will be significantly improved. Since the development of the DiBAR concept about a decade ago, NASA Langley DiBAR research team has made substantial progress in advancing the concept. The feasibility assessment clearly shows the potential of sea surface barometry using existing radar technologies. The team has developed a DiBAR system design, fabricated a Prototype-DiBAR (P-DiBAR) for proof-of-concept, conducted lab, ground and airborne P-DiBAR tests. The flight test results are consistent with the instrumentation goals. Observational system simulation experiments for space DiBAR performance based on the existing DiBAR technology and capability show substantial improvements in tropical storm predictions, not only for the hurricane track and position but also for the hurricane intensity. DiBAR measurements will lead us to an unprecedented level of the prediction and knowledge on global extreme weather and climate conditions.

Lin, Bing↗