Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Operation-adversarial scenario generation

This paper proposes a modified conditional generative adversarial network (cGAN) model to generate net load scenarios for power systems that are statistically credible, conditioned by given labels (e.g., seasons), and, at the same time, “stressful” to the system operations and dispatch decisions. The measure of stress used in this paper is based on the operating cost increases due to net load changes. The proposed operation-adversarial cGAN (OA-cGAN) internalizes a DC optimal power flow model and seeks to maximize the operating cost and achieve a worst-case data generation. The training and testing stages employed in the proposed OA-cGAN use historical day-ahead net load forecast errors and has been implemented for the realistic NYISO 11-zone system. In conclusion, our numerical experiments demonstrate that the generated operation-adversarial forecast errors lead to more cost-effective and reliable dispatch decisions.

42 ENGINEERING↗

The useful potential of using existing data to uniquely identify predictable wind events and regimes, part 2

Wind data from four sites were stratified and found to naturally fit into a few unique groups. These were compared with synoptic weather patterns using the Booz-Allen classification system. Strong relationships became evident between a particular synoptic type and wind events for each site. Statistics indicate certain patterns which result in strong winds and some that result in weak winds. For each site there is a preferred wind direction associated with the strongest speed. Important relationships were also found comparing 850-mb and surface wind. Additionally, comparisons between pressure gradient and wind speed for a given gradient direction show some significant relationships. It can be stated that the overall results show what by using existing data for any site, the winds can be characterized and correlated with synoptic weather patterns. As a result, reliable wind forecasts can be made for utility companies for the purpose of power generation.

Notis, C.↗

A Primer on Dose-Response Data Modeling in Radiation Therapy

An overview of common approaches used to assess a dose response for radiation therapy–associated endpoints is presented, using lung toxicity data sets analyzed as a part of the High Dose per Fraction, Hypofractionated Treatment Effects in the Clinic effort as an example. Each component presented (eg, data-driven analysis, dose-response analysis, and calculating uncertainties on model prediction) is addressed using established approaches. Specifically, the maximum likelihood method was used to calculate best parameter values of the commonly used logistic model, the profile-likelihood to calculate confidence intervals on model parameters, and the likelihood ratio to determine whether the observed data fit is statistically significant. The bootstrap method was used to calculate confidence intervals for model predictions. Correlated behavior of model parameters and implication for interpreting dose response are discussed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The GEOS-iODAS: Description and Evaluation

This report documents the GMAO's Goddard Earth Observing System sea ice and ocean data assimilation systems (GEOS iODAS) and their evolution from the first reanalysis test, through the implementation that was used to initialize the GMAO decadal forecasts, and to the current system that is used to initialize the GMAO seasonal forecasts. The iODAS assimilates a wide range of observations into the ocean and sea ice components: in-situ temperature and salinity profiles, sea level anomalies from satellite altimetry, analyzed SST, and sea-ice concentration. The climatological sea surface salinity is used to constrain the surface salinity prior to the Argo years. Climatological temperature and salinity gridded data sets from the 2009 version of the World Ocean Atlas (WOA09) are used to help constrain the analysis in data sparse areas. The latest analysis, GEOS ODAS5.2, is diagnosed through detailed studies of the statistics of the innovations and analysis departures, comparisons with independent data, and integrated values such as volume transport. Finally, the climatologies of temperature and salinity fields from the Argo era, 2002-2011, are presented and compared with the WOA09.

Climate↗

Offshore wind energy forecasting sensitivity to sea surface temperature input in the Mid-Atlantic

Abstract. As offshore wind farm development expands, accurate wind resource forecasting over the ocean is needed. One important yet relatively unexplored aspect of offshore wind resource assessment is the role of sea surface temperature (SST). Models are generally forced with reanalysis data sets, which employ daily SST products. Compared with observations, significant variations in SSTs that occur on finer timescales are often not captured. Consequently, shorter-lived events such as sea breezes and low-level jets (among others), which are influenced by SSTs, may not be correctly represented in model results. The use of hourly SST products may improve the forecasting of these events. In this study, we examine the sensitivity of model output from the Weather Research and Forecasting model (WRF) 4.2.1 to different SST products. We first evaluate three different data sets: the Multiscale Ultrahigh Resolution (MUR25) SST analysis, a daily, 0.25∘ × 0.25∘ resolution product; the Operational Sea Surface Temperature and Ice Analysis (OSTIA), a daily, 0.054∘ × 0.054∘ resolution product; and SSTs from the Geostationary Operational Environmental Satellite 16 (GOES-16), an hourly, 0.02∘ × 0.02∘ resolution product. GOES-16 is not processed at the same level as OSTIA and MUR25; therefore, the product requires gap-filling using an interpolation method to create a complete map with no missing data points. OSTIA and GOES-16 SSTs validate markedly better against buoy observations than MUR25, so these two products are selected for use with model simulations, while MUR25 is at this point removed from consideration. We run the model for June and July of 2020 and find that for this time period, in the Mid-Atlantic, although OSTIA SSTs overall validate better against in situ observations taken via a buoy array in the area, the two products result in comparable hub-height (140 m) wind characterization performance on monthly timescales. Additionally, during hours-long flagged events (< 30 h each) that show statistically significant wind speed deviations between the two simulations, both simulations once again demonstrate similar validation performance (differences in bias, earth mover's distance, correlation, and root mean square error on the order of 10−1 or less), with GOES-16 winds validating nominally better than OSTIA winds. With a more refined GOES-16 product, which has been not only gap-filled but also assimilated with in situ SST measurements in the region, it is likely that hub-height winds characterized by GOES-16-informed simulations would definitively validate better than those informed by OSTIA SSTs.

17 WIND ENERGY↗

Data-Driven Day-Ahead PV Estimation Using Autoencoder-LSTM and Persistence Model

Inherent variability in photovoltaic (PV) and associated impacts on power systems is a challenging problem for both the PV owners and the grid operators. Existing statistical and machine learning algorithms typically work well for weather conditions similar to historical data. Furthermore, uncertain weather conditions pose a great challenge to the estimation accuracy of the estimation models. With the enhanced integration of intelligent electronic devices and the realization of associated automation in the power grid, renewable energy data is becoming more accessible, which can be utilized by deep learning models and improve the PV power generation estimation accuracy. In this paper, a hybrid deep learning model driven by external weather data is proposed to do day-ahead PV output forecasting at 15-minute-interval. The proposed model is motivated by the recent advancement of Long-Short-Term-Memory (LSTM) networks and AutoEncoder (AE), which estimates uncertainties in sequence while making the prediction for complex weather conditions. Meanwhile, the persistence model (PM) is used to predict continuous sunny weather conditions. The forecasting result is validated with data from multiple locations

42 ENGINEERING↗

Sensitivity of Lower Stratospheric Assimilated Ozone on Error Covariance Modeling and Data Selection

Assimilated ozone is produced at the NASA/Goddard Data Assimilation Office by blending ozone retrieved from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument and the Earth Probe Total Ozone Mapping Spectrometer (EP TOMS) measurements into an off-line transport model. The current system tends to overestimate the amount of lower stratospheric ozone. This is a region where ozone plays a key role in the forcing of climate. A biased ozone field in this region will adversely impact calculations of the stratosphere-troposphere exchange and, when used as a first guess in retrievals, the values determined from satellite observations. Since these are all important applications of assimilated ozone products, effort is being directed towards reducing this bias. The SBUV ozone data have a coarse vertical resolution with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone in the lower stratosphere, and its vertical distribution in particular, are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Accordingly, the sensitivity of the assimilated lower stratospheric ozone fields to changes in the TOMS error-covariance modeling and the SBUV data selection has been investigated. The use of a spatially correlated TOMS error covariance model led to improvements in the product. However, withholding the SBUV/2 data for the layer between 63 and 126 hPa typically degraded the product, a result which vindicates the use of this layer ozone product, despite its known errors. These efforts to improve the lower stratospheric distribution will be extended to include a more advanced forecast error covariance model, and by assimilating ozone products from new instruments on Envisat and EOS Aura.

Stajner, Ivanka↗

A Scheme for finding the Front Boundary of an Interplanetary Magnetic Cloud

We developed a scheme for finding the front boundary of an interplanetary magnetic cloud (MC) based on criteria that depend on the possible existence of any one or all of six specific solar wind features. The features that the program looks for, within +/- 2 hours of a preliminarily determined time for the front boundary, estimated either by visual inspection or by an automatic MC identification scheme, are: (1) a sufficiently large directional discontinuity in the interplanetary magnetic field (IMF), (2) existence of a magnetic hole, (3) a significant proton plasma beta drop, (4) a significant proton temperature drop, (5) a marked increase in the IMF's intensity, and (6) a significant decrease in a normalized root-mean-square deviation (RMS)of the magnetic field - where the scheme was tested using 5, 10, 15, and 20 minute averages of the relevant physical quantities, in order to find the optimum average (and RMS) to use. Other criteria, besides these six, were examined and dismissed as not reliable, e.g., plasma speed. The scheme was developed specifically for aiding in forecasting the strength and timing of a geomagnetic storm due to the passage of an interplanetary MC in real-time, but can be used in post ground-data collection for imposition of consistency in choosing a MC's front boundary. The scheme has been extensively tested, first using 80 bona fide MCs over about 9 years of WIND data, and also for 121 MC-like structures as defined by a program that automatically identifies such structures over the same period. Optimum limits for various parameters in the scheme were found by statistical studies of the WIND MCs. The resulting limits can be user-adjusted for other data sets, if desired. Final testing of the 80 MCs showed that for 50 percent of the events the boundary estimates occurred within +/-10 minutes of visually determined times, 80 percent occurred within +/-30 minutes, and 91 percent occur within +/-60 minutes, and three or more individual boundary tests were passed for 88 percent of the total MCs. The scheme and its testing will be described.

Lepping, Ronald P.↗

Improving the Monitoring of Crop Productivity Using Spaceborne Solar-Induced Fluorescence

Large-scale monitoring of crop growth and yield has important value for forecasting food production and prices and ensuring regional food security. A newly emerging satellite retrieval, solar-induced fluorescence (SIF) of chlorophyll, provides for the first time a direct measurement related to plant photosynthetic activity (i.e. electron transport rate). Here, we provide a framework to link SIF retrievals and crop yield, accounting for stoichiometry, photosynthetic pathways, and respiration losses. We apply this framework to estimate United States crop productivity for 2007-2012, where we use the spaceborne SIF retrievals from the Global Ozone Monitoring Experiment-2 satellite, benchmarked with county-level crop yield statistics, and compare it with various traditional crop monitoring approaches. We find that a SIF-based approach accounting for photosynthetic pathways (i.e. C3 and C4 crops) provides the best measure of crop productivity among these approaches, despite the fact that SIF sensors are not yet optimized for terrestrial applications. We further show that SIF provides the ability to infer the impacts of environmental stresses on autotrophic respiration and carbon-use-efficiency, with a substantial sensitivity of both to high temperatures. These results indicate new opportunities for improved mechanistic understanding of crop yield responses to climate variability and change.

Guan, Kaiyu↗

How wind speed shear and directional veer affect the power production of a megawatt-scale operational wind turbine

Most megawatt-scale wind turbines align themselves into the wind as defined by the wind speed at or near the center of the rotor (hub height). However, both wind speed and wind direction can change with height across the area swept by the turbine blades. A turbine aligned to hub-height winds might experience suboptimal or superoptimal power production, depending on the changes in the vertical profile of wind, also known as shear. Using observed winds and power production over 6 months at a site in the high plains of North America, we quantify the sensitivity of a wind turbine's power production to wind speed shear and directional veer as well as atmospheric stability. We measure shear using metrics such as α (the log-law wind shear exponent), β bulk (a measure of bulk rotor-disk-layer veer), β total (a measure of total rotor-disk-layer veer), and rotor-equivalent wind speed (REWS; a measure of actual momentum encountered by the turbine by accounting for shear). We also consider the REWS with the inclusion of directional veer, REWS θ , although statistically significant differences in power production do not occur between REWS and REWS θ at our site. When REWS differs from the hub-height wind speed (as measured by either the lidar or a transfer function-corrected nacelle anemometer), the turbine power generation also differs from the mean power curve in a statistically significant way. This change in power can be more than 70 kW or up to 5 % of the rated power for a single 1.5 MW utility-scale turbine. Over a theoretical 100-turbine wind farm, these changes could lead to instantaneous power prediction gains or losses equivalent to the addition or loss of multiple utility-scale turbines. At this site, REWS is the most useful metric for segregating the turbine's power curve into high and low cases of power production when compared to the other shear or stability metrics. Therefore, REWS enables improved forecasts of power production.

17 WIND ENERGY↗

Simulating Impacts of Extreme Events on Grids with High Penetrations of Wind Power Resources

As extreme weather events become more frequent and intense, the demand for connecting grid operation and infrastructure planning with extreme event models will increase as well. We present a methodology for creating damage contingencies and scenarios for electric transmission grids during a hurricane strike. Using WIND Toolkit meteorological data in conjunction with fragility curves for various electric grid elements, we generate stochastic damage scenarios that can be used for short- and long-term planning problems, e.g., emergency asset management. Included is an example case study: Hurricane Dolly damaging a synthetic 2000-bus test system during its landing in Southern Texas. We perform statistical analysis of damages and discuss topological effects on the example synthetic grid. Also, we include a cursory evaluation of impacts using simplified operational models. Finally, we discuss how our method can be extended to use even higher-fidelity meteorological data sets and suggest directions for future work.

contingencies↗

Retrieval and use of high-resolution moisture and stability fields from Nimbus 6 HIRS radiances in pre-convective situations

A moisture-temperature retrieval scheme was developed for lower-tropospheric analysis and forecasting parameters from the Nimbus 6 High-resolution Infrared Radiation Sounder, in a study of convective development on the Great Plains of the U.S. on four case study days in August 1975. Dew points and temperatures, along with such secondary parameters as total precipitate water and static stability indices, were derived and analyzed at a horizontal resolution of up to 30 km on the four days. Convective development beginning 2.0-2.5 hours after the satellite pass at local noon was found to correlate well with local moisture and instability maxima seen in the satellite-derived analyses. A statistical structure analysis of the satellite-derived parameters gave the highest signal-to-noise values for the moisture and stability parameters, while the temperature parameters showed much lower signal-to-noise content.

Hillger, D. W.↗

Efficient Super-Resolution of Near-Surface Climate Modeling Using the Fourier Neural Operator

Downscaling methods are critical in efficiently generating high-resolution atmospheric data. However, state-of-the-art statistical or dynamical downscaling techniques either suffer from the high computational cost of running a physical model or require high-resolution data to develop a downscaling tool. Here, we demonstrate a recently proposed zero-shot super-resolution method, the Fourier neural operator (FNO), to efficiently perform downscaling without the need for high-resolution data. Because the FNO learns dynamics in Fourier space, FNO is a resolution-invariant emulator; it can be trained at a coarse resolution and produces emulation at any high resolution. We applied FNO to downscale a 4-km resolution Weather Research and Forecasting (WRF) Model simulation of near-surface heat-related variables over the Great Lakes region. The FNO is driven by the atmospheric forcings, and topographic features used in the WRF model at the same resolution. We incorporated a physics-constrained loss in FNO by using the Clausius-Clapeyron relation to better constrain the relations among the emulated states. Trained on merely 600 WRF snapshots at 4-km resolution, the FNO shows comparable performance with a widely used convolutional network, U-Net, achieving averaged modified Kling-Gupta Efficiency of 0.88 and 0.94 on the test dataset for temperature and pressure, respectively. We then employed the FNO to produce 1-km emulations to reproduce the fine climate features. Further, by taking the WRF simulation as ground truth, we show consistent performances at the two resolutions, suggesting the reliability of FNO in producing high-resolution dynamics. Our study demonstrates the potential of using FNO for zero-shot super-resolution in generating first-order estimation on atmospheric modeling.

54 ENVIRONMENTAL SCIENCES↗

Experimental forecasts of El Nino

A deterministic numerical model of the coupled evolution of the tropical ocean and atmosphere was used to forecast all El Nino/Southern Oscillation (ENSO) events from 1970 to 1986. More particularly, the model, originally developed for studying large-scale ocean-atmosphere interactions in the tropics, successfully predicted the characteristics of the spatial and temporal structure of ENSO observed in the study interval. The model indicated that rainfall moving eastward over the Pacific slackens the surface winds that would otherwise cool the eastern Pacific by drawing up cooler subsurface waters. The oceanic thermocline increases, a poleward flow of westerly flowing warn waters deplets the equatorial warm water reservoir, and sea surface temperatures decline. These ENSO conditions are statistically tractable with the model several months in advance, provided upper ocean layer thermal data are available.

Cane, M. A.↗

The Status of the Tropical Rainfall Measuring Mission (TRMM) after 2 Years in Orbit

The Tropical Rainfall Measuring Mission (TRMM) satellite was launched on November 27, 1997, and data from all the instruments first became available approximately 30 days after launch. Since then, much progress has been made in the calibration of the sensors, the improvement of the rainfall algorithms, in related modeling applications and in new datasets tailored specifically for these applications. This paper reports the latest results regarding the calibration of the TRMM Microwave Imager, (TMI), Precipitation Radar (PR) and Visible and Infrared Sensor (VIRS). For the TMI, a new product is in place that corrects for a still unknown source of radiation leaking in to the TMI receiver. The PR calibration has been adjusted upward slightly (by 0.6 dBZ) to better match ground reference targets, while the VIRS calibration remains largely unchanged. In addition to the instrument calibration, great strides have been made with the rainfall algorithms as well, with the new rainfall products agreeing with each other to within less than 20% over monthly zonally averaged statistics. The TRMM Science Data and Information System (TSDIS) has responded equally well by making a number of new products, including real-time and fine resolution gridded rainfall fields available to the modeling community. The TRMM Ground Validation (GV) program is also responding with improved radar calibration techniques and rainfall algorithms to provide more accurate GV products which will be further enhanced with the new multiparameter 10 cm radar being developed for TRMM validation and precipitation studies. Progress in these various areas has, in turn, led to exciting new developments in the modeling area where Data Assimilation, and Weather Forecast models are showing dramatic improvements after the assimilation of observed rainfall fields.

Kummerow, C.↗

Detection of the Earth with the SETI microwave observing system assumed to be operating out in the galaxy

This paper estimates the maximum range at which radar signals from the Earth could be detected by a search system similar to the NASA Search for Extraterrestrial Intelligence Microwave Observing Project (SETI MOP) assumed to be operating out in the galaxy. Figures are calculated for the Targeted Search, and for the Sky Survey parts of the MOP, both operating, as currently planned, in the second half of the decade of the 1990s. Only the most powerful terrestrial transmitters are considered, namely, the planetary radar at Arecibo in Puerto Rico, and the ballistic missile early warning systems (BMEWS). In each case the probabilities of detection over the life of the MOP are also calculated. The calculation assumes that we are only in the eavesdropping mode. Transmissions intended to be detected by SETI systems are likely to be much stronger and would of course be found with higher probability to a greater range. Also, it is assumed that the transmitting civilization is at the same level of technological evolution as ours on Earth. This is very improbable. If we were to detect another technological civilization, it would, on statistical grounds, be much older than we are and might well have much more powerful transmitters. Both factors would make detection by the NASA MOP a much more likely outcome.

NASA Center ARC↗

Remote sensing-aided systems for snow qualification, evapotranspiration estimation, and their application in hydrologic models

The design of general remote sensing-aided methodologies was studied to provide the estimates of several important inputs to water yield forecast models. These input parameters are snow area extent, snow water content, and evapotranspiration. The study area is Feather River Watershed (780,000 hectares), Northern California. The general approach involved a stepwise sequence of identification of the required information, sample design, measurement/estimation, and evaluation of results. All the relevent and available information types needed in the estimation process are being defined. These include Landsat, meteorological satellite, and aircraft imagery, topographic and geologic data, ground truth data, and climatic data from ground stations. A cost-effective multistage sampling approach was employed in quantification of all the required parameters. The physical and statistical models for both snow quantification and evapotranspiration estimation was developed. These models use the information obtained by aerial and ground data through appropriate statistical sampling design.

Korram, S.↗

Aspects of clear air turbulence severity forecasting and detection

Factors influencing the accuracy of the forecasts of incidences of clear air turbulence (CAT) are discussed, along with techniques for improved verification. Descriptive ranking terms for the intensity of CAT events, ranging from light to extreme, are developed, and meteorological parameters used for predictions are reviewed, including jetstream core location, vertical and horizontal wind shears, stable layers, tropopause height, trough speed, 500-mb vorticity, surface fronts, pressure centers and cyclogenesis, and wind speeds near mountain ridges. Methods of remote detection of CAT, particularly by using radiometry sensitive to the IR water vapor band, are noted to have had some success in detecting actual CAT events and decreasing false alarms. Statistical aspects of CAT encounter severity are discussed, including the establishment of confidence intervals for thresholds of detection of CATs of varying intensities.

Ehernberger, L. J.↗