SEARCH · Engineering Papers

Results for “Statistical forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Evaluation of idealized large-eddy simulations performed with the Weather Research and Forecasting model using turbulence measurements from a 250 m meteorological mast

Abstract. We investigate the ability of the Weather Research and Forecasting model to perform large-eddy simulation of canonical flows. This is achieved through comparison of the simulation outputs with measurements from sonic anemometers on a 250 m meteorological mast located at Østerild, in northern Denmark. Østerild is on a flat and rough area, and for the predominant wind directions, the atmospheric flow can be considered to be close to homogeneous. The idealized simulated flows aim at representing atmospheric boundary layer turbulence under unstable, neutral, and stable stability conditions at the surface, which are statistically significant conditions observed at Østerild. We found that the resolved fields from the simulations appear to have the characteristics of the three stability regimes. Vertical profiles of observed mean wind speeds and direction are well reproduced by the simulations, with the largest differences under near-neutral conditions, where the effect of the subgrid-scale model is evident on the vertical wind shear close to the surface. Vertical profiles of observed eddy fluxes are also well reproduced by the simulations, with the largest differences for the three velocity component variances under stable stability conditions, although nearly always within the observed variability. With regards to turbulent kinetic energy, we find good agreement between observations and simulations at all vertical levels. Simulated and observed velocity spectra match very well and show very similar behavior with height and with atmospheric stability within the low-frequency interval; at the effective resolution, the simulated spectra show the typical drop-off of finite differences. Our findings demonstrate that these idealized simulations reproduce the characteristics of atmospheric stability regimes often observed at a high turbulent and flat site within a direction sector, where the air flows over nearly homogeneous land.

17 WIND ENERGY↗

DOE OSTI2020

Development of a Time-Height Profile Assimilation Technique for Large-Eddy Simulation

Mesoscale-to-microscale coupling (MMC) aims to address the limited scope of traditional large-eddy simulations by driving the microscale flow with information concerning large-scale weather patterns provided by mesoscale models. We present a new offline MMC technique for horizontally homogeneous microscale flow conditions, in which internal forcing terms are computed based on mesoscale time–height profiles of mean-flow quantities. The advantage of such an approach is that it can be used to drive a microscale simulation with either mesoscale or observational data, and that it does not rely on specific terms in the mesoscale budget equations, which are typically not part of the default output of a mesoscale solver. The performance of the proposed profile assimilation technique is assessed based on the simulation of a typical diurnal cycle over the Scaled Wind Farm Technology site in west Texas. Results indicate that simple data assimilation techniques lead to unphysically high levels of shear and turbulence caused by the algorithm’s inability to cope with inaccuracies in the mesoscale time–height profiles. Modifying the algorithm to account for vertical coherence in the mesoscale source terms gives the microscale solver a greater ability to correct the provided mesoscale time–height profiles, leading to improved predictions of shear and turbulence statistics. The resulting turbulence statistics are in good agreement with meteorological tower observations and simulation results obtained with state-of-the-art coupling techniques using mesoscale budget components.

data assimilation↗

DOE OSTI2023

A species’ response to spatial climatic variation does not predict its response to climate change

The dominant paradigm for assessing ecological responses to climate change assumes that future states of individuals and populations can be predicted by current, species-wide performance variation across spatial climatic gradients. However, if the fates of ecological systems are better predicted by past responses to in situ climatic variation through time, this current analytical paradigm may be severely misleading. Empirically testing whether spatial or temporal climate responses better predict how species respond to climate change has been elusive, largely due to restrictive data requirements. Here, we leverage a newly collected network of ponderosa pine tree-ring time series to test whether statistically inferred responses to spatial versus temporal climatic variation better predict how trees have responded to recent climate change. When compared to observed tree growth responses to climate change since 1980, predictions derived from spatial climatic variation were wrong in both magnitude and direction. This was not the case for predictions derived from climatic variation through time, which were able to replicate observed responses well. Future climate scenarios through the end of the 21st century exacerbated these disparities. These results suggest that the currently dominant paradigm of forecasting the ecological impacts of climate change based on spatial climatic variation may be severely misleading over decadal to centennial timescales.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Basement Fault Activation before Larger Earthquakes in Oklahoma and Kansas

Oklahoma and Kansas experienced unprecedented seismic activity over the past decade due to earthquakes associated with unconventional hydrocarbon development. The modest natural seismicity and incomplete knowledge of the fault network in the region made it difficult to anticipate the locations of earthquakes with larger magnitudes (M w ≥ 4). Here, we show that monitoring of microearthquakes at regional scale using a pretrained neural phase picker and an earthquake relocation algorithm can illuminate unknown fault structures, and deliver information that can be synthesized for earthquake forecasting. We found that 80% of the larger earthquakes that occurred in the past decade could have been anticipated based on the spatial extent of the seismicity clusters that were formed before these earthquakes occurred. We also found that once a seismicity cluster with a length scale enough to host a larger earthquake was formed, there was a ~5% chance that it would host one or more larger earthquakes within a year. This probability is nearly an order of magnitude higher than one based on Gutenberg–Richter statistics and preceding seismicity. Applying our approach in practice can provide critical information on seismic hazards for risk management and regulatory decision making.

58 GEOSCIENCES↗

DOE OSTI2022

Simulating Impacts of Extreme Events on Grids with High Penetrations of Wind Power Resources

As extreme weather events become more frequent and intense, the demand for connecting grid operation and infrastructure planning with extreme event models will increase as well. We present a methodology for creating damage contingencies and scenarios for electric transmission grids during a hurricane strike. Included is an example case study: Hurricane Dolly damaging a synthetic 2000 bus test system during its landing in Southern Texas. Using WIND Toolkit meteorological data in conjunction with fragility curves for various electric grid elements, we generate stochastic damage scenarios that can be used for short- and long-term planning problems including emergency asset management. We perform statistical analysis of damages and quantify topological effects on example synthetic grid. Also, we investigate loss-of-load events during two-day economic dispatch experiment. Finally, we point out various shortcomings of our method and suggest how it can be improved.

data-driven forecasting↗

DOE OSTI2022

Simulating Impacts of Extreme Events on Grids with High Penetrations of Wind Power Resources: Preprint

contingencies↗

DOE OSTI2022

Operation-adversarial scenario generation

This paper proposes a modified conditional generative adversarial network (cGAN) model to generate net load scenarios for power systems that are statistically credible, conditioned by given labels (e.g., seasons), and, at the same time, “stressful” to the system operations and dispatch decisions. The measure of stress used in this paper is based on the operating cost increases due to net load changes. The proposed operation-adversarial cGAN (OA-cGAN) internalizes a DC optimal power flow model and seeks to maximize the operating cost and achieve a worst-case data generation. The training and testing stages employed in the proposed OA-cGAN use historical day-ahead net load forecast errors and has been implemented for the realistic NYISO 11-zone system. In conclusion, our numerical experiments demonstrate that the generated operation-adversarial forecast errors lead to more cost-effective and reliable dispatch decisions.

42 ENGINEERING↗

DOE OSTI2021

A Primer on Dose-Response Data Modeling in Radiation Therapy

An overview of common approaches used to assess a dose response for radiation therapy–associated endpoints is presented, using lung toxicity data sets analyzed as a part of the High Dose per Fraction, Hypofractionated Treatment Effects in the Clinic effort as an example. Each component presented (eg, data-driven analysis, dose-response analysis, and calculating uncertainties on model prediction) is addressed using established approaches. Specifically, the maximum likelihood method was used to calculate best parameter values of the commonly used logistic model, the profile-likelihood to calculate confidence intervals on model parameters, and the likelihood ratio to determine whether the observed data fit is statistically significant. The bootstrap method was used to calculate confidence intervals for model predictions. Correlated behavior of model parameters and implication for interpreting dose response are discussed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2023

Offshore wind energy forecasting sensitivity to sea surface temperature input in the Mid-Atlantic

Abstract. As offshore wind farm development expands, accurate wind resource forecasting over the ocean is needed. One important yet relatively unexplored aspect of offshore wind resource assessment is the role of sea surface temperature (SST). Models are generally forced with reanalysis data sets, which employ daily SST products. Compared with observations, significant variations in SSTs that occur on finer timescales are often not captured. Consequently, shorter-lived events such as sea breezes and low-level jets (among others), which are influenced by SSTs, may not be correctly represented in model results. The use of hourly SST products may improve the forecasting of these events. In this study, we examine the sensitivity of model output from the Weather Research and Forecasting model (WRF) 4.2.1 to different SST products. We first evaluate three different data sets: the Multiscale Ultrahigh Resolution (MUR25) SST analysis, a daily, 0.25∘ × 0.25∘ resolution product; the Operational Sea Surface Temperature and Ice Analysis (OSTIA), a daily, 0.054∘ × 0.054∘ resolution product; and SSTs from the Geostationary Operational Environmental Satellite 16 (GOES-16), an hourly, 0.02∘ × 0.02∘ resolution product. GOES-16 is not processed at the same level as OSTIA and MUR25; therefore, the product requires gap-filling using an interpolation method to create a complete map with no missing data points. OSTIA and GOES-16 SSTs validate markedly better against buoy observations than MUR25, so these two products are selected for use with model simulations, while MUR25 is at this point removed from consideration. We run the model for June and July of 2020 and find that for this time period, in the Mid-Atlantic, although OSTIA SSTs overall validate better against in situ observations taken via a buoy array in the area, the two products result in comparable hub-height (140 m) wind characterization performance on monthly timescales. Additionally, during hours-long flagged events (< 30 h each) that show statistically significant wind speed deviations between the two simulations, both simulations once again demonstrate similar validation performance (differences in bias, earth mover's distance, correlation, and root mean square error on the order of 10−1 or less), with GOES-16 winds validating nominally better than OSTIA winds. With a more refined GOES-16 product, which has been not only gap-filled but also assimilated with in situ SST measurements in the region, it is likely that hub-height winds characterized by GOES-16-informed simulations would definitively validate better than those informed by OSTIA SSTs.

17 WIND ENERGY↗

DOE OSTI2020

Data-Driven Day-Ahead PV Estimation Using Autoencoder-LSTM and Persistence Model

Inherent variability in photovoltaic (PV) and associated impacts on power systems is a challenging problem for both the PV owners and the grid operators. Existing statistical and machine learning algorithms typically work well for weather conditions similar to historical data. Furthermore, uncertain weather conditions pose a great challenge to the estimation accuracy of the estimation models. With the enhanced integration of intelligent electronic devices and the realization of associated automation in the power grid, renewable energy data is becoming more accessible, which can be utilized by deep learning models and improve the PV power generation estimation accuracy. In this paper, a hybrid deep learning model driven by external weather data is proposed to do day-ahead PV output forecasting at 15-minute-interval. The proposed model is motivated by the recent advancement of Long-Short-Term-Memory (LSTM) networks and AutoEncoder (AE), which estimates uncertainties in sequence while making the prediction for complex weather conditions. Meanwhile, the persistence model (PM) is used to predict continuous sunny weather conditions. The forecasting result is validated with data from multiple locations

42 ENGINEERING↗

DOE OSTI2020

How wind speed shear and directional veer affect the power production of a megawatt-scale operational wind turbine

Most megawatt-scale wind turbines align themselves into the wind as defined by the wind speed at or near the center of the rotor (hub height). However, both wind speed and wind direction can change with height across the area swept by the turbine blades. A turbine aligned to hub-height winds might experience suboptimal or superoptimal power production, depending on the changes in the vertical profile of wind, also known as shear. Using observed winds and power production over 6 months at a site in the high plains of North America, we quantify the sensitivity of a wind turbine's power production to wind speed shear and directional veer as well as atmospheric stability. We measure shear using metrics such as α (the log-law wind shear exponent), β bulk (a measure of bulk rotor-disk-layer veer), β total (a measure of total rotor-disk-layer veer), and rotor-equivalent wind speed (REWS; a measure of actual momentum encountered by the turbine by accounting for shear). We also consider the REWS with the inclusion of directional veer, REWS θ , although statistically significant differences in power production do not occur between REWS and REWS θ at our site. When REWS differs from the hub-height wind speed (as measured by either the lidar or a transfer function-corrected nacelle anemometer), the turbine power generation also differs from the mean power curve in a statistically significant way. This change in power can be more than 70 kW or up to 5 % of the rated power for a single 1.5 MW utility-scale turbine. Over a theoretical 100-turbine wind farm, these changes could lead to instantaneous power prediction gains or losses equivalent to the addition or loss of multiple utility-scale turbines. At this site, REWS is the most useful metric for segregating the turbine's power curve into high and low cases of power production when compared to the other shear or stability metrics. Therefore, REWS enables improved forecasts of power production.

17 WIND ENERGY↗

DOE OSTI2022

Simulating Impacts of Extreme Events on Grids with High Penetrations of Wind Power Resources

As extreme weather events become more frequent and intense, the demand for connecting grid operation and infrastructure planning with extreme event models will increase as well. We present a methodology for creating damage contingencies and scenarios for electric transmission grids during a hurricane strike. Using WIND Toolkit meteorological data in conjunction with fragility curves for various electric grid elements, we generate stochastic damage scenarios that can be used for short- and long-term planning problems, e.g., emergency asset management. Included is an example case study: Hurricane Dolly damaging a synthetic 2000-bus test system during its landing in Southern Texas. We perform statistical analysis of damages and discuss topological effects on the example synthetic grid. Also, we include a cursory evaluation of impacts using simplified operational models. Finally, we discuss how our method can be extended to use even higher-fidelity meteorological data sets and suggest directions for future work.

contingencies↗

DOE OSTI2023

Efficient Super-Resolution of Near-Surface Climate Modeling Using the Fourier Neural Operator

Downscaling methods are critical in efficiently generating high-resolution atmospheric data. However, state-of-the-art statistical or dynamical downscaling techniques either suffer from the high computational cost of running a physical model or require high-resolution data to develop a downscaling tool. Here, we demonstrate a recently proposed zero-shot super-resolution method, the Fourier neural operator (FNO), to efficiently perform downscaling without the need for high-resolution data. Because the FNO learns dynamics in Fourier space, FNO is a resolution-invariant emulator; it can be trained at a coarse resolution and produces emulation at any high resolution. We applied FNO to downscale a 4-km resolution Weather Research and Forecasting (WRF) Model simulation of near-surface heat-related variables over the Great Lakes region. The FNO is driven by the atmospheric forcings, and topographic features used in the WRF model at the same resolution. We incorporated a physics-constrained loss in FNO by using the Clausius-Clapeyron relation to better constrain the relations among the emulated states. Trained on merely 600 WRF snapshots at 4-km resolution, the FNO shows comparable performance with a widely used convolutional network, U-Net, achieving averaged modified Kling-Gupta Efficiency of 0.88 and 0.94 on the test dataset for temperature and pressure, respectively. We then employed the FNO to produce 1-km emulations to reproduce the fine climate features. Further, by taking the WRF simulation as ground truth, we show consistent performances at the two resolutions, suggesting the reliability of FNO in producing high-resolution dynamics. Our study demonstrates the potential of using FNO for zero-shot super-resolution in generating first-order estimation on atmospheric modeling.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Analysis of aerosol cloud interactions with a consistent signal of meteorology and other influencing parameters

Quantifying the impact of aerosols on cloud micro/macro physical properties and estimating the signature of Aerosol Cloud Interactions (ACI) is one of the challenging tasks in atmospheric sciences. The Moderate Resolution Imaging Spectroradiometer and the European Centre for Medium-Range Weather Forecasts ERA-5 reanalysis data are employed to systematically study the ACI over the monsoon region in Pakistan. Based on the monsoon occurrence and rainfall intensity, the whole region is divided into three sub-regions labeled as highly intensive (R1), moderately intensive (R2) and weak (R3) monsoon region. The results indicate that the monthly mean Aerosol Optical Depth (AOD) peaks in the summer monsoon months (Jun, Jul, Aug, Sep). Here, the well-known Twomey effect whereby the Cloud Droplet Radius (CDR) decreases with increasing AOD holds only over R3; the opposite effects (Anti-Twomey effect) are found over R1 and R2, all passing the test of statistical significance (p<0.05). The multi-year AOD is found to be positively correlated with Cloud Liquid Water Path (CLWP) and Cloud Optical Depth (COD) over R1 and R2, suggesting that thicker clouds containing more water droplets are formed in polluted atmosphere. Over R3, decreases in CLWP and COD are found with increasing AOD only when AOD is less than~0.325. The analysis of ACI over R1 and R2 during the winter months shows similar but stronger responses of CDR, CLWP and COD to the variation in AOD. The weaker responses during the summer monsoon season may attributed to the occurrence of high level cloud and unstable atmospheric condition. Further investigation of the influences of Relative Humidity and pressure vertical velocity on the CDR-AOD relationships shows that although the magnitude of the CDR-AOD correlations change with meteorological conditions, the sign of correlations remain unchanged with meteorological conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Modeling Nanoconfinement Effects Using Active Learning

Predicting the spatial configuration of gas in nanopores of is relevant in applications such as fluid flow forecasting and hydrocarbon reserves estimation. For example, shale reservoirs have suffered from computationally intractable multiscale problems, since fluid properties such as viscosity, density, and adsorption must be calculated by using expensive molecular dynamics (MD) simulations within each nanopore, whereas flow through these connected nanopores must be simulated at the micrometer scale. We utilize machine learning techniques to quickly and accurately model nanoscale confinement effects as an important step toward bridging the nano and micro scales. Our workflow is based on building and training physics-based deep-neural-networks models by learning from a database of MD calculations. The model accounts for the adsorption phenomenon by predicting the statistical distribution of gas inside nanopores. Because large databases of MD calculations are expensive to create, we investigate active learning (AL) as a data set construction strategy. In this workflow, new data are selected based on the model uncertainty via the query-by-committee approach. We show that our workflow obtains accurate models that generalize to real scanning electron microscopy geometries with 1/10th of the number of MD calculations required vs random data set generation. Our method enables the possibility of modeling nanoconfinement effects at the mesoscale, where complex connected sets of nanopores affect flow.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Hestia-SWIFL: hourly anthropogenic fossil fuel CO2 and heat on the 2km WRF grid, version 1.1

The Hestia-SWIFL version 1.1 anthropogenic heat (AH) and fossil fuel CO2 (FFCO2) emissions data product represent emissions due to the combustion of fossil fuel and cement production within the state of Arizona from 2019 to 2022. This product was developed as part of the Southwest Urban Corridor Integrated Field Laboratory (SW-IFL) project, which aims to provide new knowledge and tools that address extreme heat, air quality, climate change and related urban environmental issues by integrating high-resolution observations, modeling, and civic engagement. The emissions are generated using a bottom-up/engineering approach and are tied to results generated by the Vulcan Project version 4, an effort to quantify space/time-resolved FFCO2 & AH emissions for the entire United States landscape. A large number of data sources are combined to best estimate the emissions at fine scales such as air quality emissions data, traffic flow data, building information, sociodemographic information, and fuel statistics. The AH product provides emissions for two emissions sources (transportation and point source emissions) in units of Watts per hour per square meter (W/m2) per year (annual files) or per hour (hourly files). The FFCO2 product provides emissions from nine individual emission sectors as well as the total, and in units of tons of carbon (tC) per grid cell per year or per hour. The output made available here places the native spatial resolution of the Hestia FFCO2 & AH emissions data product (points, lines, and polygons) into a regularized 2km x 2km grid at hourly and annual temporal resolutions, and stored in netCDF files. The exact spatial extent is defined by the ASU Weather Research Forecast (WRF) simulation grid. All data are processed using R/Python pm high-performance computing system. 2-27-2026 updates: Bugs in airport hourly profile (both AH and FFCO2) and building spatial patterns (FFCO2 only) were fixed. Hourly emissions are reprocessed for all years to reflect those changes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Hierarchical semi-Markov models with duration-aware dynamics for activity sequences

Residential electricity demand at granular scales is driven by what people do and for how long. Accurately forecasting this demand for applications like microgrid management and demand response therefore requires generative models for activities that can produce realistic daily activity sequences, capturing both the timing and duration of human behavior. This paper develops a generative model of human activity sequences using nationally representative time-use diaries at a 10-min resolution. We use this model to quantify which demographic factors are most critical for improving predictive performance. We propose a hierarchical semi-Markov framework that addresses two key modeling challenges. First, a time-inhomogeneous Markov router learns the patterns of “which activity comes next.” Second, a semi-Markov hazard component explicitly models activity durations, capturing “how long” activities realistically last. To ensure statistical stability when data are sparse, the model pools information across related demographic groups and time blocks. The entire framework is trained and evaluated using survey design weights to ensure our findings are representative of the U.S. population. On a held-out test set, we demonstrate that explicitly modeling durations with the hazard component provides a substantial and statistically significant improvement over purely Markovian models. Furthermore, our analysis reveals a clear hierarchy of demographic factors: Sex, Day-Type, and Household Size provide the largest predictive gains, while Region and Season, though important for energy calculations, contribute little to predicting the activity sequence itself. The result is an interpretable and robust generator of synthetic activity traces, providing a high-fidelity foundation for downstream energy systems modeling.

24 POWER TRANSMISSION AND DISTRIBUTION↗