Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Enabling the Assimilation of CrIS Shortwave Infrared Observations in Global NWP at NOAA. Part II: OSEs and Results

The assimilation of data from hyperspectral infrared sounders in global data assimilation systems has historically been focused on observations in the longwave infrared (LWIR) region of the spectrum (650-1100 cm−1), despite the often concurrent availability of measurements from the shortwave infrared (SWIR) region of the spectrum (2150-2550 cm−1), because issues (like solar effects) have generally prevented the assimilation of SWIR observations. Recent advances in radiative transfer models have worked to address some of the previous challenges in simulating SWIR observations, and the assimilation of SWIR data (e.g. from potential future small-satellites) is now a feasible prospect. Still, a better understanding of how these observations perform in a data assimilation system and impact resulting analyses and NWP forecasts is necessary. In this study, the value of SWIR observations in global NWP is assessed by assimilating SWIR observations from the Cross-track Infrared Sounder (CrIS) in NOAA’s Global Data Assimilation System (GDAS). The methodologies used to enable the assimilation of these observations, including the implementation of a scene-dependent observation error and the enhancement of quality control procedures, are discussed, as are the results of Observing System Experiments (OSEs) conducted to evaluate the impact of assimilating SWIR observations on forecast skill. The overall results show that SWIR assimilation produces similar forecast impacts to LWIR assimilation. The ability to demonstrate that the assimilation or SWIR observations in NWP is a realistic prospect may help to shape future constellations of small-satellites to serve as a beneficial complement to the current constellation if hyperspectral IR sounders.

Erin Jones↗

A Scientist-in-the-Loop Data Analytics Framework for Intelligent Simulation Model Tuning and Validation

This project developed a scientist-in-the-loop data analytics framework for intelligent simulation model tuning and validation, targeting the Weather Research and Forecasting (WRF) model and its solar energy variant, WRF-Solar-BNL. Domain experts, such as climate scientists, depend on large-scale numerical simulations for knowledge discovery and decision-making, yet the complexity of parameter tuning and the disconnect between automated optimization and domain expertise pose significant challenges. We extended an interactive visual analytics framework that enables domain experts to observe and intervene in the computational steering process by identifying disagreements between the simulation model, surrogate model, and the expert’s domain knowledge. Using Bayesian Optimization with Gaussian Process Regression as the surrogate model, our system allows users to probe parameter relationships, analyze correlation patterns, and adjust tuning parameters in real time. We developed use cases for solar irradiance forecasting through sustained collaboration with Brookhaven National Laboratory, resolving critical model configuration challenges and achieving meaningful reductions in prediction error. The project supported one PhD student, one MS student, and eight undergraduate students across three Data Science Capstone projects, resulting in one master’s thesis.

Dasgupta, Aritra [New Jersey Institute of Technolo↗

Computations of atmospheric angular momentum, with emphasis on the merit period

Three-dimensional wind and pressure fields used to calculate effective angular momentum functions (EAMFs) for earth rotation/polar motion are produced by a complex 3-step system at the U.S. National Meteorological Center. The resulting series of functions have errors which can be estimated by comparisons with similar series produced by the European Center for Medium Range Weather Forecasts. For the axial wind component, related to length of day (lod) changes, the small differences between the two series of atmospheric angular momentum (AAM) are confined to the tropics and the higher latitudes of the Southern Hemisphere. In addition, differences between the seasonal components of the AAM series and those of lod are found to be significantly reduced by including the entire stratosphere's momentum. Comparisons of the EAMFs for 8 calendar years indicate substantial interannual variability exists in the annual amplitudes of these forcing terms. In particular, the axial AAM showed quite different behavior from normal in 1983 and 1984, the years of the MERIT campaign. These two years showed very high and low annual amplitudes for AAM, respectively, which can be attributed to the effect of the tropical Pacific sea surface warming (El Nino) and its aftermath.

Salstein, David A.↗

Long-Range Solar Activity Predictions: A Reprieve from Cycle #24's Activity

We discuss the field of long-range solar activity predictions and provide an outlook into future solar activity. Orbital predictions for satellites in Low Earth Orbit (LEO) depend strongly on exospheric densities. Solar activity forecasting is important in this regard, as the solar ultra-violet (UV) and extreme ultraviolet (EUV) radiations inflate the upper atmospheric layers of the Earth, forming the exosphere in which satellites orbit. Rather than concentrate on statistical, or numerical methods, we utilize a class of techniques (precursor methods) which is founded in physical theory. The geomagnetic precursor method was originally developed by the Russian geophysicist, Ohl, using geomagnetic observations to predict future solar activity. It was later extended to solar observations, and placed within the context of physical theory, namely the workings of the Sun s Babcock dynamo. We later expanded the prediction methods with a SOlar Dynamo Amplitude (SODA) index. The SODA index is a measure of the buried solar magnetic flux, using toroidal and poloidal field components. It allows one to predict future solar activity during any phase of the solar cycle, whereas previously, one was restricted to making predictions only at solar minimum. We are encouraged that solar cycle #23's behavior fell closely along our predicted curve, peaking near 192, comparable to the Schatten, Myers and Sofia (1996) forecast of 182+/-30. Cycle #23 extends from 1996 through approximately 2006 or 2007, with cycle #24 starting thereafter. We discuss the current forecast of solar cycle #24, (2006-2016), with a predicted smoothed F10.7 radio flux of 142+/-28 (1-sigma errors). This, we believe, represents a reprieve, in terms of reduced fuel costs, etc., for new satellites to be launched or old satellites (requiring reboosting) which have been placed in LEO. By monitoring the Sun s most deeply rooted magnetic fields; long-range solar activity can be predicted. Although a degree of uncertainty in the long-range predictions remains, requiring future monitoring, we do not expect the next cycle's + 2-sigma value will rise significantly above solar cycle #23's activity level.

Richon, K.↗

Mass Conservation and Positivity Preservation with Ensemble-type Kalman Filter Algorithms

Maintaining conservative physical laws numerically has long been recognized as being important in the development of numerical weather prediction (NWP) models. In the broader context of data assimilation, concerted efforts to maintain conservation laws numerically and to understand the significance of doing so have begun only recently. In order to enforce physically based conservation laws of total mass and positivity in the ensemble Kalman filter, we incorporate constraints to ensure that the filter ensemble members and the ensemble mean conserve mass and remain nonnegative through measurement updates. We show that the analysis steps of ensemble transform Kalman filter (ETKF) algorithm and ensemble Kalman filter algorithm (EnKF) can conserve the mass integral, but do not preserve positivity. Further, if localization is applied or if negative values are simply set to zero, then the total mass is not conserved either. In order to ensure mass conservation, a projection matrix that corrects for localization effects is constructed. In order to maintain both mass conservation and positivity preservation through the analysis step, we construct a data assimilation algorithms based on quadratic programming and ensemble Kalman filtering. Mass and positivity are both preserved by formulating the filter update as a set of quadratic programming problems that incorporate constraints. Some simple numerical experiments indicate that this approach can have a significant positive impact on the posterior ensemble distribution, giving results that are more physically plausible both for individual ensemble members and for the ensemble mean. The results show clear improvements in both analyses and forecasts, particularly in the presence of localized features. Behavior of the algorithm is also tested in presence of model error.

EnKR↗

Simulations and Visualizations of Hurricane Sandy (2012) as Revealed by the NASA CAMVis

Storm Sandy first appeared as a tropical storm in the southern Caribbean Sea on Oct. 22, 2012, moved northeastward, turned northwestward, and made landfall near Brigantine, New Jersey in late October. Sandy devastated surrounding areas, caused an estimated damage of $50 billion, and became the second costliest tropical cyclone (TC) in U.S. History surpassed only by Hurricane Katrina (2005). To save lives and mitigate economic damage, a central question to be addressed is to what extent the lead time of severe storm prediction such as Sandy can be extended (e.g., Emanuel 2012; Kerr 2012). In this study, we present 10 numerical experiments initialized at 00 and 1200 UTC Oct. 22-26, 2012, with the NASA coupled advanced global modeling and visualization systems (CAMVis). All of the predictions realistically capture Sandy's movement with the northwestward turn prior to its landfall. However, three experiments (initialized at 0000 UTC Oct. 22 and 24 and 1200 UTC Oct. 22) produce larger errors. Among the 10 experiments, the control run initialized at 0000 UTC Oct. 23 produces a remarkable 7-day forecast. To illustrate the impact of environmental flows on the predictability of Sandy, we produce and discuss four-dimensional (4-D) visualizations with the control run. 4-D visualizations clearly demonstrate the following multiscale processes that led to the sinuous track of Sandy: the initial steering impact of an upper-level trough (appearing over the northwestern Caribbean Sea and Gulf of Mexico), the blocking impact of systems to the northeast of Sandy, and the binary interaction with a mid-latitude, upper-level trough that appeared at 130degrees west longitude on Oct. 23, moved to the East Coast and intensified during the period of Oct. 29-30 prior to Sandy's landfall.

visualizations↗

Insight and Evidence Motivating the Simplification of Dual-Analysis Hybrid Systems into Single-Analysis Hybrid Systems

Many hybrid data assimilation systems currently used for NWP employ some form of dual-analysis system approach. Typically a hybrid variational analysis is responsible for creating initial conditions for high-resolution forecasts, and an ensemble analysis system is responsible for creating sample perturbations used to form the flow-dependent part of the background error covariance required in the hybrid analysis component. In many of these, the two analysis components employ different methodologies, e.g., variational and ensemble Kalman filter. In such cases, it is not uncommon to have observations treated rather differently between the two analyses components; recentering of the ensemble analysis around the hybrid analysis is used to compensated for such differences. Furthermore, in many cases, the hybrid variational high-resolution system implements some type of four-dimensional approach, whereas the underlying ensemble system relies on a three-dimensional approach, which again introduces discrepancies in the overall system. Connected to these is the expectation that one can reliably estimate observation impact on forecasts issued from hybrid analyses by using an ensemble approach based on the underlying ensemble strategy of dual-analysis systems. Just the realization that the ensemble analysis makes substantially different use of observations as compared to their hybrid counterpart should serve as enough evidence of the implausibility of such expectation. This presentation assembles numerous anecdotal evidence to illustrate the fact that hybrid dual-analysis systems must, at the very minimum, strive for consistent use of the observations in both analysis sub-components. Simpler than that, this work suggests that hybrid systems can reliably be constructed without the need to employ a dual-analysis approach. In practice, the idea of relying on a single analysis system is appealing from a cost-maintenance perspective. More generally, single-analysis systems avoid contradictions such as having to choose one sub-component to generate performance diagnostics to another, possibly not fully consistent, component.

Todling, Ricardo↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavordsky, Bradley↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavodsky, Bradley↗

Three-Stage Adjusted Regression Forecasting for Software Defect Prediction

In this paper, a three-stage adjusted regression forecasting model is proposed to forecast the local regression model [6]. This is a growth curve approximation model that predicts the parameters for a future linear model based on a sliding window of previous linear models. The three stages of the model are as follows: • Initial fit: train regression models on a sliding window of the date and record model coefficients. • Prediction: fit new regression models to the coefficient lists and predict the value of the next coefficient. • Error correction: correct coefficient prediction error using the residual of the last point of the coefficient list and moving average. The resulting model from the multi-stage process is a forecast of the local regression model that represents the future window of data and is referred to as the predicted line. Results suggest the three-stage model demonstrates better prediction capability compared to existing solutions.

Pritchard, Shadow↗

A Deep Learning Modeling Framework to Capture Mixing Patterns in Reactive-Transport Systems

Prediction and control of chemical mixing are vital for many scientific areas such as subsurface reactive transport, climate modeling, combustion, epidemiology, and pharmacology. Due to the complex nature of mixing in heterogeneous and anisotropic media, the mathematical models related to this phenomenon are not analytically tractable. Numerical simulations often provide a viable route to predict chemical mixing accurately. However, contemporary modeling approaches for mixing cannot utilize available spatial-temporal data to improve the accuracy of the future prediction and can be compute-intensive, especially when the spatial domain is large and for long-term temporal predictions. To address this knowledge gap, in this work we will present in this paper a deep learning (DL) modeling framework applied to predict the progress of chemical mixing under fast bimolecular reactions. This framework uses convolutional neural networks (CNN) for capturing spatial patterns and long short-term memory (LSTM) networks for forecasting temporal variations in mixing. By careful design of the framework—placement of non-negative constraint on the weights of the CNN and the selection of activation function, the framework ensures non-negativity of the chemical species at all spatial points and for all times. Our DL-based framework is fast, accurate, and requires minimal data for training. The time needed to obtain a forecast using the model is a fraction (≈ O(-6)) of the time needed to obtain the result using a high-fidelity simulation. To achieve an error of 10% (measured using the infinity norm) for capturing local-scale mixing features such as interfacial mixing, only 24% to 32% of the sequence data for model training is required. To achieve the same level of accuracy for capturing global-scale mixing features, the sequence data required for model training is 64% to 70% of the total spatial-temporal data. Hence, the proposed approach—a fast and accurate way to forecast long-time spatial-temporal mixing patterns in heterogeneous and anisotropic media—will be a valuable tool for modeling reactive-transport in a wide range of applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The Impact of Atmospheric InfraRed Sounder (AIRS) Profiles on Short-term Weather Forecasts

The Atmospheric Infrared Sounder (AIRS), together with the Advanced Microwave Sounding Unit (AMSU), represents one of the most advanced spacebased atmospheric sounding systems. The combined AlRS/AMSU system provides radiance measurements used to retrieve temperature profiles with an accuracy of 1 K over 1 km layers under both clear and partly cloudy conditions, while the accuracy of the derived humidity profiles is 15% in 2 km layers. Critical to the successful use of AIRS profiles for weather and climate studies is the use of profile quality indicators and error estimates provided with each profile Aside form monitoring changes in Earth's climate, one of the objectives of AIRS is to provide sounding information of sufficient accuracy such that the assimilation of the new observations, especially in data sparse region, will lead to an improvement in weather forecasts. The purpose of this paper is to describe a procedure to optimally assimilate highresolution AIRS profile data in a regional analysis/forecast model. The paper will focus on the impact of AIRS profiles on a rapidly developing east coast storm and will also discuss preliminary results for a 30-day forecast period, simulating a quasi-operation environment. Temperature and moisture profiles were obtained from the prototype version 5.0 EOS science team retrieval algorithm which includes explicit error information for each profile. The error profile information was used to select the highest quality temperature and moisture data for every profile location and pressure level for assimilation into the ARPS Data Analysis System (ADAS). The AIRS-enhanced analyses were used as initial fields for the Weather Research and Forecast (WRF) system used by the SPORT project for regional weather forecast studies. The ADASWRF system will be run on CONUS domain with an emphasis on the east coast. The preliminary assessment of the impact of the AIRS profiles will focus on quality control issues associated with AIRS, intelligent use of the quality indicators, and forecast verification.

Chou, Shih-Hung↗

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗

Examining Dense Data Usage near the Regions with Severe Storms in All-Sky Microwave Radiance Data Assimilation and Impacts on GEOS Hurricane Analyses

Many numerical weather prediction (NWP) centers assimilate radiances affected by clouds and precipitation from microwave sensors, with the expectation that these data can provide critical constraints on meteorological parameters in dynamically sensitive regions to make significant impacts on forecast accuracy for precipitation. The Global Modeling and Assimilation Office (GMAO) at NASA Goddard Space Flight Center assimilates all-sky microwave radiance data from various microwave sensors such as all-sky GPM Microwave Imager (GMI) radiance in the Goddard Earth Observing System (GEOS) atmospheric data assimilation system (ADAS), which includes the GEOS atmospheric model, the Gridpoint Statistical Interpolation (GSI) atmospheric analysis system, and the Goddard Aerosol Assimilation System (GAAS). So far, most of NWP centers apply same large data thinning distances, that are used in clear-sky radiance data to avoid correlated observation errors, to all-sky microwave radiance data. For example, NASA GMAO is applying 145 km thinning distances for most of satellite radiance data including microwave radiance data in which all-sky approach is implemented. Even with these coarse observation data usage in all-sky assimilation approach, noticeable positive impacts from all-sky microwave data on hurricane track forecasts were identified in GEOS-5 system. The motivation of this study is based on the dynamic thinning distance method developed in our all-sky framework to use of denser data in cloudy and precipitating regions due to relatively small spatial correlations of observation errors. To investigate the benefits of all-sky microwave radiance on hurricane forecasts, several hurricane cases selected between 2016-2017 are examined. The dynamic thinning distance method is utilized in our all-sky approach to understand the sources and mechanisms to explain the benefits of all-sky microwave radiance data from various microwave radiance sensors like Advanced Microwave Sounder Unit (AMSU-A), Microwave Humidity Sounder (MHS), and GMI on GEOS-5 analyses and forecasts of various hurricanes.

Kim, Min-Jeong↗

Assessing Impacts of Waves on Hub-Height Winds off the U.S. West Coast Using Lidar Buoys and Coupled Modeling Approaches

Given the importance of offshore wind energy development to the U.S. clean energy targets, it is vital to be able to characterize the wind resource in that environment accurately. Toward that end, two Bureau of Ocean Energy Management buoys equipped with Doppler lidar are being maintained by Pacific Northwest National Laboratory on behalf of the Department of Energy and deployed to regions of potential offshore wind development. In addition to standard meteorological and oceanographic measurements, the buoys document the wind profile between about 40 m and 250 m above the sea surface through Doppler lidar retrievals. After a multiyear deployment of two buoys along the U.S. East Coast, the buoys were redeployed to the U.S. West coast from 2020 – 2022 to locations near the Humboldt and Morro Bay lease areas. The buoys provide nearly continuous, multiyear datasets that can be used to evaluate predictions of hub-height (~100 m) wind speed for standard atmospheric models in the region. In the absence of measurements at the study site, offshore wind developers rely on model-based data to assess site conditions. Potential sources of model error in this environment include under-resolution or misrepresentation of coastal topographically forced flows, marine boundary layer dynamics and the evolution of their associated cloud and turbulence fields, the role of upwelling and other currents on surface heat fluxes into the boundary layer, and the impact of wave fields on surface momentum fluxes and thus the wind speed profile. In particular, most predictive models of wind speed do not predict wave fields at all, relying on parameterizations to represent their effects. In thus study, we focus on evaluating the role of wind / wave interactions on modeled hub-height wind speed and error by using the Coupled Ocean–Atmosphere–Wave–Sediment–Transport Modeling System to capture two-way interactions between an atmospheric model (Weather Research and Forecasting (WRF)) and a wave model (WAVEWATCHIII (WW3)) and compare to both stand-alone WRF and one-way coupled WRF / WW3 configurations. Our approach is similar to that used in Gaudet et al. (2022) to evaluate wind / wave coupling over the U.S. East Coast, but applied to the very different environment of the U.S. West Coast. We show examples for two cases, a cold-season frontal case and a warm-season low-level jet case. We find that wind / wave coupling makes little impact on model error for these cases at the location of the lidar buoys, for which other misrepresentations of model physics seems to be responsible for model-observation discrepancies. However, domain-wide evaluations, which also make use of the National Buoy Data Center network, show that a two-way coupling approach is less prone to systematic errors in the hub-height wind field than the one-way coupled approach. WRF resolution of kilometer-scale or less is needed to properly capture the sharp wind speed gradients that can be found along the coastline, and WW3 simulations driven by the downscaled WRF produce better bulk and spectral wave fields when compared to observations. Implications of the results for wind resource characterization are then discussed.

17 WIND ENERGY↗

Verify MesoNAM Performance

The AMU conducted an objective analysis of the MesoNAM forecasts compared to observed values from sensors at specified KSC/CCAFS wind towers by calculating the following statistics to verify the performance of the model: 1) Bias (mean difference), 2) Standard deviation of Bias, 3) Root Mean Square Error (RMSE), and 4) Hypothesis test for Bias = O. The 45 WS LWOs use the MesoNAM to support launch weather operations. However, the actual performance of the model at KSC and CCAFS had not been measured objectively. The analysis compared the MesoNAM forecast winds, temperature and dew point to the observed values from the sensors on wind towers. The data were stratified by tower sensor, month and onshore/offshore wind direction based on the orientation of the coastline to each tower's location. The model's performance statistics were then calculated for each wind tower based on sensor height and model initialization time. The period of record for the data used in this task was based on the operational start of the current MesoNAM in mid-August 2006 and so the task began with the first full month of data, September 2006, through May 2010. The analysis of model performance indicated: a) The accuracy decreased as the forecast valid time from the model initialization increased, b) There was a diurnal signal in T with a cool bias during the late night and a warm bias during the afternoon, c) There was a diurnal signal in Td with a low bias during the afternoon and a high bias during the late night, and d) The model parameters at each vertical level most closely matched the observed parameters at heights closest to those vertical levels. The AMU developed a GUI that consists of a multi-level drop-down menu written in JavaScript embedded within the HTML code. This tool allows the LWO to easily and efficiently navigate among the charts and spreadsheet files containing the model performance statistics. The objective statistics give the LWOs knowledge of the model's strengths and weaknesses and the GUI allows quick access to the data which will result in improved forecasts for operations.

Bauman, William H., III↗

Transfer Learning Trained LSTM Models for Household Load Profile Forecasting

Grid edge renewable energy resources, such as rooftop solar photovoltaics, closely interact with consumer load profiles. Therefore, forecasting future electricity demand, ideally at the individual household level, is indispensable. In this paper, we present a transfer learning enhanced household load profile forecasting method. First, we tune a long short-term memory forecasting model to perform day-ahead prediction of household electricity load profiles. Then we improve these individualized models using transfer learning, and we use k-means clustering to create optimal source data sets. We find average improvements of 4.38% (largest improvement of 10.71%) when the entire data set was used to train the source model and 2.45% (largest improvement of 11.57%) in the mean absolute error when households were first clustered and used to train separate source models for each cluster. We find that transfer learning with clustered data can effectively boost the forecasting performance of the LSTM models. We use realistic household power measurements for 148 real residential households in Austin, Texas.

deep learning↗

Photometric redshift uncertainties in weak gravitational lensing shear analysis: models and marginalization

ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.

Zhang, Tianqing (ORCID:000000025596198X)↗