Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bias correction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Validation of the AMSU-B Bias Corrections Based on Satellite Measurements from SSM/T-2

The NOAA-15 Advanced Microwave Sounding Unit-B (AMSU-B) was designed in the same spirit as the Special Sensor Microwave Water Vapor Profiler (SSM/T-2) on board the DMSP F11-14 satellites, to perform remote sensing of spatial and temporal variations in mid and upper troposphere humidity. While the SSM/T-2 instruments have a 48 km spatial resolution at nadir and 28 beam positions per scan, AMSU-B provides an improvement with a 16 km spatial resolution at nadir and 90 beam positions per scan. The AMSU-B instrument, though, has been experiencing radio frequency interference (RFI) contamination from the NOAA-15 transmitters whose effect is dependent upon channel, geographic location, and current spacecraft antenna configuration. This has lead to large cross-track biases reaching as high as 100 Kelvin for channel 17 (150 GHz) and 50 Kelvin for channel 19 (183 +/-3 GHz). NOAA-NESDIS has recently provided a series of bias corrections for AMSU-B data starting from March, 1999. These corrections are available for each of the five channels, for every third field of view, and for three cycles within an eight second period. There is also a quality indicator in each data record to indicate whether or not the bias corrections should be applied. As a precursor to performing retrievals of mid and upper troposphere humidity, a validation study is performed by statistically analyzing the differences between the F14 SSM/T-2 and the bias corrected AMSU-B brightness temperatures for three months in the spring of 1999.

Kolodner, Marc A.↗
DOE OSTI2023

Future Projections of EURO‐CORDEX Raw and Bias‐Corrected Daily Maximum Wind Speeds Over Scandinavia

Twenty historical and future Coordinated Regional Climate Downscaling Experiment ensemble for Europe simulations are bias corrected to investigate the future changes in the daily maximum wind speed over Scandinavia. We use quantile mapping to adjust the wind for the historical period (1985–2014) and quantile delta mapping for two future periods (2041–2070, 2071–2100, RCP8.5) with the 3-km spatial resolution NORA3 hindcast as the reference data set. Decomposing the variance, we find that most of the inter-model spread in the bias and the response to climate change is due to the regional climate model over land and mainly to the general climate model over sea. On average, the mean daily maximum wind speed is projected to increase everywhere except along the western coast of Norway and Denmark. In summer, we see an opposite sign over Sweden and Finland. The Norwegian Sea experiences weaker mean and high wind whereas the Baltic Sea experiences a strengthening. Bias correction influences the amplitude of the response, not the response pattern. Wind speed distributions can have different shapes in the future, with, for example, a flattening of the distribution off the coast of Norway with more frequent weak and very strong winds. Apart from a few locations in Norway, we find an increase in the number of days in the local highest historical wind category. Overall, summer exhibits opposite signals compared to the three other seasons. At country scale, the sign of the change in the mean and 98th percentile varies greatly depending on the region and among the simulations, especially for Norway.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

On the Limitations of Variational Bias Correction

Satellite radiances are the largest dataset assimilated into Numerical Weather Prediction (NWP) models, however the data are subject to errors and uncertainties that need to be accounted for before assimilating into the NWP models. Variational bias correction uses the time series of observation minus background to estimate the observations bias. This technique does not distinguish between the background error, forward operator error, and observations error so that all these errors are summed up together and counted as observation error. We identify some sources of observations errors (e.g., antenna emissivity, non-linearity in the calibration, and antenna pattern) and show the limitations of variational bias corrections on estimating these errors.

Moradi, Isaac↗
DOE OSTI2024

Bias Correcting NOAA's High-Resolution Rapid Refresh (HRRR) Wind Resource Data for Grid Integration Applications [Slides]

Many weather years of high-quality wind data are widely accepted in the grid integration community to be important for studying wind energy technical potential, energy system operations, and grid resilience. NREL makes high-quality wind and solar resource data available. NREL's Grid-Atmosphere workshop (March 2024) identified NREL National Solar Radiation Database as widely used in grid integration modeling, but there is less agreement on commonly used wind datasets. One important factor identified by ESIG's 2023 report 'Weather Dataset Needs for Planning and Analyzing Modern Power Systems' for gold standard wind data is regular updates. To address the need for regular updates, NREL's team can now process all currently available and regularly updated High-Resolution Rapid Refresh (HRRR) outputs. HRRR is an hourly-updated operational forecast product produced by the National Oceanic and Atmospheric Administration (NOAA) (Dowell et al., 2022). One barrier to NREL using HRRR is systematic bias and consistency with NREL's existing wind datasets (e.g. WIND Toolkit, 'WTK') across weather years. To address this barrier, we show that the HRRR can be interpolated and bias-corrected to be consistent with NRE's existing datasets. We call the new dataset BC-HRRR (bias-corrected HRRR). As with historical datasets like the WTK, BC-HRRR is intended for use in grid integration modeling (e.g., capacity expansion, production cost, and resource adequacy modeling). BC-HRRR's (2015-present) consistency with WTK (2007-2013) allows NREL to extend internal grid integration tooling with 15+ weather years of wind data with low-overhead extensibility to future years as they are made available by NOAA. The rest of this slide deck documents the BC-HRRR processing methods, validation, and its implications for intended use.

17 WIND ENERGY↗
DOE OSTI2026

Machine learning-based bias-corrected future projections of ozone concentrations from a chemistry-climate model

Reliable projection of future near-surface ozone is crucial for air quality management and health risk assessment. However, potential biases in spatial distribution, magnitude and trends in ozone concentrations simulated by global chemistry-climate models limit their applicability in regional-scale evaluations. In this study, LightGBM, a machine learning (ML) algorithm is applied to correct biases in CESM2-simulated ozone concentrations over China, the United States and Europe and calibrate future ozone projections under two diverse Shared Socioeconomic Pathways (SSP1-2.6 and SSP5-8.5) scenarios from 2020 to 2060. The ML-based correction significantly improves the spatial distribution and reduces the model bias by 40%–60%. It also reverses the potentially incorrect trend of ozone change under SSP1-2.6 in eastern China. When applying ML-based bias correction to CESM2 future projections, warm season mean ozone concentrations decrease across China, the United States, and Europe by –13.5, –17.9, and –13.7 µg/m³, respectively, between 2020 and 2060 in SSP1-2.6, while they increase by 9.4, 2.0, and 5.2 µg/m³ in SSP5-8.5. Decomposition analysis show that changes in anthropogenic emissions dominate future ozone changes in both scenarios, while strong climate penalty from ozone changes occurs in polluted eastern China and climate benefit is found in western China, the United States and Europe under SSP5-8.5. These findings demonstrate the value of combining ML with chemistry-climate models to produce more accurate air quality projections, thereby informing more effective and region-specific environmental protection strategies.

Chemistry Model↗
NASA NTRS2014

Bias Correction for Assimilation of Retrieved AIRS Profiles of Temperature and Humidity

Atmospheric Infrared Sounder (AIRS) is a hyperspectral radiometer aboard NASA's Aqua satellite designed to measure atmospheric profiles of temperature and humidity. AIRS retrievals are assimilated into the Weather Research and Forecasting (WRF) model over the North Pacific for some cases involving "atmospheric rivers". These events bring a large flux of water vapor to the west coast of North America and often lead to extreme precipitation in the coastal mountain ranges. An advantage of assimilating retrievals rather than radiances is that information in partly cloudy fields of view can be used. Two different Level 2 AIRS retrieval products are compared: the Version 6 AIRS Science Team standard retrievals and a neural net retrieval from MIT. Before assimilation, a bias correction is applied to adjust each layer of retrieved temperature and humidity so the layer mean values agree with a short-term model climatology. WRF runs assimilating each of the products are compared against each other and against a control run with no assimilation. This paper will describe the bias correction technique and results from forecasts evaluated by validation against a Total Precipitable Water (TPW) product from CIRA and against Global Forecast System (GFS) analyses.

Blankenship, Clay↗
NASA NTRS2001

Bias Correction and Random Error Characterization for the Assimilation of HRDI Line-of-Sight Wind Measurements

A new approach to the analysis of systematic and random observation errors is presented in which the error statistics are obtained using forecast data rather than observations from a different instrument type. The analysis is carried out at an intermediate retrieval level, instead of the more typical state variable space. This method is carried out on measurements made by the High Resolution Doppler Imager (HRDI) on board the Upper Atmosphere Research Satellite (UARS). HRDI, a limb sounder, is the only satellite instrument measuring winds in the stratosphere, and the only instrument of any kind making global wind measurements in the upper atmosphere. HRDI measures doppler shifts in the two different O2 absorption bands (alpha and B) and the retrieved products are tangent point Line-of-Sight wind component (level 2 retrieval) and UV winds (level 3 retrieval). This analysis is carried out on a level 1.9 retrieval, in which the contributions from different points along the line-of-sight have not been removed. Biases are calculated from O-F (observed minus forecast) LOS wind components and are separated into a measurement parameter space consisting of 16 different values. The bias dependence on these parameters (plus an altitude dependence) is used to create a bias correction scheme carried out on the level 1.9 retrieval. The random error component is analyzed by separating the gamma and B band observations and locating observation pairs where both bands are very nearly looking at the same location at the same time. It is shown that the two observation streams are uncorrelated and that this allows the forecast error variance to be estimated. The bias correction is found to cut the effective observation error variance in half.

Tangborn, Andrew↗
NASA NTRS2006

Skin Temperature Analysis and Bias Correction in a Coupled Land-Atmosphere Data Assimilation System

In an initial investigation, remotely sensed surface temperature is assimilated into a coupled atmosphere/land global data assimilation system, with explicit accounting for biases in the model state. In this scheme, an incremental bias correction term is introduced in the model's surface energy budget. In its simplest form, the algorithm estimates and corrects a constant time mean bias for each gridpoint; additional benefits are attained with a refined version of the algorithm which allows for a correction of the mean diurnal cycle. The method is validated against the assimilated observations, as well as independent near-surface air temperature observations. In many regions, not accounting for the diurnal cycle of bias caused degradation of the diurnal amplitude of background model air temperature. Energy fluxes collected through the Coordinated Enhanced Observing Period (CEOP) are used to more closely inspect the surface energy budget. In general, sensible heat flux is improved with the surface temperature assimilation, and two stations show a reduction of bias by as much as 30 Wm(sup -2) Rondonia station in Amazonia, the Bowen ratio changes direction in an improvement related to the temperature assimilation. However, at many stations the monthly latent heat flux bias is slightly increased. These results show the impact of univariate assimilation of surface temperature observations on the surface energy budget, and suggest the need for multivariate land data assimilation. The results also show the need for independent validation data, especially flux stations in varied climate regimes.

Bosilovich, Michael G.↗
DOE OSTI2024

UFNet: Joint U-Net and Fully Connected Neural Network to Bias Correct Precipitation Predictions from

Paper information. Shuang Yu, Indrasis Chakraborty, Gemma J. Anderson, Donald D. Lucas, Yannic Lops, and Daniel Galea. UFNet: Joint U-Net and fully connected neural network to bias correct precipitation predictions from climate models. Artificial Intelligence for the Earth Systems, 2024. Overview. This work develops the UFNet methodology to correct E3SM historical precipitation projection bias. The UFNet deep learning framework consists of a two-part architecture: a U-Net convolutional network to capture the spatiotemporal distribution of precipitation and a fully connected network to capture the distribution of higher-order statistics. The joint network, termed UFNet, can simultaneously improve the spatial structure of the modeled precipitation and capture the distribution of extreme precipitation values. Below we provide guidance for applying UFNet to correct the Energy Exascale Earth System Model (E3SM; Golaz et al. 2019) daily precipitation projection over the contiguous United States (CONUS). Getting started 1. Obtain the historical climate simulation and observation data. The E3SM historical simulation data are available through https://aims2.llnl.gov/search/cmip6/. The CPC unified gauge-based analysis of daily precipitation can be found through https://psl.noaa.gov/data/gridded/data.cpc.globalprecip.html. The ECMWF atmospheric reanalysis of the 20th century (ERA-20C) data are available through https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era-20c. The spatial resolution of E3SM and observed datasets are both regridded to a common 1° resolution grid using conservative interpolation. The regridded E3SM, CPC and ERA-20C with 1° resolution can be found throught ./data/. 2. Train the fully connected network (DNN) Python train_dnn.py 3. Train the UFNet Python train_ufnet.py 4. Evaluation and compared with the baseline Python evaluation.py

Lucas, DonaldD↗
DOE OSTI2024

Bias Correction and Statistical Downscaling of Future Solar Irradiance Projections Using the NSRDB

Assessing renewable energy resources under future climate scenarios has been highlighted to understand potential impacts of future climate change in renewable generation on the power sector. Climate model projection has been recognized by the renewable energy community as a useful data set to analyze the impacts of future climate change on renewable resources. However, future climate projections generated from general circulation models (GCMs) contain inherent biases that need to be corrected for accurate analysis of future projections of climate variables. In addition, the coarse spatiotemporal resolution of GCMs needs to be improved for regional climate studies. In this work, we develop statistical methods to downscale future projections of global horizontal irradiance (GHI) in a computationally efficient way. Our approach builds statistical downscaling models that correct bias of climate projection of GHI and downscale the future GHI projection from daily-scale to hourly-scale. The National Solar Radiation Database (NSRDB) is used to calibrate the statistical models and validate the downscaled GHI projections across the contiguous United State (CONUS). Preliminary results show that the statistical approach efficiently downscales climate projections of GHI with a nBIAS of 3%, nMAE of 34 % and nRMSE of 46% calculated against NSRDB for CONUS. This study describes the implemented methodology and initial results as well as future research to create high-resolution climate data sets for solar energy applications.

analytical models↗
DOE OSTI2024

Is Bias Correction in Dynamical Downscaling Defensible?

Localized projections of 21st‐century hydroclimate variables obtained from downscaling Global Climate Model (GCM) output are central to informing regional impact assessments and infrastructure planning. Regional GCM biases can be significant and, for dynamical downscaling, can be addressed either before (a priori) or after (a posteriori) downscaling. However, a priori bias correction (APBC) has generally unexplored effects on climate change signals. Here we analyze dynamically downscaled solutions of CMIP6 GCMs over the Western U.S., with and without APBC, and quantify APBC's impact on climate change signals relative to other irreducible uncertainty sources. For temperature and precipitation, the uncertainty introduced by APBC is negligible compared to that arising from GCM choice or internal variability. Furthermore, APBC greatly reduces regional models' unrealistically high snow‐water‐equivalent (SWE) biases that result directly from GCM errors. We leverage this finding to encourage the dynamical downscaling community to adopt APBC as a standard operating procedure.

Risser, Mark D.↗
NASA NTRS1990

Bias correction for rainrate retrievals from satellite passive microwave sensors

Rainrates retrieved from past and present satellite-borne microwave sensors are affected by a fundamental remote sensing problem. Sensor fields-of-view are typically large enough to encompass substantial rainrate variability, whereas the retrieval algorithms, based on radiative transfer calculations, show a non-linear relationship between rainrate and microwave brightness temperature. Retrieved rainrates are systematically too low. A statistical model of the bias problem shows that bias correction factors depend on the probability distribution of instantaneous rainrate and on the average thickness of the rain layer.

Short, David A.↗
NASA NTRS2021

Bias-Correcting Carbon Fluxes Derived From Land-Surface Satellite Data for Retrospective and Near Real-Time Assimilation Systems

The ability to monitor and understand natural and anthropogenic variability in atmospheric carbon dioxide(CO2) is a growing need of many stakeholders across the world. Systems that assimilate satellite observations, given their short latency and dense spatial coverage, into high resolution global models are valuable, if not essential, tools for addressing this need. A notable drawback of modern assimilation systems is the long latency of many vital in-put datasets, e.g., inventories, in situ measurements, and re-processed remote-sensing data can trail the current date by months to years. This paper describes techniques for bias-correcting surface fluxes derived from satellite observations of the Earth’s surface to be consistent with constraints from inventories and in situ CO2 datasets. The techniques are applicable in both short-term forecasts and retrospective simulations, thus taking advantage of the coverage and short latency of satellite data while reproducing the major features of long-term inventory and in situ records. Our approach begins with a standard collection of diagnostic fluxes which incorporate a variety of remote-sensing driver data, viz. vegetation indices, fire radiative power, and nighttime lights. We then apply an empirical sink so that global budgets of the diagnostic fluxes match given atmospheric and oceanic growth rates for each year. This step removes coherent, systematic flux errors that produce biases inCO2which mask the signals an assimilation system hopes to capture. Depending on the simulation mode, the empirical sink uses different choices of atmospheric growth rates: estimates based on observations in retrospective mode and projections based on seasonal fore-casts of sea surface temperature in forecasting mode. The retrospective fluxes, when used in simulations with NASA’s Goddard Earth Observing System (GEOS), reproduce marine boundary layer measurements with comparable skill to those using fluxes from a modern inversion system. The forecasted fluxes show promising accuracy in their application to the analysis of changes in the carbon cycle as they occur.

CO2↗
NASA NTRS2021

Bias Correction of Hydrologic Projections Strongly Impacts Inferred Climate Vulnerabilities in Institutionally Complex Water Systems

Water-resources planners use regional water management models (WMMs) to identify vulnerabilities to climate change. Frequently, dynamically downscaled climate inputs are used in conjunction with land-surface models (LSMs) to provide hydrologic streamflow projections, which serve as critical inputs for WMMs. Here, we show how even modest projection errors can strongly affect assessments of water availability and financial stability for irrigation districts in California. Specifically, our results highlight that LSM errors in projections of flood and drought extremes are highly interactive across timescales, path-dependent, and can be amplified when modeling infrastructure systems (e.g., misrepresenting banked groundwater). Common strategies for reducing errors in deterministic LSM hydrologic projections (e.g., bias correction) can themselves strongly distort projected climate vulnerabilities and misrepresent their inferred financial consequences. Overall, our results indicate a need to move beyond standard deterministic climate projection and error management frameworks that are dependent on single simulated climate change scenario outcomes.

Keyvan Malek↗
NASA NTRS2014

Bias Correction for Assimilation of Retrieved AIRS Profiles of Temperature and Humidity

The Atmospheric Infrared Sounder (AIRS) is a hyperspectral radiometer aboard NASA's Aqua satellite designed to measure atmospheric profiles of temperature and humidity. AIRS retrievals are assimilated into the Weather Research and Forecasting (WRF) model over the North Pacific for some cases involving "atmospheric rivers". These events bring a large flux of water vapor to the west coast of North America and often lead to extreme precipitation in the coastal mountain ranges. An advantage of assimilating retrievals rather than radiances is that information in partly cloudy fields of view can be used. Two different Level 2 AIRS retrieval products are compared: the Version 6 AIRS Science Team standard retrievals and a neural net retrieval from MIT. Before assimilation, a bias correction is applied to adjust each layer of retrieved temperature and humidity so the layer mean values agree with a short‐term model climatology. WRF runs assimilating each of the products are compared against each other and against a control run with no assimilation. Forecasts are against ERA reanalyses.

Blakenship, Clay↗
NASA NTRS2021

Tendency Bias Correction in the GEOS AGCM

In this report, we summarize the results of global and regional TBC applied to the GEOS AGCM(the same model used to generate MERRA-2 though run at lower resolution, referred to as the M2_AGCM) employing the analysis increments (analysis minus forecast) generated by MERRA-2 to calculate the TBC terms. Extending the results of Chang et al. (2019)and Schubert et al. (2019), we examine in more detail the seasonality of the TBC impacts, including a deeper look into the reasons for why TBC appears to be least effective during boreal winter. We also look into the ability of TBC to correct other diagnostic fields such as cloudiness and surface fluxes and, more generally, attempt to provide some insight into why TBC is effective in correcting long term climate biases. Looking beyond TBC, we also present some preliminary results from an extension of the TBC approach in which we include a state-dependent term

Yehui Chang↗
DOE OSTI2024

Bias Correction and Statistical Downscaling of Solar Radiation Using NA-CORDEX and the NSRDB

The current state-of-art for estimating long-term PV production uses long-term estimates of solar radiation variables, such as global horizontal irradiance (GHI), from previous years. This data is used in models such as the System Advisor Model (SAM) or PYSyst to predict annual production for a PV plant. This information is then used to estimate the production over the next 20 years (a typical plant lifetime) under the assumption that the variability over the current period is representative of the future. As the PV industry moves to extend plant lifetimes to 50 years the current assumptions of representativeness of weather may not be appropriate. This is especially true as our climate changes rapidly. To assess long-term PV production, future projections for solar radiation based on projected carbon emissions are readily available in regional and global climate models. However, climate model projections contain inherent biases that may need to be corrected for accurate analysis of future projections of climate variables. Several studies have analyzed projections of solar radiation for future years, however the accuracy of the model output compared to current and historic data has not been widely studied. Chen (2021) showed that available climate models do not accurately represent solar radiation in some cases, over-projecting GHI at the surface while under-projecting its obstructions, such as clouds and aerosols. This works aims to (1) increase understanding of the accuracy of solar radiation currently available in global and regional climate models and (2) implement bias correction through linear models based on reanalysis data compared to observed solar radiation. The latter aim will be conducted using available observed solar radiation data and modeled data from several regional climate models (RCMs). The bias correction method will be applied to projections of solar radiation resulting in a more accurate representation of the future of solar production.

climate data↗