Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Assessing Confidence in Pliocene Sea Surface Temperatures to Evaluate Predictive Models

In light of mounting empirical evidence that planetary warming is well underway, the climate research community looks to palaeoclimate research for a ground-truthing measure with which to test the accuracy of future climate simulations. Model experiments that attempt to simulate climates of the past serve to identify both similarities and differences between two climate states and, when compared with simulations run by other models and with geological data, to identify model-specific biases. Uncertainties associated with both the data and the models must be considered in such an exercise. The most recent period of sustained global warmth similar to what is projected for the near future occurred about 3.33.0 million years ago, during the Pliocene epoch. Here, we present Pliocene sea surface temperature data, newly characterized in terms of level of confidence, along with initial experimental results from four climate models. We conclude that, in terms of sea surface temperature, models are in good agreement with estimates of Pliocene sea surface temperature in most regions except the North Atlantic. Our analysis indicates that the discrepancy between the Pliocene proxy data and model simulations in the mid-latitudes of the North Atlantic, where models underestimate warming shown by our highest-confidence data, may provide a new perspective and insight into the predictive abilities of these models in simulating a past warm interval in Earth history.This is important because the Pliocene has a number of parallels to present predictions of late twenty-first century climate.

simulation↗

Passive and Active L-Band System and Observations During the 2007 CLASIC Campaign

This article describes the upgraded PALS instrument and the characteristics of data acquired from the Cloud Land Atmospheric Interaction Campaign (CLASIC) 2007. The data acquired over lake passes were used to remove the radiometer calibration bias. The calibrated radiometer data showed significant consistency with the L-band land emission model for soil surfaces published in the literature. We observed significant temporal (days) changes of a few dB in the radar data. The change of radar backscatter appeared to correlate well with the change of in-situ soil moisture or the soil moisture data derived from the PALS dual-polarized brightness temperatures. The radar vegetation index also correlated well with the vegetation opacity estimated from the radiometer data. The preliminary analyses suggest complementary information contained in the surface emissivity and backscatter signatures for the retrieval of soil moisture and vegetation water content.

Soil moisture↗

The Impact of Satellite Sea Surface Salinity for Prediction of the Coupled Indo-Pacific System

Here we assess the impact of satellite sea surface salinity (SSS) observations on seasonal to interannual variability of tropical Indo-Pacific Ocean dynamics as well as on dynamical ENSO forecasts. The baseline experiment assimilates satellite sea level (SL), sea surface temperature (SST), and in situ subsurface temperature and salinity observations (Tz, Sz). These baseline experiments are then compared with experiments that additionally assimilate Aquarius (version 5.0 Lilly and Lagerloef, 2008) and SMAP (version 2.0 Meissner and Wentz, 2016) SSS. Twelve-month forecasts are initialized for each month from September 2011 to September 2017. We find that including satellite SSS significantly improves NINO3.4 sea surface temperature anomaly validation over 0-8 month forecast lead-times and removing the salty bias from SMAP data helps to extend useful forecasts out to 12 month lead-times.

SSS↗

TPSAS-NF1676L-17931-DND

Many geophysical variables including temperature, clouds, and precipitation exhibit robust diurnal cycles in response to the daily cycle of solar insolation. Due to the fundamental nature of this variability, it is critical that weather and climate models accurately represent the diurnal cycle. Numerical model, however, have difficulty reproducing this observed diurnal cycle behavior, which leads to systematic errors in model representation of earth energy budget terms: including TOA and surface radiation, precipitation, and surface latent and sensible heat fluxes. This study evaluates the regional diurnal cycle in the Tropics within reanalysis models (ERA-Interim and MERRA) and quantifies systematic errors in the simulated TOA flux and precipitation due to biases in the diurnal cycle representation. The focus of this study is to quantify the importance of diurnal cycle simulation to systematic bias in reanalysis data set climatologies.

Patrick C Taylor↗

Scattered Light in the Hinode/EIS and SDO/AIA Instruments Measured from the 2012 Venus Transit

Observations from the 2012 transit of Venus are used to derive empirical formulae for long- and short-range scattered light at locations on the solar disk observed by the Hinode Extreme ultraviolet Imaging Spectrometer (EIS) and the Solar Dynamics Observatory Atmospheric Imaging Assembly (AIA) instruments. Long-range scattered light comes from the entire solar disk, while short-range scattered light is considered to come from a region within 50” of the region of interest. The formulae were derived from the Fe XII 195.12 Å emission line observed by EIS and the AIA 193 Å channel. A study of the weaker Fe XIV 274.20 Å line during the transit and a comparison of scattering in the AIA 193 Å and 304 Å channels suggests the EIS scattering formula applies to other emission lines in the EIS wavebands. Both formulae should be valid in regions of fairly uniform emission such as coronal holes and quiet Sun, but may be less accurate for faint areas close (around 100”) to bright active regions. The formula for EIS is used to estimate the scattered light component of Fe XII λ195.12 for seven on-disk coronal holes observed between 2010 and 2018. Scattered light contributions of 56%–100% are found, suggesting that these features are dominated by scattered light, consistent with earlier work of Wendeln & Landi. Emission lines from the S X and Si X ions—formed at the same temperature as Fe XII and often used to derive the first ionization potential bias from EIS data—are also expected to be dominated by scattered light in coronal holes.

Transits↗

Salvaging Data Records with Missing Data: Data Imputation using the Multivariate t Distribution

When doing multivariate data analysis, one commonobstacle is the presence of incomplete observations, i.e., observationsfor which one or more key fields are blank. Missing datais often countered by deleting entire observations that containmissing data. The negative effects of deleting entire observationsare multiple: deleting observations reduces sample size andcan also result in biased inferences even if data is missing atrandom. In addition, knowledge contained within incompleteobservations is knowledge lost when they are deleted– and theeffort spent collecting that knowledge is effort wasted. Data imputationmethods, or methods of statistically “filling-in” missingdata, can help combat small sample sizes by using the existinginformation in partially complete observations with the end goalof producing less biased and higher confidence inferences. Whena sample from a multivariate normal population is only partiallycomplete, and the missing data meets appropriate assumptions(missing at random), robust data imputation of the missing datacan be implemented with monotone data augmentation (MDA)using the multivariate t distribution.Missing data imputation is applied to data from the NASA InstrumentCost Model (NICM) using the MDA algorithm underthe assumption of having a multivariate t distribution with fixeddegrees of freedom. A sensitivity analysis to the degrees offreedom parameter is presented to demonstrate robustness ofthe multivariate t distribution when dealing with small samplesas compared to the multivariate normal distribution.

DiNicola, Michael↗

Validation of SO2 Retrievals from the Ozone Monitoring Instrument over NE China

The Dutch-Finnish Ozone Monitoring Instrument (OMI) launched on the NASA Aura satellite in July 2004 offers unprecedented spatial resolution, coupled with contiguous daily global coverage, for space-based UV measurements of sulfur dioxide (SO2). We present a first validation of the OMI SO2 data with in situ aircraft measurements in NE China in April 2005. The study demonstrates that OMI can distinguish between background SO2 conditions and heavy pollution on a daily basis. The noise (expressed as the standard deviation,sigma) is approximately 1.5 DU (Dobson units; 1 DU = 2.69 10 (exp 16) molecules/cm (exp 2)) for instantaneous field of view boundary layer (PBL) SO2 data. Temporal and spatial averaging can reduce the noise to sigma approximetly 0.3 DU over a remote region of the South Pacific; the long-term average over this remote location was within 0.1 DU of zero. Under polluted conditions collection 2 OMI data are higher than aircraft measurements by a factor of two. Improved calibrations of the radiance and irradiance data (collection 3) result in better agreement with aircraft measurements on polluted days. The air mass corrected collection 3 data still show positive bias and sensitivity to UV absorbing aerosols. The difference between the in situ data and the OMI SO2 measurements within 30 km of the aircraft profiles was about 1 DU, equivalent to approximately 5 ppb from 0 to 3000 m altitude. Quantifying the SO2 and aerosol profiles and spectral dependence of aerosol absorption between 310 and 330 nm are critical for an accurate estimate of SO2 from satellite UV measurements.

Krotkov, Nickolay A.↗

Orbit/attitude estimation for the GOES spacecraft using VAS landmark data

A software system is described which provides for batch least squares estimation of spacecraft orbit, attitude, and camera bias parameters using image data from the Geostationary Operational Environmental Satellites (GOES). The image data are obtained by the Visible and Infrared Spin Scan Radiometer (VISSR) Atmospheric Sounder (VAS). The resulting estimated parameters are used for absolute image registration. Operating in the Digital Equipment Corporation (DEC) PDP-11/70 computer, the FORTRAN system also includes the capabilities of image display and manipulations. An overview of the system is presented as well as some numerical results obtained from observations taken by the SMS-2 satellite over a 3 day interval in August 1975.

Sielski, H.↗

Bias Correction in Urban Building Energy Modeling for Chicago Using Machine Learning

Urban-scale building energy modeling (UBEM) holds promise for optimizing energy usage across extensive geographic regions. However, there is a recognized bias between simulated energy consumption and actual measured data. This study, based on building data from Chicago, delved into bias correction techniques for enhancing the accuracy of UBEM energy consumption estimates. Initially, the AutoBEM simulation yielded a normalized mean bias error (NMBE) of 1.1% and 51% of Coefficient of the Variation of the Root Mean Square Error (CVRMSE) after outlier exclusion. To address this, three bias correction methods were deployed: Average Mean Bias Error based bias correction, Quantile mapping bias correction, and Machine learning-based bias correction using Linear Regression and Random Forest models. Post-correction results exhibited marked improvement. The NMBE values were diminished to 0 for Average MBE-based, 0.36 for Quantile Mapping, and 0 for Machine Learning-based corrections. Concurrently, the CVRMSE values registered reductions from an original 51 to 50.8 for Quantile Mapping, and 38.56 for Machine Learning-based corrections, pointing towards the effectiveness of specific bias correction methods in refining the precision of UBEM energy predictions. Such accurate estimations are paramount for informed energy planning and urban policy-making.

Chowdhury, Shovan↗

Bias-Correcting Carbon Fluxes Derived From Land-Surface Satellite Data for Retrospective and Near Real-Time Assimilation Systems

The ability to monitor and understand natural and anthropogenic variability in atmospheric carbon dioxide(CO2) is a growing need of many stakeholders across the world. Systems that assimilate satellite observations, given their short latency and dense spatial coverage, into high resolution global models are valuable, if not essential, tools for addressing this need. A notable drawback of modern assimilation systems is the long latency of many vital in-put datasets, e.g., inventories, in situ measurements, and re-processed remote-sensing data can trail the current date by months to years. This paper describes techniques for bias-correcting surface fluxes derived from satellite observations of the Earth’s surface to be consistent with constraints from inventories and in situ CO2 datasets. The techniques are applicable in both short-term forecasts and retrospective simulations, thus taking advantage of the coverage and short latency of satellite data while reproducing the major features of long-term inventory and in situ records. Our approach begins with a standard collection of diagnostic fluxes which incorporate a variety of remote-sensing driver data, viz. vegetation indices, fire radiative power, and nighttime lights. We then apply an empirical sink so that global budgets of the diagnostic fluxes match given atmospheric and oceanic growth rates for each year. This step removes coherent, systematic flux errors that produce biases inCO2which mask the signals an assimilation system hopes to capture. Depending on the simulation mode, the empirical sink uses different choices of atmospheric growth rates: estimates based on observations in retrospective mode and projections based on seasonal fore-casts of sea surface temperature in forecasting mode. The retrospective fluxes, when used in simulations with NASA’s Goddard Earth Observing System (GEOS), reproduce marine boundary layer measurements with comparable skill to those using fluxes from a modern inversion system. The forecasted fluxes show promising accuracy in their application to the analysis of changes in the carbon cycle as they occur.

CO2↗

Off-nadir antenna bias correction using Amazon rain forest sigma deg data

The radar response from the Amazon rain forest was studied to determine the suitability of this region for use as a standard target to calibrate a scatterometer like that proposed for the National Ocean Satellite System (NOSS). Backscattering observations made by the SEASAT-1 scatterometer system show the Amazon rain forest to be a homogeneous, azimuthally-isotropic, radar target which is insensitive to polarization. The variation with angle of incidence may be adequately modeled as sigma deg (dB) = alpha theta + beta with typical values for the incidence-angle coefficient from 0.07 dB deg to 0.15 dB/deg. A small diurnal effect occurs, with measurements at sunrise being 0.5 dB to 1 dB higher than the rest of the day. Maximum likelihood estimation algorithms are presented which permit determination of relative bias and true pointing angle for each beam. Specific implementation of these algorithms for the proposed NOSS scatterometer system is also discussed.

Birrer, I. J.↗

Exploratory geological analysis of AVIRIS data

The size and complexity of AVIRIS data sets makes analysis difficult. We present a technique that allows the researcher to rapidly scan the full data set in image form in order to empirically find significant spatial patterns anywhere across the spectrum. Our approach takes advantage of the speed and power of computer graphics workstations to allow real-time, interactive data manipulation and display. Empirical data selection avoids the bias inherent in theoretical selection criteria, and allows discovery of unexpected relationships within the data set. Link Winds, a prototype data analysis system under development, provides the visualization tools used in this study. We are applying this approach to geological studies in the eastern Mojave Desert.

Beratan, K. K.↗

Evaluating Long-Term Changes in Atmospheric Ozone

Ozonesondes have made inexpensive, accurate measurements of ozone from the ground to 30km for more than 50 years. The data are used extensively for trend analyses and for evaluation of satellite and model data products, and are also part of climatologies that are used as a priori data for satellite retrievals. They are essential as a transfer standard when merging shorter satellite-derived time series, and are the most important source of trend-quality long-term records below about 18 km. The importance of long-term ozonesonde records as a stable reference has led to increased attention to quantifying uncertainties and changes in ozonesonde data. Based on past intercomparison data, ECC sondes show a modest (~1-5%) high bias with respect to UV-absorption measurements (including MOZAIC-IAGOS) in the troposphere, with an uncertainty of 5%, but no evidence of a change with time. Other sonde types show an increase of 5-20% in sensitivity to tropospheric ozone from 1970-1995. Agreement in the stratosphere is much better. In the past 20 years ozonesonde precision has improved by a factor of 2, primarily through the adoption of strict standard operating procedures. In addition, many of the most important ozonesonde records have been re-evaluated and corrected, and detailed estimates made of their biases and uncertainties. Corrections to historical data for known issues may reduce biases but simultaneously introduce additional uncertainties. The uncertainty budget for the ozone partial pressure reading has contributions from stoichiometry, cell background current, pump efficiency and temperature, sensing solution type and volume. The much-discussed “background current” has recently been shown to be primarily related to reaction stoichiometry. Several quality assurance issues remain, but are tractable problems that can be addressed with further research. This will be required if the present goal of better than 5% overall uncertainty throughout the global ozonesonde network is to be achieved. Finally, the importance of regular sonde intercomparisons, employing UV photometers traceable to the modern UV-absorption standard, and of regular comparison of operational station records with multiple satellite sensors, is emphasized.

Ozonesondes↗

Validating automated resonance evaluation with synthetic data

The integrity and precision of nuclear data are crucial for a broad spectrum of applications, from national security and nuclear reactor design to medical diagnostics, where the associated uncertainties can significantly impact outcomes. A substantial portion of uncertainty in nuclear data originates from the subjective biases in the evaluation process, a crucial phase in the nuclear data production pipeline. Recent advancements indicate that automation of certain routines can mitigate these biases, thereby standardizing the evaluation process and enhancing reproducibility. This research aims to provide a methodology, framework, and metrics for the validation of automated nuclear data evaluation software leveraging high-quality synthetic data that closely mimic real experimental observables. An introduced error metric provides a scale and intuitive measure of the evaluation quality by quantifying the estimate’s accuracy and performance across the specified energy range. Synthetic data provides access to experimental observables and underlying resonance parameters, enabling comparison of different evaluations. The methodology is demonstrated using Ta-181 isotope data in the resolved resonance region. The Automated Resonance Identification Subroutine (ARIS), which operates without prior resonance information, was used to test and showcase the framework’s capabilities utilizing the proposed error metrics. The results demonstrate the effectiveness of the proposed approach and framework for optimizing software parameters and testing hypotheses through “what-if” controlled experiments, such as modifying assumptions about experimental conditions or average resonance parameters.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Need for a New LLNL Pulsed Sphere Neutron Leakage Spectra Series

Here, it is shown that spectra measured as part of the Lawrence Livermore National Laboratory Pulsed Sphere (LPS) program offer decisive information to locate formatting or physics issues in nuclear data of key interest for fusion reactor simulations. However, experiments from this measurement series are not benchmarks. For instance, their uncertainties are incomplete. There are also many open questions—e.g., on the setup, the detector response, and whether LPS are accurately modeled—that cannot be answered anymore given the limited documentation and that many of the experimenters are no longer actively working. This limited knowledge has implications when one tries to adjust nuclear data to LPS spectra. Usually, one adjusts to benchmarks representing an application with the hope to get more precise nuclear data for the application of interest where differential data might be scarce and/or to reduce nuclear data uncertainties in the application simulations. However, it is demonstrated that adjustment with LPS spectra without accounting for missing uncertainties and modeling potential biases in the experimental data leads to adjusted data that are highly unphysical. That means adjusted data differ significantly from evaluated data based on information from differential experiments; also, application quantities predicted with the adjusted data deviate distinctly from experimental ones. While we can approximate our limited knowledge on these experiments with Gaussian processes in the adjustment process, this modeling of bias is arbitrary rather than based on a physics explanation, calling into doubt the validity of resulting adjusted data. Thus, we discuss here the need for a new measurement series, learning from the strengths and weaknesses of the LPS program, to yield decisive and well-benchmarked integral experiments to support fusion reactor research.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

How can a diverse set of integral and semi-integral measurements inform identification of discrepant nuclear data?

Nuclear data are used for a variety of applications, including criticality safety, reactor performance, and material safeguards. Despite the breadth of use-cases, the effective neutron multiplication factor, keff, of ICSBEP critical assemblies are primarily used for nuclear data validation; these are sensitive to specific energy regions and nuclides and are unable to uniquely constrain nuclear data. As a consequence, general-purpose nuclear data libraries, such as ENDF/B-VIII.0, may have deficiencies that, while not apparent in criticality applications, negatively impact other applications, such as non-destructive analysis of special nuclear material and neutron diagnosed subcritical experiments. Recent work by the Experiments Underpinned by Computational Learning for Improvements in Nuclear Data (EUCLID) project developed a machine learning tool, RAFIEKI, which uses random forests and the SHAP metric to determine which nuclear data contribute most to predicted bias between measured and simulated responses (e.g. keff). This paper contrasts RAFIEKI analysis applied to keff only against RAFIEKI analysis with keff paired with either LLNL pulsed sphere measurements or subcritical benchmarks. Two examples show that a) including pulsed sphere measurements substantially increases 9Be nuclear data importance to bias between 2 and 15 MeV, and b) including subcritical benchmarks has the potential for disentangling compensating errors between 240Pu (n,el) and (n,il) cross-sections between 0.1 and 10 MeV. These results show that RAFIEKI analysis applied to response sets that include, but go beyond, keff can aid nuclear data evaluators in identifying issues in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

sparse_bias

This is a python package used to fit an unknown function from data that potential contains systematic biases related to metadata. The model fits the unknown function and uses a Bayesian horseshoe prior model to impose sparsity on the bias terms. This code has been generalized from research code developed for AIACHNE into a package that should have more general application in a wider class of statistical models.

Walton, Noah↗