Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Comparative Analysis of Upper Ocean Heat Content Variability from Ensemble Operational Ocean Analyses

Upper ocean heat content (HC) is one of the key indicators of climate variability on many time-scales extending from seasonal to interannual to long-term climate trends. For example, HC in the tropical Pacific provides information on thermocline anomalies that is critical for the longlead forecast skill of ENSO. Since HC variability is also associated with SST variability, a better understanding and monitoring of HC variability can help us understand and forecast SST variability associated with ENSO and other modes such as Indian Ocean Dipole (IOD), Pacific Decadal Oscillation (PDO), Tropical Atlantic Variability (TAV) and Atlantic Multidecadal Oscillation (AMO). An accurate ocean initialization of HC anomalies in coupled climate models could also contribute to skill in decadal climate prediction. Errors, and/or uncertainties, in the estimation of HC variability can be affected by many factors including uncertainties in surface forcings, ocean model biases, and deficiencies in data assimilation schemes. Changes in observing systems can also leave an imprint on the estimated variability. The availability of multiple operational ocean analyses (ORA) that are routinely produced by operational and research centers around the world provides an opportunity to assess uncertainties in HC analyses, to help identify gaps in observing systems as they impact the quality of ORAs and therefore climate model forecasts. A comparison of ORAs also gives an opportunity to identify deficiencies in data assimilation schemes, and can be used as a basis for development of real-time multi-model ensemble HC monitoring products. The OceanObs09 Conference called for an intercomparison of ORAs and use of ORAs for global ocean monitoring. As a follow up, we intercompared HC variations from ten ORAs -- two objective analyses based on in-situ data only and eight model analyses based on ocean data assimilation systems. The mean, annual cycle, interannual variability and longterm trend of HC have been analyzed

Xue, Yan↗

Spatial Distribution of Accuracy of Aerosol Retrievals from Multiple Satellite Sensors

Remote sensing of aerosols from space has been a subject of extensive research, with multiple sensors retrieving aerosol properties globally on a daily or weekly basis. The diverse algorithms used for these retrievals operate on different types of reflected signals based on different assumptions about the underlying physical phenomena. Depending on the actual retrieval conditions and especially on the geographical location of the sensed aerosol parcels, the combination of these factors might be advantageous for one or more of the sensors and unfavorable for others, resulting in disagreements between similar aerosol parameters retrieved from different sensors. In this presentation, we will demonstrate the use of the Multi-sensor Aerosol Products Sampling System (MAPSS) to analyze and intercompare aerosol retrievals from multiple spaceborne sensors, including MODIS (on Terra and Aqua), MISR, OMI, POLDER, CALIOP, and SeaWiFS. Based on this intercomparison, we are determining geographical locations where these products provide the greatest accuracy of the retrievals and identifying the products that are the most suitable for retrieval at these locations. The analyses are performed by comparing quality-screened satellite aerosol products to available collocated ground-based aerosol observations from the Aerosol Robotic Network (AERONET) stations, during the period of 2006-2010 when all the satellite sensors were operating concurrently. Furthermore, we will discuss results of a statistical approach that is applied to the collocated data to detect and remove potential data outliers that can bias the results of the analysis.

Petrenko, Maksym↗

Arctic Sea Ice Freeboard from Icebridge Acquisitions in 2009: Estimates and Comparisons with ICEsat

During the spring of 2009, the Airborne Topographic Mapper (ATM) system on the IceBridge mission acquired cross-basin surveys of surface elevations of Arctic sea ice. In this paper, the total freeboard derived from four 2000 km transects are examined and compared with those from the 2009 ICESat campaign. Total freeboard, the sum of the snow and ice freeboards, is the elevation of the air-snow interface above the local sea surface. Prior to freeboard retrieval, signal dependent range biases are corrected. With data from a near co-incident outbound and return track on 21 April, we show that our estimates of the freeboard are repeatable to within 4 cm but dependent locally on the density and quality of sea surface references. Overall difference between the ATM and ICESat freeboards for the four transects is 0.7 (8.5) cm (quantity in bracket is standard deviation), with a correlation of 0.78 between the data sets of one hundred seventy-eight 50 km averages. This establishes a level of confidence in the use of ATM freeboards to provide regional samplings that are consistent with ICESat. In early April, mean freeboards are 41 cm and 55 cm over first year and multiyear sea ice (MYI), respectively. Regionally, the lowest mean ice freeboard (28 cm) is seen on 5 April where the flight track sampled the large expanse of seasonal ice in the western Arctic. The highest mean freeboard (71 cm) is seen in the multiyear ice just west of Ellesmere Island from 21 April. The relatively large unmodeled variability of the residual sea surface resolved by ATM elevations is discussed.

Airborne Topographic Mapper (ATM)↗

Inconsistent Strategies to Spin up Models in CMIP5: Implications for Ocean Biogeochemical Model Performance Assessment

During the fifth phase of the Coupled Model Intercomparison Project (CMIP5) substantial efforts were made to systematically assess the skill of Earth system models. One goal was to check how realistically representative marine biogeochemical tracer distributions could be reproduced by models. In routine assessments model historical hindcasts were compared with available modern biogeochemical observations. However, these assessments considered neither how close modeled biogeochemical reservoirs were to equilibrium nor the sensitivity of model performance to initial conditions or to the spin-up protocols. Here, we explore how the large diversity in spin-up protocols used for marine biogeochemistry in CMIP5 Earth system models (ESMs) contributes to model-to-model differences in the simulated fields. We take advantage of a 500-year spin-up simulation of IPSL-CM5A-LR to quantify the influence of the spin-up protocol on model ability to reproduce relevant data fields. Amplification of biases in selected biogeochemical fields (O2, NO3, Alk-DIC) is assessed as a function of spin-up duration. We demonstrate that a relationship between spin-up duration and assessment metrics emerges from our model results and holds when confronted with a larger ensemble of CMIP5 models. This shows that drift has implications for performance assessment in addition to possibly aliasing estimates of climate change impact. Our study suggests that differences in spin-up protocols could explain a substantial part of model disparities, constituting a source of model-to- model uncertainty. This requires more attention in future model intercomparison exercises in order to provide quantitatively more correct ESM results on marine biogeochemistry and carbon cycle feedbacks.

histories↗

MERRA-2 Input Observations: Summary and Assessment

The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) is an atmospheric reanalysis, spanning 1980 through near-realtime, that uses state-of-the-art processing of observations from the continually evolving global observing system. The effectiveness of any reanalysis is a function not only of the input observations themselves, but also of how the observations are handled in the assimilation procedure. Relevant issues to consider include, but are not limited to, data selection, data preprocessing, quality control, bias correction procedures, and blacklisting. As the assimilation algorithm and earth system models are fundamentally fixed in a reanalysis, it is often a change in the character of the observations, and their feedbacks on the system, that cause changes in the character of the reanalysis. It is therefore important to provide documentation of the observing system so that its discontinuities and transitions can be readily linked to discontinuities seen in the gridded atmospheric fields of the reanalysis. With this in mind, this document provides an exhaustive list of the input observations, the context under which they are assimilated, and an initial assessment of selected core observations fundamental to the reanalysis.

Satellite Observations↗

Taking SiC Power Devices to the Final Frontier: Addressing Challenges of the Space Radiation Environment

Silicon carbide power device technology has the potential to enable a new generation of aerospace power systems that demand high efficiency, rapid switching, and reduced mass and volume in order to expand space-based capabilities. For this potential to be realized, SiC devices must be capable of withstanding the harsh space radiation environment. Commercial SiC components exhibit high tolerance to total ionizing dose but to date, have not performed well under exposure to heavy ion radiation representative of the on-orbit galactic cosmic rays. Insertion of SiC power device technology into space applications to achieve breakthrough performance gains will require intentional development of components hardened to the effects of these highly-energetic heavy ions. This work presents heavy-ion test data obtained by the authors over the past several years for discrete SiC power MOSFETs, JFETs, and diodes in order to increase the body of knowledge and understanding that will facilitate hardening of this technology to space radiation effects. Specifically, heavy-ion irradiation data taken under different bias, temperature, and ion beam conditions is presented for devices from different manufacturers, and the emerging patterns discussed.

Power semiconductor devices↗

Miserable Risk Estimation: “Managing” Low-Probability, High-Consequence Risks

As with all bold endeavors, NASA missions must identify and manage their risks. While estimating the consequences of these risks is typically straightforward, it can be challenging to estimate their likelihood. This is especially true for low-probability risks, due both to the lack of operational data and the cognitive biases humans bring to risk estimation. In this talk, I will present both a tongue-in-cheek and “Management Science” approach to estimating low-probability, high-consequence risks. I then summon my Human Factors colleagues to provide NASA mission managers with the gentle guidance needed to avoid common errors in risk assessment

Mary K Kaiser↗

An Examination of Causes of Multi-Wire Bias During SLD Instrumentation Testing in the IRT

The Icing Research Tunnel (IRT) at NASA Glenn Research Center has been using the SEA Multi-Element Sensor (aka, the multi-wire) as its primary liquid water content instrument since 2011. Recent tests in the IRT with four different multi-wire probes (i.e., different serial numbers) have indicated situations that can result in biasing of the probe data. The reference data used in this report are multi-wire data that have been proven to agree well with the icing blade in low-impingement rate conditions. Data from these recent tests suggest that the presence of a canister probe located 4.45 ft axially downstream and 2.5 ft to the side may have caused multi-wire data to read around 5% low at an airspeed of 150 kts. Additionally, two probes of different serial numbers were observed to measure 5-15% lower than the reference probes, and the causes have been linked to excessive solder on the sensing element and to an out of date element calibration. For these reasons, the authors suggest the community be aware of the possible aerodynamic influences on the probe inlet and outlet, as well as the importance of regular calibration and maintenance of the probes.

aircraft icing↗

An Examination of Causes of Multi-Wire Bias during SLD Instrumentation Testing in the IRT

The Icing Research Tunnel (IRT) at NASA Glenn Research Center has been using the SEA Multi-Element Sensor (aka, the multi-wire) as its primary liquid water content instrument since 2011. Recent tests in the IRT with four different multi-wire probes (i.e., different serial numbers) have indicated situations that can result in biasing of the probe data. The reference data used in this report are multi-wire data that have been proven to agree well with the icing blade in low-impingement rate conditions. Data from these recent tests suggest that the presence of a canister probe located 4.45 ft axially downstream and 2.5 ft to the side may have caused multi-wire data to read around 5% low at an airspeed of 150 kts. Additionally, two probes of different serial numbers were observed to measure 5-15% lower than the reference probes, and the causes have been linked to excessive solder on the sensing element and to an out of date element calibration. For these reasons, the authors suggest the community be aware of the possible aerodynamic influences on the probe inlet and outlet, as well as the importance of regular calibration and maintenance of the probes.

aircraft icing↗

Dark Energy Survey Year 3 Results: Constraints on cosmological parameters and galaxy bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample

We constrain cosmological parameters and galaxy-bias parameters using the combination of galaxy clustering and galaxy-galaxy lensing measurements from the Dark Energy Survey Year-3 data. We describe our modeling framework and choice of scales analyzed, validating their robustness to theoretical uncertainties in small-scale clustering by analyzing simulated data. Using a linear galaxy bias model and redMaGiC galaxy sample, we obtain constraints on the matter content of the universe to be $\Omega_{\rm m} = 0.325^{+0.033}_{-0.034}$. We also implement a non-linear galaxy bias model to probe smaller scales that includes parameterizations based on hybrid perturbation theory, and find that it leads to a 17% gain in cosmological constraining power. Using the redMaGiC galaxy sample as foreground lens galaxies, we find the galaxy clustering and galaxy-galaxy lensing measurements to exhibit significant signals akin to decorrelation between galaxies and mass on large scales, which is not expected in any current models. This likely systematic measurement error biases our constraints on galaxy bias and the $S_8$ parameter. We find that a scale-, redshift- and sky-area-independent phenomenological decorrelation parameter can effectively capture this inconsistency between the galaxy clustering and galaxy-galaxy lensing. We perform robustness tests of our methodology pipeline and demonstrate stability of the constraints to changes in the theory model. After accounting for this decorrelation, we infer the constraints on the mean host halo mass of the redMaGiC galaxies from the large-scale bias constraints, finding the galaxies occupy halos of mass approximately $1.5 \times 10^{13} M_{\odot}/h$.

79 ASTRONOMY AND ASTROPHYSICS↗

A Terrestrial Validation of ICESat Elevation Measurements and Implications for Global Reanalyses

The primary goal of NASA's Ice, Cloud, and land Elevation Satellite (ICESat) mission was to detect centimeter-level changes in global ice sheet elevations at the spatial scale of individual ice streams. Confidence in detecting these small signals requires careful validation over time to characterize the uncertainty and stability of measured elevations. A common validation approach compares altimeter elevations to an independently characterized and stable reference surface. Using a digital elevation model (DEM) from geodetic surveys of one such surface, the salar de Uyuni in Bolivia, we show that ICESat elevations at this location have a 0.0-centimeter bias relative to the WGS84 ellipsoid, 4.0-centimeter (1-sigma) uncertainty overall, and 1.8-centimeter uncertainty under ideal conditions over short (50 kilometer) profiles. We observe no elevation bias between ascending and descending orbits, but we do find that elevations measured immediately after transitions from low to high surface albedo may be negatively biased. Previous studies have reported intercampaign biases (ICBs) between various ICESat observation campaigns, but we find no statistically significant ICBs or ICB trends in our data. We do find a previously unreported 3.1-centimeter bias between ICESat's Laser 2 and Laser 3, and we find even larger interlaser biases in reanalyzed data from other studies. For an altimeter with an exact repeat orbit like ICESat, we also demonstrate that validation results with respect to averaged elevation profiles along a single ground track are comparable to results obtained using reference elevations from an in situ survey.

Laser Ranging↗

ILRS Analysis Activities After the Adoption of ITRF2020

"The contribution of the International Laser Ranging Service (ILRS) to the most recent realization of the International Terrestrial Reference System (ITRS) was the result of an analysis strategy with two major modifications compared to the operational products: a modeling for stations long-term systematic errors (biases reported in the ILRS Data Handling File) and an updated model of the target signature error (satellite Centre of Mass model). Both refined models were used as input information for the ILRS contribution to the ITRF2020 (International Terrestrial Reference Frame 2020). Thereafter, the ILRS Analysis Standing Committee (ASC) focused its effort on implementing the new reference frame in its operational products, define a strategy to improve the ongoing monitoring of the systematic errors, compute the ILRS contribution to the planned ITRF2020 update, and to include LARES-2 among the considered satellites for the operational products. The ILRS ASC implemented the ITRF2020/SLRF2020 into all its official operational products (TRF, Earth Orientation Parameters, predicted and combined satellite orbits) and its impact was evaluated. The operational products benefit from the continuous monitoring of the station systematic errors and the frequent updates of the Data Handling File whenever a significant change in the station systematic error is observed. In the future, a change-point detection algorithm, jointly estimating the times and the number of discontinuities, will be implemented to detect potential new discontinuities in the range bias series. The inclusion of LARES-2 among the satellites whose data are operationally analyzed will furtherly increase the robustness of the estimated parameters. Finally, the ILRS ASC activities include the benchmarking of a new analysis center (CNES) which will formally begin its own contribution in 2024."

Satellite Laser Ranging↗

Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer

The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases of specific crops throughout time and used these data to generate independent bias-adjusted crop area estimates, which may complement other USDA survey- and census-based crop statistics. Our overall findings demonstrate that the CDLs provide highly accurate annual measures of crops and cropland areas, and when used appropriately, are an indispensable tool for monitoring changes to agricultural landscapes.

54 ENVIRONMENTAL SCIENCES↗

Enhancing ZFP: A Statistical Approach to Understanding and Reducing Error Bias in a Lossy Floating-Point Compression Algorithm

The amount of data generated and gathered in scientific simulations and data collection applications is continuously growing, putting mounting pressure on storage and bandwidth concerns. A means of reducing such issues is data compression; but, lossless data compression is typically ineffective when applied to floating-point data. Thus, users tend to apply a lossy data compressor, which allows for small deviations from the original data. It is essential to understand how the error from lossy compression impacts the accuracy of the data analytics. Thus, we must analyze not only the compression properties but the error as well. In this paper, we provide a statistical analysis of the error caused by ZFP compression, a state-of-the-art, lossy compression algorithm explicitly designed for floating-point data. We show that the error is indeed biased and propose simple modifications to the algorithm to neutralize the bias and further reduce the resulting error.

97 MATHEMATICS AND COMPUTING↗

Absorptive corrections to the electromagnetic form factor in high-energy elastic proton-proton scattering

Recently, it was noted that absorptive corrections to the electromagnetic form factor in high-energy proton-proton scattering are important for the theoretical interpretation of the p ↑ p and p ↑ A analyzing power A N ( t ) measurements with the Hydrogen Jet Target polarimeter (HJET) at RHIC. Here, a concise expression for the absorptive correction was derived within the eikonal approach. The resulting analysis reveals a systematic bias, nearly independent of the beam energy, in the experimental determination of the real-to-imaginary ratio ρ when absorption effects are overlooked in the data analysis. Quantification of this bias, as ρ meas = ρ + ( 0.036 ± 0.016 ) bias , was achieved using a Regge fit applied to available proton-proton measurements of ρ meas ( s ) and σ tot meas ( s ) . Considering the potential impact of such an effect on the experimentally determined A N ( t ) , one may enhance consistency between the HJET and STAR measurements of the hadronic spin-flip amplitude. While the sign of the bias in the value of ρ aligns with the anticipated effective increase in the proton charge radius in p p scattering due to absorption, it amplifies the observed discrepancy between σ tot meas and ρ meas values at s = 13 TeV as measured in the TOTEM experiment. Evaluation (using published TOTEM data) of the measured proton-proton d σ / d t dependence on the absorptive corrections indicated that possible soft photon corrections to the hadronic amplitude slope may be essential for such data analysis. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

Improving Simulated Soil Moisture Fields Through Assimilation of AMSR-E Soil Moisture Retrievals with an Ensemble Kalman Filter and a Mass Conservation Constraint

Model simulated soil moisture fields are often biased due to errors in input parameters and deficiencies in model physics. Satellite derived soil moisture estimates, if retrieved appropriately, represent the spatial mean of soil moisture in a footprint area, and can be used to reduce model bias (at locations near the surface) through data assimilation techniques. While assimilating the retrievals can reduce model bias, it can also destroy the mass balance enforced by the model governing equation because water is removed from or added to the soil by the assimilation algorithm. In addition, studies have shown that assimilation of surface observations can adversely impact soil moisture estimates in the lower soil layers due to imperfect model physics, even though the bias near the surface is decreased. In this study, an ensemble Kalman filter (EnKF) with a mass conservation updating scheme was developed to assimilate the actual value of Advanced Microwave Scanning Radiometer (AMSR-E) soil moisture retrievals to improve the mean of simulated soil moisture fields by the Noah land surface model. Assimilation results using the conventional and the mass conservation updating scheme in the Little Washita watershed of Oklahoma showed that, while both updating schemes reduced the bias in the shallow root zone, the mass conservation scheme provided better estimates in the deeper profile. The mass conservation scheme also yielded physically consistent estimates of fluxes and maintained the water budget. Impacts of model physics on the assimilation results are discussed.

Li, Bailing↗

Understanding Peelle’s Pertinent Puzzle bias in generalized least squares regression through eigenspectrum analysis

Certain correlation structures in the data covariance matrix (DCM) used for generalized least squares (GLS) regression can result in biased estimates, commonly known in the field of nuclear data evaluation as Peele’s Pertinent Puzzle (PPP). This article introduces a generative, forward modeling framework within which the PPP bias is characterized through an eigenspectrum analysis of the DCM. This analysis highlights the root cause of the bias, generalizes the problem beyond the nuclear data field, and provides insight to the problem regimes where it can occur. What follows is an understanding that the bias can show up for any experimental neutron time-of-flight data for which systematic uncertainties have been quantified. Lastly, a discussion of the adaptation of cross validation approaches that require pre-whitening to incorporate the known ‘fix’ to the PPP bias in the GLS estimator.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗