Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

The sea state bias in altimeter estimates of sea level from collinear analysis of TOPEX data

The wind speed and significant wave height (H(sub 1/3)) dependencies of the sea state bias in altimeter estimates of sea level, expressed in the form (Delta)h(sub SSB) = bH(sub 1/3), are examined from least squares analysis of 21 cycles of collinear TOPEX data. The bias coefficient b is found to increase in magnitude with increasing wind speed up to about 12 m/s and decrease monotonically in magnitude with increasing H(sub 1/3). A parameterization of b as a quadratic function of wind speed only, as in the formation used to produce the TOPEX geophysical data records (GDRs), is significantly better than a parameterization purely in terms of H(sub 1/3). However, a four-parameter combined wind speed and wave height formulation for b (quadratic in wind speed plus linear in H(sub 1/3)) significantly improves the accuracy of the sea state bias correction. The GDR formulation in terms of wind speed only should therefore be expanded to account for a wave height dependence of b. An attempt to quantify the accuracy of the sea state bias correction (Delta)h(sub SSB) concludes that the uncertainty is a disconcertingly large 1% of H(sub 1/3).

Chelton, Dudley B.↗
DOE OSTI2023

An empirical approach to model selection: weak lensing and intrinsic alignments

ABSTRACT In cosmology, we routinely choose between models to describe our data, and can incur biases due to insufficient models or lose constraining power with overly complex models. In this paper, we propose an empirical approach to model selection that explicitly balances parameter bias against model complexity. Our method uses synthetic data to calibrate the relation between bias and the χ2 difference between models. This allows us to interpret χ2 values obtained from real data (even if catalogues are blinded) and choose a model accordingly. We apply our method to the problem of intrinsic alignments – one of the most significant weak lensing systematics, and a major contributor to the error budget in modern lensing surveys. Specifically, we consider the example of the Dark Energy Survey Year 3 (DES Y3), and compare the commonly used non-linear alignment (NLA) and tidal alignment and tidal torque (TATT) models. The models are calibrated against bias in the Ωm–S8 plane. Once noise is accounted for, we find that it is possible to set a threshold Δχ2 that guarantees an analysis using NLA is unbiased at some specified level Nσ and confidence level. By contrast, we find that theoretically defined thresholds (based on, e.g. p-values for χ2) tend to be overly optimistic, and do not reliably rule out cosmological biases up to ∼1–2σ. Considering the real DES Y3 cosmic shear results, based on the reported difference in χ2 from NLA and TATT analyses, we find a roughly $30{{\ \rm per\ cent}}$ chance that were NLA to be the fiducial model, the results would be biased (in the Ωm–S8 plane) by more than 0.3σ. More broadly, the method we propose here is simple and general, and requires a relatively low level of resources. We foresee applications to future analyses as a model selection tool in many contexts.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2001

Impacts of Interannual Climate Variability on Agricultural and Marine Ecosystems

The El Nino - Southern Oscillation (ENSO) is the dominant mode of global interannual climate variability, and seems to be the only mode for which current prediction methods are more skillful than climatology or persistence. The Zebiak and Cane intermediate coupled ocean-atmosphere model has been in use for ENSO prediction for more than a decade, with notable success. However, the sole dependence of its original initialization scheme and the improved initialization on wind fields derived from merchant ship observations proved to be a liability during 1997/1998 El Nino event: the deficiencies of wind observations prevented the oceanic component of the model from reaching the realistic state during the year prior to the event, and the forecast failed. Our work on the project was concentrated on the use of satellite data for improving various stages of ENSO prediction technology: model initialization, bias correction, and data assimilation. Close collaboration with other teams of the IDS project was maintained throughout.

Cane, M. A.↗
NASA NTRS2011

Thermal Cycling and Isothermal Deformation Response of Polycrystalline NiTi: Simulations vs. Experiment

A recent microstructure-based FEM model that couples crystal-based plasticity, the B2<-> MB190 phase transformation and anisotropic elasticity at the grain scale is calibrated to recent data for polycrystalline NiTi (49.9 at.% Ni). Inputs include anisotropic elastic properties, texture and differential scanning calorimetry data, as well as a subset of recent isothermal deformation and load-biased thermal cycling data. The model is assessed against additional experimental data. Several experimental trends are captured - in particular, the transformation strain during thermal cycling monotonically increases and reaches a peak with increasing bias stress. This is achieved, in part, by modifying the martensite hardening matrix proposed by Patoor et al. [Patoor E, Eberhardt A, Berveiller M. J Phys IV 1996;6:277]. Some experimental trends are underestimated - in particular, the ratcheting of macrostrain during thermal cycling. This may reflect a model limitation that transformation-plasticity coupling is captured on a coarse (grain) scale but not on a fine (martensitic plate) scale.

Manchiraju, Sivom↗
DOE OSTI2024

CovTransformer: A transformer model for SARS-CoV-2 lineage frequency forecasting

With hundreds of SARS-CoV-2 lineages circulating in the global population, there is an ongoing need for predicting and forecasting lineage frequencies and thus identifying rapidly expanding lineages. Accurate prediction would allow for more focused experimental efforts to understand pathogenicity of future dominating lineages and characterize the extent of their immune escape. Here, we first show that the inherent noise and biases in lineage frequency data make a commonly-used regression-based approach unreliable. To address this weakness, we constructed a machine learning model for SARS-CoV-2 lineage frequency forecasting, called CovTransformer, based on the transformer architecture. We designed our model to navigate challenges such as a limited amount of data with high levels of noise and bias. We first trained and tested the model using data from the UK and the USA, and then tested the generalization ability of the model to many other countries and US states. Remarkably, the trained model makes accurate predictions two months into the future with high levels of accuracy both globally (in 31 countries with high levels of sequencing effort) and at the US-state level. Our model performed substantially better than a widely used forecasting tool, the multinomial regression model implemented in Nextstrain, demonstrating its utility in SARS-CoV-2 monitoring. Assuming a newly emerged lineage is identified and assigned, our test using retrospective data shows that our model is able to identify the dominating lineages 7 weeks in advance on average before they became dominant. Overall, our work demonstrates that transformer models represent a promising approach for SARS-CoV-2 forecasting and pandemic monitoring.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1999

Data Assimilation in the Presence of Forecast Bias: The GEOS Moisture Analysis

We describe the application of the unbiased sequential analysis algorithm developed by Dee and da Silva (1998) to the GEOS DAS moisture analysis. The algorithm estimates the persistent component of model error using rawinsonde observations and adjusts the first-guess moisture field accordingly. Results of two seasonal data assimilation cycles show that moisture analysis bias is almost completely eliminated in all observed regions. The improved analyses cause a sizable reduction in the 6h-forecast bias and a marginal improvement in the error standard deviations.

Dee, Dick P.↗
NASA NTRS1982

Adjustment, interpolation, and smoothing of GEOS 3 altimeter data

A computational scheme that provides a rapid method for constructing a local or regional geoid from GEOS 3 altimeter data is presented. It is shown that for an oceanic area not larger than 30 deg longitude by 30 deg latitude, an adjustment of GEOS 3 track data for the erroneous bias and tilt can reduce the data inconsistencies at track intersections to smaller than 50 cm. This makes it possible to construct a map of the geoid with the contour interval of 1 m in any local or regional areas where the altimeter data exist with reasonable density and uniformity. In addition, a formula is developed for computing an expected value of geoid height by taking a weighted average of the adjusted altimeter data. Using the data's autocovariance as a weight, the formula can give a profile of geoid height along a given traverse. The geoid data can thus be compared with other marine geophysical data that are recorded continually along a ship's track.

Horai, K.-I.↗
NASA NTRS2008

Precision Measurement of Black Hole Binary Dynamics: Analyzing the LISA Data Stream

One of the richest potential sources of insight into fundamental physics that LISA will be capable of observing is the inspiral of supermassive black hole binaries (BHBs). However, the data analysis challenge presented by the LISA data stream is quite unlike the situation for present day gravitational wave detectors. In order to make the precision measurements necessary to achieve LISA's science goals, the BHB signal must be distinguished from a data stream that not only contains instrumental noise, but potentially thousands of other signals as well, so that the "background" we wish to separate out to focus on the BHB signal is likely to be highly nonstationary and nongaussian, as well as being of scientific interest in its own right. In addition, whereas the theoretical templates that we calculate in order to ultimately estimate the parameters can afford to be somewhat inaccurate and still be effective for present day and near future detectors, this is not the case for LISA, and extremely high fidelity of the theoretical templates for high signal-to-noise signals will be required to prevent theoretical errors from dominating the parameter estimates. NVe, will describe efforts in the community of LISA data analysts to address the challenges regarding the specific issue of BHB signals. These efforts include using a Markov Chain Monte Carlo approach with the freedom to model the BHB and the other signals present in the data stream simultaneously, rather than trying to remove other signals and risk biasing the remaining data. The Mock LISA Data Challenge is a community of LISA scientists who generate rounds of simulated LISA noise with increasingly difficult signal content, and invite the LISA data analysis community to exercise their methods, or develop new methods, in an attempt to extract the parameters for the signals embedded in the mock data. In addition to practical approaches such ,is this to assess the level of parameter accuracy, one can apply the Fisher matrix formalism to assess both the statistical errors from noise and the theoretical errors

McWilliams, Sean T.↗
NASA NTRS2010

Eight Year Climatologies from Observational (AIRS) and Model (MERRA) Data

We examine climatologies derived from eight years of temperature, water vapor, cloud, and trace gas observations made by the Atmospheric Infrared Sounder (AIRS) instrument flying on the Aqua satellite and compare them to similar climatologies constructed with data from a global assimilation model, the Modern Era Retrospective-Analysis for Research and Applications (MERRA). We use the AIRS climatologies to examine anomalies and trends in the AIRS data record. Since sampling can be an issue for infrared satellites in low earth orbit, we also use the MERRA data to examine the AIRS sampling biases. By sampling the MERRA data at the AIRS space-time locations both with and without the AIRS quality control we estimate the sampling bias of the AIRS climatology and the atmospheric conditions where AIRS has a lower sampling rate. While the AIRS temperature and water vapor sampling biases are small at low latitudes, they can be more than a few degrees in temperature or 10 percent in water vapor at higher latitudes. The largest sampling biases are over desert. The AIRS and MERRA data are available from the Goddard Earth Sciences Data and Information Services Center (GES DISC). The AIRS climatologies we used are available for analysis with the GIOVANNI data exploration tool. (see, http://disc.gsfc.nasa.gov).

Hearty, Thomas↗
NASA NTRS1986

Completeness of the geological record

The completeness of a sedimentary section of known timespan may be assessed qualitatively by comparing its thickness with the average accumulation for that timespan. Average accumulations may be estimated from sediment volume and continental area data. Quantitative completeness estimation methods based on data compiled from the geological literature have been proposed, but we argue that the literature data are significantly biased and cannot support such methods. Interestingly, however, a comparison of the literature data and accumulation averages computed from sediment volume data suggests that the thickest known sections may be extremely complete.

NASA Discipline Exobiology↗
NASA NTRS2013

First Observations of SO2 from the Satellite Suomi NPP OMPS: Widespread Air Pollution Events Over China

Severe smog episodes over China in January 2013 received worldwide attention. This air pollution was distinguished by heavy loadings of fine particulate matter and SO2. To characterize these episodes, we employed the Ozone Mapping and Profiler Suite, Nadir Mapper (OMPS NM), an ultraviolet (UV) spectrometer flying on the Suomi National Polar-orbiting Partnership (SNPP) spacecraft since October 2011. We developed an advanced algorithm to quantify SO2 in the lower troposphere and achieved high-quality retrievals from OMPS NM, which are characterized by high precision, approx. 0.2 Dobson Units (DU; 1 DU = 2.69 x 10(exp 16) molecules/sq cm) for instantaneous field of view SO2 data and low biases (within +/-0.2 DU). Here we report SO2 retrievals and UV aerosol index data for these pollution events. The SO2 columns and the areas covered by high pollutant concentrations are quantified; the results reveal for the first time the full extent (an area of approx. 10(exp 6) sq km containing up to 60 kt of SO2) of these episodes.

Sulfur Dioxide↗
DOE OSTI2025

Second-generation downscaled earth system model data using generative machine learning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. As with the first Sup3rCC version, the data still include temperature, wind speed and direction at multiple heights, pressure, three components of downwelling solar radiation, and relative humidity—all at 4-kilometer (km) hourly resolution over the contiguous United States. This is a 25x spatial enhancement and 24x temporal enhancement of the source 100-km daily-average ESM data. This extension of the Sup3rCC dataset includes data from six ESMs from two shared socioeconomic pathways (SSPs) totaling 400 years of data with multiple future projections of changing meteorological conditions. The scenario selection was based on a structured evaluation of historical ESM skill and comprehensive representation of possible trajectories of future climate change in temperature, humidity, precipitation, solar irradiance, and near-surface wind speeds. The inclusion of multiple future projections is intended to enable users to assess key drivers of un 36 certainty and variability. All data are double-bias corrected, resulting in a product that can be used out-of-the-box for energy system analysis with minimal historical bias. The potential applications of Sup3rCC data extend to various topics in renewable energy resource assessment, energy systems modeling, and grid resilience studies. High-resolution future meteorological projections are critical for evaluating the effects of changing meteorological conditions on renewable energy generation, energy demand, and for optimizing energy storage and grid infrastructure. The 4-km hourly resolution of the downscaled data enables understanding of spatial and temporal variability at the scales necessary for energy system operational planning. In addition, the dataset can support risk assessments by providing detailed information on possible future extreme weather events and long-term meteorological variability at scales relevant to energy infrastructure. By offering an enhanced representation of possible future meteorological conditions, the second-generation Sup3rCC dataset enables more precise modeling of energy resilience and adaptation strategies in response to changing meteorological conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2007

Validation of the Aura Microwave Limb Sounder Temperature and Geopotential Height Measurements

This paper describes the retrievals algorithm used to determine temperature and height from radiance measurements by the Microwave Limb Sounder on EOS Aura. MLS is a "limbscanning" instrument, meaning that it views the atmosphere along paths that do not intersect the surface - it actually looks forwards from the Aura satellite. This means that the temperature retrievals are for a "profile" of the atmosphere somewhat ahead of the satellite. Because of the need to view a finite sample of the atmosphere, the sample spans a box about 1.5km deep and several tens of kilometers in width; the optical characteristics of the atmosphere mean that the sample is representative of a tube about 200-300km long in the direction of view. The retrievals use temperature analyses from NASA's Goddard Earth Observing System, Version 5 (GEOS-5) data assimilation system as a priori states. The temperature retrievals are somewhat deperrde~zt on these a priori states, especially in the lower stratosphere. An important part of the validation of any new dataset involves comparison with other, independent datasets. A large part of this study is concerned with such comparisons, using a number of independent space-based measurements obtained using different techniques, and with meteorological analyses. The MLS temperature data are shown to have biases that vary with height, but also depend on the validation dataset. MLS data are apparently biased slightly cold relative to correlative data in the upper troposphere and slightly warm in the middle stratosphere. A warm MLS bias in the upper stratosphere may be due to a cold bias in GEOS-5 temperatures.

Schwartz, M. J.↗
NASA NTRS2020

Very High Resolution, Altitude-Corrected, TMPA-Based Monthly Satellite Precipitation Product Over the CONUS

The Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA) product provided over 17 years of gridded precipitation datasets. However, the accuracy and spatial resolution of TMPA limits the applicability in hydrometeorological applications. We present a dataset that enhances the accuracy and spatial resolution of the TMPA monthly product (3B43). We resample the TMPA data to a 1 km grid and apply a correction function derived from the Parameter-elevation Regressions on Independent Slopes Model (PRISM) to reduce bias in the data. We confirm a linear relationship between bias and elevation above 1,500 meters where TMPA underestimates measured precipitation, providing a proof-of-concept of how simple linear scaling can be used to augment existing satellite datasets. The result of the correction is the High-Resolution Altitude-Corrected Precipitation product (HRAC-Precip) for the CONUS. Using 9,200 precipitation stations from the Global Historical Climatology Network (GHCN), we compare the accuracy of TMPA 3B43 versus the new HRAC-Precip product. The results show an improvement of the mean absolute error of 12.98% on average.

Hossein Hashemi↗
NASA NTRS1979

Astrometric observations of the satellites of the outer planets. I - The Galilean satellites in 1977

Astrometric observations of the Galilean satellites of Jupiter performed around the opposition of 1977 with a 67-cm photovisual refractor are reported. The measurements are reduced to absolute and intersatellite positions by two different methods: a linear least-squares plate-constant solution to the AGK3 reference-star frame and the trail-scale method of Pascu (1977). Results of a plate-constant reduction are also presented for two observations of JV (Amalthea). Comparison of the data with Liske's (1978) theoretical predictions for the intersatellite positions indicates no systematic bias in the data; a probable scatter of about 15 arcsec in both right ascension and declination is estimated.

Ianna, P. A.↗
NASA NTRS2016

Foreground Bias from Parametric Models of Far-IR Dust Emission

We use simple toy models of far-IR dust emission to estimate the accuracy to which the polarization of the cosmic microwave background can be recovered using multi-frequency fits, if the parametric form chosen for the fitted dust model differs from the actual dust emission. Commonly used approximations to the far-IR dust spectrum yield CMB residuals comparable to or larger than the sensitivities expected for the next generation of CMB missions, despite fitting the combined CMB plus foreground emission to precision 0.1 percent or better. The Rayleigh-Jeans approximation to the dust spectrum biases the fitted dust spectral index by (Delta)(Beta)(sub d) = 0.2 and the inflationary B-mode amplitude by (Delta)(r) = 0.03. Fitting the dust to a modified blackbody at a single temperature biases the best-fit CMB by (Delta)(r) greater than 0.003 if the true dust spectrum contains multiple temperature components. A 13-parameter model fitting two temperature components reduces this bias by an order of magnitude if the true dust spectrum is in fact a simple superposition of emission at different temperatures, but fails at the level (Delta)(r) = 0.006 for dust whose spectral index varies with frequency. Restricting the observing frequencies to a narrow region near the foreground minimum reduces these biases for some dust spectra but can increase the bias for others. Data at THz frequencies surrounding the peak of the dust emission can mitigate these biases while providing a direct determination of the dust temperature profile.

cosmic microwave background↗