Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Modeling of the high column density systems in the Lyman-Alpha forest

The Lyman-α forests observed in the spectra of high-redshift quasars can be used as a tracer of the cosmological matter density to study baryon acoustic oscillations (BAO) and the Alcock-Paczynski effect. Extraction of cosmological information from these studies requires modeling of the forest correlations. While the models depend most importantly on the bias parameters of the intergalactic medium (IGM), they also depend on the numbers and characteristics of high-column-density systems (HCDs) ranging from Lyman-limit systems with column densities log N HI /1cm -2 > 17 to damped Lyman-α systems (DLAs) with log N HI /1cm -2 > 20.2. These HCDs introduce broad damped absorption characteristic of a Voigt profile. Consequently they imprint a component on the power spectrum whose modes in the radial direction are suppressed, leading to a scale-dependent bias. Using mock data sets of known HCD content, we test a model that describes this effect in terms of the distribution of column densities of HCDs, the Fourier transforms of their Voigt profiles and the bias of the halos containing the HCDs. Our results show that this physically well-motivated model describes the effects of HCDs with an accuracy comparable to that of the ad-hoc models used in published forest analyses. We also discuss the problems of applying the model to real data, where the HCD content and their bias is uncertain.

Lyman alpha forest↗
DOE OSTI2026

Machine Learning Eliminates Reanalysis Warm Bias and Reveals Weaker Winter Surface Cooling Over Arctic Sea Ice

The surface energy budget governs Arctic sea-ice growth/melt, yet observations are sparse, and reanalysis data sets suffer from systematic biases. Here, we train a neural network with observational data to bias-correct hourly ERA5 fluxes over Arctic ice-covered regions (≥70°N; sea-ice concentration >80%) for 1994–2024. Training data cover two full seasonal cycles and different sea-ice regimes. The neural network reduces RMSE for net shortwave radiation by ∼40%, downward longwave radiation by ∼16% and the total surface energy budget by ∼55%, eliminating the wintertime warm bias of ∼4 K in ERA5. Wintertime surface cooling is reduced by ∼50%, yielding thermodynamic ice-growth estimates of ∼80–120 cm, consistent with SMOS–CryoSat satellite thickness increases and in contrast to the 150–200 cm growth implied by ERA5. Our bias-corrected data capture the observed clear/cloudy states of the winter boundary layer and can be used to study Arctic climatology, evaluate climate models and drive sea-ice-ocean models.

Hossain, Akil [Alfred Wegener Institute for Polar ↗
NASA NTRS1983

GSFC optical ozonesonde results during the Gap, France, intercomparisons, June 1981

O3 soundings made with balloon-borne optical sensors during the French Intercomparison Ozone Campaign in June, 1981, are reported. The GSFC four-channel UV-filter-photometer ozonesonde designed for the Super Loki rocket was attached to the gondola roof for redundant O3-density measurements at altitudes of 22-32 km, using the 300 and 303-nm filters. Sensor calibration, data processing, input constants, and vertical O3-distribution calculations are discussed. The density profiles for three legs of the flight, calculated using Bass or Vigroux cross sections, agreed within a standard error of 1.4 percent for each channel, but showed a consistent 4-5 percent (significant) difference between channels. Total average O3-column amounts determined by combining the GSFC data with ECC measurements for altitudes below 21 km were in good agreement with bias-corrected TOMS data from Nimbus-VII and with ground-based data from the Observatoire de Haute-Provence at Mt. Chiran, when the latter were computed using the pre-campaign calibration. A 9-percent discrepancy arose when the Chiran data were corrected for a post-campaign recalibration of the Dobson spectrophotometer.

Krueger, A. J.↗
NASA NTRS1993

Timebias corrections to predictions

The importance of an accurate knowledge of the time bias corrections to predicted orbits to a satellite laser ranging (SLR) observer, especially for low satellites, is highlighted. Sources of time bias values and the optimum strategy for extrapolation are discussed from the viewpoint of the observer wishing to maximize the chances of getting returns from the next pass. What is said may be seen as a commercial encouraging wider and speedier use of existing data centers for mutually beneficial exchange of time bias data.

Wood, Roger↗
NASA NTRS1999

Moisture Forecast Bias Correction in GEOS DAS

Data assimilation methods rely on numerous assumptions about the errors involved in measuring and forecasting atmospheric fields. One of the more disturbing of these is that short-term model forecasts are assumed to be unbiased. In case of atmospheric moisture, for example, observational evidence shows that the systematic component of errors in forecasts and analyses is often of the same order of magnitude as the random component. we have implemented a sequential algorithm for estimating forecast moisture bias from rawinsonde data in the Goddard Earth Observing System Data Assimilation System (GEOS DAS). The algorithm is designed to remove the systematic component of analysis errors and can be easily incorporated in an existing statistical data assimilation system. We will present results of initial experiments that show a significant reduction of bias in the GEOS DAS moisture analyses.

Dee, D.↗
NASA NTRS1985

The muon content of EAS as a function of primary energy

The muon content of extensive air showers (EAS) was measured over the wide primary energy range 10 to the 16th power to 10 to the 20th power eV. It is reported that the relative muon content of EAS decreases smoothly over the energy range 10 to the 17th power to 10 to the 19th power eV and concluded that the primary cosmic ray flux has a constant mass composition over this range. It is also reported that an apparent significant change in the power index occurs below 10 to the 17th power eV rho sub c (250 m) sup 0.78. Such a change indicates a significant change in primary mass composition in this range. The earlier conclusions concerning EAS of energy 10 to the 17th power eV are confirmed. Analysis of data in the 10 to the 16th power - 10 to the 17th power eV range revealed a previously overlooked selection bias in the data set. The full analysis of the complete data set in the energy range 10 to the 16th power - 10 to the 17th power ev with the selection bias eliminated is presented.

Blake, P. R.↗
DOE OSTI2021

Evaluating fine-resolution, regional outputs of a variable resolution global climate model

Climate models have been used to study water resources and regional hydrologic responses to climate change, but climate model outputs must be downscaled to provide relevant regional data. However, the accuracy of this regional data is limited by uncertainties across and within downscaling methods, uncertainty across global outputs, and discontinuities at downscaled boundaries. A new alternative to traditional downscaling is a variable resolution model that incorporates fine-resolution regions directly into a coarse-resolution, global climate simulation in order to capture contiguous dynamics across resolution boundaries. In this study, we used the Variable-Resolution Community Earth System Model (VR-CESM) to generate one-eighth degree (14 km) fine-resolution outputs for the western U.S. and eastern China from 1970-2006. We focus our evaluation on precipitaiton, temperature, snow pack, solar radiation, and wind. We compare the model outputs with remote-sensing-based precipitation data, and both reanalysis and gridded weather station data for precipitation and temperature. VR-CESM generally has a cold bias in winter and a warm bias in summer in the western U.S., which compensate each other to reduce the annual bias. In eastern China, however, the sign of temperature biases are more consistent throughout the year with cold biases in the higher mountains and warm biases throughout most of the rest of the region. Precipitation biases are dependent upon reference data, and show slight overestimation in high mountain regions in both the U.S. and China with respect to gridded weather station data. Simulated snow cover in the western U.S. is reasonable compared to remote sensing data, but snow cover and snow water equivalent have larger biases when compared to reanalysis data. In eastern China there are widespread snow cover biases compared to remote sensing data. VR-CESM underestimates downward shortwave radiation to a greater degree in summer than in winter, and underestimates surface layer windspeed over mountains to a greater degree than in other areas. Comparison between VR-CESM and a coarser simulation (1-degree Beijing Climate Center model) shows reduced precipitation biases in the mountainous regions with finer resolution, indicating the value of variable-resolution modeling for reigonal studies.

Di Vittorio, Alan↗
NASA NTRS1982

A comparison of turbulence intensity measurements using a laser velocimeter and a hot wire in a low speed jet flow

The study involves a simultaneous measurement with both instruments along radial scans at two axial locations in the jet exiting from the turbulent pipe and an axial scan at the 75-percent radial location in the jet from the convergent nozzle. The results suggest that, within the limits of flow stationarity, both instruments yield measurements in good agreement, + or - 0.8-percent in turbulence intensity, below a turbulence intensity (the ensemble standard deviation divided by the local mean velocity) of 20 percent. From turbulence intensities of 20 percent to a maximum of 75 percent, the measurements exhibit the same trends; for reasons discussed here, however, the comparisons are not of the quality as those below 20 percent. It is found that correcting the turbulence intensity data for velocity bias errors increases the results by an average of 2 percent in turbulence intensity above the hot wire results and the uncorrected laser velocimeter data. The results are seen as calling into question the validity of using the velocity bias correction and time average techniques for turbulence intensity measurements.

Meyers, J. F.↗
NASA NTRS2007

Effects on Spacecraft Radiometric Data at Superior Solar Conjunction

During 2006, three ESA interplanetary spacecraft, Rosetta, Mars Express (MEX) and Venus Express (VEX), passed through superior solar conjunction. For all three spacecraft, the noise in the post-fit range-rate residuals from the orbit determination was analysed. At small Sun-Earth-Probe (SEP) angles the level was almost two orders of magnitude higher than normal. The main objective was to characterize the Doppler (rangerate) noise as a function of SEP angle. At least then the range-rate data can be appropriately weighted within the orbit determination so that the solution uncertainties are realistic. For VEX, some intervals of particularly noisy Doppler data could be correlated with unusual solar activity. For Rosetta, the biases in the range data residuals were analysed with the aim of improving the model used for calibrating the signal delay due to the solar plasma. The model, which originally had fixed coefficients, was adjusted to achieve better fits to the data. Even the relatively small Doppler biases were well represented. Using the improved model, the electron density at 20 solar radii was compared with earlier results obtained by radio science studies using Voyager 2 and Ulysses radiometric data. There is some evidence for a dependency of the density on the phase within the 11 years solar cycle.

Morley, Trevor↗
DOE OSTI2022

MISPR : an open-source package for high-throughput multiscale molecular simulations

Computational tools provide a unique opportunity to study and design optimal materials by enhancing our ability to comprehend the connections between their atomistic structure and functional properties. However, designing materials with tailored functionalities is complicated due to the necessity to integrate various computational-chemistry software (not necessarily compatible with one another), the heterogeneous nature of the generated data, and the need to explore vast chemical and parameter spaces. The latter is especially important to avoid bias in scattered data points-based models and derive statistical trends only accessible by systematic datasets. Here, we introduce a robust high-throughput multi-scale computational infrastructure coined MISPR (Materials Informatics for Structure–Property Relationships) that seamlessly integrates classical molecular dynamics (MD) simulations with density functional theory (DFT). By enabling high-performance data analytics and coupling between different methods and scales, MISPR addresses critical challenges arising from the needs of automated workflow management and data provenance recording. The major features of MISPR include automated DFT and MD simulations, error handling, derivation of molecular and ensemble properties, and creation of output databases that organize results from individual calculations to enable reproducibility and transparency. In this work, we describe fully automated DFT workflows implemented in MISPR to compute various properties such as nuclear magnetic resonance chemical shift, binding energy, bond dissociation energy, and redox potential with support for multiple methods such as electron transfer and proton-coupled electron transfer reactions. The infrastructure also enables the characterization of large-scale ensemble properties by providing MD workflows that calculate a wide range of structural and dynamical properties in liquid solutions. MISPR employs the methodologies of materials informatics to facilitate understanding and prediction of phenomenological structure–property relationships, which are crucial to designing novel optimal materials for numerous scientific applications and engineering technologies.

36 MATERIALS SCIENCE↗
NASA NTRS1981

The effects of missing data on global ozone estimates

The effects of missing data and model truncation on estimates of the global mean, zonal distribution, and global distribution of ozone are considered. It is shown that missing data can introduce biased estimates with errors that are not accounted for in the accuracy calculations of empirical modeling techniques. Data-fill techniques are introduced and used for evaluating error bounds and constraining the estimate in areas of sparse and missing data. It is found that the accuracy of the global mean estimate is more dependent on data distribution than model size. Zonal features can be accurately described by 7th order models over regions of adequate data distribution. Data variance accounted for by higher order models appears to represent climatological features of columnar ozone rather than pure error. Data-fill techniques can prevent artificial feature generation in regions of sparse or missing data without degrading high order estimates over dense data regions.

Drewry, J. W.↗
NASA NTRS1983

On the error in crop acreage estimation using satellite (LANDSAT) data

The problem of crop acreage estimation using satellite data is discussed. Bias and variance of a crop proportion estimate in an area segment obtained from the classification of its multispectral sensor data are derived as functions of the means, variances, and covariance of error rates. The linear discriminant analysis and the class proportion estimation for the two class case are extended to include a third class of measurement units, where these units are mixed on ground. Special attention is given to the investigation of mislabeling in training samples and its effect on crop proportion estimation. It is shown that the bias and variance of the estimate of a specific crop acreage proportion increase as the disparity in mislabeling rates between two classes increases. Some interaction is shown to take place, causing the bias and the variance to decrease at first and then to increase, as the mixed unit class varies in size from 0 to 50 percent of the total area segment.

Chhikara, R.↗
NASA NTRS2019

Differences Between OCO‐2 and GOME‐2 SIF Products From a Model‐Data Fusion Perspective

Space-borne retrievals of solar-induced chlorophyll fluorescence (SIF) over land surfaces have recently become a resource for studying and quantifying the broad scale dynamics of gross carbon uptake (gross primary productivity—GPP) across ecosystems. To prepare for the assimilation of SIF data in terrestrial biosphere models, we examine how differences between SIF products (due to differences in acquisition characteristics and processing chain) may affect the optimization of model parameters and the resultant GPP estimate. We compare recent daily mean SIF products (one from the Orbiting Carbon Observatory-2 [OCO-2] and two from the Global Ozone Monitoring Experiment–2 [GOME-2], GlobFluo [GF] and NASA-v28 [N28], missions), averaged at 0.5° × 0.5° spatial resolution and 16-day temporal resolution, at the biome level. Phase differences between these products are relatively small. A first-order correction of the difference in spectral sampling between the two instruments shows that OCO-2 and N28 are consistent in terms of magnitude and amplitude, while GF is twice as large as the others. Using a bias-blind toy data assimilation framework, we analyze how biases between SIF products, and between model and products, can be partially alleviated by optimizing the slope and intercept parameters of a linear GPP-SIF operator. As observation biases can transfer to biases in other optimized process-based parameters and to modeled carbon fluxes— thereby resulting in unidentified inaccurate parameter values—we argue that potential SIF biases should be treated cautiously in real-world experiments in order to achieve realistic and reliable future simulations.

Gross primary production↗
NASA NTRS1986

Constructing a coherent long-term global total ozone climatology from the BUV, MFR, and SBUV/TOMS data sets

Multichannel Filter Radiometer (MFR) data are intercompared with Solar Backscattered Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) data during a five-month period of their data overlap in order to determine the usefulness of MFR data to represent the SBUV/TOMS and backscatter ultraviolet spectrometer data during their data gap period. Total ozone differences found were latitudinally and monthly dependent. Average differences between the TOMS and the MFR ozone data vary from -12.4 to +13.3 percent, with differences in the tropical to middle latitudes generally between + or - 4 percent. Biases between the data sets can be removed for certain latitude zones by applying an appropriate algorithm to the MFR ozone data.

Ellis, J. S.↗
NASA NTRS2013

Dependence of Dynamic Modeling Accuracy on Sensor Measurements, Mass Properties, and Aircraft Geometry

The NASA Generic Transport Model (GTM) nonlinear simulation was used to investigate the effects of errors in sensor measurements, mass properties, and aircraft geometry on the accuracy of identified parameters in mathematical models describing the flight dynamics and determined from flight data. Measurements from a typical flight condition and system identification maneuver were systematically and progressively deteriorated by introducing noise, resolution errors, and bias errors. The data were then used to estimate nondimensional stability and control derivatives within a Monte Carlo simulation. Based on these results, recommendations are provided for maximum allowable errors in sensor measurements, mass properties, and aircraft geometry to achieve desired levels of dynamic modeling accuracy. Results using additional flight conditions and parameter estimation methods, as well as a nonlinear flight simulation of the General Dynamics F-16 aircraft, were compared with these recommendations

Grauer, Jared A.↗
NASA NTRS1993

C-band attenuation by tropical rainfall in Darwin, Australia, using climatologically tuned Z(e)-R relations

The probability matching method (PMM) is used as a basis for estimating attenuation in tropical rains near Darwin, Australia. PMM provides a climatological relationship between measured radar reflectivity and rain rate, which includes the effects of rain and cloud attenuation. When the radar sample is representative, PMM estimates the rainfall without bias. When the data are stratified for greater than average rates, the method no longer compensates for the higher attenuation and the radar rainfall estimates are biased low. The uncompensated attenuation is used to estimate the climatological attenuation coefficient. The two-way attenuation coefficient was found to be 0.0085 dB/km ( mm/h) exp -1.08 for the tropical rains and associated clouds in Darwin for the first two months of the year for horizontally polarized radiation at 5.63 GHz. This unusually large value is discussed. The risks of making real-time corrections for attenuation are also treated.

Atlas, David↗
DOE OSTI2023

Lorentz group equivariant autoencoders

Abstract There has been significant work recently in developing machine learning (ML) models in high energy physics (HEP) for tasks such as classification, simulation, and anomaly detection. Often these models are adapted from those designed for datasets in computer vision or natural language processing, which lack inductive biases suited to HEP data, such as equivariance to its inherent symmetries. Such biases have been shown to make models more performant and interpretable, and reduce the amount of training data needed. To that end, we develop the Lorentz group autoencoder (LGAE), an autoencoder model equivariant with respect to the proper, orthochronous Lorentz group $$\textrm{SO}^+(3,1)$$ SO + ( 3 , 1 ) , with a latent space living in the representations of the group. We present our architecture and several experimental results on jets at the LHC and find it outperforms graph and convolutional neural network baseline models on several compression, reconstruction, and anomaly detection metrics. We also demonstrate the advantage of such an equivariant model in analyzing the latent space of the autoencoder, which can improve the explainability of potential anomalies discovered by such ML models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1992

Equivalent GPS measurements for efficient estimation process

Dual-frequency pseudorange and carrier phase data streams can be analytically combined into a single equivalent data stream, reducing the data volume and computing time in the filtering process for parameter estimation by a factor of 2 to 4. The resulting single data stream is that of carrier phase measurements with both data noise and bias uncertainty strictly defined. Based on these analytical formulas the equivalent GPS measurements can be formed by simple and efficient numerical calculations without any degradation in data strength. Formulation for the equivalent GPS measurements and their covariances are given in closed form; and a numerical simulation is performed to demonstrate the validity and effectiveness of the equivalent measurements.

Wu, S. C.↗