Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

Combinations of Earth Orientation Measurements: SPACE94, COMB94, and POLE94

A Kalman filter has been used to combine independent measurements of the Earth's orientation taken by the space-geodetic observing techniques of lunar laser ranging, satellite laser ranging, very long baseline interferometry, and the Global Positioning System. Prior to their combination, the data series were adjusted to have the same bias and rate, the stated uncertainties of the measurements were adjusted, and data points considered to be outliers were deleted. The resulting combination, SPACE94, consists of smoothed, interpolated polar motion and UT1-UTC values spanning October 6.0, 1976, to January 27.0, 1995, at 1-day intervals.

Kalman↗
DOE OSTI2024

Spatially-resolved soot evolution and statistics in high-pressure diesel spray flames using two-color pyrometry

Previous studies of diesel spray flames have focused on details of the sooting behavior mainly during the quasi-steady period, but few have considered the spatially-resolved transient evolution in combination with injection-to-injection variations. In this study, a 500-injection data set is utilized to investigate the temporal evolution of a spray flame during auto-ignition, the premixed burn phase, and the quasi-steady period. Spatially-resolved OH* chemiluminescence data provide ignition delay times and reaction zone locations. Two-color pyrom-etry with a vastly improved optical system is used to quantify spatially-resolved soot evolution and its statistical variations. The ambient thermodynamic con-ditions are slightly below those in modern diesel engines, resulting in longer lift-off lengths and lower overall soot production. Spatially, soot formation in the lift-off region is small, but appreciable soot forms in the jet core and jet head regions, while it oxidizes gradually on the jet periphery. Total soot mass profiles indicate that regions with larger local soot mass take longer to form, but are the first to oxidize. Probability distributions of soot mass in localized regions indicate that a few injections with high soot mass bias the average soot mass data towards higher values. Altogether, results show good agreement with previous studies employing different diagnostic techniques while providing statistical details of transient and localized soot behavior in high pressure diesel spray flames in support of the related modeling efforts.

09 BIOMASS FUELS↗
DOE OSTI2020

Metabolic flux analysis reaching genome wide coverage: lessons learned and future perspectives

13 C-MFA is currently the only technique capable of elucidating intracellular metabolic fluxes. Generally, in 13 C-MFA studies the reactions that can carry flux are mostly pre-specified by only considering canonical pathways and ignoring alternate ones. This may bias flux elucidation and cause labeling data to erroneously confirm implied assumptions. Here, by expanding the scope of the metabolic mapping models to match known genome-scale metabolism such estimation biases can be eliminated. However, this model expansion to genome-scale requires the construction of expanded atom mapping models, more efficient flux estimation algorithms, and formal estimation of confidence levels. Even though significant progress has been made in this direction, a number of challenges remain before widespread adoption by the community.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1978

Section drag coefficients from pressure probe transverses of a wing wake at low speeds

An in-flight wing wake section drag investigation was conducted using traversing pitot and static probes. The primary objective was to develop measurement techniques and improve the accuracy of in-flight wing profile drag measurements for low values of dynamic pressure and Reynolds number. Data were obtained on a sailplane for speeds from about 40 knots to 125 knots at chord Reynolds numbers between 1,000,000 and 3,000,000. Tests were conducted with zero flap deflection, deflected flaps, and various degrees of surface roughness, and for smooth and rough atmospheric conditions. Several techniques were used to increase data reliability and to minimize certain bias errors. A discussion of the effects of a total pressure probe in a pressure gradient, and the effects of discrete turbulence levels, on the data presented and other experimental results is also included.

Montoya, L. C.↗
NASA NTRSDate not supplied

Creating A Consistent Historical NASA POWER Solar Radiation Dataset to Support Renewable Energy, Building Energy Efficiency and Agro-Climatology Decisions

Prediction of Worldwide Energy Resources (POWER) project provides irradiance dataset to support renewable energy, building energy efficiency and agricultural needs. These datasets are derived from Global Energy and Water Cycle Experiment Surface Radiation Budget (GEWEX SRB) and Clouds and the Earth’s Radiant Energy System (CERES SYN1Deg). A systematic bias has been reported between these two datasets for the years with overlapping observations. For obtaining a consistent climate data record spanning the entire time record of observations, it is crucial to understand and remove the bias in the irradiance dataset. Inconsistency in solar radiation data can lead to inaccurate conclusions about solar energy potential and obscure real trends in solar radiation patterns that would impact energy availability assessments. In this study, we adapt quantile mapping approach to remove the systematic bias and to improve reliability of shortwave and longwave irradiance data. We present a validation of the bias corrected data against ground truth. For each 1° latitude and 1° longitude grid box across the globe, we match the CDFs of the reference dataset (CERES SYN1Deg) to that of the SRB dataset, thereby, adjusting the irradiance values to match the empirical distribution of two different measurements. The performance of quantile mapping is evaluated by using the metrics such as Mean Absolute Deviation (MAD). The results indicate that the quantile mapping significantly improves the accuracy and reliability of solar irradiance dataset especially for the weather conditions associated with high cloud cover and extreme irradiance values. The initial range of MAD for the studied sites for daily data was 4 to 19 Wm-2. After correction these reduced to 3 to 7 Wm-2. The findings from this study have important implications for solar energy system design, agricultural planning, and climate modeling community. Reducing the inconsistency and biases in solar irradiance dataset can enable better planning and operation of solar energy systems, leading to increased efficiency and cost-effectiveness. Additionally, this work also contributes to the statistical post-processing techniques in the renewable energy domain and highlights the potential of historical and near-real-time NASA POWER dataset as a valuable resource for solar energy research and applications.

POWER↗
DOE OSTI2024

Towards a liana plant functional type for vegetation models

Lianas (woody climbers) are crucial components of tropical forests and they have been increasingly recognized to have profound effects on tropical forest carbon dynamics. Despite their importance, lianas' representation in vegetation models remains limited, partly due to the complexity of liana-tree dynamics and the diversity in liana life history strategies. This paper provides a comprehensive review of advances and challenges for mechanistically representing lianas in forest ecosystem models and a proposed path towards effectively representing lianas in these models. Defining a liana plant functional type is a significant challenge because of the high morphological and physiological diversity amongst liana species, and because of their structural association with trees. Here, we identify critical liana traits that likely should contribute to establishing a liana plant functional type, along with key processes to properly represent lianas in ecosystem models. Subsequently, we discuss a variety of possible liana implementation strategies with their associated strengths, limitations, computational costs and data requirements. A fundamental redesign of the tree-centric demographic vegetation models seems appropriate to accommodate the unique growth and competition strategies of lianas. We illustrate the potential of such models with a single-site case study where we disentangle putative mechanisms of liana increasing abundance. Furthermore, we underscore the critical need for comprehensive liana demographic and functional data (including long-term, physiological, and pantropical observations) for the qualitative implementation and evaluation in the proposed modeling efforts. Currently, there is a scarcity of liana data and the data that do exist have a neotropical bias. We finally introduce a new liana functional trait database that can centralize existing liana trait data, incentivize improved data gathering and thus facilitate model development and scientific analyses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Unsupervised learning of representative local atomic arrangements in molecular dynamics data

Molecular dynamics (MD) simulations present a data-mining challenge, given that they can generate a considerable amount of data but often rely on limited or biased human interpretation to examine their information content. By not asking the right questions of MD data we may miss critical information hidden within it. Here we combine dimensionality reduction (UMAP) and unsupervised hierarchical clustering (HDBSCAN) to quantitatively characterize prevalent coordination environments of chemical species within MD data. By focusing on local coordination, we significantly reduce the amount of data to be analyzed by extracting all distinct molecular formulas within a given coordination sphere. We then efficiently combine UMAP and HDBSCAN with alignment or shape-matching algorithms to partition these formulas into structural isomer families indicating their relative populations. The method was employed to reveal details of cation coordination in electrolytes based on molecular liquids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2001

Chandra ACIS Observations of Jovian X-Ray Emission

On November 25 and 26, 1999, the Chandra X-ray spacecraft conducted a set of four 19,000 sec observations of Jupiter. The ACIS-S instrument configuration was used for its good low energy efficiency and spatial resolution. An anomalous response was obtained which was subsequently attributed to strong jovian infrared radiation penetrating the detector and piling up spurious events across the entire X-ray range. However, the pre-observation establishment of an offsetting bias field has allowed the recovery of data from that portion of Jupiter's disc which remained within the elevated portion of the bias field during the observation. This ranges from fewer than 3000 sec to the entire observing time for about 10% of the planet. Auroral emission is seen near both poles in each observation. The northern aurora ia overall more intense than the southern, consistent with prior Einstein and ROSAT Observatory results. The southern aurora shows more modulation with Jupiter's rotation than the northern. Spatial resolution has been improved by at least a factor of two over prior measurements but convincing evidence of structure has not been seen. Lower latitude emission, first observed by ROSAT, is confirmed with flux levels averaging more than a factor of five below peak auroral values. Pronounced variation in the observed emission has occurred over the observing period. The spectral response extends from 0.24 keV, below which noise dominates, to about 1.2 keV. For all four observations the spectrum is clearly enhanced between 0.45 and 0.85 keV. This is apparently unequivocal evidence that Jupiter's X-ray emission is the result of oxygen and perhaps sulfur ions precipitating into the planet's atmosphere, where they undergo charge exchange interactions. The identification of specific transitions lines in the spectrum is among the ongoing efforts. A bremsstrahlung component has not yet been identified.

Garmire, Gordon↗
DOE OSTI2021

Analysis of Automated Fault Detection and Diagnosis Records as an Indicator of HVAC Fault Prevalence: Methodology and Preliminary Results

Faults in commercial buildings can cause energy waste and other performance problems such as reduced occupant comfort, reduced equipment longevity, and increased noise. However, it is currently unknown how commonly faults occur in different equipment types. A method has been developed to estimate the prevalence of faults in air handling units, air terminal units, and rooftop units. This method includes two types of data. The first is data from several automated fault detection and diagnostics (AFDD) software technologies. This type of data provides a large sample that represents a wide range of building types, geographical locations, and equipment types. It includes fault diagnoses from thousands of buildings around the United States, as well as anonymized metadata describing the building and equipment characteristics. The number of fault records is in the order of 107. However, despite the size and richness of the data sample, this data contains some degree of inaccuracy, i.e., false positive and false negative findings. Therefore, the study includes a second type of data, coming from manual inspection of buildings that have had the same AFDD methods applied to them (from the commercial AFDD offerings). Since the field tests are conducted in buildings with AFDD-generated fault prevalence data, they can be combined with the larger sample size to provide insight into the potential biases or lower sensitivity of the AFDD data. Once a library of fault prevalence data is built, it will be studied to provide further insight into the drivers of fault prevalence, for example, whether prevalence is correlated with building type, geographical location (which is tied to climate and to utility rates), building size, etc. This paper describes the methods developed for this study and illustrates them with preliminary data. It discusses some of the challenges of harmonizing disparate outputs from multiple AFDD vendors, application of a unifying fault taxonomy, and fault prevalence metrics.

Ebrahimi Fakhar, Amir↗
NASA NTRS2018

HZETRN Radiation Transport Validation Using Balloon-Based Experimental Data

The deterministic radiation transport code HZETRN (High charge (Z) and Energy TRaNsport) was developed by NASA to study the effects of cosmic radiation on astronauts and instrumentation shielded by various materials. This work presents an analysis of computed differential flux from HZETRN compared with measurement data from three balloon-based experiments over a range of atmospheric depths, particle types, and energies. Model uncertainties were quantified using an interval-based validation metric that takes into account measurement uncertainty both in the flux and the energy at which it was measured. Average uncertainty metrics were computed for the entire dataset as well as subsets of the measurements (by experiment, particle type, energy, etc.) to reveal any specific trends of systematic over- or under-prediction by HZETRN. The distribution of individual model uncertainties was also investigated to study the range and dispersion of errors beyond just single scalar and interval metrics. The differential fluxes from HZETRN were generally well-correlated with balloon-based measurements; the median relative model difference across the entire dataset was determined to be 30%. The distribution of model uncertainties, however, revealed that the range of errors was relatively broad, with approximately 30% of the uncertainties exceeding ± 40%. The distribution also indicated that HZETRN systematically under-predicts the measurement dataset as a whole, with approximately 80% of the relative uncertainties having negative values. Instances of systematic bias for subsets of the data were also observed, including a significant underestimation of alpha particles and protons for energies below 2.5 GeV/u. Muons were found to be systematically over-predicted at atmospheric depths deeper than 50 g/cm(sup 2) but under-predicted for shallower depths. Furthermore, a systematic under-prediction of alpha particles and protons was observed below the geomagnetic cutoff, suggesting that improvements to the light ion production cross sections in HZETRN should be investigated.

James E Warner↗
NASA NTRS2009

Basic Diagnosis and Prediction of Persistent Contrail Occurrence using High-resolution Numerical Weather Analyses/Forecasts and Logistic Regression. Part I: Effects of Random Error

Straightforward application of the Schmidt-Appleman contrail formation criteria to diagnose persistent contrail occurrence from numerical weather prediction data is hindered by significant bias errors in the upper tropospheric humidity. Logistic models of contrail occurrence have been proposed to overcome this problem, but basic questions remain about how random measurement error may affect their accuracy. A set of 5000 synthetic contrail observations is created to study the effects of random error in these probabilistic models. The simulated observations are based on distributions of temperature, humidity, and vertical velocity derived from Advanced Regional Prediction System (ARPS) weather analyses. The logistic models created from the simulated observations were evaluated using two common statistical measures of model accuracy, the percent correct (PC) and the Hanssen-Kuipers discriminant (HKD). To convert the probabilistic results of the logistic models into a dichotomous yes/no choice suitable for the statistical measures, two critical probability thresholds are considered. The HKD scores are higher when the climatological frequency of contrail occurrence is used as the critical threshold, while the PC scores are higher when the critical probability threshold is 0.5. For both thresholds, typical random errors in temperature, relative humidity, and vertical velocity are found to be small enough to allow for accurate logistic models of contrail occurrence. The accuracy of the models developed from synthetic data is over 85 percent for both the prediction of contrail occurrence and non-occurrence, although in practice, larger errors would be anticipated.

Duda, David P.↗
NASA NTRS2021

Illinois Disasters: Utilizing NASA Earth Observations to Enhance Drought Monitoring in Illinois

Drought and flooding in Illinois have severe impacts on the communities and ecosystems of the state. Soil moisture is a valuable indicator of drought and flood vulnerability but can be difficult to measure since in situ monitoring is limited to discrete stations throughout the state. The team created a framework to compare in situ, modeled, and NASA satellite soil moisture measurements to increase the spatial coverage of soil moisture monitoring. The team partnered with the Illinois State Weather Survey, USDA Midwest Climate Hub, NOAA Regional Climate Services of the Central Region, NOAA National Integrated Drought Information System’s Midwest Drought Early Warning System, and the NOAA North Central River ForecastCenter. The team standardized and compared soil moisture data from NASA’s Soil Moisture Active Passive (SMAP) mission, modeled soil moisture outputs from NASA’s SPoRT Land Information System (SPoRT-LIS), and in situ measurements from the Illinois State Weather Survey’s Water and Atmospheric Resources Monitoring (WARM) program. Compared to the WARM data, the satellite and modeled data showed seasonally variable differences and bias. The difference was highest in the winter months and lowest in the late summer and early fall months for the SMAP and SPoRT-LIS data products. SPoRT-LIS produced lower seasonal variability and SMAP demonstrated higher correlation values and lower differences. These analyses suggest that both SMAP and SPoRT-LIS products offer unique strengths and limitations when used for soil moisture monitoring

Joshua Green↗
DOE OSTI2023

Understanding Biases in Sample Preparation Techniques for Coupled Scanning Electron Microscopy and MAMA PuO 2 Morphological Analysis

In this project, the scanning electron microscopy (SEM) sampling method used during the statistical design study (SDS) was investigated to determine if any sampling biases were present in the analyzed data. Using standard particle size distribution powders from the National Institute of Standards and Technology (NIST 1984 standard reference material) with the origin wet dispersion method, it was determined that a bias to smaller particles was present. This was supported by theoretical calculations using Stokes’ law to determine the settling rate of spherical particles of roughly the same size and mass as those found in the SDS. Based on the theoretical calculations, it was determined that the settling rate for each of the 76 powder sets in the SDS could be unique based on specific particle shape and mass distributions, making a universal correction factor/formula not applicable. Therefore, priority shifted to developing an improved wet dispersion method that significantly reduced the particle settling rate for all particle size and shapes. This was achieved by replacing the original solvent (isopropyl alcohol) with a heavy liquid (lithium heteropolytungstates), which dramatically slowed the settling rate and allowed for the capture of a suitable homogeneous aliquot. SEM imaging and Morphological Analysis for Material Attribution (MAMA) software analysis were conducted on the NIST standard, and the SEM/MAMA data were compared to data captured by a dynamic image analysis particle size analyzer. The resulting data confirmed that the new wet dispersion method does indeed deliver an improved representative aliquot to the SEM stub. For instance, in the NIST certificate, the average particle size is ~17.1 µm ± 2.2 µm with a normal distribution. The initial wet dispersion method resulted in a drastically reduced average particle size of 6.1 µm in addition to a non-representative heavy bi-modal distribution whereas the improved LST wet dispersion method resulting in an average particle size that was much closer to the NIST certificate (12.7 µm) with a similar normal distribution. Although the improved method was still short of the NIST certificate average, atomic force microscopy analysis determined that the resulting ~20-25% reduction in size was due to particles sinking into the carbon sticky tape used for SEM imaging. It is believed that that this bias can be calibrated in a much more predicable manner than the original settling rate bias. In addition, the matching normal distribution curves between the NIST certificate and the heavy liquid method indicate a much-improved representative aliquot has been sampled and imaged. A surrogate CeO 2 powder was used to reflect PuO 2 more accurately and to aid in implementing radiological controls and shielding. The resulting data sets from the SEM/MAMA method and the particle size analyzer give almost identical average particle sizes and particle distribution statistics. Future work will re-analyze several select runs from the SDS to determine if morphological signatures can be found with the improved sampling method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1980

Determination of instrumentation errors from measured data using maximum likelihood method

The maximum likelihood method is used for estimation of unknown initial conditions, constant bias and scale factor errors in measured flight data. The model for the system to be identified consists of the airplane six-degree-of-freedom kinematic equations, and the output equations specifying the measured variables. The estimation problem is formulated in a general way and then, for practical use, simplified by ignoring the effect of process noise. The algorithm developed is first applied to computer generated data having different levels of process noise for the demonstration of the robustness of the method. Then the real flight data are analyzed and the results compared with those obtained by the extended Kalman filter algorithm.

Keskar, D. A.↗
DOE OSTI2021

A Data Set for Intercomparing the Transient Behavior of Dynamical Model-Based Subseasonal to Decadal Climate Predictions

Climate predictions using coupled models in different time scales, from intraseasonal to decadal, are usually affected by initial shocks, drifts, and biases, which reduce the prediction skill. These arise from inconsistencies between different components of the coupled models and from the tendency of the model state to evolve from the prescribed initial conditions toward its own climatology over the course of the prediction. Aiming to provide tools and further insight into the mechanisms responsible for initial shocks, drifts, and biases, this paper presents a novel data set developed within the Long Range Forecast Transient Intercomparison Project, LRFTIP. This data set has been constructed by averaging hindcasts over available prediction years and ensemble members to form a hindcast climatology, that is a function of spatial variables and lead time, and thus results in a useful tool for characterizing and assessing the evolution of errors as well as the physical mechanisms responsible for them. A discussion on such errors at the different time scales is provided along with plausible ways forward in the field of climate predictions

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗
DOE OSTI2021

Hierarchical Inference with Bayesian Neural Networks: An Application to Strong Gravitational Lensing

In the past few years, approximate Bayesian Neural Networks (BNNs) have demonstrated the ability to produce statistically consistent posteriors on a wide range of inference problems at unprecedented speed and scale. However, any disconnect between training sets and the distribution of real-world objects can introduce bias when BNNs are applied to data. This is a common challenge in astrophysics and cosmology, where the unknown distribution of objects in our universe is often the science goal. In this work, we incorporate BNNs with flexible posterior parameterizations into a hierarchical inference framework that allows for the reconstruction of population hyperparameters and removes the bias introduced by the training distribution. We focus on the challenge of producing posterior PDFs for strong gravitational lens mass model parameters given Hubble Space Telescope–quality single-filter, lens-subtracted, synthetic imaging data. We show that the posterior PDFs are sufficiently accurate (statistically consistent with the truth) across a wide variety of power-law elliptical lens mass distributions. We then apply our approach to test data sets whose lens parameters are drawn from distributions that are drastically different from the training set. We show that our hierarchical inference framework mitigates the bias introduced by an unrepresentative training set's interim prior. Simultaneously, we can precisely reconstruct the population hyperparameters governing our test distributions. Our full pipeline, from training to hierarchical inference on thousands of lenses, can be run in a day. The framework presented here will allow us to efficiently exploit the full constraining power of future ground- and space-based surveys (https://github.com/swagnercarena/ovejero).

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2000

A Systematic Error Correction Method for TOVS Radiances

Treatment of systematic errors is crucial for the successful use of satellite data in a data assimilation system. Systematic errors in TOVS radiance measurements and radiative transfer calculations can be as large or larger than random instrument errors. The usual assumption in data assimilation is that observational errors are unbiased. If biases are not effectively removed prior to assimilation, the impact of satellite data will be lessened and can even be detrimental. Treatment of systematic errors is important for short-term forecast skill as well as the creation of climate data sets. A systematic error correction algorithm has been developed as part of a 1D radiance assimilation. This scheme corrects for spectroscopic errors, errors in the instrument response function, and other biases in the forward radiance calculation for TOVS. Such algorithms are often referred to as tuning of the radiances. The scheme is able to account for the complex, air-mass dependent biases that are seen in the differences between TOVS radiance observations and forward model calculations. We will show results of systematic error correction applied to the NOAA 15 Advanced TOVS as well as its predecessors. We will also discuss the ramifications of inter-instrument bias with a focus on stratospheric measurements.

Joiner, Joanna↗