Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS1973

Precise timing correlation in telemetry recording and processing systems

Independent PCM telemetry data signals received from missiles must be correlated to within + or - 100 microseconds for comparison with radar data. Tests have been conducted to determine RF antenna receiving system delays; delays associated with wideband analog tape recorders used in the recording, dubbing and repdocuing processes; and uncertainties associated with computer processed time tag data. Several methods used in the recording of timing are evaluated. Through the application of a special time tagging technique, the cumulative timing bias from all sources is determined and the bias removed from final data. Conclusions show that relative time differences in receiving, recording, playback and processing of two telemetry links can be accomplished with a + or - 4 microseconds accuracy. In addition, the absolute time tag error (with respect to UTC) can be reduced to less than 15 microseconds. This investigation is believed to be the first attempt to identify the individual error contributions within the telemetry system and to describe the methods of error reduction within the telemetry system and to describe the methods of error reduction and correction.

Pickett, R. B.↗
NASA NTRS2002

SPARC Intercomparison of Middle Atmosphere Climatologies

This atlas presents detailed incomparisons of several climatological wind and temperature data sets which cover the middle atmosphere (over altitudes approx. 10-80 km). A number of middle atmosphere climatologies have been developed in the research community based on a variety of meteorological analyses and satellite data sets. Here we present comparisons between these climatological data sets for a number of basic circulation statistics, such as zonal mean temperature, winds and eddy flux statistics. Special attention is focused on tropical winds and temperatures, where large differences exist among separate analyses. We also include comparisons between the global climatologies and historical rocketsonde wind and temperature measurements, and also with more recent lidar temperature data. These comparisons highlight differences and uncertainties in contemporary middle atmosphere data sets, and allow biases in particular analyses to be isolated. In addition, a brief atlas of zonal mean temperature and wind statistics is provided to highlight data availability and as a quick-look reference. This technical report is intended as a companion to the climatological data sets held in archive at the SPARC Data Center (http://www.sparc.sunysb.edu).

Randel, William↗
NASA NTRS1984

The near-Earth magnetic field at 1980 determined from MAGSAT data

Data from the MAGSAT spacecraft for November 1979 through April 1980 and from 91 magnetic observatories for 1978 through 1982 are used to derive a spherical harmonic model of the Earth's main magnetic field and its secular variation. Constant coefficients are determined through degree and order 13 and secular variation coefficients through degree and order 10. The first degree external terms and corresponding induced internal terms are given as a function of Dst. Preliminary modeling using separate data sets at dawn and dusk local time showed that the dusk data contains a substantial field contribution from the equatorial electrojet current. The final data set is selected first from dawn data and then augmented by dusk data to achieve a good geographic data distribution for each of three time periods: (1) November/December, 1979; (2) January/February; 1980; (3) March/April, 1980. A correction for the effects of the equatorial electrojet is applied to the dusk data utilized. The solution included calculation of fixed biases, or anomalies, for the observation data.

Langel, R. A.↗
NASA NTRS1985

The near-earth magnetic field at 1980 determined from Magsat data

Data from the Magsat spacecraft for November 1979 through April 1980 and from 91 magnetic observatories for 1978 through 1982 are used to derive a spherical harmonic model of the earth's main magnetic field and its secular variation. Constant coefficients are determined through degree and order 13 and secular variation coefficients through degree and order 10. The first degree external terms and corresponding induced internal terms are given as a function of Dst. Preliminary modeling using separate data sets at dawn and dusk local time showed that the dusk data contains a substantial field contribution from the equatorial electrojet current. The final data set is selected first from dawn data and then augmented by dusk data to achieve a good geographic data distribution for each of three time periods: (1) November/December, 1979; (2) January/February, 1980; (3) March/April, 1980. A correction for the effects of the equatorial electrojet is applied to the dusk data utilized. The solution included calculation of fixed biases, or anomalies, for the observation data.

Langel, R. A.↗
NASA NTRS1999

Validation of the AMSU-B Bias Corrections Based on Satellite Measurements from SSM/T-2

The NOAA-15 Advanced Microwave Sounding Unit-B (AMSU-B) was designed in the same spirit as the Special Sensor Microwave Water Vapor Profiler (SSM/T-2) on board the DMSP F11-14 satellites, to perform remote sensing of spatial and temporal variations in mid and upper troposphere humidity. While the SSM/T-2 instruments have a 48 km spatial resolution at nadir and 28 beam positions per scan, AMSU-B provides an improvement with a 16 km spatial resolution at nadir and 90 beam positions per scan. The AMSU-B instrument, though, has been experiencing radio frequency interference (RFI) contamination from the NOAA-15 transmitters whose effect is dependent upon channel, geographic location, and current spacecraft antenna configuration. This has lead to large cross-track biases reaching as high as 100 Kelvin for channel 17 (150 GHz) and 50 Kelvin for channel 19 (183 +/-3 GHz). NOAA-NESDIS has recently provided a series of bias corrections for AMSU-B data starting from March, 1999. These corrections are available for each of the five channels, for every third field of view, and for three cycles within an eight second period. There is also a quality indicator in each data record to indicate whether or not the bias corrections should be applied. As a precursor to performing retrievals of mid and upper troposphere humidity, a validation study is performed by statistically analyzing the differences between the F14 SSM/T-2 and the bias corrected AMSU-B brightness temperatures for three months in the spring of 1999.

Kolodner, Marc A.↗
NASA NTRS2001

NASA Technical Management Report (533Q)

The objective of this task is analytical support of the NASA Satellite Laser Ranging (SLR) program in the areas of SLR data analysis, software development, assessment of SLR station performance, development of improved models for atmospheric propagation and interpretation of station calibration techniques, and science coordination and analysis functions for the NASA led Central Bureau of the International Laser Ranging Service (ILRS). The contractor shall in each year of the five year contract: (1) Provide software development and analysis support to the NASA SLR program and the ILRS. Attend and make analysis reports at the monthly meetings of the Central Bureau of the ILRS covering data received during the previous period. Provide support to the Analysis Working Group of the ILRS including special tiger teams that are established to handle unique analysis problems. Support the updating of the SLR Bibliography contained on the ILRS web site; (2) Perform special assessments of SLR station performance from available data to determine unique biases and technical problems at the station; (3) Develop improvements to models of atmospheric propagation and for handling pre- and post-pass calibration data provided by global network stations; (4) Provide review presentation of overall ILRS network data results at one major scientific meeting per year; (5) Contribute to and support the publication of NASA SLR and ILRS reports highlighting the results of SLR analysis activity.

Klosko, S. M.↗
NASA NTRS2017

Interval Predictor Models for Data with Measurement Uncertainty

An interval predictor model (IPM) is a computational model that predicts the range of an output variable given input-output data. This paper proposes strategies for constructing IPMs based on semidefinite programming and sum of squares (SOS). The models are optimal in the sense that they yield an interval valued function of minimal spread containing all the observations. Two different scenarios are considered. The first one is applicable to situations where the data is measured precisely whereas the second one is applicable to data subject to known biases and measurement error. In the latter case, the IPMs are designed to fully contain regions in the input-output space where the data is expected to fall. Moreover, we propose a strategy for reducing the computational cost associated with generating IPMs as well as means to simulate them. Numerical examples illustrate the usage and performance of the proposed formulations.

Lacerda, Marcio J.↗
NASA NTRS2020

Evaluation of Global Fire Weather Database Reanalysis and Short-Term Forecast Products

Daily Fire Weather Index (FWI) System components calculated from the NASA Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), are compared to FWI calculations from a global network of weather stations over 2004–2018, and short-term, experimental (8 d) daily FWI forecasts are evaluated for their skill across the Terrestrial Ecoregions of the World for 2018. FWI components from MERRA-2 were, in general, biased low compared to station data, but this reflects a mix of coherent low and high biases of different magnitudes. Biases in different MERRA-2 FWI components were related to different biases in weather input variables for different regions, but temperature and relative humidity biases were the most important overall. FWI forecasts had high skill for 1–2 d lead times for most of the world. For longer lead times, forecast skill decreased most quickly at high latitudes and was most closely related to decreasing skill of relative humidity forecasts. These results provide a baseline for the evaluation and use of fire weather products calculated from global analysis and forecast fields.

Global Fire Weather Database↗
NASA NTRS2012

Inferring Land Surface Model Parameters for the Assimilation of Satellite-Based L-Band Brightness Temperature Observations into a Soil Moisture Analysis System

The Soil Moisture and Ocean Salinity (SMOS) satellite mission provides global measurements of L-band brightness temperatures at horizontal and vertical polarization and a variety of incidence angles that are sensitive to moisture and temperature conditions in the top few centimeters of the soil. These L-band observations can therefore be assimilated into a land surface model to obtain surface and root zone soil moisture estimates. As part of the observation operator, such an assimilation system requires a radiative transfer model (RTM) that converts geophysical fields (including soil moisture and soil temperature) into modeled L-band brightness temperatures. At the global scale, the RTM parameters and the climatological soil moisture conditions are still poorly known. Using look-up tables from the literature to estimate the RTM parameters usually results in modeled L-band brightness temperatures that are strongly biased against the SMOS observations, with biases varying regionally and seasonally. Such biases must be addressed within the land data assimilation system. In this presentation, the estimation of the RTM parameters is discussed for the NASA GEOS-5 land data assimilation system, which is based on the ensemble Kalman filter (EnKF) and the Catchment land surface model. In the GEOS-5 land data assimilation system, soil moisture and brightness temperature biases are addressed in three stages. First, the global soil properties and soil hydraulic parameters that are used in the Catchment model were revised to minimize the bias in the modeled soil moisture, as verified against available in situ soil moisture measurements. Second, key parameters of the "tau-omega" RTM were calibrated prior to data assimilation using an objective function that minimizes the climatological differences between the modeled L-band brightness temperatures and the corresponding SMOS observations. Calibrated parameters include soil roughness parameters, vegetation structure parameters, and the single scattering albedo. After this climatological calibration, the modeling system can provide L-band brightness temperatures with a global mean absolute bias of less than 10K against SMOS observations, across multiple incidence angles and for horizontal and vertical polarization. Third, seasonal and regional variations in the residual biases are addressed by estimating the vegetation optical depth through state augmentation during the assimilation of the L-band brightness temperatures. This strategy, tested here with SMOS data, is part of the baseline approach for the Level 4 Surface and Root Zone Soil Moisture data product from the planned Soil Moisture Active Passive (SMAP) satellite mission.

Reichle, Rolf H.↗
NASA NTRS2012

Bridging Informatics and Earth Science: a Look at Gregory Leptoukh's Contributions

With the tragic passing this year of Gregory Leptoukh, the Earth and Space Sciences community lost a tireless participant in--and advocate for--science informatics. Throughout his career at NASA, Dr. Leptoukh established a theme of bridging the gulf between the informatics and science communities. Nowhere is this more evident than his leadership in the development of Giovanni (GES DISC Interactive Online Visualization ANd aNalysis Infrastructure). Giovanni is an online tool that serves to hide the often-complex technical details of data format and structure, making science data easier to explore and use by Earth scientists. To date Giovanni has been acknowledged as a contributor in 500-odd scientific articles. In recent years, Leptoukh concentrated his efforts on multi-sensor data inter-comparison, merging and fusion. This work exposed several challenges at the intersection of data and science. One of these was the ease with which a naive user might generate spurious comparisons, a potential hazard that was the genesis of the Multi-sensor Data Synergy Advisor (MDSA). The MDSA uses semantic ontologies and inference rules to organize knowledge about dataset quality and other salient characteristics in order to advise users on potential caveats for comparing or merging two datasets. Recently, Leptoukh also led the development of AeroStat, an online Giovanni instance to investigate aerosols via statistics from station and satellite comparisons and merged maps of data from more than one instrument. Aerostat offers a neural net based bias adjustment to harmonize the data by removing systematic offsets between datasets before merging. These examples exhibit Leptoukh's talent for adopting advanced computer technologies in the service of making science data more accessible to researchers. In this, he set an example that is at once both vital and challenging for the ESSI community to emulate.

Source record↗
NASA NTRS2020

A Post-2013 Dropoff in Total Ozone at a Third of Global Ozonesonde Stations: Electrochemical Concentration Cell Instrument Artifacts?

An international effort to improve ozonesonde data quality and to reevaluate historical recordshas made significant improvements in the accuracy of global network data. However, between 2014 and2016, ozonesonde total column ozone (TCO; O3) at 14 of 37 regularly reporting stations exhibited a suddendropoff relative to satellite measurements. The ozonesonde TCO drop is 3–7% compared to satellite andground‐based TCO, and 5–10% or more compared to satellite stratospheric O3profiles, compromising theuse of recent data for trends, although they remain reliable for other uses. Hardware changes in theozonesonde instrument are likely a major factor in the O3dropoff, but no single property of the ozonesondeexplains thefindings. The bias remains in recent data. Research to understand the dropoff is in progress; thisletter is intended as a caution to users of the data. Ourfindings underscore the importance of regularozonesonde data evaluation.

ozonesonde TCO drop↗
NASA NTRS1999

Tropical Rainfall Distributions Determined Using TRMM Combined with other Satellite and Raingauge Information

Abstract A technique is described to use Tropical Rain Measuring Mission (TRMM) combined radar/radiometer information to adjust geosynchronous infrared satellite data (the TRMM Adjusted GOES Precipitation Index, or TRMM AGPI). The AGPI is then merged with rain gauge information (mostly over land; the TRMM merged product) to provide fine- scale (1 deg latitude/longitude) pentad and monthly analyses, respectively. The TRMM merged estimates are 10% higher than those from the Global Precipitation Climatology Project (GPCP) when integrated over the tropical oceans (37 deg N-S) for 1998, with 20% differences noted in the most heavily raining areas. In the dry subtropics the TRMM values are smaller than the GPCP estimates. The TRMM merged-product tropical-mean estimates for 1998 are 3.3 mm/ day over ocean and 3.1 mm/ day over land and ocean combined. Regional differences are noted between the western and eastern Pacific Ocean maxima when TRMM and GPCP are compared. In the eastern Pacific rain maximum the TRMM and GPCP mean values are nearly equal, very different from the other tropical rainy areas where TRMM merged-product estimates are higher. This regional difference may indicate that TRMM is better at taking in to account the vertical structure of the rain systems and the difference in structure between the western and eastern (shallower) Pacific convection. Comparisons of these TRMM merged analysis estimates with surface data sets shows varied results; the bias is near zero when compared to western Pacific Ocean atoll raingauge data, but significantly positive compared to Kwajalein radar estimates (adjusted by rain gauges). Over land the TRMM estimates also show a significant positive bias. The inclusion of gauge information in the final merged product significantly reduces the bias over land, as expected. The monthly precipitation patterns produced by the TRMM merged data process clearly show the evolution of the ENSO tropical precipitation pattern from early 1998 (El Nino) through early 1999 (La Nina) and beyond. The El Nino minus La Nina difference map shows the eastern Pacific maximum, the maritime continent minima and other tropical and mid-latitude features. The differences in the Pacific are very similar to those detected by the GPCP analyses. However, summing the El Nino minus La Nina differences over the global tropical oceans yields divergent answers from TRMM, GPCP and other estimates. This emphasizes the need for additional validation and analysis before it is feasible to understand the relations between global precipitation anomalies and Pacific Ocean ENSO temperature changes.

Adler, Robert F.↗
NASA NTRS1999

Improving Global Reanalyses and Short-Range Forecast Using TRMM and SSM/I-Derived Precipitation and Moisture Observations

Global reanalyses currently contain significant errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. The Data Assimilation Office (DAO) at the NASA Goddard Space Flight Center has been exploring the use of tropical rainfall and total precipitable water (TPW) observations from the TRMM Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments to improve short-range forecast and reanalyses. We describe a 1+1D procedure for assimilating 6-hr averaged rainfall and TPW in the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS). The algorithm is based on a 6-hr time integration of a column version of the GEOS DAS, hence the 1+1D designation. The scheme minimizes the least-square differences between the observed TPW and rain rates and those produced by the column model over the 6-hr analysis window. This 1+1D scheme, in its generalization to four dimensions, is related to the standard 4D variational assimilation but uses analysis increments instead of the initial condition as the control variable. Results show that assimilating the TMI and SSW rainfall and TPW observations improves not only the precipitation and moisture fields but also key climate parameters such as clouds, the radiation, the upper-tropospheric moisture, and the large-scale circulation in the tropics. In particular, assimilating these data reduce the state-dependent systematic errors in the assimilated products. The improved analysis also provides better initial conditions for short-range forecasts, but the improvements in forecast are less than improvements in the time-averaged assimilation fields, indicating that using these data types is effective in correcting biases and other errors of the forecast model in data assimilation.

Hou, Arthur Y.↗
NASA NTRS2000

Improving Global Reanalyses and Short Range Forecast Using TRMM and SSM/I-Derived Precipitation and Moisture Observations

Global reanalyses currently contain significant errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. The Data Assimilation Office (DAO) at the NASA Goddard Space Flight Center has been exploring the use of tropical rainfall and total precipitable water (TPW) observations from the TRMM Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments to improve short-range forecast and reanalyses. We describe a "1+1"D procedure for assimilating 6-hr averaged rainfall and TPW in the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS). The algorithm is based on a 6-hr time integration of a column version of the GEOS DAS, hence the "1+1"D designation. The scheme minimizes the least-square differences between the observed TPW and rain rates and those produced by the column model over the 6-hr analysis window. This 1+lD scheme, in its generalization to four dimensions, is related to the standard 4D variational assimilation but uses analysis increments instead of the initial condition as the control variable. Results show that assimilating the TMI and SSM/I rainfall and TPW observations improves not only the precipitation and moisture fields but also key climate parameters such as clouds, the radiation, the upper-tropospheric moisture, and the large-scale circulation in the tropics. In particular, assimilating these data reduce the state-dependent systematic errors in the assimilated products. The improved analysis also provides better initial conditions for short-range forecasts, but the improvements in forecast are less than improvements in the time-averaged assimilation fields, indicating that using these data types is effective in correcting biases and other errors of the forecast model in data assimilation.

Hou, Arthur Y.↗
NASA NTRS2014

Estimating Sampling Biases and Measurement Uncertainties of AIRS-AMSU-A Temperature and Water Vapor Observations Using MERRA Reanalysis

We use MERRA (Modern Era Retrospective-Analysis for Research Applications) temperature and water vapor data to estimate the sampling biases of climatologies derived from the AIRS/AMSU-A (Atmospheric Infrared Sounder/Advanced Microwave Sounding Unit-A) suite of instruments. We separate the total sampling bias into temporal and instrumental components. The temporal component is caused by the AIRS/AMSU-A orbit and swath that are not able to sample all of time and space. The instrumental component is caused by scenes that prevent successful retrievals. The temporal sampling biases are generally smaller than the instrumental sampling biases except in regions with large diurnal variations, such as the boundary layer, where the temporal sampling biases of temperature can be +/- 2 K and water vapor can be 10% wet. The instrumental sampling biases are the main contributor to the total sampling biases and are mainly caused by clouds. They are up to 2 K cold and greater than 30% dry over mid-latitude storm tracks and tropical deep convective cloudy regions and up to 20% wet over stratus regions. However, other factors such as surface emissivity and temperature can also influence the instrumental sampling bias over deserts where the biases can be up to 1 K cold and 10% wet. Some instrumental sampling biases can vary seasonally and/or diurnally. We also estimate the combined measurement uncertainties of temperature and water vapor from AIRS/AMSU-A and MERRA by comparing similarly sampled climatologies from both data sets. The measurement differences are often larger than the sampling biases and have longitudinal variations.

MERRA↗
NASA NTRSDate not supplied

Radiative Flux Measurements from ARISE: A Comparison with CERES Top-of-Atmosphere Radiative Fluxes

Uncertainty in top-of-atmosphere (TOA) radiation fluxes observations are larger in the Arctic than in other regions. These uncertainties are due to the low sun angles and the highly reflective, anisotropic, and heterogeneous surface conditions. Quantifying, attributing, and reducing Arctic TOA radiative flux uncertainty enables a better understanding of the rapidly changing Arctic. To advance this goal, we compare the Cloud and Earth’s Radiant Energy System (CERES) TOA radiative fluxes with Arctic Radiation-IceBridge Sea and Ice Experiment (ARISE) campaign measurements collected in September 2014. We compare CERES TOA and aircraft radiative flux measurements using two complementary approaches: grid box average fluxes and instantaneously matched footprints. The grid box mean flux comparison indicates an agreement between CERES and aircraft measurements within 2 uncertainty (calibration and inversion) in the longwave for all five grid boxes and for four-of-five grid boxes in the shortwave; shortwave and longwave mean differences are -7.9 and +2.3 Wm‑2, respectively. The comparison of 36 instantaneously matched footprints with aircraft measurements reveals mean differences of -10.5 and 0.4 Wm‑2 in the shortwave and longwave, respectively. To further explore the persistent negative difference in the shortwave, we further quantify the effects of temporal and spatial sampling differences, angular distribution models, and scene identification to CERES-aircraft differences. Our analysis indicates that sampling differences (including scene evolution) account for an additional 1.8 and 1.7% uncertainty in the shortwave and longwave, respectively and indicates no bias. After accounting for this sampling uncertainty, all CERES-aircraft grid box mean fluxes agree within 2 uncertainty. Scene identification errors due to sea ice concentration data set differences exhibit no bias in the shortwave flux difference and indicate the possibility of substantial differences in the CERES fluxes in specific cases with large spatial heterogeneity. Considering the instantaneously matched footprints, we find that the angular distribution models account may account for up to ‑7.3 Wm-2 of the persistent CERES-aircraft shortwave flux difference due to systematic differences in the anisotropy for sea ice partly cloudy scenes. Additional analysis using a special scan model with the CERES FM2 instrument suggests a significant view zenith angle dependence of the CERES fluxes for sea ice partly cloudy scenes where shortwave fluxes systematically decrease with increasing view zenith angle; no dependence is found for other scene types. We conclude that (1) spatial heterogeneity and scene temporal evolution substantially limit our ability to use aircraft measurements to place strong constraints on CERES TOA fluxes and (2) that the representation of anisotropy in sea ice partly cloudy scenes is a significant factor contributing to the persistent negative CERES-aircraft shortwave flux difference in this comparison and require additional data to analysis fully quantify the potential bias.

Patrick C Taylor↗