SEARCH · Engineering Papers

Results for “validation data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2007

Comparisons of Instantaneous TRMM Ground Validation and Satellite Rain Rate Estimates at Different Spatial Scales

This study provides a comprehensive inter-comparison of instantaneous rain estimates from the two rain sensors aboard the TRMM satellite with ground data from thee designated Ground Validation Sites: Kwajalein Atoll, Melbourne, Florida and Houston, Texas. The satellite rain retrievals utilize rain observations collected by the TRMM microwave imager (TMI) and the Precipitation Radar (PR) aboard the TRMM satellite. Three standard instantaneous rain products are the generated from the rain information retrieved from the satellite using the TMI, PR and Combined (COM) rain algorithms. The validation data set used in this study was obtained from instantaneous rain rates inferred from ground radars at each GV site. The first comparison used 0.5(sup 0) x 0.5(sup 0) gridded data obtained from the TRMM 3668 product, and similarly gridded GV data obtained from ground-based radars. The comparisons were made at the same spatial and temporal scales in order to eliminate sampling biases in our comparisons. An additional comparison was made by averaging rain rates for the PR, COM and GV estimates within each TMI footprint (approx. 150 square kilometers). For this analysis, unconditional mean rain rates from PR, COM and GV estimates were calculated within each TMI footprint that was observed within 100 km from the respective GV site (and also observed by the PR). This analysis used all the available matching data from the period 1999-2004, representing a sample size of over 50,000 footprints for each site. In the first analysis our results showed that all of the respective rain rate estimates agree well, with some exceptions. The more salient differences were associated with heavy rain events in which one or more of the algorithms failed to properly retrieve these extreme events. Also, it appears that there is a preferred mode of precipitation for TMI rain rates at or near 2 mm per hour over the ocean. This mode was noted over ocean areas of Melbourne, Florida and Kwajalein, Republic of the Marshall Islands, and is shown to exist in TRMM tropical-global ocean areas as well. Further research by algorithm developers is needed to explain or justify the seemingly errant observed probability distributions.

Wolff, David B.↗

NASA NTRS2008

New Developments for Physically-based Falling Snow Retrievals over Land in Preparation for GPM

The NASA Global Precipitation Measurement mission (GPM) concept centers on deploying a Core spacecraft carrying a dual-frequency precipitation radar and a microwave radiometric imager with channels from 10 to 183 GHz to serve as a precipitation physics observatory and a calibration reference to unify a constellation of dedicated and operational passive microwave sensors. Because of the extended orbit of the Core (plus or minus 65 deg) and the enhanced dual frequency radar and high frequency radiometer, GPM will be able to sense falling snow precipitation and light rain over land. Accordingly, GPM has partnered with the Canadian CloudSat/CALIPSO Validation Project (C3VP) to obtain observations to provide one of several important ground-based validation data sets around which the falling snow models and retrieval algorithms can be further developed and tested. In this work we compare and correlate the long time series (Nov.'06 - March '07) measurements of precipitation rate from parsivels to the passive (89, 150, 183 plus or minus 1, plus or minus 3, plus or minus 7 GHz) observations of NOAA's AMSU-B radiometer. We separate the comparisons into categories of no precipitation, liquid rain and falling snow precipitation. We found that there are similar TBs (especially at 89 and 150 GHz) for cases with falling snow and for non-precipitating cases. The comparisons indicate that surface emissivity contributions to the satellite observed TB over land can add uncertainty in detecting and estimating falling snow. The newest results show that by computing brightness temperatures based on CARE radiosonde data and a rough estimate of surface emissivity show that the cloud ice scattering signal in the AMSU-B data is detected. That is the differences in computed TB and AMSU-B TB for precipitating and non-precipitating cases are unique such that the precipitating and non-precipitating cases can be identified. These results require that the radiosonde releases are within an hour of the AMSU-B data. Forest fraction, snow cover, and measured emissivities were combined to calculate the surface emissivities.

Jackson, Gail S.↗

NASA NTRS2009

2-D Circulation Control Airfoil Benchmark Experiments Intended for CFD Code Validation

A current NASA Research Announcement (NRA) project being conducted by Georgia Tech Research Institute (GTRI) personnel and NASA collaborators includes the development of Circulation Control (CC) blown airfoils to improve subsonic aircraft high-lift and cruise performance. The emphasis of this program is the development of CC active flow control concepts for both high-lift augmentation, drag control, and cruise efficiency. A collaboration in this project includes work by NASA research engineers, whereas CFD validation and flow physics experimental research are part of NASA s systematic approach to developing design and optimization tools for CC applications to fixed-wing aircraft. The design space for CESTOL type aircraft is focusing on geometries that depend on advanced flow control technologies that include Circulation Control aerodynamics. The ability to consistently predict advanced aircraft performance requires improvements in design tools to include these advanced concepts. Validation of these tools will be based on experimental methods applied to complex flows that go beyond conventional aircraft modeling techniques. This paper focuses on recent/ongoing benchmark high-lift experiments and CFD efforts intended to provide 2-D CFD validation data sets related to NASA s Cruise Efficient Short Take Off and Landing (CESTOL) study. Both the experimental data and related CFD predictions are discussed.

Englar, Robert J.↗

NASA NTRS2014

Oceanic Storm Characteristics Off the Kennedy Space Center Coast

Natural cloud-to-ground lightning may behave differently depending on the characteristics of the attachment mediums, including the peak current (inferred from radiation fields) and the number of ground strike locations per flash. Existing literature has raised issues over the yea"rs on the behavior of lightning over ocean terrain and these phenomena are not yet well understood. To investigate lightning characteristics over differing terrain we will obtain identical observations over adjacent land and ocean regions during both clear air and thunderstorm periods comparing the electric field behavior over these various terrains. For this, a 3-meter NOAA buoy moored 20NM off the coast of the Kennedy Space Center was instrumented with an electric field mill and New Mexico Tech's slow antenna to measure the electric fields aloft and compared to the existing on-shore electric field mill suite of 31 sensors and a coastal slow antenna. New Mexico Tech's Lightning Mapping Array and the Eastern Range Cloud-to-Ground Lightning Surveillance System, along with the network of high-speed cameras being used to capture cloud-to-ground lightning strikes over the terrain regions to identify a valid data set and verify the electric fields. This is an on-going project with the potential for significant impact on the determination of lightning risk to objects on the ground. This presentation will provide results and instrumentation progress to date.

Wilson, J.↗

NASA NTRS2014

Oceanic Storm Characteristics off the Kennedy Space Center Coast

Natural cloud-to-ground lightning may behave differently depending on the characteristics of the attachment mediums, including the peak current (inferred from radiation fields) and the number of ground strike locations per flash. Existing literature has raised questions over the years on these characteristics of lightning over oceans, and the behaviors are not yet well understood. To investigate this we will obtain identical electric field observations over adjacent land and ocean regions during both clear air and thunderstorm periods. Oceanic observations will be obtained using a 3-meter NOAA buoy that has been instrumented with a Campbell Scientific electric field mill and New Mexico Techs slow antenna, to measure the electric fields aloft. We are currently obtaining measurements from this system on-shore at the Florida coast, to calibrate and better understand the behavior of the system in elevated-field environments. Sometime during winter 2013, this system will be moored 20NM off the coast of the Kennedy Space Center. Measurements from this system will be compared to the existing on-shore electric field mill suite of 31 sensors and a coastal slow antenna. Supporting observations will be provided by New Mexico Techs Lightning Mapping Array, the Eastern Range Cloud to Ground Lightning Surveillance System, and the National Lightning Detection Network. An existing network of high-speed cameras will be used to capture cloud-to-ground lightning strikes over the terrain regions to identify a valid data set for analysis. This on-going project will demonstrate the value of off-shore electric field measurements for safety-related decision making at KSC, and may improve our understanding of relative lightning risk to objects on the ground vs. ocean. This presentation will provide an overview of this new instrumentation, and a summary of our progress to date.

Ocean↗

NASA NTRS2015

Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS)

The Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) mission will extend the SAGE data record from the ideal vantage point of the International Space Station (ISS). The ISS orbital inclination is ideal for SAGE measurements providing coverage between 70 deg north and 70 deg south latitude. The SAGE data record includes an extensively validated data set including aerosol optical depth data dating to the Stratospheric Aerosol Measurement (SAM) experiments in 1975 and 1978 and stratospheric ozone profile data dating to the Stratospheric Aerosol and Gas Experiment (SAGE) in 1979. These and subsequent data records, notably from the SAGE II experiment launched on the Earth Radiation Budget Satellite in 1984 and the SAGE III experiment launched on the Russian Meteor-3M satellite in 2001, have supported a robust, long-term assessment of key atmospheric constituents. These scientific measurements provide the basis for the analysis of five of the nine critical constituents (aerosols, ozone (O3), nitrogen dioxide (NO2), water vapor (H2O), and air density using O2) identified in the U.S. National Plan for Stratospheric Monitoring. SAGE III on ISS was originally scheduled to fly on the ISS in the same timeframe as the Meteor-3M mission, but was postponed due to delays in ISS construction. The project was re-established in 2009.

Gasbarre, Joseph↗

NASA NTRS2016

Active Learning with Rationales for Identifying Operationally Significant Anomalies in Aviation

A major focus of the commercial aviation community is discovery of unknown safety events in flight operations data. Data-driven unsupervised anomaly detection methods are better at capturing unknown safety events compared to rule-based methods which only look for known violations. However, not all statistical anomalies that are discovered by these unsupervised anomaly detection methods are operationally significant (e.g., represent a safety concern). Subject Matter Experts (SMEs) have to spend significant time reviewing these statistical anomalies individually to identify a few operationally significant ones. In this paper we propose an active learning algorithm that incorporates SME feedback in the form of rationales to build a classifier that can distinguish between uninteresting and operationally significant anomalies. Experimental evaluation on real aviation data shows that our approach improves detection of operationally significant events by as much as 75% compared to the state-of-the-art. The learnt classifier also generalizes well to additional validation data sets.

anomaly detection↗

NASA NTRS2021

A Machine Learning Approach to Objective Identification of Dust in Satellite Imagery

Airborne dust has broad adverse effects on human activity, including aviation, human health, and agriculture. Remote sensing observations are used to detect dust and aerosols in the atmosphere using long established techniques. False color Red-Green-Blue (RGB) imagery using band differences sensitive to dust absorption (Dust RGB) is currently used operationally to assist forecasters and decision-makers in identifying dust at night, but there are still limitations, subjectivity, and nuances to image interpretation making night-time dust identification difficult even for experts. This study applies machine learning to the problem of night-time dust detection with a simple random forest (RF) model using Geostationary Operational Environmental Satellite-16 (GOES-16) Advanced Baseline Imager (ABI) infrared imagery, band differences sensitive to dust absorption, and Dust RGB color components as inputs to the model. The RF model achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels and 99.96% of no-dust pixels for all dust images in the validation data set. The addition of a single null case to the training data set drastically reduces error in labeling no-dust pixels as dust from 45% to 14.5%. Application of the machine learning model to the April 13–14, 2019 dust event demonstrates the ability of the model to identify dust during night-time hours when visual dust detection is limited by the cooling ground surface characteristics.

dust↗

NASA NTRS2018

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

NASA NTRSDate not supplied

Development and Application of NASA SPoRT’s DustTracker-AI Model for Real-Time Identification and Tracking of Dust in Geostationary Satellite Imagery

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed the DustTracker-AI model for identifying and tracking dust in NASA/NOAA Geostationary Operational Environmental Satellite (GOES) imagery in a real-time framework. A training dataset consisting of day and night dust cases was gathered over the southwestern consisting of 115 distinct images and over a million dust pixels and 256 million no dust pixels. The dataset was separated into training (60%), testing (20%), and validation (20%). A simple random forest machine learning model was developed originally to overcome the problem of night-time dust detection and has been expanded to a comprehensive day/night model for dust identification and tracking. This physically-based machine-learning approach uses NASA/NOAA GOES-16 Advanced Baseline Imager infrared imagery as inputs to the model. The model probability of dust output achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels for all dust images in the validation data set. In conjunction with developing the machine-learning model, the NASA Short-term Prediction Research and Transition Center (SPoRT) partnered with NOAA National Weather Service forecast offices to evaluate the model for utility in weather forecasting operations during the 2021 and 2023 late winter-spring seasons. Preliminary evaluation has indicated the majority of forecasters described the DustTracker-AI probabilities as having added confidence to interpreting the Dust RGB and other satellite products to objectively assess the dust extent and trends and increased the amount of time the dust plume could be tracked into the night as compared to use of the Dust RGB. More recently, SPoRT tested small scale events associated with thunderstorm outflow and burn scars to determine the model’s ability to capture local events. This presentation highlights design of the model, validation/evaluation of model performance, and example cases collected during end user product assessments.

Connor H Welch↗

DOE OSTI2024

Statistical Validation of Multiple Related Data Sets—Case Study Using Interstellar Boundary Explorer Satellite Data

Abstract Space scientists often face the question of whether data collected by different instruments are measurements of the same source population. This paper proposes a statistical validation method for evaluating the agreement between such related data sets. It offers a detailed case study focused on validating a new data set from the Interstellar Boundary Explorer (IBEX) mission, which serves as a practical how-to guide for similar analyses. Since 2008, the IBEX satellite has been gathering data on heliospheric energetic neutral atoms (ENAs) while being exposed to various sources of background noise, such as cosmic rays and solar energetic particles. The IBEX mission initially released only a qualified triple-coincidence (qABC) data product, which was designed to provide observations of ENAs free of background contamination. Further measurements revealed that the qABC data were in fact susceptible to contamination, having relatively low ENA counts and high background rates. To mitigate this issue, the mission team recently considered releasing a certain qualified double-coincidence (qBC) data product, which has roughly twice the detection rate of the qABC data product. This paper presents a simulation-based validation of the new qBC data product against the already-released qABC data product. The results show that the qBCs can plausibly be said to be measuring the same source population as the qABCs up to an average absolute deviation of 3.6%. Visual diagnostics provide additional confirmation of source rate coherence across data products. The framework introduced here is general and can be applied to other validation problems both within and outside the field of space physics.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1980

NASA TLA workload analysis support. Volume 2: Metering and spacing studies validation data

Four sets of graphic reports--one for each of the metering and spacing scenarios--are presented. The complete data file from which the reports were generated is also given. The data was used to validate the detail task of both the pilot and copilot for four metering and spacing scenarios. The output presents two measures of demand workload and a report showing task length and task interaction.

Sundstrom, J. L.↗

NASA NTRS1991

Validating a large geophysical data set - Experiences with satellite-derived cloud parameters

The goal of this study is to validate the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and to use the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The need to work with Level 2 (point) data, rather than Level 3 (gridded) data for validation purposes is discussed, and some techniques developed for charting the assumptions made in deriving an algorithm and generating a code to produce geophysical quantities from measured radiances are presented.

Kahn, Ralph↗

NASA NTRS2006

The Use of RGPS Kinematic Data to Estimate Nonlinear Sea Ice Motion

In current simulations of the interaction between sea ice and its environment, large significance is placed on the deformation of the sea ice. Sea ice deformation is an important process in determining the sea ice thickness distribution across a wide range of space and time scales. Changes in the sea ice thickness distribution affect energy and mass fluxes between the atmosphere and ocean and also the strength of the ice. While most current ice models assume linear variation in the ice motion field to calculate strain, deformation of sea ice occurs through the opening, closing and shearing of ice along discrete linear features. New numerical models are being developed which explicitly account for discontinuities in ice motion, and the need for requisite data sets for model validation has emerged. Multiple buoy data sets, as well as satellite data, have been used to examine the movement and deformation of sea ice. Generally it has been found that the ice motion field has been represented well by buoy data, as well as satellite data over a broad range of scales. However, the underlying deformation (spatial variation in displacement) as represented by different data sets may vary. For the work presented here, sea ice motion In current simulations of the interaction between sea ice and its environment, large significance is placed on the deformation of the sea ice. Sea ice deformation is an important process in determining the sea ice thickness distribution across a wide range of space and time scales. Changes in the sea ice thickness distribution affect energy and mass fluxes between the atmosphere and ocean and also the strength of the ice. While most current ice models assume linear variation in the ice motion field to calculate strain, deformation of sea ice occurs through the opening, closing and shearing of ice along discrete linear features. New numerical models are being developed which explicitly account for discontinuities in ice motion, and the need for requisite data sets for model validation has emerged. Multiple buoy data sets, as well as satellite data, have been used to examine the movement and deformation of sea ice. Generally it has been found that the ice motion field has been represented well by buoy data, as well as satellite data over a broad range of scales. However, the underlying deformation (spatial variation in displacement) as represented by different data sets may vary. For the work presented here, sea ice motio

Pruis, M.↗

NASA NTRS2012

First Assessments of Predicted ICESat-2 Performance Using Aircraft Data

The Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) is a next-generation laser altimeter designed to continue key observations of ice sheet elevation change, sea ice freeboard, vegetation canopy height, earth surface elevation, and sea surface height. Scheduled for launch in mid-2016, ICESat-2 will use a high repetition rate (10 kHz), small footprint (10 m nominal ground diameter) laser, and a single-photon-sensitive detection strategy (photon counting) to measure precise range to the earth's surface. Using green light (532 nm), the six beams of ICESat-2 will provide improved spatial coverage compared with the single beam of ICESat, while the differences in transmit energy among the beams provide a large dynamic range. The six beams are arranged into three pairs of beams which allow slopes to measured on an orbit-by-orbit basis. In order to evaluate models of predicted ICESat-2 performance and provide ICESat-2-like data for algorithm development, an airborne ICESat-2 simulator was developed and first flown in 2010. This simulator, the Multiple Altimeter Beam Experimental Lidar (MABEL) was most recently deployed to Iceland in April 2012 and collected approx 85 hours of science data over land ice, sea ice, and calibration targets. MABEL uses a similar photon-counting measurement strategy to what will be used on ICESat-2. MABEL collects data in 16 green channels and an additional 8 channels in the infrared aligned across the direction of flight. By using NASA's ER-2 aircraft flying at 20km altitude, MABEL flies as close to space as is practical, and collects data through approx 95% of the atmosphere. We present background on the MABEL instrument, and data from the April 2012 deployment to Iceland. Among the 13 MABEL flights, we collected data over the Greenland ice sheet interior and outlet glaciers in the southwest and western Greenland, sea ice data over the Nares Strait and Greenland Sea, and a number of small glaciers and ice caps in Iceland and Svalbard. Several of the flights were coincident in time and space with NASA's Operation IceBridge, which provides an independent data set for validation. MABEL also collected data along CryoSat track 10482 in north central Greenland approximately one month after CryoSat passed overhead.

Neumann, Thomas↗

NASA NTRS1999

Validation of Satellite Retrieved Land Surface Variables

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Lakshmi, Venkataraman↗

NASA NTRS1999

Validation of Satellite Retrieved Land Surface Variables

Lakshmi, Venkataraman↗

NASA NTRS2010

Utilization of Airborne and in Situ Data Obtained in SGP99, SMEX02, CLASIC and SMAPVEX08 Field Campaigns for SMAP Soil Moisture Algorithm Development and Validation

Field experiment data sets that include coincident remote sensing measurements and in situ sampling will be valuable in the development and validation of the soil moisture algorithms of the NASA's future SMAP (Soil Moisture Active and Passive) mission. This paper presents an overview of the field experiment data collected from SGP99, SMEX02, CLASIC and SMAPVEX08 campaigns. Common in these campaigns were observations of the airborne PALS (Passive and Active L- and S-band) instrument, which was developed to acquire radar and radiometer measurements at low frequencies. The combined set of the PALS measurements and ground truth obtained from all these campaigns was under study. The investigation shows that the data set contains a range of soil moisture values collected under a limited number of conditions. The quality of both PALS and ground truth data meets the needs of the SMAP algorithm development and validation. The data set has already made significant impact on the science behind SMAP mission. The areas where complementing of the data would be most beneficial are also discussed.

Soil moisture↗