Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Can One Satellite Data Set Validation Another? Validation of Envisat SCIAMACHY Data by Comparisons with NOAA-16 SBUV/2 and ERS-2 GOME

Validation of satellite data remains a high priority for the construction of climate data sets. Traditionally ground based measurements have provided the primary comparison data for validation. For some atmospheric parameters such as ozone, a thoroughly validated satellite data record can be used to validate a new instrument s data product in addition to using ground based data. Comparing validated data with new satellite data has several advantages; availability of much more data, which will improve precision, larger geographical coverage, and the footprints are closer in size, which removes uncertainty due to different observed atmospheric volumes. To demonstrate the applicability and some limitations of this technique, observations from the newly launched SCIAMACHY instrument were compared with the NOM-16 SBW/2 and ERS-2 GOME instruments. The SBW/2 data had all ready undergone validation by comparing to the total ozone ground network. Overall the SCIAMACHY data were found to low by 3% with respect to satellite data and 1% low with respect to ground station data. There appears to be seasonal and or solar zenith angle dependences in the comparisons with SBW/2 where differences increase with higher solar zenith angles. It is known that accuracies in both satellite and ground based total ozone algorithms decrease at high solar zenith angles. There is a strong need for more accurate measurement from and the ground under these conditions. At the present time SCIAMACHY data are limited and longer data set with more coverage in both hemispheres is needed to unravel the cause of these differences.

Hilsenrath, E.↗
NASA NTRS1999

NASA Ocean Altimeter Pathfinder Project: Data Set Validation - Report 2

The NOAA/NASA Pathfinder program was created by the Earth Observing System (EOS) Program Office to determine how existing satellite-based data sets can be processed and used to study global change. The data sets are designed to be long time-series data processed with stable calibration and community consensus algorithms to better assist the research community. The Ocean Altimeter Pathfinder Project involves the reprocessing of all altimeter observations with a consistent set of improved algorithms, based on the results from TOPEX/POSEIDON (T/P), into easy-to-use data sets for the oceanographic community for climate research. Details are currently presented in two technical reports: Report# 1: Data Processing Handbook Report #2: Data Set Validation This report describes the validation of the data sets against a global network of high quality tide gauge measurements and provides an estimate of the error budget. The first report describes the processing schemes used to produce the geodetic consistent data set comprised of SEASAT, GEOSAT, ERS-1, TOPEX/ POSEIDON, and ERS-2 satellite observations.

Koblinsky, C. J.↗
NASA NTRS1986

SAGE 2 satellite data set validation

The results of a validation study of data obtained by the Stratospheric Aerosol and Gas Experiment 2 satellite experiment (SAGE 2) are given. Preliminary SAGE 2 data have been available for the period October, 1984 to May, 1985. In addition, the results of two correlative experimental measurement series have been studied in detail, as well as climatological data obtained by other techniques, including ground-based and airborne lidar. The study shows the SAGE 2 data to be of great potential value to studies of the microphyiscs of stratospheric aerosols, the chemistry of trace gases and stratospheric dynamics. A small number of unidentified errors in the current preliminary data set are described. These will be removed from the next version of the data set which is anticipated to be of archival quality.

Kent, G. S.↗
NASA NTRS2008

Atmospheric Correction at AERONET Locations: A New Science and Validation Data Set

This paper describes an AERONET-based Surface Reflectance Validation Network (ASRVN) and its dataset of spectral surface bidirectional reflectance and albedo based on MODIS TERRA and AQUA data. The ASRVN is an operational data collection and processing system. It receives 50x50 square kilometer subsets of MODIS L1B data from MODAPS and AERONET aerosol and water vapor information. Then it performs an accurate atmospheric correction for about 100 AERONET sites based on accurate radiative transfer theory with high quality control of the input data. The ASRVN processing software consists of L1B data gridding algorithm, a new cloud mask algorithm based on a time series analysis, and an atmospheric correction algorithm. The atmospheric correction is achieved by fitting the MODIS top of atmosphere measurements, accumulated for 16-day interval, with theoretical reflectance parameterized in terms of coefficients of the LSRT BRF model. The ASRVN takes several steps to ensure high quality of results: 1) cloud mask algorithm filters opaque clouds; 2) an aerosol filter has been developed to filter residual semi-transparent and sub-pixel clouds, as well as cases with high inhomogeneity of aerosols in the processing area; 3) imposing requirement of consistency of the new solution with previously retrieved BRF and albedo; 4) rapid adjustment of the 16-day retrieval to the surface changes using the last day of measurements; and 5) development of seasonal back-up spectral BRF database to increase data coverage. The ASRVN provides a gapless or near-gapless coverage for the processing area. The gaps, caused by clouds, are filled most naturally with the latest solution for a given pixels. The ASRVN products include three parameters of LSRT model (k(sup L), k(sup G), k(sup V)), surface albedo, NBRF (a normalized BRF computed for a standard viewing geometry, VZA=0 deg., SZA=45 deg.), and IBRF (instantaneous, or one angle, BRF value derived from the last day of MODIS measurement for specific viewing geometry) for MODIS 500m bands 1-7. The results are produced daily at resolution of 1 km in gridded format. We also provide cloud mask, quality flag and a browse bitmap image. The new dataset can be used for a wide range of applications including validation analysis and science research.

Wang, Yujie↗
NASA NTRS1993

Data management for support of the Oregon Transect Ecosystem Research (OTTER) project

Management of data collected during projects that involve large numbers of scientists is an often overlooked aspect of the experimental plan. Ecosystem science projects like the Oregon Transect Ecosystem Research (OTTER) Project that involve many investigators from many institutions and that run for multiple years, collect and archive large amounts of data. These data range in size from a few kilobytes of information for such measurements as canopy chemistry and meteorological variables, to hundreds of megabytes of information for such items as views from multi-band spectrometers flown on aircraft and scenes from imaging radiometers aboard satellites. Organizing and storing data from the OTTER Project, certifying those data, correcting errors in data sets, validating the data, and distributing those data to other OTTER investigators is a major undertaking. Using the National Aeronautics and Space Administration's (NASA) Pilot Land Data System (PLDS), a Support mechanism was established for the OTTER Project which accomplished all of the above. At the onset of the interaction between PLDS and OTTER, it was not certain that PLDS could accomplish these tasks in a manner that would aid researchers in the OTTER Project. This paper documents the data types that were collected under the auspices of the OTTER Project and the procedures implemented to store, catalog, validate, and certify those data. The issues of the compliance of investigators with data-management requirements, data use and certification, and the ease of retrieving data are discussed. We advance the hypothesis that formal data management is necessary in ecological investigations involving multiple investigators using many data gathering instruments and experimental procedures. The issues and experience gained in this exercise give an indication of the needs for data management systems that must be addressed in the coming decades when other large data-gathering endeavors are undertaken by the ecological science community.

Skiles, J. W.↗
NASA NTRS2001

Collection of LAI and FPAR Data Over The Terra Core Sites

The objective of our effort was to collect and archive data on LAI (leaf area index) and FPAR (Fraction of Photosynthetically active Radiation absorbed by vegetation) at the EOS Core validation sites as well as to validate and evaluate global fields of LAI and FPAR derived from atmospherically corrected MODIS (Moderate Resolution Imaging Spectrometer) surface reflectance data by comparing these fields with the EOS Core validation data set. The above has been accomplished by: (a) the participation in selected field campaigns within the EOS Validation Program; (b) the processing of the collected data so that suitable comparison between field measurements and the MODIS LAI/FPAR fields can be made; (c) the comparison of the MODAS LAI/FRAM fields with the EOS Terra Core validation data set.

Myneni, Ranga B.↗
NASA NTRS1995

Calculation of surface and top of atmosphere radiative fluxes from physical quantities based on ISCCP data sets. 2: Validation and first results

We use global, multiyear observations of the properties of clouds, the atmosphere, and the surface to calculate global shortwave (SW) and longwave (LW) fluxes at the top of the atmosphere and at the surface at a resolution of 280 km and 3 hours for every third month from April 1985 to January 1989. Our validation studies suggest that the specification of cloud effects is no longer the dominant uncertainty in reconstructing the radiative fluxes at the top of atmosphere and at the surface. Rather cloud property uncertainties are now roughly equal contributors to the flux uncertainty, along with surface and atmospheric properties. The resulting SW and LW flux data sets suggest the following conclusions: (1) The net SW heating of Earth appears predominantly at the surface, whereas the net LW cooling arises predominantly from the atmosphere. The net cooling effect of clouds on top of atmospheric radiation appears primarily at the surface rather than in the atmosphere. (2) Clouds have almost no net effect on the global mean radiation balance of the atmosphere, but they enhance the latitudinal gradient in the LW cooling and reinforce the radiative forcing for the mean atmospheric circulation. Clouds act to mute seasonal contrasts however. (3) Clouds enhance the land-ocean contrasts of the atmospheric cooling, reinforcing the growth of standing eddy motions; but reduce land-ocean contrasts of the surface heating.

Rossow, W. B.↗
NASA NTRS1992

Validating a large geophysical data set: Experiences with satellite-derived cloud parameters

We are validating the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and are using the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The data handling needed for this work is possible only with the help of a suite of interactive graphical and numerical analysis tools. Level 3 (gridded) data is the common form in which large data sets of this type are distributed for scientific analysis. We find that Level 3 data is inadequate for the data comparisons required for validation. Level 2 data (individual measurements in geophysical units) is needed. A sampling problem arises when individual measurements, which are not uniformly distributed in space or time, are used for the comparisons. Standard 'interpolation' methods involve fitting the measurements for each data set to surfaces, which are then compared. We are experimenting with formal criteria for selecting geographical regions, based upon the spatial frequency and variability of measurements, that allow us to quantify the uncertainty due to sampling. As part of this project, we are also dealing with ways to keep track of constraints placed on the output by assumptions made in the computer code. The need to work with Level 2 data introduces a number of other data handling issues, such as accessing data files across machine types, meeting large data storage requirements, accessing other validated data sets, processing speed and throughput for interactive graphical work, and problems relating to graphical interfaces.

Kahn, Ralph↗
NASA NTRS2003

Refinement of Protocols for Measuring the Apparent Optical Properties of Seawater

Ocean color satellite missions, like the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) or the Moderate Resolution Imaging Spectroradiometer (MODIS) projects, are tasked with acquiring a global ocean color data set, validating and monitoring the accuracy and quality of the data, processing the radiometric data into geophysical units using a set of atmospheric and bio-optical algorithms, and distributing the final products to the scientific community. The long-standing requirement of the SeaWiFS Project, for example, is to produce spectral water-leaving radiances, LW(lambda), to within 5% absolute (lambda denotes wavelength) and chlorophyll a concentrations to within 35% (Hooker and Esaias 1993), and most ocean color sensors have the same or similar requirements. Although a diverse set of activities are required to ensure the accuracy requirements are met (Hooker and McClain 2000), the perspective here is with field observations. The accurate determination of upper ocean apparent optical properties (AOPs) is essential for the vicarious calibration of ocean color data and the validation of the derived data products, because the sea-truth measurements are used to evaluate the satellite observations (Hooker and McClain 2000). The uncertainties with in situ AOP measurements have various sources: a) the sampling procedures used in the field, including the environmental conditions encountered; b) the absolute characterization of the radiometers in the laboratory; c) the conversion of the light signals to geophysical units in a processing scheme, and d) the stability of the radiometers in the harsh environment they are subjected to during transport and use. Assuming ideal environmental conditions, so this aspect can be neglected, the SeaWiFS ground-truth uncertainty budget can only be satisfied if each uncertainty is on the order of 1-2%, or what is generally referred to as 1% radiometry. In recent years, progress has been made in estimating the magnitude of some of these uncertainties and in defining procedures for minimizing them. For the SeaWiFS Project, the first step was to convene a workshop to draft the SeaWiFS Ocean Optics Protocols (hereafter referred to as the Protocols). The Protocols initially adhered to the Joint Global Ocean Flux Study (JGOFS) sampling procedures (JGOFS 1991) and defined the standards for optical measurements to be used in SeaWiFS calibration and validation activities (Mueller and Austin 1992). Over time, the Protocols were revised (Mueller and Austin 1995), and then recurringly updated on essentially an annual basis (Mueller 2000, 2002, and 2003) as part of the Sensor Inter-comparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project. 98

Hooker, Stanford B.↗
NASA NTRS2014

Observations on CFD Verification and Validation from the AIAA Drag Prediction Workshops

The authors provide observations from the AIAA Drag Prediction Workshops that have spanned over a decade and from a recent validation experiment at NASA Langley. These workshops provide an assessment of the predictive capability of forces and moments, focused on drag, for transonic transports. It is very difficult to manage the consistency of results in a workshop setting to perform verification and validation at the scientific level, but it may be sufficient to assess it at the level of practice. Observations thus far: 1) due to simplifications in the workshop test cases, wind tunnel data are not necessarily the “correct” results that CFD should match, 2) an average of core CFD data are not necessarily a better estimate of the true solution as it is merely an average of other solutions and has many coupled sources of variation, 3) outlier solutions should be investigated and understood, and 4) the DPW series does not have the systematic build up and definition on both the computational and experimental side that is required for detailed verification and validation. Several observations regarding the importance of the grid, effects of physical modeling, benefits of open forums, and guidance for validation experiments are discussed. The increased variation in results when predicting regions of flow separation and increased variation due to interaction effects, e.g., fuselage and horizontal tail, point out the need for validation data sets for these important flow phenomena. Experiences with a recent validation experiment at NASA Langley are included to provide guidance on validation experiments.

Computational Fluid Dynamics↗
NASA NTRS1988

Cloud cover determination in polar regions from satellite imagery

The principal objectives of this project are: to develop suitable validation data sets to evaluate the effectiveness of the ISCCP operational algorithm for cloud retrieval in polar regions and to validate model simulations of polar cloud cover; to identify limitations of current procedures for varying atmospheric surface conditions, and to explore potential means to remedy them using textural classifiers: and to compare synoptic cloud data from a control run experiment of the Goddard Institute for Space Studies (GISS) climate model 2 with typical observed synoptic cloud patterns. Current investigations underway are listed and the progress made to date is summarized.

Barry, R. G.↗
NASA NTRS2010

Comparing Spray Characteristics from Reynolds Averaged Navier-Stokes (RANS) National Combustion Code (NCC) Calculations Against Experimental Data for a Turbulent Reacting Flow

Developing physics-based tools to aid in reducing harmful combustion emissions, like Nitrogen Oxides (NOx), Carbon Monoxide (CO), Unburnt Hydrocarbons (UHC s), and Sulfur Dioxides (SOx), is an important goal of aeronautics research at NASA. As part of that effort, NASA Glenn Research Center is performing a detailed assessment and validation of an in-house combustion CFD code known as the National Combustion Code (NCC) for turbulent reacting flows. To assess the current capabilities of NCC for simulating turbulent reacting flows with liquid jet fuel injection, a set of Single Swirler Lean Direct Injection (LDI) experiments performed at the University of Cincinnati was chosen as an initial validation data set. This Jet-A/air combustion experiment operates at a lean equivalence ratio of 0.75 at atmospheric pressure and has a 4 percent static pressure drop across the swirler. Detailed comparisons of NCC predictions for gas temperature and gaseous emissions (CO and NOx) against this experiment are considered in a previous work. The current paper is focused on detailed comparisons of the spray characteristics (radial profiles of drop size distribution and at several radial rakes) from NCC simulations against the experimental data. Comparisons against experimental data show that the use of the correlation for primary spray break-up implemented by Raju in the NCC produces most realistic results, but this result needs to be improved. Given the single or ten step chemical kinetics models, use of a spray size correlation gives similar, acceptable results

Iannetti, Anthony C.↗
NASA NTRS1988

Cloud cover determination in polar regions from satellite imagery

The principal objectives of this project are: (1) to develop suitable validation data sets to evaluate the effectiveness of the International Satellite Cloud Climatology Project (ISCCP) operational algorithm for cloud retrieval in polar regions and to validate model simulations of polar cloud cover; (2) to identify limitations of current procedures for varying atmospheric surface conditions, and to explore potential means to remedy them using textural classifiers; and (3) to compare synoptic cloud data from a control run experiment of the GISS climate model II with typical observed synoptic cloud patterns.

Barry, R. G.↗
NASA NTRS2021

T0TEM - T0 Test Evaluation Module Development and Verification

Transition temperature testing of ferritic steels evaluates the ductile to brittle transition temperature, where the behavior of the steel changes from controlled ductile tearing to uncontrollable brittle fracture. This testing is governed by ASTM (American Society of Testing and Materials) E1921 standard. The calculations and plots required by this standard are iterative in nature and require significant effort to produce by standard hand calculations. In addition to analysis of a complete data set, intermediate analysis during testing is beneficial to determine optimal test temperatures. Given the exhaustive nature of calculating the transition temperature, being able to quickly update target temperatures is a significant benefit to not only the quality of tests, but the number of required tests as well. T0 Test Evaluation Module (T0TEM) v1.5 is a software application created under the Layered Pressure Vessel (LPV) certification effort. To reduce the analysis time of transition temperature test data sets producedfor this effort, T0TEM was created to calculate the E1921 Master Curve along with all required data and validity checks. By creating this program, hundreds of hours of analysis time were saved. In addition, the creation of a standard program provided a significant improvement in the consistency with which results were reported. T0TEM also calculates the results and plots required for the E1921 inhomogeneity annex to determine whether a material behaves in a homogenous manner. This program was created by Levi Shelton and Cameron Bosley at NASA, with input and review from the E1921 committee. The results generated by T0TEM were compared to the validation data sets provided by ASTM with good concurrence. ASTM committee members have reviewed and applied T0TEM to other data sets with satisfactory results. T0TEM was originally released to the NASA Software Repository and publicly via SourceForge in May of 2020. Version 1.5 was released in April of 2021 with minor functionality updates and additional statistical analysis methods.

Levi Shelton↗
NASA NTRS2018

Improved Hydrology over Peatlands in a Global Land Modeling System

Peatlands of the Northern Hemisphere represent an important carbon pool that mainly accumulated since the last ice age under permanently wet conditions in specific geological and climatic settings. The carbon balance of peatlands is closely coupled to water table dynamics. Consequently, the future carbon balance over peatlands is strongly dependent on how hydrology in peatlands will react to changing boundary conditions, e.g. due to climate change or regional water level drawdown of connected aquifers or streams. Global land surface modeling over organic-rich regions can provide valuable global-scale insights on where and how peatlands are in transition due to changing boundary conditions. However, the current global land surface models are not able to reproduce typical hydrological dynamics in peatlands well. We implemented specific structural and parametric changes to account for key hydrological characteristics of peatlands into NASA's GEOS-5 Catchment Land Surface Model (CLSM, Koster et al. 2000). The main modifications pertain to the modeling of partial inundation, and the definition of peatland-specific runoff and evapotranspiration schemes. We ran a set of simulations on a high performance cluster using different CLSM configurations and validated the results with a newly compiled global in-situ dataset of water table depths in peatlands. The results demonstrate that an update of soil hydraulic properties for peat soils alone does not improve the performance of CLSM over peatlands. However, structural model changes for peatlands are able to improve the skill metrics for water table depth. The validation results for the water table depth indicate a reduction of the bias from 2.5 to 0.2 m, and an improvement of the temporal correlation coefficient from 0.5 to 0.65, and from 0.4 to 0.55 for the anomalies. Our validation data set includes both bogs (rain-fed) and fens (ground and/or surface water influence) and reveals that the metrics improved less for fens. In addition, a comparison of evapotranspiration and soil moisture estimates over peatlands will be presented, albeit only with limited ground-based validation data. We will discuss strengths and weaknesses of the new model by focusing on time series of specific validation sites.

Bechtold, M.↗
NASA NTRS1978

NASA and the U.S. climate program - A problem in data management

NASA's contribution to the total data base for the National Climate Plan will be to produce climate data sets from its experimental space observing systems and to maximize the value of these data for climate analysis and prediction. Validated data sets will be provided to NOAA for inclusion into their overall diagnostic data base. NASA data management for the Climate Plan will involve: (1) cataloging and retrieval of large integrated and distributed data sets upon user demand, and (2) the storage equivalent of 100,000 digital data tapes. It will be the largest, most complex data system ever developed by NASA

Quann, J. J.↗
NASA NTRSDate not supplied

Assessment of Coupling One-Dimension and Three-Dimension CFD in Conjugate Heat Transfer Modeling and Simulations for Cooling of Turbine Engine

The CHT (conjugate heat transfer) modeling and simulation work fits under a bigger area in the TTT (Transformational Tools and Technologies) project called “Cooling Tools and Technologies for Combustor and Turbine.” The existing validation data sets such as TTT GRC (Glenn Research Center) THX (Turbulent Heat FLUX) IV experiments will be used to assess the solid/fluid heat transfer development and validation. The experimental configuration was a subsonic convergent nozzle with a square exit blowing a heated exhaust over an effusion-cooled deck. The simulation solutions were obtained and compared to experimental measurements of the profiles of flow velocities and temperatures, as well as deck surface temperatures. Cooling air blowing ratios of 0, 1, and 2 were considered. The three-dimensional cooling tubes were modelled by the medial axis of the cylindrical geometries due to large length over width ratios. It represented a typical coupling of one-dimension and three-dimension simulations of conjugate heat transfer approaches. The surface temperatures on the solid surfaces and the profiles of velocities and temperatures near the surfaces compared to the experimental data were presented.

nonlinear sub-filter stresses↗