Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Observations on CFD Verification and Validation from the AIAA Drag Prediction Workshops

The authors provide observations from the AIAA Drag Prediction Workshops that have spanned over a decade and from a recent validation experiment at NASA Langley. These workshops provide an assessment of the predictive capability of forces and moments, focused on drag, for transonic transports. It is very difficult to manage the consistency of results in a workshop setting to perform verification and validation at the scientific level, but it may be sufficient to assess it at the level of practice. Observations thus far: 1) due to simplifications in the workshop test cases, wind tunnel data are not necessarily the “correct” results that CFD should match, 2) an average of core CFD data are not necessarily a better estimate of the true solution as it is merely an average of other solutions and has many coupled sources of variation, 3) outlier solutions should be investigated and understood, and 4) the DPW series does not have the systematic build up and definition on both the computational and experimental side that is required for detailed verification and validation. Several observations regarding the importance of the grid, effects of physical modeling, benefits of open forums, and guidance for validation experiments are discussed. The increased variation in results when predicting regions of flow separation and increased variation due to interaction effects, e.g., fuselage and horizontal tail, point out the need for validation data sets for these important flow phenomena. Experiences with a recent validation experiment at NASA Langley are included to provide guidance on validation experiments.

Computational Fluid Dynamics↗

Validation of Cloud Properties From Multiple Satellites Using CALIOP Data

The NASA Langley Satellite ClOud and Radiative Property retrieval System (SatCORPS) is routinely applied to multispectral imagery from several geostationary and polar-orbiting imagers to retrieve cloud properties for weather and climate applications. Validation of the retrievals with independent datasets is continuously ongoing in order to understand differences caused by calibration, spatial resolution, viewing geometry, and other factors. The CALIOP instrument provides a decade of detailed cloud observations which can be used to evaluate passive imager retrievals of cloud boundaries, thermodynamic phase, cloud optical depth, and water path on a global scale. This paper focuses on comparisons of CALIOP retrievals to retrievals from MODIS, VIIRS, AVHRR, GOES, SEVIRI, and MTSAT. CALIOP is particularly skilled at detecting weakly-scattering cirrus clouds with optical depths less than approx. 0.5. These clouds are often undetected by passive imagers and the effect this has on the property retrievals is discussed.

Yost, Christopher R.↗

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗

Simulating Visible/Infrared Imager Radiometer Suite Normalized Difference Vegetation Index Data Using Hyperion and MODIS

The success of MODIS (the Moderate Resolution Imaging Spectrometer) in creating unprecedented, timely, high-quality data for vegetation and other studies has created great anticipation for data from VIIRS (the Visible/Infrared Imager Radiometer Suite). VIIRS will be carried onboard the joint NASA/Department of Defense/National Oceanic and Atmospheric Administration NPP (NPOESS (National Polar-orbiting Operational Environmental Satellite System) Preparatory Project). Because the VIIRS instruments will have lower spatial resolution than the current MODIS instruments 400 m versus 250 m at nadir for the channels used to generate Normalized Difference Vegetation Index data, scientists need the answer to this question: how will the change in resolution affect vegetation studies? By using simulated VIIRS measurements, this question may be answered before the VIIRS instruments are deployed in space. Using simulated VIIRS products, the U.S. Department of Agriculture and other operational agencies can then modify their decision support systems appropriately in preparation for receipt of actual VIIRS data. VIIRS simulations and validations will be based on the ART (Application Research Toolbox), an integrated set of algorithms and models developed in MATLAB(Registerd TradeMark) that enables users to perform a suite of simulations and statistical trade studies on remote sensing systems. Specifically, the ART provides the capability to generate simulated multispectral image products, at various scales, from high spatial hyperspectral and/or multispectral image products. The ART uses acquired ( real ) or synthetic datasets, along with sensor specifications, to create simulated datasets. For existing multispectral sensor systems, the simulated data products are used for comparison, verification, and validation of the simulated system s actual products. VIIRS simulations will be performed using Hyperion and MODIS datasets. The hyperspectral and hyperspatial properties of Hyperion data will be used to produce simulated MODIS and VIIRS products. Hyperion-derived MODIS data will be compared with near-coincident MODIS collects to validate both spectral and spatial synthesis, which will ascertain the accuracy of converting from MODIS to VIIRS. MODIS-derived VIIRS data is needed for global coverage and for the generation of time series for regional and global investigations. These types of simulations will have errors associated with aliasing for some scene types. This study will help quantify these errors and will identify cases where high-quality, MODIS-derived VIIRS data will be available.

Ross, Kenton W.↗

Traction Control Design and Integration Onboard the Mars Science Laboratory Curiosity Rover

The Mars Science Laboratory (MSL) Curiosity rover experienced increasing wheel damage beginning in October 2013. While the wheels were designed to operate with considerable damage, the rate at which damage was occurring was unexpected and raised concerns regarding wheel lifetime. The Jet Propulsion Laboratory (JPL) has now developed and deployed new software on Curiosity that reduces the forces acting on the wheels. Our new Traction Control algorithm adapts each wheel’s speed to fit the terrain it drives over. It does not rely on any a priori knowledge of the terrain, and instead leverages the rover’s measured attitude rates and suspension angles, together with a rigid-body kinematics model, to estimate the real-time wheel-terrain contact angles and ideal, no-slip wheel angular rates. In addition, free-floating “wheelies” are detected and autonomously corrected. In this paper, we describe the algorithm, its ground testing campaign and associated challenges, and finally its validation and performance in flight. Ground test data demonstrates reductions in the forces acting on the wheels and validates the wheelie-damping capability. Secondary benefits in some terrains include a reduction in heading deviations while climbing rocks, with a reduction in slip in certain sandy terrains. Preliminary validation from flight data confirms these findings.

Maimone, Mark↗

Electronic Health Management

Accelerated aging methodologies for electrolytic components have been designed and accelerated aging experiments have been carried out. The methodology is based on imposing electrical and/or thermal overstresses via electrical power cycling in order to mimic the real world operation behavior. Data are collected in-situ and offline in order to periodically characterize the devices' electrical performance as it ages. The data generated through these experiments are meant to provide capability for the validation of prognostic algorithms (both model-based and data-driven). Furthermore, the data allow validation of physics-based and empirical based degradation models for this type of capacitor. A first set of models and algorithms has been designed and tested on the data.

Celaya, Jose R.↗

Advanced data acquisition and display techniques for laser velocimetry

The Basic Aerodynamics Research Tunnel (BART) has been equipped with state-of-the-art instrumentation for acquiring the data needed for code validation. This paper describes the three-component LDV and the workstation-based data-acquisition system (DAS) which has been developed for the BART. The DAS allows the use of automation and the quick integration of advanced instrumentation, while minimizing the software development time required between investigations. The paper also includes a description of a graphics software library developed to support the windowing environment of the DAS. The real-time displays generated using the graphics library help the researcher ensure the test is proceeding properly. The graphics library also supports the requirements of posttest data analysis. The use of the DAS and graphics libraries is illustrated by presenting examples of the real-time and postprocessing display graphics for LDV investigations.

Kjelgaard, Scott O.↗

Recognition of error symptoms in large systems

A methodology for automatically detecting symptoms of frequently occurring errors in large computer systems is developed. The proposed symptom recognition methodology and its validation are based on probabilistic techniques. The technique is shown to work on real failure data from two CYBER systems at the University of Illinois. The methodology allows for the resolution between independent and dependent causes and, also quantifies a measure of the strength of relationship among errors. Comparison made with failure/repair information obtained from field maintenance engineers shows that in 85% of the cases, the error symptoms recognized by our approach correspond to real system problems. Further, the remaining 15% although not directly supported by field data, were confirmed as valid problems. Some of these were shown to be persistent problems which otherwise would have been considered as minor transients and hence ignored.

Iyer, Ravishankar K.↗

Turbulence Measurements on a Wing-Fuselage Junction Model for CFD Validation

Current turbulence models, such as those employed in Reynolds-averaged Navier-Stokes CFD, are unable to reliably predict the onset and extent of the three-dimensional separated flow that typically occurs in wing fuselage junctions. To critically assess, as well as to improve upon, existing turbulence models, experimental validation-quality flow field data in the junction region is needed. To that end, NASA has developed a CFD validation experiment for a generic full-span wing-fuselage junction model at subsonic conditions. In this paper, we present and discuss sample results from this effort, with a focus on turbulence measurements in the separated corner flow of the wing-fuselage junction that were obtained with an internally mounted laser Doppler velocimetry (LDV) system. In addition, sample comparisons between the flow field measurements and representative CFD of our test case are presented and here, we highlight some of the key discrepancies.

Kegerise, Michael↗

Assessment of Version 4 of the SMAP Passive Soil Moisture Standard Product

NASAs Soil Moisture Active Passive (SMAP) mission launched on January 31, 2015 into a sun-synchronous 6 am6 pm orbit with an objective to produce global mapping of high-resolution soil moisture and freeze-thaw state every 2-3 days. The SMAP radiometer began acquiring routine science data on March 31, 2015 and continues to operate nominally. SMAPs radiometer-derived standard soil moisture product (L2SMP) provides soil moisture estimates posted on a 36-km fixed Earth grid using brightness temperature observations and ancillary data. A beta quality version of L2SMP was released to the public in October, 2015, Version 3 validated L2SMP soil moisture data were released in May, 2016, and Version 4 L2SMP data were released in December, 2016. Version 4 data are processed using the same soil moisture retrieval algorithms as previous versions, but now include retrieved soil moisture from both the 6 am descending orbits and the 6 pm ascending orbits. Validation of 19 months of the standard L2SMP product was done for both AM and PM retrievals using in situ measurements from global core calval sites. Accuracy of the soil moisture retrievals averaged over the core sites showed that SMAP accuracy requirements are being met.

SMAP↗

Requirements for facilities and measurement techniques to support CFD development for hypersonic aircraft

The design of a hypersonic aircraft poses unique challenges to the engineering community. Problems with duplicating flight conditions in ground based facilities have made performance predictions risky. Computational fluid dynamics (CFD) has been proposed as an additional means of providing design data. At the present time, CFD codes are being validated based on sparse experimental data and then used to predict performance at flight conditions with generally unknown levels of uncertainty. This paper will discuss the facility and measurement techniques that are required to support CFD development for the design of hypersonic aircraft. Illustrations are given of recent success in combining experimental and direct numerical simulation in CFD model development and validation for hypersonic perfect gas flows.

Sellers, William L., III↗

A Method for Assessing the Quality of Model-Based Estimates of Ground Temperature and Atmospheric Moisture Using Satellite Data

A method is developed for validating model-based estimates of atmospheric moisture and ground temperature using satellite data. The approach relates errors in estimates of clear-sky longwave fluxes at the top of the Earth-atmosphere system to errors in geophysical parameters. The fluxes include clear-sky outgoing longwave radiation (CLR) and radiative flux in the window region between 8 and 12 microns (RadWn). The approach capitalizes on the availability of satellite estimates of CLR and RadWn and other auxiliary satellite data, and multiple global four-dimensional data assimilation (4-DDA) products. The basic methodology employs off-line forward radiative transfer calculations to generate synthetic clear-sky longwave fluxes from two different 4-DDA data sets. Simple linear regression is used to relate the clear-sky longwave flux discrepancies to discrepancies in ground temperature ((delta)T(sub g)) and broad-layer integrated atmospheric precipitable water ((delta)pw). The slopes of the regression lines define sensitivity parameters which can be exploited to help interpret mismatches between satellite observations and model-based estimates of clear-sky longwave fluxes. For illustration we analyze the discrepancies in the clear-sky longwave fluxes between an early implementation of the Goddard Earth Observing System Data Assimilation System (GEOS2) and a recent operational version of the European Centre for Medium-Range Weather Forecasts data assimilation system. The analysis of the synthetic clear-sky flux data shows that simple linear regression employing (delta)T(sub g)) and broad layer (delta)pw provides a good approximation to the full radiative transfer calculations, typically explaining more thin 90% of the 6 hourly variance in the flux differences. These simple regression relations can be inverted to "retrieve" the errors in the geophysical parameters, Uncertainties (normalized by standard deviation) in the monthly mean retrieved parameters range from 7% for (delta)T(sub g) to approx. 20% for the lower tropospheric moisture between 500 hPa and surface. The regression relationships developed from the synthetic flux data, together with CLR and RadWn observed with the Clouds and Earth Radiant Energy System instrument, ire used to assess the quality of the GEOS2 T(sub g) and pw. Results showed that the GEOS2 T(sub g) is too cold over land, and pw in upper layers is too high over the tropical oceans and too low in the lower atmosphere.

Wu, Man Li C.↗

The Validation of Version 8 Ozone Profiles: Is SBUV Ready for Prime Time?

Ozone profile data are now available from a series of BUV instruments - SBUV on Nimbus 7 and SBW/2 instruments on NOAA 9, NOAA 11, and NOAA 16. The data have been processed through the new version 8 algorithm, which is designed to be more accurate and, more importantly, to reduce the influence of the a priori on ozone trends. As a part of the version 8 reprocessing we have attempted to apply a consistent calibration to the individual instruments so that their data records can be used together in a time series analysis. Validation consists of examining not only the mean difference from external datasets (i.e trends) but also consistency in the interannual variability of the data. Here we validate the v8 BUV data through comparison with ECC sondes, lidar and microwave measurements, and with SAGE II and HALOE satellite data records. We find that individual profiles generally agree with external data sets within +/-10% between 30 hPa and 1 hPa (approx. 24 - 50 km) and frequently agree within +/-5%. The interannual variability of the BUV ozone time series agrees well with that of SAGE II . On the average, different B W instruments usually agree within +/-5% with each other, though the relative error increases near the ends of the Nimbus 7 and NOAA 16 data records as a result of instrument problems. The combined v8 BUV data sets cover the 1979-2003 time period giving daily global coverage of the ozone vertical distribution to better accuracy than has ever been possible before.

McPeters, R. D.↗

Modeling energy flow and nutrient cycling in natural semiarid grassland ecosystems with the aid of thematic mapper data

Energy flow and nutrient cycling were modeled as affected by herbivory on selected intensive sites along gradients of precipitation and soils, validating the model output by monitoring selected parameters with data derived from the Thematic Mapper (TM). Herbivore production was modeled along the gradient of soils and herbivory, and validated with data derived from TM in a spatial data base.

Lewis, James K.↗

A Compilation of Global Bio-Optical in Situ Data for Ocean-Colour Satellite Applications – Version Two

A global compilation of in situ data is useful to evaluate the quality of ocean-colour satellite data records. Here we describe the data compiled for the validation of the ocean-colour products from the ESA Ocean Colour Climate Change Initiative (OC-CCI). The data were acquired from several sources (including, inter alia, MOBY, BOUSSOLE, AERONETOC, SeaBASS, NOMAD, MERMAID, AMT, ICES, HOT, GeP&CO) and span the period from 1997 to 2018. Observations of the following variables were compiled: spectral remote-sensing reflectances, concentrations of chlorophyll-a, spectral inherent optical properties, spectral diffuse attenuation coefficients and total suspended matter. The data were from multi-project archives acquired via open internet services or from individual projects, acquired directly from data providers. Methodologies were implemented for homogenisation, quality control and merging of all data. No changes were made to the original data, other than averaging of observations that were close in time and space, elimination of some points after quality control and conversion to a standard format. The final result is a merged table designed for validation of satellite-derived ocean-colour products and available in text format. Metadata of each in situ measurement (original source, cruise or experiment, principal investigator) were propagated throughout the work and made available in the final table. By making the metadata available, provenance is better documented, and it is also possible to analyse each set of data separately. This paper also describes the changes that were made to the compilation in relation to the previous version (Valente et al., 2016). The compiled data are available at https://doi.org/10.1594/PANGAEA.898188.

Andre Valente↗

A Supersonic Argon/Air Coaxial Jet Experiment for Computational Fluid Dynamics Code Validation

A non-reacting experiment is described in which data has been acquired for the validation of CFD codes used to design high-speed air-breathing engines. A coaxial jet-nozzle has been designed to produce pressure-matched exit flows of Mach 1.8 at 1 atm in both a center jet of argon and a coflow jet of air, creating a supersonic, incompressible mixing layer. The flowfield was surveyed using total temperature, gas composition, and Pitot probes. The data set was compared to CFD code predictions made using Vulcan, a structured grid Navier-Stokes code, as well as to data from a previous experiment in which a He-O2 mixture was used instead of argon in the center jet of the same coaxial jet assembly. Comparison of experimental data from the argon flowfield and its computational prediction shows that the CFD produces an accurate solution for most of the measured flowfield. However, the CFD prediction deviates from the experimental data in the region downstream of x/D = 4, underpredicting the mixing-layer growth rate.

Clifton, Chandler W.↗

A technique for extrapolating and validating forest cover across large regions - Calibrating AVHRR data with TM data

A method is presented for extending high-resolution forest cover information across large regions. Using Landsat TM data with AVHRR data, an empirical relationship beween AVHRR spectral signatures and forest cover is developed. The resulting regression equation is applied to an AVHRR scene covering a large area centered around southern Illinois. The map is used to estimate forest cover within a geographical information system. The results are compared with U.S. Forest Service estimates, showing good agreement.

Iverson, L. R.↗