Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Chlorophyll-a Algorithms for Oligotrophic Oceans: A Novel Approach Based on Three-Band Reflectance Difference

A new empirical algorithm is proposed to estimate surface chlorophyll-a concentrations (Chl) in the global ocean for Chl less than or equal to 0.25 milligrams per cubic meters (approximately 77% of the global ocean area). The algorithm is based on a color index (CI), defined as the difference between remote sensing reflectance (R(sub rs), sr(sup -1) in the green and a reference formed linearly between R(sub rs) in the blue and red. For low Chl waters, in situ data showed a tighter (and therefore better) relationship between CI and Chl than between traditional band-ratios and Chl, which was further validated using global data collected concurrently by ship-borne and SeaWiFS satellite instruments. Model simulations showed that for low Chl waters, compared with the band-ratio algorithm, the CI-based algorithm (CIA) was more tolerant to changes in chlorophyll-specific backscattering coefficient, and performed similarly for different relative contributions of non-phytoplankton absorption. Simulations using existing atmospheric correction approaches further demonstrated that the CIA was much less sensitive than band-ratio algorithms to various errors induced by instrument noise and imperfect atmospheric correction (including sun glint and whitecap corrections). Image and time-series analyses of SeaWiFS and MODIS/Aqua data also showed improved performance in terms of reduced image noise, more coherent spatial and temporal patterns, and consistency between the two sensors. The reduction in noise and other errors is particularly useful to improve the detection of various ocean features such as eddies. Preliminary tests over MERIS and CZCS data indicate that the new approach should be generally applicable to all existing and future ocean color instruments.

Hu, Chuanmin↗

A Deterministic Annealing Approach to Clustering AIRS Data

We will examine the validity of means and standard deviations as a basis for climate data products. We will explore the conditions under which these two simple statistics are inadequate summaries of the underlying empirical probability distributions by contrasting them with a nonparametric, method called Deterministic Annealing technique

clustering↗

Directed Design of Experiments for Validating Probability of Detection Capability of a Testing System

A method of validating a probability of detection (POD) testing system using directed design of experiments (DOE) includes recording an input data set of observed hit and miss or analog data for sample components as a function of size of a flaw in the components. The method also includes processing the input data set to generate an output data set having an optimal class width, assigning a case number to the output data set, and generating validation instructions based on the assigned case number. An apparatus includes a host machine for receiving the input data set from the testing system and an algorithm for executing DOE to validate the test system. The algorithm applies DOE to the input data set to determine a data set having an optimal class width, assigns a case number to that data set, and generates validation instructions based on the case number.

Generazio, Edward R.↗

Optimal Strategies for Validating TRMM Rainfall Estimates with Rain-Gauge Data

In spite of all their problems, rain gauges measure rainfall in such a direct way when compared with other methods of estimating rainfall that comparing their totals to satellite estimates remains an essential tool in the validation of satellite products. Some disagreement between averages of satellite data and rain-gauge data is expected because of the very different sampling patterns of the two systems--the satellite provides only occasional snapshots of large areas, whereas rain gauges provide continuous measurements over very small areas. A quantitative estimate of the expected level of disagreement due to the differences in sampling is needed in order for comparisons of the two kinds of averages to be informative. As part of an earlier effort to determine the sampling error of satellite averages, a space-time model for rainfall statistics was developed. Sets of parameter values for the model have been obtained for which the model statistics are found to agree quite well with those of radar data taken over the Atlantic during GATE and the western Pacific during TOGA COARE. Although the model was intended to represent the statistics of relatively large scale fluctuations of rain, it is surprisingly consistent with the very different scales on which rain gauges observe. Implications for maximizing the benefit in comparisons of rain gauge averages and TRMM estimates are derived using the model predictions.

Bell, Thomas L.↗

Hyper-X: Flight Validation of Hypersonic Airbreathing Technology

This paper provides an overview of NASA's focused hypersonic technology program, i.e. the Hyper-X program. This program is designed to move hypersonic, air breathing vehicle technology from the laboratory environment to the flight environment, the last stage preceding prototype development. This paper presents some history leading to the flight test program, research objectives, approach, schedule and status. Substantial experimental data base and concept validation have been completed. The program is concentrating on Mach 7 vehicle development, verification and validation in preparation for wind tunnel testing in 1998 and flight testing in 1999. It is also concentrating on finalization of the Mach 5 and 10 vehicle designs. Detailed evaluation of the Mach 7 vehicle at the flight conditions is nearing completion, and will provide a data base for validation of design methods once flight test data are available.

Rausch, Vincent L.↗

Doppler lidar results from the San Gorgonio Pass experiments

During FY-84, the Doppler Lidar data from the San Gorgonio Pass experiments were analyzed, evaluated, and interpreted with regard to signal strength, signal width, magnitude and direction of velocity component and a goodness parameter associated with the expected noise level of the signal. From these parameters, a screening criteria was developed to eliminate questionable data. For the most part analysis supports the validity of Doppler Lidar data obtained at San Gorgonio Pass with respect to the mean velocity magnitude and direction. The question as to whether the Doppler width could be interpreted as a measure of the variance of the turbulence within the Doppler Lidar System (DLS) focal volume was not resolved. The stochastic nature of the Doppler broadening from finite residence time of the particles in the beam as well as other Doppler broadening phenomenon tend to mask the Doppler spread associated with small scale turbulence. Future tests with longer pulses may assist in better understanding.

Cliff, W. C.↗

Initial assessment of the stratospheric and climatic impact of the 1991 Mount Pinatubo eruption - Prologue

An overview is given of the techniques employed to evaluate the early effects of the volcanic eruption on the stratosphere and climate, and data are given on the initial eruption yield. Global satellite measurements were taken by TOMS, SAGE II, AVHRR, and other devices, and the initial results indicate an eruption yield of 20 megatons of SO2 and 20-30 megatons of H2SO4/H2O aerosol mass. The predicted effects of the eruption - accelerated global ozone depletion and surface cooling - can be compared to meteorological data to test the validity of present climate models based on these data.

Mccormick, M. P.↗

Determination of Aerosol Optical Depth and Land Surface Directional Reflectances Using Multiangle Imagery

Spectral aerosol optical depths, surface hemispherical-directional reflectance factors, and bihemispherical reflectances (albedos) are retrieved for an area of Glacier National Park using spectral, multiangle imagery obtained with the airborne advanced solid state array spectroradiometer (ASAS). The retrieval algorithms are described and are identical in principle to those being devised for use by the multiangle imaging spectroradiometer (MISR) which will fly on the EOS-AMI spacecraft in 1998. As part of its science mission, MISR will produce global coverage of both aerosol amounts an an surface reflection properties. The results in this paper represent the initial effort in applying the MISR algorithms to real data. These algorithms will undergo additional testing and validation as more multiangle data become available.

Martonchik, John V.↗

What You Need to Know About the OMI NO2 Data Product for Air Quality Studies

The standard nitrogen dioxide (NO2) data product, produced from measurements by the Ozone Monitoring Instrument (OMI), are publicly available online from the NASA GESDISC facility. Important data fields include total and tropospheric column densities, as well as collocated data for cloud fraction and cloud top height, surface albedo and snow/ice coverage, at the resolution of the OMI instrument (12 km x 26 km, at nadir). The retrieved NO2 data have been validated, principally under clear-sky conditions. The first public-release version has been available since September 2006. An improved version of the data product, which includes a number of new data fields, and improved estimates of the retrieval uncertainties will be released by the end of 2007. This talk will describe the standard NO2 data product, including details that are essential for the use of the data for air quality studies. We will also describe the principal improvements with the new version of the data product.

Celarier, E. A.↗

MODIS Science Algorithms and Data Systems Lessons Learned

For almost 10 years, standard global products from NASA's Earth Observing System s (EOS) two Moderate Resolution Imaging Spectroradiometer (MODIS) sensors are being used world-wide for earth science research and applications. This paper discusses the lessons learned in developing the science algorithms and the data systems needed to produce these high quality data products for the earth sciences community. Strong science team leadership and communication, an evolvable and scalable data system, and central coordination of QA and validation activities enabled the data system to grow by two orders of magnitude from the initial at-launch system to the current system able to reprocess data from both the Terra and Aqua missions in less than a year. Many of the lessons learned from MODIS are already being applied to follow-on missions.

Wolfe, Robert E.↗

Automation of the ICME Workflow Incorporating Material Digital Twins at Different Length Scales Within a Robust Information Management System

Recent successes in Integrated Computational Materials Engineering (ICME) have demonstrated the potential in designing ‘fit-for-purpose’ materials for a given application in a cost and time efficient manner. However, the material design process must contain a level of judicious automation in the material decision process; that is implementing some optimization algorithms to truly enable the benefits of ICME, particularly when considering materials at multiple length and time scales. Furthermore, the ability to effectively store developed material models, experimental data used for validation, and link models at multiple length and time scales must be implemented to ensure traceability across the material design process, such that the data gathered can be leveraged towards efficient material design. To enable such an optimization scheme a robust framework must exist: (1) that can capture changes made at a given length scale, (2) automatically propagate changes upstream to the highest scale, and (3) evaluate the material’s performance at the structural level. In this work, a developed framework for tracking material changes, automatically running the necessary simulations to determine the properties at the next highest scale, and saving each iteration of the design process to maintain the application’s digital thread is presented for polymer matrix composites (PMCs). The Automated Information Management Across Organizations and Scales (AIMAOS) program offers users an interactive graphical user interface (GUI) for defining constituent materials, building lamina and laminates, and applying effective laminate properties to finite element and composite optimization third party software. At each length scale, the necessary input files are automatically written, and subsequent analysis tools are called to solve for effective properties at the next scale, which are then read by the AIMAOS tool and displayed to the user. As changes are made to the material at lower length scales, information is automatically propagated upstream to higher length scales, and changes made are automatically tracked and versioned to maintain traceability during the design process. The AIMAOS tools serves as the first step in enabling optimized design of composites from the nano to the macroscale for a given application.

Brandon L Hearley↗

Dissertation Defense Computational Fluid Dynamics Uncertainty Analysis for Payload Fairing Spacecraft Environmental Control Systems

Spacecraft thermal protection systems are at risk of being damaged due to airflow produced from Environmental Control Systems. There are inherent uncertainties and errors associated with using Computational Fluid Dynamics to predict the airflow field around a spacecraft from the Environmental Control System. This paper describes an approach to quantify the uncertainty in using Computational Fluid Dynamics to predict airflow speeds around an encapsulated spacecraft without the use of test data. Quantifying the uncertainty in analytical predictions is imperative to the success of any simulation-based product. The method could provide an alternative to traditional "validation by test only" mentality. This method could be extended to other disciplines and has potential to provide uncertainty for any numerical simulation, thus lowering the cost of performing these verifications while increasing the confidence in those predictions. Spacecraft requirements can include a maximum airflow speed to protect delicate instruments during ground processing. Computational Fluid Dynamics can be used to verify these requirements; however, the model must be validated by test data. This research includes the following three objectives and methods. Objective one is develop, model, and perform a Computational Fluid Dynamics analysis of three (3) generic, non-proprietary, environmental control systems and spacecraft configurations. Several commercially available and open source solvers have the capability to model the turbulent, highly three-dimensional, incompressible flow regime. The proposed method uses FLUENT, STARCCM+, and OPENFOAM. Objective two is to perform an uncertainty analysis of the Computational Fluid Dynamics model using the methodology found in "Comprehensive Approach to Verification and Validation of Computational Fluid Dynamics Simulations". This method requires three separate grids and solutions, which quantify the error bars around Computational Fluid Dynamics predictions. The method accounts for all uncertainty terms from both numerical and input variables. Objective three is to compile a table of uncertainty parameters that could be used to estimate the error in a Computational Fluid Dynamics model of the Environmental Control System /spacecraft system. Previous studies have looked at the uncertainty in a Computational Fluid Dynamics model for a single output variable at a single point, for example the re-attachment length of a backward facing step. For the flow regime being analyzed (turbulent, three-dimensional, incompressible), the error at a single point can propagate into the solution both via flow physics and numerical methods. Calculating the uncertainty in using Computational Fluid Dynamics to accurately predict airflow speeds around encapsulated spacecraft in is imperative to the success of future missions.

CFD↗

Dissertation Defense: Computational Fluid Dynamics Uncertainty Analysis for Payload Fairing Spacecraft Environmental Control Systems

Spacecraft thermal protection systems are at risk of being damaged due to airflow produced from Environmental Control Systems. There are inherent uncertainties and errors associated with using Computational Fluid Dynamics to predict the airflow field around a spacecraft from the Environmental Control System. This paper describes an approach to quantify the uncertainty in using Computational Fluid Dynamics to predict airflow speeds around an encapsulated spacecraft without the use of test data. Quantifying the uncertainty in analytical predictions is imperative to the success of any simulation-based product. The method could provide an alternative to traditional validation by test only mentality. This method could be extended to other disciplines and has potential to provide uncertainty for any numerical simulation, thus lowering the cost of performing these verifications while increasing the confidence in those predictions.Spacecraft requirements can include a maximum airflow speed to protect delicate instruments during ground processing. Computational Fluid Dynamics can be used to verify these requirements; however, the model must be validated by test data. This research includes the following three objectives and methods. Objective one is develop, model, and perform a Computational Fluid Dynamics analysis of three (3) generic, non-proprietary, environmental control systems and spacecraft configurations. Several commercially available and open source solvers have the capability to model the turbulent, highly three-dimensional, incompressible flow regime. The proposed method uses FLUENT, STARCCM+, and OPENFOAM. Objective two is to perform an uncertainty analysis of the Computational Fluid Dynamics model using the methodology found in Comprehensive Approach to Verification and Validation of Computational Fluid Dynamics Simulations. This method requires three separate grids and solutions, which quantify the error bars around Computational Fluid Dynamics predictions. The method accounts for all uncertainty terms from both numerical and input variables. Objective three is to compile a table of uncertainty parameters that could be used to estimate the error in a Computational Fluid Dynamics model of the Environmental Control System spacecraft system.Previous studies have looked at the uncertainty in a Computational Fluid Dynamics model for a single output variable at a single point, for example the re-attachment length of a backward facing step. For the flow regime being analyzed (turbulent, three-dimensional, incompressible), the error at a single point can propagate into the solution both via flow physics and numerical methods. Calculating the uncertainty in using Computational Fluid Dynamics to accurately predict airflow speeds around encapsulated spacecraft in is imperative to the success of future missions.

Fluid Dynamics↗

A Physical Validation Program for the GPM Mission

The GPM mission is currently planned for start in the late 2007 - early 2008 time frame. Its main scientific goal is to help answer pressing scientific problems arising within the context of global and regional water cycling. These problems cut across a hierarchy of scales and include climate-water cycle interactions, techniques for improving weather and climate predictions, and better methods for combining observed precipitation with hydrometeorological prediction models for applications to hazardous flood-producing storms, seasonal flood draught conditions, and fresh water resource assessments. The GPM mission will expand the scope of precipitation measurement through the use of a constellation of some 9 satellites, one of which will be an advanced TRMM-like core satellite carrying a dual-frequency Ku-Ka band precipitation radar and an advanced, multifrequency passive microwave radiometer with vertical-horizontal polarization discrimination. The other constellation members will include new dedicated satellites and co-existing operational/research satellites carrying similar (but not identical) passive microwave radiometers. The goal of the constellation is to achieve approximately 3-hour sampling at any spot on the globe -- continuously. The constellation's orbit architecture will consist of a mix of sun-synchronous and non-sun-synchronous satellites with the core satellite providing measurements of cloud-precipitation microphysical processes plus calibration-quality rainrate retrievals to be used with the other retrieval information to ensure bias-free constellation coverage. A major requirement before the retrieved rainfall information generated by the GPM mission can be used effectively by prognostic models to improve weather forecasts, hydrometeorological forecasts, and climate model reanalysis simulations is a capability to quantify the error characteristics of the retrievals. A solution for this problem has been upheld in past precipitation missions because of the lack of suitable error modeling systems incorporated into the validation programs and data distribution systems. An overview of how NASA intends to overcome this problem for the GPM mission using a physically-based error modeling approach within a multi-faceted validation program is described. The solution is to first identify specific user requirements and then determine the most stringent of these requirements that embodies all essential error characterization information needed by the entire user community. In the context of NASA s scientific agenda for the GPM mission, the most stringent user requirement is found within the data assimilation community. The fundamental theory of data assimilation vis-a-vis ingesting satellite precipitation information into the pre-forecast initializations is based on quantifying the conditional bias and precision errors of individual rain retrievals, and the space-time structure of the precision error (i.e., the spatial-temporal error covariance). By generating the hardware and software capability to produce this information in a near real-time fashion, and to couple the derived quantitative error properties to the actual retrieved rainrates, all key validation users can be satisfied. The talk will describe the essential components of the hardware and software systems needed to generate such near real-time error properties, as well as the various paradigm shifts needed within the validation community to produce a validation program relevant to the precipitation user community.

Smith, Eric A.↗

Validation of US3D for Capsule Aerodynamics using 05-CA Wind Tunnel Test Data

Several comparisons of computational fluid dynamics to wind tunnel test data are shown for the purpose of code validation. The wind tunnel test, 05-CA, uses a 7.66% model of NASA's Multi-Purpose Crew Vehicle in the 11-foot test section of the Ames Unitary Plan Wind tunnel. A variety of freestream conditions over four Mach numbers and three angles of attack are considered. Test data comparisons include time-averaged integrated forces and moments, time-averaged static pressure ports on the surface, and Strouhal Number. The applicability of the US3D code to subsonic and transonic flow over a bluff body is assessed on a comprehensive data set. With close comparison, this work validates US3D for highly separated flows similar to those examined here.

Schwing, Alan↗

Gravity Offloading and Analysis of Long Imperfection-Sensitive Elements (GOALIE)

Use of large-scale deployable structures (e.g., iROSA) can enable space exploration and science missions (e.g., ACS3, Solar Cruiser). Numerical models predicting behavior of deployable structures in microgravity are difficult to validate because ground testing of long, slender, and flexible booms is challenging due to the influence of Earth’s gravity. The GOALIE team is collecting data for model validation through experimental testing to increase confidence in numerical models. Redwire, Inc. provided a subscale (7 m) and a full-scale (30 m) Triangular, Rollable, and Collapsible (TRAC) boom to use for test development. Other boom designs may be tested in the future.

Composites↗

March 2003 EOS Aqua AMSR-E Arctic Sea Ice Field Campaign

An overview of the March 2003 coordinated sea ice field campaign in the Alaskan Arctic is presented with reference to the papers in this special section. This campaign is part of the program to validate the Aqua Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E) sea ice products. Standard AMSR-E sea ice products include sea ice concentration, sea ice temperature, and snow depth on sea ice. The validation program consists of three elements, namely: 1) satellite data comparisons; 2) coordinated satellite/aircraft surface measurements; and 3) modeling and sensitivity analyses. Landsat-7 and RADARSAT observations were used in comparative studies with the retrieved AMSR-E sea ice concentrations. The aircraft sensors provided high-resolution microwave imagery of the surface, atmospheric profiles of temperature and humidity, and digital records of sea ice conditions. When combined with in situ measurements, aircraft data were used to validate the AMSR-E sea ice temperature and snow-depth products. The modeling studies helped interpret the field-data comparisons, provided insight on the limitations of the AMSR-E sea ice algorithms, and suggested potential improvements to the AMSR-E retrieval algorithms.

Cavalieri, Donald J.↗

Evaluating China's fossil-fuel CO2 emissions from a comprehensive dataset of nine inventories

China's fossil-fuel CO2 (FFCO2) emissions accounted for approximately 28 % of the global total FFCO2 in 2016. An accurate estimate of China's FFCO2 emissions is a prerequisite for global and regional carbon budget analyses and the monitoring of carbon emission reduction efforts. However, significant uncertainties and discrepancies exist in estimations of China's FFCO2 emissions due to a lack of detailed traceable emission factors (EFs) and multiple statistical data sources. Here, we evaluated China's FFCO2 emissions from nine published global and regional emission datasets. These datasets show that the total emissions increased from 3.4 (3.0–3.7) in 2000 to 9.8 (9.2–10.4) Gt CO2 per yr in 2016. The variations in these estimates were largely due to the different EF (0.491–0.746 t C per t of coal) and activity data. The large-scale patterns of gridded emissions showed a reasonable agreement, with high emissions being concentrated in major city clusters, and the standard deviation mostly ranged from 10 % to 40 % at the provincial level. However, patterns beyond the provincial scale varied significantly, with the top 5 % of the grid level accounting for 50 %–90 % of total emissions in these datasets. Our findings highlight the significance of using locally measured EF for Chinese coal. To reduce uncertainty, we recommend using physical CO2 measurements and use these values for dataset validation, key input data sharing (e.g., point sources), and finer-resolution validations at various levels.

Pengfei Han↗