Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Summary of EASM Turbulence Models in CFL3D With Validation Test Cases

This paper summarizes the Explicit Algebraic Stress Model in k-omega form (EASM-ko) and in k-epsilon form (EASM-ke) in the Reynolds-averaged Navier-Stokes code CFL3D. These models have been actively used over the last several years in CFL3D, and have undergone some minor modifications during that time. Details of the equations and method for coding the latest versions of the models are given, and numerous validation cases are presented. This paper serves as a validation archive for these models.

Rumsey, Christopher L.↗

Ocean Optics Protocols for Satellite Ocean Color Sensor Validation: Inherent Optical Properties: Instruments, Characterizations, Field Measurements and Data Analysis Protocols - Volume 4

This document stipulates protocols for measuring bio-optical and radiometric data for the Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) Project activities and algorithm development. The document is organized into 6 separate volumes as Ocean Optics Protocols for Satellite Ocean Color Sensor Validation, Revision 4. Volume I: Introduction, Background and Conventions; Volume II: Instrument Specifications, Characterization and Calibration; Volume III: Radiometric Measurements and Data Analysis Methods; Volume IV: Inherent Optical Properties: Instruments, Characterization, Field Measurements and Data Analysis Protocols; Volume V: Biogeochemical and Bio-Optical Measurements and Data Analysis Methods; Volume VI: Special Topics in Ocean Optics Protocols and Appendices. The earlier version of Ocean Optics Protocols for Satellite Ocean Color Sensor Validation, Revision 3 (Mueller and Fargion 2002, Volumes 1 and 2) is entirely superseded by the six volumes of Revision 4 listed above.

Mueller, J. L.↗

Ocean Optics Protocols for Satellite Ocean Color Sensor Validation, Revision 4, Volume IV: Inherent Optical Properties: Instruments, Characterizations, Field Measurements and Data Analysis Protocols

This document stipulates protocols for measuring bio-optical and radiometric data for the Sensor Intercomparision and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) Project activities and algorithm development. The document is organized into 6 separate volumes as Ocean Optics Protocols for Satellite Ocean Color Sensor Validation, Revision 4. Volume I: Introduction, Background, and Conventions; Volume II: Instrument Specifications, Characterization and Calibration; Volume III: Radiometric Measurements and Data Analysis Methods; Volume IV: Inherent Optical Properties: Instruments, Characterization, Field Measurements and Data Analysis Protocols; Volume V: Biogeochemical and Bio-Optical Measurements and Data Analysis Methods; Volume VI: Special Topics in Ocean Optics Protocols and Appendices. The earlier version of Ocean Optics Protocols for Satellite Ocean Color Sensor Validation, Revision 3 is entirely superseded by the six volumes of Revision 4 listed above.

Mueller, J. L.↗

Validation of an In-Water, Tower-Shading Correction Scheme

Large offshore structures used for the deployment of optical instruments can significantly perturb the intensity of the light field surrounding the optical measurement point, where different portions of the visible spectrum are subject to different shadowing effects. These effects degrade the quality of the acquired optical data and can reduce the accuracy of several derived quantities, such as those obtained by applying bio-optical algorithms directly to the shadow-perturbed data. As a result, optical remote sensing calibration and validation studies can be impaired if shadowing artifacts are not fully accounted for. In this work, the general in-water shadowing problem is examined for a particular case study. Backward Monte Carlo (MC) radiative transfer computations- performed in a vertically stratified, horizontally inhomogeneous, and realistic ocean-atmosphere system are shown to accurately simulate the shadow-induced relative percent errors affecting the radiance and irradiance data profiles acquired close to an oceanographic tower. Multiparameter optical data processing has provided adequate representation of experimental uncertainties allowing consistent comparison with simulations. The more detailed simulations at the subsurface depth appear to be essentially equivalent to those obtained assuming a simplified ocean-atmosphere system, except in highly stratified waters. MC computations performed in the simplified system can be assumed, therefore, to accurately simulate the optical measurements conducted under more complex sampling conditions (i.e., within waters presenting moderate stratification at most). A previously reported correction scheme, based on the simplified MC simulations, and developed for subsurface shadow-removal processing of in-water optical data taken close to the investigated oceanographic tower, is then validated adequately under most experimental conditions. It appears feasible to generalize the present tower-specific approach to solve other optical sensor shadowing problems pertaining to differently shaped deployment platforms, and also including surrounding structures and instrument casings.

Hooker, Stanford B.↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗

MODIS Validation, Data Merger and Other Activities Accomplished by the SIMBIOS Project: 2002-2003

The purpose of this technical report is to provide current documentation of the Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) Project activities, satellite data processing, and data product validation. This documentation is necessary to ensure that critical information is related to the scientific community and NASA management. This critical information includes the technical difficulties and challenges of validating and combining ocean color data from an array of independent satellite systems to form consistent and accurate global bio-optical time series products. This technical report focuses on the SIMBIOS Project s efforts in support of the Moderate-Resolution Imaging Spectroradiometer (MODIS) on the Earth Observing System (EOS) Terra platform (similar evaluations of MODIS/Aqua are underway). This technical report is not meant as a substitute for scientific literature. Instead, it will provide a ready and responsive vehicle for the multitude of technical reports issued by an operational project.

Fargion, Giulietta S.↗

Physical Validation of TRMM TMI and PR Monthly Rain Products Over Oklahoma

The Tropical Rainfall Measuring Mission (TRMM) provides monthly rainfall estimates using data collected by the TRMM satellite. These estimates cover a substantial fraction of the earth's surface. The physical validation of TRMM estimates involves corroborating the accuracy of spaceborne estimates of areal rainfall by inferring errors and biases from ground-based rain estimates. The TRMM error budget consists of two major sources of error: retrieval and sampling. Sampling errors are intrinsic to the process of estimating monthly rainfall and occur because the satellite extrapolates monthly rainfall from a small subset of measurements collected only during satellite overpasses. Retrieval errors, on the other hand, are related to the process of collecting measurements while the satellite is overhead. One of the big challenges confronting the TRMM validation effort is how to best estimate these two main components of the TRMM error budget, which are not easily decoupled. This four-year study computed bulk sampling and retrieval errors for the TRMM microwave imager (TMI) and the precipitation radar (PR) by applying a technique that sub-samples gauge data at TRMM overpass times. Gridded monthly rain estimates are then computed from the monthly bulk statistics of the collected samples, providing a sensor-dependent gauge rain estimate that is assumed to include a TRMM equivalent sampling error. The sub-sampled gauge rain estimates are then used in conjunction with the monthly satellite and gauge (without sub- sampling) estimates to decouple retrieval and sampling errors. The computed mean sampling errors for the TMI and PR were 5.9% and 7.796, respectively, in good agreement with theoretical predictions. The PR year-to-year retrieval biases exceeded corresponding TMI biases, but it was found that these differences were partially due to negative TMI biases during cold months and positive TMI biases during warm months.

Fisher, Brad L.↗

Validation of the Poisson Stochastic Radiative Transfer Model

A new approach to validation of the Poisson stochastic radiative transfer method is proposed. In contrast to other validations of stochastic models, the main parameter of the Poisson model responsible for cloud geometrical structure - cloud aspect ratio - is determined entirely by matching measurements and calculations of the direct solar radiation. If the measurements of the direct solar radiation is unavailable, it was shown that there is a range of the aspect ratios that allows the stochastic model to accurately approximate the average measurements of surface downward and cloud top upward fluxes. Realizations of the fractionally integrated cascade model are taken as a prototype of real measurements.

Zhuravleva, Tatiana↗

Achieving and Validating the 1-centimeter Orbit: JASON-1 Precision Orbit Determination Using GPS, SLR, DORIS and Altimeter data

Jason-1, launched on December 7, 2001, is continuing the time series of centimeter level ocean topography observations as the follow-on to the highly successful TOPEX/POSEIDON (T/P) radar altimeter satellite. The precision orbit determination (POD) is a critical component to meeting the ocean topography goals of the mission. Jason-1 is no exception and has set a 1 cm radial orbit accuracy goal, which represents a factor of two improvement over what is currently being achieved for T/P. The challenge to precision orbit determination (POD) is both achieving the 1 cm radial orbit accuracy and evaluating and validating the performance of the 1 cm orbit. Fortunately, Jason-1 POD can rely on four independent tracking data types including near continuous tracking data from the dual frequency codeless BlackJack GPS receiver. In addition, to the enhanced GPS receiver, Jason-1 carries significantly improved SLR and DORIS tracking systems along with the altimeter itself. We demonstrate the 1 cm radial orbit accuracy goal has been achieved using GPS data alone in a reduced dynamic solution. It is also shown that adding SLR data to the GPS-based solutions improves the orbits even further. In order to assess the performance of these orbits it is necessary to process all of the available tracking data (GPS, SLR, DORIS and altimeter crossover differences) as either dependent or independent of the orbit solutions. It was also necessary to compute orbit solutions using various combinations of the four available tracking data in order to independently assess the orbit performance. Towards this end, we have greatly improved orbits determined solely from SLR+DORIS data by applying the reduced dynamic solution strategy. In addition, we have computed reduced dynamic orbits based on SLR, DORIS and crossover data that are a significant improvement over the SLR and DORIS based dynamic solutions. These solutions provide the best performing orbits for independent validation of the GPS-based reduced dynamic orbits.

Luthcke, Scott B.↗

Development of Modal Test Techniques for Validation of a Solar Sail Design

This paper focuses on the development of modal test techniques for validation of a solar sail gossamer space structure design. The major focus is on validating and comparing the capabilities of various excitation techniques for modal testing solar sail components. One triangular shaped quadrant of a solar sail membrane was tested in a 1 Torr vacuum environment using various excitation techniques including, magnetic excitation, and surface-bonded piezoelectric patch actuators. Results from modal tests performed on the sail using piezoelectric patches at different positions are discussed. The excitation methods were evaluated for their applicability to in-vacuum ground testing and to the development of on orbit flight test techniques. The solar sail membrane was tested in the horizontal configuration at various tension levels to assess the variation in frequency with tension in a vacuum environment. A segment of a solar sail mast prototype was also tested in ambient atmospheric conditions using various excitation techniques, and these methods are also assessed for their ground test capabilities and on-orbit flight testing.

Gaspar, James L.↗

EOS Aqua AMSR-E Arctic Sea Ice Validation Program

A coordinated Arctic sea ice validation field campaign using the NASA Wallops P-3B aircraft was successfully completed in March 2003. This campaign was part of the program for validating the Earth Observing System (EOS) Aqua Advanced Microwave Scanning Radiometer (AMSR-E) sea ice products. The AMSR-E, designed and built by the Japanese National Space Development Agency for NASA, was launched May 4,2002 on the EOS Aqua spacecraft. The AMSR-E sea ice products include sea ice concentration, sea ice temperature, and snow depth on sea ice. The primary instrument on the P-3B aircraft was the NOAA ETL Polarimetric Scanning Radiometer (PSR) covering the same frequencies and polarizations as the AMSR-E. This paper describes the objectives of each of the seven flights, the Arctic regions overflown, and the coordination among satellite, aircraft, and surface-based measurements. Two of the seven aircraft flights were coordinated with scientists making surface measurements of snow and ice properties including sea ice temperature and snow depth on sea ice at a study area near Barrow, AK and at a Navy ice camp located in the Beaufort Sea. The remaining flights covered portions of the Bering Sea ice edge, the Chukchi Sea, and Norton Sound. Comparisons among the satellite and aircraft PSR data sets are presented.

Cavalieri, D. J.↗

EOS Aqua AMSR-E Arctic Sea Ice Validation Program: Intercomparison Between Modeled and Measured Sea Ice Brightness Temperatures

During March 2003, an extensive field campaign was conducted near Barrow, Alaska to validate AQUA Advanced Microwave Scanning Radiometer (AMSR) sea ice products. Field, airborne and satellite data were collected over three different types of sea ice: 1) first year ice with little deformation, 2) first year ice with various amounts of deformation and 3) mixed first year ice and multi-year ice with various degrees of deformation. The validation plan relies primarily on comparisons between satellite, aircraft flights and ground-based measurements. Although these efforts are important, key aspects such as the effects of atmospheric conditions, snow properties, surface roughness, melt processes, etc on the sea ice algorithms are not sufficiently well understood or documented. To improve our understanding of these effects, we combined the detailed, in-situ data collection from the 2003 field campaign with radiance modeling using a radiative transfer model to simulate the top of the atmosphere AMSR brightness temperatures. This study reports on the results of the simulations for a variety of snow and ice types and compares the results with the National Oceanographic and Atmospheric Administration Environmental Technology Laboratory Polarimetric Scanning Radiometer (NOAA) (ETL) (PSR) microwave radiometer that was flown on the NASA P-3.

Stroeve, J.↗

Overview of GPM Missions's Ground Validation Program

An important element of the internationally structured Global Precipitation Measurement (GPM) mission will be its ground validation research program. Within the last year, the initial architecture of this program has taken shape. This talk will describe that architecture, both in terms of the international program and in terms of the separate regional programs of the principle participating space agencies, i.e., ESA, JAXA, and NASA. There are three overriding goals being addressed in the planning of this program; (1) establishing various new, challenging and important scientific research goals vis-a-vis current ground validation programs supporting satellite retrieval of precipitation; (2) designing the program as an international partnership which operates, out of necessity, heterogeneous sites in terms of their respective observational foci and science thrusts, but anneals itself in terms of achieving a few overarching scientific objectives; and (3) developing a well-designed protocol that allows specific sites or site networks, at their choosing, to operate in a 'supersite' mode - defined as the capability to routinely transmit GV information at low latency to GPM's Precipitation Processing System (PPS). (The PPS is being designed as GPM's data information system, a distributed data system with main centers at the Goddard Space Flight Center (GSFC) within NASA, the Earth Observation Research Center (EORC) within JAXA, and a TBD facility to be identified by the ESA s ESTEC facility in Noordwijk.)

Smith, Eric A.↗

Initial Validation of NDVI time seriesfrom AVHRR, VEGETATION, and MODIS

The paper will address Theme 7: Multi-sensor opportunities for VEGETATION. We present analysis of a long-term vegetation record derived from three moderate resolution sensors: AVHRR, VEGETATION, and MODIS. While empirically based manipulation can ensure agreement between the three data sets, there is a need to validate the series. This paper uses atmospherically corrected ETM+ data available over the EOS Land Validation Core Sites as an independent data set with which to compare the time series. We use ETM+ data from 15 globally distributed sites, 7 of which contain repeat coverage in time. These high-resolution data are compared to the values of each sensor by spatially aggregating the ETM+ to each specific sensors' spatial coverage. The aggregated ETM+ value provides a point estimate for a specific site on a specific date. The standard deviation of that point estimate is used to construct a confidence interval for that point estimate. The values from each moderate resolution sensor are then evaluated with respect to that confident interval. Result show that AVHRR, VEGETATION, and MODIS data can be combined to assess temporal uncertainties and address data continuity issues and that the atmospherically corrected ETM+ data provide an independent source with which to compare that record. The final product is a consistent time series climate record that links historical observations to current and future measurements.

Morisette, Jeffrey T.↗

Verification and Validation Methodology of Real-Time Adaptive Neural Networks for Aerospace Applications

Recent research has shown that adaptive neural based control systems are very effective in restoring stability and control of an aircraft in the presence of damage or failures. The application of an adaptive neural network with a flight critical control system requires a thorough and proven process to ensure safe and proper flight operation. Unique testing tools have been developed as part of a process to perform verification and validation (V&V) of real time adaptive neural networks used in recent adaptive flight control system, to evaluate the performance of the on line trained neural networks. The tools will help in certification from FAA and will help in the successful deployment of neural network based adaptive controllers in safety-critical applications. The process to perform verification and validation is evaluated against a typical neural adaptive controller and the results are discussed.

Gupta, Pramod↗

Validation of Methodology for Estimating Aircraft Unsteady Aerodynamic Parameters from Dynamic Wind Tunnel Tests

A basic problem in flight dynamics is the mathematical formulation of the aerodynamic model for aircraft. This study is part of an ongoing effort at NASA Langley to develop a more general formulation of the aerodynamic model for aircraft that includes nonlinear unsteady aerodynamics and to develop appropriate test techniques that facilitate identification of these models. A methodology for modeling and testing using wide-band inputs to estimate the unsteady form of the aircraft aerodynamic model was developed previously but advanced test facilities were not available at that time to allow complete validation of the methodology. The new model formulation retained the conventional static and rotary dynamic terms but replaced conventional acceleration terms with more general indicial functions. In this study advanced testing techniques were utilized to validate the new methodology for modeling. Results of static, conventional forced oscillation, wide-band forced oscillation, oscillatory coning, and ramp tests are presented.

Murphy, Patrick C.↗

Modeling and Validation of Damped Plexiglas Windows for Noise Control

Windows are a significant path for structure-borne and air-borne noise transmission in general aviation aircraft. In this paper, numerical and experimental results are used to evaluate damped plexiglas windows for the reduction of structure-borne and air-borne noise transmitted into the interior of an aircraft. In contrast to conventional homogeneous windows, the damped plexiglas windows were fabricated using two or three layers of plexiglas with transparent viscoelastic damping material sandwiched between the layers. Transmission loss and radiated sound power measurements were used to compare different layups of the damped plexiglas windows with uniform windows of the same nominal thickness. This vibro-acoustic test data was also used for the verification and validation of finite element and boundary element models of the damped plexiglas windows. Numerical models are presented for the prediction of radiated sound power for a point force excitation and transmission loss for diffuse acoustic excitation. Radiated sound power and transmission loss predictions are in good agreement with experimental data. Once validated, the numerical models were used to perform a parametric study to determine the optimum configuration of the damped plexiglas windows for reducing the radiated sound power for a point force excitation.

Buehrle, Ralph D.↗

Validation of Mars-GRAM and Planned New Features

For altitudes below 80 km, Mars Global Reference Atmospheric Model (Mars-GRAM 2001) is based on output climatology from NASA Ames Mars General Circulation Model (MGCM). At COSPAR 2002, results were presented of validation tests of Mars-GRAM versus data from Mars Global Surveyor Thermal Emission Spectrometer (TES) and Radio Science (RS) experiment. Further validation tests are presented comparing Mars- GRAM densities with those from the European Mars Climate Database (MCD), and comparing densities from both Mars-GRAM and MCD against TES observations. Throughout most of the height and latitude range of TES data (040 km and 70s to 70N), good agreement is found between atmospheric densities from Mars-GRAM and MCD. However, at the season and latitude zone for Mars Phoenix arrival and landing (Ls = 65 to 80 degrees and latitude 65 to 75N), Mars-GRAM densities are about 30 to 45 percent higher than MCD densities near 40 km altitude. Further evaluation is warranted concerning potential impact of these model differences on planning for Phoenix entry and descent. Three planned features for Mars-GRAM update are also discussed: (1) new MGCM and Thermospheric General Circulation Model data sets to be used as a revised basis for Mars-GRAM mean atmosphere, (2) a new feature to represent planetary-scale traveling waves for upper altitude density variations (such as found during Mars Odyssey aerobraking), and (3) a new model for effects of high resolution topographic slope on winds near the surface (0 to 4.5 km above MOLA topography level). Mars-GRAM slope winds will be computed from a diagnostic (algebraic) relationship based on Ye, Segal, and Pielke (1990). This approach differs from mesoscale models (such as MRAMS and Mars MM5), which use prognostic, full-physics solutions of the time- and space-dependent differential equations of motion. As such, slope winds in Mars-GRAM will be consistent with its "engineering-level" approach, and will be extremely fast and easy to evaluate, compared with mesoscale model solutions. Mars-GRAM slope winds are not being suggested as a replacement for sophisticated, full-physics Mars mesoscale models, but may have value, particularly for preliminary screening of large numbers of candidate landing sites for future Mars missions, such as Phoenix and Mars Science Laboratory. Test output is presented from Mars-GRAM slope winds in the area of Gusev Crater and Valles Marineris.

Justus, C. G.↗