Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Validation of an In-Water, Tower-Shading Correction Scheme

Large offshore structures used for the deployment of optical instruments can significantly perturb the intensity of the light field surrounding the optical measurement point, where different portions of the visible spectrum are subject to different shadowing effects. These effects degrade the quality of the acquired optical data and can reduce the accuracy of several derived quantities, such as those obtained by applying bio-optical algorithms directly to the shadow-perturbed data. As a result, optical remote sensing calibration and validation studies can be impaired if shadowing artifacts are not fully accounted for. In this work, the general in-water shadowing problem is examined for a particular case study. Backward Monte Carlo (MC) radiative transfer computations- performed in a vertically stratified, horizontally inhomogeneous, and realistic ocean-atmosphere system are shown to accurately simulate the shadow-induced relative percent errors affecting the radiance and irradiance data profiles acquired close to an oceanographic tower. Multiparameter optical data processing has provided adequate representation of experimental uncertainties allowing consistent comparison with simulations. The more detailed simulations at the subsurface depth appear to be essentially equivalent to those obtained assuming a simplified ocean-atmosphere system, except in highly stratified waters. MC computations performed in the simplified system can be assumed, therefore, to accurately simulate the optical measurements conducted under more complex sampling conditions (i.e., within waters presenting moderate stratification at most). A previously reported correction scheme, based on the simplified MC simulations, and developed for subsurface shadow-removal processing of in-water optical data taken close to the investigated oceanographic tower, is then validated adequately under most experimental conditions. It appears feasible to generalize the present tower-specific approach to solve other optical sensor shadowing problems pertaining to differently shaped deployment platforms, and also including surrounding structures and instrument casings.

Hooker, Stanford B.↗
NASA NTRS2003

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗
NASA NTRS2003

MODIS Validation, Data Merger and Other Activities Accomplished by the SIMBIOS Project: 2002-2003

The purpose of this technical report is to provide current documentation of the Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) Project activities, satellite data processing, and data product validation. This documentation is necessary to ensure that critical information is related to the scientific community and NASA management. This critical information includes the technical difficulties and challenges of validating and combining ocean color data from an array of independent satellite systems to form consistent and accurate global bio-optical time series products. This technical report focuses on the SIMBIOS Project s efforts in support of the Moderate-Resolution Imaging Spectroradiometer (MODIS) on the Earth Observing System (EOS) Terra platform (similar evaluations of MODIS/Aqua are underway). This technical report is not meant as a substitute for scientific literature. Instead, it will provide a ready and responsive vehicle for the multitude of technical reports issued by an operational project.

Fargion, Giulietta S.↗
NASA NTRS2004

Physical Validation of TRMM TMI and PR Monthly Rain Products Over Oklahoma

The Tropical Rainfall Measuring Mission (TRMM) provides monthly rainfall estimates using data collected by the TRMM satellite. These estimates cover a substantial fraction of the earth's surface. The physical validation of TRMM estimates involves corroborating the accuracy of spaceborne estimates of areal rainfall by inferring errors and biases from ground-based rain estimates. The TRMM error budget consists of two major sources of error: retrieval and sampling. Sampling errors are intrinsic to the process of estimating monthly rainfall and occur because the satellite extrapolates monthly rainfall from a small subset of measurements collected only during satellite overpasses. Retrieval errors, on the other hand, are related to the process of collecting measurements while the satellite is overhead. One of the big challenges confronting the TRMM validation effort is how to best estimate these two main components of the TRMM error budget, which are not easily decoupled. This four-year study computed bulk sampling and retrieval errors for the TRMM microwave imager (TMI) and the precipitation radar (PR) by applying a technique that sub-samples gauge data at TRMM overpass times. Gridded monthly rain estimates are then computed from the monthly bulk statistics of the collected samples, providing a sensor-dependent gauge rain estimate that is assumed to include a TRMM equivalent sampling error. The sub-sampled gauge rain estimates are then used in conjunction with the monthly satellite and gauge (without sub- sampling) estimates to decouple retrieval and sampling errors. The computed mean sampling errors for the TMI and PR were 5.9% and 7.796, respectively, in good agreement with theoretical predictions. The PR year-to-year retrieval biases exceeded corresponding TMI biases, but it was found that these differences were partially due to negative TMI biases during cold months and positive TMI biases during warm months.

Fisher, Brad L.↗
NASA NTRS2004

Validation of the Poisson Stochastic Radiative Transfer Model

A new approach to validation of the Poisson stochastic radiative transfer method is proposed. In contrast to other validations of stochastic models, the main parameter of the Poisson model responsible for cloud geometrical structure - cloud aspect ratio - is determined entirely by matching measurements and calculations of the direct solar radiation. If the measurements of the direct solar radiation is unavailable, it was shown that there is a range of the aspect ratios that allows the stochastic model to accurately approximate the average measurements of surface downward and cloud top upward fluxes. Realizations of the fractionally integrated cascade model are taken as a prototype of real measurements.

Zhuravleva, Tatiana↗
NASA NTRS2003

Achieving and Validating the 1-centimeter Orbit: JASON-1 Precision Orbit Determination Using GPS, SLR, DORIS and Altimeter data

Jason-1, launched on December 7, 2001, is continuing the time series of centimeter level ocean topography observations as the follow-on to the highly successful TOPEX/POSEIDON (T/P) radar altimeter satellite. The precision orbit determination (POD) is a critical component to meeting the ocean topography goals of the mission. Jason-1 is no exception and has set a 1 cm radial orbit accuracy goal, which represents a factor of two improvement over what is currently being achieved for T/P. The challenge to precision orbit determination (POD) is both achieving the 1 cm radial orbit accuracy and evaluating and validating the performance of the 1 cm orbit. Fortunately, Jason-1 POD can rely on four independent tracking data types including near continuous tracking data from the dual frequency codeless BlackJack GPS receiver. In addition, to the enhanced GPS receiver, Jason-1 carries significantly improved SLR and DORIS tracking systems along with the altimeter itself. We demonstrate the 1 cm radial orbit accuracy goal has been achieved using GPS data alone in a reduced dynamic solution. It is also shown that adding SLR data to the GPS-based solutions improves the orbits even further. In order to assess the performance of these orbits it is necessary to process all of the available tracking data (GPS, SLR, DORIS and altimeter crossover differences) as either dependent or independent of the orbit solutions. It was also necessary to compute orbit solutions using various combinations of the four available tracking data in order to independently assess the orbit performance. Towards this end, we have greatly improved orbits determined solely from SLR+DORIS data by applying the reduced dynamic solution strategy. In addition, we have computed reduced dynamic orbits based on SLR, DORIS and crossover data that are a significant improvement over the SLR and DORIS based dynamic solutions. These solutions provide the best performing orbits for independent validation of the GPS-based reduced dynamic orbits.

Luthcke, Scott B.↗
NASA NTRS2004

Development of Modal Test Techniques for Validation of a Solar Sail Design

This paper focuses on the development of modal test techniques for validation of a solar sail gossamer space structure design. The major focus is on validating and comparing the capabilities of various excitation techniques for modal testing solar sail components. One triangular shaped quadrant of a solar sail membrane was tested in a 1 Torr vacuum environment using various excitation techniques including, magnetic excitation, and surface-bonded piezoelectric patch actuators. Results from modal tests performed on the sail using piezoelectric patches at different positions are discussed. The excitation methods were evaluated for their applicability to in-vacuum ground testing and to the development of on orbit flight test techniques. The solar sail membrane was tested in the horizontal configuration at various tension levels to assess the variation in frequency with tension in a vacuum environment. A segment of a solar sail mast prototype was also tested in ambient atmospheric conditions using various excitation techniques, and these methods are also assessed for their ground test capabilities and on-orbit flight testing.

Gaspar, James L.↗
NASA NTRS2004

EOS Aqua AMSR-E Arctic Sea Ice Validation Program

A coordinated Arctic sea ice validation field campaign using the NASA Wallops P-3B aircraft was successfully completed in March 2003. This campaign was part of the program for validating the Earth Observing System (EOS) Aqua Advanced Microwave Scanning Radiometer (AMSR-E) sea ice products. The AMSR-E, designed and built by the Japanese National Space Development Agency for NASA, was launched May 4,2002 on the EOS Aqua spacecraft. The AMSR-E sea ice products include sea ice concentration, sea ice temperature, and snow depth on sea ice. The primary instrument on the P-3B aircraft was the NOAA ETL Polarimetric Scanning Radiometer (PSR) covering the same frequencies and polarizations as the AMSR-E. This paper describes the objectives of each of the seven flights, the Arctic regions overflown, and the coordination among satellite, aircraft, and surface-based measurements. Two of the seven aircraft flights were coordinated with scientists making surface measurements of snow and ice properties including sea ice temperature and snow depth on sea ice at a study area near Barrow, AK and at a Navy ice camp located in the Beaufort Sea. The remaining flights covered portions of the Bering Sea ice edge, the Chukchi Sea, and Norton Sound. Comparisons among the satellite and aircraft PSR data sets are presented.

Cavalieri, D. J.↗
NASA NTRS2004

EOS Aqua AMSR-E Arctic Sea Ice Validation Program: Intercomparison Between Modeled and Measured Sea Ice Brightness Temperatures

During March 2003, an extensive field campaign was conducted near Barrow, Alaska to validate AQUA Advanced Microwave Scanning Radiometer (AMSR) sea ice products. Field, airborne and satellite data were collected over three different types of sea ice: 1) first year ice with little deformation, 2) first year ice with various amounts of deformation and 3) mixed first year ice and multi-year ice with various degrees of deformation. The validation plan relies primarily on comparisons between satellite, aircraft flights and ground-based measurements. Although these efforts are important, key aspects such as the effects of atmospheric conditions, snow properties, surface roughness, melt processes, etc on the sea ice algorithms are not sufficiently well understood or documented. To improve our understanding of these effects, we combined the detailed, in-situ data collection from the 2003 field campaign with radiance modeling using a radiative transfer model to simulate the top of the atmosphere AMSR brightness temperatures. This study reports on the results of the simulations for a variety of snow and ice types and compares the results with the National Oceanographic and Atmospheric Administration Environmental Technology Laboratory Polarimetric Scanning Radiometer (NOAA) (ETL) (PSR) microwave radiometer that was flown on the NASA P-3.

Stroeve, J.↗
NASA NTRS2004

Overview of GPM Missions's Ground Validation Program

An important element of the internationally structured Global Precipitation Measurement (GPM) mission will be its ground validation research program. Within the last year, the initial architecture of this program has taken shape. This talk will describe that architecture, both in terms of the international program and in terms of the separate regional programs of the principle participating space agencies, i.e., ESA, JAXA, and NASA. There are three overriding goals being addressed in the planning of this program; (1) establishing various new, challenging and important scientific research goals vis-a-vis current ground validation programs supporting satellite retrieval of precipitation; (2) designing the program as an international partnership which operates, out of necessity, heterogeneous sites in terms of their respective observational foci and science thrusts, but anneals itself in terms of achieving a few overarching scientific objectives; and (3) developing a well-designed protocol that allows specific sites or site networks, at their choosing, to operate in a 'supersite' mode - defined as the capability to routinely transmit GV information at low latency to GPM's Precipitation Processing System (PPS). (The PPS is being designed as GPM's data information system, a distributed data system with main centers at the Goddard Space Flight Center (GSFC) within NASA, the Earth Observation Research Center (EORC) within JAXA, and a TBD facility to be identified by the ESA s ESTEC facility in Noordwijk.)

Smith, Eric A.↗
NASA NTRS2004

Initial Validation of NDVI time seriesfrom AVHRR, VEGETATION, and MODIS

The paper will address Theme 7: Multi-sensor opportunities for VEGETATION. We present analysis of a long-term vegetation record derived from three moderate resolution sensors: AVHRR, VEGETATION, and MODIS. While empirically based manipulation can ensure agreement between the three data sets, there is a need to validate the series. This paper uses atmospherically corrected ETM+ data available over the EOS Land Validation Core Sites as an independent data set with which to compare the time series. We use ETM+ data from 15 globally distributed sites, 7 of which contain repeat coverage in time. These high-resolution data are compared to the values of each sensor by spatially aggregating the ETM+ to each specific sensors' spatial coverage. The aggregated ETM+ value provides a point estimate for a specific site on a specific date. The standard deviation of that point estimate is used to construct a confidence interval for that point estimate. The values from each moderate resolution sensor are then evaluated with respect to that confident interval. Result show that AVHRR, VEGETATION, and MODIS data can be combined to assess temporal uncertainties and address data continuity issues and that the atmospherically corrected ETM+ data provide an independent source with which to compare that record. The final product is a consistent time series climate record that links historical observations to current and future measurements.

Morisette, Jeffrey T.↗
NASA NTRS2004

Verification and Validation Methodology of Real-Time Adaptive Neural Networks for Aerospace Applications

Recent research has shown that adaptive neural based control systems are very effective in restoring stability and control of an aircraft in the presence of damage or failures. The application of an adaptive neural network with a flight critical control system requires a thorough and proven process to ensure safe and proper flight operation. Unique testing tools have been developed as part of a process to perform verification and validation (V&V) of real time adaptive neural networks used in recent adaptive flight control system, to evaluate the performance of the on line trained neural networks. The tools will help in certification from FAA and will help in the successful deployment of neural network based adaptive controllers in safety-critical applications. The process to perform verification and validation is evaluated against a typical neural adaptive controller and the results are discussed.

Gupta, Pramod↗
NASA NTRS2003

Validation of Methodology for Estimating Aircraft Unsteady Aerodynamic Parameters from Dynamic Wind Tunnel Tests

A basic problem in flight dynamics is the mathematical formulation of the aerodynamic model for aircraft. This study is part of an ongoing effort at NASA Langley to develop a more general formulation of the aerodynamic model for aircraft that includes nonlinear unsteady aerodynamics and to develop appropriate test techniques that facilitate identification of these models. A methodology for modeling and testing using wide-band inputs to estimate the unsteady form of the aircraft aerodynamic model was developed previously but advanced test facilities were not available at that time to allow complete validation of the methodology. The new model formulation retained the conventional static and rotary dynamic terms but replaced conventional acceleration terms with more general indicial functions. In this study advanced testing techniques were utilized to validate the new methodology for modeling. Results of static, conventional forced oscillation, wide-band forced oscillation, oscillatory coning, and ramp tests are presented.

Murphy, Patrick C.↗
NASA NTRS2003

Modeling and Validation of Damped Plexiglas Windows for Noise Control

Windows are a significant path for structure-borne and air-borne noise transmission in general aviation aircraft. In this paper, numerical and experimental results are used to evaluate damped plexiglas windows for the reduction of structure-borne and air-borne noise transmitted into the interior of an aircraft. In contrast to conventional homogeneous windows, the damped plexiglas windows were fabricated using two or three layers of plexiglas with transparent viscoelastic damping material sandwiched between the layers. Transmission loss and radiated sound power measurements were used to compare different layups of the damped plexiglas windows with uniform windows of the same nominal thickness. This vibro-acoustic test data was also used for the verification and validation of finite element and boundary element models of the damped plexiglas windows. Numerical models are presented for the prediction of radiated sound power for a point force excitation and transmission loss for diffuse acoustic excitation. Radiated sound power and transmission loss predictions are in good agreement with experimental data. Once validated, the numerical models were used to perform a parametric study to determine the optimum configuration of the damped plexiglas windows for reducing the radiated sound power for a point force excitation.

Buehrle, Ralph D.↗
NASA NTRS2004

Validation of Mars-GRAM and Planned New Features

For altitudes below 80 km, Mars Global Reference Atmospheric Model (Mars-GRAM 2001) is based on output climatology from NASA Ames Mars General Circulation Model (MGCM). At COSPAR 2002, results were presented of validation tests of Mars-GRAM versus data from Mars Global Surveyor Thermal Emission Spectrometer (TES) and Radio Science (RS) experiment. Further validation tests are presented comparing Mars- GRAM densities with those from the European Mars Climate Database (MCD), and comparing densities from both Mars-GRAM and MCD against TES observations. Throughout most of the height and latitude range of TES data (040 km and 70s to 70N), good agreement is found between atmospheric densities from Mars-GRAM and MCD. However, at the season and latitude zone for Mars Phoenix arrival and landing (Ls = 65 to 80 degrees and latitude 65 to 75N), Mars-GRAM densities are about 30 to 45 percent higher than MCD densities near 40 km altitude. Further evaluation is warranted concerning potential impact of these model differences on planning for Phoenix entry and descent. Three planned features for Mars-GRAM update are also discussed: (1) new MGCM and Thermospheric General Circulation Model data sets to be used as a revised basis for Mars-GRAM mean atmosphere, (2) a new feature to represent planetary-scale traveling waves for upper altitude density variations (such as found during Mars Odyssey aerobraking), and (3) a new model for effects of high resolution topographic slope on winds near the surface (0 to 4.5 km above MOLA topography level). Mars-GRAM slope winds will be computed from a diagnostic (algebraic) relationship based on Ye, Segal, and Pielke (1990). This approach differs from mesoscale models (such as MRAMS and Mars MM5), which use prognostic, full-physics solutions of the time- and space-dependent differential equations of motion. As such, slope winds in Mars-GRAM will be consistent with its "engineering-level" approach, and will be extremely fast and easy to evaluate, compared with mesoscale model solutions. Mars-GRAM slope winds are not being suggested as a replacement for sophisticated, full-physics Mars mesoscale models, but may have value, particularly for preliminary screening of large numbers of candidate landing sites for future Mars missions, such as Phoenix and Mars Science Laboratory. Test output is presented from Mars-GRAM slope winds in the area of Gusev Crater and Valles Marineris.

Justus, C. G.↗
NASA NTRS2004

Methods for Validation and Intercomparison of Remote Sensing and In situ Ice Water Measurements: Case Studies from CRYSTAL-FACE and Model Results

Remote sensing observations, such as those from AURA, are necessary to understand the role of cirrus in determining the radiative and humidity budgets of the upper troposphere. Using these measurements quantitatively requires comparisons with in situ measurements that have previously been validated. However, a direct comparison of remote and in situ measurements is difficult due to the requirement that the spatial and temporal overlap be sufficient in order to guarantee that both instruments are measuring the same air parcel. A difficult as this might be for gas phase intercomparisons, cloud inhomogeneities significantly exacerbate the problem for cloud ice water content measurements. The CRYSTAL-FACE mission provided an opportunity to assess how well such intercomparisons can be performed and to establish flight plans that will be necessary for validation of future satellite instruments. During CRYSTAL-FACE, remote and in situ instruments were placed on different aircraft (NASA's ER-2 and WB-59, and the two planes flew in tandem so that the in situ payload flew in the field of view of the remote instruments. We show here that, even with this type of careful flight planning, it is not always possible to guarantee that remote and in situ instruments are viewing the same air parcel. We use ice water data derived from the in situ Harvard Total Water (HV-TW) instrument, and the remote Goddard Cloud Radar System (CRS) and show that agreement between HV-TW and CRS is a strong function of the horizontal separation and the time delay between the aircraft transects. We also use a cloud model to simulate possible trajectories through a cloud and evaluate the use of statistical analysis in determining the agreement between the two instruments. This type of analysis should guide flight planning for future intercomparison efforts, whether for aircraft or satellite-borne instrumentation.

Sayres, D.S.↗
NASA NTRS2004

Validation of an Impedance Education Method in Flow

This paper reports results of a research effort to validate a method for educing the normal incidence impedance of a locally reacting liner, located in a grazing incidence, nonprogressive acoustic wave environment with flow. The results presented in this paper test the ability of the method to reproduce the measured normal incidence impedance of a solid steel plate and two soft test liners in a uniform flow. The test liners are known to be locally react- ing and exhibit no measurable amplitude-dependent impedance nonlinearities or flow effects. Baseline impedance spectra for these liners were therefore established from measurements in a conventional normal incidence impedance tube. A key feature of the method is the expansion of the unknown impedance function as a piecewise continuous polynomial with undetermined coefficients. Stewart's adaptation of the Davidon-Fletcher-Powell optimization algorithm is used to educe the normal incidence impedance at each Mach number by optimizing an objective function. The method is shown to reproduce the measured normal incidence impedance spectrum for each of the test liners, thus validating its usefulness for determining the normal incidence impedance of test liners for a broad range of source frequencies and flow Mach numbers. Nomenclature

Watson, Willie R.↗
NASA NTRS2004

Validation of SCIAMACHY and TOMS UV Radiances Using Ground and Space Observations

Verification of a stratospheric ozone recovery remains a high priority for environmental research and policy definition. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify its recovery. We show that validation of satellite radiances from space and from the ground can be a very effective means for correcting long term drifts of backscatter type satellite measurements and can be used to cross calibrate all B W instruments in orbit (TOMS, SBW/2, GOME, SCIAMACHY, OM, GOME-2, OMPS). This method bypasses the retrieval algorithms used for both satellite and ground based measurements that are normally used to validate and correct the satellite data. Radiance comparisons employ forward models and are inherently more accurate than inverse (retrieval) algorithms. This approach however requires well calibrated instruments and an accurate radiative transfer model that accounts for aerosols. TOMS and SCIAMACHY calibrations are checked to demonstrate this method and to demonstrate applicability for long term trends.

Hilsenrath, E.↗