Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

The Use of Transfer Radiometers in Validating the Visible through Shortwave Infrared Calibrations of Radiance Sources Used by Instruments in NASA's Earth Observing System

The detection and study of climate change over a time frame of decades requires successive generations of satellite, airborne, and ground-based instrumentation carefully calibrated against a common radiance scale. In NASA s Earth Observing System (EOS) program, the pre-launch radiometric calibration of these instruments in the wavelength region from 400 nm to 2500 nm is accomplished using internally illuminated integrating spheres and diffuse reflectance panels illuminated by irradiance standard lamps. Since 1995, the EOS Calibration Program operating within the EOS Project Science Office (PSO) has enlisted the expertise of national standards laboratories and government and university metrology laboratories in an effort to validate the radiance scales assigned to sphere and panel radiance sources by EOS instrument calibration facilities. This state-of-the-art program has been accomplished using ultra-stable transfer radiometers independently calibrated by the above participating institutions. In ten comparisons since February 1995, the agreement between the radiance measurements of the transfer radiometers is plus or minus 1.80% at 411 nm, plus or minus 1.31% at 552.5 nm, plus or minus 1.32% at 868.0 nm, plus or minus 2.54% at 1622nm, and plus or minus 2.81% at 2200nm (sigma =1).

Butler, James J.↗

Validation of Force Limited Vibration Testing at NASA Langley Research Center

Vibration tests were performed to develop and validate the forced limited vibration testing capability at the NASA Langley Research Center. The force limited vibration test technique has been utilized at the Jet Propulsion Laboratory and other NASA centers to provide more realistic vibration test environments for aerospace flight hardware. In standard random vibration tests, the payload is mounted to a rigid fixture and the interface acceleration is controlled to a specified level based on a conservative estimate of the expected flight environment. In force limited vibration tests, both the acceleration and force are controlled at the mounting interface to compensate for differences between the flexible flight mounting and rigid test fixture. This minimizes the over test at the payload natural frequencies and results in more realistic forces being transmitted at the mounting interface. Force and acceleration response data was provided by NASA Goddard Space Flight Center for a test article that was flown in 1998 on a Black Brant sounding rocket. The measured flight interface acceleration data was used as the reference acceleration spectrum. Using this acceleration spectrum, three analytical methods were used to estimate the force limits. Standard random and force limited vibration tests were performed and the results are compared with the flight data.

Rice, Chad↗

Countermeasure Evaluation and Validation Project (CEVP) Database Requirement Documentation

The initial focus of the project by the JSC laboratories will be to develop, test and implement a standardized complement of integrated physiological test (Integrated Testing Regimen, ITR) that will examine both system and intersystem function, and will be used to validate and certify candidate countermeasures. The ITR will consist of medical requirements (MRs) and non-MR core ITR tests, and countermeasure-specific testing. Non-MR and countermeasure-specific test data will be archived in a database specific to the CEVP. Development of a CEVP Database will be critical to documenting the progress of candidate countermeasures. The goal of this work is a fully functional software system that will integrate computer-based data collection and storage with secure, efficient, and practical distribution of that data over the Internet. This system will provide the foundation of a new level of interagency and international cooperation for scientific experimentation and research, providing intramural, international, and extramural collaboration through management and distribution of the CEVP data. The research performed this summer includes the first phase of the project. The first phase of the project is a requirements analysis. This analysis will identify the expected behavior of the system under normal conditions and abnormal conditions; that could affect the system's ability to produce this behavior; and the internal features in the system needed to reduce the risk of unexpected or unwanted behaviors. The second phase of this project have also performed in this summer. The second phase of project is the design of data entry screen and data retrieval screen for a working model of the Ground Data Database. The final report provided the requirements for the CEVP system in a variety of ways, so that both the development team and JSC technical management have a thorough understanding of how the system is expected to behave.

Shin, Sung Y.↗

The MODIS Aerosol Algorithm, Products and Validation

The MODerate resolution Imaging Spectroradiometer (MODIS) aboard both NASA's Terra and Aqua satellites is making near global daily observations of the earth in a wide spectral range. These measurements are used to derive spectral aerosol optical thickness and aerosol size parameters over both land and ocean. The aerosol products available over land include aerosol optical thickness at three visible wavelengths, a measure of the fraction of aerosol optical thickness attributed to the fine mode and several derived parameters including reflected spectral solar flux at top of atmosphere. Over ocean, the aerosol optical thickness is provided in seven wavelengths from 0.47 microns to 2.13 microns. In addition, quantitative aerosol size information includes effective radius of the aerosol and quantitative fraction of optical thickness attributed to the fine mode. Spectral aerosol flux, mass concentration and number of cloud condensation nuclei round out the list of available aerosol products over the ocean. The spectral optical thickness and effective radius of the aerosol over the ocean are validated by comparison with two years of AERONET data gleaned from 133 AERONET stations. 8000 MODIS aerosol retrievals colocated with AERONET measurements confirm that one-standard deviation of MODIS optical thickness retrievals fall within the predicted uncertainty of delta tauapproximately equal to plus or minus 0.03 plus or minus 0.05 tau over ocean and delta tay equal to plus or minus 0.05 plus or minus 0.15 tau over land. 271 MODIS aerosol retrievals co-located with AERONET inversions at island and coastal sites suggest that one-standard deviation of MODIS effective radius retrievals falls within delta r_eff approximately equal to 0.11 microns. The accuracy of the MODIS retrievals suggests that the product can be used to help narrow the uncertainties associated with aerosol radiative forcing of global climate.

Remer, L. A.↗

An Analysis of Measured Pressure Signatures From Two Theory-Validation Low-Boom Models

Two wing/fuselage/nacelle/fin concepts were designed to check the validity and the applicability of sonic-boom minimization theory, sonic-boom analysis methods, and low-boom design methodology in use at the end of the 1980is. Models of these concepts were built, and the pressure signatures they generated were measured in the wind-tunnel. The results of these measurements lead to three conclusions: (1) the existing methods could adequately predict sonic-boom characteristics of wing/fuselage/fin(s) configurations if the equivalent area distributions of each component were smooth and continuous; (2) these methods needed revision so the engine-nacelle volume and the nacelle-wing interference lift disturbances could be accurately predicted; and (3) current nacelle-configuration integration methods had to be updated. With these changes in place, the existing sonic-boom analysis and minimization methods could be effectively applied to supersonic-cruise concepts for acceptable/tolerable sonic-boom overpressures during cruise.

Mack, Robert J.↗

Temperature Data Assimilation with Salinity Corrections: Validation for the NSIPP Ocean Data Assimilation System in the Tropical Pacific Ocean, 1993-1998

The NASA Seasonal-to-Interannual Prediction Project (NSIPP) has developed an Ocean data assimilation system to initialize the quasi-isopycnal ocean model used in our experimental coupled-model forecast system. Initial tests of the system have focused on the assimilation of temperature profiles in an optimal interpolation framework. It is now recognized that correction of temperature only often introduces spurious water masses. The resulting density distribution can be statically unstable and also have a detrimental impact on the velocity distribution. Several simple schemes have been developed to try to correct these deficiencies. Here the salinity field is corrected by using a scheme which assumes that the temperature-salinity relationship of the model background is preserved during the assimilation. The scheme was first introduced for a zlevel model by Troccoli and Haines (1999). A large set of subsurface observations of salinity and temperature is used to cross-validate two data assimilation experiments run for the 6-year period 1993-1998. In these two experiments only subsurface temperature observations are used, but in one case the salinity field is also updated whenever temperature observations are available.

Troccoli, Alberto↗

The Updated Umkehr Ozone Retrieval Algorithm and its Validation against Satellite Data

Improvements to the Umkehr ozone profile retrieval algorithm have been developed and are now being evaluated. The updated algorithm is able to simulate observations more accurately and provides data output that is easier to analyze. Among the new diagnostic capabilities that the updated algorithm provides is the averaging kernel (AK) method. The AK approach allows studying how the algorithm responds when a small perturbation is made in a particular layer of the atmosphere [Rodgers 1976, 1990]. We will use the AK method to define precisely what Umkehr should measure given a set of profiles measured by other platforms. This method allows us to compare trends and offsets in data more accurately than it has been done in the past. The updated Umkehr retrievals will be validated against SAGE II ozone profiles as well as SSBUV ozone profile data. We will discuss possible reasons for offset between data and differences in derived ozone profile trends. Considerable variability of the ozone profile within the 10-degree latitude envelope creates noise in the SAGE matching dataset and makes comparisons difficult. To eliminate this problem, the SAGE and Umkehr data had been previously de-seasonalized by subtracting the latitude/season dependent ozone climatology. However, the remaining noise in the ozone residuals was still considerably high for trend analysis and was attributed to longitude variability of SAGE sampling. The new ozone climatology (Labow, NASA) that has longitude dependent ozone variability will be used to minimize contribution of sampling noise in comparisons of satellite and ground station. The comparison of zenith-sky radiances (Umkehr N-value measurements) synthesized for a given set of SAGE profiles will be used to determine whether SAGE-derived N-values agree with the Umkehr-measured N-values. The instrumental effects will be discussed. Both the Umkehr data and SAGE II measurements will be analyzed for their information about ozone variability and loss and recovery rates at the mid- and upper (40 km) levels. The updated long-term Umkehr dataset can be used to provide high quality information for identifying signs of ozone recovery. The long Umkehr historical record can provide additional information for separating the dynamic and chemical mechanisms of depletion, and can help the community better understand climate change effects.

Petropavlovskikh, I.↗

Validation of Variations in Mental Workload as a Function of Scenario Difficulty: Traffic Density and Visibility

Fluctuations in mental workload can be expected as a function of traffic density and visibility. The aim of the current investigation was to establish simulation scenarios that differed in attentional processing requirements. Four scenarios were created and tested representing two levels of traffic density (urban versus freeway) and two levels of visibility (clear versus foggy). An array of mental workload assessment measures were used to exam changes in attentional processing requirements in each scenario. The assessment array consisted of physiological (P300 amplitude and latency) and behavioral (RT and accuracy) indices. Preliminary results indicate that workload differs significantly as a function of traffic density in rural versus freeway scenarios. Workload also differs significantly in rural versus freeway scenarios as a function of visibility as observed by a significant interaction between the two variables of interest. Results are discussed in terms of their application for validating the difficulty level of simulation scenarios as a format for examining mental workload.

Source record↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

We report on a study to determine the maturity of different verification and validation technologies (V&V) on a representative example of NASA flight software. The study consisted of a controlled experiment where three technologies (static analysis, runtime analysis and model checking) were compared to traditional testing with respect to their ability to find seeded errors in a prototype Mars Rover. What makes this study unique is that it is the first (to the best of our knowledge) to do a controlled experiment to compare formal methods based tools to testing on a realistic industrial-size example where the emphasis was on collecting as much data on the performance of the tools and the participants as possible. The paper includes a description of the Rover code that was analyzed, the tools used as well as a detailed description of the experimental setup and the results. Due to the complexity of setting up the experiment, our results can not be generalized, but we believe it can still serve as a valuable point of reference for future studies of this kind. It did confirm the belief we had that advanced tools can outperform testing when trying to locate concurrency errors. Furthermore the results of the experiment inspired a novel framework for testing the next generation of the Rover.

Brat, Guillaume↗

Synthesis of Multispectral Bands from Hyperspectral Data: Validation Based on Images Acquired by AVIRIS, Hyperion, ALI, and ETM+

Spectral band synthesis is a key step in the process of creating a simulated multispectral image from hyperspectral data. In this step, narrow hyperspectral bands are combined into broader multispectral bands. Such an approach has been used quite often, but to the best of our knowledge accuracy of the band synthesis simulations has not been evaluated thus far. Therefore, the main goal of this paper is to provide validation of the spectral band synthesis algorithm used in the ART software. The next section contains a description of the algorithm and an example of its application. Using spectral responses of AVIRIS, Hyperion, ALI, and ETM+, the following section shows how the synthesized spectral bands compare with actual bands, and it presents an evaluation of the simulation accuracy based on results of MODTRAN modeling. In the final sections of the paper, simulated images are compared with data acquired by actual satellite sensors. First, a Landsat 7 ETM+ image is simulated using an AVIRIS hyperspectral data cube. Then, two datasets collected with the Hyperion instrument from the EO-1 satellite are used to simulate multispectral images from the ALI and ETM+ sensors.

Blonski, Slawomir↗

Validating NASA's Airborne Multikilohertz Microlaser Altimeter (Microaltimeter) by Direct Comparison of Data Taken Over Ocean City, Maryland Against an Existing Digital Elevation Model

NASA's Airborne Multikilohertz Microlaser Altimeter (Microaltimeter) is a scanning, photon-counting laser altimeter, which uses a low energy (less than 10 microJuoles), high repetition rate (approximately 10 kHz) laser, transmitting at 532 nm. A 14 cm diameter telescope images the ground return onto a segmented anode photomultiplier, which provides up to 16 range returns for each fire. Multiple engineering flights were made during 2001 and 2002 over the Maryland and Virginia coastal area, all during daylight hours. Post-processing of the data to geolocate the laser footprint and determine the terrain height requires post- detection Poisson filtering techniques to extract the actual ground returns from the noise. Validation of the instrument's ability to produce accurate terrain heights will be accomplished by direct comparison of data taken over Ocean City, Maryland with a Digital Elevation Model (DEM) of the region produced at Ohio State University (OSU) from other laser altimeter and photographic sources. The techniques employed to produce terrain heights from the Microaltimeter ranges will be shown, along with some preliminary comparisons with the OSU DEM.

Abel, Peter↗

Synthesis of Multispectral Bands from Hyperspectral Data: Validation Based on Images Acquired by AVIRIS, Hyperion, ALI, and ETM+

Multispectral data requirements for Earth science applications are not always studied rigorously studied before a new remote sensing system is designed. A study of the spatial resolution, spectral bandpasses, and radiometric sensitivity requirements of real-world applications would focus the design onto providing maximum benefits to the end-user community. To support systematic studies of multispectral data requirements, the Applications Research Toolbox (ART) has been developed at NASA's Stennis Space Center. The ART software allows users to create and assess simulated datasets while varying a wide range of system parameters. The simulations are based on data acquired by existing multispectral and hyperspectral instruments. The produced datasets can be further evaluated for specific end-user applications. Spectral synthesis of multispectral images from hyperspectral data is a key part of the ART software. In this process, hyperspectral image cubes are transformed into multispectral imagery without changes in spatial sampling and resolution. The transformation algorithm takes into account spectral responses of both the synthesized, broad, multispectral bands and the utilized, narrow, hyperspectral bands. To validate the spectral synthesis algorithm, simulated multispectral images are compared with images collected near-coincidentally by the Landsat 7 ETM+ and the EO-1 ALI instruments. Hyperspectral images acquired with the airborne AVIRIS instrument and with the Hyperion instrument onboard the EO-1 satellite were used as input data to the presented simulations.

Blonksi, Slawomir↗

The MODIS Aerosol Algorithm, Products, Validation and Applications

The MODerate resolution Imaging Spectroradiometer (MODIS) currently aboard both the Terra and Aqua satellites produces a suite of products designed to characterize global aerosol distribution, optical thickness and particle size. Never before has a space-borne instrument been able to provide such detailed information, complementing field and modeling efforts to produce a comprehensive picture of aerosol characteristics. The three years of Terra-MODIS data have been validated by comparing with co-located AERONET observations of aerosol optical thickness and derivations of aerosol size parameters. Some 8000 comparison points located at 133 AERONET sites around the globe show that the MODIS aerosol optical thickness retrievals are accurate to within the pre-launch expectations. MODIS-derived size parameters are also compared with AERONET retrievals and found to agree well for fine-mode dominated aerosol regimes. Aerosol regimes dominated by dust aerosol are less accurate, attributed to what is thought to be nonsphericity. Errors due to nonsphericity will be reduced by introducing a new set of empirical phase functions, derived without any assumptions of particle shape. The major innovation that MODIS bring to the field of remote sensing of aerosol is the measure of particle size and the separation of finemode and coarsemode dominated aerosol regimes. Particle size can separate finemode man-made aerosols created during combustion, from larger natural aerosols originating from salt spray or wind erosion. This separation allows for the calculation of aerosol radiative effect and the estimation of the man-made aerosol radiative forcing. MODIS can also be used in regional studies of aerosol-cloud interaction that affect the global radiative and hydrological cycles.

Remer, L. A.↗

Acquisition and Analysis of NASA Ames Sunphotometer Measurements during SAGE III Validation Campaigns and other Tropospheric and Stratospheric Research Missions

NASA Cooperative Agreement NCC2-1251 provided funding from April 2001 through December 2003 for Mr. John Livingston of SRI International to collaborate with NASA Ames Research Center scientists and engineers in the acquisition and analysis of airborne sunphotometer measurements during various atmospheric field studies. Mr. Livingston participated in instrument calibrations at Mauna Loa Observatory, pre-mission hardware and software preparations, acquisition and analysis of sunphotometer measurements during the missions, and post-mission analysis of data and reporting of scientific findings. The atmospheric field missions included the spring 2001 Intensive of the Asian Pacific Regional Aerosol Characterization Experiment (ACE-Asia), the Asian Dust Above Monterey-2003 (ADAM-2003) experiment, and the winter 2003 Second SAGE III Ozone Loss and Validation Experiment (SOLVE II).

Livingston, John M.↗

Pulsed Inductive Thruster (PIT): Modeling and Validation Using the MACH2 Code

Numerical modeling of the Pulsed Inductive Thruster exercising the magnetohydrodynamics code, MACH2 aims to provide bilateral validation of the thruster's measured performance and the code's capability of capturing the pertinent physical processes. Computed impulse values for helium and argon propellants demonstrate excellent correlation to the experimental data for a range of energy levels and propellant-mass values. The effects of the vacuum tank wall and massinjection scheme were investigated to show trivial changes in the overall performance. An idealized model for these energy levels and propellants deduces that the energy expended to the internal energy modes and plasma dissipation processes is independent of the propellant type, mass, and energy level.

Schneider, Steven↗

Real-Time Embedded Software Verification and Validation 2001

As the space applications become more complex and timing constraints on control actions are more stringent, the task of integrating and testing NASA's real-time systems (such as X-38 Crew Return Vehicle, and certain International Space Station autonomous systems) has become a great challenge. A testing environment where can preserve consistent temporal behaviors as in the target execution must be established for system-level verification and software quality assurance. Our goal is to develop an analysis suite for validation and verification of real-time systems that are used to perform human- in-the-loop control operations during safety-critical missions. The suite will be able to carry out quantitative approaches of coverage diagnostic and temporal behavior evaluation in order to measure test coverage, to optimize test utilization, and to verify timing correctness.

Lee, Yann-Hang↗

Modeling and Validation of a Propellant Mixer for Controller Design

A mixing chamber used in rocket engine testing at the NASA Stennis Space Center is modelled by a system of two nonlinear ordinary differential equations. The mixer is used to condition the thermodynamic properties of cryogenic liquid propellant by controlled injection of the same substance in the gaseous phase. The three inputs of the mixer are the positions of the valves regulating the liquid and gas flows at the inlets, and the position of the exit valve regulating the flow of conditioned propellant. Mixer operation during a test requires the regulation of its internal pressure, exit mass flow, and exit temperature. A mathematical model is developed to facilitate subsequent controller designs. The model must be simple enough to lend itself to subsequent feedback controller design, yet its accuracy must be tested against real data. For this reason, the model includes function calls to thermodynamic property data. Some structural properties of the resulting model that pertain to controller design, such as uniqueness of the equilibrium point, feedback linearizability and local stability are shown to hold under conditions having direct physical interpretation. The existence of fixed valve positions that attain a desired operating condition is also shown. Validation of the model against real data is likewise provided.

Richter, Hanz↗

Hyper-X Stage Separation Trajectory Validation Studies

An independent twelve degree-of-freedom simulation of the X-43A separation trajectory was created with the Program to Optimize Simulated trajectories (POST II). This simulation modeled the multi-body dynamics of the X-43A and its booster and included the effect of two pyrotechnically actuated pistons used to push the vehicles apart as well as aerodynamic interaction forces and moments between the two vehicles. The simulation was developed to validate trajectory studies conducted with a 14 degree-of-freedom simulation created early in the program using the Automatic Dynamic Analysis of Mechanics Systems (ADAMS) simulation software. The POST simulation was less detailed than the official ADAMS-based simulation used by the Project, but was simpler, more concise and ran faster, while providing similar results. The increase in speed provided by the POST simulation provided the Project with an alternate analysis tool. This tool was ideal for performing separation control logic trade studies that required the running of numerous Monte Carlo trajectories.

Tartabini, Paul V.↗