Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Flight Validation of a Handling Qualities Metric for a Damaged Aircraft

Objectives: a) Develop an asymmetric handling qualities metric to predict cross coupling effects of a damaged aircraft: 1) Initial use of U.S Army Aeronautical Design Specification ADS-33; 2) Modification as required based on flight test results. b) Simulation and Flight Validation of proposed metric: 1) F-16 VISTA (March 2010); 2) F-18 Full Scale Test bed (Potential Early Experiment); and 3) Flight Simulators (GTM, ACFS, F-18 HILS). c) Provide flight validated metric and tool box to control law designers.

Cogan, Bruce R.↗

Data Visualization and Analysis Tools for the Global Precipitation Measurement (GPM) Validation Network

The Validation Network (VN) prototype for the Global Precipitation Measurement (GPM) Mission compares data from the Tropical Rainfall Measuring Mission (TRMM) satellite Precipitation Radar (PR) to similar measurements from U.S. and international operational weather radars. This prototype is a major component of the GPM Ground Validation System (GVS). The VN provides a means for the precipitation measurement community to identify and resolve significant discrepancies between the ground radar (GR) observations and similar satellite observations. The VN prototype is based on research results and computer code described by Anagnostou et al. (2001), Bolen and Chandrasekar (2000), and Liao et al. (2001), and has previously been described by Morris, et al. (2007). Morris and Schwaller (2009) describe the PR-GR volume-matching algorithm used to create the VN match-up data set used for the comparisons. This paper describes software tools that have been developed for visualization and statistical analysis of the original and volume matched PR and GR data.

Morris, Kenneth R.↗

Validating Human Performance Models of the Future Orion Crew Exploration Vehicle

NASA's Orion Crew Exploration Vehicle (CEV) will provide transportation for crew and cargo to and from destinations in support of the Constellation Architecture Design Reference Missions. Discrete Event Simulation (DES) is one of the design methods NASA employs for crew performance of the CEV. During the early development of the CEV, NASA and its prime Orion contractor Lockheed Martin (LM) strived to seek an effective low-cost method for developing and validating human performance DES models. This paper focuses on the method developed while creating a DES model for the CEV Rendezvous, Proximity Operations, and Docking (RPOD) task to the International Space Station. Our approach to validation was to attack the problem from several fronts. First, we began the development of the model early in the CEV design stage. Second, we adhered strictly to M&S development standards. Third, we involved the stakeholders, NASA astronauts, subject matter experts, and NASA's modeling and simulation development community throughout. Fourth, we applied standard and easy-to-conduct methods to ensure the model's accuracy. Lastly, we reviewed the data from an earlier human-in-the-loop RPOD simulation that had different objectives, which provided us an additional means to estimate the model's confidence level. The results revealed that a majority of the DES model was a reasonable representation of the current CEV design.

Wong, Douglas T.↗

Challenges to Computational Aerothermodynamic Simulation and Validation for Planetary Entry Vehicle Analysis

Challenges to computational aerothermodynamic (CA) simulation and validation of hypersonic flow over planetary entry vehicles are discussed. Entry, descent, and landing (EDL) of high mass to Mars is a significant driver of new simulation requirements. These requirements include simulation of large deployable, flexible structures and interactions with reaction control system (RCS) and retro-thruster jets. Simulation of radiation and ablation coupled to the flow solver continues to be a high priority for planetary entry analyses, especially for return to Earth and outer planet missions. Three research areas addressing these challenges are emphasized. The first addresses the need to obtain accurate heating on unstructured tetrahedral grid systems to take advantage of flexibility in grid generation and grid adaptation. A multi-dimensional inviscid flux reconstruction algorithm is defined that is oriented with local flow topology as opposed to grid. The second addresses coupling of radiation and ablation to the hypersonic flow solver - flight- and ground-based data are used to provide limited validation of these multi-physics simulations. The third addresses the challenges of retro-propulsion simulation and the criticality of grid adaptation in this application. The evolution of CA to become a tool for innovation of EDL systems requires a successful resolution of these challenges.

Gnoffo, Peter A.↗

Methods and Results for a Global Precipitation Measurement (GPM) Validation Network Prototype

As one component of a ground validation system to meet requirements for the upcoming Global Precipitation Measurement (GPM) mission, a quasi-operational prototype a system to compare satellite- and ground-based radar measurements has been developed. This prototype, the GPM Validation Network (VN), acquires data from the Precipitation Radar (PR) on the Tropical Rainfall Measuring Mission (TRMM) satellite and from ground radar (GR) networks in the continental U.S. and participating international sites. PR data serve as a surrogate for similar observations from the Dual-frequency Precipitation Radar (DPR) to be present on GPM. Primary goals of the VN prototype are to understand and characterize the variability and bias of precipitation retrievals between the PR and GR in various precipitation regimes at large scales, and to improve precipitation retrieval algorithms for the GPM instruments. The current VN capabilities concentrate on comparisons of the base reflectivity observations between the PR and GR, and include support for rain rate comparisons. The VN algorithm resamples PR and GR reflectivity and other 2-D and 3-D data fields to irregular common volumes defined by the geometric intersection of the instrument observations, and performs statistical comparisons of PR and GR reflectivity and estimated rain rates. Algorithmic biases and uncertainties introduced by traditional data analysis techniques are minimized by not performing interpolation or extrapolation of data to a fixed grid. The core VN dataset consists of WSR-88D GR data and matching PR orbit subset data covering 21 sites in the southeastern U. S., from August, 2006 to the present. On average, about 3.5 overpass events per month for these WSR-88D sites meet VN criteria for significant precipitation, and have matching PR and GR data available. This large statistical sample has allowed the relative calibration accuracy and stability of the individual ground radars, and the quality of the PR reflectivity attenuation correction in convective and stratiform precipitation to be evaluated. We will present results of PR-GR reflectivity and rain rate bias comparisons for each OR site, and for different rain types, for the full data set and as time series. The capabilities of the statistical analysis and vertical cross section tools for display and analysis of individual site overpass event data will be described, and examples of the tools' outputs will be shown.

Morris, Kenneth R.↗

Validations of Coupled CSD/CFD and Particle Vortex Transport Method for Rotorcraft Applications: Hover, Transition, and High Speed Flights

This paper presents validations of a novel rotorcraft analysis that coupled Computational Fluid Dynamics (CFD), Computational Structural Dynamics (CSD), and Particle Vortex Transport Method (PVTM) methodologies. The CSD with associated vehicle trim analysis is used to calculate blade deformations and trim parameters. The near body CFD analysis is employed to provide detailed near body flow field information which is used to obtain high-fidelity blade aerodynamic loadings. The far field wake dominated region is simulated using the PVTM analysis which provides accurate prediction of the evolution of the rotor wake released from the near body CFD domains. A loose coupling methodology between the CSD and CFD/PVTM modules are used with appropriate information exchange amongst the CSD/CFD/PVTM modules. The coupled CSD/CFD/PVTM methodology is used to simulate various rotorcraft flight conditions (i.e. hover, transition, and high speed flights), and the results are compared with several sets of experimental data. For the hover condition, the results are compared with hover data for the HART II rotor tested at DLR Institute of Flight Systems, Germany. For the forward flight conditions, the results are validated with the UH-60A flight test data.

Anusonti-Inthra, Phuriwat↗

MODIS Tree Cover Validation for the Circumpolar Taiga-Tundra Transition Zone

A validation of the 2005 500m MODIS vegetation continuous fields (VCF) tree cover product in the circumpolar taiga-tundra ecotone was performed using high resolution Quickbird imagery. Assessing the VCF's performance near the northern limits of the boreal forest can help quantify the accuracy of the product within this vegetation transition area. The circumpolar region was divided into longitudinal zones and validation sites were selected in areas of varying tree cover where Quickbird imagery is available in Google Earth. Each site was linked to the corresponding VCF pixel and overlaid with a regular dot grid within the VCF pixel's boundary to estimate percent tree crown cover in the area. Percent tree crown cover was estimated using Quickbird imagery for 396 sites throughout the circumpolar region and related to the VCF's estimates of canopy cover for 2000-2005. Regression results of VCF inter-annual comparisons (2000-2005) and VCF-Quickbird image-interpreted estimates indicate that: (1) Pixel-level, inter-annual comparisons of VCF estimates of percent canopy cover were linearly related (mean R(sup 2) = 0.77) and exhibited an average root mean square error (RMSE) of 10.1 % and an average root mean square difference (RMSD) of 7.3%. (2) A comparison of image-interpreted percent tree crown cover estimates based on dot counts on Quickbird color images by two different interpreters were more variable (R(sup 2) = 0.73, RMSE = 14.8%, RMSD = 18.7%) than VCF inter-annual comparisons. (3) Across the circumpolar boreal region, 2005 VCF-Quickbird comparisons were linearly related, with an R(sup 2) = 0.57, a RMSE = 13.4% and a RMSD = 21.3%, with a tendency to over-estimate areas of low percent tree cover and anomalous VCF results in Scandinavia. The relationship of the VCF estimates and ground reference indicate to potential users that the VCF's tree cover values for individual pixels, particularly those below 20% tree cover, may not be precise enough to monitor 500m pixel-level tree cover in the taiga-tundra transition zone.

Montesano, P. M.↗

Combined Heat Transfer in High-Porosity High-Temperature Fibrous Insulations: Theory and Experimental Validation

Combined radiation and conduction heat transfer through various high-temperature, high-porosity, unbonded (loose) fibrous insulations was modeled based on first principles. The diffusion approximation was used for modeling the radiation component of heat transfer in the optically thick insulations. The relevant parameters needed for the heat transfer model were derived from experimental data. Semi-empirical formulations were used to model the solid conduction contribution of heat transfer in fibrous insulations with the relevant parameters inferred from thermal conductivity measurements at cryogenic temperatures in a vacuum. The specific extinction coefficient for radiation heat transfer was obtained from high-temperature steady-state thermal measurements with large temperature gradients maintained across the sample thickness in a vacuum. Standard gas conduction modeling was used in the heat transfer formulation. This heat transfer modeling methodology was applied to silica, two types of alumina, and a zirconia-based fibrous insulation, and to a variation of opacified fibrous insulation (OFI). OFI is a class of insulations manufactured by embedding efficient ceramic opacifiers in various unbonded fibrous insulations to significantly attenuate the radiation component of heat transfer. The heat transfer modeling methodology was validated by comparison with more rigorous analytical solutions and with standard thermal conductivity measurements. The validated heat transfer model is applicable to various densities of these high-porosity insulations as long as the fiber properties are the same (index of refraction, size distribution, orientation, and length). Furthermore, the heat transfer data for these insulations can be obtained at any static pressure in any working gas environment without the need to perform tests in various gases at various pressures.

Daryabeigi, Kamran↗

Verification and Validation for Flight-Critical Systems (VVFCS)

On March 31, 2009 a Request for Information (RFI) was issued by NASA s Aviation Safety Program to gather input on the subject of Verification and Validation (V & V) of Flight-Critical Systems. The responses were provided to NASA on or before April 24, 2009. The RFI asked for comments in three topic areas: Modeling and Validation of New Concepts for Vehicles and Operations; Verification of Complex Integrated and Distributed Systems; and Software Safety Assurance. There were a total of 34 responses to the RFI, representing a cross-section of academic (26%), small & large industry (47%) and government agency (27%).

Graves, Sharon S.↗

Assessing the Relative Performance of Microwave-Based Satellite Rain Rate Retrievals Using TRMM Ground Validation Data

Space-borne microwave sensors provide critical rain information used in several global multi-satellite rain products, which in turn are used for a variety of important studies, including landslide forecasting, flash flood warning, data assimilation, climate studies, and validation of model forecasts of precipitation. This study employs four years (2003-2006) of satellite data to assess the relative performance and skill of SSM/I (F13, F14 and F15), AMSU-B (N15, N16 and N17), AMSR-E (Aqua) and the TRMM Microwave Imager (TMI) in estimating surface rainfall based on direct instantaneous comparisons with ground-based rain estimates from Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) sites at Kwajalein, Republic of the Marshall Islands (KWAJ) and Melbourne, Florida (MELB). The relative performance of each of these satellite estimates is examined via comparisons with space- and time-coincident GV radar-based rain rate estimates. Because underlying surface terrain is known to affect the relative performance of the satellite algorithms, the data for MELB was further stratified into ocean, land and coast categories using a 0.25 terrain mask. Of all the satellite estimates compared in this study, TMI and AMSR-E exhibited considerably higher correlations and skills in estimating/observing surface precipitation. While SSM/I and AMSU-B exhibited lower correlations and skills for each of the different terrain categories, the SSM/I absolute biases trended slightly lower than AMSRE over ocean, where the observations from both emission and scattering channels were used in the retrievals. AMSU-B exhibited the least skill relative to GV in all of the relevant statistical categories, and an anomalous spike was observed in the probability distribution functions near 1.0 mm/hr. This statistical artifact appears to be related to attempts by algorithm developers to include some lighter rain rates, not easily detectable by its scatter-only frequencies. AMSU-B, however, agreed well with GV when the matching data was analyzed on monthly scales. These results signal developers of global rainfall products, such as the TRMM Multi-Satellite Precipitation Analysis (TMPA), and the Climate Data Center s Morphing (CMORPH) technique, that care must be taken when incorporating data from these input satellite estimates in order to provide the highest quality estimates in their products. 3

Wolff, David B.↗

Cross Calibration and Validation Using CLARREO

The presentation focuses on study questions, effort, and result. Study questions include a focus on MW/LW, error sources and what can be expected, how validation will be performed and what resolution is required, and spatial resolution required for cross-calibration. Study effort includes empirical approach by examining AIRS ,IASI and MODIS cross-calibration methods already in place and estimate the number of clear and Dome C observations possible versus spatial resolution. Study results include 5000 sampler per cross-calibration recommended, insufficient cloud free and Dome C AWS observations for cross calibration and validation at 100km, and less than 20 km IFOV at 100 km swath needed to achieve sufficient samples for cross-calibration of CLARREO.

calibration↗

Reliability and Validity of Ultrasound Cross Sectional Area Measurements for Long-Duration Spaceflight

Limb muscle atrophy and the accompanying decline in function can adversely affect the performance of astronauts during mission-related activities and upon re-ambulation in a gravitational environment. Previous characterization of space flight-induced muscle atrophy has been performed using pre and post flight magnetic resonance imaging (MRI). In addition to being costly and time consuming, MRI is an impractical methodology for assessing in-flight changes in muscle size. Given the mobility of ultrasound (US) equipment, it may be more feasible to evaluate changes in muscle size using this technique. PURPOSE: To examine the reliability and validity of using a customized template to acquire panoramic ultrasound (US) images for determining quadriceps and gastrocnemius anatomical cross sectional area (CSA). METHODS: Vastus lateralis (VL), rectus femoris (RF), medial gastrocnemius (MG), and lateral gastrocnemius (LG) CSA were assessed in 10 healthy individuals (36+/-2 yrs) using US and MRI. Panoramic US images were acquired by 2 sonographers using a customized template placed on the thigh and calf and analyzed by the same 2 sonographers (CX50 Philips). MRI images of the leg were acquired while subjects were supine in a 1.5T scanner (Signa Horizon LX, General Electric) and were analyzed by 3 trained investigators. The average of the 2 US and 3 MRI values were used for validity analysis. RESULTS: High inter-experimenter reliability was found for both the US template and MRI analysis as coefficients of variation across muscles ranged from 2.4 to 4.1% and 2.8 to 3.8%, respectively. Significant correlations were found between US and MRI CSA measures (VL, r = 0.85; RF, r = 0.60; MG, r = 0.86; LG, r = 0.73; p < 0.05). Furthermore, the standard error of measurement between US and MRI ranged from 0.91 to 2.09 sq cm with high limits of agreement analyzed by Bland-Altman plots. However, there were significant differences between absolute values of MRI and US for all muscles. CONCLUSION: The present results indicate that utilizing a customized US template provides reliable measures of leg muscle CSA, and thus could be used to characterize changes in muscle CSA both in flight and on the ground.

Scott, Jessica M.↗

Data Visualization and Analysis Tools for the Global Precipitation Measurement (GPM) Validation Network

The Validation Network (VN) prototype for the Global Precipitation Measurement (GPM) mission compares data from the Tropical Rainfall Measuring Mission (TRMM) satellite Precipitation Radar (PR) to similar measurements from U.S. and international operational weather radars. This prototype is a major component of the GPM Ground Validation System (GVS). The VN provides a means for the precipitation measurement community to identify and resolve significant discrepancies between the ground radar (GR) observations and similar satellite observations. The VN prototype is based on research results and computer code described by Anagnostou et al. (2001), Bolen and Chandrasekar (2000), and Liao et al. (2001), and has previously been described by Morris, et al. (2007). Morris and Schwaller (2009) describe the PR-GR volume-matching algorithm used to create the VN match-up data set used for the comparisons. This paper describes software tools that have been developed for visualization and statistical analysis of the original and volume matched PR and GR data.

Morris, K. Robert↗

Validation of On-Orbit Methodology for the Assessment of Cardiac Function and Changes in the Circulating Volume Using Ultrasound and Braslet-M Occlusion Cuffs

The objective of this joint U.S. - Russian project was the development and validation of an in-flight methodology to assess a number of cardiac and vascular parameters associated with circulating volume and its manipulation in long-duration space flight. Responses to modified Valsalva and Mueller maneuvers were measured by cardiac and vascular ultrasound (US) before, during, and after temporary volume reduction by means of Braslet-M thigh occlusion cuffs (Russia). Materials and Methods: The study protocol was conducted in 14 sessions on 9 ISS crewmembers, with an average exposure to microgravity of 122 days. Baseline cardiovascular measurements were taken by echocardiography in multiple modes (including tissue Doppler of both ventricles) and femoral and jugular vein imaging on the International Space Station (ISS). The Braslet devices were then applied and measurements were repeated after >10 minutes. The cuffs were then released and the hemodynamic recovery process was monitored. Modified Valsalva and Mueller maneuvers were used throughout the protocol. All US data were acquired by the HDI-5000 ultrasound system aboard the ISS (ATL/Philips, USA) during remotely guided sessions. The study protocol, including the use of Braslet-M for this purpose, was approved by the ISS Human Research Multilateral Review Board (HRMRB). Results: The effects of fluid sequestration on a number of echocardiographic and vascular parameters were readily detectable by in-flight US, as were responses to respiratory maneuvers. The overall volume status assessment methodology appears to be valid and practical, with a decrease in left heart lateral E (tissue Doppler) as one of the most reliable measures. Increase in the femoral vein cross-sectional areas was consistently observed with Braslet application. Other significant differences and trends within the extensive cardiovascular data were also observed. (Decreased - RV and LV preload indices, Cardiac Output, LV E all maneuvers, LV Stroke Volume). Conclusions: This Study: 1) Addressed specific aspects of operational space medicine and space physiology, including assessment of circulating volume disturbances 2) Expanded the applications of diagnostic ultrasound imaging and Doppler techniques in microgravity. 3) Used respiratory maneuvers against the background of acute circulating volume manipulations which appear to enhance our ability to noninvasively detect volume-dependency in a number of cardiac and vascular parameters. 4) Determined that Tei index is not clinically changed therefore contractility not altered in the face of reduced preload. 5) Determined that increased Femoral Vein Area indicating blood being sequestered in lower extremities correlates with reduced preload and cardiac output. 6) That Braslet may be the only feasible means of acutely treating high pressure pulmonary edema in reduced gravity environments.

Hamilton, Douglas↗

Self-Validating Thermocouple

Self-Validating Thermocouple (SVT) Systems capable of detecting sensor probe open circuits, short circuits, and unnoticeable faults such as a probe debonding and probe degradation are useful in the measurement of temperatures. SVT Systems provide such capabilities by incorporating a heating or excitation element into the measuring junction of the thermocouple. By heating the measuring junction and observing the decay time for the detected DC voltage signal, it is possible to indicate whether the thermocouple is bonded or debonded. A change in the thermal transfer function of the thermocouple system causes a change in the rise and decay times of the thermocouple output. Incorporation of the excitation element does not interfere with normal thermocouple operation, thus further allowing traditional validation procedures as well.

Perotti, Jose M.↗

NDARC - NASA Design and Analysis of Rotorcraft Validation and Demonstration

Validation and demonstration results from the development of the conceptual design tool NDARC (NASA Design and Analysis of Rotorcraft) are presented. The principal tasks of NDARC are to design a rotorcraft to satisfy specified design conditions and missions, and then analyze the performance of the aircraft for a set of off-design missions and point operating conditions. The aircraft chosen as NDARC development test cases are the UH-60A single main-rotor and tail-rotor helicopter, the CH-47D tandem helicopter, the XH-59A coaxial lift-offset helicopter, and the XV-15 tiltrotor. These aircraft were selected because flight performance data, a weight statement, detailed geometry information, and a correlated comprehensive analysis model are available for each. Validation consists of developing the NDARC models for these aircraft by using geometry and weight information, airframe wind tunnel test data, engine decks, rotor performance tests, and comprehensive analysis results; and then comparing the NDARC results for aircraft and component performance with flight test data. Based on the calibrated models, the capability of the code to size rotorcraft is explored.

Johnson, Wayne↗

A Hardware Model Validation Tool for Use in Complex Space Systems

One of the many technological hurdles that must be overcome in future missions is the challenge of validating as-built systems against the models used for design. We propose a technique composed of intelligent parameter exploration in concert with automated failure analysis as a scalable method for the validation of complex space systems. The technique is impervious to discontinuities and linear dependencies in the data, and can handle dimensionalities consisting of hundreds of variables over tens of thousands of experiments.

Davies, Misty Dawn↗

Assessing the Relative Performance of Microwave-Based Satellite Rain Rate Retrievals Using TRMM Ground Validation Data

Space-borne microwave sensors provide critical rain information used in several global multi-satellite rain products, which in turn are used for a variety of important studies, including landslide forecasting, flash flood warning, data assimilation, climate studies, and validation of model forecasts of precipitation. This study employs four years (2003-2006) of satellite data to assess the relative performance and skill of SSM/I (F13, F14 and F15), AMSU-B (N15, N16 and N17), AMSR-E (Aqua) and the TRMM Microwave Imager (TMI) in estimating surface rainfall based on direct instantaneous comparisons with ground-based rain estimates from Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) sites at Kwajalein, Republic of the Marshall Islands (KWAJ) and Melbourne, Florida (MELB). The relative performance of each of these satellite estimates is examined via comparisons with space- and time-coincident GV radar-based rain rate estimates. Because underlying surface terrain is known to affect the relative performance of the satellite algorithms, the data for MELB was further stratified into ocean, land and coast categories using a 0.25deg terrain mask. Of all the satellite estimates compared in this study, TMI and AMSR-E exhibited considerably higher correlations and skills in estimating/observing surface precipitation. While SSM/I and AMSU-B exhibited lower correlations and skills for each of the different terrain categories, the SSM/I absolute biases trended slightly lower than AMSR-E over ocean, where the observations from both emission and scattering channels were used in the retrievals. AMSU-B exhibited the least skill relative to GV in all of the relevant statistical categories, and an anomalous spike was observed in the probability distribution functions near 1.0 mm/hr. This statistical artifact appears to be related to attempts by algorithm developers to include some lighter rain rates, not easily detectable by its scatter-only frequencies. AMSU-B, however, agreed well with GV when the matching data was analyzed on monthly scales. These results signal developers of global rainfall products, such as the TRMM Multi-Satellite Precipitation Analysis (TMPA), and the Climate Data Center s Morphing (CMORPH) technique, that care must be taken when incorporating data from these input satellite estimates in order to provide the highest quality estimates in their products.

Wolff, David B.↗