Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

New V and V Tools for Diagnostic Modeling Environment (DME)

The purpose of this report is to provide correctness and reliability criteria for verification and validation (V&V) of Second Generation Reusable Launch Vehicle (RLV) Diagnostic Modeling Environment, describe current NASA Ames Research Center tools for V&V of Model Based Reasoning systems, and discuss the applicability of Advanced V&V to DME. This report is divided into the following three sections: (1) correctness and reliability criteria; (2) tools for V&V of Model Based Reasoning; and (3) advanced V&V applicable to DME. The Executive Summary includes an overview of the main points from each section. Supporting details, diagrams, figures, and other information are included in subsequent sections. A glossary, acronym list, appendices, and references are included at the end of this report.

Pecheur, Charles↗
NASA NTRS2002

Error Estimation and Uncertainty Propagation in Computational Fluid Mechanics

Numerical simulation has now become an integral part of engineering design process. Critical design decisions are routinely made based on the simulation results and conclusions. Verification and validation of the reliability of the numerical simulation is therefore vitally important in the engineering design processes. We propose to develop theories and methodologies that can automatically provide quantitative information about the reliability of the numerical simulation by estimating numerical approximation error, computational model induced errors and the uncertainties contained in the mathematical models so that the reliability of the numerical simulation can be verified and validated. We also propose to develop and implement methodologies and techniques that can control the error and uncertainty during the numerical simulation so that the reliability of the numerical simulation can be improved.

Zhu, J. Z.↗
NASA NTRS2002

Multiscale Modeling, Simulation and Visualization and Their Potential for Future Aerospace Systems

This document contains the proceedings of the Training Workshop on Multiscale Modeling, Simulation and Visualization and Their Potential for Future Aerospace Systems held at NASA Langley Research Center, Hampton, Virginia, March 5 - 6, 2002. The workshop was jointly sponsored by Old Dominion University's Center for Advanced Engineering Environments and NASA. Workshop attendees were from NASA, other government agencies, industry, and universities. The objectives of the workshop were to give overviews of the diverse activities in hierarchical approach to material modeling from continuum to atomistics; applications of multiscale modeling to advanced and improved material synthesis; defects, dislocations, and material deformation; fracture and friction; thin-film growth; characterization at nano and micro scales; and, verification and validation of numerical simulations, and to identify their potential for future aerospace systems.

Noor, Ahmed K.↗
NASA NTRS2002

Mars Smart Lander Simulations for Entry, Descent, and Landing

Two primary simulations have been developed and are being updated for the Mars Smart Lander Entry, Descent, and Landing (EDL). The high fidelity engineering end-to-end EDL simulation that is based on NASA Langley's Program to Optimize Simulated Trajectories (POST) and the end-to-end real-time, hardware-in-the-loop simulation testbed, which is based on NASA JPL's (Jet Propulsion Laboratory) Dynamics Simulator for Entry, Descent and Surface landing (DSENDS). This paper presents the status of these Mars Smart Lander EDL end-to-end simulations at this time. Various models, capabilities, as well as validation and verification for these simulations are discussed.

Striepe, S. A.↗
NASA NTRS2003

Computational Materials: Modeling and Simulation of Nanostructured Materials and Systems

The paper provides details on the structure and implementation of the Computational Materials program at the NASA Langley Research Center. Examples are given that illustrate the suggested approaches to predicting the behavior and influencing the design of nanostructured materials such as high-performance polymers, composites, and nanotube-reinforced polymers. Primary simulation and measurement methods applicable to multi-scale modeling are outlined. Key challenges including verification and validation of models are highlighted and discussed within the context of NASA's broad mission objectives.

Gates, Thomas S.↗
NASA NTRS2003

Technology Transfer Challenges for High-Assurance Software Engineering Tools

In this paper, we describe our experience with the challenges thar we are currently facing in our effort to develop advanced software verification and validation tools. We categorize these challenges into several areas: cost benefits modeling, tool usability, customer application domain, and organizational issues. We provide examples of challenges in each area and identrfj, open research issues in areas which limit our ability to transfer high-assurance software engineering tools into practice.

John Penix↗
NASA NTRS2003

An Overview of the Process for Pre-Launch Checkout and Transition Activities in Support of the International Space Station (ISS) Payload Operations Integration Center

The objective of this paper is to provide future ISS scientists and/or engineers with an overview of the coordination process for the preparation and implementation of the pre-launch checkout and transition activities as observed from the Marshall Control Flight Center (MSFC) Payload Operations Integration Center perspective. This includes 4 major phases: (1) Verification and validation of the new command and telemetry databases that are needed for new payload experiments and new onboard formats; (2) Integration testing of the new ground control software and hardware; (3) Final internal and external pre-launch checkouts with cadre and experiment teams; (4) Performance of the actual synchronized transition between MSFC, Johnson Space Center (JSC), and ISS onboard configuration to new onboard software, ground software, and databases.

Digesu, Sam↗
NASA NTRS2001

In-Flight Edge Response Measurements for High Spatial Resolution Remote Sensing Systems

In-flight measurement of spatial resolution were conducted as part of the ASA Scientific Data Purchase (SDP) Validation and Verification (V&V) process. Characterization included remote sensing systems with ground sample distance (GSD) of 1 meter or less, such as the panchromatic imager on-board the ICONOS satellite and the airborne ADAR System 5500 multispectral instrument. Final image products were used to evaluate the effect of both the image acquisition system (e.g., optics, electronics, motion, jitter, atmosphere) and image post-processing (e.g., resampling, modulation trasfer function (MTF) compensator). Spatial resolution was characterized by full width at half maximum (FWHM) of an edge response-derived line spread function. This was found to be a more robust measure of spatial resolution than the value of NTF at Nyquist frequency The edge responses were analysed using the tilted-edge technique that ovecomes the spatial sampling limitations of the digital imaging systems. As an enhancement to existing algorithms, the slope of the edge response and the orientation of the edge target were determined by a single computational process. Adjacent black and white square panels, either painted on a flat surface or deployed as traps, formed the ground-based edge targets used in the tests. Orientation of the deployable tarps was optimized beforehand, based on simulations of the imaging system. Numerous edge target images were analyzed for each of the tested sensors. The effect of such factors as acquisition geometry, temporal variability, MTF compensation, and GSD on spatial resolution were investigated.

Blonski, Slawomir↗
NASA NTRS2002

NASA Scientific Data Purchase Project: From Collection to User

NASA's Scientific Data Purchase (SDP) project is currently a $70 million operation managed by the Earth Science Applications Directorate at Stennis Space Center. The SDP project was developed in 1997 to purchase scientific data from commercial sources for distribution to NASA Earth science researchers. Our current data holdings include 8TB of remote sensing imagery consisting of 18 products from 4 companies. Our anticipated data volume is 60 TB by 2004, and we will be receiving new data products from several additional companies. Our current system capacity is 24 TB, expandable to 89 TB. Operations include tasking of new data collections, archive ordering, shipment verification, data validation, distribution, metrics, finances, customer feedback, and technical support. The program has been included in the Stennis Space Center Commercial Remote Sensing ISO 9001 registration since its inception. Our operational system includes automatic quality control checks on data received (with MatLab analysis); internally developed, custom Web-based interfaces that tie into commercial-off-the-shelf software; and an integrated relational database that links and tracks all data through operations. We've distributed nearly 1500 datasets, and almost 18,000 data files have been downloaded from our public web site; on a 10-point scale, our customer satisfaction index is 8.32 at a 23% response level. More information about the SDP is available on our Web site.

Nicholson, Lamar↗
NASA NTRS2003

Functional Flight Test Report for Positive Systems' ADAR System 5500 Sensor SN8 Linear

This report describes results of the functional flight test conducted with the Positive Systems' ADAR 5500 sensor system (serial number 8, linear configuration) near Winslow, Arizona on June 30 and July 1, 1999. The in-flight test is one component of the NASA Scientific Data Purchase (SDP) Validation and Verification (V&V) process. It allows to measure characteristics of the entire sensor system affected by both performance of the sensor during a flight and post-flight image processing. The following characteristics were analyzed: changes of dark digital numbers (DN's), radiometric linearity, signal-to-noise ratio (SNR), spatial resolution, and geolocation accuracy. The measured characteristics were compared with the image product specifications defined in the Positive Systems' SDP contract. Dependence of the dark DN's on several factors was analyzed, but no significant correlation was found. However, the observed changes in dark DN's were relatively small, which justifies usage of a constant value in the dark DN subtraction procedure during post-processing. Dependence of measured at-sensor, in-band radiance (in arbitrary units) on measured in-band ground reflectance is very well described by a linear function - The sensor fulfills the linearity requirement. Measured SNR values lower than the contract specifications, but accuracy of that test was possibly affected by non-uniformity of the employed gray-scale panels. The SNR values are generally sufficiently high for most applications. SNR can also be improved during standard flights by using longer exposure times. Full width at half maximum (FWHM) of an edge response derived line spread function was used as a measure of spatial resolution. FWHM was generally smaller than twice the ground sample distance (GSD), in agreement with the contract specifications. Accuracy of the geolocation information, which is provided for the particular images in a metadata file, was found to meet contract requirements as well.

Stanley, Tom↗
NASA NTRS1999

Synthetic Scene Generation of the Stennis V and V Target Range for the Calibration of Remote Sensing Systems

The verification and validation (V&V) target range developed at Stennis Space Center is a useful test site for the calibration of remote sensing systems. In this paper, we present a simple algorithm for generating synthetic radiance scenes or digital models of this target range. The radiation propagation for the target in the solar reflective and thermal infrared spectral regions is modeled using the atmospheric radiative transfer code MODTRAN 4. The at-sensor, in-band radiance and spectral radiance for a given sensor at a given altitude is predicted. Software is developed to generate scenes with different spatial and spectral resolutions using the simulated at-sensor radiance values. The radiometric accuracy of the simulation is evaluated by comparing simulated with AVIRIS acquired radiance values. The results show that in general there is a good match between AVIRIS sensor measured and MODTRAN predicted radiance values for the target despite the fact that some anomalies exist. Synthetic scenes provide a cost-effective way for in-flight validation of the spatial and radiometric accuracy of the data. Other applications include mission planning, sensor simulation, and trade-off analysis in sensor design.

Cao, Chang-Yong↗
NASA NTRS2003

NASA Scientific Data Purchase Laboratory Characterization of Positive Systems ADAR 5500 Sensor

This report summarizes the laboratory characterization of the Positive Systems ADAR 5500 SN4 multi-spectral imager measured dirijg the period of April 10-11, 2000 in the NASA CRSP Commercial Instrumentation Validation Laboratory (CIVL). This characterization is one component of the NASA Scientific Data Purchase (SDP) validation and verification process. A complete characterization will require analysis of airborne data. The spectral, radiometric, and spatial characteristics of this system were measured and compared with the product data specifications as defined in the SDP contract. These results are summarized in the specification compliance matrices in this summary. A complete description of the system, the SDP product specification and the sensor laboratory characterization is provided in the body of the main report.

Ryan, James↗
NASA NTRS2003

Development of Methodologies for IV and V of Neural Networks

Non-deterministic systems often rely upon neural network (NN) technology to "lean" to manage flight systems under controlled conditions using carefully chosen training sets. How can these adaptive systems be certified to ensure that they will become increasingly efficient and behave appropriately in real-time situations? The bulk of Independent Verification and Validation (IV&V) research of non-deterministic software control systems such as Adaptive Flight Controllers (AFC's) addresses NNs in well-behaved and constrained environments such as simulations and strict process control. However, neither substantive research, nor effective IV&V techniques have been found to address AFC's learning in real-time and adapting to live flight conditions. Adaptive flight control systems offer good extensibility into commercial aviation as well as military aviation and transportation. Consequently, this area of IV&V represents an area of growing interest and urgency. ISR proposes to further the current body of knowledge to meet two objectives: Research the current IV&V methods and assess where these methods may be applied toward a methodology for the V&V of Neural Network; and identify effective methods for IV&V of NNs that learn in real-time, including developing a prototype test bed for IV&V of AFC's. Currently. no practical method exists. lSR will meet these objectives through the tasks identified and described below. First, ISR will conduct a literature review of current IV&V technology. TO do this, ISR will collect the existing body of research on IV&V of non-deterministic systems and neural network. ISR will also develop the framework for disseminating this information through specialized training. This effort will focus on developing NASA's capability to conduct IV&V of neural network systems and to provide training to meet the increasing need for IV&V expertise in such systems.

Taylor, Brian↗
NASA NTRS2004

Verification of Emergent Behaviors in Swarm-based Systems

The emergent properties of swarms make swarm-based missions powerful, but at the same time more difficult to design and to assure that the proper behaviors will emerge. We are currently investigating formal methods and techniques for verification and validation of swarm-based missions. The Autonomous Nano-Technology Swarm (ANTS) mission is being used as an example and case study for swarm-based missions to experiment and test current formal methods with intelligent swarms. Using the ANTS mission, we have evaluated multiple formal methods to determine their effectiveness in modeling and assuring swarm behavior. This paper introduces how intelligent swarm technology is being proposed for NASA missions, and gives the results of a comparison of several formal methods and approaches for specifying intelligent swarm-based systems and their effectiveness for predicting emergent behavior.

Rouff, Christopher↗
NASA NTRS2004

Verification of NASA Emergent Systems

NASA is studying advanced technologies for a future robotic exploration mission to the asteroid belt. This mission, the prospective ANTS (Autonomous Nano Technology Swarm) mission, will comprise of 1,000 autonomous robotic agents designed to cooperate in asteroid exploration. The emergent properties of swarm type missions make them powerful, but at the same time are more difficult to design and assure that the proper behaviors will emerge. We are currently investigating formal methods and techniques for verification and validation of future swarm-based missions. The advantage of using formal methods is their ability to mathematically assure the behavior of a swarm, emergent or otherwise. The ANT mission is being used as an example and case study for swarm-based missions for which to experiment and test current formal methods with intelligent swam. Using the ANTS mission, we have evaluated multiple formal methods to determine their effectiveness in modeling and assuring swarm behavior.

Rouff, Christopher↗
NASA NTRS2004

Monitoring the Performance of a Neuro-Adaptive Controller

Traditional control has proven to be ineffective to deal with catastrophic changes or slow degradation of complex, highly nonlinear systems like aircraft or spacecraft, robotics, or flexible manufacturing systems. Control systems which can adapt toward changes in the plant have been proposed as they offer many advantages (e.g., better performance, controllability of aircraft despite of a damaged wing). In the last few years, use of neural networks in adaptive controllers (neuro-adaptive control) has been studied actively. Neural networks of various architectures have been used successfully for online learning adaptive controllers. In such a typical control architecture, the neural network receives as an input the current deviation between desired and actual plant behavior and, by on-line training, tries to minimize this discrepancy (e.g.; by producing a control augmentation signal). Even though neuro-adaptive controllers offer many advantages, they have not been used in mission- or safety-critical applications, because performance and safety guarantees cannot b e provided at development time-a major prerequisite for safety certification (e.g., by the FAA or NASA). Verification and Validation (V&V) of an adaptive controller requires the development of new analysis techniques which can demonstrate that the control system behaves safely under all operating conditions. Because of the requirement to adapt toward unforeseen changes during operation, i.e., in real time, design-time V&V is not sufficient.

Schumann, Johann↗
NASA NTRS2004

From Bridges and Rockets, Lessons for Software Systems

Although differences exist between building software systems and building physical structures such as bridges and rockets, enough similarities exist that software engineers can learn lessons from failures in traditional engineering disciplines. This paper draws lessons from two well-known failures the collapse of the Tacoma Narrows Bridge in 1940 and the destruction of the space shuttle Challenger in 1986 and applies these lessons to software system development. The following specific applications are made: (1) the verification and validation of a software system should not be based on a single method, or a single style of methods; (2) the tendency to embrace the latest fad should be overcome; and (3) the introduction of software control into safety-critical systems should be done cautiously.

Holloway, C. Michael↗
NASA NTRS2004

Recent Enhancements to USM3D Unstructured Flow Solver for Unsteady Flows

The NASA USM3D unstructured flow solver is undergoing extensions to address dynamic flow problems in support of NASA and NAVAIR efforts to study the applicability of Computational Fluid Dynamics tools for the prediction of aircraft stability and control characteristics. The initial extensions reported herein include two second-order time stepping schemes, Detached-Eddy Simulation, and grid motion. This paper reports the initial code verification and validation assessment of the dynamic flow capabilities of USM3D. The cases considered are the classic inviscid shock-tube problem, low Reynolds number wake shedding from a NACA 0012 airfoil, high Reynolds number DES-based wake shedding from a 4-to-1 length-to-diameter cylinder, and forced pitch oscillation of a NACA 0012 airfoil with inviscid and turbulent flow.

Pandya, Mohagna J.↗