Impact Real World System Validation
Explore the source record for details and available documents.
Eric Kerstman↗
SEARCH · Engineering Papers
Results for “system validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Impact Real World System Validation
Explore the source record for details and available documents.
Eric Kerstman↗
Validation and verification of expert systems
Validation and verification (V&V) are procedures used to evaluate system structure or behavior with respect to a set of requirements. Although expert systems are often developed as a series of prototypes without requirements, it is not possible to perform V&V on any system for which requirements have not been prepared. In addition, there are special problems associated with the evaluation of expert systems that do not arise in the evaluation of conventional systems, such as verification of the completeness and accuracy of the knowledge base. The criticality of most NASA missions make it important to be able to certify the performance of the expert systems used to support these mission. Recommendations for the most appropriate method for integrating V&V into the Expert System Development Methodology (ESDM) and suggestions for the most suitable approaches for each stage of ESDM development are presented.
Gilstrap, Lewey↗
Validation of expert systems
The validation of expert systems (ESs) has only recently become an active AI research topic. Current approaches have concentrated mainly on the validation of rule properties of such systems. The efforts presented improves on current methods by also exploiting the structural and semantic information of such systems. To increase programmer productivity, more and more companies have begun exploiting the advent of AI technology by developing applications using ES shells or other AI-based high level program generators. The architecture, functionality, and future goals of Expert Systems Validation are described along with the features that have been implemented for and in Automated Reasoning Tool, the ES shell presented.
Stachowitz, Rolf A.↗
Building validation tools for knowledge-based systems
The Expert Systems Validation Associate (EVA), a validation system under development at the Lockheed Artificial Intelligence Center for more than a year, provides a wide range of validation tools to check the correctness, consistency and completeness of a knowledge-based system. A declarative meta-language (higher-order language), is used to create a generic version of EVA to validate applications written in arbitrary expert system shells. The architecture and functionality of EVA are presented. The functionality includes Structure Check, Logic Check, Extended Structure Check (using semantic information), Extended Logic Check, Semantic Check, Omission Check, Rule Refinement, Control Check, Test Case Generation, Error Localization, and Behavior Verification.
Stachowitz, R. A.↗
Testing validation tools on CLIPS-based expert systems
The Expert Systems Validation Associate (EVA) is a validation system which was developed at the Lockheed Software Technology Center and Artificial Intelligence Center between 1986 and 1990. EVA is an integrated set of generic tools to validate any knowledge-based system written in any expert system shell such as C Language Integrated Production System (CLIPS), ART, OPS5, KEE, and others. Many validation tools have been built in the EVA system. In this paper, we describe the testing results of applying the EVA validation tools to the Manned Maneuvering Unit (MMU) Fault Diagnosis, Isolation, and Reconfiguration (FDIR) expert system, written in CLIPS, obtained from the NASA Johnson Space Center.
Chang, C. L.↗
Select Methodology for Validating Advanced Satellite Measurement Systems
Advanced satellite sensors are tasked with improving global measurements of the Earth's atmosphere, clouds, and surface to enable enhancements in weather prediction, climate monitoring capability, and environmental change detection. Measurement system validation is crucial to achieving this goal and maximizing research and operational utility of resultant data. Field campaigns including satellite under-flights with well calibrated FTS sensors aboard high-altitude aircraft are an essential part of the validation task. This presentation focuses on an overview of validation methodology developed for assessment of high spectral resolution infrared systems, and includes results of preliminary studies performed to investigate the performance of the Infrared Atmospheric Sounding Interferometer (IASI) instrument aboard the MetOp-A satellite.
Larar, Allen M.↗
Infrared Spectral Radiance Intercomparisons With Satellite and Aircraft Sensors
Measurement system validation is critical for advanced satellite sounders to reach their full potential of improving observations of the Earth's atmosphere, clouds, and surface for enabling enhancements in weather prediction, climate monitoring capability, and environmental change detection. Experimental field campaigns, focusing on satellite under-flights with well-calibrated FTS sensors aboard high-altitude aircraft, are an essential part of the validation task. Airborne FTS systems can enable an independent, SI-traceable measurement system validation by directly measuring the same level-1 parameters spatially and temporally coincident with the satellite sensor of interest. Continuation of aircraft under-flights for multiple satellites during multiple field campaigns enables long-term monitoring of system performance and inter-satellite cross-validation. The NASA / NPOESS Airborne Sounder Testbed - Interferometer (NAST-I) has been a significant contributor in this area by providing coincident high spectral/spatial resolution observations of infrared spectral radiances along with independently-retrieved geophysical products for comparison with like products from satellite sensors being validated. This presentation gives an overview of benefits achieved using airborne sensors such as NAST-I utilizing examples from recent field campaigns. The methodology implemented is not only beneficial to new sensors such as the Cross-track Infrared Sounder (CrIS) flying aboard the Suomi NPP and future JPSS satellites but also of significant benefit to sensors of longer flight heritage such as the Atmospheric InfraRed Sounder (AIRS) and the Infrared Atmospheric Sounding Interferometer (IASI) on the AQUA and METOP-A platforms, respectively, to ensure data quality continuity important for climate and other applications. Infrared spectral radiance inter-comparisons are discussed with a particular focus on usage of NAST-I data for enabling inter-platform cross-validation.
Larar, Allen M.↗
Control Modes of the ST7 Disturbance Reduction System Flight Validation Experiment
The Space Technology 7 experiment will perform an on-orbit system-level validation of two specific Disturbance Reduction System technologies: a gravitational reference sensor employing a free-floating test mass and a set of micro-Newton colloidal thrusters. The ST7 Disturbance Reduction System is designed to maintain the spacecraft s position with respect to a free-floating test mass to less than 10 nm/the square root of Hz over the frequency range of 1 to 30 mHz. This requirement will help ensure that the residual accelerations on the test masses (beyond gravitational acceleration) will be below the ST7 goal of 300 (1 + [f/3 mHz](sup 2)) pm/s(sup 2)/the square root of Hz. This paper presents the overall design and analysis of the spacecraft drag-free and attitude controllers being designed by NASA s Goddard Space Flight Center. These controllers close the loop between the GRS and the micro-Newton colloidal thrusters. The ST7 DRS comprises three control systems: the attitude control system to maintain a sun-pointing attitude, the drag free control to center the spacecraft about the test masses, and the test mass suspension control. There are five control modes in the operation of the ST7-DRS, starting from the attitude-only mode and leading to the challenging science mode. The design and analysis of each of the control modes are presented. An 18-DOF model is developed to capture the essential dynamics of the ST7-DRS package. It includes all rigid-body dynamics of the spacecraft and two test masses (three translations and three rotations for the spacecraft and each of the test masses). Actuation and measurement noise and major disturbance sources acting on the spacecraft and test masses are modeled.
Maghami, P. G.↗
Fluorescent particle generation and detection system for validation of sterility maintenance.
Aerosolized bacterial simulating fluorescent particle generation and detection system for sterility maintenance validation in closed system allowing sterile assembly and repair
Adlon, G. L.↗
The Space Technology-7 Disturbance Reduction System Precision Control Flight Validation Experiment Control System Design
As originally proposed, the Space Technology-7 Disturbance Reduction System (DRS) project, managed out of the Jet Propulsion Laboratory, was designed to validate technologies required for future missions such as the Laser Interferometer Space Antenna (LISA). The two technologies to be demonstrated by DRS were Gravitational Reference Sensors (GRSs) and Colloidal MicroNewton Thrusters (CMNTs). Control algorithms being designed by the Dynamic Control System (DCS) team at the Goddard Space Flight Center would control the spacecraft so that it flew about a freely-floating GRS test mass, keeping it centered within its housing. For programmatic reasons, the GRSs were descoped from DRS. The primary goals of the new mission are to validate the performance of the CMNTs and to demonstrate precise spacecraft position control. DRS will fly as a part of the European Space Agency (ESA) LISA Pathfinder (LPF) spacecraft along with a similar ESA experiment, the LISA Technology Package (LTP). With no GRS, the DCS attitude and drag-free control systems make use of the sensor being developed by ESA as a part of the LTP. The control system is designed to maintain the spacecraft s position with respect to the test mass, to within 10 nm/the square root of Hz over the DRS science frequency band of 1 to 30 mHz.
O'Donnell, James R.↗
GMAO Updates – FP Systems and Validation
GMAO has updated the FP system a few times since IGC8, and the updates will be summarized here. In addition, some FP systems currently under development that may result in changes in transport are summarized. Efforts inside GMAO to folk transport into the evaluation of new systems are also discussed.
Molod, Andrea↗
Reliability validation of systems for life-critical applications
A framework is proposed which addresses traditional reliability validation approaches consisting of life testing techniques which are inapplicable for digital flight control systems. A specific validation methodology is identified based on logical proofs, analytical modeling, and experimental testing. Research activities required to support continued development of validation technology are identified, and the validation procedure is driven by the reliability model obtained from the system description. The analytical reliability model is shown to be a proper abstraction of the system under consideration, and a proof of correctness of system design and system scheduler performance is proposed.
Trivedi, K. S.↗
NASA Ares I Launch Vehicle First Stage Roll Control System Cold Flow Development Test Program Overview
The Ares I launch vehicle is the selected design, chosen to return humans to the moon, Mars, and beyond. It is configured in two inline stages: the First Stage is a Space Shuttle derived five-segment Solid Rocket Booster and the Upper Stage is powered by a Saturn V derived J-2X engine. During launch, roll control for the First Stage (FS) is handled by a dedicated Roll Control System (RoCS) located on the connecting Interstage. That system will provide the Ares I with the ability to counteract induced roll torque while any induced yaw or pitch moments are handled by vectoring of the booster nozzle. This paper provides an overview of NASA s Ares I FS RoCS cold flow development test program including detailed test objectives, types of tests run to meet those objectives, an overview of the results, and applicable lessons learned. The test article was built and tested at the NASA Marshall Space Flight Center in Huntsville, AL. The FS RoCS System Development Test Article (SDTA) is a full scale, flight representative water flow test article whose primary objective was to obtain fluid system performance data to evaluate integrated system level performance characteristics and verify analytical models. Development testing and model correlation was deemed necessary as there is little historical precedent for similar large flow, pulsing systems such as the FS RoCS. The cold flow development test program consisted of flight-similar tanks, pressure regulators, and thruster valves, as well as plumbing simulating flight geometries, combined with other facility grade components and structure. Orifices downstream of the thruster valves were used to simulate the pressure drop through the thrusters. Additional primary objectives of this test program were to: evaluate system surge pressure (waterhammer) characteristics due to thruster valve operation over a range of mission duty cycles at various feed system pressures, evaluate temperature transients and heat transfer in the pressurization system, including regulator blowdown and propellant ullage performance, measure system pressure drops for comparison to analysis of tubing and components, and validate system activation and re-activation procedures for the helium pressurant system. Secondary objectives included: validating system processes for loading, unloading, and purging, validating procedures and system response for multiple failure scenarios, including relief valve operation, and evaluating system performance for contingency scenarios. The test results of the cold flow development test program are essential in validating the performance and interaction of the Roll Control System and anchoring analysis tools and results to a Critical Design Review level of fidelity.
Butt, Adam↗
A Simulation System for Validating the Analytical Prediction of Performance of the Convolutional Encoded and Symbol Interleaved TDRSS S-band Return Link Service in a Pulsed RFI Environment
A hardware integrated convolutional coding/symbol interleaving and integrated symbol deinterleaving/Viterbi decoding simulation system is described. Validation on the system of the performance of the TDRSS S-band return link with BPSK modulation, operating in a pulsed RFI environment is included. The system consists of three components, the Fast Linkabit Error Rate Tester (FLERT), the Transition Probability Generator (TPG), and a modified LV7017B which includes rate 1/3 capability as well as a periodic interleaver/deinterleaver. Operating and maintenance manuals for each of these units are included.
Source record↗
UAS-Systems Integration, Validation, and Diagnostics Simulation Capability
As part of the Phase 1 efforts of NASA's UAS-in-the-NAS Project a task was initiated to explore the merits of developing a system simulation capability for UAS to address airworthiness certification requirements. The core of the capability would be a software representation of an unmanned vehicle, including all of the relevant avionics and flight control system components. The specific system elements could be replaced with hardware representations to provide Hardware-in-the-Loop (HWITL) test and evaluation capability. The UAS Systems Integration and Validation Laboratory (UAS-SIVL) was created to provide a UAS-systems integration, validation, and diagnostics hardware-in-the-loop simulation capability. This paper discusses how SIVL provides a robust and flexible simulation framework that permits the study of failure modes, effects, propagation paths, criticality, and mitigation strategies to help develop safety, reliability, and design data that can assist with the development of certification standards, means of compliance, and design best practices for civil UAS.
Buttrill, Catherine W.↗
Using High Frequency Passive Microwave, A-train, and TRMM Data to Evaluate Hydrometer Structure in the NASA GEOS-5 Data Assimilation System
Validating water vapor and prognostic condensate in global models remains a challenging research task. Model parameterizations are still subject to a large number of tunable parameters; furthermore, accurate and representative in situ observations are very sparse, and satellite observations historically have significant quantitative uncertainties. Progress on improving cloud / hydrometeor fields in models stands to benefit greatly from the growing inventory ofA-Train data sets. ill the present study we are using a variety of complementary satellite retrievals of hydrometeors to examine condensate produced by the emerging NASA Modem Era Retrospective Analysis for Research and Applications, MERRA, and its associated atmospheric general circulation model GEOS5. Cloud and precipitation are generated by both grid-scale prognostic equations and by the Relaxed Arakawa-Schubert (RAS) diagnostic convective parameterization. The high frequency channels (89 to 183.3 GHz) from AMSU-B and MRS on NOAA polar orbiting satellites are being used to evaluate the climatology and variability of precipitating ice from tropical convective anvils. Vertical hydrometeor structure from the Tropical Rainfall Measuring Mission (TRMM) and CloudSat radars are used to develop statistics on vertical hydrometeor structure in order to better interpret the extensive high frequency passive microwave climatology. Cloud liquid and ice water path data retrieved from the Moderate Resolution Imaging Spectroradiometer, MODIS, are used to investigate relationships between upper level cloudiness and tropical deep convective anvils. Together these data are used to evaluate cloud / ice water path, gross aspects of vertical hydrometeor structure, and the relationship between cloud extent and surface precipitation that the MERRA reanalysis must capture.
Robertson, Franklin↗
Dynamic analysis of Free-Piston Stirling Engine/Linear Alternator-load system-experimentally validated
This paper discusses the effects of variations in system parameters on the dynamic behavior of the Free-Piston Stirling Engine/Linear Alternator (FPSE/LA)-load system. The mathematical formulations incorporate both the mechanical and thermodynamic properties of the FPSE, as well as the electrical equations of the connected load. A state-space technique in the frequency domain is applied to the resulting system of equations to facilitate the evaluation of parametric impacts on the system dynamic stability. Also included is a discussion on the system transient stability as affected by sudden changes in some key operating conditions. Some representative results are correlated with experimental data to verify the model and analytic formulation accuracies. Guidelines are given for ranges of the system parameters which will ensure an overall stable operation.
Kankam, M. David↗