Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Testing validation tools on CLIPS-based expert systems

The Expert Systems Validation Associate (EVA) is a validation system which was developed at the Lockheed Software Technology Center and Artificial Intelligence Center between 1986 and 1990. EVA is an integrated set of generic tools to validate any knowledge-based system written in any expert system shell such as C Language Integrated Production System (CLIPS), ART, OPS5, KEE, and others. Many validation tools have been built in the EVA system. In this paper, we describe the testing results of applying the EVA validation tools to the Manned Maneuvering Unit (MMU) Fault Diagnosis, Isolation, and Reconfiguration (FDIR) expert system, written in CLIPS, obtained from the NASA Johnson Space Center.

Chang, C. L.↗
NASA NTRS2008

Select Methodology for Validating Advanced Satellite Measurement Systems

Advanced satellite sensors are tasked with improving global measurements of the Earth's atmosphere, clouds, and surface to enable enhancements in weather prediction, climate monitoring capability, and environmental change detection. Measurement system validation is crucial to achieving this goal and maximizing research and operational utility of resultant data. Field campaigns including satellite under-flights with well calibrated FTS sensors aboard high-altitude aircraft are an essential part of the validation task. This presentation focuses on an overview of validation methodology developed for assessment of high spectral resolution infrared systems, and includes results of preliminary studies performed to investigate the performance of the Infrared Atmospheric Sounding Interferometer (IASI) instrument aboard the MetOp-A satellite.

Larar, Allen M.↗
NASA NTRS2014

Infrared Spectral Radiance Intercomparisons With Satellite and Aircraft Sensors

Measurement system validation is critical for advanced satellite sounders to reach their full potential of improving observations of the Earth's atmosphere, clouds, and surface for enabling enhancements in weather prediction, climate monitoring capability, and environmental change detection. Experimental field campaigns, focusing on satellite under-flights with well-calibrated FTS sensors aboard high-altitude aircraft, are an essential part of the validation task. Airborne FTS systems can enable an independent, SI-traceable measurement system validation by directly measuring the same level-1 parameters spatially and temporally coincident with the satellite sensor of interest. Continuation of aircraft under-flights for multiple satellites during multiple field campaigns enables long-term monitoring of system performance and inter-satellite cross-validation. The NASA / NPOESS Airborne Sounder Testbed - Interferometer (NAST-I) has been a significant contributor in this area by providing coincident high spectral/spatial resolution observations of infrared spectral radiances along with independently-retrieved geophysical products for comparison with like products from satellite sensors being validated. This presentation gives an overview of benefits achieved using airborne sensors such as NAST-I utilizing examples from recent field campaigns. The methodology implemented is not only beneficial to new sensors such as the Cross-track Infrared Sounder (CrIS) flying aboard the Suomi NPP and future JPSS satellites but also of significant benefit to sensors of longer flight heritage such as the Atmospheric InfraRed Sounder (AIRS) and the Infrared Atmospheric Sounding Interferometer (IASI) on the AQUA and METOP-A platforms, respectively, to ensure data quality continuity important for climate and other applications. Infrared spectral radiance inter-comparisons are discussed with a particular focus on usage of NAST-I data for enabling inter-platform cross-validation.

Larar, Allen M.↗
NASA NTRS2003

Control Modes of the ST7 Disturbance Reduction System Flight Validation Experiment

The Space Technology 7 experiment will perform an on-orbit system-level validation of two specific Disturbance Reduction System technologies: a gravitational reference sensor employing a free-floating test mass and a set of micro-Newton colloidal thrusters. The ST7 Disturbance Reduction System is designed to maintain the spacecraft s position with respect to a free-floating test mass to less than 10 nm/the square root of Hz over the frequency range of 1 to 30 mHz. This requirement will help ensure that the residual accelerations on the test masses (beyond gravitational acceleration) will be below the ST7 goal of 300 (1 + [f/3 mHz](sup 2)) pm/s(sup 2)/the square root of Hz. This paper presents the overall design and analysis of the spacecraft drag-free and attitude controllers being designed by NASA s Goddard Space Flight Center. These controllers close the loop between the GRS and the micro-Newton colloidal thrusters. The ST7 DRS comprises three control systems: the attitude control system to maintain a sun-pointing attitude, the drag free control to center the spacecraft about the test masses, and the test mass suspension control. There are five control modes in the operation of the ST7-DRS, starting from the attitude-only mode and leading to the challenging science mode. The design and analysis of each of the control modes are presented. An 18-DOF model is developed to capture the essential dynamics of the ST7-DRS package. It includes all rigid-body dynamics of the spacecraft and two test masses (three translations and three rotations for the spacecraft and each of the test masses). Actuation and measurement noise and major disturbance sources acting on the spacecraft and test masses are modeled.

Maghami, P. G.↗
DOE OSTI2026

Validating Protection System Behavior with Machine Learning in a Master State Overseer

As power system protection devices continue the widespread transition from analog to digital, they become increasingly intricate. The internal functions and communication between critical grid components must now be significantly more complex to keep up with the demands of the modern smart grid. This brings increased difficulty in maintenance and monitoring, making it harder to identify potential misoperation, power anomalies, and cyber threats. Such issues are often only pinpointed after an exhaustive and costly post-mortem analysis, when a major outage or damage has already occurred. A solution is needed for validating protection systems as they operate, independently evaluating grid state and confirming whether the protection system is behaving accordingly. As opposed to incident response, this acts as a constant verification mechanism that raises a flag when subtler issues are noticed, catching them earlier and preventing larger incidents. This work presents the implementation of such a system, expanding on the prototype developed by the authors in a previous paper. This is accomplished with a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. Additionally, this system is contextualized within a larger, modular Master State awareness Overseer (MSO) framework, responsible for monitoring, analyzing, and managing an electric grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2006

The Space Technology-7 Disturbance Reduction System Precision Control Flight Validation Experiment Control System Design

As originally proposed, the Space Technology-7 Disturbance Reduction System (DRS) project, managed out of the Jet Propulsion Laboratory, was designed to validate technologies required for future missions such as the Laser Interferometer Space Antenna (LISA). The two technologies to be demonstrated by DRS were Gravitational Reference Sensors (GRSs) and Colloidal MicroNewton Thrusters (CMNTs). Control algorithms being designed by the Dynamic Control System (DCS) team at the Goddard Space Flight Center would control the spacecraft so that it flew about a freely-floating GRS test mass, keeping it centered within its housing. For programmatic reasons, the GRSs were descoped from DRS. The primary goals of the new mission are to validate the performance of the CMNTs and to demonstrate precise spacecraft position control. DRS will fly as a part of the European Space Agency (ESA) LISA Pathfinder (LPF) spacecraft along with a similar ESA experiment, the LISA Technology Package (LTP). With no GRS, the DCS attitude and drag-free control systems make use of the sensor being developed by ESA as a part of the LTP. The control system is designed to maintain the spacecraft s position with respect to the test mass, to within 10 nm/the square root of Hz over the DRS science frequency band of 1 to 30 mHz.

O'Donnell, James R.↗
NASA NTRS2019

GMAO Updates – FP Systems and Validation

GMAO has updated the FP system a few times since IGC8, and the updates will be summarized here. In addition, some FP systems currently under development that may result in changes in transport are summarized. Efforts inside GMAO to folk transport into the evaluation of new systems are also discussed.

Molod, Andrea↗
DOE OSTI2026

Dynamic modeling of heat pipe integrated thermal battery latent heat storage system experiment validation

A heat pipe integrated thermal battery system has been constructed to investigate a high-temperature latent heat thermal energy storage technology that takes advantage of near isothermal operation of latent heat storage and heat pipes to potentially enable high-energy isothermal heat storage. A dynamic model constructed in Modelica has been validated, showing errors between 2.5 °C–39.7 °C across 10-h to 47-h simulations against experiment results, showing good prediction capability of experiment output, especially against phase change time. Model calibrations showing vessel heat-up capability of 3 kW and heat pipes combining to provide 600 W each during experiment operation validate experiment circumstances including reduced material loading and reduced power capability. The experiment configuration uses an Al-Mg-Zn eutectic metal as the storage material, heated via heat tape wrapped around the vessel and guide tubes to bring the system to operation range (>400 °C) and to simulate charging heat exchange, respectively, with heat rejection occurring through the surfaces of the material and facilitated via guide tubes with less insulation wrapping. The model is available in the open-source repository HYBRID on Github.

25 - ENERGY STORAGE↗
NASA NTRS1980

Reliability validation of systems for life-critical applications

A framework is proposed which addresses traditional reliability validation approaches consisting of life testing techniques which are inapplicable for digital flight control systems. A specific validation methodology is identified based on logical proofs, analytical modeling, and experimental testing. Research activities required to support continued development of validation technology are identified, and the validation procedure is driven by the reliability model obtained from the system description. The analytical reliability model is shown to be a proper abstraction of the system under consideration, and a proof of correctness of system design and system scheduler performance is proposed.

Trivedi, K. S.↗
NASA NTRS2010

NASA Ares I Launch Vehicle First Stage Roll Control System Cold Flow Development Test Program Overview

The Ares I launch vehicle is the selected design, chosen to return humans to the moon, Mars, and beyond. It is configured in two inline stages: the First Stage is a Space Shuttle derived five-segment Solid Rocket Booster and the Upper Stage is powered by a Saturn V derived J-2X engine. During launch, roll control for the First Stage (FS) is handled by a dedicated Roll Control System (RoCS) located on the connecting Interstage. That system will provide the Ares I with the ability to counteract induced roll torque while any induced yaw or pitch moments are handled by vectoring of the booster nozzle. This paper provides an overview of NASA s Ares I FS RoCS cold flow development test program including detailed test objectives, types of tests run to meet those objectives, an overview of the results, and applicable lessons learned. The test article was built and tested at the NASA Marshall Space Flight Center in Huntsville, AL. The FS RoCS System Development Test Article (SDTA) is a full scale, flight representative water flow test article whose primary objective was to obtain fluid system performance data to evaluate integrated system level performance characteristics and verify analytical models. Development testing and model correlation was deemed necessary as there is little historical precedent for similar large flow, pulsing systems such as the FS RoCS. The cold flow development test program consisted of flight-similar tanks, pressure regulators, and thruster valves, as well as plumbing simulating flight geometries, combined with other facility grade components and structure. Orifices downstream of the thruster valves were used to simulate the pressure drop through the thrusters. Additional primary objectives of this test program were to: evaluate system surge pressure (waterhammer) characteristics due to thruster valve operation over a range of mission duty cycles at various feed system pressures, evaluate temperature transients and heat transfer in the pressurization system, including regulator blowdown and propellant ullage performance, measure system pressure drops for comparison to analysis of tubing and components, and validate system activation and re-activation procedures for the helium pressurant system. Secondary objectives included: validating system processes for loading, unloading, and purging, validating procedures and system response for multiple failure scenarios, including relief valve operation, and evaluating system performance for contingency scenarios. The test results of the cold flow development test program are essential in validating the performance and interaction of the Roll Control System and anchoring analysis tools and results to a Critical Design Review level of fidelity.

Butt, Adam↗
NASA NTRS1981

A Simulation System for Validating the Analytical Prediction of Performance of the Convolutional Encoded and Symbol Interleaved TDRSS S-band Return Link Service in a Pulsed RFI Environment

A hardware integrated convolutional coding/symbol interleaving and integrated symbol deinterleaving/Viterbi decoding simulation system is described. Validation on the system of the performance of the TDRSS S-band return link with BPSK modulation, operating in a pulsed RFI environment is included. The system consists of three components, the Fast Linkabit Error Rate Tester (FLERT), the Transition Probability Generator (TPG), and a modified LV7017B which includes rate 1/3 capability as well as a periodic interleaver/deinterleaver. Operating and maintenance manuals for each of these units are included.

Source record↗
NASA NTRS2014

UAS-Systems Integration, Validation, and Diagnostics Simulation Capability

As part of the Phase 1 efforts of NASA's UAS-in-the-NAS Project a task was initiated to explore the merits of developing a system simulation capability for UAS to address airworthiness certification requirements. The core of the capability would be a software representation of an unmanned vehicle, including all of the relevant avionics and flight control system components. The specific system elements could be replaced with hardware representations to provide Hardware-in-the-Loop (HWITL) test and evaluation capability. The UAS Systems Integration and Validation Laboratory (UAS-SIVL) was created to provide a UAS-systems integration, validation, and diagnostics hardware-in-the-loop simulation capability. This paper discusses how SIVL provides a robust and flexible simulation framework that permits the study of failure modes, effects, propagation paths, criticality, and mitigation strategies to help develop safety, reliability, and design data that can assist with the development of certification standards, means of compliance, and design best practices for civil UAS.

Buttrill, Catherine W.↗
NASA NTRS2007

Using High Frequency Passive Microwave, A-train, and TRMM Data to Evaluate Hydrometer Structure in the NASA GEOS-5 Data Assimilation System

Validating water vapor and prognostic condensate in global models remains a challenging research task. Model parameterizations are still subject to a large number of tunable parameters; furthermore, accurate and representative in situ observations are very sparse, and satellite observations historically have significant quantitative uncertainties. Progress on improving cloud / hydrometeor fields in models stands to benefit greatly from the growing inventory ofA-Train data sets. ill the present study we are using a variety of complementary satellite retrievals of hydrometeors to examine condensate produced by the emerging NASA Modem Era Retrospective Analysis for Research and Applications, MERRA, and its associated atmospheric general circulation model GEOS5. Cloud and precipitation are generated by both grid-scale prognostic equations and by the Relaxed Arakawa-Schubert (RAS) diagnostic convective parameterization. The high frequency channels (89 to 183.3 GHz) from AMSU-B and MRS on NOAA polar orbiting satellites are being used to evaluate the climatology and variability of precipitating ice from tropical convective anvils. Vertical hydrometeor structure from the Tropical Rainfall Measuring Mission (TRMM) and CloudSat radars are used to develop statistics on vertical hydrometeor structure in order to better interpret the extensive high frequency passive microwave climatology. Cloud liquid and ice water path data retrieved from the Moderate Resolution Imaging Spectroradiometer, MODIS, are used to investigate relationships between upper level cloudiness and tropical deep convective anvils. Together these data are used to evaluate cloud / ice water path, gross aspects of vertical hydrometeor structure, and the relationship between cloud extent and surface precipitation that the MERRA reanalysis must capture.

Robertson, Franklin↗
DOE OSTI2021

Verification and Validation of Systems in which AI is a Key Element

Many systems are being considered in which artificial intelligence (AI) will be a key element. Failure of an AI element can lead to system failure, hence the need for AI verification and validation (V&V). This article addresses V&V of such a system, focusing on the issues created by characteristics of AI that make V&V challenging. The element(s) containing AI capabilities is treated as a subsystem and V&V is conducted on that subsystem and its interfaces with other elements of the system under study, just as V&V would be conducted on other subsystems. That is, the high-level definitions of verification and of validation do not change for systems containing one or more AI elements. However, AI V&V challenges require approaches and solutions beyond those for conventional or traditional (those without AI elements) systems. This article provides an overview of how machine learning components/subsystems “fit” in the systems engineering framework (Section 1), identifies characteristics of AI subsystems that create challenges in their V&V (Section 2), describes those challenges (Section 3) and provides some potential solutions (Section 4).

Pullum, Laura↗
NASA NTRS1992

Dynamic analysis of Free-Piston Stirling Engine/Linear Alternator-load system-experimentally validated

This paper discusses the effects of variations in system parameters on the dynamic behavior of the Free-Piston Stirling Engine/Linear Alternator (FPSE/LA)-load system. The mathematical formulations incorporate both the mechanical and thermodynamic properties of the FPSE, as well as the electrical equations of the connected load. A state-space technique in the frequency domain is applied to the resulting system of equations to facilitate the evaluation of parametric impacts on the system dynamic stability. Also included is a discussion on the system transient stability as affected by sudden changes in some key operating conditions. Some representative results are correlated with experimental data to verify the model and analytic formulation accuracies. Guidelines are given for ranges of the system parameters which will ensure an overall stable operation.

Kankam, M. David↗
NASA NTRS1990

Human performance measurement: Validation procedures applicable to advanced manned telescience systems

As telescience systems become more and more complex, autonomous, and opaque to their operators it becomes increasingly difficult to determine whether the total system is performing as it should. Some of the complex and interrelated human performance measurement issues are addressed as they relate to total system validation. The assumption is made that human interaction with the automated system will be required well into the Space Station Freedom era. Candidate human performance measurement-validation techniques are discussed for selected ground-to-space-to-ground and space-to-space situations. Most of these measures may be used in conjunction with an information throughput model presented elsewhere (Haines, 1990). Teleoperations, teleanalysis, teleplanning, teledesign, and teledocumentation are considered, as are selected illustrative examples of space related telescience activities.

Haines, Richard F.↗