Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Full System Modeling and Validation of the Carbon Dioxide Removal Assembly

The Atmosphere Revitalization Recovery and Environmental Monitoring (ARREM) project was initiated in September of 2011 as part of the Advanced Exploration Systems (AES) program. Under the ARREM project, testing of sub-scale and full-scale systems has been combined with multiphysics computer simulations for evaluation and optimization of subsystem approaches. In particular, this paper describes the testing and modeling of various subsystems of the carbon dioxide removal assembly (CDRA). The goal is a full system predictive model of CDRA to guide system optimization and development. The development of the CO2 removal and associated air-drying subsystem hardware under the ARREM project is discussed in a companion paper.

Coker, Robert↗

Expert system verification and validation study. Delivery 1: Survey and interview questions

The NASA funded questionnaire is presented to help define the state-of-the-practice in the formal evaluation of Expert Systems on current NASA and industry applications. The answers to this questionnaire, together with follow-up interviews, will provide realistic answers to the following questions: (1) How much evaluation is being performed; (2) What evaluation techniques are in use; and (3) What, if any, are the unique issues in evaluating Expert Systems.

Source record↗

Hardware fault insertion and instrumentation system: Mechanization and validation

Automated test capability for extensive low-level hardware fault insertion testing is developed. The test capability is used to calibrate fault detection coverage and associated latency times as relevant to projecting overall system reliability. Described are modifications made to the NASA Ames Reconfigurable Flight Control System (RDFCS) Facility to fully automate the total test loop involving the Draper Laboratories' Fault Injector Unit. The automated capability provided included the application of sequences of simulated low-level hardware faults, the precise measurement of fault latency times, the identification of fault symptoms, and bulk storage of test case results. A PDP-11/60 served as a test coordinator, and a PDP-11/04 as an instrumentation device. The fault injector was controlled by applications test software in the PDP-11/60, rather than by manual commands from a terminal keyboard. The time base was especially developed for this application to use a variety of signal sources in the system simulator.

Benson, J. W.↗

System Level Analysis Software Validation with Argonne's THETA Experimental Facility (Final CRADA Report)

Under this CRADA, the Contractor will be generating and collecting sodium-based experimental data with modern instrumentation. The Contractor will work symbiotically with the Participant to generate SAS4A/SASSYS-1 and SAM computational models of the THETA experimental facility for validation of the system-level analysis codes utilized by Oklo, Inc. This effort will be specifically focused on the design basis event space scoped by Chapter 15 of the NRC’s Standard Review Plan (NUREG-0800) with an emphasis on natural circulation and thermal stratification phenomena in a prototypic sodium-cooled fast reactor (SFR).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Hybrid Heavy Duty Diesel Power System for Off-Road Applications—Concept Validation

A multiyear power system R&D program was completed with the objective of developing an off-road hybrid heavy duty diesel engine with front end accessory drive-integrated energy storage. This system was validated to deliver 10.5–25.6% reduction in fuel consumption over current Tier 4 Final-based 18L diesel engines, over various off-road machine application cycles. The power system consisted of a downsized heavy-duty diesel 13L engine containing advanced combustion technologies, capable of elevated peak cylinder pressures and thermal efficiencies, thermal barrier coatings, exhaust waste heat recovery via SuperTurbo™ turbocompounding, and hybrid energy assisting and recovery through both mechanical and electrical systems. Following the concept definition, design, and analysis phases of the program, the final phase focused on building and validating the performance and efficiency in laboratory tests. While aspects of the system such as start/stop and reduced off-road cooling package energy losses were only analytically evaluated, the main 13L concept engine with full hybrid system was successfully built and tested in steady-state and in transient certification and real-world application cycles. Extensive simulations in Caterpillar's DYNASTY™ software environment utilized the validation test data to assess performance more fully and confidently over varied cycles and strategies. An average fuel consumption reduction of 17.9% was realized, and the majority (~13%) of the benefit stemmed from the core concept 13L engine. In conclusion, a total cost of ownership analysis provides context to commercial viability and where adoption focus should be placed.

33 ADVANCED PROPULSION SYSTEMS↗

Summary: Experimental validation of real-time fault-tolerant systems

Testing and validation of real-time systems is always difficult to perform since neither the error generation process nor the fault propagation problem is easy to comprehend. There is no better substitute to results based on actual measurements and experimentation. Such results are essential for developing a rational basis for evaluation and validation of real-time systems. However, with physical experimentation, controllability and observability are limited to external instrumentation that can be hooked-up to the system under test. And this process is quite a difficult, if not impossible, task for a complex system. Also, to set up such experiments for measurements, physical hardware must exist. On the other hand, a simulation approach allows flexibility that is unequaled by any other existing method for system evaluation. A simulation methodology for system evaluation was successfully developed and implemented and the environment was demonstrated using existing real-time avionic systems. The research was oriented toward evaluating the impact of permanent and transient faults in aircraft control computers. Results were obtained for the Bendix BDX 930 system and Hamilton Standard EEC131 jet engine controller. The studies showed that simulated fault injection is valuable, in the design stage, to evaluate the susceptibility of computing sytems to different types of failures.

Iyer, R. K.↗

Shuttle orbiter experiments: Use of an operational vehicle for advancement and validation of space systems design technologies

The NASA Orbiter Experiments (OEX) Program provided a mechanism for utilization of an operational space shuttle orbiter as a flight research vehicle, as an adjunct to its normal space transportation mission. OEX Program experiments were unique among orbiter payloads, as the research instrumentation for these experiments were carried as integral parts of the vehicle's structure, rather than being placed in the orbiter's payload bay as mission-unique cargo. On each of its first 17 flights, the Orbiter Columbia carried some type of research instrumentation. Various instrumentation systems were used to measure, in flight, the requisite parameters for determination of the orbiter aerodynamic characteristics over the entire entry flight regime and/or the aerodynamic-heating rates imposed upon the vehicle during the hypersonic portion of atmospheric entry. The data derived from this instrumentation represent benchmark hypersonic flight data heretofore unavailable for a lifting entry vehicle. The data are being used in a continual process of validation of state-of-the-art methods, both experimental and computational, for simulating/predicting the aerodynamic and aerothermal characteristics of advanced space transportation vehicles. This paper describes the OEX Program complement of research experiments, presents typical flight data obtained by these experiments, and demonstrates the utilization of these data for advancement and validation of vehicle aerothermodynamic-design tools. By example, the concept of instrumenting operational vehicles and/or spacecraft in order to perform advanced technology development and validation is demonstrated to be an effective and economical method for maturing space-systems design technologies.

Holloway, Paul F.↗

Design and validation of fault-tolerant flight systems

Flight systems must be validated to show that they are consistent with the requirements of their intended applications. While high reliability is difficult to validate, the additional complexity of fault tolerance further compounds the validation problem. The objective of NASA’s research is to develop a methodology for designing validatable fault-tolerant systems. Under the design-for-validation philosophy, emphasis is placed on developing validation methods that can be incorporated into the design process right from the start and design methods and guidance which, while incorporating fault tolerance, can assure validatability. This paper examines the statistical issues of validating highly reliable, fault tolerant system. There are many problems associated with traditional methods of designing and validating these potentially complex hardware and software systems. Useful design-for-validation methods, which include structured specification and design methodologies, mathematical proof techniques, analytical modeling, simulation and emulation, and physical testing, are discussed. Important design issues associated with fault tolerance are presented along with the related validation concerns which must be addressed. Experience has shown that synchronization and Byzantine resilience must accompany fault tolerance. Other design attributes associated with fault tolerance may be used by a designer on the basis of cost, weight, performance, and validation considerations.

Computer systems↗

Development and validation of the crew-station system-integration research facility

The various issues associated with the use of integrated flight management systems in aircraft were discussed. To address these issues a fixed base integrated flight research (IFR) simulation of a helicopter was developed to support experiments that contribute to the understanding of design criteria for rotorcraft cockpits incorporating advanced integrated flight management systems. A validation experiment was conducted that demonstrates the main features of the facility and the capability to conduct crew/system integration research.

Nedell, B.↗

Expert system verification and validation study. Delivery 3A and 3B: Trip summaries

Key results are documented from attending the 4th workshop on verification, validation, and testing. The most interesting part of the workshop was when representatives from the U.S., Japan, and Europe presented surveys of VV&T within their respective regions. Another interesting part focused on current efforts to define industry standards for artificial intelligence and how that might affect approaches to VV&T of expert systems. The next part of the workshop focused on VV&T methods of applying mathematical techniques to verification of rule bases and techniques for capturing information relating to the process of developing software. The final part focused on software tools. A summary is also presented of the EPRI conference on 'Methodologies, Tools, and Standards for Cost Effective Reliable Software Verification and Validation. The conference was divided into discussion sessions on the following issues: development process, automated tools, software reliability, methods, standards, and cost/benefit considerations.

French, Scott↗

Mikhailov Stability Criterion for Time-delayed Systems

The valid and invalid application of the Mikhailov criterion to linear, time-invariant systems with time delays is discussed. The Mikhailov criterion is a graphical procedure which was developed to examine the stability of linear, time-invariant systems with no time delays. Two equivalent formulations of the criterion are discussed. Results indicate that the first formulation remains valid for time-delayed systems of the retared type, with the understanding that the Mikhailov curve need not necessarily always rotate in the counterclockwise direction for a stable system. Erroneous results in the second formulation are formed when there are time delays in the systems.

Barker, L. K.↗

Control Oriented Modeling and Validation of Aeroservoelastic Systems

Lightweight aircraft design emphasizes the reduction of structural weight to maximize aircraft efficiency and agility at the cost of increasing the likelihood of structural dynamic instabilities. To ensure flight safety, extensive flight testing and active structural servo control strategies are required to explore and expand the boundary of the flight envelope. Aeroservoelastic (ASE) models can provide online flight monitoring of dynamic instabilities to reduce flight time testing and increase flight safety. The success of ASE models is determined by the ability to take into account varying flight conditions and the possibility to perform flight monitoring under the presence of active structural servo control strategies. In this continued study, these aspects are addressed by developing specific methodologies and algorithms for control relevant robust identification and model validation of aeroservoelastic structures. The closed-loop model robust identification and model validation are based on a fractional model approach where the model uncertainties are characterized in a closed-loop relevant way.

Crowder, Marianne↗

System-Level Experimental Validations for Supersonic Commercial Transport Aircraft Entering Service in the 2018-2020 Time Period

This report describes the work conducted under NASA funding for the Boeing N+2 Supersonic Experimental Validation project to experimentally validate the conceptual design of a supersonic airliner feasible for entry into service in the 2018 -to 2020 timeframe (NASA N+2 generation). The primary goal of the project was to develop a low-boom configuration optimized for minimum sonic boom signature (65 to 70 PLdB). This was a very aggressive goal that could be achieved only through integrated multidisciplinary optimization tools validated in relevant ground and, later, flight environments. The project was split into two phases. Phase I of the project covered the detailed aerodynamic design of a low boom airliner as well as the wind tunnel tests to validate that design (ref. 1). This report covers Phase II of the project, which continued the design methodology development of Phase I with a focus on the propulsion integration aspects as well as the testing involved to validate those designs. One of the major airplane configuration features of the Boeing N+2 low boom design was the overwing nacelle. The location of the nacelle allowed for a minimal effect on the boom signature, however, it added a level of difficulty to designing an inlet with acceptable performance in the overwing flow field. Using the Phase I work as the starting point, the goals of the Phase 2 project were to design and verify inlet performance while maintaining a low-boom signature. The Phase II project was successful in meeting all contract objectives. New modular nacelles were built for the larger Performance Model along with a propulsion rig with an electrically-actuated mass flow plug. Two new mounting struts were built for the smaller Boom Model, along with new nacelles. Propulsion integration testing was performed using an instrumented fan face and a mass flow plug, while boom signatures were measured using a wall-mounted pressure rail. A side study of testing in different wind tunnels was completed as a precursor to the selection of the facilities used for validation testing. As facility schedules allowed, the propulsion testing was done at the NASA Glenn Research Center (GRC) 8 x 6-Foot wind tunnel, while boom and force testing was done at the NASA Ames Research Center (ARC) 9 x 7-Foot wind tunnel. During boom testing, a live balance was used for gathering force data. This report is broken down into nine sections. The first technical section (Section 2) covers the general scope of the Phase II activities, goals, a description of the design and testing efforts, and the project plan and schedule. Section 3 covers the details of the propulsion system concepts and design evolution. A series of short tests to evaluate the suitability of different wind tunnels for boom, propulsion, and force testing was also performed under the Phase 2 effort, with the results covered in Section 4. The propulsion integration testing is covered in Section 5 and the boom and force testing in Section 6. CFD comparisons and analyses are included in Section 7. Section 8 includes the conclusions and lessons learned.

Magee, Todd E.↗

Gravitational radiation quadrupole formula is valid for gravitationally interacting systems

An argument is presented for the validity of the quadrupole formula for gravitational radiation energy loss in the far field of nearly Newtonian (e.g., binary stellar) systems. This argument differs from earlier ones in that it determines beforehand the formal accuracy of approximation required to describe gravitationally self-interacting systems, uses the corresponding approximate equation of motion explicitly, and evaluates the appropriate asymptotic quantities by matching along the correct space-time light cones.

Walker, M.↗

Reflecting on Planning Models: A Challenge for Verification and Validation of Planning Systems

We discuss the opportunities for autonomous sys- tems to perform reflection on their planners by adapting the models used to build plans. We first describe model-based planning systems, a form of automated planning system driven by declarative models of the planning domain. These models include descriptions of the conditions and effects of actions on the state of the world. When planning the activities of cyber-physical systems, the command and data representation of the system must be formally abstracted to the actions and states described in the planning system model. When the execution of a plan either fails or produces unexpected outcomes, the execution trace can be abstracted and compared to the predicted state according to the planning model, producing a list of discrepancies; these discrepancies can then be used to fix the model. This provides part of a reflection capability, namely, a set of well-formed problems with the domain model, the abstractions, or both. The challenge lies in the rest of the reflection capability, namely, a set of techniques for changing the models or the abstractions. We discuss these challenges and describe some of the options for addressing them

Mission Planning↗

The First Habitable-zone Earth-sized Planet from TESS. I. Validation of the TOI-700 System

We present the discovery and validation of a three-planet system orbiting the nearby (31.1 pc) M2 dwarf star TOI-700 (TIC 150428135). TOI-700 lies in the TESS continuous viewing zone in the Southern Ecliptic Hemisphere; observations spanning 11 sectors reveal three planets with radii ranging from 1 R⊕ to 2.6 R⊕ and orbital periods ranging from 9.98 to 37.43 days. Ground-based follow-up combined with diagnostic vetting and validation tests enables us to rule out common astrophysical false-positive scenarios and validate the system of planets. The outermost planet, TOI-700 d, has a radius of 1.19 ± 0.11 R⊕ and resides within a conservative estimate of the host star's habitable zone, where it receives a flux from its star that is approximately 86% of Earth's insolation. In contrast to some other low-mass stars that host Earth-sized planets in their habitable zones, TOI-700 exhibits low levels of stellar activity, presenting a valuable opportunity to study potentially rocky planets over a wide range of conditions affecting atmospheric escape. While atmospheric characterization of TOI-700 d with the James Webb Space Telescope (JWST) will be challenging, the larger sub-Neptune, TOI-700 c (R = 2.63 R⊕), will be an excellent target for JWST and future space-based observatories. TESS is scheduled to once again observe the Southern Hemisphere, and it will monitor TOI-700 for an additional 11 sectors in its extended mission. These observations should allow further constraints on the known planet parameters and searches for additional planets and transit timing variations in the system.

Emily A. Gilbert↗