Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Evaluation in context: ATC automation in the field

The process for incorporating advanced technologies into complex aviation systems is as important as the final product itself. This paper described a process that is currently being applied to the development and assessment of an advanced ATC automation system, CTAS. The key element of the process is field exposure early in the system development cycle. The process deviates from current established practices of system development -- where field testing is an implementation endpoint -- and has been deemed necessary by the FAA for streamlining development and bringing system functions to a level of stability and usefulness. Methods and approaches for field assessment are borrowed from human factors engineering, cognitive engineering, and usability engineering and are tailored for the constraints of an operational ATC environment. To date, the focus has been on the qualitative assessment of the match between TMA capabilities and the context for their use. Capturing the users' experience with the automation tool and understanding tool use in the context of the operational environment is important, not only for developing a tool that is an effective problem-solving instrument but also for defining meaningful operational requirements. Such requirements form the basis for certifying the safety and efficiency of the system. CTAS is the first U.S. advanced ATC automation system of its scope and complexity to undergo this field development and assessment process. With the rapid advances in aviation technologies and our limited understanding of their impact on system performance, it is time we opened our eyes to new possibilities for developing, validating, and ultimately certifying complex aviation systems.

Harwood, Kelly↗

ISS Medical Checklist Procedures Validation and Training

The Health Maintenance System (HMS) hardware will be used to support a medical contingency for the International Space Station (ISS). During two test flights, the procedures for performing Advanced Cardiac Life Support (ACLS) were evaluated to determine the required level of detail, assess the logic of the steps and division of tasks among crew members.

Tom Marshburn↗

Discrete Event Simulation-Based Timeline Validation Using R2U2

The Gateway Vehicle Systems Manager (VSM), the top-level software control system in a distributed, hierarchical Autonomous System Management Architecture is, like most modern spacecraft software control systems, heavily data-driven. For example, schedules (timelines) will be developed on the ground and, due to the high degree of autonomy, contain complex procedures involving conditional branching, variable timing, and resource contention resolution. In order to verify that an uploaded timeline will function correctly, it is necessary to explore the feasible set of possible executions. While it is possible to test a timeline using a mission simulation, the complexity of the system and duration of a timeline limits the number of trials and therefore the test coverage. To address this problem, the VSM team is using a discrete event system model that can rapidly generate from a timeline sets of event sequences using Monte Carlo techniques. To achieve rapid and trustworthy checking of the event sequences, we use an offline version of the runtime model checking tool R2U2. This presentation describes the approach the VSM team is using to implement the discrete event simulation and evaluate event sequences using R2U2. The presentation will discuss: 1. Description of the timelines by VSM in the context of VSM operations 2. Expansion of a timeline into a sequence of atomic events 3. Adjustment, in the Monte Carlo environment, of an event sequence to account for uncertainty, external events, and failures 4. Definition of R2U2 input and mission-time linear temporal logic files 5. Generation and use of R2U2 verdict sequences 6. Lessons learned and future work

Verification↗

Moving base simulation of an integrated flight and propulsion control system for an ejector-augmentor STOVL aircraft in hover

A piloted motion simulator evaluation, using the NASA Ames Vertical Motion Simulator, was conducted in support of a NASA Lewis Contractual study of the integration of flight and propulsion systems of a STOVL aircraft. Objectives of the study were to validate the Design Methods for Integrated Control Systems (DMICS) concept, to evaluate the handling qualities, and to assess control power usage. The E-7D ejector-augmentor STOVL fighter design served as the basis for the simulation. Handling-qualities ratings were obtained during precision hover and shipboard landing tasks. Handling-qualities ratings for these tasks ranged from satisfactory to adequate. Further improvement of the design process to fully validate the DMICS concept appears to be warranted.

Mcneill, Walter, E.↗

Verification and Validation Plan for Flight Performance Requirements on the CEV Parachute Assembly System

The Crew Exploration Vehicle Parachute Assembly System (CPAS) is engaged in a multi-year design and test campaign aimed at qualifying a parachute recovery system for human use on the Orion Spacecraft. Orion has parachute flight performance requirements that will ultimately be verified through the use of Monte Carlo multi-degree of freedom flight simulations. These simulations will be anchored by real world flight test data and iteratively improved to provide a closer approximation to the real physics observed in the inherently chaotic inflation and steady state flight of the CPAS parachutes. This paper will examine the processes necessary to verify the flight performance requirements of the human rated spacecraft. The focus will be on the requirements verification and model validation planned on CPAS.

Morris, Aaron L.↗

Analysis of Wallops Flight Test Data Through an Automated COTS System

During the summer of 2004 NASA Langley Research Center flight tested a Synthetic Vision System (SVS) at the Reno/Tahoe International Airport (RNO) and the Wallops Flight Facility (WAL). The SVS included a Runway Incursion Prevention System (RIPS) to improve pilot situational awareness while operating near and on the airport surface. The flight tests consisted of air and ground operations to evaluate and validate the performance of the system. This paper describes the flight test and emphasizes how positioning data was collected, post processed and analyzed through the use of a COTS-derived software system. The system that was developed to analyze the data was constructed within the MATLAB(TM) environment. The software was modified to read the data, perform several if-then scenarios and produce the relevant graphs, figures and tables.

Blackstock, Dexter Lee↗

Developments in Atmosphere Revitalization Modeling and Simulation

"NASA's Advanced Exploration Systems (AES) program is pioneering new approaches for rapidly developing prototype systems, demonstrating key capabilities, and validating operational concepts for future human missions beyond Earth orbit" (NASA 2012). These forays beyond the confines of earth's gravity will place unprecedented demands on launch systems. They must not only blast out of earth's gravity well as during the Apollo moon missions, but also launch the supplies needed to sustain a crew over longer periods for exploration missions beyond earth's moon. Thus all spacecraft systems, including those for the separation of metabolic carbon dioxide and water from a crewed vehicle, must be minimized with respect to mass, power, and volume. Emphasis is also placed on system robustness both to minimize replacement parts and ensure crew safety when a quick return to earth is not possible. Current efforts are focused on improving the current state-of-the-art systems utilizing fixed beds of sorbent pellets by evaluating structured sorbents, seeking more robust pelletized sorbents, and examining alternate bed configurations to improve system efficiency and reliability. These development efforts combine testing of sub-scale systems and multi-physics computer simulations to evaluate candidate approaches, select the best performing options, and optimize the configuration of the selected approach, which is then implemented in a full-scale integrated atmosphere revitalization test. This paper describes the development of atmosphere revitalization models and simulations. A companion paper discusses the hardware design and sorbent screening and characterization effort in support of the Atmosphere Revitalization Recovery and Environmental Monitoring (ARREM) project within the AES program.

Knox, James C.↗

Development of Carbon Dioxide Removal Systems for Advanced Exploration Systems

"NASA's Advanced Exploration Systems (AES) program is pioneering new approaches for rapidly developing prototype systems, demonstrating key capabilities, and validating operational concepts for future human missions beyond Earth orbit" (NASA 2012). These forays beyond the confines of earth's gravity will place unprecedented demands on launch systems. They must not only blast out of earth's gravity well as during the Apollo moon missions, but also launch the supplies needed to sustain a crew over longer periods for exploration missions beyond earth's moon. Thus all spacecraft systems, including those for the separation of metabolic carbon dioxide and water from a crewed vehicle, must be minimized with respect to mass, power, and volume. Emphasis is also placed on system robustness both to minimize replacement parts and ensure crew safety when a quick return to earth is not possible. Current efforts are focused on improving the current state-of-the-art systems utilizing fixed beds of sorbent pellets by seeking more robust pelletized sorbents, evaluating structured sorbents, and examining alternate bed configurations to improve system efficiency and reliability. These development efforts combine testing of sub-scale systems and multi-physics computer simulations to evaluate candidate approaches, select the best performing options, and optimize the configuration of the selected approach, which is then implemented in a full-scale integrated atmosphere revitalization test. This paper describes the carbon dioxide (CO2) removal hardware design and sorbent screening and characterization effort in support of the Atmosphere Resource Recovery and Environmental Monitoring (ARREM) project within the AES program. A companion paper discusses development of atmosphere revitalization models and simulations for this project.

Knox, James C.↗

Transient Thermal Analyses of Passive Systems on SCEPTOR X-57

As efficiency, emissions, and noise become increasingly prominent considerations in aircraft design, turning to an electric propulsion system is a desirable solution. Achieving the intended benefits of distributed electric propulsion (DEP) requires thermally demanding high power systems, presenting a different set of challenges compared to traditional aircraft propulsion. The embedded nature of these heat sources often preclude the use of traditional thermal management systems in order to maximize performance, with less opportunity to exhaust waste heat to the surrounding environment. This paper summarizes the thermal analyses of X-57 vehicle subsystems that don't employ externally air-cooled heat sinks. The high-power battery, wires, high-lift motors, and aircraft outer surface are subjected to heat loads with stringent thermal constraints. The temperature of these components are tracked transiently, since they never reach a steady-state equilibrium. Through analysis and testing, this report demonstrates that properly characterizing the material properties is key to accurately modeling peak temperature of these systems, with less concern for spatial thermal gradients. Experimentally validated results show the thermal profile of these systems can be sufficiently estimated using reduced order approximations.

Thermal Analyses↗

Internal Acoustics of the ISS and Other Spacecraft

It is important to control the acoustic environment inside spacecraft and space habitats to protect for astronaut communications, alarm audibility, and habitability, and to reduce astronauts' risk for sleep disturbance, and hear-ing loss. But this is not an easy task, given the various design trade-offs, and it has been difficult, historically, to achieve. Over time it has been found that successful control of spacecraft acoustic levels is achieved by levying firm requirements at the system-level, using a systems engineering approach for design and development, and then validating these requirements with acoustic testing. In the systems engineering method, the system-level requirements must be flowed down to sub-systems and component noise sources, using acoustic analysis and acoustic modelling to develop allocated requirements for the sub-systems and components. Noise controls must also be developed, tested, and implemented so the sub-systems and components can achieve their allocated limits. It is also important to have management support for acoustics efforts to maintain their priority against the various trade-offs, including mass, volume, power, cost, and schedule. In this extended abstract and companion presentation, the requirements, approach, and results for controlling acoustic levels in most US spacecraft since Apollo will be briefly discussed. The approach for controlling acoustic levels in the future US space vehicle, Orion Multipurpose Crew Vehicle (MPCV), will also be briefly discussed. These discussions will be limited to the control of continuous noise inside the space vehicles. Other types of noise, such as launch, landing, and abort noise, intermittent noise, Extra-Vehicular Activity (EVA) noise, emergency operations/off-nominal noise, noise exposure, and impulse noise are important, but will not be discussed because of time limitations.

Allen, Christopher S.↗

Progress Towards Modeling the Mars Science Laboratory PICA-NuSil Heatshield

The data collected by the Mars Science Laboratory (MSL) Entry, Descent and Landing Instrumentation, MEDLI, have become an established reference to assess the performance of engineering models of the Phenolic Impregnated Carbon Ablator (PICA) and to validate hypersonic computational fluid dynamics (CFD) tools for entry systems. MEDLI measurements are also extensively used as validation reference for current developments of high-fidelity material response models for PICA. So large has been the scientific output and impact of MEDLI that a follow-up instrumentation suite MEDLI2 is underway for the upcoming Mars 2020 mission.A feature neglected thus far in the modeling of the MSL heatshield, is the presence of a silicone-based room temperature vulcanizing coating designated NuSil CV-1144-0. NuSil was used to coat the entire MSL heatshield, including the MEDLI plugs, to mitigate the spread of phenolic dust from PICA, and limit contamination during clean room operations. NuSil CV-1144-0 is a space grade siloxane copolymer, designed as an oxygen protection barrier for extreme low temperature environment.Assessments conducted during MSL development demonstrated that the presence of NuSil had no adverse effect on the performance of PICA. However, evidence from ground testing of PICA-NuSil (PICA-N) models in the HyMETS arc-jet test facility suggests that the silicone changes the high temperature response of PICA. It is therefore critical to assess the importance of modeling the coating in ongoing code validation efforts.

Bessire, Brody K.↗

Real-time In-Flight Strain and Deflection Monitoring with Fiber Optic Sensors

This viewgraph presentation reviews Dryden's efforts to develop in-flight monitoring based on Fiber Optics. One of the motivating factors for this development was the breakup of the Helios aircraft. On Ikhana the use of fiber optics for wing shape sensing is being developed. They are being used to flight validate fiber optic sensor measurements and real-time wing shape sensing predictions on NASA's Ikhana vehicle; validate fiber optic mathematical models and design tools; Assess technical viability and, if applicable, develop methodology and approach to incorporate wing shape measurements within the vehicle flight control system, and develop and flight validate advanced approaches to perform active wing shape control.

Richards, Lance↗

Fiber Optic Wing Shape Sensing on NASA's Ikhana UAV

This document discusses the development of fiber optic wing shape sensing on NASA's Ikhana vehicle. The Dryden Flight Research Center's Aerostructures Branch initiated fiber-optic instrumentation development efforts in the mid-1990s. Motivated by a failure to control wing dihedral resulting in a mishap with the Helios aircraft, new wing displacement techniques were developed. Research objectives for Ikhana included validating fiber optic sensor measurements and real-time wing shape sensing predictions; the validation of fiber optic mathematical models and design tools; assessing technical viability and, if applicable, developing methodology and approaches to incorporate wing shape measurements within the vehicle flight control system; and, developing and flight validating approaches to perform active wing shape control using conventional control surfaces and active material concepts.

Richards, Lance↗

Explaining Synthesized Software

Motivated by NASA's need for high-assurance software, NASA Ames' Amphion project has developed a generic program generation system based on deductive synthesis. Amphion has a number of advantages, such as the ability to develop a new synthesis system simply by writing a declarative domain theory. However, as a practical matter, the validation of the domain theory for such a system is problematic because the link between generated programs and the domain theory is complex. As a result, when generated programs do not behave as expected, it is difficult to isolate the cause, whether it be an incorrect problem specification or an error in the domain theory. This paper describes a tool we are developing that provides formal traceability between specifications and generated code for deductive synthesis systems. It is based on extensive instrumentation of the refutation-based theorem prover used to synthesize programs. It takes augmented proof structures and abstracts them to provide explanations of the relation between a specification, a domain theory, and synthesized code. In generating these explanations, the tool exploits the structure of Amphion domain theories, so the end user is not confronted with the intricacies of raw proof traces. This tool is crucial for the validation of domain theories as well as being important in everyday use of the code synthesis system. It plays an important role in validation because when generated programs exhibit incorrect behavior, it provides the links that can be traced to identify errors in specifications or domain theory. It plays an important role in the everyday use of the synthesis system by explaining to users what parts of a specification or of the domain theory contribute to what pieces of a generated program. Comments are inserted into the synthesized code that document these explanations.

VanBaalen, Jeffrey↗

L(sub 1) Adaptive Flight Control System: Flight Evaluation and Technology Transition

Certification of adaptive control technologies for both manned and unmanned aircraft represent a major challenge for current Verification and Validation techniques. A (missing) key step towards flight certification of adaptive flight control systems is the definition and development of analysis tools and methods to support Verification and Validation for nonlinear systems, similar to the procedures currently used for linear systems. In this paper, we describe and demonstrate the advantages of L(sub l) adaptive control architectures for closing some of the gaps in certification of adaptive flight control systems, which may facilitate the transition of adaptive control into military and commercial aerospace applications. As illustrative examples, we present the results of a piloted simulation evaluation on the NASA AirSTAR flight test vehicle, and results of an extensive flight test program conducted by the Naval Postgraduate School to demonstrate the advantages of L(sub l) adaptive control as a verifiable robust adaptive flight control system.

Xargay, Enric↗

Three-dimensional compressible viscous analysis of mixer nozzles

An analysis-based design procedure for compound-mixer exhaust nozzles is presented and compared to test data. The design approach is based on two numerical solutions to the 3-D viscous compressible Navier-Stokes equations: an equation splitting technique used for the analysis of the core and bypass flow, and a parabolic marching scheme used in the analysis of the mixing duct. The selection of the analytical methods through test data comparisons and their coupling into an integrated design system are discussed. NASA test data is used to demonstrate the validity of the computations from the exhaust system rating station, upstream of the mixer lobe, to the nozzle throat. An estimate is made of the savings in development time and cost utilizing the new procedure.

Goyal, R. K.↗

Modeling and Simulation Verification, Validation and Accreditation (VV&A): A New Undertaking for the Exploration Systems Mission Directorate

and Accreditation (VV&A) session audience, a snapshot review of the Exploration Space Mission Directorate s (ESMD) investigation into implementation of a modeling and simulation (M&S) VV&A program. The presentation provides some legacy ESMD reference material, including information on the then-current organizational structure, and M&S (Simulation Based Acquisition (SBA)) focus contained therein, to provide a context for the proposed M&S VV&A approach. This reference material briefly highlights the SBA goals and objectives, and outlines FY05 M&S development and implementation consistent with the Subjective Assessment, Constructive Assessment, Operator-in-the-Loop Assessment, Hardware-in-the-Loop Assessment, and In Service Operations Assessment M&S construct, the NASA Exploration Information Ontology Model (NExIOM) data model, and integration with the Windchill-based Integrated Collaborative Environment (ICE). The presentation then addresses the ESMD team s initial conclusions regarding an M&S VV&A program, summarizes the general VV&A implementation approach anticipated, and outlines some of the recognized VV&A program challenges, all within a broader context of the overarching Integrated Modeling and Simulation (IM&S) environment at both the ESMD and Agency (NASA) levels. The presentation concludes with a status on the current M&S organization s progress to date relative to the recommended IM&S implementation activity. The overall presentation was focused to provide, for the Verification, Validation,

Prill, Mark E.↗