Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Proceedings of the Second NASA Formal Methods Symposium

This publication contains the proceedings of the Second NASA Formal Methods Symposium sponsored by the National Aeronautics and Space Administration and held in Washington D.C. April 13-15, 2010. Topics covered include: Decision Engines for Software Analysis using Satisfiability Modulo Theories Solvers; Verification and Validation of Flight-Critical Systems; Formal Methods at Intel -- An Overview; Automatic Review of Abstract State Machines by Meta Property Verification; Hardware-independent Proofs of Numerical Programs; Slice-based Formal Specification Measures -- Mapping Coupling and Cohesion Measures to Formal Z; How Formal Methods Impels Discovery: A Short History of an Air Traffic Management Project; A Machine-Checked Proof of A State-Space Construction Algorithm; Automated Assume-Guarantee Reasoning for Omega-Regular Systems and Specifications; Modeling Regular Replacement for String Constraint Solving; Using Integer Clocks to Verify the Timing-Sync Sensor Network Protocol; Can Regulatory Bodies Expect Efficient Help from Formal Methods?; Synthesis of Greedy Algorithms Using Dominance Relations; A New Method for Incremental Testing of Finite State Machines; Verification of Faulty Message Passing Systems with Continuous State Space in PVS; Phase Two Feasibility Study for Software Safety Requirements Analysis Using Model Checking; A Prototype Embedding of Bluespec System Verilog in the PVS Theorem Prover; SimCheck: An Expressive Type System for Simulink; Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness; Software Model Checking of ARINC-653 Flight Code with MCP; Evaluation of a Guideline by Formal Modelling of Cruise Control System in Event-B; Formal Verification of Large Software Systems; Symbolic Computation of Strongly Connected Components Using Saturation; Towards the Formal Verification of a Distributed Real-Time Automotive System; Slicing AADL Specifications for Model Checking; Model Checking with Edge-valued Decision Diagrams; and Data-flow based Model Analysis.

Munoz, Cesar↗

International Space Station Requirement Verification for Commercial Visiting Vehicles

The COTS program demonstrated NASA could rely on commercial providers for safe, reliable, and cost-effective cargo delivery to ISS. The ISS Program has developed a streamlined process to safely integrate commercial visiting vehicles and ensure requirements are met Levy a minimum requirement set (down from 1000s to 100s) focusing on the ISS interface and safety, reducing the level of NASA oversight/insight and burden on the commercial Partner. Partners provide a detailed verification and validation plan documenting how they will show they've met NASA requirements. NASA conducts process sampling to ensure that the established verification processes is being followed. NASA participates in joint verification events and analysis for requirements that require both parties verify. Verification compliance is approved by NASA and launch readiness certified at mission readiness reviews.

Garguilo, Dan↗

Aircraft electromagnetic compatibility

Illustrated are aircraft architecture, electromagnetic interference environments, electromagnetic compatibility protection techniques, program specifications, tasks, and verification and validation procedures. The environment of 400 Hz power, electrical transients, and radio frequency fields are portrayed and related to thresholds of avionics electronics. Five layers of protection for avionics are defined. Recognition is given to some present day electromagnetic compatibility weaknesses and issues which serve to reemphasize the importance of EMC verification of equipment and parts, and their ultimate EMC validation on the aircraft. Proven standards of grounding, bonding, shielding, wiring, and packaging are laid out to help provide a foundation for a comprehensive approach to successful future aircraft design and an understanding of cost effective EMC in an aircraft setting.

Clarke, Clifton A.↗

TOPEX Microwave Radiometer - Thermal design verification test and analytical model validation

The testing of the TOPEX Microwave Radiometer (TMR) is described in terms of hardware development based on the modeling and thermal vacuum testing conducted. The TMR and the vacuum-test facility are described, and the thermal verification test includes a hot steady-state segment, a cold steady-state segment, and a cold survival mode segment totalling 65 hours. A graphic description is given of the test history which is related temperature tracking, and two multinode TMR test-chamber models are compared to the test results. Large discrepancies between the test data and the model predictions are attributed to contact conductance, effective emittance from the multilayer insulation, and heat leaks related to deviations from the flight configuration. The TMR thermal testing/modeling effort is shown to provide technical corrections for the procedure outlined, and the need for validating predictive models is underscored.

Lin, Edward I.↗

Advancements in Frequency Domain Analysis of Dual Centerline Propellant Tanks for Space Vehicle Stability and Design

This paper presents advancements in the frequency domain stability analysis for landing and ascent vehicle configurations with dual centerline propellant tanks, developed in support of Guidance, Navigation, and Control (GNC) insight activities for the Human Landing System project. The study focuses on the impact of axial thrust on the dual tank slosh danger zone solution. The frequency domain stability analysis tool is developed within the GeneraLized Aerospace Simulation in Simulink® (GLASS) framework at NASA Marshall Space Flight Center. The frequency domain stability analysis tool is used to determine slosh damping and control systems design requirements. The accuracy of the tool’s instability predictions is validated against time-domain outcomes within the GLASS simulation environment, showing consistent and anticipated results. Additionally, the method is validated by comparing its results with Frequency Domain Analysis and Comparison Tool Assuming Linearity (FRACTAL), a frequency domain analysis tool with extensive heritage and rigorous verification and validation using NASA Ares I-X and SLS flight data. The findings of this paper contribute to a better understanding of dual-tank slosh instability and support improved design and operation margins of space vehicles.

Han Woong (Brian) Bae↗

Advancements in Frequency Domain Analysis of Dual Centerline Propellant Tanks for Space Vehicle Stability and Design

This paper presents advancements in the frequency domain stability analysis for landing and ascent vehicle configurations with dual centerline propellant tanks, developed in support of Guidance, Navigation, and Control (GNC) insight activities for the Human Landing System project. The study focuses on the impact of axial thrust on the dual tank slosh danger zone solution. The frequency domain stability analysis tool is developed within the GeneraLized Aerospace Simulation in Simulink® (GLASS) framework at NASA Marshall Space Flight Center. The frequency domain stability analysis tool is used to determine slosh damping and control systems design requirements. The accuracy of the tool’s instability predictions is validated against time-domain outcomes within the GLASS simulation environment, showing consistent and anticipated results. Additionally, the method is validated by comparing its results with Frequency Domain Analysis and Comparison Tool Assuming Linearity (FRACTAL), a frequency domain analysis tool with extensive heritage and rigorous verification and validation using NASA Ares I-X and SLS flight data. The findings of this paper contribute to a better understanding of dual-tank slosh instability and support improved design and operation margins of space vehicles.

Han Woong (Brian) Bae↗

TEAMS Model Analyzer

The TEAMS model analyzer is a supporting tool developed to work with models created with TEAMS (Testability, Engineering, and Maintenance System), which was developed by QSI. In an effort to reduce the time spent in the manual process that each TEAMS modeler must perform in the preparation of reporting for model reviews, a new tool has been developed as an aid to models developed in TEAMS. The software allows for the viewing, reporting, and checking of TEAMS models that are checked into the TEAMS model database. The software allows the user to selectively model in a hierarchical tree outline view that displays the components, failure modes, and ports. The reporting features allow the user to quickly gather statistics about the model, and generate an input/output report pertaining to all of the components. Rules can be automatically validated against the model, with a report generated containing resulting inconsistencies. In addition to reducing manual effort, this software also provides an automated process framework for the Verification and Validation (V&V) effort that will follow development of these models. The aid of such an automated tool would have a significant impact on the V&V process.

Tijidjian, Raffi P.↗

Integrated Simulation Design Challenges to Support TPS Repair Operations

During the Orbiter Repair Maneuver (ORM) operations planned for Return to Flight (RTF), the Shuttle Remote Manipulator System (SRMS) must grapple the International Space Station (ISS), undock the Orbiter, maneuver it through a long duration trajectory, and orient it to an EVA crewman poised at the end of the Space Station Remote Manipulator System (SSRMS) to facilitate the repair of the Thermal Protection System (TPS). Once repair has been completed and confirmed, then the SRMS proceeds back through the trajectory to dock the Orbiter to the Orbiter Docking System. In order to support analysis of the complex dynamic interactions of the integrated system formed by the Orbiter, ISS, SRMS, and SSMS during the ORM, simulation tools used for previous ‘nominal’ mission support required substantial enhancements. These upgrades were necessary to provide analysts with the capabilities needed to study integrated system performance. Prevalent throughout this ORM operation is a dynamically varying topology. In other words, the ORM starts with the SRMS grappled to the mated Shuttle/ISS stack (closed loop topology), moves to an open loop chain topology consisting of the Shuttle, SRMS, and ISS, and then, at the repair configuration, extends the chain topology to one consisting of the Shuttle, SMS, ISS, and SSRMS/EVA crewman. The resulting long dynamic chain of vehicles and manipulators may exhibit significant motion between the Shuttle worksite and the EVA crewman due to the system flexibility throughout the topology (particularly within the SRMS/SSRMS joints and links). Since the attachment points of both manipulators span the flexible structure of the ISS, simulation analysis may also need to take that into consideration. Moreover, due to the lengthy time duration associated with the maneuver and repair, orbital effects become a factor and require the ISS vehicle control system to maintain active attitude control. Several facets of the ORM operation make the associated analytical efforts different from previous mission support, including: (1) the magnitude of the SRMS handled payload (Le., Orbiter class), (2) the orbital effects induced on the integrated system consisting of the large Shuttle and ISS masses connected by a light flexible SRMS, (3) long duration environmental consequences due to the lengthy operational times associated with the maneuver and repair of the TPS, (4) active attitude control (as opposed to free drift) interacting with the SRMS and SSRMS manipulators (also due to the length of the maneuver and repair), (5) relative dynamics between the EVA crewman and thc worksite influenced by the extended flexible topology. In order to meet these analysis challenges, an ORM simulation architecture was developed leveraging upon numerous pre-existing simulation elements to analyze the various subsystems individually. For example, core manipulator subsystem simulations for both the SRMS and SSRMS were originally combined to provide the dual-arm dynamics topology simulation (in the absence of orbital dynamics and vehicle control). This capability was later merged with the simulation used to analyze SRMS loading with a heavy payload in the orbital environment with an active payload control system (in this case, the ISS Attitude Control System (ACS)), configured for the ORM. The resulting worksite dynamics simulation, based off of the modified ORM simulation, provided the extended topological chain of vehicles and manipulators, while taking into account the orbital effects of both the Shuttle and ISS (as well as its ACS). Verification and validation (V&V) of these integrated simulations became a challenge in itself. A systematic approach needed to be developed such that integration simulation results could be tested against previous constituent simulations upon which these simulations were built. General V&V categories included: (1) core orbital state propagation, (2), stand-alone SRMS, (3) stand-alone SSRMS, (4) stand-alone ISS ACS, (5) integrated Shuttle, SRMS, ISS (with active ACS) in the orbital environment, and (5) dual-arm SRMS/SSRMS dynamics topology. Integrated simulation V&V run suites were created and correlated to verification runs from subsystem simulations, in order to establish the validity of the results. This paper discusses the simulation design challenges encountered while developing simulation capabilities to mirror the ORM operations. The paper also describes the incremental build approach that was utilized, starting with the subsystem simulation elements and integration into increasing more complex simulations until the resulting ORM worksite dynamics simulation had been assembled. Furthermore, the paper presents an overall integrated simulation V&V methodology based upon a subsystem level testing, integrated comparisons, and phased checkout.

Thermal Protection System↗

Validation Database Based Thermal Analysis of an Advanced RPS Concept

Advanced RPS concepts can be conceived, designed and assessed using high-end computational analysis tools. These predictions may provide an initial insight into the potential performance of these models, but verification and validation are necessary and required steps to gain confidence in the numerical analysis results. This paper discusses the findings from a numerical validation exercise for a small advanced RPS concept, based on a thermal analysis methodology developed at JPL and on a validation database obtained from experiments performed at Oregon State University. Both the numerical and experimental configurations utilized a single GPHS module enabled design, resembling a Mod-RTG concept. The analysis focused on operating and environmental conditions during the storage phase only. This validation exercise helped to refine key thermal analysis and modeling parameters, such as heat transfer coefficients, and conductivity and radiation heat transfer values. Improved understanding of the Mod-RTG concept through validation of the thermal model allows for future improvements to this power system concept.

numerical model↗

Climate studies from satellite observations - Special problems in the verification of earth radiation balance, cloud climatology, and related climate experiments

A body of techniques that have been developed and planned for use during the Earth Radiation Budget Experiment (ERBE), the International Satellite Cloud Climatology Project (ISCCP), and related climate experiments of the 1980's are reviewed. Validation and verification methods must apply for systems of satellites. They include: (1) use of a normalization or intercalibration satellite, (2) special intensive observation areas located over ground-truth sites, and (3) monitoring of sun and earth by several satellites and/or several instruments at the same time. Since each climate application area has a hierarchy of user communities, validation techniques vary from very detailed methods to those that simply assure high relative accuracy in detecting space and time variations for climate studies. It is shown that climate experiments generally require more emphasis on long-term stability and internal consistency of satellite data sets than high absolute accuracy.

Vonder Haar, T. H.↗

Offloading techniques for large deployable space structures

The validation and verification of large deployable space structures are continual challenges which face the integration and test engineer today. Spar Aerospace Limited has worked on various programs in which such structure validation was required and faces similar tasks in the future. This testing is reported and the different offloading and deployment methods which were used, as well as the proposed methods which will be used on future programs, are described. Past programs discussed include the Olympus solar array ambient and thermal vacuum deployments, and the Anik-E array and reflector deployments. The proposed MSAT reflector and boom ambient deployment tests, as well as the proposed RADARSAT Synthetic Aperture Radar (SAR) ambient and thermal vacuum deployment tests will also be presented. A series of tests relating to various component parts of the offloading equipment systems was required. These tests included the characterization and understanding of linear bearings and large (180 in-lbf) constant force spring motors in a thermal vacuum environment, and the results from these tests are presented.

Caravaggio, Levino↗

Real-time Models at the Community Coordinated Modeling Center and their Capabilities

Real-time models at the Community Coordinated Modeling Center and their capabilities The Community Coordinated Modeling Center serves both scientific research and space weather operations communities through access to and evaluation of modern space environment models. Critical to both objectives is an unbiased assessment of model capabilities, which includes scientific validity, performance verification, and model robustness. While all of these assessments are relevant to operational customers, the latter plays a particularly important role. For this reason, as well as for testing model validity, CCMC established a set of fully automated real-time execution systems, which are based on models provided by the research community. This presentation will provide a summary of these activities, and a report on experiences and model validity. Finally, this presentation will invite feedback from CCMC customers regarding future directions of real time modeling at CCMC.

Hesse, Michael↗

Flight Test 4 Preliminary Results: NASA Ames SSI

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. The Unmanned Aircraft System (UAS) Integration into the National Airspace System (NAS) Project conducted flight test program, referred to as Flight Test 4, at Armstrong Flight Research Center from April -June 2016. Part of the test flights were dedicated to the NASA Ames-developed Detect and Avoid (DAA) System referred to as JADEM (Java Architecture for DAA Extensibility and Modeling). The encounter scenarios, which involved NASA's Ikhana UAS and a manned intruder aircraft, were designed to collect data on DAA system performance in real-world conditions and uncertainties with four different surveillance sensor systems. Flight test 4 has four objectives: (1) validate DAA requirements in stressing cases that drive MOPS requirements, including: high-speed cooperative intruder, low-speed non-cooperative intruder, high vertical closure rate encounter, and Mode CS-only intruder (i.e. without ADS-B), (2) validate TCASDAA alerting and guidance interoperability concept in the presence of realistic sensor, tracking and navigational errors and in multiple-intruder encounters against both cooperative and non-cooperative intruders, (3) validate Well Clear Recovery guidance in the presence of realistic sensor, tracking and navigational errors, and (4) validate DAA alerting and guidance requirements in the presence of realistic sensor, tracking and navigational errors. The results will be presented at RTCA Special Committee 228 in support of final verification and validation of the DAA MOPS.

Detect-And-Avoid (DAA)↗

Verifying Stability of Dynamic Soft-Computing Systems

Soft computing is a general term for algorithms that learn from human knowledge and mimic human skills. Example of such algorithms are fuzzy inference systems and neural networks. Many applications, especially in control engineering, have demonstrated their appropriateness in building intelligent systems that are flexible and robust. Although recent research have shown that certain class of neuro-fuzzy controllers can be proven bounded and stable, they are implementation dependent and difficult to apply to the design and validation process. Many practitioners adopt the trial and error approach for system validation or resort to exhaustive testing using prototypes. In this paper, we describe our on-going research towards establishing necessary theoretic foundation as well as building practical tools for the verification and validation of soft-computing systems. A unified model for general neuro-fuzzy system is adopted. Classic non-linear system control theory and recent results of its applications to neuro-fuzzy systems are incorporated and applied to the unified model. It is hoped that general tools can be developed to help the designer to visualize and manipulate the regions of stability and boundedness, much the same way Bode plots and Root locus plots have helped conventional control design and validation.

Wen, Wu↗

Projected Impact of Compositional Verification on Current and Future Aviation Safety Risk

The projected impact of compositional verification research conducted by the National Aeronautic and Space Administration System-Wide Safety and Assurance Technologies on aviation safety risk was assessed. Software and compositional verification was described. Traditional verification techniques have two major problems: testing at the prototype stage where error discovery can be quite costly and the inability to test for all potential interactions leaving some errors undetected until used by the end user. Increasingly complex and nondeterministic aviation systems are becoming too large for these tools to check and verify. Compositional verification is a "divide and conquer" solution to addressing increasingly larger and more complex systems. A review of compositional verification research being conducted by academia, industry, and Government agencies is provided. Forty-four aviation safety risks in the Biennial NextGen Safety Issues Survey were identified that could be impacted by compositional verification and grouped into five categories: automation design; system complexity; software, flight control, or equipment failure or malfunction; new technology or operations; and verification and validation. One capability, 1 research action, 5 operational improvements, and 13 enablers within the Federal Aviation Administration Joint Planning and Development Office Integrated Work Plan that could be addressed by compositional verification were identified.

Reveley, Mary S.↗

Precise and Scalable Static Program Analysis of NASA Flight Software

Recent NASA mission failures (e.g., Mars Polar Lander and Mars Orbiter) illustrate the importance of having an efficient verification and validation process for such systems. One software error, as simple as it may be, can cause the loss of an expensive mission, or lead to budget overruns and crunched schedules. Unfortunately, traditional verification methods cannot guarantee the absence of errors in software systems. Therefore, we have developed the CGS static program analysis tool, which can exhaustively analyze large C programs. CGS analyzes the source code and identifies statements in which arrays are accessed out of bounds, or, pointers are used outside the memory region they should address. This paper gives a high-level description of CGS and its theoretical foundations. It also reports on the use of CGS on real NASA software systems used in Mars missions (from Mars PathFinder to Mars Exploration Rover) and on the International Space Station.

Brat, G.↗

Collected software engineering papers, volume 3

Topics addressed include: software technology evaluation programs; collection of valid software engineering data; test processes using structural coverage; prototype expert system for software engineering management; use of an environment characteristic software metric set; software modulation; software development by analysis of change; and independent verification and validation.

Source record↗

Validation of High-Fidelity CFD Simulations for Rocket Injector Design

Computational fluid dynamics (CFD) has the potential to improve the historical rocket injector design process by evaluating the sensitivity of performance and injector-driven thermal environments to the details of the injector geometry and key operational parameters. Methodical verification and validation efforts on a range of coaxial injector elements have shown the current production CFD capability must be improved in order to quantitatively impact the injector design process. This paper documents the status of a focused effort to compare and understand the predictive capabilities and computational requirements of a range of CFD methodologies on a set of single element injector model problems. The steady Reynolds-Average Navier-Stokes (RANS), unsteady Reynolds-Average Navier-Stokes (URANS) and three different approaches using the Large Eddy Simulation (LES) technique were used to simulate the initial model problem, a single element coaxial injector using gaseous oxygen and gaseous hydrogen propellants. While one high-fidelity LES result matches the experimental combustion chamber wall heat flux very well, there is no monotonic convergence to the data with increasing computational tool fidelity. Systematic evaluation of key flow field regions such as the flame zone, the head end recirculation zone and the downstream near wall zone has shed significant, though as of yet incomplete, light on the complex, underlying causes for the performance level of each technique. 1 Aerospace Engineer and Combustion CFD Team Leader, MS ER42, NASA MSFC, AL 35812, Senior Member, AIAA. 2 Professor and Director, Computational Combustion Laboratory, School of Aerospace Engineering, 270 Ferst Dr., Atlanta, GA 30332, Associate Fellow, AIAA. 3 Reilly Professor of Engineering, School of Mechanical Engineering, 585 Purdue Mall, West Lafayette, IN 47907, Fellow, AIAA. 4 Principal Member of Technical Staff, Combustion Research Facility, 7011 East Avenue, MS9051, Livermore, CA 94550, Associate Fellow, AIAA. 5 J. L. and G. H. McCain Endowed Chair, Mechanical Engineering, 104 Research Building East, University Park, PA 16802, Fellow, AIAA. American Institute of Aeronautics and Astronautics 1

Tucker, P. Kevin↗