Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Inspection and Verification of Domain Models with PlanWorks and Aver

When developing a domain model, it seems natural to bring the traditional informal tools of inspection and verification, debuggers and automated test suites, to bear upon the problems that will inevitably arise. Debuggers that allow inspection of registers and memory and stepwise execution have been a staple of software development of all sorts from the very beginning. Automated testing has repeatedly proven its considerable worth, to the extent that an entire design philosophy (Test Driven Development) has been developed around the writing of tests. Unfortunately, while not entirely without their uses, the limitations of these tools and the nature of the complexity of models and the underlying planning systems make the diagnosis of certain classes of problems and the verification of their solutions difficult or impossible. Debuggers provide a good local view of executing code, allowing a fine-grained look at algorithms and data. This view is, however, usually only at the level of the current scope in the implementation language, and the data-inspection capabilities of most debuggers usually consist of on-line print statements. More modem graphical debuggers offer a sort of tree view of data structures, but even this is too low-level and is often inappropriate for the kinds of structures created by planning systems. For instance, god or constraint networks are at best awkward when visualized as trees. Any any non-structural link between data structures, as through a lookup table, isn't captured at all. Further, while debuggers have powerful breakpointing facilities that are suitable for finding specific algorithmic errors, they have little use in the diagnosis of modeling errors.

Bedrax-Weiss, Tania↗

Knowledge-Based Aircraft Automation: Managers Guide on the use of Artificial Intelligence for Aircraft Automation and Verification and Validation Approach for a Neural-Based Flight Controller

The ultimate goal of this report was to integrate the powerful tools of artificial intelligence into the traditional process of software development. To maintain the US aerospace competitive advantage, traditional aerospace and software engineers need to more easily incorporate the technology of artificial intelligence into the advanced aerospace systems being designed today. The future goal was to transition artificial intelligence from an emerging technology to a standard technology that is considered early in the life cycle process to develop state-of-the-art aircraft automation systems. This report addressed the future goal in two ways. First, it provided a matrix that identified typical aircraft automation applications conducive to various artificial intelligence methods. The purpose of this matrix was to provide top-level guidance to managers contemplating the possible use of artificial intelligence in the development of aircraft automation. Second, the report provided a methodology to formally evaluate neural networks as part of the traditional process of software development. The matrix was developed by organizing the discipline of artificial intelligence into the following six methods: logical, object representation-based, distributed, uncertainty management, temporal and neurocomputing. Next, a study of existing aircraft automation applications that have been conducive to artificial intelligence implementation resulted in the following five categories: pilot-vehicle interface, system status and diagnosis, situation assessment, automatic flight planning, and aircraft flight control. The resulting matrix provided management guidance to understand artificial intelligence as it applied to aircraft automation. The approach taken to develop a methodology to formally evaluate neural networks as part of the software engineering life cycle was to start with the existing software quality assurance standards and to change these standards to include neural network development. The changes were to include evaluation tools that can be applied to neural networks at each phase of the software engineering life cycle. The result was a formal evaluation approach to increase the product quality of systems that use neural networks for their implementation.

Broderick, Ron↗

In Situ Data Infrastructure for Scientific Unit Testing Platform

Testing is a significant software development process for the management of software systems and scientific code. However, as the complexity of scientific codes increases, extra checks are needed to monitor impacts to dependent models and to verify system constraints. The software complexity also impedes the efforts of module developers and software engineers to rapidly develop and extend their code. Recently, we have developed an automatic methodology and prototype platform to facilitate scientific verification of individual functions within complex scientific codes. With this system, the scientific module builders are able to track variables conveniently in one module or track variables’ changes among different modules. In this paper, we present a procedure for automatic unit testing generation. For the interest of a general audience of this conference, we are emphasizing the technical details of integrating the In Situ data infrastructure into our platform. At the end of this paper, we have included an implementation of unit testing for the ACME Land Model (ALM) to demonstrate the usefulness and correctness of the platform. We have also used single- and multipoint checks to demonstrate the efficient variable tracking capability of this platform.

97 MATHEMATICS AND COMPUTING↗

BISON TRISO Modeling Advancements and Validation to AGR-1 Data

BISON is a finite element-based nuclear fuel performance code. Among its unique characteristics are its ability to model 1D, 2D, and 3D geometries and its applicability to a wide variety of nuclear fuels. For the last eight years, BISON has included a beginning capability to model tri-structural isotropic (TRISO) fuel. Recently, interest in TRISO fuel has grown, and a significant effort has been made to improve BISON’s capabilities in this area. Capability development has occurred for each material present in TRISO fuel particles: the buffer, inner pyrolytic carbon, silicon carbide, and outer pyrolytic carbon layers, as well as the fuel kernel. New elastic, creep, swelling, thermal expansion, thermal conductivity, and fission gas release (FGR) models are available. New models for the graphite matrix are also now available. Another important addition is the ability to perform statistical failure analysis of large samples of fuel particles. This new capability, which continues to grow, enables evaluation of failure due to pressure or crack formation by analyzing many thousands of particles. This enables realistic calculations of fission product release from the many particles in a TRISO-fueled reactor. These capabilities were checked via regression and verification tests. A large number of code benchmarking problems were also run, showing that BISON’s results closely match those of other software tools. Finally, a significant validation effort was completed in which fission product release, measured as part of the AGR-1 capsule experiments, was compared to BISON outputs. BISON outputs compared very well to the experimental data and to PARFUME results. Interest in BISON’s TRISO capabilities is growing, with the U.S. Nuclear Regulatory Commission (NRC) and Westinghouse Electric Company receiving training during the past year. Multiple other entities have expressed interest in or are actively using BISON. Kairos Power, LLC, has a strong partnership with Idaho National Laboratory (INL) regarding the use of BISON for TRISO analysis. While its capabilities still continue to grow, BISON has already become a powerful tool for TRISO analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Requirements Description of VARPOW

This report presents the modeling and simulation capabilities of Argonne National Laboratory’s VARPOW code [1] that is used in present reactor analysis activities. These capabilities will then be used to establish the set of VARPOW verification tasks necessary to verify VARPOW for usage on commercial projects. A similar approach was taken for the PERSENT, REBUS and DIF3D software packages. The VARPOW program is a post-processing utility program for DIF3D, specifically DIF3DVARIANT. As covered in [1], the VARPOW program was built to provide input for follow-on steady state thermal-hydraulic analysis. Its primary purpose is to act as the interface between DASSH and DIF3D-VARIANT. The outputs from VARPOW are contained in three output files: Output.VARPOW, VariantMonoExponents.out, and MaterialPower.out.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Requirements Description of VARPOW

This report presents the modeling and simulation capabilities of Argonne National Laboratory’s VARPOW code that is used in present reactor analysis activities. These capabilities will then be used to establish the set of VARPOW verification tasks necessary to verify VARPOW for usage on commercial projects. A similar approach was taken for the PERSENT, REBUS and DIF3D software packages. The VARPOW program is a post-processing utility program for DIF3D, specifically DIF3D-VARIANT. As covered in [1], the VARPOW program was built to provide input for follow-on steady state thermal-hydraulic analysis. Its primary purpose is to act as the interface between DASSH and DIF3D-VARIANT. The outputs from VARPOW are contained in three output files: Output.VARPOW, VariantMonoExponents.out, and MaterialPower.out.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Requirements Description of VARPOW

This report presents the modeling and simulation capabilities of Argonne National Laboratory’s VARPOW code that is used in present reactor analysis activities. These capabilities will then be used to establish the set of VARPOW verification tasks necessary to verify VARPOW for usage on commercial projects. A similar approach was taken for the PERSENT, REBUS and DIF3D software packages.

Ramey, Kyle [Argonne National Laboratory (ANL), Ar↗

Tools to aid the specification and design of flight software, appendix B

The tasks that are normally performed during the specification and architecture design stages of software development are identified. Ways that tools could perform, or aid the performance, of such tasks are also identified. Much of the verification and analysis that is suggested is currently rarely performed during these early stages, but it is believed that this analysis should be done as early as possible so as to detect errors as early as possible.

Bristow, G.↗

Discrete Spring Model for Predicting Delamination Growth in Z-Fiber Reinforced DCB Specimens

Beam theory analysis was applied to predict delamination growth in DCB specimens reinforced in the thickness direction with pultruded pins, known as Z-fibers. The specimen arms were modeled as cantilever beams supported by discrete springs, which were included to represent the pins. A bi-linear, irreversible damage law was used to represent Z-fiber damage, the parameters of which were obtained from previous experiments. Closed-form solutions were developed for specimen compliance and displacements corresponding to Z-fiber row locations. A solution strategy was formulated to predict delamination growth, in which the parent laminate mode I fracture toughness was used as the criterion for delamination growth. The solution procedure was coded into FORTRAN 90, giving a dedicated software tool for performing the delamination prediction. Comparison of analysis results with previous analysis and experiment showed good agreement, yielding an initial verification for the analytical procedure.

Ratcliffe, James G.↗

Discrete Spring Model for Predicting Delamination Growth in Z-Fiber Reinforced DCB Specimens

Beam theory analysis was applied to predict delamination growth in Double Cantilever Beam (DCB) specimens reinforced in the thickness direction with pultruded pins, known as Z-fibers. The specimen arms were modeled as cantilever beams supported by discrete springs, which were included to represent the pins. A bi-linear, irreversible damage law was used to represent Z-fiber damage, the parameters of which were obtained from previous experiments. Closed-form solutions were developed for specimen compliance and displacements corresponding to Z-fiber row locations. A solution strategy was formulated to predict delamination growth, in which the parent laminate mode I critical strain energy release rate was used as the criterion for delamination growth. The solution procedure was coded into FORTRAN 90, giving a dedicated software tool for performing the delamination prediction. Comparison of analysis results with previous analysis and experiment showed good agreement, yielding an initial verification for the analytical procedure.

Ratcliffe, James G.↗

Database Driven 6-DOF Trajectory Simulation for Debris Transport Analysis

Debris mitigation and risk assessment have been carried out by NASA and its contractors supporting Space Shuttle Return-To-Flight (RTF). As a part of this assessment, analysis of transport potential for debris that may be liberated from the vehicle or from pad facilities prior to tower clear (Lift-Off Debris) is being performed by MSFC. This class of debris includes plume driven and wind driven sources for which lift as well as drag are critical for the determination of the debris trajectory. As a result, NASA MSFC has a need for a debris transport or trajectory simulation that supports the computation of lift effect in addition to drag without the computational expense of fully coupled CFD with 6-DOF. A database driven 6-DOF simulation that uses aerodynamic force and moment coefficients for the debris shape that are interpolated from a database has been developed to meet this need. The design, implementation, and verification of the database driven six degree of freedom (6-DOF) simulation addition to the Lift-Off Debris Transport Analysis (LODTA) software are discussed in this paper.

West, Jeff↗

Quantitative gamma-spectrometry of nuclear material under conditions of limited information about assayed objects

Canberra Industries has developed a specialized software package, Advanced In-Situ Object Counting System (A-ISOCS), which is based on absolute gamma-spectrometric measurements. It is intended for the verification of the quantity of nuclear materials under conditions where measurements are challenged by incomplete information on the properties of assayed objects which are inspected by the International Atomic Energy (IAEA)'s inspectors. A-ISOCS introduces a technique, which is called the automated optimization that allows the users to determine unknown sample parameters as well as the mass and isotopic composition of nuclear materials. The optimization process is carried out by using benchmarks referring the information included within the gamma-ray spectrum of the measured item. For each benchmark, Figure-of-Merit (FOM) is calculated and used to find the most consistent quantitative result (the best solution) corresponded to the minimized FOM. We have evaluated the capabilities and performance of A-ISOCS based on the measurements of uranium standard reference material samples, which have well-known geometry parameters and physical properties. In addition the applicability of the software to field measurements was assessed with an extensive set of gamma-ray spectra from holdup materials collected at uranium bulk handling facilities. This paper summarizes the results of our evaluation activity. (authors)

36 MATERIALS SCIENCE↗

ABM Drag_Pass Report Generator

dragREPORT software was developed in parallel with abmREPORT, which is described in the preceding article. Both programs were built on the capabilities created during that process. This tool generates a drag_pass report that summarizes vital information from the MRO aerobreaking drag_pass build process to facilitate both sequence reviews and provide a high-level summarization of the sequence for mission management. The script extracts information from the ENV, SSF, FRF, SCMFmax, and OPTG files, presenting them in a single, easy-to-check report providing the majority of parameters needed for cross check and verification as part of the sequence review process. Prior to dragReport, all the needed information was spread across a number of different files, each in a different format. This software is a Perl script that extracts vital summarization information and build-process details from a number of source files into a single, concise report format used to aid the MPST sequence review process and to provide a high-level summarization of the sequence for mission management reference. This software could be adapted for future aerobraking missions to provide similar reports, review and summarization information.

Fisher, Forest↗

An overview of the V&V of Flight-Critical Systems effort at NASA

As the US is getting ready for the Next Generation (NextGen) of Air Traffic System, there is a growing concern that the current techniques for verification and validation will not be adequate for the changes to come. The JPDO (in charge of implementing NextGen) has given NASA a mandate to address the problem and it resulted in the formulation of the V&V of Flight-Critical Systems effort. This research effort is divided into four themes: argument-based safety assurance, distributed systems, authority and autonomy, and, software intensive systems. This paper presents an overview of the technologies that will address the problem.

validation↗

Safety Verification of a Fault Tolerant Reconfigurable Autonomous Goal-Based Robotic Control System

Fault tolerance and safety verification of control systems are essential for the success of autonomous robotic systems. A control architecture called Mission Data System (MDS), developed at the Jet Propulsion Laboratory, takes a goal-based control approach. In this paper, a method for converting goal network control programs into linear hybrid systems is developed. The linear hybrid system can then be verified for safety in the presence of failures using existing symbolic model checkers. An example task is simulated in MDS and successfully verified using HyTech, a symbolic model checking software for linear hybrid systems.

goal network↗

SU-E-T-348: Verification MU Calculation for Conformal Radiotherapy with Multileaf Collimator Using Report AAPM TG 114

Purpose: The purpose of this work was to develop and validate an open source independent MU dose calculation software for 3D conformal radiotherapy with multileaf high and low resolution according to the report of AAPM TG 11 Methods: Treatment plans were done using Iplan v4.5 BrainLAB TPS. A 6MV photon beam produced by Primus and Novalis linear accelerators equipped with an Optifocus MLC and HDMLC, respectively. TPS dose calculation algorithms were pencil beam and Monte Carlo. 1082 treatments plans were selected for the study. The algorithm was written in free and open source CodeBlocks C++ platform. Treatment plans were imported by the software using RTP format. Equivalent size field is obtained from the positions of the leaves; the effective depth of calculation can be introduced by TPS's dosimetry report or automatically calculated starting from SSD. The inverse square law is calculated by the 3D coordinates of the isocenter and normalization point of the treatment plan. The dosimetric parameters TPR, Sc, Sp and WF are linearly interpolated. Results: 1082 plans of both machines were analyzed. The average uncertainty between the TPS and the independent calculation was −0.43% ± 2.42% [−7.90%, 7.50%]. Specifically for the Primus the variation obtained was −0.85% ± 2.53% and for the Novalis 0.00% ± 2.23%. Data show that 94.8% of the cases the uncertainty was less than or equal to 5%, while 98.9% is less than or equal to 6%. Conclusion: The developed software is appropriate for use in calculation of UM. This software can be obtained upon request.

07 ISOTOPE AND RADIATION SOURCES↗

Development and implementation of the verification process for the shuttle avionics system

The background of the shuttle avionics system design and the unique drivers associated with the redundant digital multiplexed data processing system are examined. With flight software pervading to the lowest elements of the flight critical subsystems, it was necessary to identify a unique and orderly approach of verifying the system as flight ready for STS-1. The approach and implementation plan is discussed, and both technical problems and management issues are dealt with.

Smith, H. E.↗

MSAP Hardware Verification: Testing Multi-Mission System Architecture Platform Hardware Using Simulation and Bench Test Equipment

The Multi-Mission System Architecture Platform (MSAP) project aims to develop a system of hardware and software that will provide the core functionality necessary in many JPL missions and can be tailored to accommodate mission-specific requirements. The MSAP flight hardware is being developed in the Verilog hardware description language, allowing developers to simulate their design before releasing it to a field programmable gate array (FPGA). FPGAs can be updated in a matter of minutes, drastically reducing the time and expense required to produce traditional application-specific integrated circuits. Bench test equipment connected to the FPGAs can then probe and run Tcl scripts on the hardware. The Verilog and Tcl code can be reused or modified with each design. These steps are effective in confirming that the design operates according specifications.

Crossin, Kent R.↗