Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Component based approach to modeling for model checking

This paper presents a portion of an overall research project on the generation of a software security assessment instrument to aid developers in assessing and assuring the security of software in the development and maintenance lifecycles.

security toolset model checking security safety fo↗

Physics Based Model for Online Fault Detection in Autonomous Cryogenic Loading System

We report the progress in the development of the chilldown model for rapid cryogenic loading system developed at KSC. The nontrivial characteristic feature of the analyzed chilldown regime is its active control by dump valves. The two-phase flow model of the chilldown is approximated as one-dimensional homogeneous fluid flow with no slip condition for the interphase velocity. The model is built using commercial SINDAFLUINT software. The results of numerical predictions are in good agreement with the experimental time traces. The obtained results pave the way to the application of the SINDAFLUINT model as a verification tool for the design and algorithm development required for autonomous loading operation.

Cryogenics↗

From Correct Specifications to Automatically Verified Implementations

Creating formally verified implementations of software can be time-consuming and difficult. This presentation details this process, and the attempts at easing the level of difficulty and human interaction. It begins by discussing the verification of an implementation of the Compact Position Reporting algorithm, which was an involved and manual process, and goes on to show the advances made since.

Mariano M. Moscato↗

Sensitivity Analysis of MFiX-PIC Parameters Using Nodeworks, PSUADE, and DAKOTA

The study presented in this report was aimed to demonstrate UQ analysis performed not only with Nodeworks, but also two other well-established UQ software tools from the U.S. DOE’s National Laboratories (PSUADE from Lawrence Livermore National Laboratory and DAKOTA from Sandia National Laboratory). It is important to emphasize that the motivation of this study was not to determine the best UQ software, but to verify if the global sensitivity analyses from the end-to-end workflow in Nodeworks are consistent with the results of other two UQ software. The components of Nodeworks from Python’s ecosystem have been tested as standalone libraries. However, an assessment study for the complete workflow targeting a specific UQ analysis has not been performed for Nodeworks. Hence, this study is expected to serve as an equivalent of solution verification for Nodeworks using other established UQ tools as reference solution. For this purpose, three distinct flow configurations (i.e., settling bed, bubbling fluidized, and circulating fluidized bed) have been used as representative multiphase flow problems of interest. The results of the systematic simulation campaigns performed in an earlier study using the particle-in-cell (PIC) approach in the Multiphase Flow with Interphase eXchanges (MFIX) suite of solvers (i.e., MFiX-PIC) was utilized. The same set of tabulated results was provided as input to the different UQ software for global sensitivity analysis. Results for the three cases indicate that based on the Sobol’ Sensitivity Indices method the order of importance ranking determined by Nodeworks for the Sobol’ Total Sensitivity Indices is consistent with PSUADE and DAKOTA in each case for the five model parameters considered. The input files for Nodeworks for the three cases are also shared through NETL’s Gitlab repository for the reader interested in reproducibility and further analysis (See Section 1.2).

97 MATHEMATICS AND COMPUTING↗

Seamless Integration of Multibody and Orbital Dynamics to Support Human Spaceflight Simulations

At the NASA Johnson Space Center (JSC), modeling capability requirements are often driven by the need to simulate upcoming mission scenarios for analysis, procedures development, and training. In preparation for free-flyer vehicle capture, maneuvers, and release, it was determined that the multibody dynamics capabilities provided by MBDyn and the orbital dynamics capabilities supplied by JEOD needed to be merged to properly simulate the dynamic behaviors expected on-orbit. After initial attempts to combine the two packages proved cumbersome, it was decided that a more refined solution was required to facilitate the interface between these two packages. The resulting interface software package was named MBJEOD. The primary design goals for this new package were to leave MBDyn and JEOD untouched, to simplify and clarify simulation initialization for users, and to support any topology or on-orbit operational scenario that future missions might require. This paper provides a detailed overview of MBJEOD and the approach taken to seamlessly integrate the multibody dynamics of MBDyn with the orbital dynamics of JEOD. Additional attention is given to the numerical considerations required for MBJEOD and the simplifying assumptions leveraged to provide for real-time simulation needs. Verification and validation are addressed and current MBJEOD applications at the NASA JSC are discussed.

modeling↗

Seamless Integration of Multibody and Orbital Dynamics to Support Human Spaceflight Simulations

At the NASA Johnson Space Center (JSC), modeling capability requirements are often driven by the need to simulate upcoming mission scenarios for analysis, procedures development, and training. In preparation for free-flyer vehicle capture, maneuvers, and release, it was determined that the multibody dynamics capabilities provided by MBDyn and the orbital dynamics capabilities supplied by JEOD needed to be merged to properly simulate the dynamic behaviors expected on-orbit. After initial attempts to combine the two packages proved cumbersome, it was decided that a more refined solution was required to facilitate the interface between these two packages. The resulting interface software package was named MBJEOD. The primary design goals for this new package were to leave MBDyn and JEOD untouched, to simplify and clarify simulation initialization for users, and to support any topology or on-orbit operational scenario that future missions might require. This paper provides a detailed overview of MBJEOD and the approach taken to seamlessly integrate the multibody dynamics of MBDyn with the orbital dynamics of JEOD. Additional attention is given to the numerical considerations required for MBJEOD and the simplifying assumptions leveraged to provide for real-time simulation needs. Verification and validation are addressed and current MBJEOD applications at the NASA JSC are discussed.

modeling↗

HDTS 2017.0 Testing and verification document

This report is a continuation of the series of Hunter Dose Tracking System (HDTS) Quality Assurance documents including (Foley and Powell, 2010; Dixon, 2012). In this report we have created a suite of automated test cases and a system to analyze the results of those tests as well as documented the methodology to ensure the field system performs within specifications. The software test cases cover all of the functions and interactions of functions that are practical to test. With the developed framework, if software defects are discovered, it will be easy to create one or more test cases to reproduce the defect and ensure that code changes correct the defect. These tests con rm HDTS version 2017.0 performs according to its specifications and documentation and that its performance meets the needs of its users at the Savannah River Site.

97 MATHEMATICS AND COMPUTING↗

Dakota-NAERM Integration

This report presents the results of a collaborative effort under the Verification, Validation, and Uncertainty Quantification (VVUQ) thrust area of the North American Energy Resilience Model (NAERM) program. The goal of the effort described in this report was to integrate the Dakota software with the NAERM software framework to demonstrate sensitivity analysis of a co-simulation for NAERM.

97 MATHEMATICS AND COMPUTING↗

Workshop on Verification and Validation of Knowledge Based Systems. I - Overview and meeting summary

An overview is presented of a workshop held on May 14-15, 1987. Presentations included overviews of knowledge-based system (KBS) fundamentals, introductions to verification and validation (V&V) methods currently being used, and theoretical V&V work. The findings of three working groups are considered, involving: (1) KBS V&V feasibility within current NASA software constraints, (2) V&V methods suited to KBS constraints, and future KBS V&V research goals.

Richardson, Keith↗

Expert system verification and validation study. Phase 2: Requirements Identification. Delivery 2: Current requirements applicability

The second phase of a task is described which has the ultimate purpose of ensuring that adequate Expert Systems (ESs) Verification and Validation (V and V) tools and techniques are available for Space Station Freedom Program Knowledge Based Systems development. The purpose of this phase is to recommend modifications to current software V and V requirements which will extend the applicability of the requirements to NASA ESs.

Source record↗

NASA/ASEE Summer Faculty Fellowship Program. 1991 Research Reports

Reports from the NASA/ASEE Summer Faculty Fellowship Program are presented. The editors are responsible for selecting appropriately qualified faculty to address some of the many problems of current interest to NASA Kennedy. Some representative titles are as follows: Development of an Accelerated Test Method for the Determination of Susceptibility to Atmospheric Corrosion; Hazardous Gas Leak Analysis in the Space Shuttle; Modeling and Control of the Automated Radiator Inspection Device; Study of the Finite Element Software Packages at KSC; Multispectral Image Processing for Plants; Algorithms for Contours Depicting Static Electric Fields during Adverse Weather Conditions; Transient Study of a Cryogenic Hydrogen Filling System; and Precision Cleaning Verification of Nonvolatile Residues by using Water, Ultrasonics, and Turbidity Analyses.

Hosler, E. Ramon↗

An evaluation of a DO-178A software development process

The guidance and control software (GCS) experiment is an effort to generate realistic software failure data by developing three implementations of a guidance and control software application according to the Radio Technical Commission for Aeronautics RTCA/DO-178A guidelines. The authors describe their approach for evaluating the DO-178A guidelines and give results from the development and verification process for the Pluto implementation. The other names are Mercury and Earth. The preliminary analysis of the Pluto implementation has already yielded some results that will be interesting to track for the other implementations.

Shagnea, Anita M.↗

AmesDT: Digital Twin and Autonomy Validation Environment

A simulation of NASA Ames Research Center was developed to provide a common testbed for multiple areas of research within the Intelligent Systems Division, primarily related to verification and validation of autonomous technologies, machine learning, and digital twin systems. AmesSim corresponds a physical rover that is capable of navigation in the real-world environment; in this way, the same experiments can be run in both settings, with the same software and hardware stacks in the loop. The simulation is built in Unreal Engine 4 and uses the AirSim plugin for API convenience. Several custom modifications allow deterministic, faster-than-realtime execution, which enables consistent testing of on-line algorithms and large-scale data collection. This paper describes the architecture and capabilities of the simulation and discusses development challenge.

simulation↗

Recent Advancements in Tomographic Gamma Scanning for Non- Destructive Assay - 17321

Canberra Industries has recently designed and built a Tomographic Gamma Scanning (TGS) system for the deployment in a nuclear facility. The TGS technique combines high-resolution gamma spectroscopy with low spatial resolution 3- dimensional image reconstruction to provide increased accuracy over traditional approaches for the assay of non-uniform source distributions in low-to medium-density containers. The TGS system has been optimized to measure 120 liter drums and has the capability to measure containers of various sizes. Canberra has incorporated numerous enhancements and improvements to the latest system in both its hardware and software components. The signal processing chain and data analysis software have been configured to use either an electronic pulser or digital signal processing (DSP) electronics for dead time corrections. In the case of using the DSP electronics, the need to calibrate and maintain a pulser can be eliminated without sacrificing any performance. For the 120 liter container, the TGS system has been calibrated and validated with three different spatial resolutions, using two collimator aperture sizes, measuring 2.54 and 1.27 cm in width. The system has also been supplied and calibrated with a wide, rectangular collimator (25.4 cm W x 10.2 cm H) for scanning containers solely in the vertical axis. The TGS system also has an automated attenuator assembly, which has the capability to use a combination of attenuators to reduce the count rate for high activity samples. An extensive measurement campaign was performed in addition to the calibration verification to evaluate the accuracy of the system using rod sources, point sources, and a variety of matrices and source distributions. Improvements to the evaluation of the total measurement uncertainty based upon these studies have been incorporated into the analysis software package. Finally, the performance of this new TGS system will be demonstrated in the context of Canberra's previous TGS systems, including several 208 liter-based systems and a smaller, 20 liter container TGS system. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A deep learning-guided automated workflow in LipidOz for detailed characterization of fungal fatty acid unsaturation by ozonolysis

Understanding fungal lipid biology and metabolism is critical for antifungal target discovery as lipids play central roles in cellular processes. Nuances in lipid structural differences can significantly impact their functions, making it necessary to characterize lipids in detail to enable and understanding of their roles in these complex systems. In particular, lipid double bond (DB) locations are an important component of lipid structure that can only be determined using a few specialized analytical techniques. Ozone-induced dissociation mass spectrometry (OzID-MS) is one such technique that uses ozone to break lipid DBs, producing pairs of characteristic fragments that allow the determination of DB positions. In this work we apply OzID-MS and LipidOz software to analyze the complex lipids of Saccharomyces cerevisiae yeast strains transfected with different fatty acid desaturases from Histoplasma capsulatum to determine the specific unsaturated lipids produce. The automated data analysis in LipidOz made the determination of DB positions from this large dataset more practical, but manual verification for all targets was still time-consuming. The DL model reduces manual involvement in data analysis, but since it was trained using mammalian lipid extracts, the prediction accuracy on yeast-derived data was reduced. We addressed both shortcomings by retraining the DL model to act as a pre-filter to prioritize targets for automated analysis, providing confident manually verified results but requiring less computational time and manual effort. Our workflow resulted in the determination of novel DB positions and enzymatic specificity.

mass spectrometry, deep learning, Lipidomics, doub↗

Probing quantum processor performance with pyGSTi

PyGSTi is a Python software package for assessing and characterizing the performance of quantum computing processors. It can be used as a standalone application, or as a library, to perform a wide variety of quantum characterization, verification, and validation (QCVV) protocols on as-built quantum processors. In this work, we outline pyGSTi's structure, and what it can do, using multiple examples. We cover its main characterization protocols with end-to-end implementations. These include gate set tomography, randomized benchmarking on one or many qubits, and several specialized techniques. We also discuss and demonstrate how power users can customize pyGSTi and leverage its components to create specialized QCVV protocols and solve user-specific problems.

97 MATHEMATICS AND COMPUTING↗

SU-E-T-651: Quantification of Dosimetric Accuracy of Respiratory Gated Stereotactic Body Radiation Therapy

Purpose: To quantify the dosimetric accuracy of respiratory gated stereotactic body radiation therapy delivery using dynamic thorax phantom. Methods: Three patients with mobile target (2 lung, 1liver) were chosen. Retrospective 4DCT image sets were acquired for using Varian RPM system. An in-house MATLAB program was designed for MIP, MinIP and AvgIP generation. ITV was contoured on MIP image set for lung patients and on MinIP for liver patient. Dynamic IMRT plans were generated on selected phase bin image set in Eclipse (v10.0) planning system. CIRS dynamic thorax phantom was used to perform the dosimetric quality assurance. Patient breathing pattern file from RPM system was converted to phantom compatible file by an in-house MATLAB program. This respiratory pattern fed to the CIRS dynamic thorax phantom. 4DCT image set was acquired for this phantom using patient breathing pattern. Verification plans were generated using patient gating window and delivered on the phantom. Measurements were carried out using with ion chamber and EBT2 film. Exposed films were analyzed and evaluated in FilmQA software. Results: The stability of gated output in comparison with un-gated output was within 0.5%. The Ion chamber measured and TPS calculated dose compared for all the patients. The difference observed was 0.45%, −0.52% and −0.54 for Patient 1, Patient2 and Patient 3 respectively.Gamma value evaluated from EBT film shows pass rates from 92.41% to 99.93% for 3% dose difference and 3mm distance to agreement criteria. Conclusion: Dosimetric accuracy of respiratory gated SBRT delivery for lung and liver was dosimetrically acceptable. The Ion chamber measured dose was within 0.203±0.5659% of the expected dose. Gamma pass rates were within 96.63±3.84% of the expected dose.

61 RADIATION PROTECTION AND DOSIMETRY↗