Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Developing and Implementing the Data Mining Algorithms in RAVEN

The RAVEN code is becoming a comprehensive tool to perform probabilistic risk assessment, uncertainty quantification, and verification and validation. The RAVEN code is being developed to support many programs and to provide a set of methodologies and algorithms for advanced analysis. Scientific computer codes can generate enormous amounts of data. To post-process and analyze such data might, in some cases, take longer than the initial software runtime. Data mining algorithms/methods help in recognizing and understanding patterns in the data, and thus discover knowledge in databases. The methodologies used in the dynamic probabilistic risk assessment or in uncertainty and error quantification analysis couple system/physics codes with simulation controller codes, such as RAVEN. RAVEN introduces both deterministic and stochastic elements into the simulation while the system/physics code model the dynamics deterministically. A typical analysis is performed by sampling values of a set of parameter values. A major challenge in using dynamic probabilistic risk assessment or uncertainty and error quantification analysis for a complex system is to analyze the large number of scenarios generated. Data mining techniques are typically used to better organize and understand data, i.e. recognizing patterns in the data. This report focuses on development and implementation of Application Programming Interfaces (APIs) for different data mining algorithms, and the application of these algorithms to different databases.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2006

A Predictive Approach to Eliminating Errors in Software Code

NASA s Metrics Data Program Data Repository is a database that stores problem, product, and metrics data. The primary goal of this data repository is to provide project data to the software community. In doing so, the Metrics Data Program collects artifacts from a large NASA dataset, generates metrics on the artifacts, and then generates reports that are made available to the public at no cost. The data that are made available to general users have been sanitized and authorized for publication through the Metrics Data Program Web site by officials representing the projects from which the data originated. The data repository is operated by NASA s Independent Verification and Validation (IV&V) Facility, which is located in Fairmont, West Virginia, a high-tech hub for emerging innovation in the Mountain State. The IV&V Facility was founded in 1993, under the NASA Office of Safety and Mission Assurance, as a direct result of recommendations made by the National Research Council and the Report of the Presidential Commission on the Space Shuttle Challenger Accident. Today, under the direction of Goddard Space Flight Center, the IV&V Facility continues its mission to provide the highest achievable levels of safety and cost-effectiveness for mission-critical software. By extending its data to public users, the facility has helped improve the safety, reliability, and quality of complex software systems throughout private industry and other government agencies. Integrated Software Metrics, Inc., is one of the organizations that has benefited from studying the metrics data. As a result, the company has evolved into a leading developer of innovative software-error prediction tools that help organizations deliver better software, on time and on budget.

Source record↗
DOE OSTI2015

Making Quality HPGe Gamma Ray Spectrum Measurements for Uranium: The Role of FRAM for Analysis, Quality Control and Enrichment Measurements, and Opportunities for Improved Quantification Documentation

Enrichment measurements are used in uranium safeguards verification and accountancy as both an attribute signature and in the interpretation of other nondestructive assay information, such as active interrogation for mass. Accurate and reliable assessments require quality information. The practices used to collect the raw data are therefore the crucial first step in managing the overall quality and uncertainty of the enrichment determination. This report discusses several topics associated with gamma-ray spectrum measurements of uranium using HPGe detectors. First a discussion of good data acquisition practices including physical setup, detector types and configurations, detector shielding and filtering, spectrum stabilization, and data acquisition protocols. Next is a discussion of analysis options to obtain isotopic composition and/or enrichment centered on the FRAM gamma ray isotopic analysis software. The report discusses the results of the development of a FRAM parameter file to perform classical Enrichment Meter Principle (EMP) analysis. Possible analysis and data acquisition issues (random summing, x-ray fluorescence peaks, peak interferences, shielding) that can affect FRAM analyses are also discussed. There is also a brief discussion of FRAM measurements in the field. Under the topic of uncertainty propagation and quantification in FRAM, uncertainty propagation verification methods and gaps in available uncertainty quantification data for uranium is covered. Suggestions are made for areas where ORNL can contribute to closing the identified uncertainty quantification gaps, and also to contributing nuclear data quality spectra to the research community.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2015

SU-E-T-83: A Study On Evaluating the Directional Dependency of 2D Seven 29 Ion Chamber Array Clinically with Different IMRT Plans

Purpose: To evaluate the directional dependency of 2D seven 29 ion chamber array clinically with different IMRT plans. Methods: 25 patients already treated with IMRT plans were selected for the study. Verification plans were created for each treatment plan in eclipse 10 treatment planning system using the AAA algorithm with the 2D array and the Octavius CT phantom. Verification plans were done 2 times for a single patient. First plan with real IMRT (plan-related approach) and second plan with zero degree gantry angle (field-related approach). Measurements were performed on a Varian Clinac-iX, linear accelerator equipped with a millennium 120 multileaf collimator. Fluence was measured for all the delivered plans and analyzed using the verisoft software. Comparison was done by selecting the fluence delivered in static gantry (zero degree gantry) versus IMRT with real gantry angles. Results: The gamma pass percentage is greater than 97 % for all IMRT delivered with zero gantry angle and between 95%–98% for real gantry angles. Dose difference between the TPS calculated and measured for IMRT delivered with zero gantry angle was found to be between (0.03 to 0.06Gy) and with real gantry angles between (0.02 to 0.05Gy). There is a significant difference between the gamma analysis between the zero degree and true angle with a significance of 0.002. Standard deviation of gamma pass percentage between the IMRT plans with zero gantry angle was 0.68 and for IMRT with true gantry angle was found to be 0.74. Conclusion: The gamma analysis for IMRT with zero degree gantry angles shows higher pass percentage than IMRT delivered with true gantry angles. Verification plans delivered with true gantry angles lower the verification accuracy when 2D array is used for measurement.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1974

In flight ground control of high drag satellites utilizing on-board accelerometer data and rapid orbit prediction techniques

High drag satellites frequently require precise verification of orbital maneuvers and the accurate prediction of perigee height. An in-flight ground support system designed to monitor and compute orbital state and maneuvers is described. The use of on-board three-axis accelerometer data in a flight support software system to perform on-line maneuver analysis and atmospheric model updating is discussed. In addition, automated analytic techniques to rapidly and accurately predict perigee height following a maneuver are described, as well as semianalytic averaging techniques designed to predict a decaying orbital state for mission control.

Fuchs, A. J.↗
NASA NTRS1986

Space radiation studies

Instrument design and data analysis expertise was provided in support of several space radiation monitoring programs. The Verification of Flight Instrumentation (VFI) program at NASA included both the Active Radiation Detector (ARD) and the Nuclear Radiation Monitor (NRM). Design, partial fabrication, calibration and partial data analysis capability to the ARD program was provided, as well as detector head design and fabrication, software development and partial data analysis capability to the NRM program. The ARD flew on Spacelab-1 in 1983, performed flawlessly and was returned to MSFC after flight with unchanged calibration factors. The NRM, flown on Spacelab-2 in 1985, also performed without fault, not only recording the ambient gamma ray background on the Spacelab, but also recording radiation events of astrophysical significance.

Gregory, J. C.↗
NASA NTRS2002

Synthesizing Certified Code

Code certification is a lightweight approach to demonstrate software quality on a formal level. Its basic idea is to require producers to provide formal proofs that their code satisfies certain quality properties. These proofs serve as certificates which can be checked independently. Since code certification uses the same underlying technology as program verification, it also requires many detailed annotations (e.g., loop invariants) to make the proofs possible. However, manually adding theses annotations to the code is time-consuming and error-prone. We address this problem by combining code certification with automatic program synthesis. We propose an approach to generate simultaneously, from a high-level specification, code and all annotations required to certify generated code. Here, we describe a certification extension of AUTOBAYES, a synthesis tool which automatically generates complex data analysis programs from compact specifications. AUTOBAYES contains sufficient high-level domain knowledge to generate detailed annotations. This allows us to use a general-purpose verification condition generator to produce a set of proof obligations in first-order logic. The obligations are then discharged using the automated theorem E-SETHEO. We demonstrate our approach by certifying operator safety for a generated iterative data classification program without manual annotation of the code.

Whalen, Michael↗
DOE OSTI2016

Hybrid Enrichment Verification Array: Module Characterization Studies

The work presented in this report is focused on the characterization and refinement of the Hybrid Enrichment Verification Array (HEVA) approach, which combines the traditional 186-keV 235 U signature with high-energy prompt gamma rays from neutron capture in the detector and surrounding collimator material, to determine the relative enrichment and 235 U mass of the cylinder. The design of the HEVA modules (hardware and software) deployed in the current field trial builds on over seven years of study and evolution by PNNL, and consists of a ø3''×3'' NaI(Tl) scintillator coupled to an Osprey digital multi-channel analyzer tube base from Canberra. The core of the HEVA methodology, the high-energy prompt gamma-ray signature, serves as an indirect method for the measurement of total neutron emission from the cylinder. A method for measuring the intrinsic efficiency of this “non-traditional” neutron signature and the results from a benchmark experiment are presented. Also discussed are potential perturbing effects on the non-traditional signature, including short-lived activation of materials in the HEVA module. Modeling and empirical results are presented to demonstrate that such effects are expected to be negligible for the envisioned implementation scenario. In comparison to previous versions, the new design boosts the high-energy prompt gamma-ray signature, provides more flexible and effective collimation, and improves count-rate management via commercially available pulse-processing electronics with a special modification prompted by PNNL.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2011

Runtime Verification with State Estimation

We introduce the concept of Runtime Verification with State Estimation and show how this concept can be applied to estimate theprobability that a temporal property is satisfied by a run of a program when monitoring overhead is reduced by sampling. In such situations, there may be gaps in the observed program executions, thus making accurate estimation challenging. To deal with the effects of sampling on runtime verification, we view event sequences as observation sequences of a Hidden Markov Model (HMM), use an HMM model of the monitored program to "fill in" sampling-induced gaps in observation sequences, and extend the classic forward algorithm for HMM state estimation (which determines the probability of a state sequence, given an observation sequence) to compute the probability that the property is satisfied by an execution of the program. To validate our approach, we present a case study based on the mission software for a Mars rover. The results of our case study demonstrate high prediction accuracy for the probabilities computed by our algorithm. They also show that our technique is much more accurate than simply evaluating the temporal property on the given observation sequences, ignoring the gaps.

sampling↗
DOE OSTI2015

Measurement of Plutonium Isotopic Composition - MGA

In this module, we will use the Canberra InSpector-2000 Multichannel Analyzer with a high-purity germanium detector (HPGe) and the MGA isotopic anlysis software to assay a variety of plutonium samples. The module provides an understanding of the MGA method, its attributes and limitations. You will assess the system performance by measuring a range of materials similar to those you may assay in your work. During the final verification exercise, the results from MGA will be combined with the 240Pueff results from neutron coincidence or multiplicity counters so that measurements of the plutonium mass can be compared with the operator-declared (certified) values.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRS1987

Space Station ground data management system

KSC is planning a Space Station Ground Data Management System (GDMS) for support of functional interface verification, integration and test of Space Station modules and elements. This computer system, planned for initial operational support in 1992, currently is entering a definition and prototyping stage. This paper provides an overview of the GDMS system concept. It synopsizes system functional capabilities, and discusses software and hardware architectural approaches currently under evaluation. It identifies programmatic constraints and their influence upon the concept, as well as specific technical issues planned for study or evaluation via prototyping.

Heuser, Jan↗
NASA NTRS1992

Transient loads analysis for space flight applications

A significant part of the flight readiness verification process involves transient analysis of the coupled Shuttle-payload system to determine the low frequency transient loads. This paper describes a methodology for transient loads analysis and its implementation for the Spacelab Life Sciences Mission. The analysis is carried out using two major software tools - NASTRAN and an external FORTRAN code called EZTRAN. This approach is adopted to overcome some of the limitations of NASTRAN's standard transient analysis capabilities. The method uses Data Recovery Matrices (DRM) to improve computational efficiency. The mode acceleration method is fully implemented in the DRM formulation to recover accurate displacements, stresses, and forces. The advantages of the method are demonstrated through a numerical example.

Thampi, S. K.↗
NASA NTRS2010

Design and Development of a Model to Simulate 0-G Treadmill Running Using the European Space Agency's Subject Loading System

Develop a model that simulates a human running in 0 G using the European Space Agency s (ESA) Subject Loading System (SLS). The model provides ground reaction forces (GRF) based on speed and pull-down forces (PDF). DESIGN The theoretical basis for the Running Model was based on a simple spring-mass model. The dynamic properties of the spring-mass model express theoretical vertical GRF (GRFv) and shear GRF in the posterior-anterior direction (GRFsh) during running gait. ADAMs VIEW software was used to build the model, which has a pelvis, thigh segment, shank segment, and a spring foot (see Figure 1).the model s movement simulates the joint kinematics of a human running at Earth gravity with the aim of generating GRF data. DEVELOPMENT & VERIFICATION ESA provided parabolic flight data of subjects running while using the SLS, for further characterization of the model s GRF. Peak GRF data were fit to a linear regression line dependent on PDF and speed. Interpolation and extrapolation of the regression equation provided a theoretical data matrix, which is used to drive the model s motion equations. Verification of the model was conducted by running the model at 4 different speeds, with each speed accounting for 3 different PDF. The model s GRF data fell within a 1-standard-deviation boundary derived from the empirical ESA data. CONCLUSION The Running Model aids in conducting various simulations (potential scenarios include a fatigued runner or a powerful runner generating high loads at a fast cadence) to determine limitations for the T2 vibration isolation system (VIS) aboard the International Space Station. This model can predict how running with the ESA SLS affects the T2 VIS and may be used for other exercise analyses in the future.

Caldwell, E. C.↗
NASA NTRS2011

Ares I-X Range Safety Simulation and Analysis IV and V

NASA s Ares I-X vehicle launched on a suborbital test flight from the Eastern Range in Florida on October 28, 2009. NASA generated a Range Safety (RS) product data package to meet the RS trajectory data requirements defined in the Air Force Space Command Manual (AFSPCMAN) 91-710. Some products included were a nominal ascent trajectory, ascent flight envelopes, and malfunction turn data. These products are used by the Air Force s 45th Space Wing (45SW) to ensure public safety and to make flight termination decisions on launch day. Due to the criticality of the RS data, an independent validation and verification (IV&V) effort was undertaken to accompany the data generation analyses to ensure utmost data quality and correct adherence to requirements. As a result of the IV&V efforts, the RS product package was delivered with confidence that two independent organizations using separate simulation software generated data to meet the range requirements and yielded similar results. This document captures the Ares I-X RS product IV&V analysis, including the methodology used to verify inputs, simulation, and output data for certain RS products. Additionally a discussion of lessons learned is presented to capture advantages and disadvantages to the IV&V processes used.

Merry, Carl M.↗
NASA NTRS2017

Benchmarking the Collocation Stand-Alone Library and Toolkit (CSALT)

This paper describes the processes and results of Verification and Validation (VV) efforts for the Collocation Stand Alone Library and Toolkit (CSALT). We describe the test program and environments, the tools used for independent test data, and comparison results. The VV effort employs classical problems with known analytic solutions, solutions from other available software tools, and comparisons to benchmarking data available in the public literature. Presenting all test results are beyond the scope of a single paper. Here we present high-level test results for a broad range of problems, and detailed comparisons for selected problems.

trajectory optimization↗
DOE OSTI2016

SU-F-T-399: Migration of Treatment Planning Systems Without Beam Data Measurement

Purpose: Data acquisition for commissioning is steered by Treatment Planning System (TPS) requirements which can be cumbersome and time consuming involving significant clinic downtime. The purpose of this abstract is to answer if we could circumvent this by extracting data from existing TPS and speed up the process. Methods: Commissioning beam data was obtained from a clinically commissioned TPS (Pinnacle™) using Matlab™ generated Pinnacle™ executable scripts to commission a secondary 3D dose verification TPS (Eclipse™). Profiles and output factors for commissioning as required by Eclipse™ were computed on a 50 cm{sup 3} water phantom at a dose grid resolution of 2mm3. Verification doses were computed and compared to clinical TPS dose profiles as per TG-106 guidelines. Standard patient plans from Pinnacle™ including IMRT and VMAT plans were re-computed keeping the same monitor units (in order to perform true comparison) using Eclipse™. Computed dose was exported back to Pinnacle for comparison to original plans. This methodology enables us to alleviate all ambiguities that arise in such studies. Results: Profile analysis using in-house software for 6x, showed that for all field sizes including small MLC generated fields, 100% of infield and penumbra data points of Eclipse™ match Pinnacle™ generated and measured profiles with 2%/2 mm gamma criteria. Excellent agreement was observed in the penumbra regions, with all data points passing DTA criteria for complex C-shaped and S-shaped profiles. Patient plan dose volume histograms (DVHs) and isodose lines agreed well to within a 1.5% for target coverage. Conclusion: Secondary 3D dose checking is of utmost importance with advanced techniques such as IMRT and VMAT. Migration of TPS is possible without compromising accuracy or enduring the cumbersome measurement of commissioning data. Economizing time for commissioning such a verification system or for migration of TPS can add great QA value and minimize downtime.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2009

Model Checking - My 27-Year Quest to Overcome the State Explosion Problem

Model Checking is an automatic verification technique for state-transition systems that are finite=state or that have finite-state abstractions. In the early 1980 s in a series of joint papers with my graduate students E.A. Emerson and A.P. Sistla, we proposed that Model Checking could be used for verifying concurrent systems and gave algorithms for this purpose. At roughly the same time, Joseph Sifakis and his student J.P. Queille at the University of Grenoble independently developed a similar technique. Model Checking has been used successfully to reason about computer hardware and communication protocols and is beginning to be used for verifying computer software. Specifications are written in temporal logic, which is particularly valuable for expressing concurrency properties. An intelligent, exhaustive search is used to determine if the specification is true or not. If the specification is not true, the Model Checker will produce a counterexample execution trace that shows why the specification does not hold. This feature is extremely useful for finding obscure errors in complex systems. The main disadvantage of Model Checking is the state-explosion problem, which can occur if the system under verification has many processes or complex data structures. Although the state-explosion problem is inevitable in worst case, over the past 27 years considerable progress has been made on the problem for certain classes of state-transition systems that occur often in practice. In this talk, I will describe what Model Checking is, how it works, and the main techniques that have been developed for combating the state explosion problem.

Clarke, Ed↗
DOE OSTI2020

Involute Working Group – Validation of CFD Turbulence Models for Steady-State Safety Analysis

There are three research reactors in the world having fuel plates curved as circle-involute (a spiral generated around a circle): The Oak Ridge National Laboratory (ORNL) High Flux Isotope Reactor (HFIR) located in Tennessee, U.S.A. [ORNL, 2018]; The Laue-Langevin Institute (ILL) High Flux Reactor (RHF) located in Grenoble, France [ILL, 2018]; and, The Technical University of Munich (TUM) Research Neutron Source Heinz Maier-Leibnitz (FRM II) located in Garching, Germany [TUM, 2018]. All three reactors are currently using Highly Enriched Uranium (HEU, 235U/U ≥ 20 wt. %) as fuel and all three are actively engaged in activities to convert to Low Enriched Uranium (LEU, 235U/U < 20 wt. %) fuel. More information on these reactors can be found in Section two. For various reasons, these reactors have expressed interest in using Computational Fluid Dynamics (CFD) tools to perform their Steady-State Thermal-Hydraulic (SSTH) safety calculations. Using CFD tools for SSTH analysis represents generally a significant departure from traditional methods and requires thorough verification and validation (V&V) to be accepted by regulators. This is why Argonne National Laboratory (ANL) and the involute reactors formed an informal group to help each other in this endeavor. This so-called Involute Working Group (IWG) aims at supporting the qualification of CFD tools for SSTH safety calculations. Activities include benchmarking, code-to-code comparison, Verification and Validation (V&V) as well as technical support. More information on the IWG and the reasons why involute-plate reactors are interested in CFD can be found in Section three. The present study aims at testing three turbulence models commonly implemented in commercial software (namely K-Epsilon, K-Omega and Reynolds-Stress) and assessing their relevance for involute-plate reactor application. An experiment performed by Gambill and Bundy in 1961 was performed to measure heat transfer coefficients in conditions prototypic of the HFIR reactor [Gambill, 1961]. More details on this experiment are provided in Section four. Based on the information available, CFD models of this experiment have been created and the experimental results have been compared to the ones obtained with these CFD models. CFD models and the results of this comparison are provided in Section five.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗