SEARCH · Engineering Papers

Results for “software verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

All sources NASA NTRS DOE OSTI

NASA NTRS2008

Tolerance and UQ4SIM: Nimble Uncertainty Documentation and Analysis Software

Ultimately, scientific numerical models need quantified output uncertainties so that modeling can evolve to better match reality. Documenting model input uncertainties and variabilities is a necessary first step toward that goal. Without known input parameter uncertainties, model sensitivities are all one can determine, and without code verification, output uncertainties are simply not reliable. The basic premise of uncertainty markup is to craft a tolerance and tagging mini-language that offers a natural, unobtrusive presentation and does not depend on parsing each type of input file format. Each file is marked up with tolerances and optionally, associated tags that serve to label the parameters and their uncertainties. The evolution of such a language, often called a Domain Specific Language or DSL, is given in [1], but in final form it parallels tolerances specified on an engineering drawing, e.g., 1 +/- 0.5, 5 +/- 10%, 2 +/- 10 where % signifies percent and o signifies order of magnitude. Tags, necessary for error propagation, can be added by placing a quotation-mark-delimited tag after the tolerance, e.g., 0.7 +/- 20% 'T_effective'. In addition, tolerances might have different underlying distributions, e.g., Uniform, Normal, or Triangular, or the tolerances may merely be intervals due to lack of knowledge (uncertainty). Finally, to address pragmatic considerations such as older models that require specific number-field formats, C-style format specifiers can be appended to the tolerance like so, 1.35 +/- 10U_3.2f. As an example of use, consider figure 1, where a chemical reaction input file is has been marked up to include tolerances and tags per table 1. Not only does the technique provide a natural method of specifying tolerances, but it also servers as in situ documentation of model uncertainties. This tolerance language comes with a utility to strip the tolerances (and tags), to provide a path to the nominal model parameter file. And, as shown in [1], having the ability to quickly mark and identify model parameter uncertainties facilitates error propagation, which in turn yield output uncertainties.

Kleb, Bil↗

NASA NTRS1982

Nodal network generator for CAVE3

A new extension of CAVE3 code was developed that automates the creation of a finite difference math model in digital form ready for input to the CAVE3 code. The new software, Nodal Network Generator, is broken into two segments. One segment generates the model geometry using a Tektronix Tablet Digitizer and the other generates the actual finite difference model and allows for graphic verification using Tektronix 4014 Graphic Scope. Use of the Nodal Network Generator is described.

Palmieri, J. V.↗

NASA NTRS2015

Environment Modeling Using Runtime Values for JPF-Android

Software applications are developed to be executed in a specific environment. This environment includes external native libraries to add functionality to the application and drivers to fire the application execution. For testing and verification, the environment of an application is simplified abstracted using models or stubs. Empty stubs, returning default values, are simple to generate automatically, but they do not perform well when the application expects specific return values. Symbolic execution is used to find input parameters for drivers and return values for library stubs, but it struggles to detect the values of complex objects. In this work-in-progress paper, we explore an approach to generate drivers and stubs based on values collected during runtime instead of using default values. Entry-points and methods that need to be modeled are instrumented to log their parameters and return values. The instrumented applications are then executed using a driver and instrumented libraries. The values collected during runtime are used to generate driver and stub values on- the-fly that improve coverage during verification by enabling the execution of code that previously crashed or was missed. We are implementing this approach to improve the environment model of JPF-Android, our model checking and analysis tool for Android applications.

Verification↗

DOE OSTI2013

A Single Tower Configuration of the Modular Gamma Box Counter System - 13392

Canberra's Standard Gamma Box Counter System is designed to perform accurate quantitative assays of gamma emitting nuclides for a wide range of large containers including B-25 crates and ISO shipping containers. Using a modular building-block approach, the system offers tremendous flexibility for a variety of measurement situations with wide ranges of sample activities and throughput requirements, as well as the opportunity to modify the configuration for other applications at a later date. The typical configuration consists of two opposing towers each equipped with two high purity germanium detectors, and an automated container trolley. This paper presents a modified configuration, consisting of a single tower placed inside a measurement trailer with three detector assemblies, allowing for additional vertical segmentation as well as a viewing a container outside the trailer through the trailer wall. An automatic liquid nitrogen fill system is supplied for each of the detectors. The use of a forklift to move the container for horizontal segmentation is accommodated by creating an additional operational and calibration set-up in the NDA 2000 software to allow for the operator to rotate the container and assay the opposite side, achieving the same sensitivity as a comparable two-tower system. This Segmented Gamma Box Counter System retains the core technologies and design features of the standard configuration. The detector assemblies are shielded to minimize interference from environmental and plant background, and are collimated to provide segmentation of the container. The assembly positions can also be modified in height and distance from the container. The ISOCS calibration software provides for a flexible approach to providing the calibrations for a variety of measurement geometries. The NDA 2000 software provides seamless operation with the current configuration, handling the data acquisition and analysis. In this paper, an overview of this system is discussed, along with the measured performance results, calibration methodology and verification, and minimum detectable activity levels. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2017

Analysis of, and defense against, spurious actuations and other incorrect behaviors of digital control systems - 390

Modern digital instrumentation and control (I and C) systems offer nearly unlimited functional capability. However, the complexity of their design (including their system software and application software) is significantly higher than that of conventional, hardwired systems, to the point that it is generally impossible to demonstrate that there are no residual design errors, even when the best development and verification techniques have been applied. When activated by specific conditions, design errors could result in systematic failures, i.e., failures that occur deterministically each time and wherever an activating condition is present. Redundancy could be defeated when the same design error affects multiple channels or systems, and the activating condition affects several of these channels or systems. In the case of safety I and C systems, most of the functions are poised protection functions that must be actuated when and only when a demand situation occurs in the plant. In nuclear power plants, the most dangerous failure mode for such functions generally is failure to actuate, and many measures are taken to protect from such failure mode. This paper considers the other failure modes of safety I and C functions, and also the failure modes of the other I and C functions that are less important to safety. It is not limited to poised functions, and considers other types of functions such as regulation functions or human interface functions. It proposes a framework for analyzing and providing defense against spurious actuations and other incorrect behaviors from digital I and C systems directly interacting with the plant process or with operators: these might be useful for example to justify that design bases for reactor protection are adequate, or to ensure plant performance and availability. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2015

SU-D-213-05: Design, Evaluation and First Applications of a Off-Site State-Of-The-Art 3D Dosimetry System

Purpose: To design, construct and commission a prototype in-house three dimensional (3D) dose verification system for stereotatic body radiotherapy (SBRT) verification at an off-site partner institution. To investigate the potential of this system to achieve sufficient performance (1mm resolution, 3% noise, within 3% of true dose reading) for SBRT verification. Methods: The system was designed utilizing a parallel ray geometry instigated by precision telecentric lenses and an LED 630nm light source. Using a radiochromic dosimeter, a 3D dosimetric comparison with our gold-standard system and treatment planning software (Eclipse) was done for a four-field box treatment, under gamma passing criteria of 3%/3mm/10% dose threshold. Post off-site installation, deviations in the system’s dose readout performance was assessed by rescanning the four-field box irradiated dosimeter and using line-profiles to compare on-site and off-site mean and noise levels in four distinct dose regions. As a final step, an end-to-end test of the system was completed at the off-site location, including CT-simulation, irradiation of the dosimeter and a 3D dosimetric comparison of the planned (Pinnacle{sup 3}) to delivered dose for a spinal SBRT treatment(12 Gy per fraction). Results: The noise level in the high and medium dose regions of the four field box treatment was relatively 5% pre and post installation. This reflects the reduction in positional uncertainty through the new design. This At 1mm dose voxels, the gamma pass rates(3%,3mm) for our in-house gold standard system and the off-site system were comparable at 95.8% and 93.2% respectively. Conclusion: This work will describe the end-to-end process and results of designing, installing, and commissioning a state-of-the-art 3D dosimetry system created for verification of advanced radiation treatments including spinal radiosurgery.

60 APPLIED LIFE SCIENCES↗

NASA NTRSDate not supplied

Assessment of Sensor Data Accuracy within Gazebo/ROS for High-Precision Autonomous In-Space Robotic Operations

Modeling high-precision in-space servicing, assembly, and manufacturing operations in a simulated environment is a critical step in the development of robotic systems that will be used to autonomously assemble large-scale structures in space. Limited facility size and high costs for manufacturing prototypes make it challenging to conduct full-scale operational testing under appropriate environmental conditions; therefore, testing in a modular, high-fidelity simulation environment is necessary for verification and validation of technology and architecture designs prior to launch. Several modeling and simulation environments exist both within NASA and industry that can be used to test robotic system design and operations, including the widely used commercial tool Gazebo integrated with Robotic Operating System software. Because the performance of autonomous robotic systems relies heavily on the quality of sensor input data, this paper focuses on assessing the accuracy of pose data from an optical sensor model in the Gazebo environment against the behavior of real hardware. The results of the tests will help developers using Gazebo for large-scale, high-precision simulation to account for modeling inaccuracies within their robotic control system algorithms.

simulation↗

NASA NTRS2018

CAIDA CUI Confirmation for OMRS & LCC SOCRRATES Emulator and iSEE Upgrade, Operations, & Analysis

This internship has focused on providing solutions for the Customer Avionics Interface Development and Analysis (CAIDA) subsystem. The main emulator that has been used during this internship is the Software-Only CEV (Crew Exploration Vehicle) Risk Reduction Analysis and Test Engineering Simulator (SOCRRATES). This emulator uses advanced math and physics methods to simulate specific points in a mission, such as ascent, entry, and orbit. Exploration Ground Systems (EGS) must ensure that all KSC based ground systems can be properly integrated with the flight vehicle software, therefore, the Modeling and Simulation Branch (NE-XM) of the KSC (Kennedy Space Center) Engineering Directorate supports a virtual environment that simulates the interface between ground systems and the flight vehicle. A primary component in assuring that is knowing whether the emulators have incorporated the correct CUIs (Compact Unique Identifiers) into their system, as well as understanding both the static and dynamic responses of the individual CUIs. Also, an effort for verification of Operational Maintenance Requirements Specifications (OMRS) and Launch Commit Criteria (LCC) that are supported by SOCRRATES for the Orion Crew Module were part of the project tasks this semester. This internship also focused on comparing two different simulation Commercial-off-the-shelf (COTS) products and to determine whether or not a COTS package was a viable replacement for the current software that the iSEE (Immersive Simulations and Engineering Environment) lab uses. Upon research and testing, I found that this software was not feasible for the lab. It could not easily load CAD (Computer-Aided Design) or CREO models, give live feedback while the user is in the environment, and was not compatible with a virtual reality headset, all of which are necessary for the lab.

Bundy, Caleb↗

DOE OSTI2026

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

DOE OSTI2013

General purpose steam table library :

Completion of the CASL L3 milestone THM.CFD.P7.04 provides a general purpose tabular interpolation library for material properties to support, in particular, standardized models for steam properties. The software consists of three parts, implementations of analytic steam models, a code to generate tables from those models, and an interpolation package to interface the tables to CFD codes such as Hydra-TH. Verification of the standard model is maintained through the entire train of routines. The performance of interpolation package exceeds that of freely available analytic implementation of the steam properties by over an order of magnitude.

Carpenter, John H.↗

DOE OSTI2017

Non-RF Chain of Custody Item Monitor (CoCIM) User Manual.

This User Manual contains a description of the wired and infrared (IR) variants of the Chain of Custody Item Monitor (CoCIM), the Coordinator for reading stored messages, and the inspector Message Viewer user interface (UI) software, as well as instructions for use. This manual does not include descriptions or use instructions for the radio frequency (RF) variant of the CoCIM. The intended audience is planners and participants in treaty verification exercises where chain of custody (CoC) elements are required.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Integrated Simulation Capabilities for Analysis of Experiments in the Versatile Test Reactor

The DOE-initiated Versatile Test Reactor (VTR) program aims to establish a domestic fast-neutron irradiation testing capability that meets a variety of domestic and international nuclear energy needs. Currently, integrated tools capable of mechanistic modeling of VTR and a test vehicle do not exist. To address this modeling and analysis deficiency, Argonne's SAS4A/SYSSYS-1 safety analysis code has been coupled with SAM (System Analysis Module) to provide a novel modeling capability that supports VTR and other fast test facilities. This report documents the design, implementation, and testing of this integrated capability. A coupling boundary has been identified at the test vehicle and primary coolant interface, where SAS4A/SASSYS-1 treats primary coolant thermal hydraulics outside the test vehicle, while SAM treats all thermal hydraulic behavior within the test vehicle, including the vehicle walls. Essential to this integrated tool is its newly developed capability to properly model the conjugate heat transfer process which ensures equality of temperatures and heat fluxes at the vehicle wall interface while ensuring energy conservation. A range of testing has been completed to support demonstration of this interface. The testing scope includes steady-state verification using a series of increasingly complex analytical solutions and transient demonstration for a range of design basis accident scenarios using prototypic VTR and test vehicle (i.e. cartridge loop) configurations. Results of this testing confirm verification of the steady-state solutions and provide reasonable and expected transient behavior. The coupling interface has been developed to be robust yet flexible. The implementation within SAS4A/SASSYS-1 supports coupling to any external software or module. The use of decomposed domains and the existing in-core thermal-hydraulic calculational framework within SAS4A/SASSYS-1 enable treatment of arbitrary test vehicle geometries with nonuniform meshing between SAS4A/SASSYS-1 and the coupled code. Modeling of multiple test locations is also supported. Furthermore, computational efficiency is enhanced by utilizing named pipes (or FIFOs), an interface for interprocess communication (IPC).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2021

Involute Working Group – FSI Analysis of Fuel Plates Using Finite Volume and Finite Element Methods

The three involute plate research reactors RHF, HFIR, and FRM II have expressed an interest in using computational software to carry their steady-state safety analysis. Since these tools represent a significant departure from the methods used currently (one-dimensional), the acceptability of the new approach by regulators requires thorough verification and validation of these tools. Therefore, Argonne National Laboratory and the three involute-plate reactors formed an informal group called the Involute Working Group aiming at qualifying computational tools to perform steady-state safety analysis. The present report focuses on a comparison of finite volume and finite element methods to model solids in fluid-structure interaction problems with the goal to estimate the coolant flow-induced fuel plate deflections obtained with the two methods. The finite volume method will be obsoleted in STARCCM+ by the end of 2021, nevertheless, this evaluation is important because the method was used by ANL researchers to model the response of the fuel plates, despite its drawbacks, which are discussed in the report. It was essential to check how those estimates compare to the results obtained with the finite element method that is considered superior for structural analysis. Various geometries, i.e., flat, cylindrical and circle-involute fuel plates, as well as coolant flow speed, were considered. The comparison shows that, independently of the plate geometry, the finite volume method significantly underestimates the deflection as compared to finite element method for coarser meshes. When the discretization is developed as a result of a mesh sensitivity study using finite element method, the result obtained using finite volume method can be a few times smaller than the corresponding finite element method solution. A code-to-code comparison , between STAR-CCM+ and LS-DYNA was included in the analysis. Within the LS-DYNA models, two types of finite element formulations were used: solid and shell finite elements. Mesh sensitivity study showed that both approaches converge to a similar value that was obtained with STAR-CCM+ finite element solver. The evaluation of the computational solvers was extended by adding two benchmark cases from the STAR-CCM+ Verification Suite and presented in the Appendix A. The selected cases are: (1) bending of a cantilever beam under external load, and (2) cylindrical shell deformation analysis, known in the literature as ‘Scordelis-Lo roof’. The problems were solved with finite volume, and finite element methods, and the results confirmed the previously discussed findings. The analysis shows that the finite element solver is superior to the finite volume solver in terms of representation of model geometry and estimating the structural behavior of fuel plates. Depending on the ratio of the load to the flexibility of the plate, the finite volume solver can greatly under- or overestimate the structural response if a very carefully selected mesh is not used.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2014

Cobra-TF Parameter Exposure Work

The purpose of this work is to provide improved VUQ capability for CTF. We will initially focus on uncertainty quantification, but we will keep the larger scope of SQA, verification, validation, calibration, and optimization in mind while we work on uncertainty quantification. This is a living document that will be amended as the work is completed. Note that any reference to the CTF software is based on the code version of 12/17/13.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

HLPW-4/GMGW-3: High Order Discretization Technology Focus Group Workshop Summary

This paper summarizes the High-Order Technical Focus Group (HO-TFG) submissions for the joint 4th AIAA High Lift Prediction and 3rd Geometry and Mesh Generation Workshop. The goal of the workshop was to assess the state-of-the-art in mesh generation and computational fluid dynamics software. The Common Research Model High-Lift (CRM-HL) variant served as the primary focus of the workshop, and a 2D airfoil section from the CRM-HL was used as a verification test case. The HO-TFG was tasked with generating high-order curved meshes for both geometries, and computing high-order solutions using both Reynolds Averaged Navier-Stokes and scale resolving formulations. While limited by computational resources, the final results demonstrate the potential of higher-order methods to increase solution accuracy with a lower degree of freedom count relative to second-order discretizations.

Galbraith, Marshall C.↗

NASA NTRS1981

Spacecraft attitude calibration/verification baseline study

A baseline study for a generalized spacecraft attitude calibration/verification system is presented. It can be used to define software specifications for three major functions required by a mission: the pre-launch parameter observability and data collection strategy study; the in-flight sensor calibration; and the post-calibration attitude accuracy verification. Analytical considerations are given for both single-axis and three-axis spacecrafts. The three-axis attitudes considered include the inertial-pointing attitudes, the reference-pointing attitudes, and attitudes undergoing specific maneuvers. The attitude sensors and hardware considered include the Earth horizon sensors, the plane-field Sun sensors, the coarse and fine two-axis digital Sun sensors, the three-axis magnetometers, the fixed-head star trackers, and the inertial reference gyros.

Chen, L. C.↗

NASA NTRSDate not supplied

Artemis Status Tracker for Real-time Awareness

Providers of Verification evidence for the Space Launch System (SLS) Program include Element Offices (SPIE, Stages, Engines, Booster) as well as Disciplines (Vehicle Management / GN&C, Loads & Environments, Safety and Mission Assurance, Systems Engineering, Integrated Avionics Software). These Elements and Disciplines rely on myriad inputs for their compliance evidence, from NASA and contractors alike, spanning testing and analysis to inspection and validation of records such as drawings and reports.

Braxton Lovett↗

NASA NTRS2014

Recent Developments and Challenges Implementing New and Improved Stress Intensity Factor (K) Solutions in NASGRO for Damage Tolerance Analyses

Fatigue crack growth analysis software has been available to damage tolerance analysts for many years in either commercial products or via proprietary in-house codes. The NASGRO software has been publicly available since the mid-80s (known as NASA/FLAGRO up to 1999) and since 2000 has been sustained and further developed by a collaborative effort between Southwest Research Institute® (SwRI®), the NASA Johnson Space Center (JSC), and the members of the NASGRO Industrial Consortium. Since the stress intensity factor (K) is the foundation of fracture mechanics and damage tolerance analysis of aircraft structures, a significant focus of development efforts in the past fifteen years has been geared towards enhancing legacy K solutions and developing new and efficient numerical K solutions that can handle the complicated stress gradients computed by today’s analysts using detailed finite element models of fatigue critical locations. This paper provides an overview of K solutions that have been recently implemented or improved for the analysis of geometries such as two unequal through cracks at a hole and two unequal corner cracks at a hole, as well as state-of-the-art weight function models capable of computing K in the presence of univariant and/or bivariant stress gradients and complicated residual stress distributions. Some historical background is provided to review how common K solutions have evolved over the years, including selective examples from the literature and from new research. Challenges and progress in rectifying discrepancies between older legacy solutions and newer models are reviewed as well as approaches and challenges for verification and validation of K solutions. Finally, a summary of current challenges and future research and development needs is presented. A key theme throughout the presentation of this paper will be how members of the aerospace industry have collaborated with software developers to develop a practical analysis tool that is used world-wide to support new design as well as the ongoing sustainment and airworthiness of commercial and military aircraft.

Cardinal, Joseph W.↗