Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Formal Requirements Elicitation with FRET

FRET is a tool for writing, understanding, formalizing and analyzing requirements. Users write requirements in an intuitive, restricted natural language, called FRETISH, with precise, unambiguous meaning. For a FRETISH requirement, FRET: 1) produces natural language and diagrammatic explanations of its exact meaning, 2) formalizes the requirement in logics, and 3) supports interactive simulation of produced logic formulas to ensure that they capture user intentions. FRET connects to analysis tools by facilitating the mapping between requirements and models/code, and by generating verification code. FRET is available open source at https://github.com/NASA-SW-VnV/fret; a video can be accessed at : https://tinyurl.com/fretForREFSQ.

Giannakopoulou, Dimitra↗

Quantification of Numerical Uncertainty via Nonlinear Dynamical Approach

Motivations (Ensure a Higher Level of Confidence in the Predictability & Reliability of Numerical Simulation for Multiscale Complex Nonlinear Fluid Problems) - The last two decades have been an era when computation is ahead of analysis & when very large scale practical computations are increasingly used in poorly understood multiscale complex nonlinear physical problems & non-traditional fields (Especially when computations offer the ONLY way of generating this type of data limited simulations). - At present some of the numerical uncertainties can be explained and minimized by traditional numerical analysis and standard CFD practices. However, such practices, usually based on linearized analysis, MIGHT NOT be sufficient for strongly nonlinear and/or stiff problems. - We need a good understanding of the nonlinear behavior of numerical schemes being used as an integral part of code verification, validation and certification.

HEC↗

Modeling and Simulation Credibility Assessments of Musculoskeletal Computational Models for Simulating Astronaut Injuries Due to a Poor Spacesuit Fit

The musculoskeletal (MS) system of astronauts is subject to physiological changes, potentially leading to injuries due to the exposure to different gravitational environments experienced during spaceflight. These injuries can occur while an astronaut is performing an Extravehicular Activity (EVA) in space, on lunar or planetary surfaces or while wearing a spacesuit during terrestrial training for an EVA. The OpenSim MS modeling software can assess EVA induced MS injury mechanisms such as muscle strains, ligament injuries and joint injuries. One area of concern, since there are only a few different spacesuit sizes with limited adjustability, is the possibility of a poorly fitting spacesuit. This can cause unnatural joint motions and torques resulting in various MS injuries. A credibility assessment of the OpenSim modeling and simulation procedures is performed per NASA-STD-7009A to provide information on the credibility of the model’s use in simulating EVA related injury mechanisms. The credibility assessment evaluated various OpenSim models against the following eight credibility factors: data pedigree, input pedigree, code verification, solution verification, conceptual validation, referent validation, results uncertainty and results robustness (sensitivity). The models evaluated for EVA injuries will require additional credibility factor analysis and upgrades to the model features, such as adding ligaments to a whole-body model, to reliably predict and analyze the EVA injuries expected to occur due to a poor spacesuit fit. The degree of elevation strategy required to increase the credibility assessment scores will depend on the model complexity and the injury mechanism.

Christopher A. Gallo↗

Modeling and Simulation Credibility Assessments of Musculoskeletal Computational Models for Simulating Astronaut Injuries Due to a Poor Spacesuit Fit

The musculoskeletal (MS) system of astronauts is subject to physiological changes, potentially leading to injuries due to the exposure to different gravitational environments experienced during spaceflight. These injuries can occur while an astronaut is performing an Extravehicular Activity (EVA) in space, on lunar or planetary surfaces or while wearing a spacesuit during terrestrial training for an EVA. The OpenSim MS modeling software can assess EVA induced MS injury mechanisms such as muscle strains, ligament injuries and joint injuries. One area of concern, since there are only a few different spacesuit sizes with limited adjustability, is the possibility of a poorly fitting spacesuit. This can cause unnatural joint motions and torques resulting in various MS injuries. A credibility assessment of the OpenSim modeling and simulation procedures is performed per NASA-STD-7009A to provide information on the credibility of the model’s use in simulating EVA related injury mechanisms. The credibility assessment evaluated various OpenSim models against the following eight credibility factors: data pedigree, input pedigree, code verification, solution verification, conceptual validation, referent validation, results uncertainty and results robustness (sensitivity). The models evaluated for EVA injuries will require additional credibility factor analysis and upgrades to the model features, such as adding ligaments to a whole-body model, to reliably predict and analyze the EVA injuries expected to occur due to a poor spacesuit fit. The degree of elevation strategy required to increase the credibility assessment scores will depend on the model complexity and the injury mechanism.

Christopher A Gallo↗

2.1.1.1.401 - Wave Energy Converter Modeling

The Wave Energy Converter (WEC) Modeling Project began in 2013 with the aim of driving innovation and advancing the state of the wave energy industry by developing publicly available, easy to use software that's customizable to meet end user needs. This project is primarily focused on development of open source software for numerical design and analysis of wave energy converters (WEC), and it also supports international collaboration on standards (IEC TC 114), code verification and validation (IEA OES Task 10) and a competition (WECCCOMP).

MATHEMATICS AND COMPUTING,TIDAL AND WAVE POWER↗

MCNP ® Code Version 6.3.0 Verification & Validation Testing

This report describes the verification and validation testing performed on MCNP ® code version 6.3.0. The purpose of this report is to act as a compendium of test suite descriptions and results. Accordingly the document is divided into two parts. Part I (this part) describes each test suite in the following sections. Part II provides the results of testing each suite and comparisons to experimental and/or alternative computational results, as appropriate.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MCNP® Code Version 6.3.1: Verification & Validation Testing (Rev.1)

This report describes the verification and validation testing performed on MCNP® code version 6.3.1. The purpose of this report is to act as a compendium of test suite descriptions and results. Accordingly the document is divided into two parts. Part I (this part) describes each test suite in the following sections. Part II provides the results of testing each suite and comparisons to experimental and/or alternative computational results, as appropriate.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assume-Guarantee Verification of Source Code with Design-Level Assumptions

Model checking is an automated technique that can be used to determine whether a system satisfies certain required properties. To address the 'state explosion' problem associated with this technique, we propose to integrate assume-guarantee verification at different phases of system development. During design, developers build abstract behavioral models of the system components and use them to establish key properties of the system. To increase the scalability of model checking at this level, we have developed techniques that automatically decompose the verification task by generating component assumptions for the properties to hold. The design-level artifacts are subsequently used to guide the implementation of the system, but also to enable more efficient reasoning at the source code-level. In particular we propose to use design-level assumptions to similarly decompose the verification of the actual system implementation. We demonstrate our approach on a significant NASA application, where design-level models were used to identify; and correct a safety property violation, and design-level assumptions allowed us to check successfully that the property was presented by the implementation.

Giannakopoulou, Dimitra↗

Shutdown dose rate analysis with the Shift Monte Carlo radiation transport code and modular verification workflow

Calculation of the shutdown dose rate is crucial for safe fusion reactor operations. The Rigorous-two-step (R2S) method is a method that requires connected neutron transport, activation, and gamma transport. Shift has integrated variance reduction with a deterministic solver Denovo, supports multiple geometry formats, and is scalable. These features make it an attractive transport solver choice for an R2S workflow. An R2S workflow for the Shift Monte Carlo code is developed and compared to the existing Oak Ridge National Laboratory Shutdown Dose Rate Code Suite (ORCS) workflow. Also, a Python framework for integrating two R2S workflows is developed to mix and match each step in the R2S workflow for improved collaboration and verification experience. In this study, results show that the Shift-Denovo R2S workflow and the ORCS workflow calculate the shutdown dose rate of the ITER Shutdown Dose Rate benchmark problem with an average relative error of 2.285%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Verification of the LOTUS code with C5G7 benchmark

In this study, the verification of the neutron transport code LOTUS through the well-known C5G7 benchmark is performed. LOTUS uses the current coupled collision probability method with the expansion of the flux by orthogonal polynomials (CCCPO) for the solution of the neutron transport equation. The expansion of the flux by orthogonal polynomials allows one to avoid discretization of the calculation regions and significantly decreases the simulation time. The results of the LOTUS calculations are compared with the results of the reference OpenMC Monte Carlo simulations. The results of the comparison demonstrate almost perfect agreement with Monte-Carlo for the second order of the flux expansion. Even though the results obtained in the presented study agree well with the results of reference Monte Carlo calculations, further investigations are necessary for a better understanding of the stability and limitations of the code.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Investigation of mixing in a turbofan exhaust duct. II Computer code application and verification

A three-dimensional analysis of turbofan forced mixer nozzle aerodynamics demonstrates that the complex flow structure is dominated by geometrically induced secondary flow rather than by turbulence. The test apparatus consisted of a fixed upstream model section and a rotating shroud. The Mach number of the fan and core streams at the mixing plane (lobe exit) was 0.45, the bypass ratio was about 4, and the Reynolds number based on the shroud radius was 1,100,000. The three velocity components near the exit plane of the lobes were measured using flow angularity probes to provide information about the mixer inflow conditions for turbulent computations. The validity of a previous computer code was demonstrated in a comparison of the nozzle exit temperature data with the computed temperature distributions. The mechanism most responsible for the generation of secondary flow within the lobes is due to the turning of the fan and core streams in opposite radial directions.

Povinelli, L. A.↗

Verification of RESRAD-OFFSITE Code (V.4)

This report documents the verification of RESRAD-OFFSITE Version 4.0 and describes, where necessary, the verification of the following: • The data comprising the standard dose and risk coefficient libraries in the RESRAD database files Master_dcf_ICRP07.mdb and Master_dcf_2k.mdb. • The extraction and transfer of the data from the selected database file to the computational code by the RESRAD-OFFSITE 4.0 interface, ResOWin.exe. • The different processes that are modeled by the main computational code in RESRAD OFFSITE 4.0, ResOMain.exe. • The data displayed in the graphical and text reports. Many verifications were performed as part of the quality assurance quality control program associated with the development and release of RESRAD-OFFSITE 4.0, namely: • developer testing, • internal independent testing, and • release testing. Some were also performed in response to questions from users regarding the performance of the code. The main text of the report focuses on summarizing a subset of those tests, both independent and developer tests that verified the computations performed by the code. The verifications included in this report served as the basis for the development of the release tests of the computational executables and provided the quantitative results to be compared with the code output. The input and output interfaces and the data transfers between the various executables of the code were tested while performing the verification testing. They were tested intentionally during release testing. This report also provides some basic information to help in understanding the activities that were verified. The report: • outlines the components of RESRAD-OFFSITE 4.0 and the interconnections between these components, • outlines the processes modeled by the computational code, • provides summary figures and tables to offer confirmation of the verification of the computational components of the code, • reproduces the verifiers’ reports, if available, in individual appendices, • refers to the previous verification report (Yu et al. 2011) for more details about some of the verifications, and • reproduces the test cases and the testers’ reports from the release testing in individual appendices, when possible.

54 ENVIRONMENTAL SCIENCES↗

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗

Verification of RESRAD-BUILD Code Version 4

This report documents the verification of the RESRAD-BUILD code, Version 4.0, which was released on December 22, 2022. Two earlier reports verifying Versions 3.0 and 3.1, respectively, were published in 2001 (Kamboj, et al. 2001) and 2003 (Tetra Tech NUS 2003). Version 4.0 of the RESRAD-BUILD code has many new features and modeling enhancements over the earlier versions, including the previously released Version 3.5. Chapter 2 of this report focuses on verifying the external dose and risk modeling for point, line, area, and volume sources, as well as for floor deposition. Besides verification, the external radiation doses calculated by RESRAD-BUILD were also benchmarked with those calculated by the MCNP code (Briemeister 1993). Section J.3 of the RESRAD-BUILD User’s Manual Vol. 1 (Yu et al. 2022) documents the results of that benchmarking effort. Chapter 3 of this report focuses on verifying the ventilation modeling, from checking the remaining source inventory, releases of radionuclides to the air, air concentrations and deposited floor concentrations over time, to the radiation dose and risk associated with inhalation, ingestion, and air submersion, with and without vacuuming. The verification efforts involve designing spreadsheets to perform calculations the same as or like those performed by the RESRAD-BUILD code and then comparing the spreadsheet results with those produced by the code. When the results agree or the differences are within acceptable range, the accuracy of model implementation in the code is verified. In addition to model implementation, the implementation of key functions and features that facilitate the modeling or the use of the code were also verified during the release testing of the code. Appendix A presents the test cases developed for these verification testing, and Appendix B presents the testing results that verify proper implementation of key functions and features.

54 ENVIRONMENTAL SCIENCES↗

Experience with advanced instrumentation in a hot section cascade

The Lewis Research Center gas turbine Hot Section Test Facility was developed to provide a real engine environment with known boundary conditions for the aerothermal performance evaluation and verification of computer design codes. This verification process requires experimental measurements in a hostile environment. The research instruments used in this facility are presented, and their characteristics and how they perform in this environment are discussed. The research instrumentation consisted of conventional pressure and temperature sensors, as well as thin-film thermocouples and heat flux gages. The hot gas temperature was measured by an aspirated temperature probe and by a dual-element, fast-response temperature probe. The data acquisition mode was both steady state and time dependent. These experiments were conducted over a wide range of gas Reynolds numbers, exit gas Mach numbers, and heat flux levels. This facility was capable of testing at temperatures up to 1600 K, and at pressures up to 18 atm. These corresponded to an airfoil exit Reynolds number range of 0.5 x 10(6) to 2.5 x 10(6) based on the airfoil chord of 5.55 cm. The results characterize the performance capability and the durability of the instrumentation. The challenge of making measurements in hostile environments is also discussed. The instruments exhibited more than adequate durability to achieve the measurement profile. About 70 percent of the thin-film thermocouples and the dual-element temperature probe survived several hundred thermal cycles and more than 35 hr at gas temperatures up to 1600 K. Within the experimental uncertainty, the steady-state and transient heat flux measurements were comparable and consistent over the range of Reynolds numbers tested.

Yeh, Frederick C.↗

Generating Customized Verifiers for Automatically Generated Code

Program verification using Hoare-style techniques requires many logical annotations. We have previously developed a generic annotation inference algorithm that weaves in all annotations required to certify safety properties for automatically generated code. It uses patterns to capture generator- and property-specific code idioms and property-specific meta-program fragments to construct the annotations. The algorithm is customized by specifying the code patterns and integrating them with the meta-program fragments for annotation construction. However, this is difficult since it involves tedious and error-prone low-level term manipulations. Here, we describe an annotation schema compiler that largely automates this customization task using generative techniques. It takes a collection of high-level declarative annotation schemas tailored towards a specific code generator and safety property, and generates all customized analysis functions and glue code required for interfacing with the generic algorithm core, thus effectively creating a customized annotation inference algorithm. The compiler raises the level of abstraction and simplifies schema development and maintenance. It also takes care of some more routine aspects of formulating patterns and schemas, in particular handling of irrelevant program fragments and irrelevant variance in the program structure, which reduces the size, complexity, and number of different patterns and annotation schemas that are required. The improvements described here make it easier and faster to customize the system to a new safety property or a new generator, and we demonstrate this by customizing it to certify frame safety of space flight navigation code that was automatically generated from Simulink models by MathWorks' Real-Time Workshop.

Denney, Ewen↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.1 code, which has been developed to perform the steady-state thermal hydraulics (TH) safety calculations required to support conversion of the Massachusetts Institute of Technology Research Reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code, including statistical processing, water property generation, and TH solution, are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the TH solution is verified using simple geometry test problems. The comparison between results obtained by the code and by hand calculations on these problems shows that each of these components works correctly. Additionally, a comprehensive comparison between STAT7 Version 1.1 and PLTEMP/ANL Version 4.3 Revision 162 calculations is performed for the validation. Good agreement is achieved between the results obtained with the two codes for all TH parameters belonging to the fuel core region.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Turbulence Model Implementation and Verification in the SENSEI CFD Code

This paper outlines the implementation and verification of the negative Spalart-Allmaras turbulence model into the SENSEI CFD code. The SA-neg turbulence model is implemented in a flexible, object-oriented framework where additional turbulence models can be easily added. In addition to outlining the new turbulence modeling framework in SENSEI, an overview of the other general improvements to SENSEI is provided. The results for four 2D test cases are compared to results from CFL3D and FUN3D to verify that the turbulence models are implemented properly. Several differences in the results from SENSEI, CFL3D, and FUN3D are identified and are attributed to differences in the implementation and discretization order of the boundary conditions as well as the order of discretization of the turbulence model. When a solid surface is located near or intersects an inflow or outflow boundary, higher order boundary conditions should be used to limit their effect on the forces on the surface. When the turbulence equations are discretized using second order spatial accuracy, the edge of the eddy viscosity profile seems to be sharper than when a first order discretization is used. However, the discretization order of the turbulence equation does not have a significant impact on output quantities of interest, such as pressure and viscous drag, for the cases studied.

Jackson, Charles W.↗