Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

MCNP(TM) Release 6.1.1 beta: Creating and Testing the Code Distribution

This report documents the preparations for and testing of the production release of MCNP6™1.1 beta through RSICC at ORNL. It addresses tests on supported operating systems (Linux, MacOSX, Windows) with the supported compilers (Intel, Portland Group and gfortran). Verification and Validation test results are documented elsewhere. This report does not address in detail the overall packaging of the distribution. Specifically, it does not address the nuclear and atomic data collection, the other included software packages (MCNP5, MCNPX and MCNP6) and the collection of reference documents.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Hardware Fuzzing with An Emulator

Bugs in digital logic have led to some significant security vulnerabilities. Hardware bugs are particularly troublesome since they cannot be easily patched. Additionally, if the bug is in the root of trust, all trust built upon it can be vulnerable. Traditional testing either require a deep knowledge of the system, creative attack vectors and lots of human interaction. This is not scalable as there are very few engineers that can wear the hat of a designer, a verification engineer, and a cybersecurity expert. Hardware fuzzing is a relatively new research area in dynamic hardware testing. It has proven to be an effective method for discovering bugs, unexpected behaviors, and security vulnerabilities in software. While hardware fuzzing is new to the hardware domain, it has a strong track record in software testing. Fuzzing is a testing technique that randomly mutates the input data to uncover bugs or vulnerabilities in the design. It is especially good at finding corner cases that test engineers can not envision. Another advantage over other dynamic testing techniques is that, if done well, deep knowledge of the design is not required. Additionally, fuzzing scales well. If the system is set up correctly, it can run unsupervised for weeks if necessary. In this work, we propose using hardware fuzzing to improve the input vector generation for an information flow tracking tool. To get reasonable throughput of test vectors, an emulator is targeted as the execution platform. Efficient emulator execution has some specific requirements.

42 ENGINEERING↗

The Multi-Isotope Process Monitor: Multivariate Analysis of Gamma Spectra

The International Atomic Energy Agency (IAEA) has established international safeguards standards for fissionable material at spent fuel reprocessing plants to ensure that significant quantities of nuclear material are not diverted from these facilities. Currently, methods to verify material control and accountancy (MC&A) at these facilities require time-consuming and resource-intensive destructive assay (DA). The time delay between sampling and subsequent DA provides a potential opportunity to divert the material out of the appropriate chemical stream. Leveraging new on-line nondestructive assay (NDA) techniques in conjunction with the traditional and highly precise DA methods may provide a more timely, cost-effective and resource efficient means for MC&A verification at such facilities. Pacific Northwest National Laboratory (PNNL) is developing on-line NDA process monitoring technologies, including the Multi-Isotope Process (MIP) Monitor. The MIP Monitor uses gamma spectroscopy and pattern recognition software to identify off-normal conditions in process streams. Recent efforts have been made to explore the basic limits of using multivariate analysis techniques on gamma-ray spectra. This paper will provide an overview of the methods and report our on-going efforts to develop and demonstrate the technology.

Orton, Christopher R.↗

Implementation and verification of a user-defined element (UEL) for coupled thermal-hydraulic-mechanical-chemical (THMC) processes in saturated geological media

Efficient and accurate modeling of the coupled thermal-hydraulic-mechanical-chemical (THMC) processes in various rock formations is indispensable for designing energy geo-structures such as underground repositories for high-level nuclear wastes. Here, this work focuses on developing and verifying an implicit finite element solver for generic coupled THMC problems in geological settings. Starting from the mass, momentum, and energy balance laws, a specialized set of governing equations and a thermoporoelastic constitutive model is derived. This system is then solved by an implicit finite element (FE) scheme. Specifically, the residuals and the Jacobians are scripted in a user-defined element (UEL) subroutine which is then combined with the general-purpose FE software Abaqus Standard to solve initial-boundary value problems. Considering the complexity of the system, the UEL development follows a stepwise manner by first solving the coupled hydraulic-mechanical (HM) and thermal-hydraulic-mechanical (THM) equations before moving on to the full THMC problem. Each implementation step consists of at least one verification test by comparing computed results with closed-form analytical solutions to ensure that the various coupling effects are correctly realized. To demonstrate the robustness of the algorithm and to validate the UEL, a three-dimensional case study is performed with reference to the in-situ heating test of ATLAS at Belgium in 1980s. A hypothetical radionuclide leakage event is then simulated by activating the chemical-concentration degree of freedom and prescribing a constant high concentration at the heater's surface. The model predicts a limited contaminated regime after six years considering both diffusion and advection effects on species transport.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Patient-specific QA and delivery verification of scanned ion beam at NIRS-HIMAC

Purpose: To evaluate a patient-specific QA program and system for constancy checking of a scanning delivery system developed at the National Institute of Radiological Sciences.Methods: For the patient-specific QA, all the planned beams are recalculated on a water phantom with treatment planning software (TPS). The recalculated dose distributions are compared with the measured distributions using a 2D ionization chamber array at several depths, and evaluated using gamma index analysis with criteria of 3% and 3 mm and a pass rate of 90%. For the constancy check, the authors developed the multiwire proportional chamber (MWPC), which can record the delivered 2D fluence images in a slice-by-slice manner. During irradiation for dosimetric QA with the 2D ionization chamber array and an accordion-type water phantom, the 2D fluence images are recorded using the MWPC in the delivery system. These recorded images are then compared to those taken in the treatment session to check the constancy check. This analysis also employs gamma index analysis using the same criteria as in the patient-specific QA. These patient-specific QA and constancy check evaluations were performed using the data of 122 patients.Results: In the patient-specific QA, the measured dose distributions agreed well with those calculated by the TPS, and the QA criteria were satisfied in all measurements. The additional check of the fluence comparison ensured the constancy of the delivered field during each treatment irradiation.Conclusions: The authors established a patient-specific QA program and additional check of delivery constancy in every treatment session. Fluence comparison is a strong tool for constancy checking of the delivery system.

61 RADIATION PROTECTION AND DOSIMETRY↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

HLPW-4/GMGW-3: High-Order Discretization Technology Focus Group Workshop Summary

This paper summarizes the High-Order Technical Focus Group (HO-TFG) submissions for the joint 4th AIAA High Lift Prediction (HLPW-4) and 3rd Geometry and Mesh Generation Workshop (GMGW-3). The goal of the workshop was to assess the state-of-the-art in mesh generation and computational fluid dynamics software. The Common Research Model High-Lift (CRM-HL) variant served as the primary focus of the workshop, and a two-dimensional airfoil section from the CRM-HL was used as a verification test case. Here, the HO-TFG was tasked with generating high-order curved meshes for both geometries, and computing high-order solutions using both Reynolds-averaged Navier–Stokes and scale-resolving formulations. While limited by computational resources, the final results demonstrate the potential of higher-order methods to increase solution accuracy with a lower degree-of-freedom count relative to second-order discretizations.

42 ENGINEERING↗

Micro-Analysis of Actinide Minerals for Nuclear Forensics and Treaty Verification

Micro-Raman spectroscopy has been demonstrated to be a viable tool for nondestructive determination of the crystal phase of relevant minerals. Collecting spectra on particles down to 5 microns in size was completed. Some minerals studied were weak scatterers and were better studied with the other techniques. A decent graphical software package should easily be able to compare collected spectra to a spectral library as well as subtract out matrix vibration peaks. Due to the success and unequivocal determination of the most common mineral false positive (zircon), it is clear that Raman has a future for complementary, rapid determination of unknown particulate samples containing actinides.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Patient dose simulations for scanning-beam digital x-ray tomosynthesis of the lungs

Purpose: An improved method of image guidance for lung tumor biopsies could help reduce the high rate of false negatives. The aim of this work is to optimize the geometry of the scanning-beam digital tomography system (SBDX) for providing real-time 3D tomographic reconstructions for target verification. The unique geometry of the system requires trade-offs between patient dose, imaging field of view (FOV), and tomographic angle.Methods: Tomosynthetic angle as a function of tumor-to-detector distance was calculated. Monte Carlo Software (PCXMC) was used to calculate organ doses and effective dose for source-to-detector distances (SDDs) from 90 to 150 cm, patient locations with the tumor at 20 cm from the source to 20 cm from the detector, and FOVs centered on left lung and right lung as well as medial and distal peripheries of the lungs. These calculations were done for two systems, a SBDX system and a GE OEC-9800 C-arm fluoroscopic unit. To evaluate the dose effect of the system geometry, results from PCXMC were calculated using a scan of 300 mAs for both SBDX and fluoroscopy. The Rose Criterion was used to find the fluence required for a tumor SNR of 5, factoring in scatter, air-gap, system geometry, and patient position for all models generated with PCXMC. Using the calculated fluence for constant tumor SNR, the results from PCXMC were used to compare the patient dose for a given SNR between SBDX and fluoroscopy.Results: Tomographic angle changes with SDD only in the region near the detector. Due to their geometry, the source array and detector have a peak tomographic angle for any given SDD at a source to tumor distance that is 69.7% of the SDD assuming constant source and detector size. Changing the patient location in order to increase tomographic angle has a significant effect on organ dose distribution due to geometrical considerations. With SBDX and fluoroscopy geometries, the dose to organs typically changes in an opposing manner with changing patient location. When tumor SNR is held constant (i.e., x-ray fluence is scaled appropriately), SBDX gives 2–10 times less dose than fluoroscopy for the same conditions within the typical range of patient locations. The relative position of the patient (as a percent of SDD) has a much more significant impact on dose than either SDD or patient position. The patient position providing the minimum dose for a given tumor SNR and SDD is approximately the same as the position of maximum tomographic angle.Conclusions: SBDX offers a significant dose advantage over currently used C-arm fluoroscopy. The patient location with lowest dose coincides with the location of maximum tomographic angle. In order to provide adequate space for the patient and for the pulmonologists’ equipment, a SDD of 100 cm is recommended.

61 RADIATION PROTECTION AND DOSIMETRY↗

Application of quantitative methods for reliability testing of a nuclear power plant digital rod position indication diagnostic system - 391

Obsolescence, aging, reliability, and performance issues are driving nuclear facilities to replace conventional analog Instrumentation and Control (I and C) systems with digital technologies. In addition, the designs of the next generation of nuclear reactors, including Small Modular Reactors (SMRs), will incorporate digital I and C for most, if not all, of their safety and non-safety related functions. As part of an on-going research and development (R and D) effort under the auspices of the U.S. Department of Energy (DOE), Analysis and Measurement Services Corporation (AMS) is developing a platform to provide automated testing of digital I and C systems and create a standard method of evaluation for reliability assessments. This hands-on R and D effort has produced a Software Reliability Tester (SRT), which is a set of software and hardware tools designed to automate the testing of digital I and C systems to measure and quantify how well the systems perform under normal operating conditions and in the presence of faults. Furthermore, the SRT provides the foundation for a practical tool to automate verification and validation (V and V) activities and reduce the amount of testing time of digital I and C systems. When combined with its capabilities of integrating both reliability and fault tolerance quantification, the SRT can be used to ensure that digital I and C implementations are both safe and cost-effective for the nuclear industry. This paper describes the application of the SRT to perform V and V of a new Digital Rod Position Indication (DRPI) diagnostic system. The DRPI diagnostic system is a digital system that monitors the rod address and rod position data bus voltages of typical DRPI systems in nuclear power plants to detect and diagnose faults. For this application, the SRT was configured to exercise the inputs of the DRPI diagnostic system, and test cases were generated for common system faults such as address and data bit errors, bus voltage, and timing problems. These test cases were applied by the SRT hardware as voltage inputs to the DRPI diagnostic system and the outputs were compared to expected values generated by a model of the DRPI diagnostic system. Included in the paper is a description of the overall design of the SRT including the hardware and software architectures. Methodologies for automating test cases are also described. V and V using the SRT demonstrates the benefits of automated testing and qualification to provide a quantitative assessment of reliability and cost effective implementation of digital I and C in existing and next generation nuclear power plants. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

WE-DE-201-02: A Statistical Analysis Tool for Plan Quality Verification in HDR Brachytherapy Forward Planning for Cervix Cancer

Purpose: High Dose Rate (HDR) brachytherapy forward planning is principally an iterative process; hence, plan quality is affected by planners’ experiences and limited planning time. Thus, this may lead to sporadic errors and inconsistencies in planning. A statistical tool based on previous approved clinical treatment plans would help to maintain the consistency of planning quality and improve the efficiency of second checking. Methods: An independent dose calculation tool was developed from commercial software. Thirty-three previously approved cervical HDR plans with the same prescription dose (550cGy), applicator type, and treatment protocol were examined, and ICRU defined reference point doses (bladder, vaginal mucosa, rectum, and points A/B) along with dwell times were collected. Dose calculation tool then calculated appropriate range with a 95% confidence interval for each parameter obtained, which would be used as the benchmark for evaluation of those parameters in future HDR treatment plans. Model quality was verified using five randomly selected approved plans from the same dataset. Results: Dose variations appears to be larger at the reference point of bladder and mucosa as compared with rectum. Most reference point doses from verification plans fell between the predicted range, except the doses of two points of rectum and two points of reference position A (owing to rectal anatomical variations & clinical adjustment in prescription points, respectively). Similar results were obtained for tandem and ring dwell times despite relatively larger uncertainties. Conclusion: This statistical tool provides an insight into clinically acceptable range of cervical HDR plans, which could be useful in plan checking and identifying potential planning errors, thus improving the consistency of plan quality.

60 APPLIED LIFE SCIENCES↗

A hardware-in-the-loop approach for laboratory performance verification of flexible building equipment in a typical commercial building

The overall objective of the project is to develop datasets that measure the holistic load flexibility performance of a suite of commonly-used commercial building HVAC and thermal storage equipment using a hardware-in-the-loop test method. The development of the software side of the hardware-in-the-loop flexible load testbed is summarized in this paper.

Chen, Zhelun↗

Cross-Code verification and sensitivity analysis to effectively model the electrothermal instability

This manuscript presents verification cases that are developed to study the electrothermal instability (ETI). Specific verification cases are included to ensure that the unit physics components necessary to model the ETI are accurate, providing a path for fluid-based codes to effectively simulate ETI in the linear and nonlinear growth regimes. Two software frameworks with different algorithmic approaches are compared for accuracy in their ability to simulate diffusion of a magnetic field, linear growth of the ETI, and a fully nonlinear ETI evolution. The nonlinear ETI simulations show early time agreement, with some differences emerging, as noted in the wavenumber spectrum, late into the nonlinear development of ETI. Here, a sensitivity study explores the role of equation-of-state (EOS), vacuum density, and vacuum resistivity. EOS and vacuum resistivity are found to be the most critical factors in the modeling of nonlinear ETI development.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Contact-Less Integrity Verification of Microelectronics Using Near-Field EM Analysis

Modern microelectronics life-cycle and supply chain ecosystem bring multiple untrusted entities, which can compromise their integrity. A major integrity issue of microelectronics stems from piracy of intellectual properties (IP) and counterfeiting, which causes significant revenue loss to the semiconductor manufacturers. Further, these components often lead to compromised functionality, reliability, security, and safety of an electronic system. This paper presents secure information transmission and probing methods for verifying the integrity of digital integrated circuit (ICs) based on their electromagnetic (EM) near-field emissions and thereby protecting systems against counterfeit components. The proposed method has been tested on both high-level instructions executed by microprocessors or Systems-on-Chip (serving as examples of software), and also logic circuits within FPGA fabrics and ASICs (serving as examples of hardware). The authentication information required by each digital system is generated using a pseudo-random number generator circuit and securely transmitted via near-field magnetic emissions. The authorized party can probe these emissions using a near-field probe, process the acquired signals to improve the signal-to-noise ratio (SNR), and then recover the secure information through matched filtering. Experimental results from commercial SoCs are used to demonstrate the proposed technique. Methods for reducing EM interference during integrity verification of both FPGAs and ASICs are also described.

47 OTHER INSTRUMENTATION↗

Gated Treatment Delivery Verification With On-Line Megavoltage Fluoroscopy

Purpose: To develop and clinically demonstrate the use of on-line real-time megavoltage (MV) fluoroscopy for gated treatment delivery verification. Methods and Materials: Megavoltage fluoroscopy (MVF) image sequences were acquired using a flat panel equipped for MV cone-beam CT in synchrony with the respiratory signal obtained from the Anzai gating device. The MVF images can be obtained immediately before or during gated treatment delivery. A prototype software tool (named RTReg4D) was developed to register MVF images with phase-sequenced digitally reconstructed radiograph images generated from the treatment planning system based on four-dimensional CT. The image registration can be used to reposition the patient before or during treatment delivery. To demonstrate the reliability and clinical usefulness, the system was first tested using a thoracic phantom and then prospectively in actual patient treatments under an institutional review board-approved protocol. Results: The quality of the MVF images for lung tumors is adequate for image registration with phase-sequenced digitally reconstructed radiographs. The MVF was found to be useful for monitoring inter- and intrafractional variations of tumor positions. With the planning target volume contour displayed on the MVF images, the system can verify whether the moving target stays within the planning target volume margin during gated delivery. Conclusions: The use of MVF images was found to be clinically effective in detecting discrepancies in tumor location before and during respiration-gated treatment delivery. The tools and process developed can be useful for gated treatment delivery verification.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Linear and nonlinear verification of gyrokinetic microstability codes

Verification of nonlinear microstability codes is a necessary step before comparisons or predictions of turbulent transport in toroidal devices can be justified. By verification we mean demonstrating that a code correctly solves the mathematical model upon which it is based. Some degree of verification can be accomplished indirectly from analytical instability threshold conditions, nonlinear saturation estimates, etc., for relatively simple plasmas. However, verification for experimentally relevant plasma conditions and physics is beyond the realm of analytical treatment and must rely on code-to-code comparisons, i.e., benchmarking. The premise is that the codes are verified for a given problem or set of parameters if they all agree within a specified tolerance. True verification requires comparisons for a number of plasma conditions, e.g., different devices, discharges, times, and radii. Running the codes and keeping track of linear and nonlinear inputs and results for all conditions could be prohibitive unless there was some degree of automation. We have written software to do just this and have formulated a metric for assessing agreement of nonlinear simulations. We present comparisons, both linear and nonlinear, between the gyrokinetic codes GYRO[J. Candy and R. E. Waltz, J. Comput. Phys. 186, 545 (2003)] and GS2[W. Dorland, F. Jenko, M. Kotschenreuther, and B. N. Rogers, Phys. Rev. Lett. 85, 5579 (2000)]. We do so at the mid-radius for the same discharge as in earlier work [C. Holland, A. E. White, G. R. McKee, M. W. Shafer, J. Candy, R. E. Waltz, L. Schmitz, and G. R. Tynan, Phys. Plasmas 16, 052301 (2009)]. The comparisons include electromagnetic fluctuations, passing and trapped electrons, plasma shaping, one kinetic impurity, and finite Debye-length effects. Results neglecting and including electron collisions (Lorentz model) are presented. We find that the linear frequencies with or without collisions agree well between codes, as do the time averages of the nonlinear fluxes without collisions. With collisions, the differences between the time-averaged fluxes are larger than the uncertainties defined as the oscillations of the fluxes, with the GS2 fluxes consistently larger (or more positive) than those from GYRO. However, the electrostatic fluxes are much smaller than those without collisions (the electromagnetic energy flux is negligible in both cases). In fact, except for the electron energy fluxes, the absolute magnitudes of the differences in fluxes with collisions are the same or smaller than those without. None of the fluxes exhibit large absolute differences between codes. Beyond these results, the specific linear and nonlinear benchmarks proposed here, as well as the underlying methodology, provide the basis for a wide variety of future verification efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modernization and optimization of a legacy open-source CFD code for high-performance computing architectures

Legacy codes remain a crucial element of today's simulation-based engineering ecosystem due to the extensive validation process and investment in such software. The rapid evolution of high-performance computing architectures necessitates the modernization of these codes. One approach to modernization is a complete overhaul of the code. However, this could require extensive investments, such as rewriting in modern languages, new data constructs, etc., which will necessitate systematic verification and validation to re-establish the credibility of the computational models. The current study advocates using a more incremental approach and is a culmination of several modernization efforts of the legacy code MFIX, which is an open-source computational fluid dynamics code that has evolved over several decades, widely used in multiphase flows and still being developed by the National Energy Technology Laboratory. Two different modernization approaches,‘bottom-up’ and ‘top-down’, are illustrated. Here, preliminary results show up to 8.5x improvement at the selected kernel level with the first approach, and up to 50% improvement in total simulated time with the latter were achieved for the demonstration cases and target HPC systems employed.

97 MATHEMATICS AND COMPUTING↗

Multi-Reactor Transmutation Analysis Utility (MRTAU,alpha1): Verification

Multi-Reactor Transmutation Utility (MRTAU) is a general depletion/decay algorithm under development at INL to support quick assessment of off-normal fuel cycle scenarios of similar nature to well studied reactor and fuel cycle concepts for which isotopic and cross-section data exists. MRTAU has been used in the past for scoping calculations to determine actinide composition evolution over the course of multiple recycles in Light Water Reactor Mixed Oxide and Sodium cooled Fast Reactor. In these applications, various actinide partitioning scenarios of interest were considered. The code has recently been expanded to include fission product generation, depletion and isotopic evolution over multiple recycles. The capability was added to investigate potential partial separations and/or limited recycling technologies such as Melt-Refining, AIROX, DUPIC or other fuel recycle technology where the recycled fuel stream is not completely decontaminated of fission products prior to being re-irradiated in a subsequent reactor pass. This report documents the code's solution methodology and algorithm as well as its solution accuracy compared to the SCALE6.0 software suite.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗