Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verifications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Correction and verification of x-ray imaging crystal spectrometer analysis on Wendelstein 7-X through x-ray ray tracing

X-ray ray tracing is used to develop ion-temperature corrections for the analysis of the X-ray Imaging Crystal Spectrometer (XICS) used at Wendelstein 7-X (W7-X) and perform verification on the analysis methods. The XICS is a powerful diagnostic able to measure ion-temperature, electron-temperature, plasma flow, and impurity charge state densities. While these systems are relatively simple in design, accurate characterization of the instrumental response and validation of analysis techniques are difficult to perform experimentally due to the requirement of extended x-ray sources. For this reason, a ray tracing model has been developed that allows characterization of the spectrometer and verification of the analysis methods while fully considering the real geometry of the XICS system and W7-X plasma. Through the use of ray tracing, several important corrections have been found that must be accounted for in order to accurately reconstruct the ion-temperature profiles. The sources of these corrections are described along with their effect on the analyzed profiles. The implemented corrections stem from three effects: (1) effect of sub-pixel intensity distribution during de-curving and spatial binning, (2) effect of sub-pixel intensity distribution during forward model evaluation and generation of residuals, and (3) effect of defocus and spherical aberrations on the instrumental response. Possible improvements to the forward model and analysis procedures are explored, along with a discussion of trade-offs in terms of computational complexity. Finally, the accuracy of the tomographic inversion technique in stellarator geometry is investigated, providing for the first time a verification exercise for inversion accuracy in stellarator geometry and a complete XICS analysis tool-chain.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Verification methods for drift–diffusion reaction models for plasma simulations

Abstract Compared to other computational physics areas such as codes for general computational fluid dynamics, the documentation of verification methods for plasma fluid codes remains under developed. Current analytical solutions for plasma are often highly limited in terms of testing highly coupled physics, due to the harsh assumptions needed to derive even simple plasma equations. This work highlights these limitations, suggesting the method of manufactured solutions (MMSs) as a potential option for future verification efforts. To demonstrate the flexibility of MMS in verifying these highly coupled systems, the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework was utilized. Thanks to the MOOSE framework’s robustness and modularity, as well as to its physics module capabilities and ecosystem applications (i.e. Zapdos and the chemical reaction network) developed for plasma physics modeling and simulation, this report lays the groundwork for a structured method of conducting plasma fluid code verification.

DeChant, Corey (ORCID:0000000293779732)↗
DOE OSTI2018

Verification of Advective Bar Elements Implemented in the Sierra/Aria Thermal Response Code

A thorough code verification effort has been performed on a reduced order, finite element model for 1D fluid flow convectively coupled with a 3D solid, referred to as the 'advective bar' model. The purpose of this effort was to provide confidence in the proper implementation of this model within the SIERRA/Aria thermal response code at Sandia National Laboratories. The method of manufactured solutions is applied so that the order of convergence in error norms for successively refined meshes and timesteps is investigated. Potential pitfalls that can lead to a premature evaluation of the model's implementation are described for this verification approach when applied to this unique model. As a result, through observation of the expected order of convergence, these verification tests provide evidence of proper implementation of the model within the codebase.

42 ENGINEERING↗
DOE OSTI2020

Local Truncation Error-Informed Code Verification

The method of manufactured solutions (MMS) has become increasingly popular in conducting code verification studies on predictive codes, such as nuclear power system codes and computational fluid dynamic codes. The reason for the popularity of this approach is that it can be used when an analytical solution is not available. Using MMS, code developers are able to verify that their code is free of coding errors that impact the observed order of accuracy. While MMS is still an excellent tool for code verification, it does not identify coding errors that are of the same order as the numerical method. This paper presents a method that combines MMS with modified equation analysis (MEA), which calculates the local truncation error (LTE) to identify coding error up to and including the order of the numerical method. This method is referred to as modified equation analysis methd of manufactured solutions (MEAMMS). MEAMMS is then applied to a custom-built code, which solves the shallow water equations, to test the performance of the code verification method. MEAMMS is able to detect all coding errors that impact the implementation of the numerical scheme. To show how MEAMMS is different than MMS, they are both applied to the same first-order numerical method test problem with a first-order coding error. When there are first-order coding errors, only MEAMMS is able to identify them. Finally, this shows that MEAMMS is able to identify a larger set of coding errors while still being able to identify the coding errors MMS is able to identify.

42 ENGINEERING↗
DOE OSTI2022

Verification of a specialized hydrodynamic simulation code for modeling deflagration and detonation of high explosives

A specialized hydrodynamic simulation code has been developed and verified for the simulation of one-dimensional unsteady problems involving the detonation and deflagration of high explosives. To model all the relevant physical processes in these problems, a code is required to simulate compressible hydrodynamics, unsteady thermal conduction, and chemical reactions with complex rate laws. Several verification exercises are presented which test the implementation of these capabilities. The code also requires models for physics processes such as equations of state and conductivity for pure materials and mixtures as well as rate laws for chemical reactions. Additional verification tests are required to ensure that these models are implemented correctly. Though this code is limited in the types of problems it can simulate, its computationally efficient formulation allows it to be used in calibration studies for reactive burn models for high explosives. Furthermore, this study demonstrates how a series of verification tests can be used to ensure that the various physics processes needed to simulate complex phenomenon can be tested to ensure that they are correctly implemented.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Successive Procedure for Solution Verification Based on User Needs

This paper discusses a revised solution verification procedure for computational fluid dynamics simulations to estimate the uncertainties in the quantities of interest based on discretization error models. This proposed procedure builds upon current procedures described in ASME V&V 20 but provides more guidance in determining the necessary number of mesh levels to build reliable discretization error models. Such guidance is particularly useful for practicing engineers without prior experience in solution verification. The key features of this proposed solution verification procedure are the ability to determine the need for additional mesh levels iteratively and the seamless treatment for underdetermined, exact, and overdetermined solutions of the power series approximation to the discretization error models. This study applies the proposed procedure to a set of synthetic examples to demonstrate the revised procedure’s clarity in determining the number of mesh solutions required for a reliable estimate of the discretization error in computational fluid dynamics settings. Additionally, this proposed procedure prevents a potential pathway in the current procedure in ASME V&V 20 that may lead to unreasonably small discretization errors.

Weinmeister, Justin↗
DOE OSTI2011

Direct dose to water dosimetry for pretreatment IMRT verification using a modified EPID

Purpose: Electronic portal imaging devices (EPIDs) are high resolution systems that produce electronic dose maps with minimal time required for equipment setup, and therefore potentially present a time-saving alternative for intensity modulated radiation therapy (IMRT) pretreatment verification. A modified commercial EPID was investigated operated with an opaque sheet blocking the optical signal produced in the phosphor layer as a precursor to a switched mode dual dosimetry-imaging EPID system. The purpose of this study was to investigate the feasibility of using this system for direct dose to water dosimetry for pretreatment IMRT verification. Methods: A Varian amorphous silicon EPID was modified by placing an opaque sheet between the Gd{sub 2}S{sub 2}O:Tb phosphor layer and the photodiode array to block the optical photons. The EPID was thus converted to a direct-detecting system (dEPID), in which the high energy radiation deposits energy directly in the photodiode array. The copper build-up was replaced with d{sub max} solid water. Sixty-one IMRT beams of varying complexity were delivered to the EPID, to EDR2 dosimetric film and to a 2D ion chamber array (MapCheck). EPID data was compared to film and MapCheck data using gamma analysis with 3%, 3mm pass criteria. Results: The fraction of points that passed the gamma test was on average 98.1% and 98.6%, for the EPID versus film and EPID versus MapCheck comparisons, respectively. In the case of comparison with film, the majority of observed discrepancies were associated with problems related to film sensitivity or processing. Conclusions: The very close agreement between EPID and both film and MapCheck data demonstrates that the modified EPID is suitable for direct dose to water measurement for pretreatment IMRT verification. These results suggest a reconfigured EPID could be an efficient and accurate dosimeter. Alternatively, optical switching methods could be developed to produce a dual-mode EPID with both dosimetry and imaging capabilities.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2012

Development of array-type prompt gamma measurement system for in vivo range verification in proton therapy

Purpose: In vivo range verification is one of the most important parts of proton therapy to fully utilize its benefits delivering high radiation dose to tumor, while sparing the normal tissue with the so-called Bragg peak. Currently, however, range verification method is not used in clinics. The purpose of the present study is to optimize and evaluate the configuration of an array-type prompt gamma measurement system on determining distal dose edge for in vivo range verification of proton therapy. Methods: To effectively measure the prompt gammas against the background gammas, the Monte Carlo simulations with the MCNPX code were employed in optimizing the configuration of the measurement system, and the Monte Carlo method was also used to understand the effect of the background gammas, mainly neutron capture gammas, in the measured gamma distribution. To reduce the effect of the background gammas, the optimized energy window of 4-10 MeV in measuring the prompt gammas was employed. A parameterized source was used to maximize computation speed in the optimization study. A simplified test measurement system, using only one detector moving from one measurement location to the next, was constructed and applied to therapeutic proton beams of 80-220 MeV. For accurate determination of the distal dose edge, the sigmoidal curve-fitting method was applied to the measured distributions of the prompt gammas, and then, the location of the half-value between the maximum and minimum value in the curve-fitting was determined as the distal dose edge and compared with the beam range assessed by the proton dose distribution. Results: The parameterized source term employed in optimization process improved the calculation speed by up to {approx}300 times. The optimization study indicates that an array-type measurement system with 3, 2, 2, and 150 mm for scintillator thickness, slit width, septal thickness, and slit length, respectively, can effectively measure the prompt gamma distributions minimizing the contribution of background gammas. The present results show that a few hundred counts of prompt gammas can be easily obtained by measuring 10 s at each measurement location for proton beams of {approx}4 nA. The distal dose edges determined by the prompt gamma distribution are 5.45, 14.73, and 27.74 cm for proton beams of 5.17 (80 MeV), 14.99 (150 MeV), and 27.38 (220 MeV) cm, respectively. Conclusions: The results show that the array-type measurement system can measure prompt gamma distributions from a therapeutic proton beam within a short measurement time, and that the distal dose edge can be determined within a few millimeters of error without using any sophisticated analysis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2014

WE-D-BRF-02: Acoustic Signal From the Bragg Peak for Range Verification in Proton Therapy

Purpose: Range verification in ion beam therapy relies to date on nuclear imaging techniques which require complex and costly detector systems. A different approach is the detection of thermoacoustic signals that are generated due to localized energy loss of ion beams. Aim of this work is to study the feasibility of determining the ion range with sub-mm accuracy by use of high frequency ultrasonic (US) transducers and to image the Bragg peak by tomography. Methods: A water phantom was irradiated by a pulsed 20 MeV proton beam with varying pulse intensity, length and repetition rate. The acoustic signal of single proton pulses was measured by different PZT-based US detectors (3.5 MHz and 10 MHz central frequencies). For tomography a 64 channel US detector array was used and moved along the ion track by a remotely controlled motor stage. Results: A clear signal of the Bragg peak was visible for an energy deposition as low as 10{sup 12} eV. The signal amplitude showed a linear increase with particle number per pulse and thus, dose. Range measurements were reproducible within +/− 20 micrometer and agreed well with Geant4 simulations. The tomographic reconstruction does not only allow to measure the ion range but also the beam spot size at the Bragg peak position. Conclusion: Range verification by acoustic means is a promising new technique for treatment modalities where the tumor can be localized by US imaging. Further improvement of sensitivity is required to account for higher attenuation of the US signal in tissue, as well as lower energy density in the Bragg peak in realistic treatment cases due to higher particle energy and larger spot sizes. Nevertheless, the acoustic range verification approach could offer the possibility of combining anatomical US imaging with Bragg Peak imaging in the near future. The work was funded by the DFG cluster of excellence Munich Centre for Advanced Photonics (MAP)

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗
DOE OSTI2015

Land Ice Verification and Validation Kit

To address a pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice-sheet models is underway. The associated verification and validation process of these models is being coordinated through a new, robust, python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVV). This release provides robust and automated verification and a performance evaluation on LCF platforms. The performance V&V involves a comprehensive comparison of model performance relative to expected behavior on a given computing platform. LIVV operates on a set of benchmark and test data, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-4-bit evaluation, and plots of tests where differences occur.

Source record↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2012

Verification and validation of the PLTEMP/ANL code for thermal hydraulic analysis of experimental and test reactors

The document compiles in a single volume several verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. Some works that are available in the open literature are simply referenced at the outset, and are not included in the document. PLTEMP has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given. Each chapter of the document deals with the verification or validation of a specific model. The model verification is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The model validation is done by comparing the code with experimental data or a more validated code like the RELAP5 code.

Kalimullah, M.↗
DOE OSTI2012

Independent Verification Survey Report for Zone 1 of the East Tennessee Technology Park in Oak Ridge, Tennessee

Oak Ridge Associated Universities (ORAU) conducted in-process inspections and independent verification (IV) surveys in support of DOE's remedial efforts in Zone 1 of East Tennessee Technology Park (ETTP) in Oak Ridge, Tennessee. Inspections concluded that the remediation contractor's soil removal and survey objectives were satisfied and the dynamic verification strategy (DVS) was implemented as designed. Independent verification (IV) activities included gamma walkover surveys and soil sample collection/analysis over multiple exposure units (EUs).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2012

Independent Verification of the Building 3550 Slab at Oak Ridge National Laboratory Oak Ridge, Tennessee

The Oak Ridge Institute for Science and Education (ORISE) has completed the independent verification survey of the Building 3550 Slab. The results of this effort are provided. The objective of this verification survey is to provide independent review and field assessment of remediation actions conducted by Safety and Ecology Corporation (SEC) to document that the final radiological condition of the slab meets the release guidelines. Verification survey activities on the Building 3550 Slab that included scans, measurements, and the collection of smears. Scans for alpha, alpha plus beta, and gamma activity identified several areas that were investigated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2012

Independent Verification Survey Summary and Results for the Argonne National Laboratory Building 330 Project Footprint, Argonne, Illinois (Final Report)

ORISE conducted onsite verification activities of the Building 330 project footprint during the period of June 6 through June 7, 2011. The verification activities included technical reviews of project documents, visual inspections, radiation surface scans, and sampling and analysis. The draft verification report was issued in July 2011 with findings and recommendations. The contractor performed additional evaluations and remediation.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2012

Verification Survey Report of the South Waste Tank Farm Training/Test Tower and hazardous Waste Storage Lockers at the West Valley Demonstration Project, West Valley, New York (Final Report)

A team from ORAU's Independent Environmental Assessment and Verification Program performed verification survey activities on the South Test Tower and four Hazardous Waste Storage Lockers. Scan data collected by ORAU determined that both the alpha and alpha-plus-beta activity was representative of radiological background conditions. The count rate distribution showed no outliers that would be indicative of alpha or alpha-plus-beta count rates in excess of background. It is the opinion of ORAU that independent verification data collected support the site's conclusions that the South Tower and Lockers sufficiently meet the site criteria for release to recycle and reuse.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2013

Verification test suite for systems analysis tools

This report documents strategies and test problems to support Verification and Validation (V&V) of the systems analysis tools currently being developed under the Reactor Product Line (RPL) of DOE’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. A suite of verification test cases has been developed. This test suite supports development of new codes as well as maintenance of existing codes. For advanced tools that are under development like RELAP-7 for light water reactor analysis [1] and the MOOSE based component models for SFR (M-SFR) analyses [2], verification of simulation results must be performed throughout the entire development phase. This test suite is also useful for established codes as part of automated testing to ensure that general code maintenance does not change existing results.

Sumner, T.↗