Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Evaluation of 3D Simulation Capabilities within xRAGE using a Suite of Test Problems

This presentation describes a 3D verification and validation suite for xRAGE. Three verification test problems for hydrodynamics are presented: the Kidder ball problem, the Verney shell problem, and a 5-material compression problem. There is excellent agreement between 2D and 3D XRAGE simulation results for these problems, and between the xRAGE results and the benchmark solutions. In addition, two 3D ICF test problems are presented, based on an OMEGA direct drive capsule experiment, and on a NIF indirect drive capsule experiment. These two ICF test problems are used to evaluate two hydrodynamic methods within xRAGE. In addition to hydrodynamics the simulations also include three temperature plasma physics, thermal conduction and radiation diffusion. When simulating either capsule in 3D the newer unsplit hydrodynamic method in xRAGE produces more vorticity relative to the older default method. For the indirect drive capsule the 3D simulations are in reasonable agreement with the experimental values of ion temperature and neutron production. Unstable 3D vortex rings are present near the DT ice/carbon interface which enhance the confinement of the DT ice.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Adopting Code Verification Methodology Based on Model Form

Code verification is an essential part of credibility analysis for computational models. It assesses whether the mathematical model is implemented correctly into the code and whether the numerical methods behave consistently, and is done before solution verification and validation. Robust guidance for code verification exists in the literature. However, there is no known, concise guide for selecting the approach based on the model form that also presents an overview of the common elements. This document was written to address this gap as an accessible reference for beginning a code-verification effort.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Adapting Code Verification Methodology to Model Form

Code verification is an essential part of credibility analysis for computational models. It assesses whether the mathematical model is implemented correctly into the code and whether the numerical methods behave consistently, and is done before solution verification and validation. Robust guidance for code verification exists in the literature. However, there is no known, concise guide for selecting the approach based on the model form that also presents an overview of the common elements. This document was written to address this gap as an accessible reference for beginning a code-verification effort.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Sierra/SD – Verification Test Manual – 5.22

Verification and validation (V&V) of scientific computing programs are important at Sandia National Labs due to the expanding role of computational simulation in managing the United States nuclear stockpile. The complexities of structural response calculations used to analyze physical problems, the varieties of codes applied to the calculations, and the importance of accurate predictions when assessing field conditions demand confidence in the consistency and accuracy of computer codes. Confidence in the accuracy of the predictions arising from computer simulations must ultimately be gained through verification and validation. The Sierra salinas structural dynamics analysis code, Sierra/SD, is used at the DOE Laboratories, and in several DOD projects. The roles of Sierra/SD in the qualification of weapon systems and components for normal and hostile environments throughout the Stockpile-to-Target Sequence include to, • Redesign weapon components. • Certify weapon components and systems for target environments such as hypersonic vehicles. • Certify that components will survive the thermal mechanical shock loads associated with hostile environments. • Evaluate current stockpile issues, including issues associated with uncertainty quantification. • Address many other problems that are encountered in stockpile management. The Sierra/SD verification plan is described, and an evolving set of key verification tests are described in detail. The verification tests ensure the correctness of the mathematics and numerical algorithms associated with functionality describing engineering phenomena. Development is in accordance with a set of tailored Software Quality Engineering (SQE) practices. SQE practices guide the overall verification and validation effort.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Use of Grid-Forming Medium-Voltage Power Electronics Hub in a Microgrid Setting

This paper presents the application of a new design of a multiport, modular, medium-voltage power electronics hub (M3PE-HUB) in a microgrid setting. The M3PE-HUB system was modeled in a digital real-time simulator (DRTS) and integrated into the Banshee microgrid test system. This paper presents the preliminary DRTS simulation-based results of the M3PE-HUB system connected in a test microgrid system. Verification and validation of the M3PE-HUB architecture and controls in the test microgrid setting are the primary contributions of this work. The results of the operation during the islanding and resynchronization process indicate the feasibility of the proposed architecture in a microgrid setting. This paper also presents results for a system reconfiguration use case where the M3PE-HUB was used to reconfigure the system under a fault condition.

grid forming↗
DOE OSTI2024

Thermochemical Nonequilibrium Modeling in a Continuous-Galerkin, Finite-Element Framework

The presented work discusses the implementation, verification, and validation of Park's two-temperature model in a scalable, computational fluid dynamics (CFD) code developed at the US Department of Energy's Oak Ridge National Laboratory (ORNL). The implementation of Park's two-temperature model was verified through 0D test cases involving an adiabatic reactor and a nitrogen thermal bath. The implementation was then validated through comparisons with other validated CFD codes and experimental data on a hypersonic cylinder and double cones. These are standard benchmark test cases for thermochemical non-equilibrium (TCNE) modeling, and all data are shared publicly. The verification and validation results showed that ORNL's in-house CFD code could model complex, high-speed flow problems with and without TCNE modeling. This work is essential for future research involving 3D shock wave/boundary layer interactions (SBLIs).

Nutter, Nicole↗
DOE OSTI2026

FOCAL Campaign I: Advanced Wind Turbine Control Strategies

Campaign I of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aims to generate a dataset enabling the validation of aerodynamic performance of a scaled turbine mounted on a rigid tower in a fixed condition. The turbine considered in the FOCAL testing campaigns is the IEA-Wind 15MW Reference Wind Turbine. This scaled model is capable of simulating advanced blade-pitch control strategies in a high-quality wind field. The turbine is fully instrumented to record a variety of parameters in real time such as structural loads and dynamics. The test data considered was generated at the University of Maine's Harold Alfond Wind and Wave (W2) testing facility. The Load Cases (LC) considered in this testing campaign are as follows: LC 1.X - Constant wind and blade-pitch with varying rotor speeds LC 2.X - Constant wind and rotor speed with varying blade-pitch LC 3.X - Varying wind with active closed-loop control Detailed properties on the modeled system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaign I: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine. UMaine ASCC Report Number 23-40-1183. Details on the results of the verification and validation are found in the following reference: Mendoza, Nicole et al., "Verification and Validation of Model-Scale Turbine Performance and Control for the IEA Wind 15 MW Reference Wind Turbine," Energies, vol. 15, no. 20, 2022, https://doi.org/10.3390/en15207649.

17 WIND ENERGY↗
DOE OSTI2024

OC6 Phase IV: Validation of CFD Models for Stiesdal TetraSpar Floating Offshore Wind Platform

ABSTRACT With only a few floating offshore wind turbine (FOWT) farms deployed anywhere in the world, FOWT technology is still in its infancy, building on a modicum of real‐world experience to advance the nascent industry. To support further development, engineers rely heavily on modeling tools to accurately portray the behavior of these complex systems under realistic environmental conditions. This reliance creates a need for verification and validation of such tools to improve reliability of load and dynamic response prediction and analysis capabilities of FOWT systems. The Offshore Code Comparison Collaboration, Continued with Correlation and unCertainty (OC6) project was created under the framework of the International Energy Agency to address this need and considers a three‐sided verification and validation between engineering level models, computational fluid dynamics (CFD), and experimental results. In this paper, a novel floating offshore wind platform, the Stiesdal TetraSpar, is simulated using CFD under the load conditions defined by Phase IV of the OC6 project. The comparison of these CFD results against the experimental results demonstrated the ability to predict the platform response to waves when imposing the measured wave signals as input. Although validation versus experiment was largely successful, the damping behavior was impacted by uncertainties likely originating from the mooring system and sensor umbilical cable. This extensive comparison effort with multiple CFD practitioners offers insight into best practices to achieve reliable results.

17 WIND ENERGY↗
DOE OSTI2025

AMR-Wind: A Performance-Portable, High-Fidelity Flow Solver for Wind Farm Simulations

We present AMR-Wind, a verified and validated high-fidelity computational-fluid-dynamics code for wind farm flows. AMR-Wind is a block-structured, adaptive-mesh, incompressible-flow solver that enables predictive simulations of the atmospheric boundary layer and wind plants. It is a highly scalable code designed for parallel high-performance computing with a specific focus on performance portability for current and future computing architectures, including graphical processing units (GPUs). In this paper, we detail the governing equations, the numerical methods, and the turbine models. Establishing a foundation for the correctness of the code, we present the results of formal verification and validation. The verification studies, which include a novel actuator line test case, indicate that AMR-Wind is spatially and temporally second-order accurate. The validation studies demonstrate that the key physics capabilities implemented in the code, including actuator disk models, actuator line models, turbulence models, and large eddy simulation (LES) models for atmospheric boundary layers, perform well in comparison to reference data from established computational tools and theory. We conclude with a demonstration simulation of a 12-turbine wind farm operating in a turbulent atmospheric boundary layer, detailing computational performance and realistic wake interactions.

17 WIND ENERGY↗
DOE OSTI2022

Multiscale Experiments and Multiphysics Simulation of Multiphase Flow for Transportable Small Modular Reactors

A new type of safe, small, transportable nuclear reactor would address the intense and ever-growing global demand for energy produced via a resilient, carbon-free energy source. In this regard, transportable small modular reactors (SMRs) are being designed and developed for electricity generation within small/micro-grid/off-grid isolated systems, as well as for heat generation in industrial/residential applications. These reactors feature the capability to be fully factory fabricated and then directly transported to utilities’ sites as “plug-and-play” systems. Research and development (R&D) programs are underway at Idaho National Laboratory (INL) to successfully design, develop, and demonstrate such safe-by-design mobile reactor technologies, in collaboration with partner organizations. Multiscale experimental facilities and multiphysics simulation tools are required for reactor design verification and validation (V&V), and licensing. These advanced reactors are intended to feature passive safety systems such as passive containment cooling systems (PCCS), which consist of multiphase flows and multispecies distributions. This seminar talk will focus on designing and analyzing transportable SMR PCCS by using multiscale experiments and multiphysics computational fluid dynamics (CFD) simulations to support reactor licensing and safety. The corresponding research challenges are addressed via supportive verification and validation results generated by the models and simulation tools in combination with selective parametric and uncertainty analysis. This solution approach could blaze the trail for commercial adoption of such technologies. The facilities, simulation capabilities, and research opportunities available at INL in regard to such reactors and the integrated energy systems with which they go hand in hand are also discussed briefly, and may spark interest in deeper research as well as new collaborative projects.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

A Causal Approach to Model Validation and Calibration

This poster presents a novel method for validation and verification that focuses on identifying causal relationships between data elements, moving beyond traditional statistical and machine learning approaches. These methods employ causal discovery techniques to reveal the underlying mechanisms of data generation. The research utilizes structural causal models and directed acyclic graphs to depict causal relationships. This approach assists in achieving alignment between simulation models and reality.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Using Temporal Information from Human Mobility Data to Detect Anchor Points

Spatiotemporal mobility data are available in massive quantities, but large quantities of data typically include fewer variables or data fields. Often, the only available fields are User ID, Longitude, Latitude, Timestamp (ULLT). This raises an important question: how much can we infer about human mobility patterns using only these four fields? With ULLT data, we do not know individuals' socioeconomic status information or when they are visiting their anchor points (AP) or locations (such as homes, places of employment, or schools), and it is a modern challenge to use this data to infer these characteristics. When detecting anchor locations with limited input information, verification and validation (VV) are significant challenges. This paper addresses the problem of identifying individuals' anchor locations using only temporal information from spatiotemporal datasets with limited attributes. Our approach does not explicitly use latitude and longitude during analysis. Locationbased information is only employed in the preprocessing stage to identify periods of movement (trips) and stops (dwelling). Beyond this step, all analysis is based on temporal patterns. In theory, if stops and dwell times could be detected through alternative means, our method could function entirely without location-based input. We demonstrate this methodology on the 2017 National Household Travel Survey (NHTS) data, because it includes a carefully designed and collected time use survey with representative sampling and labeled ground truth. The high-quality survey data allows us to test the accuracy of our methods because NHTS contains intended place labels and agent/user characteristics. We have also applied our validated AP identification algorithm on very large-scale GPS based trajectory data for Patterns-of-Life (PoL) assessment and other applications, but due to space limit that could not be presented here.

McBride, Liz [ORNL] (ORCID:0000000286925869)↗
DOE OSTI2024

SAM Code Enhancements for Modeling of Liquid Metal-Cooled Fast Reactor Concepts

The SAM code is under development and supported by DOE-NE’s Nuclear Energy Advanced Modeling and Simulation program as a modern system-level modeling and simulation tool for advanced non-light water reactor safety analyses. These advanced reactor concepts incorporate novel and improved approaches to achieve safety and economic feasibility. This report summarizes two major efforts in addressing the modeling gaps in SAM for liquid-metal-cooled fast reactor (LMFR) applications, i.e. thermal mixing and stratification phenomena in large pools and corrosion-oxidation of components in flowing lead. A new one-dimensional model for thermal mixing and stratification effects in large pools and enclosures is developed and implemented. Thermal mixing and stratification occur when fluid enters a pool at a temperature different than the bulk fluid itself, a scenario often encountered during transients in pool-type systems. These phenomena are critical for the safety of reactors, impacting phenomena like natural circulation, which is essential for passive cooling. The improved model in SAM addresses limitations of state-of-the-art approaches by combining one-dimensional (1D) channels, representing the coolant jet flow, with lumped-parameter zero-dimensional (0D) pools, representing the rest of coolant in the tank. Energy exchange between the 1D jet and the 0D pools is based on heat transfer correlations calibrated against 3D simulations. It is verified that this model can handle various flow configurations, including hot jets in colder pools, cold jets in hotter pools, and the presence of features like ceilings, free surfaces, and obstacles. Additionally, validation against experimental data demonstrates the ability of the model to capture mixing and stratification effects in a wide range of conditions. The flexibility and improved accuracy of the new model make it a valuable tool for reactor safety analysis, allowing for the simulation of different geometries encountered in advanced reactors. A system-level corrosion modeling capability is developed and implemented in SAM to support Lead Fast Reactor (LFR) development. Although the initial focus of this capability will be on LFR application, this can later be expanded to include other liquid metals such as Lead-Bismuth Eutectic (LBE) and PbLi. This report summarizes the common corrosion mitigation strategies and outlines the progress on implementing and validating a corrosion-oxidation model in SAM. Verification and validation of the corrosion-oxidation portion of the model was performed using analytical solution and measured data from samples tested in the non-isothermal pumped lead loop at IPPE Obninsk. The iron transport and corrosion/precipitation portion of the model was assessed using an analytical model and measured corrosion depths from a natural convection lead loop experiment performed at CEA. It is demonstrated that the model implemented in SAM performed well in these assessments.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Progress Towards the Validation of a new RELAP5-3D model of the High Temperature Test Facility

Validation is a key step in the development of any type of systems model. As the next generation of reactors approaches, the need for codes that have been validated for these new types of systems continues to grow. An example of a prominent option is the Reactor Excursion Leak Analysis Program (RELAP5-3D), developed by Idaho National Laboratory. This code was developed for the purpose of systems level thermal-hydraulic modeling of light water reactors (LWRS) and postulated transients that can occur in LWRS.RELAP5-3D has been substantially validated against LWR data. Due to its long history as a reactor safety analysis tool, there has been an effort to adapt RELAP5-3D for the purposes of advanced reactor concepts such as prismatic high-temperature gas-cooled reactors (HTGRs). However, RELAP5-3D has not nearly been validated and verified for HTGRs to the degree of LWRs, warranting verification and validation opportunities with computational benchmarks and existing experimental facilities. Examples of such facilities include the modular high-temperature gas-cooled reactor (MHTGR) 350 and the high temperature engineering test reactor (HTTR) from Japan. The MHTGR 350 is a benchmark design concept for code-to-code verification purposes; therefore, it does not provide any experimental data for validation opportunities The HTTR provides useful multiphysics validation data but does not have the in-core instruments to generate thermal-hydraulic experimental data to help with RELAP5-3D validation. Consequently, a facility that could provide key in-core temperatures for thermal-hydraulic validation was still needed. The High Temperature Test Facility (HTTF) is an integral effects facility for HTGR thermal hydraulics developed and operated by Oregon State University. HTTF represents ¼ length scale of the General Atomics MHTGR and is rated for a total power of 2.2 MW. Axially, the core consists of an upper and lower reflector and 10 blocks, numbered from bottom to top (Block 1 is right above lower reflector). The core is heated via graphite resistive heater rods, with respective channels distributed throughout the core. The primary coolant is helium and heat can radiate out of the core to the reactor cavity cooling system (RCCS), which is cooled by water. The primary purpose of the facility is to investigate pressurized conduction cooldown (PCC) and depressurized conduction cooldown (DCC) transients, which are also referred to as the pressurized and depressurized loss of forced cooling respectively. Two experiments were chosen to perform the validation study with a RELAP5-3D model of HTTF. These experiments are PG-27 (PCC) and PG-29 (DCC). These were chosen based off of the quality of available experimental data before and during the experiment which led to their inclusion in the HTGR Thermal Hydraulics Benchmark.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Oak Ridge National Laboratory Technical Input for the Nuclear Regulatory Commission Review of the 2017 Edition of ASME Section III, Division 5, ‘High Temperature Reactors’

To assist the Nuclear Regulatory Commission in its decision making on endorsement of the American Society for Mechanical Engineers Boiler and Pressure Vessel Code Section III, Division 5 (2017 Edition) for development of advanced non-light water reactors, the following Division 5 portions were reviewed: Article HBB-2000 Material; Article HCB-2000 Material; Article HGB-2000 Material; Mandatory Appendix HBB-I-14 Tables and Figures; and, Nonmandatory Appendix HBB-U Guidelines for Restricted Material Specifications to Improve Performance in Certain Service Applications. In addition to the 2017 Edition, the same parts of the 2019 Edition have also been reviewed as indicated in various sections of the report. This review was conducted by a collaboration of national laboratory and private sector participants with significant industrial experience, including some heavy lifting and deep diving from Clarus Consulting, LLC., all intended to achieve an objective, independent, and practical perspective. The report provides recommendations, descriptions of the evaluation methods, and the source references for the data used. To build confidence required for endorsement of the Code, this review was conducted as a verification and validation of the above Code contents. The objective of verification is to ensure that the Code is free of error – direct or implied; contains the information needed for its use, including proper coverage of the Code-specified materials for the intended application, and completeness and adequacy of references to other portions of the Code. The objective of validation is to authenticate that the Code tabulations and graphs represent design inputs consistent with what are determined using rules and methods specified by the Code. The authentication process used data that were assembled and/or generated independent of Code development, while the methods of analysis followed Code-specified methods where appropriate. The designated portions for this review cover the five alloys codified for high temperature reactor applications in Division 5, i.e. 316 SS, 304 SS, 800H, 2¼Cr-1Mo, and 9Cr-1Mo-V, regarding their general requirements, permitted specifications and design stress intensity values for pressure-retaining applications, deterioration in service, fatigue acceptance test, permissible weld materials, tensile and yield strength, expected minimum stress-to-rupture values (including for Alloy 718), weld stress rupture factors, permissible materials for bolting use, and restricted specifications in certain service applications. Additionally, stress intensity values for bolting materials including 316 SS, 304 SS and alloy 718 were reviewed. Analysis and discussion are also provided on contents outside of these designated Code portions where it was deemed relevant and necessary to develop a technically sound understanding of issues relating to the designated portions. Due to unavailability of sufficient test data on welds during the review period, the weld stress rupture factors in Tables HBB-I-10.14A to E, which cover a total of ten tables for the five alloys welded with twenty-eight different weld metals (some with similar properties), have been deferred to a future review effort. The review identified mainly two types of issues. The first type includes instances where the Code is found factually incomplete or incorrect, such as obsolete materials specifications listings, missing tabulation of stresses for bolting. Changes to the Code are recommended in these cases. The second type of issue includes instances where the Code tabulations and graphs are found to be less conservative than the review analysis results. In these cases, recommendations are made for further review and consideration where the difference in conservatism exceeds 10%, which is our threshold for questioning technical adequacy, meriting a risk assessment by the Nuclear Regulatory Commission and/or reactor designers. It is noted that this effort has been executed using all available data and established methods of analysis, including methods and criteria specified and used by the Code. As such, the findings that are presented in quantitative detail, in a format for convenient comparison with the Code, and with identification of where further review is recommended, should provide a sound technical basis for decisions about quantifying the implications of the reduced design margins and technical adequacy/inadequacy to form a basis for conditioning specific Code tabulation values on endorsement. Recommendations for specific changes to the Code, however, entail design conservatism considerations beyond the scope of this review effort, and are not made in this report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Software Verification Toolkit (SVT): Survey on Available Software Verification Tools and Future Direction

Writing software is difficult. However, writing complex, well tested and designed, and functionally correct software is incredibly difficult. An entire field of study is devoted to the validation and verification of software to address this problem, and in this paper we analyze the landscape of currently available third party software. We have divided our analyses into three separate subsections with regards to software validation: formal methods, static analysis, and test generation. Formal verification is the most complex method in which to validate software correctness, but also the most thorough as it truly validates the mathematical validity of the source code. Static analysis generally is relegated to abstract syntax tree traversal techniques to find errors related to faulty software such as memory leaks or stack overflow issues. Automatic test generation is similar in implementation to static analysis, but pushes a bit further in verifying the boundedness of function inputs and outputs with regards to annotated or parsed criteria. The crux of this report is to analyze and describe the software tools that implement these techniques to validate and verify software. Pros and cons related to installation, utilization, and capabilities of the frameworks are described, and reproducible examples are provided with a focus on usability. The initial survey concluded that the most interesting tools of note are Z3, Isabelle/HOL, and TLA+ with regards to formal verification; and Infer, Frama-C, and SonarQube with regards to static analysis. With these tools in mind, a final conjecture is provided that describes future avenues of utilizing these tools for developing a verification framework to assist in validating existing software at Sandia National Laboratories.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Sensitivity Analysis of Irradiated Fueled Experiments using the MOOSE Framework [Slides]

Modeling and simulation (M&S) methods are able to predict uncertainties in experimental parameters (e.g., power and fission density) during irradiation. A shortfall exists in predicting how sensitive some of the parameters will behave during the experimental process. Sensitivity and Uncertainty Quantification (SUQ) is critical in support of qualification and licensing reactor fuels. The application of a method to quantify the uncertainty in these experiments is critical to the prediction of their performance. In this work, we propose the use of a polynomial chaos expansion (PCE) method to quantify the sensitive parameters in these simulations and, in an extension, their experimental surrogates. We propose to perform M&S using PCE uncertainty quantification on a previously irradiated fueled experiment in order to provide a validation case for Griffin and expand its use as a verification and validation (V&V) tool for experiments with a neutronics component. Griffin is an advanced, deterministic neutronics analysis code built using the MOOSE (multiphysics object-oriented simulation environment) framework which can provide state-of-the-art neutronic analysis on M&S of experiments. We will use the stochastic tools module (STM) in MOOSE to provide PCE uncertainty quantification on the proposed experimental setup. Idaho National Laboratory (INL) does not yet have an in-house developed code with V&V approval for experiments performed on-site; this work would provide a necessary addition of support for experiments performed at INL. The Nuclear Regulatory Commission (NRC) has explicitly requested uncertainties in calculated values such as fuel power and burnup, and the development of this capability would benefit the relationship between INL and the NRC.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Automated Data Review of Analytical Laboratory Results at Los Alamos National Laboratory - 20299

Newport News Nuclear BWXT-Los Alamos, LLC (N3B) collects samples in support of the U.S. Department of Energy's (DOE) Office of Environmental Management (EM) Los Alamos Legacy Cleanup Contract (LLCC). N3B receives and reviews over 1.6 million sample data points annually in support of various ongoing environmental monitoring and remediation projects of the LLCC. N3B must demonstrate and document that reported external analytical laboratory data produced for the LLCC are of sufficient quality to fulfill their intended purpose and to support defensible decision making as described in EPA QA/G4 Guidance for the Data Quality Objectives Process 1994. In 2018, N3B assumed management of the LLCC along with the Environmental Information Management (EIM) database that contains all historical and current environmental data associated with the LLCC. The entire EIM database is shared between N3B, Triad National Security, LLC (Triad), and New Mexico Environment Department (NMED). These three parties jointly manage the database, its configuration, and changes / updates. All environmental data that are entered into EIM are updated and available, on a daily basis, in the linked public database Intellus New Mexico (Intellus). The quality and defensibility of the environmental data generated from sampling activities is a key component of an effective remediation process. Providing quality data is accomplished through a data assessment process that includes examination, verification, and validation. Examination is the assessment of completeness of the deliverables, identification of any reporting errors, and determining the usability of the data based on the laboratory's evaluation of its data as described in the case narrative received with the data. Verification consists of an evaluation of the Electronic Data Deliverables (EDD) data report to determine the extent to which the external analytical laboratories met method and contract-specific quality control and reporting requirements. Validation consists of determining the data quality and the extent to which the external analytical laboratories accurately and completely reported all sample and quality control results and satisfied all contract requirements. EIM contains an automatic Data Validation Module which performs automated data review (DVM ADR). DVM ADR is a tool to assist in the validation process. When DVM ADR is used in conjunction with manual examination of sample data packages, the combination of the two will meet and exceed the requirements of verification. N3B recognized an opportunity for process improvement, focusing on DVM ADR configuration and enhancements in EIM. Testing EIM's configuration provided proof of the DVM ADR's capabilities and flexibility to accurately perform routine data checks based on analytical methods and regulatory requirements. In addition, the DVM ADR module was improved through enhancements for all analytes, particularly upgrades for radiochemistry data. Extensive testing of the DVM ADR module occurred using EDDs from actual laboratory analyses on the EIM testing site. During this process, N3B manipulated EDD information to verify that the actual outcomes matched the expected outcomes. The results of this testing were shared with the database architects, and configuration improvements were identified to address these results. During this process, N3B identified that the radiochemical DVM ADR capabilities were underutilized, and so enhanced the DVM ADR functionality with respect to radioanalytical assessment. N3B environmental data uploads to Intellus on a daily basis from EIM, once the analytical data undergoes examination and verification. As such, it is important to have a high level of confidence in the quality and defensibility of the data. The process of manual examination, along with the DVM ADR, in conjunction with full validation of a percentage the data specified through the Data Quality Objectives greatly increases efficiency of data review and confidence level of the quality of the data, and gives the project managers, governmental offices, and the public expedited access to high-quality data. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗