Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Identification and Study of Validation Level Test Cases for Computational Modeling of Non-Charring Ablators

Computational modeling of Thermal Protection System (TPS) materials, used for aerospace applications, provides numerous advantages in preliminary selection and design of a heatshield material and shape for atmospheric entry vehicles. However, to serve as a reliable tool for prediction of material thermal and ablative behavior, the modeling approach needs to be validated against real experimental and flight data, preferably at a range of applied conditions. The validation study is typically very complex as it requires reliable measured data not only for the material thermal response and surface recession, but also well characterized environmental conditions. The validation problem becomes even more complex when the material thermal response is dictated by multi-physics effects such as solid conduction, in-depth thermal decomposition, pyrolysis gas flow and chemical reactions. The multi-physics effects complicate not only the modeling effort, but also the experimental measurement for validation of various aspects of the highly coupled problem. In this study, an attempt is made to identify suitable experimental data that could serve as a source for validation of material thermal response modeling tools. To reduce the computational complexity, this study focuses only on non-charring ablators, where the material thermal response could be modeled with a single governing equation for solid conduction and the ablation is limited only to the surface of the material. With a well characterized and publicly available experimental data being sparse, the study is limited in presenting test cases for only three materials: camphor, graphite and FiberForm® in the sequence of increased modeling complexity. Graphite is a commonly used TPS material for aerospace applications, both for leading edges of high-speed vehicles and internal insulation of solid rocket motors. FiberForm® is a porous carbon pre-form used in preparation of the well known PICA material Tran et al. [1996]. Inclusion of camphor into the list is conditioned with the relative simplicity in modeling the material thermal and chemical response and the low-enthalpy flow environment. In addition, camphor has been used as a simple test material for study of flow transition behavior by Stock and Ginoux [1973] and assessment of a heatshield shape change at flight relevant conditions by Rotondi et al. [2022]. In this work, the identified experimental data was extracted from the public literature and test cases that yet have been published. As it was found from the review, not a single test case contains an exhaustive set of data that would validate every aspect of the material physics. However, in the data collected, various aspects of the material behavior can be still validated, such as surface and in-depth temperature, amount of recession and a shape change. The identified experimental data for each case is accompanied with a characterized flow environment and simulated boundary conditions predicted by a Data-Parallel Line Relaxation (DPLR) code Wright et al. [1998]. In addition, material thermal response numerical simulations in each test case are performed with Kentucky Aerothermodynamics and Thermal Response System (KATS-MR) Zibitsker et al. [2022] providing a comparative study and a sanity check for the proposed validation data. Sample results from the performed numerical study are shown below. Figure 1 shows distribution of surface heat flux and pressure values on a hemi-cylinder model made of FiberForm® and tested in HyMETS arc-jet facility. The results are shown for the high pressure condition among the two tests. Flow simulation was performed with DPLR code on a quarter of original geometry. In the figure, the quarter shape was mirrored across zx and xy planes to show the complete distribution. Figure 2 shows the material response results for the high pressure case (7500 Pa), simulated with KATS-MR and a comparison to the experimental data for the surface temperature and shape shape. The simulation was performed on a 2-D slice, extracted in the xy plane at the middle of the sample. Figure 3 shows the material response simulation for the low pressure case (3500 Pa) and a comparison to the experimental data for surface temperature and shape change.

ablation↗

Validation for 233U-Fueled Systems in KENO V.a in SCALE 6.2

Validation of the KENO V.a Monte Carlo code has been performed in recent years using benchmark experiments contained in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The models used in these recent validation efforts have been drawn from the Verified, Archived Library of Inputs and Data (VALID). Models must be generated and reviewed by qualified individuals to be added to the VALID library, which leads to high confidence in the models and reduces the probability that apparent validation issues are a result of modeling errors. The contents of the VALID library are somewhat limited because of the effort involved in generating and reviewing models, so no 233U-fueled experiments are included in VALID. A large number of models of 233U experiments have been modeled in the past in support of the criticality safety of 233U in storage at Oak Ridge National Laboratory (ORNL). In June 2016, two midshipmen from the United States Naval Academy were assigned to ORNL, and they reviewed and updated these models for execution in SCALE 6.2. The validation of 233U is of interest because some discrepancies in SCALE results were identified by a beta tester at the Nuclear Energy Agency modeling these systems. These discrepancies were related to a data thinning procedure in the continuous-energy nuclear data process, and had been resolved prior to the release of SCALE 6.2

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Human factors case study: An iterative approach to verifying and validating a new suite of reactor inspection and maintenance tooling - 177

An iterative approach was taken to perform the HF Verification and Validation (V and V) activities for a complex set of reactor inspection and maintenance tooling equipment known as the Bruce Reactor Inspection and Maintenance System (BRIMS). This paper is divided into the verification activities (of Human System Information Task Support and Design verifications) and the validation activities. The validation method used a graded approach by breaking validation activities into early usability testing and high fidelity validations. Early usability testing, allowed for issues and design concepts to be identified and explored. High fidelity validation activities tested that the final design requirements and operational goals of the system were met in the production equipment. The validation method has been described in detail by depicting the following: task selection criteria, tools, performance measures and data collection. Validation results demonstrate the benefits of the graded approach as issues were to be identified early in the design process, improvements were made during detailed design and additional testing could confirm that issues were resolved prior to commissioning. To capture and share the success of this iterative V and V approach lessons learned have been created for use in future V and V projects. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Thermal Hydraulics Validation Activities in the ART-GCR Campaign

The Advanced Reactor Technologies - Gas Cooled Reactor Campaign (ART-GCR) is part of the United States Department of Energy - Office of Nuclear Energy's Advanced Reactor Technologies program aimed at developing a High Temperature Gas-cooled Reactor (HTGR) which will offer enhancements in safety and efficiency. The Design, Methods, and Validation arm of the ART-GCR program provides experience and advanced tools for HTGR design and analysis. The Methods and Validation arm is developing data to validate predictions of decay heat removal through an extensive experimental campaign the Natural Convection Shutdown Heat Removal Test Facility at Argonne National Laboratory. In-core thermal hydraulics validation is being facilitated through the OECD/NEA's Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data. That benchmark contains code-to-code and code-to-data comparisons for 3 sets of HTGR thermal hydraulics phenomena. This ongoing benchmark activity has 16 participants from 9 countries developing leading insights into HTGR thermal hydraulics code validation. The ART-GCR campaign is also working on the development of state-of-the-art MOOSE-based models of the High Temperature Engineering Test Reactor (HTTR). Through the OECD/NEA's HTTR Loss of Forced Cooling (LOFC) program, the ART-GCR campaign is developing a multiphysics transient code validation benchmark based on 3 HTTR experiments that will provide an opportunity for international collaboration on multiphysics code validation.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Computer Modeling and Simulation: Increasing Reliability by Disentangling Verification and Validation

Verification and validation (V&V) of computer codes and models used in simulations are two aspects of the scientific practice of high importance that recently have been discussed widely by philosophers of science. While verification is predominantly associated with the correctness of the way a model is represented by a computer code or algorithm, validation more often refers to the model’s relation to the real world and its intended use. Because complex simulations are generally opaque to a practitioner, the Duhem problem can arise with verification and validation due to their entanglement; such an entanglement makes it impossible to distinguish whether a coding error or the model’s general inadequacy to its target should be blamed in the case of a failure. I argue that a clear distinction between computer modeling and simulation has to be made to disentangle verification and validation. Drawing on that distinction, I suggest to associate modeling with verification and simulation, which shares common epistemic strategies with experimentation, with validation. To explain the reasons for their entanglement in practice, I propose a Weberian ideal–typical model of modeling and simulation as roles in practice. I examine an approach to mitigate the Duhem problem for verification and validation that is generally applicable in practice and is based on differences in epistemic strategies and scopes. Based on this analysis, I suggest two strategies to increase the reliability of simulation results, namely, avoiding alterations of verified models at the validation stage as well as performing simulations of the same target system using two or more different models. In response to Winsberg’s claim that verification and validation are entangled I argue that deploying the methodology proposed in this work it is possible to mitigate inseparability of V&V in many if not all domains where modeling and simulation are used.

97 MATHEMATICS AND COMPUTING↗

Validation of Microgrid Algorithms using At-Scale Simulation and Emulation Real-Time (ASSERT) Framework

This paper presents a novel framework for validating microgrid algorithms using a At-Scale Simulation and Emulation Real-Time (ASSERT) setup. The proposed universal microgrid validation framework was developed at Advanced Research on Integrated Energy Systems (ARIES) platform at National Renewable Energy Laboratory in Golden, Colorado, USA. As the number of intercommunicating devices grow in power systems, along with more integration of inverter-based resources, developing and validating microgrid operation and control algorithms is becoming complex and time-consuming task. The ASSERT framework is designed to provide a comprehensive, accurate, and efficient solution for validating microgrid algorithms. It combines at-scale simulations and real-time emulation to create a virtual environment that closely mimics the behavior of a physical microgrids which are characteristic of future smart distribution systems, such as: (1) increasing variability in the physical size of new energy technologies; (2) requiring control large numbers of interconnected devices, and (3) integrating diverse technologies that have not previously worked together. The paper describes the technical details of the ASSERT framework, its validation process, and its benefits over traditional validation methods. The framework's ability to validate the performance of various algorithms is demonstrated through a case study, which shows that it can effectively identify the weaknesses of an algorithm and optimize its performance. Overall, the ASSERT framework is a promising tool that can significantly enhance the development and validation of microgrid algorithms, leading to more reliable and efficient microgrid operation.

at-scale↗

Performing k eff Validation of As-Loaded Criticality Safety Calculations Using UNF-ST&DARDS: Applicable Experiment Selection

The general method for performing validation of as loaded criticality safety calculations using UNF ST&DARDS is presented in a paper by Clarity, which includes a description of the UNF-ST&DARDS system. Proof-of-principle analyses were performed in the summer of 2019 for MPC-32 dual purpose canisters (DPCs) containing pressurized water reactor (PWR) fuel assemblies. Summaries of these results are presented in this and a companion paper for this conference. The current paper describes the TSUNAMI-IP calculations performed to select applicable experiments for validation of 11 MPC-32 DPCs. The companion paper discusses the TSUNAMI-3D calculations used to generate sensitivity data to support the experiment selections discussed here. Experiment selection is based on the sensitivity/uncertainty (S/U) methods used to validate criticality safety calculations of as-loaded DPCs containing pressurized water reactor (PWR) spent nuclear fuel (SNF). This process has been demonstrated and is summarized in this paper. The approach is similar to that used in NUREG/CR-7109, which provides an approach for validation of PWR burnup credit (BUC), including major and minor actinides and major fission products. The premise of S/U-based validation is that applicable experiments—those having a similar bias to a given application system—will have similar sensitivities for each isotope and reaction in the two systems. It is assumed that cross sections with larger uncertainties are more likely to contain data errors which contribute to the bias. The integral index c k thus propagates the system sensitivities with the nuclear covariance data to calculate a correlation coefficient representing the similarity of the two systems. In this work, a c k value of 0.8 or higher is interpreted as identifying an experiment with sufficient similarity for use in validation. This paper presents a brief summary of the characteristics of the 11 MPC-32 DPCs used in the proof of-principle analysis for as-loaded criticality safety calculation validation and an overview of the critical experiment suite with which each of these DPC models was compared. A summary and discussion of c k results is also presented, followed by conclusions and a discussion of future work to be performed for validation of UNF ST&DARDS as-loaded criticality safety calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ARC Software Validation Work for the FFTF Reactor

Extensive efforts have been carried out at ANL for the verification and validation of the Argonne Reactor Codes (ARC) software package currently used for the design of Versatile Test Reactor (VTR). The ARC software package consists of steady state neutronics and thermal hydraulics modeling capabilities which are being used by the VTR program to develop most of the VTR reactor design details which will be part of the licensing application. It is anticipated that this software will continue to be used for the design work and for initial operations although additional software may be introduced at a later time. The validation work was focused primarily on obtaining validation data consistent with VTR and usable for the ARC software. Because no critical facilities or operating fast spectrum reactors are available to do experiments for the VTR, the next best option is to identify historical experimental data that can be used as validation data. Early on in VTR, the ZPPR-15 set of experiments was identified as good validation data because of 1) the availability and quality of the data, 2) existing staff that are already familiar with the experimental machine and measurements, 3) most of the ZPPR-15 loadings of interest have already been processed into ARC models, and 4) a full uncertainty quantification has already been done for several loadings of ZPPR-15. The FFTF startup and operations data was identified as the most consistent reactor type that has validation data usable for VTR. Finally, the EBR-II fuel depletion measurements were identified as the best available validation data for VTR. It is important to note that both the FFTF and EBR-II reactors typically come with higher uncertainties than the ZPPR. In the frame of the discussed verification and validation efforts, the present document discusses the analysis of selected FFTF measurements included in the benchmark specifications of the International Reactor Physics Experiment (IRPhE) handbook. The FFTF reactor core configurations from the benchmark specification are presented in Section 2. The analysis is performed with the use of the ARC code suite available at ANL for fast reactor studies and is discussed in Section 3. The reactor parameters from the benchmark include criticality, neutron spectra, effective delayed neutron spectra, control rod worth, isothermal temperature coefficient and low energy gamma-ray spectra. The calculated values and the comparison with the experimental data is discussed in Sections 4 to 9 for each considered reactor parameter. Finally, conclusions are presented in Section 10.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Earth Science Enterprise Scientific Data Purchase Project: Verification and Validation

This paper presents viewgraphs on the Earth Science Enterprise Scientific Data Purchase Project's verification,and validation process. The topics include: 1) What is Verification and Validation? 2) Why Verification and Validation? 3) Background; 4) ESE Data Purchas Validation Process; 5) Data Validation System and Ingest Queue; 6) Shipment Verification; 7) Tracking and Metrics; 8) Validation of Contract Specifications; 9) Earth Watch Data Validation; 10) Validation of Vertical Accuracy; and 11) Results of Vertical Accuracy Assessment.

Jenner, Jeff↗

Review of TRMM/GPM Rainfall Algorithm Validation

A review is presented concerning current progress on evaluation and validation of standard Tropical Rainfall Measuring Mission (TRMM) precipitation retrieval algorithms and the prospects for implementing an improved validation research program for the next generation Global Precipitation Measurement (GPM) Mission. All standard TRMM algorithms are physical in design, and are thus based on fundamental principles of microwave radiative transfer and its interaction with semi-detailed cloud microphysical constituents. They are evaluated for consistency and degree of equivalence with one another, as well as intercompared to radar-retrieved rainfall at TRMM's four main ground validation sites. Similarities and differences are interpreted in the context of the radiative and microphysical assumptions underpinning the algorithms. Results indicate that the current accuracies of the TRMM Version 6 algorithms are approximately 15% at zonal-averaged / monthly scales with precisions of approximately 25% for full resolution / instantaneous rain rate estimates (i.e., level 2 retrievals). Strengths and weaknesses of the TRMM validation approach are summarized. Because the dew of convergence of level 2 TRMM algorithms is being used as a guide for setting validation requirements for the GPM mission, it is important that the GPM algorithm validation program be improved to ensure concomitant improvement in the standard GPM retrieval algorithms. An overview of the GPM Mission's validation plan is provided including a description of a new type of physical validation model using an analytic 3-dimensional radiative transfer model.

Smith, Eric A.↗

Validation of Decompression Sickness Risk Mitigation Protocols for Planetary Spaceflight Missions

BACKGROUND: Apollo missions used a 100% O2 cabin atmosphere which effectively eliminated the risk of decompression sickness (DCS) during extravehicular activity (EVA) on the moon. NASA’s future missions to the moon and Mars are expected to use nitrox gas mixtures of up to 34% O2, 66% N2, which will reduce flammability risk compared with Apollo, but will necessitate Oxygen prebreathe prior to EVA to reduce DCS risk to acceptable levels. Prebreathe protocols used on the space shuttle and International Space Station are validated for microgravity EVAs, but the significantly increased risk of DCS during equivalent ambulatory EVAs make these protocols inapplicable to planetary EVA. An “exploration atmosphere” of 56.5 kPa (8.2 psia), 34% O2, 66% N2 has been recommended by NASA as a compromise that balances prebreathe duration, hypoxia, and flammability risk, assuming a 29.6 kPa (4.3 psi) spacesuit. However, this atmosphere may not be used for vehicles that do not support frequent EVA, and with commercial providers and international providers expected to provide landers, pressurized rovers, habitats, and spacesuits, different combinations of vehicle and spacesuit atmospheres are possible and will each require validated prebreathe protocols. OVERVIEW: Key components of a multi-year strategic roadmap include: 1) Establish hypobaric chamber facility capable of supporting 8-person EVA prebreathe validation tests at saturation atmospheres up to 36% O2; 2) validate an EVA physical workload simulation for use during prebreathe validation testing; 3) validate the recommended “exploration atmosphere” prebreathe protocol; 4) validate prebreathe protocols for additional atmospheric combinations that bound the most likely potential operating ranges of future vehicles and spacesuits; and 5) update DCS risk estimation models based on results of prebreathe validation studies. DISCUSSION: Details and data from completion of the first two steps of the strategic roadmap will be presented; the third step is currently underway, with pilot results provided in a companion presentation. Steps four and five will require a multi-year series of chamber tests; collaborations are being pursued.

Andrew F. J. Abercromby↗

Validation for {sup 233}U-Fueled Systems in KENO V.a in SCALE 6.2

Validation of the KENO V.a Monte Carlo code has been performed in recent years using benchmark experiments contained in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The models used in these recent validation efforts have been drawn from the Verified, Archived Library of Inputs and Data (VALID). Models must be generated and reviewed by qualified individuals to be added to the VALID library, which leads to high confidence in the models and reduces the probability that apparent validation issues are a result of modeling errors. The contents of the VALID library are somewhat limited because of the effort involved in generating and reviewing models, so no {sup 233}U-fueled experiments are included in VALID. A large number of models of {sup 233}U experiments have been modeled in the past in support of the criticality safety of {sup 233}U in storage at Oak Ridge National Laboratory (ORNL). In June, 2016, two midshipmen from the United States Naval Academy were assigned to ORNL, and they reviewed and updated these models for execution in SCALE 6.2. The validation of {sup 233}U is of interest because some discrepancies in SCALE results were identified by a beta tester at the Nuclear Energy Agency modeling these systems. These discrepancies were related to a data thinning procedure in the continuous-energy nuclear data process, and had been resolved prior to the release of SCALE 6.2. (authors)

07 ISOTOPE AND RADIATION SOURCES↗

Validation in the Absence of Observed Events

Here our paper addresses the problem of validating models in the absence of observed events, in the area of Weapons of Mass Destruction terrorism risk assessment. We address that problem with a broadened definition of “Validation,” based on “backing up” to the reason why modelers and decision makers seek validation, and from that basis re-define validation as testing how well the model can advise decision makers in terrorism risk management decisions. We develop that into two conditions: Validation must be based on cues available in the observable world; and it must focus on what can be done to affect that observable world, i.e. risk management. That in turn leads to two foci: 1.) the risk generating process, 2.) best use of available data. Based on our experience with nine WMD terrorism risk assessment models, we then describe three best use of available data pitfalls: SME confidence bias, lack of SME cross-referencing, and problematic initiation rates. Those two foci and three pitfalls provide a basis from which we define validation in this context in terms of four tests -- Does the model: … capture initiation? … capture the sequence of events by which attack scenarios unfold? … consider unanticipated scenarios? … consider alternative causal chains? Finally, we corroborate our approach against three key validation tests from the DOD literature: Is the model a correct representation of the simuland? To what degree are the model results comparable to the real world? Over what range of inputs are the model results useful?

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

An Approach for Validating Actinide and Fission Product Burnup Credit Criticality Safety Analyses: Criticality (k eff ) Predictions

One of the most important remaining challenges associated with expanded implementation of burnup credit in the United States is the validation of depletion and criticality calculations used in the safety evaluation—in particular, the availability and use of applicable measured data to support validation, especially for fission products (FPs). Applicants and regulatory reviewers have been constrained by both a scarcity of data and a lack of clear technical basis or approach for use of the data. In this study, this paper describes a validation approach for commercial spent nuclear fuel (SNF) criticality safety (k eff ) evaluations based on best-available data and methods and applies the approach for representative SNF storage and transport configurations/conditions to demonstrate its usage and applicability, as well as to provide reference bias results. The criticality validation approach utilizes not only available laboratory critical experiment (LCE) data from the International Handbook of Evaluated Criticality Safety Benchmark Experiments and the French Haut Taux de Combustion program to support validation of the principal actinides but also calculated sensitivities, nuclear data uncertainties, and limited available FP LCE data to predict and verify individual biases for relevant minor actinides and FPs. The results demonstrate that (a) sufficient critical experiment data exist to adequately validate k eff calculations via conventional validation approaches for the primary actinides, (b) sensitivity-based critical experiment selection is more appropriate for generating accurate application model bias and uncertainty, and (c) calculated sensitivities and nuclear data uncertainties can be used for generating conservative estimates of bias for minor actinides and FPs. Results based on the SCALE 6.1 and the ENDF/B-VII.0 cross-section libraries indicate that a conservative estimate of the bias for the minor actinides and FPs is 1.5% of their worth within the application model. Finally, this paper provides a detailed description of the approach and its technical bases, describes the application of the approach for representative pressurized water reactor and boiling water reactor safety analysis models, and provides reference bias results based on the prerelease SCALE 6.1 code package and ENDF/B-VII nuclear cross-section data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Experience with Aero- and Fluid-Dynamic Testing for Engineering and CFD Validation

Ever since computations have been used to simulate aerodynamics the need to ensure that the computations adequately represent real life has followed. Many experiments have been performed specifically for validation and as computational methods have improved, so have the validation experiments. Validation is also a moving target because computational methods improve requiring validation for the new aspect of flow physics that the computations aim to capture. Concurrently, new measurement techniques are being developed that can help capture more detailed flow features pressure sensitive paint (PSP) and particle image velocimetry (PIV) come to mind. This paper will present various wind-tunnel tests the author has been involved with and how they were used for validation of various kinds of CFD. A particular focus is the application of advanced measurement techniques to flow fields (and geometries) that had proven to be difficult to predict computationally. Many of these difficult flow problems arose from engineering and development problems that needed to be solved for a particular vehicle or research program. In some cases the experiments required to solve the engineering problems were refined to provide valuable CFD validation data in addition to the primary engineering data. All of these experiments have provided physical insight and validation data for a wide range of aerodynamic and acoustic phenomena for vehicles ranging from tractor-trailers to crewed spacecraft.

experiment↗

AVT-297 Development of a Framework for Validation of Computational Tools

Design of aerospace vehicles relies on system models. These models rely on validation data to ensure accurate representation of the system. This paper provides an introduction to the problem and an overview of a NATO STO Activity, AVT-297, which developed a framework to determine validation experiments required to support system level models. The goals of the research group were to develop a process to identify a validation database for intended uses of a vehicle system, demonstrate the process on vehicles and document the process. Applying this process to multiple intended uses and collecting this set of validation databases identifies a set of validation experiments that could be applied to the design of multiple vehicles, further reducing the cost and time to develop air and naval vehicles. Four subgroup teams focused on different aspects of the validation database process: two focused on different aspects of a missile, and two focused on different aspects of a fixed-wing mobility transport class vehicle. This resulted in three different processes to decompose the multi-disciplinary problem to identify critical validation data. All four of the teams demonstrated their process on a sample problem demonstrating the benefit of the process.

Validation↗

Achieving reasonable confidence in the validation of control room designs and modifications: A summary of the 2015 NEA experts' workshop - 124

Defining and achieving reasonable confidence in the validation of nuclear power plant control room designs is a complex challenge for many reasons; not the least of which is that validation is a test of strength rather than a test of truth. In 2015, the Nuclear Energy Agency, Committee for Safety of Nuclear Installations' Working Group on Human and Organizational Factors (WGHOF) hosted an experts' workshop to identify and critically examine potential means to address the challenge of achieving reasonable confidence in control room design validations. The experts' principal task was to answer four challenge questions. (1) What are the critical considerations in defining validation objectives and how do these impact achieving reasonable confidence? (2) What methods, approaches, resources, or rationales might be used for deriving performance requirements, selecting measures, and establishing acceptance criteria so as to support reasonable confidence? (3) What methods might be used to develop scenarios that maximize the amount and relevance of information in support of the validation conclusions and achieving reasonable confidence? (4) How should the validation results be aggregated and analyzed to determine the final validation conclusions? This paper provides an overview of the experts' responses to these challenges and briefly touches upon their implications for future directions. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of Scale 6.2 criticality calculations using KENO V.A and KENO-VI - 14603

SCALE 6.2 provides enhancements for criticality calculations relative to SCALE 6.1, especially with updated nuclear data libraries, resonance self-shielding options for multigroup (MG) calculations, and problem-dependent temperature treatments for continuous-energy (CE) calculations. Benchmark experiments from the International Criticality Safety Benchmark Evaluation Project that are available in the Oak Ridge National Laboratory Verified, Archived, Library of Inputs and Data (VALID) were applied in this validation effort to examine the impact of the SCALE 6.2 enhancements. Over 300 cases are drawn from the VALID library for testing KENO V.a, and a more limited set of approximately 50 configurations is used for validation of KENO-VI. A total of 401 unique critical experiments are used in this validation effort. In some cases, the KENO V.a models were converted to KENO-VI models so that the performance of both codes could be assessed for the same systems. Validation results for the SCALE 6.2 ENDF/B-VII.1 nuclear data libraries are presented, including MG neutron data in 56- and 252-group structures as well as CE data. The performance of all three multipurpose neutron libraries in calculating k{sub eff} is examined with critical experiment models covering a wide range of fuels, moderators, reflectors, absorbers, and neutron spectra. The SCALE 6.2 ENDF/B-VII.1 coupled neutron-photon library, primarily developed for shielding applications with 200 neutron groups and 47 gamma groups, provides additional energy resolution for fast systems relative to the MG neutron libraries which were developed to produce low biases for thermal neutron systems. The applicability of this library to criticality calculations for fast neutron spectrum systems is not investigated here but will be addressed in the final SCALE 6.2 validation report. The results of these calculations demonstrate that SCALE 6.2 generally provides lower biases than SCALE 6.1 and that the two versions of KENO provide equivalent results on the same suite of problems. SCALE 6.2 also includes an updated neutron cross-section covariance library based on the ENDF/B-VII.1 covariance data. The effect of these updated covariances on the uncertainty in k{sub eff} due to cross section uncertainties is also presented for some cases. A more thorough investigation of the updated covariance data is presented in a companion paper. (authors)

42 ENGINEERING↗