Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗

A Metric-Based Validation Process to Assess the Realism of Synthetic Power Grids

Public power system test cases that are of high quality benefit the power systems research community with expanded resources for testing, demonstrating, and cross-validating new innovations. Building synthetic grid models for this purpose is a relatively new problem, for which a challenge is to show that created cases are sufficiently realistic. This paper puts forth a validation process based on a set of metrics observed from actual power system cases. These metrics follow the structure, proportions, and parameters of key power system elements, which can be used in assessing and validating the quality of synthetic power grids. Though wide diversity exists in the characteristics of power systems, the paper focuses on an initial set of common quantitative metrics to capture the distribution of typical values from real power systems. The process is applied to two new public test cases, which are shown to meet the criteria specified in the metrics of this paper.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Ten Years of VIIRS Land Surface Temperature Product Validation

The Visible Infrared Imaging Radiometer Suite (VIIRS) Land Surface Temperature (LST) has been operationally produced for a decade since the Suomi National Polar-orbiting Partnership (SNPP) launched in October 2011. A comprehensive evaluation of its accuracy and precision will be helpful for product users in climate studies and atmospheric models. In this study, the VIIRS LST is validated with ground observations from multiple high-quality radiation networks, including six stations from the Surface Radiation budget (SURFRAD) network, two stations from the Baseline Surface Radiation Network (BSRN), and 13 stations from the Atmospheric Radiation Measurement (ARM) network, to evaluate its performance over various land-cover types. The VNP21A1 LST was validated against the same ground observations as a reference. The results yield a close agreement between the SNPP VIIRS LST and ground LSTs with a bias of -0.4 K and a RMSE of 1.96 K over six SURFRAD sites; a bias of -0.2 K and a RMSE of 1.93 K over two BSRN sites; and a bias of -0.1 K and a RMSE of 1.7 K over the 13 ARM sites. The time series of the LST errors over individual sites indicate seasonal cycles. The data anomaly over the BSRN site in Cabauw and the SURFRAD site in Desert Rock is revealed and discussed in this study. In addition, a method using Landsat-8 data is applied to quantify the heterogeneity level of each ground station and the results provide promising insights. The validation results demonstrate the maturity of the JPSS VIIRS LST products and their readiness for various application studies.

54 ENVIRONMENTAL SCIENCES↗

Development and validation of a two-phase, three-dimensional model for PEM fuel cells.

The objectives of this presentation are: (1) To develop and validate a two-phase, three-dimensional transport modelfor simulating PEM fuel cell performance under a wide range of operating conditions; (2) To apply the validated PEM fuel cell model to improve fundamental understanding of key phenomena involved and to identify rate-limiting steps and develop recommendations for improvements so as to accelerate the commercialization of fuel cell technology; (3) The validated PEMFC model can be employed to improve and optimize PEM fuel cell operation. Consequently, the project helps: (i) address the technical barriers on performance, cost, and durability; and (ii) achieve DOE's near-term technical targets on performance, cost, and durability in automotive and stationary applications.

08 HYDROGEN↗

Validation Study for Crediting Chlorine in Criticality Analyses for Spent Nuclear Fuel Disposition

Spent nuclear fuel (SNF) management practices in the United States rely on dry storage systems that include both canister- and cask-based systems. The United States Department of Energy Used Fuel Disposition Campaign is examining the feasibility of direct disposal of dual-purpose (storage and transportation) canisters (DPCs) in a geological repository. One of the major technical challenges for direct disposal is the ability to demonstrate the subcriticality of the DPCs loaded with SNF for the repository performance period (e.g., 10,000 years or more) as the DPCs may undergo degradation over time. Specifically, groundwater ingress into the DPC (i.e., flooding) could allow the system to achieve criticality in scenarios where the neutron absorber plates in the DPC basket have degraded. However, as was shown by Banerjee et al., some aqueous species in the groundwater provide noticeable reactivity reduction for these systems. For certain amounts of particular aqueous species (e.g., chlorine, lithium) in the groundwater, subcriticality can be demonstrated even for DPCs with complete degradation of the neutron absorber plates or a degraded fuel basket configuration. It has been demonstrated that chlorine is the leading impurity, as indicated by significant neutron absorption in the water that is available in reasonable quantities for the deep geological repository media under consideration. This paper presents the results of an investigation of the available integral experiments worldwide that could be used to validate DPC disposal criticality evaluations, including credit for chlorine. Due to the small number of applicable critical configurations, validation through traditional trending analysis was not possible. The bias in the eigenvalue of the application systems due only to the chlorine was calculated using TSURFER analysis and found to be on the order of 100 percent mille (1 pcm = 10 -5 k eff ). This study investigated the design of a series of critical configurations with varying amounts of chlorine to address validation gaps. Such integral experiments would support the crediting of the chlorine neutron-absorption properties in groundwater and the demonstration of subcriticality for DPCs in deep geologic repositories with sufficient chlorine availability.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Verification and Validation of Multisegmented Mooring Capabilities in FAST v8: Preprint

The quasi-static and dynamic mooring modules of the open-source aero-hydro-servo-elastic wind turbine simulation software, FAST v8, have previously been verified and validated, but only for mooring arrangements consisting of single lines connecting each fairlead and anchor. This paper extends the previous verification and validation efforts to focus on the multisegmented mooring capability of the FAST v8 modules: MAP++, MoorDyn, and the OrcaFlex interface. The OC3-Hywind spar buoy system tested by the DeepCwind consortium at the MARIN ocean basin, which includes a multisegmented bridle layout of the mooring system, was used for the verification and validation activities.

17 WIND ENERGY↗

Verification and Validation of Multisegmented Mooring Capabilities in FAST v8

The quasi-static and dynamic mooring modules of the open-source aero-hydro-servo-elastic wind turbine simulation software, FAST v8, have previously been verified and validated, but only for mooring arrangements consisting of single lines connecting each fairlead and anchor. This paper extends the previous verification and validation efforts to focus on the multisegmented mooring capability of the FAST v8 modules: MAP++, MoorDyn, and the OrcaFlex interface. The OC3-Hywind spar buoy system tested by the DeepCwind consortium at the MARIN ocean basin, which includes a multisegmented bridle layout of the mooring system, was used for the verification and validation activities.

17 WIND ENERGY↗

Computational Fluid Dynamics Modeling of Bubbling in a Viscous Fluid for Validation of Waste Glass Melter Modeling

At the Hanford site, radioactive waste stored in underground tanks is slated for vitrification for final disposal. A comprehensive knowledge of the glass batch melting process will be useful in optimizing the process, which could potentially reduce the cost and duration of this multi-billion dollar cleanup effort. We are developing a high-fidelity heat transfer model of a Joule-heated ceramic lined melter to improve the understanding of the complex, inter-related processes occurring with the melter. The glass conversion rates in the cold cap layer are dependent on promoting efficient heat transfer. In practice, heat transfer is augmented by inserting air bubblers into the molten glass. However, the computational simulations must be validated to provide confidence in the solutions. As part of a larger validation procedure, it is beneficial to split the physics of the melter into smaller systems to validate individually. The substitution of molten glass for a simulant liquid with similar density and viscosity at room temperature provides a way to study mixing through bubbling as an isolated effect without considering the heat transfer dynamics. The simulation results are compared to experimental data obtained by the Vitreous State Laboratory at the Catholic University of America using bubblers placed within a large acrylic tank that is similar in scale to a pilot glass waste melter. Comparisons are made for surface area of the rising air bubbles between experiments and CFD simulations for a variety of air flow rates and bubble injection depths. Also, computed bubble rise velocity is compared to a well-accepted expression for bubble terminal velocity.

bubbling↗

Validation and Bias Quantification of Criticality Safety Codes for SRNS Operations

The validation and bias quantification methods employed by the Criticality Safety Engineering group at Savannah River Nuclear Solutions are discussed. Both SCALE and MCNP are validated against benchmark experiments, where these benchmark models have been divided into subgroups representative of the types of fissile material operations at SRNS. A quantification of the bias is made for each subgroup for each code and the three methods employed for quantification are discussed. The bias information is employed directly in the establishment of the Upper Safety Limit (USL) value of the neutron multiplication factor when using standardized documented SRNS methods. A simple example of validation and bias quantification is given and the procedure for setting the USL using the derived bias information is also presented.

97 MATHEMATICS AND COMPUTING↗

BISON Validation for LOCA and PCMI Behaviour Using Measurements From the Halden Reactor Project

BISON is a finite element-based nuclear fuel performance code that has been under development at Idaho National Laboratory (INL) since 2009. The code is applicable to both steady and transient fuel behavior and has been used to analyze a variety of fuel forms in 1D spherical, 1.5D and 2D axisymmetric, or 3D geometries. Efforts are underway to validate BISON for application to Light Water Reactor fuels using, to a large extent, experimental data from the Halden Reactor Project. Recent validation activities have included both Loss of Coolant Accident (LOCA) and Pellet Clad Mechanical Interaction (PCMI) experiments. Two such validation cases, the IFA-650.10 LOCA test and the IFA-629.4 power ramp test (PCMI), are summarized in this paper.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Structural Validation at the NWTC Helps Improve Component Design and Increase System Reliability

Since 1990, the National Wind Technology Center (NWTC) at the National Renewable Energy Laboratory (NREL) has validated more than 150 wind turbine blades, as well as blades and components for marine energy devices. Researchers at the NWTC can experimentally validate full-scale and subcomponent articles, conduct data analyses, and provide engineering expertise to optimize design practices. Structural evaluation of turbine blades enables designers, manufacturers, and owner operators t o assess designs and structural performance under specific extreme loading and dynamic conditions. Rigorous structural validation can reveal design and manufacturing problems at an early state of development that lead to improvements in component design and increase system reliability.

17 WIND ENERGY↗

Validation of RELAP5-3D He-FUS3 Data

The RELAP5-3D computer code was validated using data from the HE FUS3 experimental facility. HE FUS3 is a helium-cooled, electrically-heated experimental facility that was used to generate experimental data for a benchmark exercise aimed at the validation of system transient analysis codes for very-high-temperature gas reactor applications. RELAP5-3D was validated using results from seven steady-state tests and one transient that simulated a loss-of-flow accident.

97 MATHEMATICS AND COMPUTING↗

Validation Studies using ELK and the Open-Source MOOSE Framework Application Zapdos for Electromagnetic Coupled Plasma Simulation

An open source simulation platform that captures electromagnetics, plasma chemistry, and fluid treatment of the plasma domain would be a powerful tool for studying low temperature plasma (LTP) phenomena. Within the Multiphysics Object-Oriented Simulation Environment (MOOSE) open source framework, ELK, CRANE, and Zapdos are combined to provide open source simulation capability for the LTP community. This talk presents continued validation of the general electromagnetic (EM) simulation tool ELK (Electromagnetic Library for Kinetics & fluids). Previous validation efforts focused on simulating standard waveguide and antenna benchmarks in vacuum and linear dielectrics, but ELK has since been coupled with the MOOSE-based plasma fluid application Zapdos [Lindsay et al 2016 J. Phys. D: Appl. Phys. 49 235204] to perform radio-frequency (rf) capacitively coupled plasma (CCP) system simulation. Plasma validation efforts initially focused on electrostatic benchmarks to demonstrate ELK-Zapdos code coupling and then moved to electromagnetic benchmarks based on interesting geometries and conditions (VHF effects in a CCP reactor, microwave heating, etc.). Results and progress in these efforts will be summarized and discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validation of Oregon State University High Temperature Test Facility Experiments Using Pronghorn

The OSU High Temperature Test Facility is a quarter-scale diameter, 1/64 scale volume test facility meant to replicate thermophysical phenomena in the prototypical General Atomics Modular High Temperature Gas Reactor. Tests pertaining to conduction cooldown events were performed from 2016-2019, providing a large database by which computational methods that are applicable to different length scales can be validated. One of these codes is Pronghorn, which is a coarse-meshed, porous-based subchannel thermal hydraulics code based on the MOOSE application, with the intention of better capturing the physics of both conduction and convection heat transfer within the OSU HTTF core. The goal of this summer project is to develop the framework by which Pronghorn can perform validation exercises of the HTTF core for benchmarking, by generating a mesh appropriate to the geometry of the HTTF core, developing input decks that accurately capture the initial and boundary conditions, materials, and relevant equations to the physics seen in the HTTF core, and using a postprocessor to compare simulation results to various experimental data. While validation of codes is a multi-year project, a mesh has been generated and tested in Pronghorn that meets mass conservation and basic heat transfer principles. The next step is to accurate depict the fluid inlet and outlet boundary conditions, which will be performed using computational fluid dynamics software.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Conducting Field Validations of Commercial Energy Efficiency Technologies with Underserved Communities: Preprint

Underserved communities in the United States often experience the negative impacts of climate change and environmental degradation but enjoy few of the benefits of technological and environmental advances. The White House has addressed this inequity through the Justice40 initiative, which requires 40% of the benefits of select federal investments to be directed to underserved communities (The White House, 2022). Clean energy and energy efficiency are two highlighted investment categories, so the U.S. Department of Energy will guide implementation of the Justice40 initiative by, among other things, decreasing energy burdens, increasing parity in clean energy technology access and adoption, and increasing energy resiliency. A strategy for reaching these goals is to evaluate and validate new energy efficiency technologies in commercial buildings in underserved communities, where buildings may be older, smaller, and have deferred maintenance due to historical underinvestment. This paper assesses the proficiency of the technologies under these conditions and increases awareness of the benefits to the communities. In addition, historical redlining and past negative experiences with government and large institutions may make residents wary of participating in these field validations. Researchers, therefore, may need to spend more time building relationships and matching technologies to buildings. In this paper, we analyzed technical reports to identify common required and desired field validation building characteristics, and conducted semi-structured expert conversations to identify key stages and major themes of engaging underserved communities. Our results indicate that the benefits to both the community and energy efficiency research justify the effort. The White House. (2022). Justice40. https://www.whitehouse.gov/environmentaljustice/justice40/

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

Validation of the U.S. NRC coupled code system TRITON/TRACE/PARCS with the special power excursion reactor test III (SPERT III)

The Special Power Excursion Reactor Test III (SPERT III) was a series of reactivity insertion experiments conducted in the 1950's. This paper describes the validation of the U.S. NRC Coupled Code system TRITON/PARCS/TRACE to simulate reactivity insertion accidents (RIA) by using several of the SPERT III tests. The work here used the SPERT III E-core configuration tests in which the RIA was initiated by ejecting a control rod. The resulting super-prompt reactivity excursion and negative reactivity feedback produced the familiar bell shaped power increase and decrease. The energy deposition during such a power peak has important safety consequences and provides validation basis for core coupled multi-physics codes. The transients of five separate tests are used to benchmark the PARCS/TRACE coupled code. The models were thoroughly validated using the original experiment documentation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reactivity loss validation of high burn-up PWR fuels with pile-oscillation experiments in MINERVE

The ALIX experimental program relies on the experimental validation of the spent fuel inventory, by chemical analysis of samples irradiated in a PWR between 5 and 7 cycles, and also on the experimental validation of the spent fuel reactivity loss with bum-up, obtained by pile-oscillation measurements in the MINERVE reactor. These latter experiments provide an overall validation of both the fuel inventory and of the nuclear data responsible for the reactivity loss. This program offers also unique experimental data for fuels with a burn-up reaching 85 GWd/t, as spent fuels in French PWRs never exceeds 70 GWd/t up to now. The analysis of these experiments is done in two steps with the APOLLO2/SHEM-MOC/CEA2005v4 package. In the first one, the fuel inventory of each sample is obtained by assembly calculations. The calculation route consists in the self-shielding of cross sections on the 281 energy group SHEM mesh, followed by the flux calculation by the Method Of Characteristics in a 2D-exact heterogeneous geometry of the assembly, and finally a depletion calculation by an iterative resolution of the Bateman equations. In the second step, the fuel inventory is used in the analysis of pile-oscillation experiments in which the reactivity of the ALIX spent fuel samples is compared to the reactivity of fresh fuel samples. The comparison between Experiment and Calculation shows satisfactory results with the JEFF3.1.1 library which predicts the reactivity loss within 2% for burn-up of {approx}75 GWd/t and within 4% for burn-up of {approx}85 GWd/t. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmark for evaluation and validation of reactor simulations (BEAVRS)

Advances in parallel computing have made possible the development of high-fidelity tools for the design and analysis of nuclear reactor cores, and such tools require extensive verification and validation. This paper introduces BEAVRS, a new multi-cycle full-core Pressurized Water Reactor (PWR) depletion benchmark based on two operational cycles of a commercial nuclear power plant that provides a detailed description of fuel assemblies, burnable absorbers, in-core fission detectors, core loading patterns, and numerous in-vessel components. This benchmark enables analysts to develop extremely detailed reactor core models that can be used for testing and validation of coupled neutron transport, thermal-hydraulics, and fuel isotopic depletion. The benchmark also provides measured reactor data for Hot Zero Power (HZP) physics tests, boron letdown curves, and three-dimensional in-core flux maps from fifty-eight instrumented assemblies. Initial comparisons between calculations performed with MIT's OpenMC Monte Carlo neutron transport code and measured cycle 1 HZP test data are presented, and these results display an average deviation of approximately 100 pcm for the various critical configurations and control rod worth measurements. Computed HZP radial fission detector flux maps also agree reasonably well with the available measured data. All results indicate that this benchmark will be extremely useful in validation of coupled-physics codes and uncertainty quantification of in-core physics computational predictions. The detailed BEAVRS specification and its associated data package is hosted online at the MIT Computational Reactor Physics Group web site (http://crpg.mit.edu/), where future revisions and refinements to the benchmark specification will be made publicly available. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗