Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Shift Verification and Validation

This documentation outlines the verification and validation of Shift for the Consortium for Advanced Simulation of Light Water Reactors (CASL). Five main types of problems were used for validation: small criticality benchmark problems; full-core reactor benchmarks for light water reactors; fixed-source coupled neutron-photon dosimetry benchmarks; depletion/burnup benchmarks; and full-core reactor performance benchmarks. We compared Shift results to measured data and other simulated Monte Carlo radiation transport code results, and found very good agreement in a variety of comparison measures. These include prediction of critical eigenvalue, radial and axial pin power distributions, rod worth, leakage spectra, and nuclide inventories over a burn cycle. Based on this validation of Shift, we are confident in Shift to provide reference results for CASL benchmarking.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2017

Validation of Material Models For Automotive Carbon Fiber Composite Structures Via Physical And Crash Testing (VMM Composites Project)

As automotive fuel economy requirements increase, the push for reducing overall vehicle weight will likely include the consideration of materials that have not previously been part of mainstream vehicle design and manufacturing, including carbon fiber composites. Vehicle manufacturers currently rely on computer-aided engineering (CAE) methods as part of the design and development process, so going forward, the ability to accurately and predictably model carbon fiber composites will be necessary. If composites are to be used for structural components, this need applies to both, crash and quasi-static modeling. This final report covers the results of a five-year, $6.89M, 50% cost-shared research project between Department of Energy (DOE) and the US Advanced Materials Partnership (USAMP) under Cooperative Agreement DE-EE-0005661 known as “Validation of Material Models for Automotive Carbon Fiber Composite Structures Via Physical and Crash Testing (VMM).” The objective of the VMM Composites Project was to validate and assess the ability of physics-based material models to predict crash performance of automotive primary load-carrying carbon fiber composite structures. Simulation material models that were evaluated included micro-mechanics based meso-scale models developed by the University of Michigan (UM) and micro-plane models by Northwestern University (NWU) under previous collaborations with the DOE and Automotive Composites Consortium/USAMP, as well as five commercial crash codes: LS-DYNA, RADIOSS, VPS/PAM-CRASH, Abaqus, and GENOA-MCQ. CAE predictions obtained from seven organizations were compared with experimental results from quasi-static testing and dynamic crash testing of a thermoset carbon fiber composite front-bumper and crush-can (FBCC) system gathered under multiple loading conditions. This FBCC design was developed to demonstrate progressive crush, virtual simulation, tooling, fabrication, assembly, non-destructive evaluation and crash testing advances in order to assess the correlation of the predicted results to the physical tests. The FBCC was developed to meet a goal of 30-35% mass reduction while aiming for equivalent energy absorption as a steel component for which baseline experimental results were obtained from testing in the same crash modes. The project also evaluated crash performance of thermoplastic composite structures fabricated from commercial prepreg materials and low cost carbon fiber sourced from Oak Ridge National Laboratory. The VMM Project determined that no set of predictions from a CAE supplier were found to be universally accurate among all the six crash modes evaluated. In general, crash modes that were most dependent on the properties of the prepreg were more accurate than those that were dependent on the behavior of the joints. The project found that current CAE modeling methods or best practices for carbon fiber composites have not achieved standardization, and accuracy of CAE is highly reliant on the experience of its users. Coupon tests alone are not sufficient to develop an accurate material model, but it is necessary to bridge the gap between the coupon data and performance of the actual structure with a series of subcomponent level tests. Much of the unreliability of the predictions can be attributed to shortcomings in our ability to mathematically link the effects of manufacturing and material variability into the material models. This is a subject of ongoing research in the industry. The final report is organized by key technical tasks to describe how the validation project developed, modeled and compared crash data obtained on the composite FBCC to the multiple sets of CAE predictions. Highlights of the report include a discussion of the quantitative comparison between predictions and experimental data, as well as an in-depth discussion of remaining technological gaps that exist in the industry, which are intended to spur innovations and improvements in CAE technology.

36 MATERIALS SCIENCE↗
DOE OSTI2016

CASL Verification and Validation Plan

This report documents the Consortium for Advanced Simulation of LWRs (CASL) verification and validation plan. The document builds upon input from CASL subject matter experts, most notably the CASL Challenge Problem Product Integrators, CASL Focus Area leaders, and CASL code development and assessment teams. This document will be a living document that will track progress on CASL to do verification and validation for both the CASL codes (including MPACT, CTF, BISON, MAMBA) and for the CASL challenge problems (CIPS, PCI, DNB). The CASL codes and the CASL challenge problems are at differing levels of maturity with respect to validation and verification. The gap analysis will summarize additional work that needs to be done. Additional VVUQ work will be done as resources permit. This report is prepared for the Department of Energy’s (DOE’s) CASL program in support of milestone CASL.P13.02.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2019

Experimental Validation of MCNP Models for PINS Shadow Shield Mockups

MCNP has been regarded as an indispensable tool in development of radiation detection systems, and it is cost effective, thanks to advances in computing power, to simulate various conceptual designs without even fabricating them. Development of various PINS systems have also benefited from MCNP modeling and simulation. MCNP models of PINS systems have been frequently used to understand detector responses and to fill the gap in experimental data. Recently, a backpack version PINS system was announced to be developed. When the neutron generator and the HPGe detector are built by external vendors, the shadow shield is the component to be designed to maximize the performance while meeting the sponsor’s requirements. In order to utilize MCNP modeling and simulation to find the best specification of the shadow shield, a campaign of PINS lab measurements with a few shadow shield mockups has been conducted to validate MCNP simulation results. This study is intended to validate MCNP simulations and models in preparation of another more extensive simulation study. Validation of neutron flux is also discussed later in this report even though neutron counts were not measured experimentally.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

SAM Code Validation on Frictional Pressure Drop through Pebble Beds

The System Analysis Module (SAM) is currently under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for safety analyses of advanced non-light water reactors. This report presents a recent effort to validate the capability of SAM to predict the frictional pressure drop through pebble beds. Selected experimental data were used for code validation, including data from test facilities at Texas A&M University, Missouri University of Science and Technology, and North-West University of South Africa. SAM implements three empirical correlations to predict frictional pressure drop: the classical Ergun correlation; the KTA correlation, which is widely used in high-temperature gas-cooled reactor applications; and the Eisfeld and Schnitzlein correlation, which explicitly considers wall effect. Code validation was performed using all three correlations. For all selected experimental data, the KTA correlation shows the best performance and agrees very well with experimental measurement; the Eisfeld and Schnitzlein correlation, explicitly considering wall effects, shows acceptable accuracy, while there is no evidence that it is better than the KTA correlation; the Ergun correlation, however, over-predicts frictional pressure drop for most selected data points.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Updated Gadolinium Validation in SCALE 6.3.0 using ENDF/B-VIII.0 Data [Slides]

This presentation provides a brief recap of the ANS Summer meeting in 2018 with a discussion of the results. The presentation also provides an overview of new models and states that all new models have been checked but have not yet been added to the VALID library. It also states that the models were originally created as part of a master's thesis or summer internships. Additionally, all models have been rerun in SCALE 6.3.0 using CE ENDF/B-VIII.0 library. In conclusion, this project has facilitated a significant expansion of validation set containing gadolinium, including 13 cases previously in VALID plus 99 new cases. The completion of IPPE HST experiments confirm no clear trend as a function of concentration or spectrum. Solid absorber cases also show no clear trends and LANL HMT experiments have significant discrepancies in Gd alloy cases. While almost half of the total gadolinium-bearing cases from the ICSBEP Handbook are considered here, the presentation recognizes that there is more work to be done.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Expansion of the Verified, Archived, Library of Inputs and Data (VALID) [Slides]

This project dialogue provides an update on the Expansion of Verified, Archived, Library of Inputs and Data or VALID. VALID is a QA-Like (Quality Assurance) process to generate high quality models from reliable reference descriptions and make those models available to users. This presentation provides a brief project overview, a reminder of cases added in FY2021, cases currently in progress, and future plans for VALID.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Validation and Verification of TEDS Facility HYBRID Modeling

The HYBRID modeling repository is an in-house developed library of models for selected integrated energy systems (IES) modelling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Here, validation and verification (V&V) capabilities are demonstrated using the Thermal Energy Distribution System (TEDS) at INL. Building upon prior work, the TEDS model has been updated and verified so that it better represents the installed system configuration and the operating control system. The model control system was changed to allow replication of actual experimental procedures. Experimental operations focusing primarily on thermocline tank performance were devised and performed. Several anomalies were found in the operation data of the experiment facility. V&V activities calibrating a selected input parameter are demonstrated on a single component as well as with a single parameter within the thermocline. Calibrating is then demonstrated on multiple components and a multi-parameter metric for the entire system. The validation methodology is successfully applied to validate the model with experimental data. It is also used to confirm a hypothesis behind one of the anomalies in experimental performance.

25 ENERGY STORAGE↗
DOE OSTI2023

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2013

Performance Test and Validation Evaluation for the Neutron Slab Counter

This Performance Testing and Validation Evaluation (PTVE) reviews and analyzes the data collected with the Neutron Slab Counter (NSC) according to the Performance Test and Validation Plan (PTVP, UCOR-4443) and reported in the NSC Performance Test and Validation Report (PTVR, NDA-13-0622). The NSC was designed for quantitative Nondestructive Assay (NDA) measurements of compressor volutes from the K25/K27 Buildings. The NSC PTVP (UCOR-4443) prescribed a methodology and set of field measurements to determine the NSC system efficiency, calibrate the system, perform verification measurements, define the components of the system's total measurement uncertainty, and perform a calibration confirmation measurement. All of the required measurements of the NSC PTVP (UCOR-4443) were completed according to the Calibration of NDA Equipment Procedure (PROC-DE-0714) and the Quantitative Measurements Using the Neutron Slab Counter Procedure (PROC-DE-0723). Following the completion of this PTVE, if the data quality objectives (DQO) of the NSC PTVP (UCOR-4443) are met, a commissioning report will be prepared which specifies the limits of use of the NSC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Improving Residential Building Simulations Through Large-Scale Empirical Validation

Residential building energy simulations are increasingly used for energy-efficient building design, codes and standards analysis, home certifications and ratings, utility programs, and technology assessments. Various software tools exist to perform residential building simulations, and these tools often use different models, inputs, and assumptions. This leads to inconsistencies that can undermine confidence in the predicted results. Validation of these tools can increase confidence by ensuring their accuracy and consistency. One way to validate simulation tools is through empirical testing, which compares predicted energy usage to measured utility billing data. This paper describes the process of data collection, data standardization, and empirical validation, and illustrates its use with our residential EnergyPlus (R)-based software. The data and process can be extended to other simulation tools and contribute to improving residential building simulations more broadly.

empirical validation↗
DOE OSTI2021

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗
DOE OSTI2022

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2017

A Metric-Based Validation Process to Assess the Realism of Synthetic Power Grids

Public power system test cases that are of high quality benefit the power systems research community with expanded resources for testing, demonstrating, and cross-validating new innovations. Building synthetic grid models for this purpose is a relatively new problem, for which a challenge is to show that created cases are sufficiently realistic. This paper puts forth a validation process based on a set of metrics observed from actual power system cases. These metrics follow the structure, proportions, and parameters of key power system elements, which can be used in assessing and validating the quality of synthetic power grids. Though wide diversity exists in the characteristics of power systems, the paper focuses on an initial set of common quantitative metrics to capture the distribution of typical values from real power systems. The process is applied to two new public test cases, which are shown to meet the criteria specified in the metrics of this paper.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Ten Years of VIIRS Land Surface Temperature Product Validation

The Visible Infrared Imaging Radiometer Suite (VIIRS) Land Surface Temperature (LST) has been operationally produced for a decade since the Suomi National Polar-orbiting Partnership (SNPP) launched in October 2011. A comprehensive evaluation of its accuracy and precision will be helpful for product users in climate studies and atmospheric models. In this study, the VIIRS LST is validated with ground observations from multiple high-quality radiation networks, including six stations from the Surface Radiation budget (SURFRAD) network, two stations from the Baseline Surface Radiation Network (BSRN), and 13 stations from the Atmospheric Radiation Measurement (ARM) network, to evaluate its performance over various land-cover types. The VNP21A1 LST was validated against the same ground observations as a reference. The results yield a close agreement between the SNPP VIIRS LST and ground LSTs with a bias of -0.4 K and a RMSE of 1.96 K over six SURFRAD sites; a bias of -0.2 K and a RMSE of 1.93 K over two BSRN sites; and a bias of -0.1 K and a RMSE of 1.7 K over the 13 ARM sites. The time series of the LST errors over individual sites indicate seasonal cycles. The data anomaly over the BSRN site in Cabauw and the SURFRAD site in Desert Rock is revealed and discussed in this study. In addition, a method using Landsat-8 data is applied to quantify the heterogeneity level of each ground station and the results provide promising insights. The validation results demonstrate the maturity of the JPSS VIIRS LST products and their readiness for various application studies.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2005

Assessing Technology Maturity for ST-9 Technology Validation Experiments

This viewgraph presentation reviews the process of assessing the maturity of a technology for use in NASA missions. The NASA New Millennium Program (NMP) identifies and flight validates breakthrough technologi es that will significantly benefit future operational Space and Earth Science missions NMP conducts two types of flight validation projec ts for the Space Science Enterprise: (1) Integrated System Validatio n Projects, and (2) Stand-Alone Subsystem Validation Projects.

Space Technology (ST) 9↗