Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Inverter Model Validation and Calibration Using Phasor Measurement Unit Data

As the penetration of inverter-based renewable energy resources increases in the power grid, especially at the distribution and microgrid levels, the need to accurately represent them in planning studies increases as well. However, due to the lack of well-established standard procedures, and vendor reluctance towards the detailed sharing of proprietary models, automated dynamic model validation and parameter calibration tools for inverter based resources (IBRs) remain scarce. This work presents a model validation and parameter calibration platform for representing IBRs with generic phasor-domain models. Phasor measurements of power system events are used for continuous validation using the data playback method, and model parameters are re-calibrated if a significant mismatch between measurements and model response is observed. Unique features of the proposed platform include- (a) an iterative Bayesian optimization approach towards parameter calibration to address a possible mismatch between the structures of generic models implemented in simulation softwares and actual commercial inverters, (b) error metrics designed to account for a possible mismatch between the time resolution of simulation and measurements, and (c) analysis of the measurement-simulation mismatch to provide guidance to engineering personnel regarding model shortcomings. The performance of the platform has been illustrated using both simulated data and field measurements to validate/calibrate inverter models in GridLAB-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

A Hybrid Heavy Duty Diesel Power System for Off-Road Applications—Concept Validation

A multiyear power system R&D program was completed with the objective of developing an off-road hybrid heavy duty diesel engine with front end accessory drive-integrated energy storage. This system was validated to deliver 10.5–25.6% reduction in fuel consumption over current Tier 4 Final-based 18L diesel engines, over various off-road machine application cycles. The power system consisted of a downsized heavy-duty diesel 13L engine containing advanced combustion technologies, capable of elevated peak cylinder pressures and thermal efficiencies, thermal barrier coatings, exhaust waste heat recovery via SuperTurbo™ turbocompounding, and hybrid energy assisting and recovery through both mechanical and electrical systems. Following the concept definition, design, and analysis phases of the program, the final phase focused on building and validating the performance and efficiency in laboratory tests. While aspects of the system such as start/stop and reduced off-road cooling package energy losses were only analytically evaluated, the main 13L concept engine with full hybrid system was successfully built and tested in steady-state and in transient certification and real-world application cycles. Extensive simulations in Caterpillar's DYNASTY™ software environment utilized the validation test data to assess performance more fully and confidently over varied cycles and strategies. An average fuel consumption reduction of 17.9% was realized, and the majority (~13%) of the benefit stemmed from the core concept 13L engine. In conclusion, a total cost of ownership analysis provides context to commercial viability and where adoption focus should be placed.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

SAM Code Validation on Frictional Pressure Drop through Pebble Beds

The System Analysis Module (SAM) is currently under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for safety analyses of advanced non-light water reactors. This report presents a recent effort to validate the capability of SAM to predict the frictional pressure drop through pebble beds. Selected experimental data were used for code validation, including data from test facilities at Texas A&M University, Missouri University of Science and Technology, and North-West University of South Africa. SAM implements three empirical correlations to predict frictional pressure drop: the classical Ergun correlation; the KTA correlation, which is widely used in high-temperature gas-cooled reactor applications; and the Eisfeld and Schnitzlein correlation, which explicitly considers wall effect. Code validation was performed using all three correlations. For all selected experimental data, the KTA correlation shows the best performance and agrees very well with experimental measurement; the Eisfeld and Schnitzlein correlation, explicitly considering wall effects, shows acceptable accuracy, while there is no evidence that it is better than the KTA correlation; the Ergun correlation, however, over-predicts frictional pressure drop for most selected data points.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Updated Gadolinium Validation in SCALE 6.3.0 using ENDF/B-VIII.0 Data [Slides]

This presentation provides a brief recap of the ANS Summer meeting in 2018 with a discussion of the results. The presentation also provides an overview of new models and states that all new models have been checked but have not yet been added to the VALID library. It also states that the models were originally created as part of a master's thesis or summer internships. Additionally, all models have been rerun in SCALE 6.3.0 using CE ENDF/B-VIII.0 library. In conclusion, this project has facilitated a significant expansion of validation set containing gadolinium, including 13 cases previously in VALID plus 99 new cases. The completion of IPPE HST experiments confirm no clear trend as a function of concentration or spectrum. Solid absorber cases also show no clear trends and LANL HMT experiments have significant discrepancies in Gd alloy cases. While almost half of the total gadolinium-bearing cases from the ICSBEP Handbook are considered here, the presentation recognizes that there is more work to be done.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Expansion of the Verified, Archived, Library of Inputs and Data (VALID) [Slides]

This project dialogue provides an update on the Expansion of Verified, Archived, Library of Inputs and Data or VALID. VALID is a QA-Like (Quality Assurance) process to generate high quality models from reliable reference descriptions and make those models available to users. This presentation provides a brief project overview, a reminder of cases added in FY2021, cases currently in progress, and future plans for VALID.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Validation and Verification of TEDS Facility HYBRID Modeling

The HYBRID modeling repository is an in-house developed library of models for selected integrated energy systems (IES) modelling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Here, validation and verification (V&V) capabilities are demonstrated using the Thermal Energy Distribution System (TEDS) at INL. Building upon prior work, the TEDS model has been updated and verified so that it better represents the installed system configuration and the operating control system. The model control system was changed to allow replication of actual experimental procedures. Experimental operations focusing primarily on thermocline tank performance were devised and performed. Several anomalies were found in the operation data of the experiment facility. V&V activities calibrating a selected input parameter are demonstrated on a single component as well as with a single parameter within the thermocline. Calibrating is then demonstrated on multiple components and a multi-parameter metric for the entire system. The validation methodology is successfully applied to validate the model with experimental data. It is also used to confirm a hypothesis behind one of the anomalies in experimental performance.

25 ENERGY STORAGE↗
DOE OSTI2023

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Improving Residential Building Simulations Through Large-Scale Empirical Validation

Residential building energy simulations are increasingly used for energy-efficient building design, codes and standards analysis, home certifications and ratings, utility programs, and technology assessments. Various software tools exist to perform residential building simulations, and these tools often use different models, inputs, and assumptions. This leads to inconsistencies that can undermine confidence in the predicted results. Validation of these tools can increase confidence by ensuring their accuracy and consistency. One way to validate simulation tools is through empirical testing, which compares predicted energy usage to measured utility billing data. This paper describes the process of data collection, data standardization, and empirical validation, and illustrates its use with our residential EnergyPlus (R)-based software. The data and process can be extended to other simulation tools and contribute to improving residential building simulations more broadly.

empirical validation↗
DOE OSTI2021

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗
DOE OSTI2022

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Ten Years of VIIRS Land Surface Temperature Product Validation

The Visible Infrared Imaging Radiometer Suite (VIIRS) Land Surface Temperature (LST) has been operationally produced for a decade since the Suomi National Polar-orbiting Partnership (SNPP) launched in October 2011. A comprehensive evaluation of its accuracy and precision will be helpful for product users in climate studies and atmospheric models. In this study, the VIIRS LST is validated with ground observations from multiple high-quality radiation networks, including six stations from the Surface Radiation budget (SURFRAD) network, two stations from the Baseline Surface Radiation Network (BSRN), and 13 stations from the Atmospheric Radiation Measurement (ARM) network, to evaluate its performance over various land-cover types. The VNP21A1 LST was validated against the same ground observations as a reference. The results yield a close agreement between the SNPP VIIRS LST and ground LSTs with a bias of -0.4 K and a RMSE of 1.96 K over six SURFRAD sites; a bias of -0.2 K and a RMSE of 1.93 K over two BSRN sites; and a bias of -0.1 K and a RMSE of 1.7 K over the 13 ARM sites. The time series of the LST errors over individual sites indicate seasonal cycles. The data anomaly over the BSRN site in Cabauw and the SURFRAD site in Desert Rock is revealed and discussed in this study. In addition, a method using Landsat-8 data is applied to quantify the heterogeneity level of each ground station and the results provide promising insights. The validation results demonstrate the maturity of the JPSS VIIRS LST products and their readiness for various application studies.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2005

Assessing Technology Maturity for ST-9 Technology Validation Experiments

This viewgraph presentation reviews the process of assessing the maturity of a technology for use in NASA missions. The NASA New Millennium Program (NMP) identifies and flight validates breakthrough technologi es that will significantly benefit future operational Space and Earth Science missions NMP conducts two types of flight validation projec ts for the Space Science Enterprise: (1) Integrated System Validatio n Projects, and (2) Stand-Alone Subsystem Validation Projects.

Space Technology (ST) 9↗
NASA NTRS2007

Thermal Design Validation of the Mars Scout Phoenix Payload

This slide presentation reviews the validation of the thermal design for the Mars Scout Phoenix Payload. It includes a description of the Phoenix Mission, the science objectives, the timeline, and the flight system and payloads that were on the lander. The initial responsibility for the development and validation the thermal design was with the developers. This process lacked overall system engineering, there was a difference of thermal expertise, and the number of institutions involved complicated the interactions. The revised approach for payload thermal design validation is described.

thermal design validation↗
NASA NTRS2014

Retrieval, Inter-Comparison, and Validation of Above-Cloud Aerosol Optical Depth from A-train Sensors

Absorbing aerosols produced from biomass burning and dust outbreaks are often found to overlay lower level cloud decks and pose greater potentials of exerting positive radiative effects (warming) whose magnitude directly depends on the aerosol loading above cloud, optical properties of clouds and aerosols, and cloud fraction. Recent development of a 'color ratio' (CR) algorithm applied to observations made by the Aura/OMI and Aqua/MODIS constitutes a major breakthrough and has provided unprecedented maps of above-cloud aerosol optical depth (ACAOD). The CR technique employs reflectance measurements at TOA in two channels (354 and 388 nm for OMI; 470 and 860 nm for MODIS) to retrieve ACAOD in near-UV and visible regions and aerosol-corrected cloud optical depth, simultaneously. An inter-satellite comparison of ACAOD retrieved from NASA's A-train sensors reveals a good level of agreement between the passive sensors over the homogeneous cloud fields. Direct measurements of ACA such as carried out by the NASA Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) can be of immense help in validating ACA retrievals. We validate the ACA optical depth retrieved using the CR method applied to the MODIS cloudy-sky reflectance against the airborne AATS and 4STAR measurements. A thorough search of the historic AATS-4STAR database collected during different field campaigns revealed five events where biomass burning, dust, and wildfire-emitted aerosols were found to overlay lower level cloud decks observed during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS- 2013, respectively. The co-located satellite-airborne measurements revealed a good agreement (RMSE less than 0.1 for AOD at 500 nm) with most matchups falling within the estimated uncertainties in the MODIS retrievals. An extensive validation of satellite-based ACA retrievals requires equivalent field measurements particularly over the regions where ACA are often observed from satellites, i.e., south-eastern Atlantic Ocean, tropical Atlantic Ocean, northern Arabian Sea, South-East and North-East Asia.

validation↗
NASA NTRS2014

Integrated Medical Model Verification, Validation, and Credibility

The Integrated Medical Model (IMM) was designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic (stochastic process) model based on historical data, cohort data, and subject matter expert opinion. A probabilistic approach is taken since exact (deterministic) results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation. METHODS: In 2008, the IMM team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) was published, the IMM team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. RESULTS: IMM VVC updates are compiled recurrently and include 7009 Compliance and Credibility matrices, IMM VV Plan status, and a synopsis of any changes or updates to the IMM during the reporting period. Reporting tools have evolved over the lifetime of the IMM project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the NASA-STD-7009 Guidance Document. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including Operations, Science and Technology Planning, and Exploration Planning. CONCLUSIONS: The VVC approach established by the IMM project of combining the IMM VV Plan with 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Validation↗