SEARCH · Engineering Papers

Results for “Validate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Validation of theory-based models for the control of plasma currents in W7-X divertor plasmas

A theory-based model for the control of plasma currents for steady-state operation in W7-X is proposed and intended for model-based plasma control. The conceptual outline implies the strength of physics-based models: it offer approaches applicable to future conditions of fusion devices or next-step machines. The application at extrapolated settings is related to the validity range of the theory model. Therefore, the predictive power of theory-based control models could be larger than for data-driven approaches and limitations can be predicted from the validity range for the prediction of bootstrap currents in W7-X. The model predicts the L/R response when density or heating power is changed. The model is based on neoclassical bootstrap current calculations and validated for different discharge conditions. While the model was found to be broadly applicable for conducted electron-cyclotron-heated discharges in W7-X, limits were found for cases when the polarization of the electron cyclotron heating was changed from X2 to O2-heating. The validity assessment attempts to quantify the potential of the derived model for model-based control in the operational space (density, heating power) of W7-X.

neoclassical modelling↗

DOE OSTI2020

Validation of Synthetic U.S. Electric Power Distribution System Data Sets

There is a strong need for synthetic yet realistic distribution system test data sets that are as diverse, large, and complex to solve as real systems. Such data sets can facilitate the development of advanced algorithms and the assessment of emerging distributed energy resources while avoiding the need to acquire proprietary critical infrastructure or private data. Such synthetic data sets, however, are useful only if they are realistic enough to look and behave similarly to actual systems. This paper presents a comprehensive framework for validating synthetic distribution data sets using a three-pronged statistical, operational, and expert validation approach. Furthermore, it also presents a set of statistical and operational metric targets for achieving realistic data sets based on detailed characterization of more than 10,000 real U.S. utility feeders. The paper demonstrates the use of the proposed validation approach to validate three large-scale synthetic data sets developed by the authors representing Santa Fe, New Mexico; Greensboro, North Carolina; and the San Francisco Bay Area, California.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Validation of finite-element models using full-field experimental data: Levelling finite-element analysis data through a digital image correlation engine

Full-field data from digital image correlation (DIC) provide rich information for finite-element analysis (FEA) validation. However, there are several inherent inconsistencies between FEA and DIC data that must be rectified before meaningful, quantitative comparisons can be made, including strain formulations, coordinate systems, data locations, strain calculation algorithms, spatial resolutions and data filtering. As such, in this paper, we investigate two full-field validation approaches: (1) the direct interpolation approach, which addresses the first three inconsistencies by interpolating the quantity of interest from one mesh to the other, and (2) the proposed DIC-levelling approach, which addresses all six inconsistencies simultaneously by processing the FEA data through a stereo-DIC simulator to ‘level’ the FEA data to the DIC data in a regularisation sense. Synthetic ‘experimental’ DIC data were generated based on a reference FEA of an exemplar test specimen. The direct interpolation approach was applied, and significant strain errorswere computed, even though therewas no model form error, because the filtering effect of theDIC enginewas neglected. In contrast, the levelling approach provided accurate validation results, with no strain error when no model form error was present. Next, model form error was purposefully introduced via a mismatch of boundary conditions. With the direct interpolation approach, the mismatch in boundary conditions was completely obfuscated, while with the levelling approach, it was clearly observed. Finally, the ‘experimental’ DIC datawere purposefully misaligned slightly fromthe FEA data. Both validation techniques suffered from the misalignment, thus motivating continued efforts to develop a robust alignment process. In conclusion, direct interpolation is insufficient, and the proposed levelling approach is required to ensure that the FEA and the DIC data have the same spatial resolution and data filtering. Only after the FEA data have been ‘levelled’ to the DIC data can meaningful, quantitative error maps be computed.

42 ENGINEERING↗

DOE OSTI2020

Development and Validation of SAM Multi-dimensional Flow Model for Thermal Mixing and Stratification Modeling

Thermal mixing and stratification in large pools or enclosures are very important phenomena that are critical to nuclear reactor safety. Because of the wide ranges of time and length scales associated with such phenomena, accurate modeling and simulation of thermal mixing and stratification remain as the key unresolved, challenging problems for reactor transient analyses. In traditional system analysis codes, simplified zero-dimensional (0-D) models are widely used for their high numerical efficiency, but they generally suffer from very limited prediction accuracies or range of applicability. Like traditional system analysis codes, the current version of the SAM code has implemented such simplified 0-D and one-dimensional mixing models. On the other hand, high-resolution Computational Fluid Dynamics (CFD) tools are often used to model complex thermal mixing and stratification phenomena. They are, however, generally numerically expensive, and they require large amounts of computational resources. It is therefore desirable to implement advanced and efficient thermal mixing and stratification modeling capabilities embedded in a system analysis code. This approach will improve the accuracy of reactor safety analyses when thermal mixing and stratification are involved, and also avoid using the large computational resources needed for high-resolution CFD analysis. Currently, with the support of the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation program, an effort has been launched to develop and implement a multi-dimensional flow model in the system analysis code SAM, and demonstrate its applications to model thermal mixing and stratification phenomena in large enclosures. The main outcomes of this research and development activity are summarized in this report, which presents an attempt to include a built-in advanced multi-dimensional flow model in a system analysis code with the focus on overcoming the simulation challenges of thermal mixing and stratification phenomena. In this report, we start with the introduction of existing SAM code capabilities to simulate thermal mixing and stratification phenomena, which is followed by a short summary of the multi-dimensional model implemented in the SAM code, including both the physical model and the Finite Element Method code implementation. In this study, two options were implemented in the SAM code to model turbulent flows: a relatively simple built-in turbulence model and an interface to accept externally computed turbulent viscosities (e.g., from a high- resolution CFD simulation). Code validation studies on this newly added capability were then carried out to compare SAM simulation results with experimental data from the SUPERCAVNA facility, which was designed to study the complex flow recirculation and thermal stratification phenomena relevant to sodium fast reactor designs. In this study, one transient and two steady-state test cases were used for code validation. Different approaches have been used to model the complex turbulence flow fields in the SUPERCAVNA facility. A highly simplified zero-equation turbulence model was first used, but it was determined that it is too simple to capture the complex turbulence flow fields in these test cases. Subsequently, the code validation continued with the use of turbulent viscosity data from high-resolution STAR-CCM+ CFD simulations to improve the accuracy of the results. Using this approach, the SAM simulation results showed very good agreement with both the SUPERCAVNA experimental data and STAR-CCM+ simulation results. In this report, we demonstrate the development, implementation, and successful validation of a multi-dimensional flow model in the SAM code, which aims to improve the simulation accuracy for complex thermal mixing and stratification phenomena. Lessons have also been learned, including that in cases where the flow fields are not well predicted by the zero-equation model, the iinput of turbulent viscosities from an external source can enhance the overall predictive capabilities needed to accurately capture complex thermal-hydraulic phenomena. Therefore, future research will be needed to further improve the code’s capabilities, such as by developing a more efficient and robust approach to capture the turbulence effects in the SAM code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Validation and Verification for INL Modelica-based TEDS models Via Experimental Results

This report provides an overview on the verification and validation (V&V) of the Thermal Energy Distribution System (TEDS) model developed in the Modelica process modeling ecosystem using experimental data. Model development has led to the creation of a dynamic process model of the experimental TEDS facility housed within the Energy Systems Laboratory (ESL) at Idaho National Laboratory (INL). The model was then used during the preconstruction phase of the experimental effort to inform experimental design (e.g., insulation requirements, bypass line placement, expected performance of components) and to test innovative control schemes prior to the initial operation. The TEDS model developed in Modelica includes the primary components of the TEDS experimental unit: a 200kW Chromalox heater; a single-tank packed-bed thermal energy storage system filled with 0.125-inch alumina (Al2O3) beads; an ethylene-glycol-to-Therminol-66 heat exchanger; system piping; five control valves; and all associated temperature, pressure, and volumetric flow sensors. Using the Institute of Electrical and Electronics Engineers (IEEE) V&V methodologies, considered the gold standard in the engineering field, the model was verified using a combination of static analysis, spatial convergence, and regression tests. Then using dynamic time warping (DTW) initial runs to validate and tune the TEDS model versus the experiment were conducted. This tuning method was accomplished using the INL Risk Analysis Virtual ENvironment (RAVEN) software package. Tuning is required to account for physical phenomena that are less understood within the empirical heat transfer correlations. Through the commencement of this work, a systems-level model of TEDS with associated control systems, sensors, piping diameters, and component capabilities has been created. This model was utilized in the pre-experimental phase to inform system design, insulation thicknesses, and potential control schemes to operate the system effectively and safely. Then, initial experimental startup and operational data were used to demonstrate the validation and tuning methodology. This process demonstrates the classical two-step approach of a model informing experimental design followed by the experiment validation and tuning the model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

VALID Past, Present, and Future [Slides]

This presentation discusses the Verified, Archived Library of Inputs and Data (VALID) procedure which is managed per computational procedure under the overall SCALE quality assurance plan. The principle behind VALID is that two independent, qualified people prepare and review the model, while a dual, independent check acts as a primary barrier to prevent errors in the library. A final check by VALID QAC of procedural compliance is then performed. The future for VALID includes plans to add more experiments, a review for all ICSBEP cases containing Deuterium, ZEUS intermediate and fast spectrum evaluations, intermediate enrichment experiments, other cases of interest to sponsors, and mixed/intermediate spectrum experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Subcomponent Validation of Composite Joints for the Marine Energy Advanced Materials Project

The Marine Energy Advanced Materials project is an ongoing multi-year, multi-lab project with the main goals of addressing barriers and uncertainties facing marine energy developers in adopting advanced materials for structural applications. NREL's goals of the project were to address subcomponents testing needs for marine energy materials, to improve understanding of design allowables at the full-scale and provide near net-scale static and fatigue data of composite subcomponents using materials applicable to the marine energy industry. In the long term, the test method development and data generated would be used to inform standards development. This report outlines perhaps one of the largest-scale studies conducted with regards to saltwater conditioning of various composite material subcomponents and their subsequent structural validation, specifically directed at the marine renewable energy industry. A variety of fiberglass composite panels with epoxy and vinyl ester epoxy resin systems were manufactured at Montana State University, which were then used to manufacture an array of different types of subcomponent test specimens at the National Renewable Energy Laboratory's Flatirons Campus. These subcomponents were in the form of T-bolt and double-ended-insert specimens, which were intended to represent bonded and mechanical bolted connections for thick composite laminates, metal-metal and composite lap shear specimens to evaluate adhesion of constituent materials, and adhesive beam-shear specimens as part of an effort to better evaluate the characteristics of thick adhesive bondlines. Overall, the materials used were fiberglass reinforced epoxy and vinyl ester matrix composites, epoxy and methacrylate adhesives, and 316 and 2507 stainless steels. Specimens were then conditioned in salt water at various temperatures and for various periods of time at Florida Atlantic University and Pacific Northwest National Laboratory. All specimens were then mechanically characterized and validated using various test methods under static and fatigue loading conditions at NREL's Structural Technology Laboratory. Throughout the conditioning and mechanical validation process, valuable experience was gained, which will help guide future test method development for marine energy materials. In many instances, the results indicated similar observations as to what had been observed during previous coupon scale characterization efforts that provided a vital understanding of the scale up process. However in some instances, unexpected phenomena were observed, such as interactions between the adhesives and 316 steel. Furthermore, some materials exhibited significant degradation due to the saltwater conditioning. Ultimately, this report provides a detailed summary of the specimens that were designed, the subcomponent test methods that were developed, and the results that were generated, which will serve as important guidance for marine renewable energy developers and researchers for future structural designs and validation.

16 TIDAL AND WAVE POWER↗

DOE OSTI2023

A Guide to Engaging Underserved Communities in Commercial Energy Efficiency Field Validations

Underserved communities in the United States often experience the negative impacts of climate change and environmental degradation but enjoy few of the benefits of technological and environmental advances. The White House has addressed this inequity through the Justice40 initiative, which requires 40% of the benefits of select federal investments to be directed to underserved communities (The White House, 2022). Clean energy and energy efficiency are two highlighted investment categories, so the U.S. Department of Energy will guide implementation of the Justice40 initiative by, among other things, decreasing energy burdens, increasing parity in clean energy technology access and adoption, and increasing energy resiliency. A strategy for reaching these goals is to evaluate and validate new energy efficiency technologies in commercial buildings in underserved communities, where buildings may be older, smaller, and have deferred maintenance due to historical underinvestment. This paper develops guidance for researchers pursuing field validations with underserved communities. Historical redlining and past negative experiences with government and large institutions may make residents wary of participating in these field validations. Researchers, therefore, may need to spend more time building relationships and matching technologies to buildings. In this paper, we analyzed technical reports to identify common field validation building characteristics and conducted semi-structured expert conversations to identify key stages and major themes of engaging underserved communities. Results indicate there may be flexibility in site selection and there are steps researchers can take to support collaboration with communities. Results also suggest benefits to both the community and energy efficiency research.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

Validation of the NLR Pumped Storage Hydropower Cost Model

The National Laboratory of the Rockies (NLR) first released its pumped storage hydropower (PSH) cost model in 2023 as the most detailed bottom-up PSH cost model available to the public. It is available both as a spreadsheet and an interactive web tool, enabling users with a variety of PSH interests to transparently characterize costs of alternative PSH sites and designs. The PSH cost model cannot replace detailed site-level studies and design, but it is important to validate it against other industry PSH cost estimates. The initial model methodology report validated the cost model for a single proposed site, the Eagle Mountain Project in California. This slide deck documents an expanded validation exercise using cost data from six other sites: Goldendale (Washington), Seminoe (Wyoming), Gordon Butte (Montana), Swan Lake (Oregon), White Pine (Oregon), and Lewis Ridge (Kentucky). It compares itemized costs from Federal Energy Regulatory Commission (FERC) applications and other reported costs with NLR PSH cost model outputs after customizing inputs for each site. The validation exercise finds that the NLR model's conservative indirect cost assumptions often drive overall cost overestimation, with direct cost comparisons typically agreeing more closely. All cost model estimates are well within an Association for the Advancement of Cost Engineering (AACE) Class 5 estimation range (-50% to +100%), with five within the AACE Class 4 range (-30% to +50%) and four being within 15%. This result is considered reasonable performance for a parametric model applied at a preliminary design stage.

13 HYDRO ENERGY↗

DOE OSTI2026

H2@Scale - Validating an Electrolysis System with High Output Pressure: Cooperative Research and Development Final Report, CRADA Number CRD-18-00741

Electrolysis has been a commercially available product for a while and electrolyzers have been a proven capability to provide additional benefits (e.g. controllable load for grid services) in addition to production of hydrogen. The hydrogen output is typically compressed for storage and dispensing. Compression adds cost and decreases system reliability. Honda’s electrolyzer systems have been developed to include electrochemical compression to leverage the production system itself for at least partial compression. In this project, the team will evaluate Honda’s PEM based electrochemical compression system. The system is capable of compressing hydrogen up to 70 MPa electrochemically. Validation testing is the next step to accelerate this technology into the marketplace, as the validation will provide needed data under a variety of operation conditions and controls. These operating conditions and controls are based on over a decade of NLR research and development with low-temperature electrolysis. The validation testing will include preparing NLR’s site for third party evaluation, benchmark testing of Honda’s stack and system, and simulating operation connected to renewables or in a grid service profile. NLR’s Energy System Integration Lab will be the location for the electrolyzer validation research and integrated into the Hydrogen Infrastructure Test & Research Facility (HITRF). This will build into the existing retail style hydrogen fueling station for a fully integrated experimental setup.

08 HYDROGEN↗

NASA NTRS2001

A semi-automatic method for left ventricle volume estimate: an in vivo validation study

This study aims to the validation of the left ventricular (LV) volume estimates obtained by processing volumetric data utilizing a segmentation model based on level set technique. The validation has been performed by comparing real-time volumetric echo data (RT3DE) and magnetic resonance (MRI) data. A validation protocol has been defined. The validation protocol was applied to twenty-four estimates (range 61-467 ml) obtained from normal and pathologic subjects, which underwent both RT3DE and MRI. A statistical analysis was performed on each estimate and on clinical parameters as stroke volume (SV) and ejection fraction (EF). Assuming MRI estimates (x) as a reference, an excellent correlation was found with volume measured by utilizing the segmentation procedure (y) (y=0.89x + 13.78, r=0.98). The mean error on SV was 8 ml and the mean error on EF was 2%. This study demonstrated that the segmentation technique is reliably applicable on human hearts in clinical practice.

NASA Discipline Cardiopulmonary↗

NASA NTRS2004

Mars Exploration Rover Mission: Entry, Descent, and Landing System Validation

System validation for a Mars entry, descent, and landing system is not simply a demonstration that the electrical system functions in the associated environments. The function of this system is its interaction with the atmospheric and surface environment. Thus, in addition to traditional test-bed, hardware-in-the-loop, testing, a validation program that confirms the environmental interaction is required. Unfortunately, it is not possible to conduct a meaningful end-to-end test of a Mars landing system on Earth. The validation plan must be constructed from an interconnected combination of simulation, analysis and test. For the Mars Exploration Rover mission, this combination of activities and the logic of how they combined to the system's validation was explicitly stated, reviewed, and tracked as part of the development plan.

system validation↗

NASA NTRS2017

Development of Level 2 Calibration and Validation Plans for GOES-R; What is a RIMP?

Calibration and Validation (CalVal) plans for Geostationary Operational Environmental Satellite version R (GOES-R) Level 2 (L2) products were documented via Resource, Implementation, and Management Plans (RIMPs) for all of the official L2 products required from the GOES-R Advanced Baseline Imager (ABI). In 2015 the GOES-R program decided to replace the typical CalVal plans with RIMPs that covered, for a given L2 product, what was required from that product, how it would be validated, and what tools would be used to do so. Similar to Level 1b products, the intent was to cover the full spectrum of planning required for the CalVal of L2 ABI products. Instead of focusing on step-by-step procedures, the RIMPs concentrated on the criteria for each stage of the validation process (Beta, Provisional, and Full Validation) and the many elements required to prove when each stage was reached.

Validation↗

NASA NTRS2017

Development of Level 2 Calibration and Validation Plans for GOES-R; What is a RIMP?

Validation↗

NASA NTRS2017

Development of Level 1b Calibration and Validation Readiness, Implementation and Management Plans for GOES-R

A complement of Readiness, Implementation and Management Plans (RIMPs) to facilitate management of post-launch product test activities for the official Geostationary Operational Environmental Satellite (GOES-R) Level 1b (L1b) products have been developed and documented. Separate plans have been created for each of the GOES-R sensors including: the Advanced Baseline Imager (ABI), the Extreme ultraviolet and X-ray Irradiance Sensors (EXIS), Geostationary Lightning Mapper (GLM), GOES-R Magnetometer (MAG), the Space Environment In-Situ Suite (SEISS), and the Solar Ultraviolet Imager (SUVI). The GOES-R program has implemented these RIMPs in order to address the full scope of CalVal activities required for a successful demonstration of GOES-R L1b data product quality throughout the three validation stages: Beta, Provisional and Full Validation. For each product maturity level, the RIMPs include specific performance criteria and required artifacts that provide evidence a given validation stage has been reached, the timing when each stage will be complete, a description of every applicable Post-Launch Product Test (PLPT), roles and responsibilities of personnel, upstream dependencies, and analysis methods and tools to be employed during validation. Instrument level Post-Launch Tests (PLTs) are also referenced and apply primarily to functional check-out of the instruments.

Validation↗

NASA NTRS2019

Validation of CERES Flight Model 5 In-Orbit Calibrations Using Lunar Observations

Scientific studies require radiation fluxes over the Earth to be accurate within 1% for shortwave fluxes and 0.5% for outgoing longwave fluxes. The validation of in-orbit instrument performance requires both stability in calibration source and also calibration corrections to compensate for instrument changes. The Moon offers an external source whose signal variance is predictable and non-degrading. CERES detectors register the signal output from the entire face of the Moon. Lunar observations performed by CERES Flight Models (FM) 1 through 4 have been successful in assisting validation of radiances to the required accuracy. CERES Flight Model 5 (FM-5) is on Suomi/NPP spacecraft, orbiting since October 2011. This paper uses lunar measurements to validate detector output of FM-5. These measurements are adjusted to remove orbital effects due to variations in distance between Moon and Sun, distance between the satellite and the Moon and lunar phase angle. These effects create a total variation in lunar irradiance of 20% in the total channel and 8% in the shortwave channel. The change in orientation of the Moon as seen by the detector is called libration and causes variations of about 1% of the irradiance. A consistent dataset spanning at least 2 years in length is required to remove variations due to libration. The major uncertainties remaining in the measurements are assumed to be due to changes of the spectral responses of the channels due to degradation of optical surfaces in orbit. The results demonstrate that lunar observations can be used to validate FM-5 measurements.

Clouds and Earth Radiant Energy System↗

NASA NTRSDate not supplied

Verification and Validation of Safety-Critical Aircraft Systems Operating under Off-Nominal, Contingency, and Emergency Conditions

Verification and validation (V&V) of safety-critical technologies developed for loss of control (LOC) prevention and recovery and other aviation safety concerns pose significant challenges. Aircraft LOC can result from a wide spectrum of hazards, often occurring in combination, which cannot be fully replicated during evaluation. Technologies developed for LOC prevention and recovery must therefore be effective under a wide variety of hazardous and uncertain conditions, and the verification and validation of these technologies must provide some measure of assurance that the new vehicle safety technologies do no harm (i.e., that they themselves do not introduce new safety risks). V&V technologies must also enable the identification of system limitations and constraints, as well as enable the identification of safe and unsafe operating conditions (and their boundaries). Additionally, the V&V of complex, increasingly autonomous systems is a fundamental concern. Scalable, reproducible and cost-effective techniques for the assurance of safety critical systems during their design and operation is a key barrier to fielding new systems or updating current systems. Moreover, these techniques need to provide artifacts that enable a comprehensive evidence-based approach to certification. This briefing summarizes research performed under NASA’s Aviation Safety Program and follow-on research for the V&V of safety-critical aircraft system technologies developed for LOC prevention and recovery and increasingly autonomous systems, and for a broad assurance capability in both current and emerging aviation applications. Note that, in this briefing, the term “validation” refers to a confirmation that the system implementation (e.g., algorithms etc.) is performing the intended function(s), as well as an affirmation of effectiveness in these functions. “Verification” refers to a confirmation that the system implementation in the software and hardware meets its (hopefully validated) specifications (e.g., correctly executes algorithms as designed).

Validation↗