Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Data Validation for Hosting Capacity Analyses: Executive Summary

The usefulness of Hosting Capacity Analysis (HCA) is dependent on users' confidence that the results accurately reflect grid conditions. This report provides the findings and recommendations from research, conducted by The National Renewable Energy Lab (NREL) and The Interstate Renewable Energy Council (IREC), into HCA data validation best practices. The goal is to provide utilities, regulators, and stakeholders best practices for HCA data validation procedures so that future HCA deployments avoid uncertainties and potential mistakes from earlier rollouts and provide useful and accurate data from the day they are published.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Validating Connected, Automated, and Electric Vehicle Models and Simulation - Research Performance Progress Report

The objective of this project is to test connected and automated vehicles with both electrified and internal combustion engine powertrains to support updates and validation of modeling and simulation tools. This includes the development of the components and network architecture to execute and collect empirical data for multiple scenarios and traffic interactions. Specific program objectives include: • Translate Lab algorithms into vehicle and infrastructure controls • Conduct physical testing at realistic scale • Evaluate system performance • Improve models using empirical data • Improve control algorithms from lessons learned • Identify system and algorithm assumptions which need refinement It is important to note that the objective of this project was not to demonstrate the efficacy of the selected algorithms to improve energy efficiency but rather to validate and improve modeling and simulation tools using empirical data. While it is a desirable outcome to concurrently demonstrate improved energy efficiency through use of these algorithms, and in most cases that was the outcome, the success of this project was not predicated on the performance of the algorithm towards improving energy efficiency across all scenarios and test matrices.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Technology Selection and Validation: New Millennium Flight Projects

NASA's New Millennium Program (NMP) was created to accelerate the insertion of advanced space-related technologies into future science missions by validating these technologies on deep space and Earth-orbiting technology validation missions.

technology validation space validation DS1 DS2 EO1↗

NASA's Global Precipitation Mission Ground Validation Segment

NASA is designing a Ground Validation Segment (GVS) as one of its contributions to the Global Precipitation Measurement (GPM) mission. The GPM GVS provides an independent means for evaluation, diagnosis, and ultimately improvement of the GPM spaceborne measurements and precipitation products. NASA's GPM GVS concept calls for a combination of direct observations executed within a Multidimensional Observing Volume (MOV) and model-based analyses executed by a Satellite Simulator Model (SSM). The MOV consists of ground-based instruments that measure local surface and atmospheric properties required for GPM validation. The SSM utilizes MOV measurements in a forward numerical model. The goal of the SSM forward modeling is calculation of the following properties: top-of-atmosphere microwave radiative quantities to within sensor noise of those measured by the GPM Core Satellite, precipitation quantities identical to those generated by the standard GPM precipitation retrieval algorithms, and quantitative/objective error estimates of both sets of quantities. At present, the GVS is in the early design stage and various scenarios have been generated to assess how it will be used in the GPM era. The GPM GVS will be operational in the year prior to the launch of the GPM core satellite, which has a launch date scheduled for December 2010.

GVS (GROUND VALIDATION SEGMENT)↗

Blind Validation Study of PRICE TruePlanning and SEER-H

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning by PRICE Systems, and System Estimation and Evaluation of Resources-Hardware (SEER-H) by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. This study is an independent verification of the accuracy of these tools and was originally published in 2018. The purpose of this presentation is to circulate the findings of that study among the NASA cost community. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER-H had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. Nine of the twelve mission's actual costs fell within the 80% confidence interval of SEER's probabilistic estimates; however, none of the missions fell within PRICE’s confidence intervals. There were several factors independent of PRICE and SEER-H which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

SEER↗

Very small-scale, segregating-fluidized-bed experiments: A dataset for CFD-DEM validation and uncertainty quantification

IWe report fluidization experiments were conducted on a small scale and with a rapid response (short duration) to enable corresponding simulations at low-computational cost. Rise times are reported for four or fewer polyethylene particles (intruders) in an air-fluidized bed of ~5000 group D glass beads. Experimental inputs were completely characterized—particle properties, system dimensions and operating conditions—which is necessary for validating computational fluid mechanics (CFD)-discrete element method (DEM) including a comprehensive uncertainty quantification (UQ) analysis. Input uncertainties are reported as bounds or cumulative distribution functions of measured values. The staggering number of simulations required to complete a UQ analysis (~O[10 4 ] simulations corresponding to ~5 uncertain inputs) motivates this study. These segregating-bed experiments are designed to permit analogous CFD-DEM simulations to complete in less than a day on a single (~2.5 GHz) computational processor unit (CPU). Segregation times are reported for several operating conditions, intruder sizes, and initial configurations, providing a rich dataset for numerical model testing, validation and UQ.

42 ENGINEERING↗

Modeling, Validation, and Control of the IEA‐15 MW Reference Wind Turbine and VolturnUS‐S Platform

This paper presents the acausal modeling, validation, and control of floating offshore wind turbines (FOWTs). The model simulates the IEA‐15 MW reference turbine and the semi‐submersible VolturnUS‐S platform utilizing a Control‐oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS), which integrates the key coupled aero‐hydro‐elasto‐servo dynamics and is being developed by authors at the University of Central Florida. Verification and validation are conducted using numerical data from the industry‐standard simulation platform OpenFAST and experimental data from the Floating Offshore‐wind and Controls Advanced Laboratory (FOCAL) project, in which the authors were involved. Numerical results demonstrate the model's ability to qualitatively capture loads and responses across various load cases, highlighting the impact of the control system under different wind and wave conditions and opening new opportunities for optimizing FOWT designs. This paper provides wind turbine researchers with valuable insights into system characteristics, system frequencies, damping effects, and internal reaction forces, serving as a reference for future studies in FOWT modeling and control.

17 WIND ENERGY↗

OpenMP 4.5 Validation and Verification Suite for Device Offload

OpenMP has been widely adopted for shared memory systems for over a decade. With the heterogeneity trend in architectures rapidly growing, the programming model needed to evolve such that applications could not only be ported to traditional CPUs but also to accelerators often acting as discrete or integrated devices to CPUs. To that end, OpenMP started to provide support for heterogeneous systems since 2013 when the version 4.0 of the specification was ratified. OpenMP 4.5 is being enhanced to cover major requirements of Exascale Computing Project (ECP) applications. As a result it is time-critical to ensure that the implementations of the 4.5 features are correct and conforming to the specification. This paper focuses on building a Validation and Verification testsuite that will test and present results for several offloading features implemented in compilers such as Clang, IBM XL C/C++, CCE, and GCC. We have results for our testsuite on TITAN, Summitdev and Summit at the Oak Ridge National Lab. We will highlight some of the ambiguities we encountered in the process of validating and verifying feature implementations. We also make the testsuite available for anyone to use and will walk the readers through the infrastructure and the workflow of the testsuite. A website has been built to capture our efforts narrated in this paper https://crpl.cis.udel.edu/ompvvsollve.

99 GENERAL AND MISCELLANEOUS↗

Data-Driven Model Validation Across Dimensions

Data-driven model validation across dimensions in mathematical and computational biology assumptions are often made (e.g., symmetry) to reduce the problem from three spatial dimensions (3D) to two (2D). However, some experimental datasets, such as cell counts obtained via flow cytometry, represent the entire 3D biological object. For purpose of model calibration and validation, it is sometimes necessary to compare these biological datasets with model outputs. In this work, we propose a methodology for scaling 2D model outputs to compare with 3D experimental datasets, and we discuss the application of this methodology to two examples: agent-based models of granuloma formation and skeletal muscle tissue. The accuracy of the method is evaluated in artificially generated scenarios.

97 MATHEMATICS AND COMPUTING↗

Fuel cycle depletion validation and code-to-code verification studies for High Flux Isotope Reactor highly and low-enriched uranium fuel designs

Here, this paper documents fuel cycle depletion validation and code-to-code verification studies for the High Flux Isotope Reactor (HFIR) highly enriched uranium (HEU) and proposed low-enriched uranium (LEU) fuel designs. In support of HFIR’s world-leading performance, transport and depletion simulations are performed to ensure safe operations, design and qualify irradiation experiments, enhance core components and irradiation facilities, and design and characterize LEU fuel designs. Identifying well-validated, computationally efficient codes is required for the success of these efforts. The HFIR Controller, Shift, and VESTA codes were deployed to simulate HEU uranium–oxide dispersion fuel cycles at 85, 95, and 100 MW operations, as well as LEU fuel cycles operating at 95 MW with uranium–silicide dispersion and uranium–molybdenum monolithic alloy fuel forms. Excellent agreement between the codes and with experimentally obtained 235 U enrichment distributions provides increased confidence in the ability of these codes to model and simulate HFIR’s unique core design.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Californium-252 production at the High Flux Isotope Reactor - I: Validation study using campaign data

This paper presents a series of 252 Cf production validation and code-to-code comparison studies performed based on data from the production campaigns at the High Flux Isotope Reactor (HFIR). These studies support efforts to convert HFIR from using highly enriched uranium (HEU) fuel to low-enriched uranium (LEU) fuel. HFIR must maintain its world-class performance and missions following this conversion, and because 252 Cf is a vital neutron-emitting radioisotope used for a variety of high-impact applications (e.g., reactor startup, cancer treatment), the ability to efficiently produce 252 Cf must be preserved. In this work, the HFIRCON, Shift, ORIGEN, and TCOMP codes were deployed, and several sets of data libraries were investigated to better understand the calculation codes and the data biases. As-loaded target composition data, as-run irradiation history data, and post-irradiation measurements from recent multi-cycle irradiation campaigns of the HEU core were used to validate and determine methodology biases. Further, the findings demonstrated a good agreement, with results falling within 3 standard deviations of measurements. This paper lays the ground work for the second paper, which evaluates and compares 252 Cf production and safety metrics with the HEU core and a proposed LEU core.

07 ISOTOPE AND RADIATION SOURCES↗

Predictive modeling of a subcritical pulverized-coal power plant for optimization: Parameter estimation, validation, and application

As renewable power generation deployment increases, fossil fuel plants are increasingly required to operate more flexibly. Many coal-fired power plants were originally designed to operate at base load and do not operate optimally at partial load. Predictive first-principles plant-wide models can be employed to identify opportunities for flexibility improvements and diagnose low-load operating issues. This paper describes the application of the Institute for the Design of Advanced Energy Systems Integrated Platform (IDAES) to model and optimize flexible power plant operations. The key benefits of using IDAES are that it provides an open-source, fully equation-oriented modeling framework for efficient modular model construction, reuse, and customization, together with a mathematical optimization framework leveraging powerful, state-of-the-art solvers. The process systems engineering workflow from predictive process simulation to parameter estimation, model validation, and plant optimization is applicable to a variety of existing and next-generation energy systems as well as other chemical and environmental processes. Here, to demonstrate this capability, a physics-based, steady-state model was developed to improve full- and part-load performance of the Escalante Generating Station, a 245 MWe (net) subcritical pulverized coal-fired power plant owned and operated by Tri-State Generation and Transmission Association. Specifically, sixty-nine model parameters were simultaneously estimated from several months of operating data enabling prediction of flow rates, temperatures, pressures, and steam quality throughout the plant. The validated model was leveraged by Escalante to reduce the minimum operating load from 90 MW to 50 MW by diagnosing a low-load water-hammer issue, enabling coal usage and emissions reductions during periods of low power demand. Additionally, opportunities for heat rate reduction (i.e., efficiency improvement) through a steeper sliding-pressure approach to load-following and optimization of other boiler operating variables were also identified and quantified. For example, a potential efficiency improvement of 0.7 percentage points was observed at half-load operation.

01 COAL, LIGNITE, AND PEAT↗

Empirical validation and comparison of methodologies to simulate micro and macro-encapsulated PCMs in the building envelope

Thermal Energy Storage (TES) has the potential to shift peak electricity demand. Passive TES is usually implemented in building envelope as micro and macro encapsulated phase change materials (PCM) to shift electric energy demand and therefore requires careful heat transfer analysis. Whole building energy modelling with simplified heat transfer analysis has become extremely important for designers, architects, engineers, and researchers to predict energy performance of buildings. It is important to validate PCM modelling algorithms used in building energy programs to quantify their error and prove their capacity to model different PCM encapsulation types. This study uses data from a microencapsulated PCM and two macroencapsulated PCMs (Bio based PCM and hydrate salts) tested in full-scale using the Advanced Multiscale Building Energy Research (AMBER) Lab located at the Colorado School of Mines and is used to validate a numerical algorithm written in MATLAB language. To approximate the heat transfer through a wall assembly with macroencapsulated PCM pouches, several modelling techniques that can reduce 3D heat transfer characteristics to 1D are explored in this research. A parallel path heat transfer modelling approach is found to give the closest agreement with the experimental data for the pouched PCMs in building envelope applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Experimental validation of a co-simulation architecture for modeling whole-building and detailed electrical distribution performance

This article presents an experimental validation of a co-simulation architecture for simultaneously modeling whole-building energy performance and detailed building electrical distribution system performance. The co-simulation architecture consists of a whole-building energy model (EnergyPlus®) embedded within a Modelica-based building electrical distribution system library called the Building Electrical Efficiency Analysis Model (BEEAM) using the Functional Mock-up Interface standard. We validate the model using experimental data collected at a full-scale test cell within Lawrence Berkeley National Laboratory’s FLEXLAB® facility. In conclusion, we show that the co-simulation model accurately predicts the electrical, mechanical, and thermal performance of the test cell for typical loads with both an AC and a DC electrical distribution topology.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The importance of cycle-by-cycle data in performing rapid battery technology development and validation

Lithium-ion battery (LiB) technology is playing a crucial role in transforming the predominantly fossil fuel-based transportation and stationary storage sectors to achieve a low-carbon economy. Rapid innovation in the LiB materials to electrode to cell design is happening to satisfy the performance, life, and safety metrics required by those myriads of applications. Lately, advanced analytics, such as machine-learning or artificial intelligence (ML/AI) techniques, are being used more frequently to aid in expedited LiB technology development, performance validation, and life prediction. The success of these techniques often relies on a large volume of well-defined and high-quality battery test data. On the other hand, most battery developers and research and development (R&D) communities are still following a classical approach to develop batteries, which is running calendar- and/or cycle-aging tests, performing reference performance tests (RPTs), and conducting post-mortem analyses periodically without paying attention to the wealth of data often not collected during the calendar or cycle life aging tests. This sparse data collection approach is time- and resource-intensive, requiring data capture and evaluation of months to years of RPT data to diagnose accurate battery state of performance, health, and safety. Even so, the underlying aging modes and mechanisms can be missed. If collected properly, battery test data during cycling or calendaring can be efficiently combined with ML/AI techniques to create powerful tools in the rapid diagnosis of battery state of performance, health, and safety along with insights into underlying aging modes and mechanisms. In this report, we discuss the importance of effective cycle-by-cycle (CBC) data collection with example case studies. Within a reasonable timeframe, RPT data are often inadequate in capturing many of the crucial battery aging dynamics, which often predominantly show up in CBC test data. Finally, we also show examples of ML/AI techniques that use CBC data in rapid diagnosis and projection of LiB state of health (SOH) to motivate the scientific community in collecting and using CBC data to facilitate expeditious technology development and validation.

25 ENERGY STORAGE↗

Dynamic modeling of heat pipe integrated thermal battery latent heat storage system experiment validation

A heat pipe integrated thermal battery system has been constructed to investigate a high-temperature latent heat thermal energy storage technology that takes advantage of near isothermal operation of latent heat storage and heat pipes to potentially enable high-energy isothermal heat storage. A dynamic model constructed in Modelica has been validated, showing errors between 2.5 °C–39.7 °C across 10-h to 47-h simulations against experiment results, showing good prediction capability of experiment output, especially against phase change time. Model calibrations showing vessel heat-up capability of 3 kW and heat pipes combining to provide 600 W each during experiment operation validate experiment circumstances including reduced material loading and reduced power capability. The experiment configuration uses an Al-Mg-Zn eutectic metal as the storage material, heated via heat tape wrapped around the vessel and guide tubes to bring the system to operation range (>400 °C) and to simulate charging heat exchange, respectively, with heat rejection occurring through the surfaces of the material and facilitated via guide tubes with less insulation wrapping. The model is available in the open-source repository HYBRID on Github.

25 - ENERGY STORAGE↗

High fidelity simulation and validation of crossflow through a tube bundle and the onset of vibration

Flow induced vibrations can be detrimental to all manner of engineering applications with fluid flow. Heat exchangers with bundles of thin tubes experiencing a crossflow are especially susceptible to the unexpected onset of vibration. Heat-exchanger design necessarily involves extensive modeling and testing to ensure that significant vibrations cannot develop for any expected flow conditions. A properly validated numerical simulation can work in conjunction with physical experiments to identify problematic vibrations and allow for rapid iteration of design at relatively low expense. A high-fidelity fluid–structure interaction code has been developed by fully coupling CFD LES/DNS code Nek5000 and CSM code Diablo. The coupled code is used to simulate crossflow through a tube bundle in a geometry recreated after a physical experiment. Validation against this experiment involves comparing the amplitude and frequency spectrum for three different flow velocities. The velocities compared straddle the onset of large magnitude vibrations. The simulation accurately captures the onset of the vibrations with a marginally lower predicted frequency of vibration. When the onset velocity is compensated for the difference in natural frequency, the simulation results closely match the experiment. Finally, the continuous nature of the simulation measurements helps illustrate the fluid mechanics behind the pin motion and reveals the front to back propagation of the vibrations as the fluid velocity increases.

42 ENGINEERING↗

Refinement and Validation of the Head and Neck Lymphedema and Fibrosis Symptom Inventory

Lymphedema and fibrosis (LEF) are common yet overlooked late effects of head and neck cancer and its therapy. Lack of reliable and valid measures of head and neck LEF is a critical barrier to the timely identification and management of head and neck LEF. To fill this gap, we developed and pilot tested a 64-item patient-reported outcome measure ( Lymphedema Symptom Intensity and Distress Survey-Head and Neck, LSIDS-H&N). This article aims to report the process of further validation and refinement of the tool.

62 RADIOLOGY AND NUCLEAR MEDICINE↗