Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93
All sourcesNASA NTRSDOE OSTI
NASA NTRS2025

CFD Validation of a Methanation Reactor With Cooling Jacket Used in an ISRU Propellant Production System

A digital model of an OxEon Energy methanation reactor (with a cooling jacket) planned for use in a NASA designed In-Situ Resource Utilization (ISRU) propellant production system was developed by the UTEP Aerospace Center using STAR-CCM+ software, a Siemens Computational Fluid Dynamics (CFD) package. The reactor digital model created includes two primary components: (i) a cooling jacket that maintains the required reactor chamber surface temperature and (ii) a reactor core chamber where the exothermic methanation reactions occur. The StarCCM+ digital model has two objectives: (i) maintain the surface temperature of the reactor below a set value so that the extra heat accumulation does not melt or crack the chamber, and (ii) produce the desired amount of methane (CH4) according to test cases completed by OxEon Energy for NASA JSC. The computational digital model was validated with the test data enabling the cooling jacket scale to be predicted based on the reactor's operating temperature. The StarCCM+ simulation of the digital model shows a good agreement with the cooling jacket performance and the CH4 production. One test case for the cooling jacket maintained the reactor wall temperature around 310 °C was validated and the reactor produced 185 g/hr CH 4 .

ISRU↗
NASA NTRSDate not supplied

Verification and Validation of a Conceptual Model of the Auto-Rigging Payload Handling and Off-Loading System Using LEGO Technic System and Three-Dimensional Printed Parts

A conceptual model (CM) can be used to validate a concept in modeling and simulation life cycles. During the 2020-2022 Coronavirus disease 2019 (COVID-19) pandemic, for employee safety NASA implemented center closures and mandatory telework for the entire workforce. During this challenging time, engineers and researchers at NASA Langley Research Center (LaRC) looked for safe and innovative approaches and methods to continue the development of CMs for various projects. Engineers and researchers at LaRC researched Auto-Rigging Payload Handling and Off-Loading System (ARPHOLS) for payload handing and off-loading a system on an inclined lunar lander deck. In this paper, the development of a CM and the verification and validation of a conceptual idea for ARPHOLS using a LEGO Technic system and three-dimensional printed parts is presented.

Payload offloading↗
NASA NTRSDate not supplied

Validation of a Two-Phase CFD Model for Predicting Tank Self-Pressurization in the Ground-Based K-Site Experiment

A two-phase CFD model for self-pressurization of a cryogenic storage tank partially filled with liquid hydrogen is presented using the Volume-Of-Fluid approach for modeling two-phase flow, as well as interfacial heat, mass and momentum transfer between the liquid and the vapor regions. The CFD model is validated against self-pressurization experiment performed using the K-site flightweight hydrogen storage tank at NASA Glenn Research Center1. Laminar and turbulent simulations are performed together with conjugated heat transfer analysis. Effects of turbulence, the value of accommodation coefficient used for predicting phase change rates, as well as tank wall geometry are presented and discussed. Predicted tank pressures, fluid and wall temperatures are compared with the experimental data at 49% fill level and two different heat loads for validating this CFD model.

Computational Fluid Dynamics↗
NASA NTRSDate not supplied

Validation and Development of a Fast-Running CFD Model for the No-Vent Fill of Liquid Propellant Tank

Cryogenic fluids, while offering higher energy density than storable propellants, present several handling challenges, including gradual boil-off and tank self-pressurization. Transferring these propellants between tanks can be problematic, as the receiving tank's temperature and pressure often lead to flashing and rapid boil-off upon injection. The No-Vent Fill (NVF) technique mitigates these risks by preventing liquid fuel from being expelled overboard. By controlling tank pressure and ensuring appropriate condensation in the ullage region, the NVF process avoids exceeding vent pressure limits. In this study, Loci/STREAM-VOF simulations were compared with data from NASA K-site test runs on a 2.1 cubic meter tank with a bottom orifice under various no-vent fill conditions, including different wall temperatures, flow rates, and inlet liquid temperatures. The effort demonstrated that Loci/STREAM-VOF is capable of quantitatively capturing the important physics of NVF with submerged jets: (1) validation of the liquid-vapor interface turbulence velocity using previous experimental data showed good agreement at different fill levels; (2) validation of the CFD Stanton number for mass transfer provided an adequate mass transfer coefficient range; (3) consistent pressure agreements were found in the pressure history for both cold and warm conditions; and (4) the variations of final pressure with flow rate and inlet liquid temperature were well predicted by the CFD simulation. The application of NVF for low-gravity conditions will be studied in future work.

CFD↗
NASA NTRSDate not supplied

Validation of a Two-Phase CFD Model for Predicting Tank Self-Pressurization in the Ground-Based K-Site Experiment

A two-phase CFD model for self-pressurization of a cryogenic storage tank partially filled with liquid hydrogen is presented using the Volume-Of-Fluid approach for modeling two-phase flow, as well as interfacial heat, mass and momentum transfer between the liquid and vapor regions. The CFD model is validated against self-pressurization experiment performed using the K-site flightweight hydrogen storage tank at NASA Glenn Research Center 1 . Laminar and turbulent simulations are performed together with conjugate heat transfer analysis. Effects of turbulence, the value of accommodation coefficient used for predicting phase change rates, as well as tank wall geometry are presented and discussed. Predicted tank pressures, fluid and wall temperatures are compared with the experimental data at 49% fill level and two different heat loads for validating this CFD model.

Computational Fluid Dynamics↗
NASA NTRSDate not supplied

Independent Verification and Validation for Artemis I Ascent Integrated Flight Performance Simulation

The NASA Engineering and Safety Center (NESC) has performed independent model development to support cross-model verification for the Space Launch System (SLS) Program since 2012 which culminated, for Artemis I, in a postflight reconciliation analysis of the Artemis I ascent trajectory (validation). This post-flight analysis was completed by both the NESC and the SLS Program. Upon successful completion of the Artemis I mission, multiple preflight simulations of the nominal ascent trajectory were updated with Day of Launch (DOL) conditions and simulated results were compared to reconstructed flight data derived from telemetry measurements. Dispersed trajectories were also produced using a combination of DOL conditions and preflight uncertainties, which ideally should bound the Artemis I flight data. Finally, multibody dynamics were simulated for some of the separation events to support clearance analyses. This paper focuses on validating and understanding the accuracy of the models by comparing simulated results against the Artemis I flight data. In addition, discrepancies uncovered between simulations led to opportunities to investigate areas for potential model improvement to refine preflight simulations for future Artemis missions. Included in this paper is background on the flight performance simulation tools, the postflight analysis approach, and a comparison of simulation results against the Artemis I flight data. Simulated results were found to generally be in close agreement with each other and the Artemis I flight data.

Jacob Fleck↗
NASA NTRSDate not supplied

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling↗
NASA NTRS2026

Methods for Validation of Random Uncertainty Estimates and Their Applications to Ozone Profiles From Limb-Viewing Satellite Instruments

For satellite measurements of atmospheric composition, the random uncertainty estimates provided by retrieval algorithms might be imperfect due to various approximations used in the retrievals or the presence of unknown error sources. This paper presents an overview of the methods used for the validation of random uncertainty estimates. All methods discussed in this study are categorized, and assumptions and limitations of each method are discussed. This overview evaluates these methods in application to ozone profile measurements from limb and occultation satellite instruments and provides practical illustrations of random uncertainty validation.

Viktoria F Sofieva↗
NASA NTRS2026

Development, Characterization, and Validation of Elevated-Temperature Constitutive Models: Deformation and Damage

This report provides a brief review of experimentally observed hereditary and nonhereditary material behavior along with background information on standard as well as advanced internal state variable constitutive modeling at elevated temperature. A description of exploratory, characterization, and validation testing is presented along with a detailed outline of what constitutes “sufficient” data content (i.e., quality and quantity) for developing or enhancing, characterizing, and validating a particular sophisticated nonlinear time- and history-dependent (hereditary) class of constitutive models known as GVIPS (generalized viscoplasticity with potential structure). The tests described are necessary to reveal a material’s behavior in the reversible (or viscoelastic) and irreversible (or viscoplastic) regimes, for the identification of both deformation and damage model parameters. Results presented are primarily for metallic materials. In all cases, both uniaxial and multiaxial tests are described, and the linkage between the specific tests and the parameters within the model that can be characterized from the results of these tests are also discussed. Discussion is also provided relative to the role information management must play relative to material data collection, analysis, maintenance, and dissemination. The need for such an information system is particularly important as both analyst and designer move toward utilizations of sophisticated, nonlinear time- and history dependent (hereditary) constitutive models. Lastly, the concept of state space and its utility in understanding and establishing constitutive models is addressed throughout. The intent behind this document is to help both the modeler and experimentalist understand each other’s specific points of view and provide guidance for both model development and characterization. Emphasis has been placed on providing the mechanician with information regarding how tests are performed and what issues to be aware of when interpreting results. It is hoped that experimentalists will take away a new perspective on the types of information that modelers and analysts are looking for from them.

Constitutive Modeling↗
DOE OSTI2018

Beyond Widgets: Validated Systems Energy Savings and Utility Custom Incentive Program Systems Trends

Energy efficiency upgrades to buildings to date through avenues such as utility incentive programs have been largely limited to component-based products (e.g., lamps, RTUs). While some utilities do provide ‘custom’ incentive programs with whole building and system level technical assistance, these programs require deeper levels of analysis, resulting in higher program costs. This results in custom programs being restricted to utilities with greater resources, and are typically applied mainly to large or energy-intensive facilities, leaving much of the market without cost effective access and incentives for these solutions. In addition, with increasingly stringent energy codes, cost effective component-based solutions that achieve significant savings are dwindling. Integrated building systems (e.g., integrated façade, HVAC and/or lighting solutions) can deliver higher savings (Regnier et al. 2017) that translate into large sector-wide savings if deployed at the scale of these programs. However, systems application poses a number of challenges – energy savings assessments are inherently more complex and are not easily suited to the deemed measure model, and implementation of systems can be more disruptive. This paper presents the outcomes of a project to develop validated utility incentive program packages for three specific integrated building systems, in collaboration with ComEd, a consortium of California Public Owned Utilities (CA POUs) (Northern California Power Agency(NCPA) and the Southern California Public Power Authority(SCPPA)), and Xcel Energy (CO, MN). Previous work described the potential for energy savings of these systems at the individual and market level, early test findings for the task-ambient lighting system, and described the work products to develop utility incentive programs (Regnier et al. 2016). This paper presents validated end use energy savings of all three systems showing energy savings of ~20% for automated shading combined with daylight dimming (does not include light fixture retrofit savings); 30-46% for task-ambient lighting systems combined with plug load occupancy controls, depending on technology package and office building size (no daylight dimming impacts); and ~94% in the south-façade daylit zone for workstation specific lighting systems with daylight dimming (including lighting retrofit and task tuning). Using a U.S. Department of Energy (DOE) reference building model (DOE 2018), this translates to whole building savings of 2-5% (large-medium commercial), 12-23% (large-small commercial), and 13-15% (medium-large commercial) for these systems respectively. Early findings from the utilities in deploying these systems through their incentive programs indicate that deployment methods such as direct install programs might be best suited for these integrated systems. Further, early findings from a scoping study across custom utility programs and federal retrofit programs indicate that component level retrofits are still prevalent even in these programs, pointing towards an opportunity for deeper energy savings deployment. High performance retrofit case studies demonstrate that deeper energy savings is possible through integrated approaches. Market stakeholder interviews indicate however that there is generally a low level of awareness of the potential for energy savings of these three integrated systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2018

OpenMP 4.5 Validation and Verification Suite for Device Offload

OpenMP has been widely adopted for shared memory systems for over a decade. With the heterogeneity trend in architectures rapidly growing, the programming model needed to evolve such that applications could not only be ported to traditional CPUs but also to accelerators often acting as discrete or integrated devices to CPUs. To that end, OpenMP started to provide support for heterogeneous systems since 2013 when the version 4.0 of the specification was ratified. OpenMP 4.5 is being enhanced to cover major requirements of Exascale Computing Project (ECP) applications. As a result it is time-critical to ensure that the implementations of the 4.5 features are correct and conforming to the specification. This paper focuses on building a Validation and Verification testsuite that will test and present results for several offloading features implemented in compilers such as Clang, IBM XL C/C++, CCE, and GCC. We have results for our testsuite on TITAN, Summitdev and Summit at the Oak Ridge National Lab. We will highlight some of the ambiguities we encountered in the process of validating and verifying feature implementations. We also make the testsuite available for anyone to use and will walk the readers through the infrastructure and the workflow of the testsuite. A website has been built to capture our efforts narrated in this paper https://crpl.cis.udel.edu/ompvvsollve.

Monsalve Diaz, Jose↗
DOE OSTI2019

A FREQUENCY RESPONSE APPROACH TO MODEL VALIDATION FOR THE COMPACT INTEGRAL EFFECTS TEST FACILITY IN TRANSFORM

One of the key challenges to licensing new reactor designs is validating the integral transient response models of a novel system. This work used a frequency response approach for model validation of the Compact Integral Effects Test (CIET) facility at the University of California, Berkeley. This facility was built as a scaled integral effects test for verifying transient modeling tools for fluoride-salt-cooled hightemperature reactors using Dowtherm A as a simulant fluid for molten salt. The dynamic system model of CIET was created using the Modelica-based TRANSFORM tool developed by Oak Ridge National Laboratory (ORNL). Analysis of the model’s performance as compared with experimental results indicates good agreement under both steady-state and transient conditions. This paper describes the Modelica model creation process using TRANSFORM and the modeling assumptions and methods for matching dynamic behavior with frequency response data. Results, analysis, and a discussion of future work are also presented.

De wet, Dane↗
DOE OSTI2020

Validation and Parametric Investigations Using a Lumped Thermal Parameter Model of an Internal Permanent Magnet Motor: Preprint

One of the key challenges for the electric vehicle industry is to develop high-power-density electric motors. Achieving higher power density requires efficient heat removal from inside the motor. In order to improve thermal management, a multi-physics modeling framework that is able to accurately predict the behavior of the motor, while being computationally efficient, is essential. This paper first presents a detailed validation of a Lumped Parameter Thermal Network (LPTN) model of an Internal Permanent Magnet (IPM) synchronous motor within the commercially available Motor-CAD® modeling environment. The IPM motor’s stator is studied at steady state, and winding losses are generated by a constant DC current. The validation is based on temperature comparison with experimental data and with more detailed Finite Element Analysis (FEA). All critical input parameters of the LPTN are considered in detail for each layer of the stator, especially the contact resistances between the impregnation, liner, laminations and housing. Finally, a sensitivity analysis for each of the critical input parameters is provided. A maximum difference of 4% - for the highest temperature in the slot windings and the end windings - was found between the LPTN and the experimental data. Comparing the results from the LPTN and the FEA model, the maximum difference was 2% for the highest temperature in the slot windings and end windings. As for the LTPN sensitivity analysis, the thermal parameter with the highest sensitivity was found to be the liner-to-lamination contact resistance. The latter is often ignored in the literature, whereas its impact on temperature rise was found to be more significant than any other contact resistance within the stator.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Using Qualified On-Site Nuclear Power Plant Simulators in Human Factors Validations of Control Room Upgrades

Existing commercial nuclear power plants (NPPs) are valuable assets in the infrastructure portfolio of the United States (U.S.) because they safely and reliably generate about 1/5th of all the electricity used. The instrumentation and control (I&C) systems in commercial NPPs are the ‘eyes and ears' of the operator, allowing operators to maintain situation awareness, thereby allowing the plant to operate safely and efficiently for all phases of operation. Because the I&C systems in NPPs are still mostly based on analog technologies, which are reliable but not especially cost-effective, upgrading the existing I&C in com-mercial NPPs to new digital I&C is very important. Furthermore, simulators and simulation are critical human factors engineering tools for this I&C modernization work. NPP control room simulators are essential test beds to simulate normal, abnormal, and emergency operations that allow human factors researchers to safely and realistically evaluate early design phase prototypes of the upgraded digital I&C, and validate final as-built digital I&C systems that have been modernized deployed in NPPs. This paper describes research performed using qualified on-site NPP simulators to perform human factors validations of digital I&C control room upgrades.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Verification and Validation of Systems in which AI is a Key Element

Many systems are being considered in which artificial intelligence (AI) will be a key element. Failure of an AI element can lead to system failure, hence the need for AI verification and validation (V&V). This article addresses V&V of such a system, focusing on the issues created by characteristics of AI that make V&V challenging. The element(s) containing AI capabilities is treated as a subsystem and V&V is conducted on that subsystem and its interfaces with other elements of the system under study, just as V&V would be conducted on other subsystems. That is, the high-level definitions of verification and of validation do not change for systems containing one or more AI elements. However, AI V&V challenges require approaches and solutions beyond those for conventional or traditional (those without AI elements) systems. This article provides an overview of how machine learning components/subsystems “fit” in the systems engineering framework (Section 1), identifies characteristics of AI subsystems that create challenges in their V&V (Section 2), describes those challenges (Section 3) and provides some potential solutions (Section 4).

Pullum, Laura↗
DOE OSTI2021

Dark Energy Survey Year 3 Results: Multi-Probe Modeling Strategy and Validation

This paper details the modeling pipeline and validates the baseline analysis choices of the DES Year 3 joint analysis of galaxy clustering and weak lensing (a so-called "3$\times$2pt" analysis). These analysis choices include the specific combination of cosmological probes, priors on cosmological and systematics parameters, model parameterizations for systematic effects and related approximations, and angular scales where the model assumptions are validated. We run a large number of simulated likelihood analyses using synthetic data vectors to test the robustness of our baseline analysis. We demonstrate that the DES Year 3 modeling pipeline, including the calibrated scale cuts, is sufficiently accurate relative to the constraining power of the DES Year 3 analyses. Our systematics mitigation strategy accounts for astrophysical systematics, such as galaxy bias, intrinsic alignments, source and lens magnification, baryonic effects, and source clustering, as well as for uncertainties in modeling the matter power spectrum, reduced shear, and estimator effects. We further demonstrate excellent agreement between two independently-developed modeling pipelines, and thus rule out any residual uncertainties due to the numerical implementation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Verdant Power: Thermoplastic Blade Validation at Full Scale

For the first time in history, thermoplastic composite blades, which have the potential to revolutionize the marine energy industry, are being validated on a large-scale tidal power turbine. Thanks to funding from the U.S. Department of Energy's Water Power Technologies Office and a collaboration with Verdant Power, NREL researchers constructed thermoplastic composite turbine blades and are validating their performance on one of Verdant Power's tidal turbines deployed in New York City's East River.

HYDRO ENERGY↗
DOE OSTI2022

Prototype HB650 Transportation Validation For The PIP-II Project

The PIP-II Project at Fermilab is centered around a superconducting 800 MeV proton linac to upgrade and modernize the Fermilab accelerator complex, allowing increased beam current to intensity frontier experiments such as LBNF-DUNE. PIP-II includes strong international collaborations, including the delivery of 12 cryomodules from European labs to FNAL (3 from STFC-UKRI in the UK and 9 from CEA in France). The transatlantic shipment of these completed modules is identifed as a serious risk for the project. To mitigate this risk, a rigorous and systematic process has been developed to design and validate a transport system, including specifcation, procedures, logistics, and realistic testing. This paper will detail the engineering process used to manage this effort across the collaboration and the results of the first major validation testing of the integrated shipping system prior to use with a cryomodule.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗