SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Validation and Development of a Fast-Running CFD Model for the No-Vent Fill of Liquid Propellant Tank

Cryogenic fluids, while offering higher energy density than storable propellants, present several handling challenges, including gradual boil-off and tank self-pressurization. Transferring these propellants between tanks can be problematic, as the receiving tank's temperature and pressure often lead to flashing and rapid boil-off upon injection. The No-Vent Fill (NVF) technique mitigates these risks by preventing liquid fuel from being expelled overboard. By controlling tank pressure and ensuring appropriate condensation in the ullage region, the NVF process avoids exceeding vent pressure limits. In this study, Loci/STREAM-VOF simulations were compared with data from NASA K-site test runs on a 2.1 cubic meter tank with a bottom orifice under various no-vent fill conditions, including different wall temperatures, flow rates, and inlet liquid temperatures. The effort demonstrated that Loci/STREAM-VOF is capable of quantitatively capturing the important physics of NVF with submerged jets: (1) validation of the liquid-vapor interface turbulence velocity using previous experimental data showed good agreement at different fill levels; (2) validation of the CFD Stanton number for mass transfer provided an adequate mass transfer coefficient range; (3) consistent pressure agreements were found in the pressure history for both cold and warm conditions; and (4) the variations of final pressure with flow rate and inlet liquid temperature were well predicted by the CFD simulation. The application of NVF for low-gravity conditions will be studied in future work.

CFD↗

NASA NTRS2025

CFD Validation and Scaling of a Condenser Used in an ISRU Propellant Production System

This work develops a Computational Fluid Dynamics (CFD) model of a Commercial-Off-The-Shelf (COTS) condenser used for ground-based testing of an In-Situ Resource Utilization (ISRU) propellant production system. STAR-CCM+ was used to simulate water condensing through the condenser downstream of a methanation reactor. The computational data of the digital model is validated with test cases using nitrogen and water in ambient conditions. After validation with the test data, the digital model can be used to predict scale at higher production targets. The StarCCM+ simulation of the digital model shows good agreement with the test data provided. From the simulation, the condensation rate calculated was 18.3 g/hr and the process gas mass flow rate was 709.2 g/hr. The test data measured an average 16.9 g/hr condensation rate and 693.6 g/hr process gas mass flow rate. The simulation shows a 7.3% error in the water condensation and 2.2% error in the process gas at the outlet.

Condenser↗

NASA NTRS2025

CFD Validation of a Methanation Reactor With Cooling Jacket Used in an ISRU Propellant Production System

A digital model of an OxEon Energy methanation reactor (with a cooling jacket) planned for use in a NASA designed In-Situ Resource Utilization (ISRU) propellant production system was developed by the UTEP Aerospace Center using STAR-CCM+ software, a Siemens Computational Fluid Dynamics (CFD) package. The reactor digital model created includes two primary components: (i) a cooling jacket that maintains the required reactor chamber surface temperature and (ii) a reactor core chamber where the exothermic methanation reactions occur. The StarCCM+ digital model has two objectives: (i) maintain the surface temperature of the reactor below a set value so that the extra heat accumulation does not melt or crack the chamber, and (ii) produce the desired amount of methane (CH4) according to test cases completed by OxEon Energy for NASA JSC. The computational digital model was validated with the test data enabling the cooling jacket scale to be predicted based on the reactor's operating temperature. The StarCCM+ simulation of the digital model shows a good agreement with the cooling jacket performance and the CH4 production. One test case for the cooling jacket maintained the reactor wall temperature around 310 °C was validated and the reactor produced 185 g/hr CH 4 .

ISRU↗

NASA NTRSDate not supplied

Verification and Validation of a Conceptual Model of the Auto-Rigging Payload Handling and Off-Loading System Using LEGO Technic System and Three-Dimensional Printed Parts

A conceptual model (CM) can be used to validate a concept in modeling and simulation life cycles. During the 2020-2022 Coronavirus disease 2019 (COVID-19) pandemic, for employee safety NASA implemented center closures and mandatory telework for the entire workforce. During this challenging time, engineers and researchers at NASA Langley Research Center (LaRC) looked for safe and innovative approaches and methods to continue the development of CMs for various projects. Engineers and researchers at LaRC researched Auto-Rigging Payload Handling and Off-Loading System (ARPHOLS) for payload handing and off-loading a system on an inclined lunar lander deck. In this paper, the development of a CM and the verification and validation of a conceptual idea for ARPHOLS using a LEGO Technic system and three-dimensional printed parts is presented.

Payload offloading↗

NASA NTRSDate not supplied

Validation of a Two-Phase CFD Model for Predicting Tank Self-Pressurization in the Ground-Based K-Site Experiment

A two-phase CFD model for self-pressurization of a cryogenic storage tank partially filled with liquid hydrogen is presented using the Volume-Of-Fluid approach for modeling two-phase flow, as well as interfacial heat, mass and momentum transfer between the liquid and the vapor regions. The CFD model is validated against self-pressurization experiment performed using the K-site flightweight hydrogen storage tank at NASA Glenn Research Center1. Laminar and turbulent simulations are performed together with conjugated heat transfer analysis. Effects of turbulence, the value of accommodation coefficient used for predicting phase change rates, as well as tank wall geometry are presented and discussed. Predicted tank pressures, fluid and wall temperatures are compared with the experimental data at 49% fill level and two different heat loads for validating this CFD model.

Computational Fluid Dynamics↗

NASA NTRSDate not supplied

Validation and Development of a Fast-Running CFD Model for the No-Vent Fill of Liquid Propellant Tank

CFD↗

NASA NTRSDate not supplied

Validation of a Two-Phase CFD Model for Predicting Tank Self-Pressurization in the Ground-Based K-Site Experiment

A two-phase CFD model for self-pressurization of a cryogenic storage tank partially filled with liquid hydrogen is presented using the Volume-Of-Fluid approach for modeling two-phase flow, as well as interfacial heat, mass and momentum transfer between the liquid and vapor regions. The CFD model is validated against self-pressurization experiment performed using the K-site flightweight hydrogen storage tank at NASA Glenn Research Center 1 . Laminar and turbulent simulations are performed together with conjugate heat transfer analysis. Effects of turbulence, the value of accommodation coefficient used for predicting phase change rates, as well as tank wall geometry are presented and discussed. Predicted tank pressures, fluid and wall temperatures are compared with the experimental data at 49% fill level and two different heat loads for validating this CFD model.

Computational Fluid Dynamics↗

NASA NTRSDate not supplied

Independent Verification and Validation for Artemis I Ascent Integrated Flight Performance Simulation

The NASA Engineering and Safety Center (NESC) has performed independent model development to support cross-model verification for the Space Launch System (SLS) Program since 2012 which culminated, for Artemis I, in a postflight reconciliation analysis of the Artemis I ascent trajectory (validation). This post-flight analysis was completed by both the NESC and the SLS Program. Upon successful completion of the Artemis I mission, multiple preflight simulations of the nominal ascent trajectory were updated with Day of Launch (DOL) conditions and simulated results were compared to reconstructed flight data derived from telemetry measurements. Dispersed trajectories were also produced using a combination of DOL conditions and preflight uncertainties, which ideally should bound the Artemis I flight data. Finally, multibody dynamics were simulated for some of the separation events to support clearance analyses. This paper focuses on validating and understanding the accuracy of the models by comparing simulated results against the Artemis I flight data. In addition, discrepancies uncovered between simulations led to opportunities to investigate areas for potential model improvement to refine preflight simulations for future Artemis missions. Included in this paper is background on the flight performance simulation tools, the postflight analysis approach, and a comparison of simulation results against the Artemis I flight data. Simulated results were found to generally be in close agreement with each other and the Artemis I flight data.

Jacob Fleck↗

NASA NTRSDate not supplied

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling↗

NASA NTRS2026

Methods for Validation of Random Uncertainty Estimates and Their Applications to Ozone Profiles From Limb-Viewing Satellite Instruments

For satellite measurements of atmospheric composition, the random uncertainty estimates provided by retrieval algorithms might be imperfect due to various approximations used in the retrievals or the presence of unknown error sources. This paper presents an overview of the methods used for the validation of random uncertainty estimates. All methods discussed in this study are categorized, and assumptions and limitations of each method are discussed. This overview evaluates these methods in application to ozone profile measurements from limb and occultation satellite instruments and provides practical illustrations of random uncertainty validation.

Viktoria F Sofieva↗

NASA NTRS2026

Development, Characterization, and Validation of Elevated-Temperature Constitutive Models: Deformation and Damage

This report provides a brief review of experimentally observed hereditary and nonhereditary material behavior along with background information on standard as well as advanced internal state variable constitutive modeling at elevated temperature. A description of exploratory, characterization, and validation testing is presented along with a detailed outline of what constitutes “sufficient” data content (i.e., quality and quantity) for developing or enhancing, characterizing, and validating a particular sophisticated nonlinear time- and history-dependent (hereditary) class of constitutive models known as GVIPS (generalized viscoplasticity with potential structure). The tests described are necessary to reveal a material’s behavior in the reversible (or viscoelastic) and irreversible (or viscoplastic) regimes, for the identification of both deformation and damage model parameters. Results presented are primarily for metallic materials. In all cases, both uniaxial and multiaxial tests are described, and the linkage between the specific tests and the parameters within the model that can be characterized from the results of these tests are also discussed. Discussion is also provided relative to the role information management must play relative to material data collection, analysis, maintenance, and dissemination. The need for such an information system is particularly important as both analyst and designer move toward utilizations of sophisticated, nonlinear time- and history dependent (hereditary) constitutive models. Lastly, the concept of state space and its utility in understanding and establishing constitutive models is addressed throughout. The intent behind this document is to help both the modeler and experimentalist understand each other’s specific points of view and provide guidance for both model development and characterization. Emphasis has been placed on providing the mechanician with information regarding how tests are performed and what issues to be aware of when interpreting results. It is hoped that experimentalists will take away a new perspective on the types of information that modelers and analysts are looking for from them.

Constitutive Modeling↗

DOE OSTI2020

Validation and Parametric Investigations Using a Lumped Thermal Parameter Model of an Internal Permanent Magnet Motor: Preprint

One of the key challenges for the electric vehicle industry is to develop high-power-density electric motors. Achieving higher power density requires efficient heat removal from inside the motor. In order to improve thermal management, a multi-physics modeling framework that is able to accurately predict the behavior of the motor, while being computationally efficient, is essential. This paper first presents a detailed validation of a Lumped Parameter Thermal Network (LPTN) model of an Internal Permanent Magnet (IPM) synchronous motor within the commercially available Motor-CAD® modeling environment. The IPM motor’s stator is studied at steady state, and winding losses are generated by a constant DC current. The validation is based on temperature comparison with experimental data and with more detailed Finite Element Analysis (FEA). All critical input parameters of the LPTN are considered in detail for each layer of the stator, especially the contact resistances between the impregnation, liner, laminations and housing. Finally, a sensitivity analysis for each of the critical input parameters is provided. A maximum difference of 4% - for the highest temperature in the slot windings and the end windings - was found between the LPTN and the experimental data. Comparing the results from the LPTN and the FEA model, the maximum difference was 2% for the highest temperature in the slot windings and end windings. As for the LTPN sensitivity analysis, the thermal parameter with the highest sensitivity was found to be the liner-to-lamination contact resistance. The latter is often ignored in the literature, whereas its impact on temperature rise was found to be more significant than any other contact resistance within the stator.

ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

Using Qualified On-Site Nuclear Power Plant Simulators in Human Factors Validations of Control Room Upgrades

Existing commercial nuclear power plants (NPPs) are valuable assets in the infrastructure portfolio of the United States (U.S.) because they safely and reliably generate about 1/5th of all the electricity used. The instrumentation and control (I&C) systems in commercial NPPs are the ‘eyes and ears' of the operator, allowing operators to maintain situation awareness, thereby allowing the plant to operate safely and efficiently for all phases of operation. Because the I&C systems in NPPs are still mostly based on analog technologies, which are reliable but not especially cost-effective, upgrading the existing I&C in com-mercial NPPs to new digital I&C is very important. Furthermore, simulators and simulation are critical human factors engineering tools for this I&C modernization work. NPP control room simulators are essential test beds to simulate normal, abnormal, and emergency operations that allow human factors researchers to safely and realistically evaluate early design phase prototypes of the upgraded digital I&C, and validate final as-built digital I&C systems that have been modernized deployed in NPPs. This paper describes research performed using qualified on-site NPP simulators to perform human factors validations of digital I&C control room upgrades.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Verification and Validation of Systems in which AI is a Key Element

Many systems are being considered in which artificial intelligence (AI) will be a key element. Failure of an AI element can lead to system failure, hence the need for AI verification and validation (V&V). This article addresses V&V of such a system, focusing on the issues created by characteristics of AI that make V&V challenging. The element(s) containing AI capabilities is treated as a subsystem and V&V is conducted on that subsystem and its interfaces with other elements of the system under study, just as V&V would be conducted on other subsystems. That is, the high-level definitions of verification and of validation do not change for systems containing one or more AI elements. However, AI V&V challenges require approaches and solutions beyond those for conventional or traditional (those without AI elements) systems. This article provides an overview of how machine learning components/subsystems “fit” in the systems engineering framework (Section 1), identifies characteristics of AI subsystems that create challenges in their V&V (Section 2), describes those challenges (Section 3) and provides some potential solutions (Section 4).

Pullum, Laura↗

DOE OSTI2021

Dark Energy Survey Year 3 Results: Multi-Probe Modeling Strategy and Validation

This paper details the modeling pipeline and validates the baseline analysis choices of the DES Year 3 joint analysis of galaxy clustering and weak lensing (a so-called "3$\times$2pt" analysis). These analysis choices include the specific combination of cosmological probes, priors on cosmological and systematics parameters, model parameterizations for systematic effects and related approximations, and angular scales where the model assumptions are validated. We run a large number of simulated likelihood analyses using synthetic data vectors to test the robustness of our baseline analysis. We demonstrate that the DES Year 3 modeling pipeline, including the calibrated scale cuts, is sufficiently accurate relative to the constraining power of the DES Year 3 analyses. Our systematics mitigation strategy accounts for astrophysical systematics, such as galaxy bias, intrinsic alignments, source and lens magnification, baryonic effects, and source clustering, as well as for uncertainties in modeling the matter power spectrum, reduced shear, and estimator effects. We further demonstrate excellent agreement between two independently-developed modeling pipelines, and thus rule out any residual uncertainties due to the numerical implementation.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Verdant Power: Thermoplastic Blade Validation at Full Scale

For the first time in history, thermoplastic composite blades, which have the potential to revolutionize the marine energy industry, are being validated on a large-scale tidal power turbine. Thanks to funding from the U.S. Department of Energy's Water Power Technologies Office and a collaboration with Verdant Power, NREL researchers constructed thermoplastic composite turbine blades and are validating their performance on one of Verdant Power's tidal turbines deployed in New York City's East River.

HYDRO ENERGY↗

DOE OSTI2022

Prototype HB650 Transportation Validation For The PIP-II Project

The PIP-II Project at Fermilab is centered around a superconducting 800 MeV proton linac to upgrade and modernize the Fermilab accelerator complex, allowing increased beam current to intensity frontier experiments such as LBNF-DUNE. PIP-II includes strong international collaborations, including the delivery of 12 cryomodules from European labs to FNAL (3 from STFC-UKRI in the UK and 9 from CEA in France). The transatlantic shipment of these completed modules is identifed as a serious risk for the project. To mitigate this risk, a rigorous and systematic process has been developed to design and validate a transport system, including specifcation, procedures, logistics, and realistic testing. This paper will detail the engineering process used to manage this effort across the collaboration and the results of the first major validation testing of the integrated shipping system prior to use with a cryomodule.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Uniformly Ordered Binary Decision Algorithm for Benchmark Experiment Correlations in Whisper Validation

When performing a validation exercise for determining the upper subcritical limit of a nuclear criticality safety application, an analyst should select and perform a statistical analysis on a population of benchmark experiments that are neutronically similar to the application. The size of this population should be sufficiently large such that the statistical analysis has a high degree of confidence that the bias plus bias uncertainty (calculational margin) has been accurately quantified. A complication arises because many benchmark experiments share common components, leading to correlations in their measured effective multiplication factors. Correlations between benchmark experiments within the population reduces its predictive power. This motivates the need for methods that consider benchmark experiment correlations and ensure adequate statistical significance of results. The Whisper code is a statistical analysis pack- age that incorporates nuclear data sensitivity coefficients from MCNP to assess benchmark experiment similarity and then performs an extreme-value analysis to estimate the bias plus bias uncertainty. The original methodology in Whisper does not consider the effect of benchmark experiment correlations when making this estimation, and this summary proposes the uniformly ordered binary decision algorithm to address this shortcoming. The original methodology in Whisper computes similarity coefficients ck for an application compared to all benchmark experiments in its library and develops weighting factors for a selected population proportional to the ck values. The methodology can be interpreted as statistically emulating a validation exercise for a particular application where the weighting factors may be viewed as the likelihood that an analyst would include a particular benchmark experiment within the population. The effective sample size of the population is the expected or mean number of benchmark experiments in the population. The uniformly ordered binary decision algorithm identifies clusters of correlated benchmark experiments within the population and then computes adjusted weighting factors based on the magnitude of the correlation coefficients within the cluster to compute a reduced effective sample size accounting for the lower information content because of correlations. Benchmark experiments within the cluster are ordered randomly with equal probability and probabilistic decisions are made as to whether a benchmark. experiment within the cluster should treated as redundant with a previous one; if two redundant benchmark experiments are included, then the conservative worst case bias plus bias uncertainty is used and the pair is counted as a single benchmark experiment in the population. Results are provided for HEU solutions in a research version of the Whisper software using benchmark experiment correlations provided by DICE, the Database for the International Criticality Safety Benchmark Evaluation Project (ICSBEP). These show that there can be a significant increase in the bias plus bias uncertainty because the effective sample size is reduced, and therefore the algorithm, needing to meet sample size requirements, expands the benchmark experiment population by accepting less similar benchmark experiments that would have otherwise not been included.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗