Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.↗

Best-estimate Modeling of the High Temperature Test Facility with RELAP5-3D

Prismatic HTGRs are a concept of interest for near-term deployment. While plenty of validation data exist for standalone neutronics or multiphysics modeling, the availability of integral effects thermal hydraulics validation data is more limited. The High Temperature Test Facility provides such data and is used as the basis for the High-Temperature Gas-Cooled Reactor Thermal Hydraulics Benchmark. This presentation presents results of best-estimate modeling of HTTF experiments PG-27 and PG-29 using the RELAP5-3D ring model developed at Idaho National Laboratory.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating Class 6 Delivery Truck Fuel Economy and Emissions Using Vehicle System Simulations for Conventional and Hybrid Powertrains and Co-Optima Fuel Blends

The US Department of Energy’s Co-Optimization of Engine and Fuels Initiative (Co-Optima) investigated how unique properties of bio-blendstocks considered within Co-Optima help address emissions challenges with mixing controlled compression ignition (i.e., conventional diesel combustion) and enable advanced compression ignition modes suitable for implementation in a diesel engine. Additionally, the potential synergies of these Co-Optima technologies in hybrid vehicle applications in the medium- and heavy-duty sector was also investigated. In this work, vehicles system were simulated using the Autonomie software tool for quantifying the benefits of Co-Optima engine technologies for medium-duty trucks. A Class 6 delivery truck with a 6.7 L diesel engine was used for simulations over representative real-world and certification drive cycles with four different powertrains to investigate fuel economy, criteria emissions, and performance. Comparisons were made between ultralow-sulfur diesel and a blend of 25% hexyl hexanoate with diesel. Model validation data were informed by 2019 model year Cummins ISB 6.7 L diesel engine maps and transient validation data in a pre-production hybrid configuration and a direct dyno coupled configuration with diesel fuel and a blend of 25% hexyl hexanoate with diesel.

33 ADVANCED PROPULSION SYSTEMS↗

Using Ground-Based Measurements and Retrievals to Validate Satellite Data

The proposed research is to use the DOE ARM ground-based measurements and retrievals as the ground-truth references for validating satellite cloud results and retrieving algorithms. This validation effort includes four different ways: (1) cloud properties on different satellites, therefore different sensors, TRMM VIRS and TERRA MODIS; (2) cloud properties at different climatic regions, such as DOE ARM SGP, NSA, and TWP sites; (3) different cloud types, low and high level cloud properties; and (4) day and night retrieving algorithms. Validation of satellite-retrieved cloud properties is very difficult and a long-term effort because of significant spatial and temporal differences between the surface and satellite observing platforms. The ground-based measurements and retrievals, only carefully analyzed and validated, can provide a baseline for estimating errors in the satellite products. Even though the validation effort is so difficult, a significant progress has been made during the proposed study period, and the major accomplishments are summarized in the follow.

Dong, Xiquan↗

Development of a Data Platform for High-Temperature Gas-cooled Reactor (HTGR) Nuclear Energy University Program (NEUP) Thermal-Fluid Experiments

Since the U.S. Department of Energy (DOE)’s Office of Nuclear Energy (NE) initiated the Nuclear Energy University Program (NEUP) in 2009, a total of 30 NEUP projects focused on High-Temperature Gas-cooled Reactor (HTGR) thermal-fluid experiments were funded up to fiscal year (FY) 2021. This represents a total DOE investment of approximately $23M over the 12-year period, covering thermal fluid phenomena important to both pebble bed and prismatic HTGR designs. The NEUP projects have produced a large amount of high-quality experimental and computational data that were published in final project reports, journal articles, dissertations, and conference proceedings, but in most cases the actual data sets and supporting information such as facility and instrumentation descriptions were not publicly disseminated to the HTGR community. To the authors’ best knowledge, a data platform that organizes and summarizes these NEUP-funded projects for HTGR research does not currently exist. To improve access to this HTGR validation data and optimize the return on the significant investment made by DOE, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program started a survey of completed and ongoing HTGR NEUP projects with the aim of developing a public-access data platform that can be used to retrieve computational fluid dynamics (CFD) and system code validation data and guide future NEUP investments. This paper summarizes the status of the current ART-GCR database, provides an overview of the NEUP-funded HTGR-related research projects from FY2009 to FY2021 and identify validation knowledge gaps still existing in HTGR thermal-fluid research.

42 ENGINEERING↗

Full-scale flammability test data for validation of aircraft fire mathematical models

Twenty-five large scale aircraft flammability tests were conducted in a Boeing 737 fuselage at the NASA Johnson Space Center (JSC). The objective of this test program was to provide a data base on the propagation of large scale aircraft fires to support the validation of aircraft fire mathematical models. Variables in the test program included cabin volume, amount of fuel, fuel pan area, fire location, airflow rate, and cabin materials. A number of tests were conducted with jet A-1 fuel only, while others were conducted with various Boeing 747 type cabin materials. These included urethane foam seats, passenger service units, stowage bins, and wall and ceiling panels. Two tests were also included using special urethane foam and polyimide foam seats. Tests were conducted with each cabin material individually, with various combinations of these materials, and finally, with all materials in the cabin. The data include information obtained from approximately 160 locations inside the fuselage.

Kuminecz, J. F.↗

TESS Data Release Notes: Sectors 1 – 36, Multi-sector Search, DR53

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). This data release is a combined, multi-sector transit search only. The underlying data products from individual observing sectors have been previously released. The data products included in this data release are the Data Validation (DV) reports, time series, and associated xml files for the threshold crossing events (TCEs) found by searching a combined data set including data from multiple observing sectors. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD)1. The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2020)2. The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018) contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

TESS↗

TESS Data Release Notes: Sectors 1 – 13, Multi-Sector Search, DR20

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). This data release is a combined, multi-sector transit search only. The underlying data products from individual observing sectors have been previously released. The data products included in this data release are the Data Validation (DV) reports, time series, and associated xml les for the threshold crossing events (TCEs) found by searching a combined data set including data from multiple observing sectors. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD)1. The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2017)2. The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018)3 contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

Burke, Christopher J.↗

Insights and Lessons Learned from the NASA Juncture Flow Experiment

The NASA Juncture Flow experiment involved both CFD and wind tunnel measurements in its quest to provide CFD validation data for separated flow in a wing-fuselage corner. The experience has produced not only a wealth of valuable validation data and a new version of a turbulence model, it also yielded many lessons learned. This paper conveys those insights, particularly with respect to the qualities we believe to be essential in a CFD validation experiment. These include wind tunnel characterization and use of CFD as an assessment tool during the validation process. With a considerable number of validation tests already run both by the NASA team as well as by independent groups, a brief assessment is made of CFD’s current ability to predict the corner flow separation.

separation↗

Insights and Lessons Learned from the NASA Juncture Flow Experiment

The NASA Juncture Flow experiment involved both CFD and wind tunnel measurements in its quest to provide CFD validation data for separated flow in a wing-fuselage corner. The experience has produced not only a wealth of valuable validation data and a new version of a turbulence model, it also yielded many lessons learned. This paper conveys those insights, particularly with respect to the qualities we believe to be essential in a CFD validation experiment. These include wind tunnel characterization and use of CFD as an assessment tool during the validation process. With a considerable number of validation tests already run both by the NASA team as well as by independent groups, a brief assessment is made of CFD’s current ability to predict the corner flow separation.

separation↗

High-Temperature Gas-Cooled Reactor Research Survey and Overview: Preliminary Data Platform Construction for the Nuclear Energy University Program

Since the U.S. Department of Energy Office of Nuclear Energy initiated the Nuclear Energy University Program (NEUP) in 2009, there are 29 NEUP projects focusing on high-temperature gas-cooled reactor (HTGR) research up to July 2022. The resultant research product, either experimental or computational, were published as final NEUP reports, journal articles and conference proceedings. However, these federally funded products have been scattered and sometimes cannot be easily accessed. To improve access to this valuable HTGR validation data and optimize the return on the significant investment made by the Department of Energy, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program started a survey of completed and ongoing HTGR NEUP projects to develop a public-access database specific for HTGRs applications that can be used to retrieve computational fluid dynamics and system code validation data. This effort will help guide future NEUP-funded research, define new state of the ART Phenomena Identification and Ranking Table (PIRT), and promote the usage of this data in the codes validation matrices. This report provides an overview of the NEUP-funded HTGR-related research projects from Fiscal Year (FY) 2009–2021 and identifies validation knowledge gaps still existing in HTGR thermal-fluid research. A preliminary data platform has been developed for the 29 NEUP projects investigating HTGR thermal hydraulics, including their final reports as well as the available scientific publications. As an ultimate goal for this work, the ART-GCR program will create a central database at Idaho National Laboratory to identify, organize, and store these datasets generated by experimental investigations or computational models, experimental facility descriptions, and publicly-available academic products from the HTGR-related NEUP projects and provide future guidance for the storage and transmission of important project documentations for later NEUP projects as well.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Utilization of UARS Data in Validation of Photochemical and Dynamical Mechanism in Stratospheric Models

The global three-dimensional measurement of long- and short-lived species from Upper Atmospheric Research Satellite (UARS) provides a unique opportunity to validate chemistry and dynamics mechanisms in the middle atmosphere. During the past three months, we focused on expanding our study of data-model comparisons to whole time periods when Cryogenic Limb Array Etalon Spectrometer (CLAES) instrument were operating.

Rodriquez, Jose M.↗

Test and Analysis of Full-Scale 27.5-Foot-Diameter Stiffened Metallic Launch Vehicle Cylinders

The Shell Buckling Knockdown Factor Project (SBKF) was established with the goal of developing improved (i.e., less-conservative, more robust) shell buckling knockdown factors (KDFs) for modern launch-vehicle structures. To this end, SBKF has engaged in several activities to support the development, validation, and implementation of the new design factors, including subscale and full-scale structural testing. Tests on eight different subscale, 8-foot-diameter, integrally stiffened aluminum-lithium 2195 (Al-Li 2195) cylinders were conducted in order to obtain the majority of the required validation data. In addition, two full-scale, 27.5-foot-diameter, Al-Li 2195, integrally stiffened cylinders were tested to provide additional validation data and to determine structural scaling trends. Presented herein are the details of a recent analysis model development and test and analysis correlation effort on the full-scale test articles. The effects of selected modeling assumptions and approaches are discussed, and results from a modeling sensitivity study are presented. It was found that simplified finite element models, that assume nominal test article geometry and material properties, can predict the overall response characteristics well. However, several discrepancies in the test and analysis results were observed. A sensitivity study was performed to determine the effects of several modeling assumptions and address the observed discrepancies. The results from the study indicated that the evolution of local skin pocket buckling and the presence of residual stresses due to the manufacturing process can have a significant influence on the predicted buckling response of the cylinders considered.

Lovejoy, Andrew E.↗

Validating Nuclear Data Uncertainties Obtained from a Statistical Analysis of Experimental Data with the “Physical Uncertainty Bounds” Method

Concerns within the nuclear data community led to substantial increases of Neutron Data Standards (NDS) uncertainties from its previous to the current version. For example, those associated with the NDS reference cross section 239 Pu(n,f) increased from 0.6–1.6% to 1.3–1.7% from 0.1–20 MeV. These cross sections, among others, were adopted, e.g., by ENDF/B-VII.1 (previous NDS) and ENDF/B-VIII.0 (current NDS). There has been a strong desire to be able to validate these increases based on objective criteria given their impact on our understanding of various application uncertainties. Here, the “Physical Uncertainty Bounds” method (PUBs) by Vaughan et al. is applied to validate evaluated uncertainties obtained by a statistical analysis of experimental data. We investigate with PUBs whether ENDF/B-VII.1 or ENDF/B-VIII.0 239 Pu(n,f) cross-section uncertainties are more realistic given the information content used for the actual evaluation. It is shown that the associated conservative (1.5–1.8%) and minimal realistic (1.1–1.3%) uncertainty bounds obtained by PUBs enclose ENDF/B-VIII.0 uncertainties and indicate that ENDF/B-VII.1 uncertainties are underestimated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comprehensive framework for data-driven model form discovery of the closure laws in thermal-hydraulics codes

The two-phase two-fluid model is a basis of many thermal-hydraulics codes used in design, licensing, and safety considerations of nuclear power plants. Thermal-hydraulics codes rely on the closure laws to close the system of conservation equations and describe the interactions between phases. These laws, derived from years of experimental investigations, are semi-empirical correlations that lack generality and have a limited range of applicability. Increase of computational power, availability of new experiments, and development of high-fidelity simulations has increased the number of validation data. The discrepancies between the code predictions and the validation data are a great source of knowledge. Missing physics that are not included in the model but are important for the considered phenomena can be discovered by propagating the information from the experimental results through the model. Furthermore, physics-discovered data-driven model form (P3DM) methodology integrates available integral effect tests and separate effects tests to determine the necessary corrections to the model form of the closure laws. In contrast to existing calibration techniques, the methodology modifies the functional form of the closure laws. Based on the functional form of the correction, the missing physics that were not included in the original model can be discovered. The methodology provides the alternative to the machine learning approach, in which the model is discovered in the form of the intractable black-box relation. In this work, the methodology was applied to the CTF subchannel code to improve the prediction of the two-phase flow phenomena.

42 ENGINEERING↗

AVT-297 Development of a Framework for Validation of Computational Tools

Design of aerospace vehicles relies on system models. These models rely on validation data to ensure accurate representation of the system. This paper provides an introduction to the problem and an overview of a NATO STO Activity, AVT-297, which developed a framework to determine validation experiments required to support system level models. The goals of the research group were to develop a process to identify a validation database for intended uses of a vehicle system, demonstrate the process on vehicles and document the process. Applying this process to multiple intended uses and collecting this set of validation databases identifies a set of validation experiments that could be applied to the design of multiple vehicles, further reducing the cost and time to develop air and naval vehicles. Four subgroup teams focused on different aspects of the validation database process: two focused on different aspects of a missile, and two focused on different aspects of a fixed-wing mobility transport class vehicle. This resulted in three different processes to decompose the multi-disciplinary problem to identify critical validation data. All four of the teams demonstrated their process on a sample problem demonstrating the benefit of the process.

Validation↗

Investigating Fission Reaction Rate Ratio Sensitivities [Abstract]

Reaction rate ratios are a measurable parameter for reactor and criticality applications. A number of foil irradiations and fission chamber measurements have been performed for critical assemblies at Los Alamos National Laboratory starting in the 1950’s including (i) Godiva, a bare HEU spherical assembly; (ii) Flattop-25, a spherical assembly consisting of an HEU core and a natural uranium reflector; (iii) Jezebel, a bare 239 Pu assembly; and (iv) Flattop-Pu, a spherical assembly consisting of a 239Pu core and a natural uranium reflector. Fission ratio data for 238 U(n,f)/ 235 U(n,f), 237 Np(n,f)/ 235 U(n,f), 233 U(n,f)/ 235 U(n,f) and 239 Pu(n,f)/ 235 U(n,f) were obtained and reported. The EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data) project at Los Alamos National Laboratory (LANL) aims to constrain nuclear data by using a suite of measurement types beyond k-effective. Recent investigations include the use of pulsed spheres for nuclear data validation and other measurement methods of interest. One focus of the work is to determine if other methods are complimentary to the critical experiments utilized for nuclear data validation. It is anticipated the investigations will help inform methods that may be utilized in machine learning algorithms for nuclear validation. In order to use a measurement type for nuclear validation, it is necessary to obtain cross-section sensitivities for parameters. This work looks at reaction rate ratio sensitivities with SENSMG and Monte Carlo N-Particle R Code Version 6.21.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Improved Hydrology over Peatlands in a Global Land Modeling System

Peatlands of the Northern Hemisphere represent an important carbon pool that mainly accumulated since the last ice age under permanently wet conditions in specific geological and climatic settings. The carbon balance of peatlands is closely coupled to water table dynamics. Consequently, the future carbon balance over peatlands is strongly dependent on how hydrology in peatlands will react to changing boundary conditions, e.g. due to climate change or regional water level drawdown of connected aquifers or streams. Global land surface modeling over organic-rich regions can provide valuable global-scale insights on where and how peatlands are in transition due to changing boundary conditions. However, the current global land surface models are not able to reproduce typical hydrological dynamics in peatlands well. We implemented specific structural and parametric changes to account for key hydrological characteristics of peatlands into NASA's GEOS-5 Catchment Land Surface Model (CLSM, Koster et al. 2000). The main modifications pertain to the modeling of partial inundation, and the definition of peatland-specific runoff and evapotranspiration schemes. We ran a set of simulations on a high performance cluster using different CLSM configurations and validated the results with a newly compiled global in-situ dataset of water table depths in peatlands. The results demonstrate that an update of soil hydraulic properties for peat soils alone does not improve the performance of CLSM over peatlands. However, structural model changes for peatlands are able to improve the skill metrics for water table depth. The validation results for the water table depth indicate a reduction of the bias from 2.5 to 0.2 m, and an improvement of the temporal correlation coefficient from 0.5 to 0.65, and from 0.4 to 0.55 for the anomalies. Our validation data set includes both bogs (rain-fed) and fens (ground and/or surface water influence) and reveals that the metrics improved less for fens. In addition, a comparison of evapotranspiration and soil moisture estimates over peatlands will be presented, albeit only with limited ground-based validation data. We will discuss strengths and weaknesses of the new model by focusing on time series of specific validation sites.

Bechtold, M.↗