Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

A Standardized Analysis Process Using Digital Image Correlation to Calculate In Situ Cladding Strain from Modified Burst Tests for Fuel Performance Code Validation

Historical data collection on nuclear fuel cladding materials has focused on generating a statistically significant amount of data to assess the material and its failure behavior. Furthermore, data generated to support material model and failure criteria development were previously posttest evaluations, so a large number of tests was required to gain new understanding. A way to expedite this process is to develop techniques capable of generating large, high-fidelity data sets from a single test with lower uncertainty or quantified uncertainty. One such example of this approach is Oak Ridge National Laboratory’s use of modified burst tests (MBTs) to analyze the mechanical behavior and failure conditions of cladding during a simulated reactivity-initiated accident (RIA). Each test incorporates digital image correlation (DIC) analysis techniques that are used to assess the accumulated strain in situ, as well as eventual cladding failure. This work has been fruitful in defining strain-to-failure conditions for materials like silicon carbide (SiC) fiber–reinforced/SiC matrix composite tubes (SiC/SiC), iron-chromium-aluminum (FeCrAl) alloy tubes, and chromium-coated Zircaloy-4 tubes. However, there are numerous DIC software available, including open-source and proprietary software. The different DIC software use various algorithms to process images and calculate displacement values. Using these different software and algorithms can lead to varying results, and perhaps larger-than-expected uncertainties. In the present study, previously published MBT data encompassing a variety of test conditions were reanalyzed with two different DIC software to assess the variance in the calculated strain results. The data consisted of SiC/SiC, FeCrAl, and chromium-coated Zircaloy-4 tubes. Plots of the calculated strains during the transient revealed good agreement between the two DIC software. The average root-mean-square errors between the two software was 0.20% strain, which is slightly larger than a previously reported error value for these tests. In conclusion, this variance in results is low enough that this analysis method can be used for code validation.

Reactivity-initiated accident↗

Making Invisible Visible: Data-Driven Seismic Inversion With Spatio-Temporally Constrained Data Augmentation

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of obtaining data through expensive physical experiments, instruments, and simulations, data augmentation techniques for scientific applications have emerged as a new direction for obtaining scientific data recently. However, existing data augmentation techniques originating from computer vision yield physically unacceptable data samples that are not helpful for the domain problems that we are interested in. In this article, we develop new data augmentation techniques based on convolutional neural networks. Specifically, our generative models leverage different physics knowledge (such as governing equations, observable perception, and physics phenomena) to improve the quality of the synthetic data. To validate the effectiveness of our data augmentation techniques, we apply them to solve a subsurface seismic full-waveform inversion using simulated CO 2 leakage data. Our interest is to invert for subsurface velocity models associated with very small CO 2 leakage. We validate the performance of our methods using comprehensive numerical tests. Here via comparison and analysis, we show that data-driven seismic imaging can be significantly enhanced by using our data augmentation techniques. Particularly, the imaging quality has been improved by 15% in test scenarios of general-sized leakage and 17% in small-sized leakage when using an augmented training set obtained with our techniques.

58 GEOSCIENCES↗

Aeromechanical stability analysis of COPTER

A plan was formed for developing a comprehensive, second-generation system with analytical capabilities for predicting performance, loads and vibration, handling qualities, aeromechanical stability, and acoustics. This second-generation system named COPTER (COmprehensive Program for Theoretical Evaluation of Rotorcraft) is designed for operational efficiency, user friendliness, coding readability, maintainability, transportability, modularity, and expandability for future growth. The system is divided into an executive, a data deck validator, and a technology complex. At present a simple executive, the data deck validator, and the aeromechanical stability module of the technology complex were implemented. The system is described briefly, the implementation of the technology module is discussed, and correlation data presented. The correlation includes hingeless-rotor isolated stability, hingeless-rotor ground-resonance stability, and air-resonance stability of an advanced bearingless-rotor in forward flight.

Yin, Sheng K.↗

Simulating the Autonomous Future: A Look at Virtual Vehicle Environments and How to Validate Simulation Using Public Data Sets

The rapid evolution of autonomous vehicles (AVs) has exposed the need for fast-paced development and testing processes of a variety of perception, planning, and control algorithms. To expedite development, the AV industry and researchers leverage virtual vehicle environments to simulate a range of test scenarios that may otherwise be costly or difficult to conduct on a real test track. However, the various virtual environments may have different results depending on the fidelity of various simulation features, such as vehicle dynamics, sensor simulation, and environment recreation. Herein, this tutorial article examines a proposed framework for constructing, parameterizing, and validating a virtual vehicle environment using an existing AV data set. First, an overview of several open source and commercially available simulation tools, including their associated workflows, for scene and scenario creation is presented. Next, various open AV data sets are examined to inform the data set selection for the validation framework. Then, an example workflow of recreating a real-world scene from the selected data set in a simulation tool with various emulated sensors parameterized to match the data set is demonstrated. Finally, an example AV-perception algorithm is subjected to data streams from virtual and real-world environments and suggested metrics for analyzing the results are discussed.

42 ENGINEERING↗

Proposed Ground Testing Standard Methods and Techniques

The methodologies used for prediction for on-orbit microgravity environment needs to be ground validated. The data and models for such validation will be coming from diverse sources. No standardized methodologies have been validated which cover the entire 0 - 300 Hz range. Current ground test data feeds into this process and therefore should be standardized to support both narrow and third octave band analysis.

Goodnight, Thomas↗

Comprehensive Analysis of Streaming and Shutdown Dose Rate Experiments at JET with ORNL Fusion Neutronics Workflows

Current experimental fusion systems and conceptual designs of fusion pilot plants (FPPs) are growing in complexity and size. Several radiation metrics are crucial to the safe operation of fusion machines, including neutron flux streaming through openings and the shutdown dose rate (SDDR). Most current designs of advanced experimental fusion systems—and the most probable candidates for FPPs—are based on the tokamak concept, which is prone to neutron streaming through the myriad openings needed for diagnostic and support systems. SDDR is caused by decay gamma rays from radionuclides that become activated by neutrons during the operation of a fusion system that use deuterium-deuterium (DD), tritium-tritium, or deuterium-tritium plasma. Because computational tools have become essential for determining these radiation metrics, they must be validated against reliable and applicable experimental data. Experiments at the Joint European Torus (JET) provide a unique source of experimental data for validating computational tools and nuclear data used to determine SDDR and neutron fluxes in streaming-dominated geometries. Here, this paper presents the comprehensive analysis of the high-performance DD JET SDDR, and streaming experiments performed using Oak Ridge National Laboratory (ORNL) fusion workflows. The computational results were compared with experimental results that consist of online SDDR measurements with ionization chambers and neutron fluence streaming measurements using thermoluminescent detectors. The ratio of calculated-to-experimental SDDR values ranges from 0.6 to 2.5, and the streaming results range from 0.5 to 8.0. Future work will include analyzing the JET 2021 DTE2 campaign alongside the integration of the Shift Monte Carlo transport code into all ORNL fusion neutronics workflows.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Estimating IDP Origins Using ACLED Political Violence Events: Validation with Lebanon IDP Flow Data

A key input in modeling population distribution and flows following conflict events is the inclusion of Internally Displaced Person (IDP) flows between administrative units within a country. These flows are critical for capturing population movement and redistribution driven by current events, particularly conflict. In some cases, IDP destination data are available while origin data is incomplete or unavailable. This creates a gap in understanding where displacement is occurring, limiting the ability to model population redistribution accurately. Without origin data, it is not possible to reallocate population flows or accurately represent where displacement is occurring within the country. This report evaluates whether Armed Conflict Location Event Data (ACLED) political violence event data can be used to estimate IDP origin distributions when direct origin data are unavailable. The approach is validated using historical IDP flow data from Lebanon, where both origins and destinations are observed. Results show that ACLED event distributions strongly correspond to observed IDP-origin patterns, particularly when using cumulative 60-day event windows. The method is most reliable for identifying major origin districts and approximating proportional origin shares. However, it is not intended to reconstruct exact individual displacement flows, but rather to provide a probabilistic spatial allocation of displacement origins.

99 GENERAL AND MISCELLANEOUS↗

Investigation of HZETRN 2010 as a Tool for Single Event Effect Qualification of Avionics Systems

NASA's future missions are focused on deep space for human exploration that do not provide a simple emergency return to Earth. In addition, the deep space environment contains a constant background Galactic Cosmic Ray (GCR) radiation exposure, as well as periodic Solar Particle Events (SPEs) that can produce intense amounts of radiation in a short amount of time. Given these conditions, it is important that the avionics systems for deep space human missions are not susceptible to Single Event Effects (SEE) that can occur from radiation interactions with electronic components. The typical process to minimizing SEE effects is through using heritage hardware and extensive testing programs that are very costly. Previous work by Koontz, et al. [1] utilized an analysis-based method for investigating electronic component susceptibility. In their paper, FLUKA, a Monte Carlo transport code, was used to calculate SEE and single event upset (SEU) rates. This code was then validated against in-flight data. In addition, CREME-96, a deterministic code, was also compared with FLUKA and in-flight data. However, FLUKA has a long run-time (on the order of days), and CREME-96 has not been updated in several years. This paper will investigate the use of HZETRN 2010, a deterministic transport code developed at NASA Langley Research Center, as another tool that can be used to analyze SEE and SEU rates. The benefits to using HZETRN over FLUKA and CREME-96 are that it has a very fast run time (on the order of minutes) and has been shown to be of similar accuracy as other deterministic and Monte Carlo codes when considering dose [2, 3, 4]. The 2010 version of HZETRN has updated its treatment of secondary neutrons and thus has improved its accuracy over previous versions. In this paper, the Linear Energy Transfer (LET) spectra are of interest rather than the total ionizing dose. Therefore, the LET spectra output from HZETRN 2010 will be compared with the FLUKA and in-flight data to validate HZETRN 2010 as a computational tool for SEE qualification by analysis. Furthermore, extrapolation of these data to interplanetary environments at 1 AU will be investigated to determine whether HZETRN 2010 can be used successfully and confidently for deep space mission analyses.

Rojdev, Kristina↗

High-Area-Ratio Rocket Nozzle at High Combustion Chamber Pressure: Experimental and Analytical Validation

Experimental data were obtained on an optimally contoured nozzle with an area ratio of 1025:1 and on a truncated version of this nozzle with an area ratio of 440:1. The nozzles were tested with gaseous hydrogen and liquid oxygen propellants at combustion chamber pressures of 1800 to 2400 psia and mixture ratios of 3.89 to 6.15. This report compares the experimental performance, heat transfer, and boundary layer total pressure measurements with theoretical predictions of the current Joint Army, Navy, NASA, Air Force (JANNAF) developed methodology. This methodology makes use of the Two-Dimensional Kinetics (TDK) nozzle performance code. Comparisons of the TDK-predicted performance to experimentally attained thrust performance indicated that both the vacuum thrust coefficient and the vacuum specific impulse values were approximately 2.0-percent higher than the turbulent prediction for the 1025:1 configurations, and approximately 0.25-percent higher than the turbulent prediction for the 440:1 configuration. Nozzle wall temperatures were measured on the outside of a thin-walled heat sink nozzle during the test fittings. Nozzle heat fluxes were calculated front the time histories of these temperatures and compared with predictions made with the TDK code. The heat flux values were overpredicted for all cases. The results range from nearly 100 percent at an area ratio of 50 to only approximately 3 percent at an area ratio of 975. Values of the integral of the heat flux as a function of nozzle surface area were also calculated. Comparisons of the experiment with analyses of the heat flux and the heat rate per axial length also show that the experimental values were lower than the predicted value. Three boundary layer rakes mounted on the nozzle exit were used for boundary layer measurements. This arrangement allowed total pressure measurements to be obtained at 14 different distances from the nozzle wall. A comparison of boundary layer total pressure profiles and analytical predictions show good agreement for the first 0.5 in. from the nozzle wall; but the further into the core flow that measurements were taken, the more that TDK overpredicted the boundary layer thickness.

Jankovsky, Robert S.↗

Crack Growth Behavior in the Threshold Region for High Cycle Fatigue Loading

This paper describes the results of a research program conducted to improve the understanding of fatigue crack growth rate behavior in the threshold growth rate region and to answer a question on the validity of threshold region test data. The validity question relates to the view held by some experimentalists that using the ASTM load shedding test method does not produce valid threshold test results and material properties. The question involves the fanning behavior observed in threshold region of da/dN plots for some materials in which the low R-ratio data fans out from the high R-ratio data. This fanning behavior or elevation of threshold values in the low R-ratio tests is generally assumed to be caused by an increase in crack closure in the low R-ratio tests. Also, the increase in crack closure is assumed by some experimentalists to result from using the ASTM load shedding test procedure. The belief is that this procedure induces load history effects which cause remote closure from plasticity and/or roughness changes in the surface morphology. However, experimental studies performed by the authors have shown that the increase in crack closure is a result of extensive crack tip bifurcations that can occur in some materials, particularly in aluminum alloys, when the crack tip cyclic yield zone size becomes less than the grain size of the alloy. This behavior is related to the high stacking fault energy (SFE) property of aluminum alloys which results in easier slip characteristics. Therefore, the fanning behavior which occurs in aluminum alloys is a function of intrinsic dislocation property of the alloy, and therefore, the fanned data does represent the true threshold properties of the material. However, for the corrosion sensitive steel alloys tested in laboratory air, the occurrence of fanning results from fretting corrosion at the crack tips, and these results should not be considered to be representative of valid threshold properties because the fanning is eliminated when testing is performed in dry air.

Forman, R. G.↗

NASA HECC Geometry and Performance Review Part 1: Validation of a Computational Model for the Vaneless Diffuser Configuration with As-Manufactured Impeller Geometry

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation presents an extensive validation of the computational model against experimental data. The validated model was then used to explore the effects geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Part I of the investigation focused on describing the HECC vaneless computational model and its validation against the experimental data published in GT2023-103128. To generate the model, a verification of the manufactured impeller was performed and was confirmed to match the impeller CAD. Section data from the impeller CAD, referred to as the As-Manufactured geometry, were used for development of the computational model. Steady RANS simulations utilizing the Wilcox K-Omega 98 turbulence model and a multiblock structured mesh were used to conduct a mesh convergence study. The resultant mesh was then used for simulations at both design-speed and off-design speed conditions. The simulations compared well to data in both 1D and 2D terms for the major performance metrics of efficiency, total pressure rise, and total temperature rise. Based on the observed results the model was deemed validated and was used in the latter two parts of the multipart investigation.

centrifugal compressor↗

Utilization of Airborne and in Situ Data Obtained in SGP99, SMEX02, CLASIC and SMAPVEX08 Field Campaigns for SMAP Soil Moisture Algorithm Development and Validation

Field experiment data sets that include coincident remote sensing measurements and in situ sampling will be valuable in the development and validation of the soil moisture algorithms of the NASA's future SMAP (Soil Moisture Active and Passive) mission. This paper presents an overview of the field experiment data collected from SGP99, SMEX02, CLASIC and SMAPVEX08 campaigns. Common in these campaigns were observations of the airborne PALS (Passive and Active L- and S-band) instrument, which was developed to acquire radar and radiometer measurements at low frequencies. The combined set of the PALS measurements and ground truth obtained from all these campaigns was under study. The investigation shows that the data set contains a range of soil moisture values collected under a limited number of conditions. The quality of both PALS and ground truth data meets the needs of the SMAP algorithm development and validation. The data set has already made significant impact on the science behind SMAP mission. The areas where complementing of the data would be most beneficial are also discussed.

Soil moisture↗

Validation of Soil Moisture Data Products from the NASA SMAP Mission

The National Aeronautics and Space Administration (NASA)Soil Moisture Active Passive(SMAP) mission has been validatingits soil moisture (SM) products since the start of data production onMarch 31, 2015. Prior to launch, the mission defined a set of criteria for core validation sites (CVS) that enable the testing of the key mission SM accuracy requirement(unbiased root-mean-square error <0.04 m3/m3). Thevalidation approach also includes other (“sparse network”) in situSM measurements, satellite SM products, model-based SM products, and field experiments. Over the past six years, the SMAP SM products have been analyzed with respect to thesereference data,and the analysis approaches themselves have been scrutinizedin an effort to best understand the products’ performance. Validation of themost recent SMAP Level 2 and 3 SMretrievalproducts (R17000) shows that the L-band (1.4 GHz) radiometer-based SM record continues to meet mission requirements. The products aregenerallyconsistentwith SM retrievals from the European Space Agency (ESA)Soil Moisture Ocean Salinity mission, althoughthere aredifferencesin some regions. The high-resolution (3-km) SM retrieval product,generated by combining Copernicus Sentinel-1 data with SMAP observations,performswithin expectations. Currently, however,there is limited availability of3-kmCVSdatato support extensive validation at this spatial scale. The most recent (version 5)SMAP Level4 SMdata assimilation productprovidingsurface and root-zone SM with complete spatio-temporal coverageat 9-km resolution also meets performance requirements. The SMAP SM validation program will continue throughout the mission life; futureplans include expanding ittoforestedand high-latituderegions

SMAP↗

Numerical Investigation of the Effect of Trailing Edge Thickness of Simulated CMC Blades on Loss Profiles

To understand such an aerodynamic characteristic of the CMC blades, we numerically simulated three different CMC blades with varying trailing edge thicknesses. We utilized both Large Eddy simulation (LES) with the dynamic subgrid closure as well a recently implemented Reynolds-averaged Navier-Stokes (RANS) coupled with an intermittency function-based transition model. We considered two sets of experimental test points with different Reynolds numbers at a given high-free stream turbulence range (Tu=~10-13%). The LES was previously validated by comparing with experimental data. We validated the RANS transition model against the ERCOFTAC experimental zero-pressure gradient smooth flat plate boundary layer at low- and high freestream turbulence offered by the experimental data of the Stripf’s for a turbine blade. We confirmed that the predicted skin friction and the heat flux agree well with the data. Finally, we computed the predicted pressure loading profiles, total loss distributions, and integrated loss of the three different CMC blades and made comparisons against the experimental data acquired at NASA Glenn Transonic Turbine Blade Cascade Rig. Our paper will present the aforementioned results and discuss the ability of LES and RANS model of our choice to predict salient aerodynamic characteristics of the blades with the various trailing edge thickness effects.

LES↗

Numerical Investigation of the Effect of Trailing Edge Thickness of Simulated CMC Blades on Loss Profiles

To understand such an aerodynamic characteristic of the CMC blades, we numerically simulated three different CMC blades with varying trailing edge thicknesses. We utilized both Large Eddy simulation (LES) with the dynamic subgrid closure as well a recently implemented Reynolds-averaged Navier-Stokes (RANS) coupled with an intermittency function-based transition model. We considered two sets of experimental test points with different Reynolds numbers at a given high-free stream turbulence range (Tu=~10-13%). The LES was previously validated by comparing with experimental data. We validated the RANS transition model against the ERCOFTAC experimental zero-pressure gradient smooth flat plate boundary layer at low- and high freestream turbulence offered by the experimental data of the Stripf’s for a turbine blade. We confirmed that the predicted skin friction and the heat flux agree well with the data. Finally, we computed the predicted pressure loading profiles, total loss distributions, and integrated loss of the three different CMC blades and made comparisons against the experimental data acquired at NASA Glenn Transonic Turbine Blade Cascade Rig. Our paper will present the aforementioned results and discuss the ability of LES and RANS model of our choice to predict salient aerodynamic characteristics of the blades with the various trailing edge thickness effects.

LES↗

Validation of ENDF/B-VIII.1 Nuclear Data Files [Slides]

ENDF-6 formatted files were processed into A Compact ENDF (ACE) files using NJOY2016. Several validation tests were performed: (1) LANL Legacy Benchmark Suite (2) “Modern” Benchmark Suite (3) HEU Benchmark Suite (4) LEU Benchmark Suite (5) Mixed (U+Pu) Benchmark Suite (6) Pu Benchmark Suite (7) 233 U Benchmark Suite.

97 MATHEMATICS AND COMPUTING↗

Landsat Data Continuity Mission Calibration and Validation

The primary payload for the Landsat Data Continuity Mission (LDCM) is the Operational Land Imager (OLI), being built by Ball Aerospace and Technologies, under contract to NASA. The OLI has spectral bands similar to the Landsat-7 ETM+, minus the thermal band and with two new bands, a 443 nm band and 1375 nm cirrus detection band. On-board calibration systems include two solar diffusers (routine and pristine), a shutter and three sets of internal lamps (routine, backup and pristine). Being a pushbroom opposed to a whiskbroom design of ETM+, the system poses new challenges for characterization and calibration, chief among them being the large focal plane with 75000+ detectors. A comprehensive characterization and calibration plan is in place for the instrument and the data throughout the mission including Ball, NASA and the United States Geological Survey, which will take over operations of LDCM after on-orbit commissioning. Driving radiometric calibration requirements for OLI data include radiance calibration to 5% uncertainty (1 q); reflectance calibration to 3% uncertainty (1 q) and relative (detector-to-detector) calibration to 0.5% (J (r). Driving geometric calibration requirements for OLI include bandto- band registration of 4.5 meters (90% confidence), absolute geodetic accuracy of 65 meters (90% CE) and relative geodetic accuracy of 25 meters (90% CE). Key spectral, spatial and radiometric characterization of the OLI will occur in thermal vacuum at Ball Aerospace. During commissioning the OLI will be characterized and calibrated using celestial (sun, moon, stars) sources and terrestrial sources. The USGS EROS ground processing system will incorporate an image assessment system similar to Landsat-7 for characterization and calibration. This system will have the added benefit that characterization data will be extracted as part of the normal image data processing, so that the characterization data available will be significantly larger than for Landsat-7 ETM+.

Markham, Brian L.↗

RotCFD Software Validation - Computational and Experimental Data Comparison

RotCFD is a software intended to ease the design of NextGen rotorcraft. Since RotCFD is a new software still in the development process, the results need to be validated to determine the software's accuracy. The purpose of the present document is to explain one of the approaches to accomplish that goal.

Experimental Data Comparison↗