Results for “VALIDATION” — Page 49

NASA NTRSDate not supplied

Validation Experiments of Incipient Turbulent Separation over an Axisymmetric Afterbody

Historically, the flow physics involved with most turbulent separated flows have presented fundamental challenges in validation between experimental and numerical approaches. As recognized by the CFD Vision 2030 study commissioned by NASA, validation of Reynolds-averaged Navier-Stokes (RANS) models and other scale-resolving methods for turbulent separated flow requires the support of advanced, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, a new test platform, referred to as the NASA Axisymmetric Afterbody, was designed to obtain detailed information of the flow field over a smooth body, undergoing adverse pressure gradient induced separation for a fixed Reynolds number, Re = 180,000. The parametric body offers a range of flow states from fully attached,incipient separation, to fully separated flow based on variable afterbody geometries. In an initial effort to evaluate RANS turbulence model capabilities, the present configuration of the axisymmetric model features a mild adverse pressure gradient over the contoured boattail section, inducing incipient turbulent separation. Experiments include steady pressure measurements to serve as preliminary comparisons to simulation studies, which examine the effect of variable grid domains and RANS turbulence models, in an effort to understand and evaluate the critical variability between solutions for the present configuration. Results indicate potential discrepancies may be due to the effect of the square tunnel test section walls, relatively large blockage ratio, and inconsistent reference parameters. Ongoing work will focus on the experimental campaigns to obtain surface flow visualizations and high-resolution, off-body flow field measurements using Stereoscopic Particle Image Velocimetry (SPIV) and Laser Doppler Velocimetry (LDV) techniques to provide a detailed benchmark dataset to aid turbulence modelers.

axisymmetric afterbody↗

NASA NTRS2020

Evaluation and Validation of a High Spatial Resolution Satellite Soil Moisture Product over the Continental United States

The soil moisture (SM) data retrieved from the Soil Moisture Active and Passive (SMAP) satellite are available at a 9 km grid spacing since April 2015. This product can provide valuable information for research and applications in hydrology and other related fields. However, the resolution may be too coarse for applications at catchment or field scale. In this study, an established downscaling methodology, which had a major modification regarding its application on the SMAP 33 km domain, was implemented to develop a 1 km soil moisture product based on the SMAP 9 km data. The algorithm proposed here is based on the thermal inertia principle and developed by modeling the relationship between surface temperature difference and SM for different Normalized Difference Vegetation Index (NDVI) classes. The model functions were established and tuned using data from the NASA’s Land Information System (LIS) North America Land Data Assimilation System (NLDAS) and remotely sensed VISible/InfRared (VIS/IR) reflectance data from Long Term Data Record (LTDR) AVHRR (Advanced Very High Resolution Radiometer) for the growing season months of April-September 1981–2018. These were then implemented using the MODIS (Moderate Resolution Imaging Spectroradiometer) data over the Continental United States (CONUS) domain. Validation activities were carried out using in situ measurements distributed through the International Soil Moisture Network (ISMN). The validation results computed using the 1 km SM data showed that the R2, unbiased RMSE (root mean square error) and bias were improved relative to the 9 km SMAP product by 0.045, 0.018m3/m3 and 0.001m3/m3, respectively. The 1 km SM also exhibited a strong time-series autocorrelation. Further accuracy assessment analyses indicated that precipitation might contribute to the uncertainties in both the 9 km SMAP and 1 km downscaled SMAP SM products.

SMAP↗

NASA NTRS2020

How Long Is Too Long? Variogram Analysis of AERONET Data to Aid Aerosol Validation and Intercomparison Studies

Geophysical data sets derived from satellite sensors, ground/airborne instrumentation, and computational models are often compared against each other. A common example is the validation of satellite aerosol optical depth (AOD) retrievals against measurements from Aerosol Robotic Network (AERONET) Sun photometers. Spatiotemporal mismatch between data set sampling means that uncaptured variation in the underlying geophysical field introduces apparent disagreement into such comparisons, known as representation or collocation matchup uncertainty. This study uses variogram analysis of AERONET data to estimate temporal mismatch uncertainties and decorrelation time scales for the global AERONET record. As well as total AOD, the fine‐ and coarse‐mode AODs, Ångström Exponent (AE), and fine‐mode fraction (FMF) of AOD are analyzed. Globally, a time difference of 30 min typically induces from 0.011–0.035 variation in AOD. For total, fine, and coarse AODs the typical time to decorrelation is around 2–10 days. For AE and FMF it is 3–33 days; that is, aerosol systems often persist significantly longer than individual events in them. Biomass burning regions tend to show the largest and fastest subdaily AOD variability and also longest times to decorrelation. Some sites show significant season‐to‐season variations in behavior. These results can be used to inform site‐specific time collocation thresholds for aerosol validation analyses and account for temporal variation when estimating data set uncertainty. They also have implications for comparisons between different satellite products or models, data aggregation, and time series analyses. Results are provided on a site‐by‐site basis to facilitate use by other researchers.

satellite↗

NASA NTRS2022

A validation of satellite derived cyanobacteria detections with state reported events and recreation advisories across U.S. lakes

Cyanobacteria harmful algal blooms (cyanoHABs) negatively affect ecological, human, and animal health. Traditional methods of validating satellite algorithms with data from water samples are often inhibited by the expense of quantifying cyanobacteria indicators in the field and the lack of public data. However, state recreation advisories and other recorded events of cyanoHAB occurrence reported by local authorities can serve as an independent and publicly available dataset for validation. State recreation advisories were defined as a period delimited by a start and end date where a warning was issued due to detections of cyanoHABs over a state’s risk threshold. State reported events were defined as any event that was documented with a single date related to cyanoHABs. This study examined the presence-absence agreement between 160 state reported cyanoHAB advisories and 1,343 events and cyanobacteria biomass estimated by a satellite algorithm called the Cyanobacteria Index (CI(cyano)). The true positive rate of agreement with state recreation advisories was 69% and 60% with state reported events. CI(cyano) detected a reduction or absence in cyanobacteria after 76% of the recreation advisories ended. CI(cyano) was used to quantify the magnitude, spatial extent, and temporal frequency of cyanoHABs; each of these three metrics were greater (r > 0.2) during state recreation advisories compared to non-advisory times with effect sizes ranging from small to large. This is the first study to quantitatively evaluate satellite algorithm performance for detecting cyanoHABs with state reported events and advisories and supports informed management decisions with satellite technologies that complement traditional field observations.

remote sensing↗

NASA NTRSDate not supplied

Fundamental Test of a Hovering Rotor: Comprehensive Measurements for CFD Validation

A model-scale hover test of a 4-bladed, 11.08-ft diameter rotor was recently completed inside the National Full-Scale Aerodynamics Complex 80- by 120-Foot Wind Tunnel test section. The primary objective of the test was to acquire key experimental data for a hovering rotor of sufficient quality and quantity to allow validation of state-of-the-art analysis codes. A comprehensive measurement set has been acquired, including rotor performance, blade airloads, flow transition locations, blade deflections, and wake geometry for a range of tip Mach numbers and collective settings. The present paper provides an overview of the test, including detailed descriptions of the hardware, instrumentation, and measurement systems. In addition, the specific test objectives, approach, and sample results are presented. The full test database, as well as detailed rotor geometry information, will ultimately be shared openly on a NASA-sponsored website to serve as a benchmark validation dataset.

Hover↗

NASA NTRS2022

Evaluating the Calibration and Validation of the Clouds and the Earth’s Radiant Energy System (CERES) instruments on Terra and Aqua Over Twenty Years

Six Clouds and the Earth’s Radiant Energy System (CERES) instruments on four satellites are used to produce a global continuous multi-decadal record of Earth’s radiation budget (ERB) at the top-of-atmosphere (TOA). Each CERES instrument was calibrated and characterized on the ground before launch, while post-launch calibration is conducted using on-board calibration sources. The performance of the CERES instruments is verified using vicarious approaches involving both Earth and celestial targets. In this paper, we describe the calibration and validation approach and demonstrate the performance of the CERES instruments on the Terra and Aqua spacecrafts over the twenty-year period since launch. Validation results demonstrate that after applying the appropriate calibration corrections, all four instruments are stable and perform consistently with each other. Comparisons of observations between instruments on the two spacecrafts during orbital crossings further confirm the consistent performance across all instruments over the twenty year period.

Terra↗

NASA NTRSDate not supplied

Verification and Validation of a Conceptual Model of the Auto-Rigging Payload Handling and Off-Loading System Using LEGO Technic System and Three-Dimensional Printed Parts

A conceptual model (CM) can be used to validate a concept in modeling and simulation life cycles. During the 2020-2022 Coronavirus disease 2019 (COVID-19) pandemic, for employee safety NASA implemented center closures and mandatory telework for the entire workforce. During this challenging time, engineers and researchers at NASA Langley Research Center (LaRC) looked for safe and innovative approaches and methods to continue the development of CMs for various projects. Engineers and researchers at LaRC researched Auto-Rigging Payload Handling and Off-Loading System (ARPHOLS) for payload handing and off-loading a system on an inclined lunar lander deck. In this paper, the development of a CM and the verification and validation of a conceptual idea for ARPHOLS using a LEGO Technic system and three-dimensional printed parts is presented.

Design↗

NASA NTRSDate not supplied

Validation of Loci-Stream for Autogenous Pressurization of Cryogenic Propellant Tank

Autogenous pressurization of cryogenic propellant tanks eliminates the need to have an additional pressurant tank on the space vehicle, which is highly advantageous due to reduced vehicle mass and design complexity. Autogenous pressurization therefore is one of the key technologies for deep space exploration and long-term space missions. The complex interaction of thermal gradients, turbulence and phase change near the interface make the problem a challenging one to model. Nodal analysis tools and reduced order models are unable to capture the necessary physics. 3-D CFD analyses are necessary to fully characterize autogenous pressurization. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. NASA MSFC's Loci-Stream CFD tool along with the VOF module is a great candidate to fit this mold. We demonstrate our modeling approach and validation of Loci-Stream for predicting autogenous pressurization of a flight scale propellant tank in order for the solver to serve as a reliable design and analysis tool for NASA's CFM application needs. Liquid hydrogen tank pressurization tests carried out at the MSFC test stand 300 facilities provide reliable validation data for this purpose. These tests were modeled using the Loci-Stream solver with a newly implemented two-phase sharp interface treatment. We show that our modeling approach and CFD solver predict the autogenous pressurization phenomena satisfactorily, and document challenging aspects of modeling this problem.

cryogenic fluid management↗

NASA NTRSDate not supplied

Validation of Loci-Stream for Autogenous Pressurization of Cryogenic Propellant Tank

Autogenous pressurization of cryogenic propellant tanks eliminates the need to have an additional pressurant tank on the space vehicle, which is highly advantageous due to reduced vehicle mass and design complexity. Autogenous pressurization therefore is one of the key technologies for deep space exploration and long-term space missions. The complex interaction of thermal gradients, turbulence and phase change near the interface make the problem a challenging one to model. Nodal analysis tools and reduced order models are unable to capture the necessary physics. 3-D CFD analyses are necessary to fully characterize autogenous pressurization. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. NASA MSFC's Loci-Stream CFD tool along with the VOF module is a great candidate to fit this mold. We demonstrate our modeling approach and validation of Loci-Stream for predicting autogenous pressurization of a flight scale propellant tank in order for the solver to serve as a reliable design and analysis tool for NASA's CFM application needs. Liquid hydrogen tank pressurization tests carried out at the MSFC test stand 300 facilities provide reliable validation data for this purpose. These tests were modeled using the Loci-Stream solver with a newly implemented two-phase sharp interface treatment. We show that our modeling approach and CFD solver predict the autogenous pressurization phenomena satisfactorily, and document challenging aspects of modeling this problem.

CFM↗

NASA NTRSDate not supplied

Optimizing Urban Air Mobility Research Through Bi-Directional Integration Processes for Effective Verification and Validation

Urban Air Mobility (UAM), a subset of Advanced Air Mobility (AAM), aims to revolutionize metropolitan transportation. This paper explores an engineering process framework within National Aeronautics and Space Administration (NASA)’s Air Mobility Pathfinders (AMP) project, which is focused on the safe scaling and seamless integration of UAM operations within the National Airspace System (NAS). Progressing through three phases — Initial, Midterm, and Mature — the Federal Aviation Administration (FAA)’s UAM Concept of Operations (ConOps) describes a proposed path for the evolution of UAM operations, presenting multifaceted challenges in technology, regulation, and stakeholder engagement. With this ConOps as a basis, the AMP project is executing research, development, test, and evaluation activities aimed at delivering validated reference architectures for the Midterm phase. This paper illuminates the pivotal role of the systems engineering process in managing these technical efforts. Robust verification and validation methods, along with systematic bi-directional integration process, enhance the ability to conduct research into the design and evolution of safe, efficient, and reliable UAM systems. In this paper a systematic framework will be presented and shown to facilitate interactions between UAM stakeholders and to effectively manage the complex architecture of UAM operations in the NAS.

National Airspace System↗

NASA NTRSDate not supplied

Validation of Two Phase Flow Modeling Techniques in Loci-Stream using Axial Jet Pressure Control and Autogenous Pressurization Experiment

Autogenous pressurization of cryogenic propellant tanks eliminates the need to have an additional pressurant tank on the space vehicle, which is highly advantageous due to reduced vehicle mass and design complexity. Autogenous pressurization therefore is one of the key technologies for deep space exploration and long-term space missions. The complex interaction of thermal gradients, turbulence and phase change near the interface make the problem a challenging one to model. Nodal analysis tools and reduced order models are unable to capture the necessary physics. 3-D CFD analyses are necessary to fully characterize autogenous pressurization. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. NASA MSFC's Loci-Stream CFD tool along with the VOF module is a great candidate to fit this mold. We demonstrate our modeling approach and validation of Loci-Stream for predicting autogenous pressurization of a flight scale propellant tank in order for the solver to serve as a reliable design and analysis tool for NASA's CFM application needs. Liquid hydrogen tank pressurization tests carried out at the MSFC test stand 300 facilities provide reliable validation data for this purpose. These tests were modeled using the Loci-Stream solver with a newly implemented two-phase sharp interface treatment. We show that our modeling approach and CFD solver predict the autogenous pressurization phenomena satisfactorily, and document challenging aspects of modeling this problem.

cryogenic fluid management↗

NASA NTRSDate not supplied

SysML Success Tree for DAVINCI In-Situ Campaign Requirements Validation and Redundancy Assessment

The DAVINCI mission will scientifically study the Venusian atmosphere to better understand the current state of the planet and its evolutionary history. This will be accomplished by deploying a descent probe to collect in-situ atmospheric dynamic and spectroscopic measurements, characterize ambient temperatures and pressures during descent, and surface imaging below the cloud layer. To better characterize the DAVINCI In-Situ Campaign, a success tree, developed in the SysML tool, MagicDraw, was created to define the events necessary to have a successful in-situ campaign, for each phase of the campaign. This success tree was also used to validate DAVINCI Program, Mission, and Element level requirements. In addition, because DAVINCI is a single-string mission, the success tree was also used to identify areas of redundancy and resiliency throughout the campaign. The initial redundancy assessment recommended further on-orbit evaluation of the probe’s communication system, as well as further evaluation of the ability of the mass spectrometer turbo-molecular pump to handle the expected decent environment. During the integration and test phase of the overall mission, the success tree will be used to guide the mission validation process, helping to ensure that the in-situ mission elements can perform in accordance with the DAVINCI In-Situ Concept of Operations document.

model-based↗

NASA NTRSDate not supplied

Validation Assessment of Loci/GGFS Gas Granular Flow Solver Predictions of Ejecta from Physics Focused Ground Test

NASA is preparing to return humans to the Moon to establish a sustained Lunar presence through the Artemis program. One area of concern for Lunar landers is the plume surface interaction (PSI) environment that poses several risks during a propulsive landing. Understanding the PSI environment caused by the landers is therefore important to designing successful landing missions. Towards this end, a two-phase, gas granular flow solver, Loci/GGFS, has been developed to predict the cratering and ejecta physics expected during a Lunar landing. The focus of this paper is on a validation assessment of Loci/GGFS predictions of ejecta with monodisperse glass beads (MGB). The validation assessment is performed with respect to the Physics Focused Ground Test 1 (PFGT1) conducted at NASA Marshall Space Flight Center (MSFC) in 2021. It is found that Loci/GGFS predicts similar initial cratering and ejecta features, with predictions of average velocities that are within 25% of experimental values.

Plume Surface Interaction↗

NASA NTRSDate not supplied

Validation Experiments for Turbulent Separation over an Axisymmetric Body of Revolution

Historically, the flow physics involved with most turbulent separated flows have presented fundamental challenges to validating numerical approaches. As recognized by the CFD Vision 2030 study commissioned by NASA, validation of Reynolds-averaged Navier-Stokes (RANS) models and other scale-resolving methods for turbulent separated flow requires data from advanced, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, a new test platform, referred to as the NASA Axisymmetric Afterbody, was designed to obtain detailed measurements of the flow field undergoing a smooth, adverse pressure gradient induced separation for a fixed Reynolds number, Re = 180,000. The parametric body offers a range of flow states progressing from fully attached, to incipient separation, and finally to small-scale separated flow based on variable afterbody geometries. In an initial effort to evaluate RANS turbulence model capabilities, the present configurations of the axisymmetric model host a mild adverse pressure gradient over the contoured boattail section, inducing incipient turbulent separation, as well as a slightly larger adverse pressure gradient, inducing a small-scale region of turbulent separation. Experiments include steady pressure measurements and 2-D PIV to provide the preliminary dataset for simulation studies, which examine the effect of variable grid domains and RANS turbulence models. This is done in an effort to understand and evaluate the critical variability between solutions for the present model configurations. Results indicate potential discrepancies may be due to the effect of the square tunnel test section walls, relatively large blockage ratio, and slight variability in reference parameters. Ongoing work will focus on higher fidelity experimental campaigns to obtain surface flow visualizations and Stereo-Particle Image Velocimetry (SPIV) to deliver higher spatial resolution of the three-dimensional flow field to aid turbulence modelers.

Validation↗

NASA NTRSDate not supplied

Ground Validation Activities for the INCUS Satellite Mission

Over the next decade, there will be several satellite-based radar missions designed to estimate vertical motions and mass flux within deep convection. One of these is the upcoming Investigation of Cumulus Updrafts (INCUS) mission. INCUS will do this using a low-Earth orbit train of three small satellites carrying Ka-band radars to observe the 3-D evolution of radar reflectivity within deep convective cells at time intervals of 30-, 90-, and 120-sec. One approach to validating this novel time-difference (delta-t) approach would include a pair of Doppler radars flown on two different high-altitude aircraft (i.e., satellite simulator), but that solution is not practical within the scope of a cost-capped Earth Venture mission like INCUS. Instead, the ground-based validation (GV) approach for INCUS will consist of using vertical profiling radars, including analysis of existing convective cases, and multiple polarimetric, Doppler radars performing coordinated rapid sampling of the same convective cell. These new observations will be collected in the coming years through local deployments of existing research radar facilities at 1 - 3 sites over multiple seasons to capture a statistically significant sample of storm types (both pre- and post-launch) or as a single post-launch field campaign in a region where convection is very predictable. This presentation will include an overview of INCUS GV, both pre- and post-launch activities, as well as some of our collaborations with the radar community to address some of the challenges in sampling the vertical evolution of convective cells on 120-sec or less time scales.

remote sensing↗

NASA NTRSDate not supplied

SysML Success Tree for DAVINCI In-Situ Campaign Requirements Validation and Redundancy Assessment

The DAVINCI mission will scientifically study the Venusian atmosphere to better understand the current state of the planet and its evolutionary history. This will be accomplished by deploying a descent probe to collect in-situ atmospheric dynamic and spectroscopic measurements, characterize ambient temperatures and pressures during descent, and surface imaging below the cloud layer. To better characterize the DAVINCI In-Situ Campaign, a success tree, developed in the SysML tool, MagicDraw, was created to define the events necessary to have a successful in-situ campaign, for each phase of the campaign. This success tree was also used to validate DAVINCI Program, Mission, and Element level requirements. In addition, because DAVINCI is a single-string mission, the success tree was also used to identify areas of redundancy and resiliency throughout the campaign. The initial redundancy assessment recommended further on-orbit evaluation of the probe’s communication system, as well as further evaluation of the ability of the mass spectrometer turbo-molecular pump to handle the expected decent environment. During the integration and test phase of the overall mission, the success tree will be used to guide the mission validation process, helping to ensure that the in-situ mission elements can perform in accordance with the DAVINCI In-Situ Concept of Operations document.

ConOps↗

NASA NTRSDate not supplied

Validation Assessment of Loci/GGFS Gas Granular Flow Solver Predictions of Ejecta From Physics Focused Ground Test

NASA is preparing to return humans to the Moon to establish a sustained Lunar presence through the Artemis program. One area of concern for Lunar landers is the plume surface interaction (PSI) environment that poses several risks during a propulsive landing. Understanding the PSI environment caused by the landers is therefore important to designing successful landing missions. Towards this end, a two-phase, gas granular flow solver, Loci/GGFS, has been developed to predict the cratering and ejecta physics expected during a Lunar landing. The focus of this paper is on a validation assessment of Loci/GGFS predictions of ejecta with monodisperse glass beads (MGB). The validation assessment is performed with respect to the Physics Focused Ground Test 1 (PFGT1) conducted at NASA Marshall Space Flight Center (MSFC) in 2021. It is found that Loci/GGFS predicts similar initial cratering and ejecta features, with predictions of average velocities that are within 25% of experimental values.

Plume Surface Interaction↗

NASA NTRSDate not supplied

The CLVTOPS Toolchain for NASA Space Launch System Liftoff Analysis and Post Flight Validation

This paper showcases the unique technical capabilities of the CLVTOPS multi-body flight dynamics toolchain developed by Marshall Space Flight Center (MSFC) for analyzing NASA’s Space Launch System (SLS) liftoff events. The CLVTOPS toolchain integrates high-fidelity simulations, geometric algorithms, advanced data analytics, and post-flight telemetry to demonstrate positive clearance between separating bodies and inform design decisions that enhance mission reliability. Proper liftoff separation is crucial to the success of the launch vehicle’s mission; vehicle impacts with the launch tower and supporting components incur a heightened risk of mission failure. For liftoff analysis, the CLVTOPS toolchain enables the integration of vehicle, launch pad, and environmental input models for the investigation of key clearance effectors. Furthermore, recent enhancements to the CLVTOPS toolchain allow for validation via photogrammetric trajectory reconstruction and plume pressure impingement estimation on the tower. The following sections will walk through the tool-chain, SLS liftoff ground rules and assumptions, key models, standard analysis, recent enhancements, and post-flight validation of the Artemis I mission liftoff event.

CLVTOPS↗