Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Validation of a Low-Thrust Mission Design Tool Using Operational Navigation Software

Design of flight trajectories for missions employing solar electric propulsion requires a suitably high-fidelity design tool. In this work, the Evolutionary Mission Trajectory Generator (EMTG) is presented as a medium-high fidelity design tool that is suitable for mission proposals. EMTG is validated against the high-heritage deep-space navigation tool MIRAGE, demonstrating both the accuracy of EMTG's model and an operational mission design and navigation procedure using both tools. The validation is performed using a benchmark mission to the Jupiter Trojans.

Englander, Jacob A.↗
NASA NTRS2016

Validation for Global Solar Wind Prediction Using Ulysses Comparison: Multiple Coronal and Heliospheric Models Installed at the Community Coordinated Modeling Center

The prediction of the background global solar wind is a necessary part of space weather forecasting. Several coronal and heliospheric models have been installed and/or recently upgraded at the Community Coordinated Modeling Center (CCMC), including the Wang-Sheely-Arge (WSA)-Enlil model, MHD-Around-a-Sphere (MAS)-Enlil model, Space Weather Modeling Framework (SWMF), and Heliospheric tomography using interplanetary scintillation data. Ulysses recorded the last fast latitudinal scan from southern to northern poles in 2007. By comparing the modeling results with Ulysses observations over seven Carrington rotations, we have extended our third-party validation from the previous near-Earth solar wind to middle to high latitudes, in the same late declining phase of solar cycle 23. Besides visual comparison, wehave quantitatively assessed the models capabilities in reproducing the time series, statistics, and latitudinal variations of solar wind parameters for a specific range of model parameter settings, inputs, and grid configurations available at CCMC. The WSA-Enlil model results vary with three different magnetogram inputs.The MAS-Enlil model captures the solar wind parameters well, despite its underestimation of the speed at middle to high latitudes. The new version of SWMF misses many solar wind variations probably because it uses lower grid resolution than other models. The interplanetary scintillation-tomography cannot capture the latitudinal variations of solar wind well yet. Because the model performance varies with parameter settings which are optimized for different epochs or flow states, the performance metric study provided here can serve as a template that researchers can use to validate the models for the time periods and conditions of interest to them.

Jian, L. K.↗
NASA NTRS2016

Calibration and Validation of Landsat Tree Cover in the Taiga-Tundra Ecotone

Monitoring current forest characteristics in the taiga-tundra ecotone (TTE) at multiple scales is critical for understanding its vulnerability to structural changes. A 30 m spatial resolution Landsat-based tree canopy cover map has been calibrated and validated in the TTE with reference tree cover data from airborne LiDAR and high resolution spaceborne images across the full range of boreal forest tree cover. This domain-specific calibration model used estimates of forest height to determine reference forest cover that best matched Landsat estimates. The model removed the systematic under-estimation of tree canopy cover greater than 80% and indicated that Landsat estimates of tree canopy cover more closely matched canopies at least 2 m in height rather than 5 m. The validation improved estimates of uncertainty in tree canopy cover in discontinuous TTE forests for three temporal epochs (2000, 2005, and 2010) by reducing systematic errors, leading to increases in tree canopy cover uncertainty. Average pixel-level uncertainties in tree canopy cover were 29.0%, 27.1% and 31.1% for the 2000, 2005 and 2010 epochs, respectively. Maps from these calibrated data improve the uncertainty associated with Landsat tree canopy cover estimates in the discontinuous forests of the circumpolar TTE.

Montesano, Paul Mannix↗
NASA NTRS2016

Validating MODIS Above-Cloud Aerosol Optical Depth Retrieved from Color Ratio Algorithm Using Direct Measurements Made by NASA's Airborne AATS and 4STAR Sensors

We present the validation analysis of above-cloud aerosol optical depth (ACAOD) retrieved from the color ratio method applied to MODIS cloudy-sky reflectance measurements using the limited direct measurements made by NASAs airborne Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) sensors. A thorough search of the airborne database collection revealed a total of five significant events in which an airborne sun photometer, coincident with the MODIS overpass, observed partially absorbing aerosols emitted from agricultural biomass burning, dust, and wildfires over a low-level cloud deck during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS 2013 campaigns, respectively. The co-located satellite-airborne match ups revealed a good agreement (root-mean-square difference less than 0.1), with most match ups falling within the estimated uncertainties associated with the MODIS retrievals (about -10 to +50 ). The co-retrieved cloud optical depth was comparable to that of the MODIS operational cloud product for ACE-ASIA and SEAC4RS, however, higher by 30-50% for the SAFARI-2000 case study. The reason for this discrepancy could be attributed to the distinct aerosol optical properties encountered during respective campaigns. A brief discussion on the sources of uncertainty in the satellite-based ACAOD retrieval and co-location procedure is presented. Field experiments dedicated to making direct measurements of aerosols above cloud are needed for the extensive validation of satellite based retrievals.

airborne sun photometer↗
NASA NTRS2017

Towards Verification and Validation for Increased Autonomy

This presentation goes over the work we have performed over the last few years on verification and validation of the next generation onboard collision avoidance system, ACAS X, for commercial aircraft. It describes our work on probabilistic verification and synthesis of the model that ACAS X is based on, and goes on to the validation of that model with respect to actual simulation and flight data. The presentation then moves on to identify the characteristics of ACAS X that are related to autonomy and to discuss the challenges that autonomy pauses on VV. All work presented has already been published.

Giannakopoulou, Dimitra↗
NASA NTRS2017

Validation of OCO-2 and ACOS-GOSAT using HIPPO and TCCON

Consistent validation of satellite CO2 estimates is a prerequisite for using multiple satellite CO2measurements for joint flux inversion and establishing a long-term atmospheric CO2 data record. Wevalidate recent satellite observation of OCO-2 v7 and ACOS-GOSAT v7.3 using similar analysis as previouswork (Kulawik et al. (2016) and Frankenberg et al. (2106)) through comparisons to the HIAPER Pole-to-Pole Observations (HIPPO) and the Total Carbon Column Observing Network (TCCON) to estimate biasesand errors affecting the understanding of carbon cycle science. CarbonTracker RT is also compared tothe validation data, and additionally used to evaluate the mismatch between the HIPPO observationtimeframe and the OCO-2 record, which are offset by 3-7 years. Some key metrics that are validatedinclude the seasonal cycle phase and amplitude, latitudinal gradient by season, regional biases, anderrors with respect to averaging.

Kulawik, Susan S.↗
NASA NTRS2017

Design of an Axisymmetric Afterbody Test Case for CFD Validation

As identified in the CFD Vision 2030 Study commissioned by NASA, validation of advanced RANS models and scale-resolving methods for computing turbulent flow fields must be supported by continuous improvements in fundamental, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, the underpinnings of a new test platform referred to herein as the NASA Axisymmetric Afterbody are presented. The devised body-of-revolution is a modular platform consisting of a forebody section and afterbody section, allowing for a range of flow behaviors to be studied on interchangeable afterbody geometries. A body-of-revolution offers advantages in shape definition and fabrication, in avoiding direct contact with wind tunnel sidewalls, and in tail-sting integration to facilitate access to higher Reynolds number tunnels. The current work is focused on validation of smooth-body turbulent flow separation, for which a six-parameter body has been developed. A priori RANS computations are reported for a risk-reduction test configuration in order to demonstrate critical variation among turbulence model results for a given afterbody, ranging from barely-attached to mild separated flow. RANS studies of the effects of forebody nose (with/without) and wind tunnel boundary (slip/no-slip) on the selected afterbody are presented. Representative modeling issues that can be explored with this configuration are the effect of higher Reynolds number on separation behavior, flow physics of the progression from attached to increasingly-separated afterbody flows, and the effect of embedded longitudinal vortices on turbulence structure.

Disotell, Kevin J.↗
NASA NTRS2017

Development and Validation of The SMAP Enhanced Passive Soil Moisture Product

Since the beginning of its routine science operation in March 2015, the NASA SMAP observatory has been returning interference-mitigated brightness temperature observations at L-band (1.41 GHz) frequency from space. The resulting data enable frequent global mapping of soil moisture with a retrieval uncertainty below 0.040 cu m/cu m at a 36 km spatial scale. This paper describes the development and validation of an enhanced version of the current standard soil moisture product. Compared with the standard product that is posted on a 36 km grid, the new enhanced product is posted on a 9 km grid. Derived from the same time-ordered brightness temperature observations that feed the current standard passive soil moisture product, the enhanced passive soil moisture product leverages on the Backus-Gilbert optimal interpolation technique that more fully utilizes the additional information from the original radiometer observations to achieve global mapping of soil moisture with enhanced clarity. The resulting enhanced soil moisture product was assessed using long-term in situ soil moisture observations from core validation sites located in diverse biomes and was found to exhibit an average retrieval uncertainty below 0.040 cu m/cu m. As of December 2016, the enhanced soil moisture product has been made available to the public from the NASA Distributed Active Archive Center at the National Snow and Ice Data Center.

SMAP Enhanced↗
NASA NTRS2017

Validation of High-Resolution MAIAC Aerosol Product over South America

Multiangle Implementation of Atmospheric Correction (MAIAC) is a new Moderate Resolution Imaging Spectroradiometer (MODIS) algorithm that combines time series approach and image processing to derive surface reflectance and atmosphere products, such as aerosol optical depth (AOD) and columnar water vapor (CWV). The quality assessment of MAIAC AOD at 1 km resolution is still lacking across South America. In the present study, critical assessment of MAIAC AOD(sub 550) was performed using ground-truth data from 19 Aerosol Robotic Network (AERONET) sites over South America. Additionally, we validated the MAIAC CWV retrievals using the same AERONET sites. In general, MAIAC AOD Terra/Aqua retrievals show high agreement with ground-based measurements, with a correlation coefficient (R) close to unity (R(sub Terra):0.956 and R(sub Aqua):0.949). MAIAC accuracy depends on the surface properties and comparisons revealed high confidence retrievals over cropland, forest, savanna, and grassland covers, where more than 2/3 (approximately 66%) of retrievals are within the expected error (EE = +/-(0.05 + 0.05 × AOD)) and R exceeding 0.86. However, AOD retrievals over bright surfaces show lower correlation than those over vegetated areas. Both MAIAC Terra and Aqua retrievals are similarly comparable to AERONET AOD over the MODIS lifetime (small bias offset approximately 0.006). Additionally, MAIAC CWV presents quantitative information with R approximatley 0.97 and more than 70% of retrievals within error (+/-15%). Nonetheless, the time series validation shows an upward bias trend in CWV Terra retrievals and systematic negative bias for CWV Aqua. These results contribute to a comprehensive evaluation of MAIAC AOD retrievals as a new atmospheric product for future aerosol studies over South America.

Martins, V. S.↗
NASA NTRS2017

Successful Validation of RNA Purification and Quantitative Real-Time PCR Analysis of Gene Expression on the International Space Station

The NASA Ames WetLab-2 system was developed to offer new on-orbit gene expression analysis capabilities to ISS researchers and can be used to conduct on-orbit RNA isolation and quantitative real time PCR (RT-qPCR) analysis of gene expression from a wide range of biological samples ranging from microbes to mammalian tissues. On orbit validation included three quantitative PCR (qPCR) runs using an E. coli genomic DNA template pre-loaded at three different concentrations. The flight Ct values for the DNA standards showed no statistically significant differences relative to ground controls although there was increased noise in Ct curves, likely due to microgravity-related bubble retention in the optical windows. RNA was successfully purified from both E. coli and mouse liver samples and successfully generated singleplex, duplex and triplex data although with higher standard deviations than ground controls, also likely due to bubbles. Using volunteer science activities, a potential bubble reduction strategy was tested and resulted in smooth amplification curves and tighter Cts between replicates. The WetLab-2 validation experiment demonstrates a novel molecular biology workbench on ISS which allows scientists to purify and stabilize RNA, and to conduct RT-qPCR analyses on-orbit with rapid results. This novel ability is an important step towards utilizing ISS as a National Laboratory facility with the capability to conduct and adjust science experiments in real time without sample return, and opens new possibilities for rapid medical diagnostics and biological environmental monitoring on ISS.

microgravity↗
NASA NTRS2018

Overview of the Exploration Exercise Device Validation Study Plans

The NASA has determined that a multi-functional exercise device will be developed for use as an exercise device during exploration missions. The device will allow for full body resistance and metabolic exercise necessary to minimize physiological losses during space flight and to maintain fitness necessary to perform critical mission tasks. Prior to implementation as an exercise device on an Exploration vehicle, there will be verification and validation testing completed to determine device efficacy at providing the necessary training stimuli to achieve desired goals. Because the exploration device will be new device that has yet be specified, specific Verification and Validation (V&V) protocols have yet to be developed. Upon delivery of an exploration exercise device training unit, stakeholders throughout NASA will develop V&V plans that include ground-based testing and testing on the International Space Station (ISS). Stakeholders will develop test protocols that include success criterion for the device. Ground tests will occur at NASA Johnson Space Station prior to flight testing. The intents of the ground tests are to allow crew, spaceflight medicine, science, engineering, Astronaut Strength, Conditioning, and Reconditioning staff, and others to gain experience in the best utilization of the device. The goal is to obtain an evidence base for recommending use of the device on the ISS. The developed protocol will be created to achieve multiple objectives, including determining if the device provides an adequate training stimulus for 5th - 95th percentile males and females, allows for exercise modalities that protect functional capability, and is robust and can withstand extensive human use. Although protocols are yet to be determined, current expectations include use of the device by test subjects and current crew in order to obtain quantitative and qualitative feedback. Information obtained during the ground tests may be used to influence device modifications during design iterations. Assuming successful ground tests, the device will be installed on the ISS for testing during space flight. Spaceflight testing is envisioned to include an activation and checkout (ACO) phase and a V&V phase. During the ACO phase, 1-2 crewmembers will exercise with the device to ensure proper function. ACO is expected to last multiple months because of the many modes and methods of exercise that need to be assessed. However, the goal is to complete the ACO as quickly as possible. Once successful ACO occurs, the crew will be free to use the device for normal exercise pending concurrence from stakeholders. V&V tests on the ISS will ideally consist of crew using the device for all of their exercise for an entire mission. Exercise prescriptions will be supplied that replicate expected prescriptions during exploration missions. Crew that are not enrolled in the V&V studies would be also free to use the device as their schedule permits. As experience is gained by users, exercise protocols could change. The intent of all V&V testing is to ensure that all have thorough understanding of experience at optimizing device capability

DeWitt, J. K.↗
NASA NTRS2017

Development and Validation of an Automated Simulation Capability in Support of Integrated Demand Management

Integrated Demand Management (IDM) is a near- to mid-term NASA concept that proposes to address mismatches in air traffic system demand and capacity by using strategic flow management capabilities to pre-condition demand into the more tactical Time-Based Flow Management System (TBFM). This paper describes an automated simulation capability to support IDM concept development. The capability closely mimics existing human-in-the-loop (HITL) capabilities, automating both the human components and collaboration between operational systems, and speeding up the real-time aircraft simulations. Such a capability allows for parametric studies that will inform the HITL simulations, identifying breaking points and parameter values at which significant changes in system behavior occur. This paper also describes the initial validation of individual components of the automated simulation capability, and an example application comparing the performance of the IDM concept under two TBFM scheduling paradigms. The results and conclusions from this simulation compare closely to those from previous HITL simulations using similar scenarios, providing an initial validation of the automated simulation capability.

Integrated Demand Management↗
NASA NTRS2017

Towards Verification and Validation for Increased Autonomy

This presentation goes over the work we have performed over the last few years on verification and validation of the next generation onboard collision avoidance system, ACAS X, for commercial aircraft. It describes our work on probabilistic verification and synthesis of the model that ACAS X is based on, and goes on to the validation of that model with respect to actual simulation and flight data. The presentation then moves on to identify the characteristics of ACAS X that are related to autonomy and to discuss the challenges that autonomy pauses on VV. All work presented has already been published.

Giannakopoulou, Dimitra↗
NASA NTRS2018

Validity of Miles Equation in Predicting Propellant Slosh Damping in Baffled Tanks at Variable Slosh Amplitude

Determination of slosh damping is a very challenging task as there is no analytical solution. The damping physics involves the vorticity dissipation which requires the full solution of the nonlinear Navier-Stokes equations. As a result, previous investigations were mainly carried out by extensive experiments. A systematical study is needed to understand the damping physics of baffled tanks, to identify the difference between the empirical Miles equation and experimental measurements, and to develop new semi-empirical relations to better represent the real damping physics. The approach of this study is to use Computational Fluid Dynamics (CFD) technology to shed light on the damping mechanisms of a baffled tank. First, a 1-D Navier-Stokes equation representing different length scales and time scales in the baffle damping physics is developed and analyzed. Loci-STREAM-VOF, a well validated CFD solver developed at NASA MSFC, is applied to study the vorticity field around a baffle and around the fluid-gas interface to highlight the dissipation mechanisms at different slosh amplitudes. Previous measurement data is then used to validate the CFD damping results. The study found several critical parameters controlling fluid damping from a baffle: local slosh amplitude to baffle thickness (A/t), surface liquid depth to tank radius (d/R), local slosh amplitude to baffle width (A/W); and non-dimensional slosh frequency. The simulation highlights three significant damping regimes where different mechanisms dominate. The study proves that the previously found discrepancies between Miles equation and experimental measurement are not due to the measurement scatter, but rather due to different damping mechanisms at various slosh amplitudes. The limitations on the use of Miles equation are discussed based on the flow regime.

Yang, H. Q.↗
NASA NTRS2018

Validity of Miles Equation in Predicting Propellant Slosh Damping in Baffled Tanks at Variable Slosh Amplitude

Determination of slosh damping is a very challenging task as there is no analytical solution. The damping physics involves the vorticity dissipation which requires the full solution of the nonlinear Navier-Stokes equations. As a result, previous investigations were mainly carried out by extensive experiments. A systematical study is needed to understand the damping physics of baffled tanks, to identify the difference between the empirical Miles equation and experimental measurements, and to develop new semi-empirical relations to better represent the real damping physics. The approach of this study is to use Computational Fluid Dynamics (CFD) technology to shed light on the damping mechanisms of a baffled tank. First, a 1-D Navier-Stokes equation representing different length scales and time scales in the baffle damping physics is developed and analyzed. Loci-STREAM-VOF, a well validated CFD solver developed at NASA MSFC, is applied to study the vorticity field around a baffle and around the fluid-gas interface to highlight the dissipation mechanisms at different slosh amplitudes. Previous measurement data is then used to validate the CFD damping results. The study found several critical parameters controlling fluid damping from a baffle: local slosh amplitude to baffle thickness (A/t), surface liquid depth to tank radius (d/R), local slosh amplitude to baffle width (A/W); and non-dimensional slosh frequency. The simulation highlights three significant damping regimes where different mechanisms dominate. The study proves that the previously found discrepancies between Miles equation and experimental measurement are not due to the measurement scatter, but rather due to different damping mechanisms at various slosh amplitudes. The limitations on the use of Miles equation are discussed based on the flow regime.

Yang, H. Q.↗
NASA NTRS2018

GT SUITE Fuel Cell Model Validation with Power Module Test Data

The AES Modular Power Systems (AMPS) Fuel Cell team at the NASA Glenn Research Center (GRC) has created a Microsoft Excel model of a regenerative fuel cell (RFC) system for potential lunar and Martian applications. Due to some limitations of this model, including the ability to predict transient effects in the thermal and fluidic performance of the system, a system-level transient thermal/fluids model was desired. GT-SUITE is a transient multi-physics simulation tool that is popular in the automotive industry and has a built in template for proton exchange membrane (PEM) fuel cells. However, terrestrial fuel cells used in the automotive industry vary significantly from aerospace fuel cells. A validation effort was undertaken to compare GT SUITE model results to actual data collected during the 2015 AMPS Power Module Demonstration in which the AMPS team used a PEM fuel cell system to power a 478 kg rover assembly at the Dunes test site located at GRC. The purpose of the model was to evaluate the efficacy of using GT SUITE to model a non-flow through PEM fuel cell system. The validation effort examined electrochemical performance including fuel cell stack voltage and power supplied, the thermal performance of the stack namely stack temperature and heat rejection rates, and the fluidic performance of the system including pressures, reactant consumption, and water production rates.

Gilligan, Ryan↗
NASA NTRS2019

Consensus on Aquatic Primary Productivity Field Protocols for Satellite Validation and Model Synthesis

The NASA PACE project, in conjunction with the IOCCG, EUMETSAT, and JAXA, have initiated an Aquatic Primary Productivity working group, with the aim to develop community consensus on multiple methods for measuring aquatic primary productivity used for satellite validation and model synthesis. A workshop to commence the working group efforts was held December 05-07, 2018 at the University Space Research Association headquarters in Columbia, MD U.S.A., bringing together 26 active researchers from 16 institutions. The group discussed the primary differences, nuances, scales, uncertainties, definitions, and best practices for measurements of primary productivity derived from in situ/on-deck/laboratory radio/stable isotope incubations, dissolved oxygen concentrations (from incubations or autonomous platforms such as floats or gliders), oxygen-argon ratios, triple oxygen isotope, natural fluorescence, and FRRF/ETR/kinetic analysis. These discussions highlighted the necessity to move the community forward towards the establishment of climate-quality primary productivity measurements that follow uniform protocols, which is imperative to ensure that existing and future measurements can be compared, assimilated, and their uncertainties determined for model development and validation. The specific deliverable resulting from of this activity will be a protocol document, published in coordination with the IOCCG. This presentation will discuss the findings of the meeting, and address future activities of the working group.

Vandermeulen, Ryan A.↗
NASA NTRS2019

GOES-R Spacecraft Verification and Validation Compared with Flight Results

The Geostationary Operational Environmental Satellite, R-Series (GOES-R) represents a dramatic improvement in GEO (Geostationary Earth Orbit) weather observation capabilities over the previous generation. To provide these new capabilities, GOES-R incorporates a number of new technologies flying for the first time. As with any new spacecraft design, extensive ground testing was performed to validate the vehicle performance. In this paper, we present several successes and several lessons-learned from the GOES-R verification and validation (V&V) efforts. Included are the Dynamic Interaction Test (DIT) results for jitter assessment, and comparison to flight results. Also included are the effects of thermally-induced alignment perturbations, along with post-launch mitigations. Finally, we discuss unexpected GOES-17 gyro performance, which caused a Safe Mode entry shortly after launch. V&V mitigations are presented, which will be used for the next two GOES-R vehicles.

GOES-17↗