Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Validation of GOSAT Data Products; Interim Report on the GOSAT/TANSO Project

The Orbiting Carbon Observatory-2 (OCO-2) Team has continued working closely with the Greenhouse Gases Observing Satellite (GOSAT) team to (i) conduct vicarious calibration experiments in Railroad Valley, NV, U.S.A., (ii) retrieve estimates of X CO2 from OCO-2 and GOSAT TANSO-FTS data, and (iii) validate these products using internationally recognized standards. The OCO-/GOSAT relationship was reinforced in March 2015 with the signing a new Memorandum of Understanding between NASA and the GOSAT and GOSAT-2 partners. Over the past year, while the GOSAT team has been finalizing the V201 product, the OCO-2 team has focused primarily on the delivery of the OCO-2 product, providing new opportunities for cross calibration of the OCO-2 and GOSAT instruments and cross validation of their products. These efforts are just now producing results. Members of the OCO-2 team have also continued the analysis of the GOSAT V161.161 data and the ACOS B3.5 products. Those efforts have produced 2 new refereed publications and several others in review. The OCO-2 now preparing to reprocess the entire GOSAT TANSO-FTS data record using the GOSAT V201 product and OCO-2 B7 algorithm to produce a 7-year, multi-satellite climate data record for X(sub CO2).

Wennberg, Paul↗
NASA NTRS2019

Global Validation of Columnar Water Vapor Derived from EOS MODIS-MAIAC Algorithm Against the Ground-Based AERONET Observations

The water vapor is a relevant greenhouse gas in the Earth's climate system, and satellite products become one of the most effective way to characterize and monitor the columnar water vapor (CWV) content at global scale. Recently, a new product (MCD19) was released as part of MODIS (Moderate Resolution Imaging Spectroradiometer) Collection 6 (C6). This operational product from the Multi-Angle Implementation for Atmospheric Correction (MAIAC) algorithm includes a high 1-kilometer resolution CWV retrievals. This study presents the first global validation of MAIAC C6 CWV obtained from MODIS MCD19A2 product. This evaluation was performed using Aerosol Robotic Network (AERONET) observations at 265 sites (2000-2017). Overall, the results show a good agreement between MAIAC/AERONET CWV retrievals, with correlation coefficient higher than 0.95 and RMS (Root Mean Square) error lower than 0.250 centimeters. The binned error analysis revealed an underestimation (approximately 10 percent) of Aqua CWV retrievals with negative bias for CWV higher than 3.0 centimeters. In contrast, Terra CWV retrievals show a slope of regression close to unity and a low mean bias of 0.075 centimeters. While the accuracy is relatively similar between 1.0 and 5.0 centimeters for both sensor products, Terra dataset is more reliable for applications in humid tropical areas (less than 5.0 centimeters). The expected error was defined as plus or minus 15 percent, with less than 68 percent of retrievals falling within this envelope. However, the accuracy is regionally dependent, and lower error should be expected in some regions, such as South America and Oceania. Since MODIS instruments have exceeded their design lifetime, time series analysis was also presented for both sensor products. The temporal analysis revealed a systematic offset of global average between Terra and Aqua CWV records. We also found an upward trend (approximately 0.2 centimeters per decade) in Terra CWV retrievals, while Aqua CWV retrievals remain stable over time. The sensor degradation influences the ability to detect climate signals, and this study indicates the need for revisiting calibration of the MODIS bands 17-19, mainly for Terra instrument, to assure the quality of the MODIS water vapor product. Finally, this study presents a comprehensive validation analysis of MAIAC CWV over land, raising the understanding of its overall quality.

MAIAC↗
NASA NTRS2019

Seasonal and Diurnal Opportunities for XCH4, XCO2, and XCO for the Amazonian Rainforest Region Allowing Sampling and Validation

There is considerable interest in the aggregate methane emissions from the Amazon and similar moist tropical regions, and XCH4 measurements are well suited to constrain sources to the global atmosphere. Similarly, XCO2 measurements constrain CO2 in the region. XCO helps to partition CO2 patterns among burning and respiration processes. GeoCarb may allow these column measurements over the Western Hemisphere, but satellite retrieval require exacting calibration and validation by sun-focused Fourier transform spectrometers (FTS). The rarity of sufficiently large gaps in the cloud cover over the Amazon and similar rainforests restricts the validation opportunities for useful FTS observations and even more the opportunities for accurate retrievals. TropOMI observational statistics are extremely poor for the region. We have used two data sources to evaluate FTS opportunities at Manaus, Brazil, an FTS operated for 8 months near Manaus by Mavendra Dubey, and also sun-photometer measurements at several stations. The promise of using data from other satellites, e.g. GOES-16 ( (Geostationary Operational Environmental Satellite) and CALIOP (Cloud-Aerosol LIdar with Orthogonal Polarization gaps and aerosol layering will be described. We report initial results on five questions: (1) how frequent are observing opportunities of FTS?, (2) What evidence is there that gaps in clouds are wide enough for satellite retrievals at an appropriate accuracy, (3) What is the diurnal and seasonal variability of cloud gaps?, and (4) What limitations are currently suggested for unbiased FTS measurement of XCH4 due to diurnal effects, and (5) What evidence is there for incidence of problematic high aerosol extinction at higher layers of the troposphere (800 hPa to 120 hPa) which alter the XCH4 light-paths?

Chatfield, Robert↗
NASA NTRS2019

Two Decades Observing Smoke Above Clouds in the South-Eastern Atlantic Ocean: Deep Blue Algorithm Updates and Validation with ORACLES Field Campaign Data

This study presents and evaluates an updated algorithmfor quantification of absorbing aerosols above clouds(AACs) from passive satellite measurements. The focus isbiomass burning in the south-eastern Atlantic Ocean duringthe 2016 and 2017 ObseRvations of Aerosols above CLoudsand their intEractionS (ORACLES) field campaign deployments.The algorithm retrieves the above-cloud aerosoloptical depth (AOD) and underlying liquid cloud opticaldepth and is applied to measurements from the Sea-viewingWide Field-of-view Sensor (SeaWiFS), Moderate ResolutionImaging Spectroradiometer (MODIS), and Visible InfraredImaging Radiometer Suite (VIIRS) from 1997 to 2017. AirborneNASA Ames Spectrometers for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) and NASA LangleyHigh Spectral Resolution Lidar 2 (HSRL2) data collectedduring ORACLES provide important validation for spectralAOD for MODIS and VIIRS; as the SeaWiFS missionended in 2010, it cannot be evaluated directly. The 4STARand HSRL2 comparisons are complementary and reveal performancegenerally in line with uncertainty estimates providedby the optimal estimation retrieval framework used. Atpresent the two MODIS-based data records seem the mostreliable, although there are differences between the deployments,which may indicate that the available data are not yetsufficient to provide a robust regional validation. Spatiotemporalpatterns in the data sets are similar, and the time seriesare very strongly correlated with each other (correlationcoefficients from 0.95 to 0.99). Offsets between the satellitedata sets are thought to be chiefly due to differences in absolutecalibration between the sensors. The available validationdata for this type of algorithm are limited to a small numberof field campaigns, and it is strongly recommended that suchairborne measurements continue to be made, both over thesouthern Atlantic Ocean and elsewhere.

Sayer, Andrew M.↗
NASA NTRS2019

Downscaling and Validation of SMAP Radiometer Soil Moisture in CONUS

The SMAP (Soil Moisture Active/Passive) satellite provides global soil moisture (SM) estimates that can be used for scientific research and applications (such as the hydrological cycle, agriculture, ecology, and land atmosphere interactions). Currently, SMAP provides the enhanced radiometer-only SM product (L2SMP) at 9 km grid resolution. However, this spatial resolution is still not enough to satisfy the needs of some studies that require a finer spatial resolution SM product, particularly in agricultural and watershed applications. This study applied a downscaling algorithm to the SMAP 9 km SM product to produce a 1 km resolution over the CONUS (Contiguous United States). The downscaling algorithm is based on the relationship between temperature change and SM modulated by Normalized Difference Vegetation Index (NDVI) of a given time period. This relationship was modeled using variables derived from NLDAS (North America Land Data Assimilation System) and NASA's LTDR (Land Long Term Data Record) between 1981-2018. The algorithm was implemented uses the 1 km MODIS Aqua LST (Land Surface Temperature) product. The downscaled SMAP 1 km SM was validated using in situ SM measurements from the ISMN (International Soil Moisture Network). The validation metrics show an improved overall accuracy of the downscaled SM.

downscaling↗
NASA NTRS2019

CFD Jet Mixing Model Validation Against Zero-Boil-Off Tank (ZBOT) Microgravity Experiment

The Zero-Boil-Off Tank (ZBOT) experiments are a series of small scale two-phase fluids physics experiments conducted aboard the International Space Station (ISS) in 2017. A goal of these experiments is to study various fundamental fluid flow, heat and mass transport, and phase change phenomena that control storage tank pressurization and pressure control in microgravity. In this paper, results of a state-of-the-art two-phase CFD (Computational Fluid Dynamics) storage tank model are presented and validated against jet mixing data provided by microgravity ZBOT experiments. Jet-ullage interaction was studied in the experiment for different jet speeds representing different flow regimes, and tank fill levels. Effects of various physical parameters, such as, jet angle, gravitational acceleration and surface tension value were investigated. Computational parameters, such as turbulence and surface tension models and interface capturing scheme, affecting jet-ullage interaction were also studied. Computational results were compared to experimental results for model validation.

Turbulence↗
NASA NTRS2019

CFD Jet Mixing Model Validation against Zero-Boil-Off Tank (ZBOT) Microgravity Experiment

The Zero-Boil-Off Tank (ZBOT) experiments are a series of small scale two-phase fluids physics experiments conducted aboard the International Space Station (ISS) in 2017. A goal of these experiments is to study various fundamental fluid flow, heat and mass transport, and phase change phenomena that control storage tank pressurization and pressure control in microgravity. In this paper, results of a state-of-the-art two-phase CFD storage tank model are presented and validated against jet mixing data provided by microgravity ZBOT experiments. Jet-ullage interaction was studied in the experiment for different jet speeds representing different flow regimes, and tank fill levels. Effects of various physical parameters, such as, jet angle, gravitational acceleration and surface tension value were investigated. Computational parameters, such as turbulence and surface tension models and interface capturing scheme, affecting jet-ullage interaction were also studied. Computational results were compared to experimental results for model validation.

Mixing↗
NASA NTRS2019

Comparing Level-2 and Level-3 Satellite Ocean Color Retrieval Validation Methodologies

Many ocean color data applications leverage global spatially composited Level-3(L3) satellite data, because of their regular Earth-grid frame of reference. However, ocean color satellite retrieval performance is routinely evaluated on Level-2 (L2) data at the native satellite swath resolution and geometries. This study assesses how accurately binned and gridded L3 data represent L2 satellite data products via satellite-to-in situ match-up activities.L2 and L3 satellite data retrievals of the photosynthetic pigment chlorophyll-a are compared with a common in situ data set, revealing similar L2 and L3 satellite-to-in situ performance for both MODIS-Aqua and VIIRS-SNPP. This agreement implies that L2 validation results are generally applicable to L3 data. However, uncertainties are introduced during the generation of L3 data from L2 data. L3 data comparisons introduce a wider temporal window between the time of in situ measurement and the time of the satellite observation, which can unintentionally reflect on the quality of the satellite retrieval or algorithm performance. The choice of L3 map projection may introduce additional uncertainty by spatially distorting the true location of the satellite retrievals. Each manipulation of satellite data beyond theinstrument's native spatio temporal reference (L2) reduces the applicability of L2 validation results to higher data processing levels.

Ocean Color↗
NASA NTRS2019

Role of CEOS Working Group on Calibration and Validation in Analysis Ready Data Products

The Committee on Earth Observation Satellites (CEOS) is leading the CEOS Analysis Ready Data for Land (CARD4L) initiative. A goal of analysis ready data products is to limit the effort needed by users to pre-process the data allowing them to concentrate on the end products. CARD4L provides a set of specifications that data providers need to meet to be considered to satisfy CARD4L. One of the working groups within CEOS, the Working Group on Calibration and Validation (WGCV) is providing a peer review process to evaluate the documentation of the data providers validation and data product accuracy assessment. The approach makes use of the expertise within WGCV to collaborate with both the CEOS Land Surface Imaging Virtual Constellation and the data providers to work towards acceptance of the...

Thome, K.↗
NASA NTRS2019

A Validation Study of the Performance Prediction Methodology of the Early Warning Metrics

Complex projects frequently experience delays and develop backlogs of their project control milestones during the acquisition and development lifecycles. In response, the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) formed an independent group of Subject Matter Experts (SMEs) to monitor the execution performance of GSFC Flight projects and instruments that are under development. The SME team’s objective is to generate data driven performance-based indicators that quantify the degree to which projects are meeting their respective schedule and budget commitments. One of these performance-based indicators, the Early Warning Metrics, provides performance forecasts and insight to project performance relative to historical successful projects. Herein this paper describes the purpose and utility of the Early Warning Metrics. Additionally, the initial prediction method used in the creation of the metrics is described along with its validity and the validity of comparable prediction methods.

Holloman, Sherrica↗
NASA NTRS2019

Validation of Satellite-Based Wind Observations During PISTON

PISTON cruises provide a useful and unique suite of measurements relevant to validating satellite-based ocean wind datasets near tropical convection. In this talk, we will focus on opportunities for using PISTON observations to validate two different scatterometer datasets: (1) Cyclone Global Navigation Satellite System (CYGNSS) (2) Advanced Scatterometer (ASCAT).

Lang, Timothy↗
NASA NTRS2019

Blind Study Validating Parametric Costing Tools PRICE True Planning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE True Planning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE True Planning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Friz, Paul D.↗
NASA NTRS2018

Validation of a Mesoscale Fiber Kinking Model Through Test and Analysis of Double Edge Notch Compression Specimens

Tests and analyses were conducted on a series of geometrically-scaled double edge notch compression specimens to validate the capability of the fiber-kinking model in the NASA continuum damage mechanics code for progressive damage analysis, CompDam. The tests and analyses focused on the fiber-kinking damage mechanism, which is of critical importance for predicting accurately longitudinal compression failure in carbon fiber reinforced polymer laminates. The fiber-kinking model in CompDam was augmented with a new capability to represent a hardening response once a kink band has fully formed, enabling prediction of band broadening. Correlation of the test and analysis results showed agreement in stiffness and strength with less than 10% error. The analysis predicts the same sequence of events leading to ultimate failure that was found in the test. The overall excellent correlation in terms of stiffness, strength, and failure process validates the capability of the model for predicting longitudinal compression failure in notched laminates with cross-ply layups.

Bergan, Andrew C.↗
NASA NTRS2019

Informing Algorithms from Ground Validation: The GPM Combined Algorithm

Ground validation (GV) for the Global Precipitation Measurement (GPM) mission encompasses in-situ (e.g., gauge, disdrometer) measurements, ground radar products, and comprehensive datasets from dedicated airborne field campaigns. These datasets are used for direct validation of the precipitation products from GPM as well as to inform assumptions used by the algorithms that produce these products. This presentation will focus on current and potential such uses of GV data in the GPM combined radar-radiometer algorithm.The GPM combined algorithm, by virtue of using data from the Dual-frequency Precipitation Radar (DPR) and GPM Microwave Imager (GMI), is the most well-constrained instantaneous precipitation product from GPM. It also plays an important in role the passive microwave algorithms as a basis for the construction of brightness temperature-precipitation profile databases and is a calibrator for the multi- satellite gridded product IMERG. Since both radar and radiometer data are used as observational inputs, and even with these data the retrievals are underconstrained, microphysical properties of the hydrometeor profile that are relevant over the range of GMI and DPR wavelengths and incidence angles need to be assumed by the algorithm forward models. Such properties include the normalized intercept parameter (N w ) and shape parameter () of the particle size distribution, ice size-density relationship, and particle size-aspect ratio relationships. The sub-beam variability must also be prescribed in order to accurately simulate the observed radar reflectivity profiles without introducing significant biases. The sensitivity of the algorithm to these parameters, along with their mean values and variability, will be discussed. Examples of future directions include refinement with new data (particularly the assumptions related to ice), and seeking relationships between assumptions and observable or environmental data.

Munchak, Joe.↗
NASA NTRS2019

Connecting Ground Validation and Algorithms

The Ground Validation (GV) component of the Global Precipitation Measurement (GPM) mission involved several field campaigns, involving aircraft, ground radars, and other instrument networks designed to measure various aspects of precipitation. In many cases, these instruments are still in operation at ongoing data collection sites at Wallops Flight Facility, VA and Marquette, MI. The data collected has been used for algorithm formulation and validation, but in many cases has been under-utilized. This presentation describes aspects of GPM algorithms that could benefit from GV data that has been collected and announces a workshop to be held for that purpose in March 2020.

Munchak, Stephen J.↗
NASA NTRS2020

An Experimental Validation of a Revised Paschen's Law Relating to the ESD of Aerospace Vehicle Surfaces

This work seeks to experimentally validate a modified Paschen law which takes into account the effects of electron-ion pair removal between two electrodes within a dynamic gas medium. A test facility has been designed and fabricated in order to create supersonic flow conditions within the test section. Custom designed electrodes are mounted into the test section at desired gap distances. A power supply is utilized to charge the electrodes until discharge occurs. The discharge voltage of the electrode is recorded over a range of pressures within the test section. An operational pressure range is calculated using isentropic flow and normal shock relations at the desired Mach numbers. These values are plotted against the modified Paschen curve as a function of Mach number, electrode gap distance, and pressure as a means of validation.

ESD↗
NASA NTRS2019

GOES-16 ABI Solar Reflective Channel Validation for Earth Science Application

This paper presents the validation results of GOES-16 Satellite's Advanced Baseline Imager (ABI) obtained from a reflectance-based field campaign undertaken at the Salar de Uyuni in Bolivia in June 2017. In situ ground measurements are used to characterize the surface reflectance and the atmosphere in order to constrain the radiative transfer code and predict at-sensor reflectance (also referred to as top-of-atmosphere (TOA) reflectance) to compare with concurrent GOES-16 ABI measurements. The five-day field campaign provided repeated TOA reflectance estimates, allowing assessment not only of the calibration accuracy of the ABI reflective channels 1, 2, 3, 5 and 6, but also of its stability over the duration of the campaign. The results show that the accuracy of the ABI reflective channels calibration is within specification for channels 1, 3, 5, and 6 - average biases within 2%; for channel 2 the bias is 5%. The estimated uncertainty on the derived biases is 2–2.4%. Some calibration stability issues were present in the ABI calibration at the time of the campaign: (i) a jump on the order of 2% in channels 1 and 6, coincident with an ABI solar calibration event, reflects an instability of the ABI gains in these channels, and (ii) short-term variability in channels 1 and 2 is due to striping (ABI detector-todetector calibration differences). Continued validation and subsequent reprocessing of ABI reflectance imagery would allow Earth scientists to fully benefit from the high spatial and spectral fidelity of the GOES-16 ABI diurnal measurements at the continental scale.

Joel McCorkel↗
NASA NTRS2019

Turbulence Measurements on a Wing-Fuselage Junction Model for CFD Validation

Current turbulence models, such as those employed in Reynolds-averaged Navier-Stokes CFD, are unable to reliably predict the onset and extent of the three-dimensional separated flow that typically occurs in wing fuselage junctions. To critically assess, as well as to improve upon, existing turbulence models, experimental validation-quality flow field data in the junction region is needed. To that end, NASA has developed a CFD validation experiment for a generic full-span wing-fuselage junction model at subsonic conditions. In this paper, we present and discuss sample results from this effort, with a focus on turbulence measurements in the separated corner flow of the wing-fuselage junction that were obtained with an internally mounted laser Doppler velocimetry (LDV) system. In addition, sample comparisons between the flow field measurements and representative CFD of our test case are presented and here, we highlight some of the key discrepancies.

Kegerise, Michael↗