Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Assimilation of GEO and LEO Satellite Retrievals in WRF-Chem (15 km and 4 km) with ‘Top-Down’ Emissions Estimation

We are constraining concentrations and emissions for all criteria pollutants (CO, O3, NO2, SO2, PM10, and PM2.5) with WRF-Chem/DART in applications for FRAPPE (15-km grid) and COLORADO (4-km grid). Our results show that: (i) dynamic emissions estimation at medium resolutions (15 km) improves forecast skill; (ii) At high resolutions, the results look good, but we do not have validation data; (iii) for what may be the first time, we assimilate O3 retrieval profiles in a regional model. The problem is that the averaging kernels generally extend above the upper boundary of regional models. We use O3 upper boundary conditions from the global model to solve that problem; and (iv) In the high resolution experiments, we document the potential benefits of assimilating TEMPO O3 profile and NO2 tropospheric column retrievals. Here, we assimilate proxy TEMPO retrievals from a GEOS-Chem nature run, so there’s a conceptual problem due to the potential bias of the proxy retrievals, but the point is to demonstrate our ability to assimilate TEMPO and identify its potential impacts.

Chemical data assimilation↗

TESS Data Release Notes: Sector 57, DR82

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). The data products included in this data release are full frame images (FFIs), target pixel files, light curve files, collateral pixel files, cotrending basis vectors (CBVs), and Data Validation (DV) reports, time series, and associated xml files.

TESS↗

Nasa Supersonics Research and the X-59 —To Enable Future Supersonic Travel!

- Brief history of supersonic flight - Shock waves and sonic booms - Sonic boom pressure signatures and loudness - Tools for studying quiet supersonic flight - CFD (Computational Fluid Dynamics) - Wind tunnels - Flight test - Quesst Mission - X-59 airplane - Mission profile - Flight simulations - Wind tunnel data validations - Video: Supersonic flight research leading to Quesst

sonic boom↗

Experimental Characterization of an Electric Ducted Fan for the SUSAN 25% Scale Research Vehicle

An electric ducted fan (EDF) was tested in the NASA Langley 12-Foot Low-Speed Tunnel for the SUbsonic Single Aft eNgine (SUSAN) Electrofan 25% scale research vehicle, which incorporates distributed electric fans along the wings and serves as a scaled electrified transport aircraft testbed. The commercial-off-the-shelf EDF was selected as a propulsor that can meet the 25% scale vehicle geometry constraints, along with the performance requirements throughout the flight profile. The test included a series of one-factor-at-a-time (OFAT) and design of experiments (DOE) approaches that were implemented across a range of fan speed, voltage, freestream dynamic pressure, and incidence angle settings to characterize the performance of the EDF. Several test matrix designs and modeling approaches were considered. System identification methods were used to develop a static motor model, a dynamic motor model, an EDF thrust model, and a power consumption model. The model predictive capabilities were then evaluated with validation data not used in the modeling process. The results provide a comprehensive set of models developed to characterize the fan, and offer general insight into EDF modeling approaches.

electric ducted fan↗

Aerothermodynamic Analyses for the LOFTID Technology Demonstration Mission

On November 10, 2023, the LOFTID flight test successfully demonstrated the aerodynamic and thermal protection system performance of an inflatable aeroshell at conditions relevant to an operational mission. Aerodynamic performance and aeroheating environment databases for this mission were generated using multiple computational tools for the rarefied, hypersonic, and supersonic flow regimes, supplemented by wind tunnel testing to obtain aeroshell boundary-layer transition and wake flow simulation validation data. A detailed discussion of tools, methods and results is presented herein.

Brian R. Hollis↗

Characterization Progress of an Absorption Laser Differential Interferometer

An absorption laser differential interferometer (A-LDI) system can be used to provide simultaneous, colinear measurements of flow properties (pressure, temperature, concentration, velocity) and flow fluctuations. Further characterization work on the absorption aspect of the system is provided in this paper, including characterization of the laser operating parameters, comparisons of two etalons of different free spectral range, and the further evaluation of a fixed-wavelength absorption measurement that can be used to obtain absorption and LDI measurements with the same sampling rate. A 0.4 GHz etalon was demonstrated to provide sufficient fringe peaks at low modulation depths to be used for the low-pressure testing characteristic of hypersonic wind tunnel facilities. The use of a 3 GHz etalon as a low-cost relative wavemeter was tested and validated. Data taken with the fixed-wavelength strategy in a sub-atmospheric test cell using 100% O2was successful and will allow absorption and LDI data to be acquired simultaneously, colinearly, and at the same sampling rate, yielding a truly simultaneous measurement of the flow density fluctuations and the flow mean density.

Joshua M Weisberger↗

Aerothermodynamic Analyses for the LOFTID Technology Demonstration Mission

On November 10, 2023, the LOFTID flight test successfully demonstrated the aerodynamic and thermal protection system performance of an inflatable aeroshell at conditions relevant to an operational mission. Aerodynamic performance and aeroheating environment databases for this mission were generated using multiple computational tools for the rarefied, hypersonic, and supersonic flow regimes, supplemented by wind tunnel testing to obtain aeroshell boundary-layer transition and wake flow simulation validation data. A detailed discussion of tools, methods and results is presented herein.

Brian R. Hollis↗

Characterization Progress of an Absorption Laser Differential Interferometer

An absorption laser differential interferometer (A-LDI) system can be used to provide simultaneous, colinear measurements of flow properties (pressure, temperature, concentration, velocity) and flow fluctuations. Further characterization work on the absorption aspect of the system is provided in this paper, including characterization of the laser operating parameters, comparisons of two etalons of different free spectral range, and the further evaluation of a fixed-wavelength absorption measurement that can be used to obtain absorption and LDI measurements with the same sampling rate. A 0.4 GHz etalon was demonstrated to provide sufficient fringe peaks at low modulation depths to be used for the low-pressure testing characteristic of hypersonic wind tunnel facilities. The use of a 3 GHz etalon as a low-cost relative wavemeter was tested and validated. Data taken with the fixed-wavelength strategy in a sub-atmospheric test cell using 100% O 2 was successful and will allow absorption and LDI data to be acquired simultaneously, colinearly, and at the same sampling rate, yielding a truly simultaneous measurement of the flow density fluctuations and the flow mean density.

Joshua M. Weisberger↗

Development and Application of NASA SPoRT’s DustTracker-AI Model for Real-Time Identification and Tracking of Dust in Geostationary Satellite Imagery

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed the DustTracker-AI model for identifying and tracking dust in NASA/NOAA Geostationary Operational Environmental Satellite (GOES) imagery in a real-time framework. A training dataset consisting of day and night dust cases was gathered over the southwestern consisting of 115 distinct images and over a million dust pixels and 256 million no dust pixels. The dataset was separated into training (60%), testing (20%), and validation (20%). A simple random forest machine learning model was developed originally to overcome the problem of night-time dust detection and has been expanded to a comprehensive day/night model for dust identification and tracking. This physically-based machine-learning approach uses NASA/NOAA GOES-16 Advanced Baseline Imager infrared imagery as inputs to the model. The model probability of dust output achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels for all dust images in the validation data set. In conjunction with developing the machine-learning model, the NASA Short-term Prediction Research and Transition Center (SPoRT) partnered with NOAA National Weather Service forecast offices to evaluate the model for utility in weather forecasting operations during the 2021 and 2023 late winter-spring seasons. Preliminary evaluation has indicated the majority of forecasters described the DustTracker-AI probabilities as having added confidence to interpreting the Dust RGB and other satellite products to objectively assess the dust extent and trends and increased the amount of time the dust plume could be tracked into the night as compared to use of the Dust RGB. More recently, SPoRT tested small scale events associated with thunderstorm outflow and burn scars to determine the model’s ability to capture local events. This presentation highlights design of the model, validation/evaluation of model performance, and example cases collected during end user product assessments.

Connor H Welch↗

Expanded Signal to Noise Ratio Estimates for Validating Next-Generation Satellite Sensors in Oceanic, Coastal, and Inland Waters

The launch of the NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) and the Surface Biology and Geology (SBG) satellite sensors will provide increased spectral resolution compared to existing platforms. These new sensors will require robust calibration and validation datasets, but existing field-based instrumentation is limited in its availability and potential for geographic coverage, particularly for coastal and inland waters, where optical complexity is substantially greater than in the open ocean. The minimum signal-to-noise ratio (SNR) is an important metric for assessing the reliability of derived biogeochemical products and their subsequent use as proxies, such as for biomass, in aquatic systems. The SNR can provide insight into whether legacy sensors can be used for algorithm development as well as calibration and validation activities for next-generation platforms. We extend our previous evaluation of SNR and associated uncertainties for representative coastal and inland targets to include the imaging sensors PRISM and AVIRIS-NG, the airborne-deployed C-AIR radiometers, and the shipboard HydroRad and HyperSAS radiometers, which were not included in the original analysis. Nearly all the assessed hyperspectral sensors fail to meet proposed criteria for SNR or uncertainty in remote sensing reflectance (R rs ) for some part of the spectrum, with the most common failures (>20% uncertainty) below 400 nm, but all the sensors were below the proposed 17.5% uncertainty for derived chlorophyll-a. Instrument suites for both in-water and airborne platforms that are capable of exceeding all the proposed thresholds for SNR and R rs uncertainty are commercially available. Thus, there is a straightforward path to obtaining calibration and validation data for current and next-generation sensors, but the availability of suitable high spectral resolution sensors is limited.

signal-to-noise ratio↗

Development of Computational Materials Workflows for Additively Manufactured Metallic Materials to Enable Accelerated Prediction of Fatigue Performance

The maturation of computational materials approaches for fatigue performance prediction in a qualification and certification process is stifled by the ability to validate complex, microstructure-based simulations. Such a validation strategy bears immediate challenges including generating accurate virtual microstructures, efficiently solving physics-based mechanical simulations over relevant spatial and temporal scales, and acquiring high-fidelity calibration and validation data at the appropriate length scale. This presentation will overview these common challenges and present a case study to demonstrate a computational materials workflow for additively manufactured metallic materials. In this study, process-specific defects are characterized using segmented X-Ray micro-computed tomography measurements and overlaid on virtual microstructures. Accelerated crystal plasticity-based fatigue simulations are performed to demonstrate cyclic evolution and localization of mechanical fields in the vicinity of defects in response to their precise spatial configuration. An example of how this computational materials workflow may support next-generation qualification is discussed.

computational materials↗

Advances in Design Capabilities for Planetary Missions from the NASA Entry Systems Modeling and Instrumentation Portfolio

The Entry Systems Modeling project (ESM) is supported by both the NASA Space Technology and the Science Mission Directorates and focuses on developing simulation tools and validated models for characterizing the performance of entry systems tailored to planetary destinations across the Solar System. ESM is organized into six technical capability areas that together address all relevant factors related to spacecraft entry, as well as some aspects of descent: Thermal Protection System (TPS) Materials; Aerothermodynamics; Entry & Descent Vehicle Dynamics; Guidance, Navigation, and Control; Vehicle Systems Analysis; and Advanced Tools and Numerical Methods. Development within the capability areas is undertaken explicitly with a focus on transition and infusion to science missions, human exploration missions, and commercial space activities. The present talk details developments that specifically impact science missions, including simulation tool capabilities that aid in mission design and model development to understand entry system performance at a given destination. Examples of the successful infusion and transition of such project outcomes to science missions also are provided. Several simulation tool development efforts within ESM have resulted in new design capabilities for missions. One such outcome is improved toolsets for mission trajectory and concept of operations design. Specifically, an initiative to couple a leading tool for entry, ascent/descent, and orbital trajectory optimization (Program to Optimize Simulated Trajectories II or POST2) to those used within the Agency for interplanetary trajectory optimization (Copernicus and Monte) has made substantial progress, with the outcomes to date promising to allow efficient trajectory optimization across mission phases. Additionally, toolchains for the evaluation of vehicle performance during entry and descent have been developed that allow assessment of multi-dimensional aeroheating on detailed vehicle geometries, characterization of deployment and inflation of parachutes, and assessment of vehicle dynamic stability during descent. These capabilities are achieved by coupling diverse sets of physics together – material response, computational fluid dynamics, radiation, and vehicle dynamics – to suitably describe complex entry and descent phenomena. Several model development and validation efforts for specific destinations and entry regimes also are underway within the ESM project. For instance, new experimental capabilities to validate radiation models at low densities/high altitudes recently have been established with project support, specifically the Low-Density Shock Tube (LDST) at the NASA Ames Research Center Electric Arc Shock Tube (EAST) facility. The LDST is being leveraged to develop improved models of shock layer kinetics and radiation in Titan atmospheres, while future studies will be conducted in the LDST and the existing high velocity shock tube to provide validation data for radiation models of Venus, Ice Giants, and Mars atmospheres. Models describing the aerothermal and thermo-structural performance of Thermal Protection System (TPS) materials has been another focus, with multiscale modeling activities on-going for the two leading TPS materials applicable to a range of entry conditions and science missions: the Phenolic-Impregnated Carbon Ablator (PICA) and woven materials like 3D Mid-Density Carbon Phenolic (3MDCP). A continual effort is made to infuse and transition outcomes from ESM simulation tool and model development activities into relevant science missions. Significant progress has been made on this front, with missions such as Dragonfly, DAVINCI, and Mars Missions benefitting from project outcomes. The groundwork also is being laid to provide insights into forward looking missions to Gas/Ice Giants as well as for potential sample returns.

Justin Haskins↗

The GEOS Ozone Data Assimilation System: Design and Validation

An ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center to provide global three-dimensional analyzed ozone mixing ratio and total column ozone. The Total Ozone Mapping Spectrometer (TOMS) total column ozone and the Solar Backscatter Ultraviolet (SBUV) or SBUV/2 partial ozone profile data are assimilated. The analyzed winds from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) drive the ozone transport. Following every transport model timestep, the model prediction is combined with the observations using a global, physical-space based, statistical analysis scheme. Due to the smaller size of the ozone system than that of a global meteorological data assimilation system, new statistical analysis methodology, including anisotropic and flow-dependent forecast error correlation models, can be implemented and tested in the ozone system more easily. Sample results from the winter 1992 validation period are presented. There is a close agreement between the analyzed fields and the independent observations from ozone sondes and the Halogen Occultation Experiment (HALOE).

Stajner, I.↗

How Long Is Too Long? Variogram Analysis of AERONET Data to Aid Aerosol Validation and Intercomparison Studies

Geophysical data sets derived from satellite sensors, ground/airborne instrumentation, and computational models are often compared against each other. A common example is the validation of satellite aerosol optical depth (AOD) retrievals against measurements from Aerosol Robotic Network (AERONET) Sun photometers. Spatiotemporal mismatch between data set sampling means that uncaptured variation in the underlying geophysical field introduces apparent disagreement into such comparisons, known as representation or collocation matchup uncertainty. This study uses variogram analysis of AERONET data to estimate temporal mismatch uncertainties and decorrelation time scales for the global AERONET record. As well as total AOD, the fine‐ and coarse‐mode AODs, Ångström Exponent (AE), and fine‐mode fraction (FMF) of AOD are analyzed. Globally, a time difference of 30 min typically induces from 0.011–0.035 variation in AOD. For total, fine, and coarse AODs the typical time to decorrelation is around 2–10 days. For AE and FMF it is 3–33 days; that is, aerosol systems often persist significantly longer than individual events in them. Biomass burning regions tend to show the largest and fastest subdaily AOD variability and also longest times to decorrelation. Some sites show significant season‐to‐season variations in behavior. These results can be used to inform site‐specific time collocation thresholds for aerosol validation analyses and account for temporal variation when estimating data set uncertainty. They also have implications for comparisons between different satellite products or models, data aggregation, and time series analyses. Results are provided on a site‐by‐site basis to facilitate use by other researchers.

satellite↗

High-Resolution Simulation of Hurricane Bonnie (1998): Microphysics Validation using TRMM Data

A simulation of Hurricane Bonnie (1998) has been performed using multiple grid nesting to 2 km grid spacing. The simulation is initialized with large-scale analysis fields from the European Center for Medium Range Forecasts and with a bogus vortex inserted via four-dimensional variational data assimilation. The simulation reproduces well the storm intensity, the wavenumber 1 asymmetry of the precipitation field, the occurrence of deep convective towers within the eyewall, and the presence of broad stratiform precipitation regions. Radar and microwave observations from TRMM are used to validate the simulation. Result show excessive graupel production and, to some extent, excessive precipitation production in general by the model. Additional simulations are conducted (and validated by TRMM data) to test parameters and assumptions within the microphysics parameterizations including particle size distributions, particle densities, and assumptions that impact the partitioning of precipitation mass between graupel and snow.

Starr, David OC.↗

NASA-JSC ozone observations for validation of Nimbus 7-LIMS data

A series of balloon flights undertaken to validate data received from the limb infrared monitor of the stratorphere instrument aboard the Nimbus 7 satellite is discussed. Ozone data profiles, which included altitude, pressure, and mixing ratio, obtained during both ascent and descent of the balloons are reported. The measurement concept, instrumental uncertainties, and temporal variations observed for several time periods are discussed.

Robbins, D. E.↗

Earth Science Enterprise Scientific Data Purchase Project: Verification and Validation

This paper presents viewgraphs on the Earth Science Enterprise Scientific Data Purchase Project's verification,and validation process. The topics include: 1) What is Verification and Validation? 2) Why Verification and Validation? 3) Background; 4) ESE Data Purchas Validation Process; 5) Data Validation System and Ingest Queue; 6) Shipment Verification; 7) Tracking and Metrics; 8) Validation of Contract Specifications; 9) Earth Watch Data Validation; 10) Validation of Vertical Accuracy; and 11) Results of Vertical Accuracy Assessment.

Jenner, Jeff↗

The Updated Umkehr Ozone Retrieval Algorithm and its Validation against Satellite Data

Improvements to the Umkehr ozone profile retrieval algorithm have been developed and are now being evaluated. The updated algorithm is able to simulate observations more accurately and provides data output that is easier to analyze. Among the new diagnostic capabilities that the updated algorithm provides is the averaging kernel (AK) method. The AK approach allows studying how the algorithm responds when a small perturbation is made in a particular layer of the atmosphere [Rodgers 1976, 1990]. We will use the AK method to define precisely what Umkehr should measure given a set of profiles measured by other platforms. This method allows us to compare trends and offsets in data more accurately than it has been done in the past. The updated Umkehr retrievals will be validated against SAGE II ozone profiles as well as SSBUV ozone profile data. We will discuss possible reasons for offset between data and differences in derived ozone profile trends. Considerable variability of the ozone profile within the 10-degree latitude envelope creates noise in the SAGE matching dataset and makes comparisons difficult. To eliminate this problem, the SAGE and Umkehr data had been previously de-seasonalized by subtracting the latitude/season dependent ozone climatology. However, the remaining noise in the ozone residuals was still considerably high for trend analysis and was attributed to longitude variability of SAGE sampling. The new ozone climatology (Labow, NASA) that has longitude dependent ozone variability will be used to minimize contribution of sampling noise in comparisons of satellite and ground station. The comparison of zenith-sky radiances (Umkehr N-value measurements) synthesized for a given set of SAGE profiles will be used to determine whether SAGE-derived N-values agree with the Umkehr-measured N-values. The instrumental effects will be discussed. Both the Umkehr data and SAGE II measurements will be analyzed for their information about ozone variability and loss and recovery rates at the mid- and upper (40 km) levels. The updated long-term Umkehr dataset can be used to provide high quality information for identifying signs of ozone recovery. The long Umkehr historical record can provide additional information for separating the dynamic and chemical mechanisms of depletion, and can help the community better understand climate change effects.

Petropavlovskikh, I.↗