Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Snow Depth and Ice Thickness Measurements From the Beaufort and Chukchi Seas Collected During the AMSR-Ice03 Campaign

In March 2003, a field validation campaign was conducted on the sea ice near Barrow, AK. The goal of this campaign was to produce an extensive dataset of sea ice thickness and snow properties (depth and stratigraphy) against which remote sensing products collected by aircraft and satellite could be compared. Chief among these were products from the Polarimetric Scanning Radiometer (PSR) flown aboard a NASA P-3B aircraft and the Aqua Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E). The data were collected in four field areas: three on the coastal sea ice near Barrow, AK, and the fourth out on the open ice pack 175 km northeast of Barrow. The snow depth ranged from 9.4-20.8 cm in coastal areas (n = 9881 for three areas) with the thinnest snow on ice that had formed late in the winter. Out in the main pack ice, the snow was 20.6 cm deep (n = 1906). The ice in all four areas ranged from 138-219 cm thick (n = 1952), with the lower value again where the ice had formed late in the winter. Snow layer and grain characteristics observed in 118 snow pits indicated that 44% of observed snow layers were depth hoar; 46% were wind slab. Snow and ice measurements were keyed to photomosaics produced from low-altitude vertical aerial photographs. Using these, and a distinctive three-way relationship between ice roughness, snow surface characteristics, and snow depth, strip maps of snow depth, each about 2 km wide, were produced bracketing the traverse lines. These maps contain an unprecedented level of snow depth detail against which to compare remote sensing products. The maps are used in other papers in this special issue to examine the retrieval of snow properties from the PSR and AMSR-E sensors.

Sturm, M.↗

Can We Use the QA4ECV Black-sky Fraction of Absorbed Photosynthetically Active Radiation (FAPAR) using AVHRR Surface Reflectance to Assess Terrestrial Global Change?

NOAA platforms provide the longest period of terrestrial observation since the 1980s. The progress in calibration, atmospheric corrections and physically based land retrieval offers the opportunity to reprocess these data for extending terrestrial product time series. Within the Quality Assurance for Essential Climate Variables (QA4ECV) project, the black-sky Joint Research Centre (JRC)-fraction of absorbed photosynthetically active radiation (FAPAR) algorithm was developed for the AVHRR sensors on-board NOAA-07 to -16 using the Land Surface Reflectance Climate Data Record. The retrieval algorithm was based on the radiative transfer theory, and uncertainties were included in the products. We proposed a time and spatial composite for providing both 10-day and monthly products at 0.05º × 0.05º. Quality control and validation were achieved through benchmarking against third-party products, including Sea-Viewing Wide Field-of-View Sensor (SeaWiFS) datasets produced with the same retrieval algorithm. Past ground-based measurements, providing a proxy of FAPAR, showed good agreement of seasonality values over short homogeneous canopies and mixed vegetation. The average difference between SeaWiFS and QA4ECV monthly products over 2002–2005 is about 0.075 with a standard deviation of 0.091. We proposed a monthly linear bias correction that reduced these statistics to 0.02 and 0.001. The complete harmonized long-term time series was then used to address its fitness for the purpose of analysis of global terrestrial change.

AVHRR↗

Web-based Visualization and Analytics of Petascale Data: Equity as a Tide that Lifts All Boats

Scientists generate petabytes of data daily to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other environmental variables is essential to predicting and establishing root causes of future undesirable scenarios and assessing possible mitigation strategies. While supercomputer centers provide a powerful infrastructure for generating petabytes of simulation output, accessing and analyzing these datasets interactively remains challenging on multiple fronts. This paper presents an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. Our novel data fabric abstraction layer allows user-friendly querying of scientific information while hid-ing the complexities of dealing with file systems or cloud services.We also optimize network utilization while streaming from petas-cale repositories through state-of-the-art progressive compression algorithms. Based on this abstraction, we provide customizable dashboards that can be accessed from any device with any inter-net connection, enabling interactive visual analysis of vast amounts of data to a wide range of users - from top scientists with access to leadership-class computing environments to undergraduate students of disadvantaged backgrounds from minority-serving institutions. We focus on NASA’s use of petascale climate datasets as an example of particular societal impact and, therefore, a case where achieving equity in science participation is critical. We validate our approach by improving the ability of climate scientists to visually explore their data via two fully interactive dashboards. We further validate our approach by deploying the dashboards and simplified training materials in the classroom at a minority-serving institution.These dashboards, released in simplified form to the general public, contribute significantly to a broader push to democratize the access and use of climate data.

Data visualization↗

Simulated Inherent Optical Properties of Aquatic Particles Using the Equivalent Algal Populations (EAP) Model

Paired measurements of phytoplankton absorption and backscatter, the inherent optical properties central to the interpretation of ocean colour remote sensing data, are notoriously rare. We present a dataset of Chlorophyll a (Chl a) -specific phytoplankton absorption, scatter and backscatter for 17 different phytoplankton groups, derived from first principles using measured in vivo pigment absorption and a well-validated semi-analytical coated sphere model which simulates the full suite of biophysically consistent phytoplankton optical properties. The optical properties of each simulated phytoplankton cell are integrated over an entire size distribution and are provided at high spectral resolution. The model code is additionally included to enable user access to the complete set of wavelength-dependent, angularly resolved volume scattering functions. This optically coherent dataset of hyperspectral optical properties for a set of globally significant phytoplankton groups has potential for use in algorithm development towards the optimal exploitation of the new age of hyperspectral satellite radiometry.

Equivalent Algal Populations↗

A generalizable machine learning approach to predict land surface temperature

Monitoring of land surface and atmospheric states is highly reliant on satellite data. Traditionally, data products are generated using carefully tuned and validated algorithms for low-earth orbit (LEO) sensors. However, the emerging constellation of geostationary (GEO) sensors contributes global, high temporal resolution observations which can better capture the diurnal variability of key observables like land surface temperature (LST). Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from LEO and GEO satellites to develop a deep learning-based method for sensor-to-sensor algorithm emulation. Our model is trained on GOES-16 thermal bands to predict MODIS Terra LST and achieves a validation error <2K. Further, application of the model to unseen times of day and a second GEO sensor observing an unseen spatial domain demonstrate the generalization of the deep learning model across space, time and spectra. We anticipate that the synergies between a variety of active orbit configurations can be used to accelerate application of existing algorithms to new datasets.

Kate Marie Duffy↗

Better Weather Prediction and Climate Diagnostics Using Rainfall Measurements from Space

Progress in understanding of the role of water in global weather and climate is currently limited by our knowledge of the spatial and temporal variability of primary hydrological fields such as precipitation and evaporation. The Tropical Rainfall Measuring Mission (TRMM) has recently demonstrated that use of microwave-based rainfall observations from space in data assimilation can provide better climate data sets and improve short-range weather forecasting. At NASA, we have been exploring non-traditional approaches to assimilating TRMM Microwave Imager (TMI) and Special Sensor Microwavehager (SSM/I) surface rain rate and latent heating profile information in global systems. In this talk we show that assimilating microwave rain rates using a continuous variational assimilation scheme based on moisture tendency corrections improves quantitative precipitation estimates (QPE) and related clouds, radiation energy fluxes, and large-scale circulations in the Goddard Earth Observing System (GEOS) reanalyses. Short-range forecasts initialized with these improved analyses also yield better QPE scores and storm track predictions for Hurricanes Bonnie and Floyd. We present a status report on current efforts to assimilate convective and stratiform latent heating profile information within the general variational framework of model parameter estimation to seek further improvements. Within the next 5 years, there will be a gradual increase in microwave rain products available from operational and research satellites, culminating to a target constellation of 9 satellites to provide global rain measurements every 3 hours with the proposed Global Precipitation Measurement (GPM) mission in 2007/2008. Based on what has been learned from TRMM, there is a high degree of confidence that these observations can play a'major role in improving weather forecasts and producing better global datasets for understanding the Earth's water and energy cycle. The key to success is to adopt an integrated approach to retrieval, validation, modeling, and data assimilation in a coordinated end-to-end observation-application program.

Hou, Arthur↗

ICESat-2 Simulated Data from Airborne Altimetery

Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) is scheduled to launch in 2015 and will carry onboard the Advanced Topographic Laser Altimeter System (ATLAS), which represents a new approach to spaceborne determination of surface elevations. Specifically, the current ATLAS design is for a micropulse, multibeam, photon-counting laser altimeter with lower energy, a shorter pulse width, and a higher repetition rate relative to the Geoscience Laser Altimeter (GLAS), the instrument that was onboard ICESat. Given the new and untested technology associated with ATLAS, airborne altimetry data is necessary (1) to test the proposed ATLAS instrument geometry, (2) to validate instrument models, and (3) to assess the atmospheric effects on multibeam altimeters. We present an overview of the airborne instruments and datasets intended to address the ATLAS instrument concept, including data collected over Greenland (July 2009) using an airborne SBIR prototype 100 channel, photon-counting, terrain mapping altimeter, which addresses the first of these 3 scientific concerns. Additionally, we present the plan for further simulator data collection over vegetated and ice covered regions using Multiple Altimeter Beam Experimental Lidar (MABEL), intended to address the latter two scientific concerns. As the ICESAT-2 project is in the design phase, the particular configuration of the ATLAS instrument may change. However, we expect this work to be relevant as long as ATLAS pursues a photon-counting approach.

Brunt, Kelly M.↗

NASA IMAGESEER: NASA IMAGEs for Science, Education, Experimentation and Research

A number of web-accessible databases, including medical, military or other image data, offer universities and other users the ability to teach or research new Image Processing techniques on relevant and well-documented data. However, NASA images have traditionally been difficult for researchers to find, are often only available in hard-to-use formats, and do not always provide sufficient context and background for a non-NASA Scientist user to understand their content. The new IMAGESEER (IMAGEs for Science, Education, Experimentation and Research) database seeks to address these issues. Through a graphically-rich web site for browsing and downloading all of the selected datasets, benchmarks, and tutorials, IMAGESEER provides a widely accessible database of NASA-centric, easy to read, image data for teaching or validating new Image Processing algorithms. As such, IMAGESEER fosters collaboration between NASA and research organizations while simultaneously encouraging development of new and enhanced Image Processing algorithms. The first prototype includes a representative sampling of NASA multispectral and hyperspectral images from several Earth Science instruments, along with a few small tutorials. Image processing techniques are currently represented with cloud detection, image registration, and map cover/classification. For each technique, corresponding data are selected from four different geographic regions, i.e., mountains, urban, water coastal, and agriculture areas. Satellite images have been collected from several instruments - Landsat-5 and -7 Thematic Mappers, Earth Observing-1 (EO-1) Advanced Land Imager (ALI) and Hyperion, and the Moderate Resolution Imaging Spectroradiometer (MODIS). After geo-registration, these images are available in simple common formats such as GeoTIFF and raw formats, along with associated benchmark data.

Le Moigne, Jacqueline↗

Mapping Global Forest Age from Forest Inventories, Biomass and Climate Data

Forest age can determine the capacity of a forest to uptake carbon from the atmosphere. However, a lack of global diagnostics that reflect the forest stage and associated disturbance regimes hampers the quantification of age-related differences in forest carbon dynamics. This study provides a new global distribution of forest age circa 2010, estimated using a machine learning approach trained with more than 40 000 plots using forest inventory, biomass and climate data. First, an evaluation against the plot-level measurements of forest age reveals that the data-driven method has a relatively good predictive capacity of classifying old-growth vs. non-old-growth (precision = 0.81 and 0.99 for old-growth and non-old-growth, respectively) forests and estimating corresponding forest age estimates (NSE = 0.6 – Nash–Sutcliffe efficiency – and RMSE = 50 years – root-mean-square error). However, there are systematic biases of overestimation in young- and underestimation in old-forest stands, respectively. Globally, we find a large variability in forest age with the old-growth forests in the tropical regions of Amazon and Congo, young forests in China, and intermediate stands in Europe. Furthermore, we find that the regions with high rates of deforestation or forest degradation (e.g. the arc of deforestation in the Amazon) are composed mainly of younger stands. Assessment of forest age in the climate space shows that the old forests are either in cold and dry regions or warm and wet regions, while young–intermediate forests span a large climatic gradient. Finally, comparing the presented forest age estimates with a series of regional products reveals differences rooted in different approaches and different in situ observations and global-scale products. Despite showing robustness in cross-validation results, additional methodological insights on further developments should as much as possible harmonize data across the different approaches. The forest age dataset presented here provides additional insights into the global distribution of forest age to better understand the global dynamics in the forest water and carbon cycles. The forest age datasets are openly available at https://doi.org/10.17871/ForestAgeBGI.2021 (Besnard et al., 2021).

Simon Besnard↗

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗

The Transition of Satellite Observations Assimilated in GEOS to JEDI

The Goddard Earth Observing System (GEOS) is used by NASA’s Global Modeling and Assimilation Office (GMAO) to produce weather, climate, and air quality forecasts and reanalysis datasets. In order to incorporate the Joint Effort for Data assimilation Integration (JEDI) system into GEOS it is necessary to provide a validated set of input observations in JEDI. The GMAO, in collaboration with the Joint Center for Satellite Data Assimilation (JCSDA), is developing the Unified Forward Operator (UFO) in JEDI and adding all the necessary features to replicate the existing capability of the Gridpoint Statistical Interpolation (GSI)–based GEOS atmospheric data assimilations system. GMAO has been adding, validating, and updating procedures to assimilate the vast array of satellite and conventional observations assimilated in GEOS, including the GEOS all-sky microwave radiance assimilation framework to assimilate those observations in the UFO. Robust tests have been conducted to ensure correct configurations of observational data bias correction, quality control, and observation error in UFO and good agreements between UFO and GSI results. Our work on satellite observations will be reported in this presentation.

Jianjun Jin↗

Validity of the Landsat Surface Reflectance Archive for Aquatic Science: Implications for Cloud-Based Analysis

Originally developed for terrestrial science and applications, the US Geological Survey Landsat surface reflectance (SR) archive spanning ~ 40 yr of observations has been increasingly utilized in large‐scale water‐quality studies. These products, however, have not been rigorously validated using in situ measured reflectance. This letter quantifies and demonstrates the quality of the SR products by harnessing a sizeable global dataset ( N = 1100). We found that the Landsat 8/9 SR in the green and red bands marginally meet the targeted accuracy requirements (30%), whereas the uncertainties in the blue and coastal‐aerosol bands ranged from 48% to 110%. We further observed > +25% biases in the visible bands of Landsat 5/7 SR, which can introduce an apparent downward trend when applied in time‐series analyses combined with Landsat 8/9. Users must exercise caution when using this archive for trend analyses, and progress in atmospheric correction is required to foster advanced applications of the Landsat archive for aquatic science.

Landsat, lakes, harmful algal blooms↗

Coaxial Rotor CFD Validation and ML Surrogate Model Generation

A fixed-pitch speed-controlled coaxial rotor system was tested in the NASA Langley Transonic Dynamics Tunnel in September 2022. The rotors have a diameter of 1.35 meters and an inter-rotor spacing of 25% of the diameter. Though this test was focused on the NASA New Frontiers Dragonfly mission, the resulting dataset is relevant to a wide array of applications of multirotor vehicles, especially those using fixed-pitch variable-speed rotors. Most notably beyond Dragonfly, perhaps, is the application of coaxial rotor pair configurations for eVTOL and Urban Air Mobility (UAM) aircraft. This work provides a thorough CFD validation study quantifying coaxial rotor performance estimation with accuracy on order 5-10% using an efficient hybrid BEMT-URANS flow solver over a wide range of operating conditions. This accuracy was achieved using novel approaches for the construction of both the C81 airfoil performance lookup tables and the BEMT rotor model. These novel approaches are combined with advanced scripting to further accelerate the commercial off-the-shelf CFD solver on GPU accelerated machines. Finally, the development of machine learning surrogate models is presented to produce highly efficient and accurate rotor performance predictions for fixed-pitch variable-speed multirotor aircraft over the complete flight regime including scout, cruise, climb, descent, as well as limiting cases of vortex-ring and windmill-brake states.

Coaxial↗

Unveiling Urban Pollution Patterns from a Bird’s-Eye View

Low-earth orbiting satellites have been observing the global distribution of nitrogen dioxide (NO2) since the 1990s and these observations have been used to identify pollution source regions, temporal trends, and links to health effects and community disparities. However, historically, space-based NO2 observations have been coarse in spatial and temporal resolution resulting in challenges in data interpretation and product validation; therefore, NASA developed airborne capabilities and measurements strategies to observe ultraviolet-visible (UV-VIS) trace gases at high temporal and spatial resolutions to unveiling never before seen spatiotemporal patterns over major urban hubs during recent air quality field studies. In this talk, Dr. Judd will share the story of these field studies with datasets collected from NASA’s airborne spectrometers, GeoTASO and GCAS, and how they integrate in with other space- and ground-based instrumentation to illustrate the conceptual model of air quality episodes in coastal urban environments, contribute to satellite validation and regional chemical transport model evaluation. These imagers have the capability to observe UV-VIS absorbing species, typically NO2 and HCHO, at spatial resolutions as fine as 250 m when observing from the upper-troposphere. Flight strategies allowed for the collection of repeated raster samples over urban areas multiple times per flight day in cities like Chicago, Los Angeles, and New York City, capturing never before seen pictures of the diurnal evolution of emissions, chemistry, and meteorology associated with NO2 heterogeneity. These airborne efforts help local air quality management better understand their air quality challenges as well as benefit the larger air quality community in preparation for geostationary air quality observations and the development of the global air quality observing system.

Laura Judd↗

Insights into Space Solar Cell Durability Using SPICE Simulation Seeded by Current-Voltage Characteristics Parametrized Using the Lambert W Special Function

We developed and validated an automated routine for the fitting of I-V curve data to the single diode model according to an exact analytical solution. Our fitting routine was validated to show good noise immunity and high accuracy usingsimulated values from LTSPICE. We are thus able to automate parameter extraction from a dataset or arbitrary size. This parameterization allows for better simulation of performance of real cells and arrays and provides utility for a host of applications relevant to space arrays. We will use this methodology to determine the array performance of radiated cells over time, and simulate the performance of the arrays with bypass diodes and power electronics.

Solar Cell↗

Simulation and Modeling of Hypersonic Turbulent Boundary Layers Subject to Favorable Pressure Gradients due to Streamline Curvature

Direct numerical simulations (DNS) of favorable-pressure-gradient turbulent boundary layers are presented for a nominal freestream Mach number of 5, with the objective of assessing the limitations of the currently available Reynolds-averaged Navier-Stokes (RANS) models.The wall geometry and flow conditions of the DNS are representative of the experimental data for a Mach 4.9 turbulent boundary layer that was tested on a two-dimensional planar convexwall model in the high-speed blow-down wind tunnel located at the National Aerothermochemistry Laboratory at Texas A&M University. The favorable pressure gradient is induced bythe streamwise surface curvature. The DNS results will be compared with experimental measurements and RANS computations for the same flow conditions and wall geometry. The DNS datasets will also be analyzed to provide an improved physical understanding of hypersonic boundary-layer turbulence subject to mechanical nonequilibrium, including the validity of Morkovin’s hypothesis and the various available compressibility transformations, as well as to obtain turbulence statistics that are relevant to RANS modeling, including the distribution ofeddy viscosity, the budgets of turbulent kinetic energy and Reynolds stresses, and the velocity-temperature correlations. The RANS predictions will be obtained by using both the commonly used one- and two-equation models that assume a constant turbulent Prandtl number and an algebraic, variable Prandtl number model for the turbulent energy flux.

turbulent boundary layers↗

SAGE III/ISS Validation Methods

Spatiotemporal collocation of measurements between instruments is an essential yet challenging component of the data validation process. Traditional methods of collocation may simply consider length of time and physical distance between measurements. However, the distribution of atmospheric constituents may change rapidly over time and space, so care must be taken to ensure that matched measurements represent the same environment and will not introduce unnecessary bias. More advanced collocation methods may consider additional physical parameters to minimize inappropriate matches with large differences caused by local circulation. We report results of SAGE III/ISS validation with ground-based measurements using advanced collocation methods, and assessments are performed on the quality and presence of trends in both datasets.

Mary Cate McKee↗