Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Retrieval Algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Hyperspectral Radiatve Transfer Modeling and its Applications

We will describe a fast radiative transfer model that is specifically designed for hyperspectral remote sensing applications. The fast radiative transfer model is capable of performing efficient and accurate calculations under cloudy condition and in the presence of solar radiations. The model uses a Principal Component Analysis to speed up computational speed. The PCRTM model is capable of simulating top of atmospheric radiance or reflectance spectral from 50 wavenumber to 30000 wavenumber. The PCRTM has a very good accuracy relative to reference line-by-line radiative transfer models and it saves orders of magnitude computational time. We will show comparisons of the PCRTM model to AIRS, CrIS, IASI, NAST-I, and SCIAMACHY data. We will further show results of applying the PCRTM retrieval algorithm to these remote sensing data to retrieve atmospheric temperature and moisture profiles, CO2, CO, CH4, N2O, and O3 profiles, cloud optical depth, size, phase, and height. Surface properties such as surface emissivity spectra and surface skin temperatures are also retrieved simultaneously.

X Liu↗
NASA NTRS2019

Exploring Aerosols Near Clouds With High‐Spatial‐Resolution Aircraft Remote Sensing During SEAC(4)RS

Since aerosols are important to our climate system, we seek to observe the variability of aerosol properties within cloud systems. When applied to the satellite‐borne Moderate‐resolution Imaging Spectroradiometer (MODIS), the Dark Target retrieval algorithm provides global aerosol optical depth (AOD; at 0.55 μm) in cloud‐free scenes. Since MODIS' resolution (500‐m pixels, 3‐ or 10‐km product) is too coarse for studying near‐cloud aerosol, we ported the Dark Target algorithm to the high‐resolution (~50‐m pixels) enhanced‐MODIS Airborne Simulator (eMAS), which flew on the high‐altitude ER‐2 during the Studies of Emissions, Atmospheric Composition, Clouds, and Climate Coupling by Regional Surveys Airborne Science Campaign over the United States in 2013. We find that even with aggressive cloud screening, the ~0.5‐km eMAS retrievals show enhanced AOD, especially within 6 km of a detected cloud. To determine the cause of the enhanced AOD, we analyze additional eMAS products (cloud retrievals and degraded‐resolution AOD), coregistered Cloud Physics Lidar profiles, MODIS aerosol retrievals, and ground‐based Aerosol Robotic Network observations. We also define spatial metrics to indicate local cloud distributions near each retrieval and then separate into near‐cloud and far‐from‐cloud environments. The comparisons show that low cloud masking is robust, and unscreened thin cirrus would have only a small impact on retrieved AOD. Some of the enhancement is consistent with clear‐cloud transition zone microphysics such as aerosol swelling. However, 3‐D radiation interaction between clouds and the surrounding clear air appears to be the primary cause of the high AOD near clouds.

aerosol retrieval algorithm↗
DOE OSTI2023

Direct reconstruction of isolated XUV or soft x-ray attosecond pulses from high-harmonic generation streaking spectra

Characterization of an isolated attosecond pulse (IAP) in the extreme ultraviolet (XUV) or soft x-ray (SXR) region is essential for its applications. Here we propose to retrieve an IAP in the time domain directly through the modulation of high-harmonic generation (HHG) spectra in the presence of a time-delayed intense few-cycle infrared or mid-infrared laser. The retrieval algorithm is derived based on the strong-field approximation and an extended quantitative rescattering model. We show that both isolated XUV pulses with a narrow spectral bandwidth and isolated SXR pulses with a broad bandwidth can be well characterized through the HHG streaking spectra. Such an all-optical method for characterizing the IAP differs from the commonly used approach based on the streaked photoelectron spectra that would require electron spectrometers. We check the robustness of the retrieval method by changing the dressing laser or by adjusting the steps of time delay. We also show that the XUV pulse can be accurately retrieved by treating the HHG streaking spectra calculated from solving the time-dependent Schrödinger equation for single atoms as the ‘experimental’ data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2011

Statistically Optimized Inversion Algorithm for Enhanced Retrieval of Aerosol Properties from Spectral Multi-Angle Polarimetric Satellite Observations

The proposed development is an attempt to enhance aerosol retrieval by emphasizing statistical optimization in inversion of advanced satellite observations. This optimization concept improves retrieval accuracy relying on the knowledge of measurement error distribution. Efficient application of such optimization requires pronounced data redundancy (excess of the measurements number over number of unknowns) that is not common in satellite observations. The POLDER imager on board the PARASOL microsatellite registers spectral polarimetric characteristics of the reflected atmospheric radiation at up to 16 viewing directions over each observed pixel. The completeness of such observations is notably higher than for most currently operating passive satellite aerosol sensors. This provides an opportunity for profound utilization of statistical optimization principles in satellite data inversion. The proposed retrieval scheme is designed as statistically optimized multi-variable fitting of all available angular observations obtained by the POLDER sensor in the window spectral channels where absorption by gas is minimal. The total number of such observations by PARASOL always exceeds a hundred over each pixel and the statistical optimization concept promises to be efficient even if the algorithm retrieves several tens of aerosol parameters. Based on this idea, the proposed algorithm uses a large number of unknowns and is aimed at retrieval of extended set of parameters affecting measured radiation.

Dubovik, O↗
NASA NTRS1988

Nimbus-7 global cloud climatology. I - Algorithms and validation

An improved version of the Nimbus-7 cloud retrieval algorithm was validated using data from Nimbus-7 Temperature Humidity Infrared Radiometer and Total Ozone Mapping Spectrometer to determine cloudiness parameters for the globe. Quantitative validation of total cloud amount was performed by comparing the algorithm results with estimates derived from GOES images and auxiliary meteorological data. The systematic errors of the Nimbus-7 total cloud-amount algorithm, relative to the GOES-derived estimates, were found to be less than 10 percent. The random errors of daily estimates ranged between 7 and 16 percent, day or night.

Stowe, L. L.↗
NASA NTRSDate not supplied

Global SO 2 Data Record from OMPS Instruments on the JPSS Constellation

NASA’s Earth Observing System (EOS) SO 2 climate data record (CDR) started in 2004, with the launch of the Aura/Ozone Monitoring Instrument (OMI) and is now being continued with the SNPP/Ozone Mapping and Profiler Suite (OMPS) launched in 2011. Both OMI and SNPP/OMPS SO 2 CDRs are produced with the Goddard principal component analysis (PCA) spectral fitting algorithm. An advantage of the data-driven PCA retrieval technique is that it enables highly consistent retrievals from different instruments, by inherently accounting for various instrumental factors. To further extend the EOS SO 2 CDR, we are implementing the PCA SO 2 retrieval algorithm with the L1B measurements from OMPS instruments flying on the Joint Polar Satellite System (JPSS) constellation. In this presentation, we will provide an update on our progress in NOAA-20 (launched in 2017) and NOAA-21 (launched in 2022) PCA SO2 retrievals. We will focus on our new NOAA-20/OMPS PCA SO 2 EOS continuity product, to be publicly released in fall of 2023. We will present statistical analyses on the quality of NOAA-20 PCA SO 2 product, including retrieval noise, biases over background areas, and long-term stability. We will compare our PCA SO 2 retrievals from NOAA-20 with those from OMI, SNPP/OMPS, and S5P/TROPOMI (TROPOspheric Monitoring Instrument) for anthropogenic sources as well as large volcanic plumes. We will also discuss the application of a new machine learning technique that helps to further reduce the noise of NOAA-20 SO 2 retrievals. In addition, we will present preliminary PCA SO 2 retrievals from NOAA-21/OMPS, including those from direct readout implementation for aviation disaster avoidance. Finally, we will share some first results applying the PCA algorithm to NASA’s geostationary TEMPO (Tropospheric Emissions: Monitoring of Pollution) instrument to obtain hourly, high resolution SO 2 data over North America.

SO2↗
NASA NTRS1992

A cloud and radiation model-based algorithm for rainfall retrieval from SSM/I multispectral microwave measurements

A hybrid statistical-physical retrieval scheme is explored which combines a statistical approach with an approach based on the development of cloud-radiation models designed to simulate precipitating atmospheres. The algorithm employs the detailed microphysical information from a cloud model as input to a radiative transfer model which generates a cloud-radiation model database. Statistical procedures are then invoked to objectively generate an initial guess composite profile data set from the database. The retrieval algorithm has been tested for a tropical typhoon case using Special Sensor Microwave/Imager (SSM/I) data and has shown satisfactory results.

Xiang, Xuwu↗
NASA NTRS1983

Remote assessment of ocean color for interpretation of satellite visible imagery: A review

An assessment is presented of the state-of-the-art of remote, (satellite-based) Coastal Zone Color (CZCS) Scanning of color variations in the ocean due to phytoplankton. Attention is given to physical problems associated with ocean color remote sensing, in-water algorithms for the correction of atmospheric effects, constituent retrieval algorithms and application of the algorithms to CZCS imagery. The applicability of CZCS to both near-coast and mid-ocean waters is considered, and it is concluded that while differences between the two environments are complex, universal algorithms can be used for the case of mid-ocean waters, and site-specific algorithms are adequate for CZCS imaging of the near-coast oceanic environment. A short description of CVCS and some sample photographs are provided in an appendix.

Gordon, H. R.↗
NASA NTRS2002

A Method to Retrieve Rainfall Rate over Land from TRMM Observations

Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar (PR) observations over mesoscale convective systems (MCSs) reveal that there are localized maxima in the rain rate with a scale of about 10 to 20 km that represent thunderstorms (Cbs). Some of these Cbs are developing or intense, while others are decaying or weak. These Cbs constitute only about 20 % of the rain area of a given MCS. Outside of Cbs, the average rain rate is much weaker than that within Cbs. From an analysis of the PR data, we find that the spatial distribution of rain and its character, convective or stratiform, is highly inhomogeneous. This complex nature of rain exists on a scale comparable to that of a Cb. The 85 GHz brightness temperature, T85, observations of the TRMM Microwave Imager (TMI) radiometer taken over an MCS reflect closely the PR rain rate pattern over land. Local maxima in rain rate shown by PR are observed as local minima in T85. Where there are no minima in T85, PR observations indicate there is light rain. However, the TMI brightness temperature measurements (Tbs) have poor ability to discriminate convective rain from stratiform rain. For this reason, a TMI rain retrieval procedure that depends primarily on the magnitude of Tbs performs poorly. In order to retrieve rain rate from TMI data on land one has to include the spatial distribution information deduced from the T85 data in the retrieval method. Then, quantitative estimation of rain rate can be accomplished. A TMI rain retrieval method developed along these lines can yield estimates of rain rate and its frequency distribution which agree closely with that given by PR. We find the current TRMM project TMI (Version 5) rain retrieval algorithm on land could be improved with the retrieval scheme developed here. To support the conceptual frame work of the rain retrieval method developed here, a theoretical analysis of the TMI brightness temperatures in convective and stratiform regions is presented.

Prabhakara, C.↗
NASA NTRS2005

Use of Multiangle Satellite Observations to Retrieve Aerosol Properties and Ocean Color

A new technique is described for retrieving aerosol over ocean water and the associated ocean color using multiangle satellite observations. Unlike current satellite aerosol retrieval algorithms which only utilize observations at red wavelengths and longer, with the assumption that these wavelengths have a negligible ocean (water-leaving radiance), this new algorithm uses all available spectral bands and simultaneously retrieves both aerosol properties and the spectral ocean color. We show some results of case studies using MISR data, performed over different water conditions (coastal water, blooms, and open water).

ocean↗
NASA NTRS2018

Observing the Full Spectrum of the Rain Drop Size Distribution

GPM DSD retrievals exhibit inconsistencies between GV, DPR and Combined algorithm retrievals. Development of positive bias in convective Dm rain DSD noted, and strongest in KuPR retrieval. Associated epsilons are too low and result in markedly reduced convective rain rates (a current issue in the retrievals). Source may be NUBF. Issues with the large end of the DSD not withstanding, on the small end of the DSD, combined MPS and 2DVD measurements fit with generalized gamma functions exhibit strong potential for representing the entire spectrum of the DSD and subsequently the whole rain rate spectrum.

Hydrology↗
NASA NTRS2019

SMAP Mission Status and Plan

The prime mission phase of National Aeronautics Space Administration's (NASA's) Soil Moisture Active Passive (SMAP) project was successfully completed in June 2018. The extended phase has been approved by NASA for operation through 2021 (with option to 2023). SMAP data have been well calibrated and have enabled diverse scientific investigations in water, energy and carbon cycle research, terrestrial ecology and ocean science. This paper will provide the highlights of algorithm updates to radiometric calibration and soil moisture retrieval algorithms. A summary of extended phase activities, in particular the SMAPVEX19 campaign, for product enhancements will be provided.

Water Cycle↗
NASA NTRS2023

PCRTM-RA Enhancements for Improving CO Retrievals Using NAST-I Measurements From the FIREX-AQ Field Campaign

The Principal Component-based Radiative Transfer Model Retrieval Algorithm (PCRTM-RA) for carbon monoxide (CO) retrieval has been improved for better use of National Airborne Sounder Testbed-Interferometer (NAST-I) measurements obtained during the Fire Influence on Regional to Global Environments and Air Quality (FIREX-AQ) field campaign. One of the explicit purposes of the campaign was to characterize wildfire-induced atmospheric changes. Coincidental measurements from various airborne instruments including NAST-I infrared hyperspectral measurements from the NASA ER-2 aircraft provided us an opportunity to test and improve the PCRTM-RA CO retrieval. By relaxing the vertical correlation of CO profiles in the a-priori covariance constraint, a significant improvement in the vertical structure of the CO retrieval has been confirmed. The methodology is validated using a synthetic testing dataset that covers observations associated with various CO vertical profiles including that of an extremely polluted atmosphere. The methodology is also applied to real NAST-I measurements, and the results have successfully demonstrated the capability of using PCRTM-RA retrieval results for CO plume evolution and transport monitoring.

Carbon monoxide (CO)↗
NASA NTRS2023

A Performance Analysis on Soil Dielectric Models Over Organic Soils in Alaska for Passive Microwave Remote Sensing of Soil Moisture

Passive microwave remote sensing of soil moisture (SM) requires a physically based dielectric model that quantitatively converts the volumetric SM into the soil bulk dielectric constant. Mironov 2009 is the dielectric model used in the operational SM retrieval algorithms of the NASA Soil Moisture Active Passive (SMAP) and the ESA Soil Moisture and Ocean Salinity (SMOS) missions. However, Mironov 2009 suffers a challenge in deriving SM over organic soils, as it does not account for the impact of soil organic matter (SOM) on the soil bulk dielectric constant. To this end, we presented a comparative performance analysis of nine advanced soil dielectric models over organic soil in Alaska, four of which incorporate SOM. In the framework of the SMAP single-channel algorithm at vertical polarization (SCA-V), SM retrievals from different dielectric models were derived using an iterative optimization scheme. The skills of the different dielectric models over organic soils were reflected by the performance of their respective SM retrievals, which was measured by four conventional statistical metrics, calculated by comparing satellite-based SM time series with in-situ benchmarks. Overall, SM retrievals of organic-soil-based dielectric models tended to overestimate, while those from mineral-soil-based models displayed dry biases. All the models showed comparable values of unbiased root-mean-square error (ubRMSE) and Pearson Correlation (R), but Mironov 2019 exhibited a slight but consistent edge over the others. An integrated consideration of the model inputs, the physical basis, and the validated accuracy indicated that the separate use of Mironov 2009 and Mironov 2019 in the SMAP SCA-V for mineral soils (SOM < 15%) and organic soils (SOM ≥ 15%) would be the preferred option.

Soil Moisture↗
NASA NTRS1999

Aerosol Retrievals over the Ocean using Channel 1 and 2 AVHRR Data: A Sensitivity Analysis and Preliminary Results

This paper outlines the methodology of interpreting channel 1 and 2 AVHRR radiance data over the oceans and describes a detailed analysis of the sensitivity of monthly averages of retrieved aerosol parameters to the assumptions made in different retrieval algorithms. The analysis is based on using real AVHRR data and exploiting accurate numerical techniques for computing single and multiple scattering and spectral absorption of light in the vertically inhomogeneous atmosphere-ocean system. We show that two-channel algorithms can be expected to provide significantly more accurate and less biased retrievals of the aerosol optical thickness than one-channel algorithms and that imperfect cloud screening and calibration uncertainties are by far the largest sources of errors in the retrieved aerosol parameters. Both underestimating and overestimating aerosol absorption as well as the potentially strong variability of the real part of the aerosol refractive index may lead to regional and/or seasonal biases in optical thickness retrievals. The Angstrom exponent appears to be the most invariant aerosol size characteristic and should be retrieved along with optical thickness as the second aerosol parameter.

Mishchenko, Michael I.↗
NASA NTRS2024

Synergistic Retrievals of Ice in High Clouds From Elastic Backscatter Lidar, Ku-band Radar and Submillimeter Wave Radiometer Observations

In this study, we investigate the synergy of elastic backscatter lidar, Ku-band radar, and sub-millimeter-wave radiometer measurements in the retrieval of ice from satellite observations. The synergy is analyzed through the generation of a large dataset of IceWater Content (IWC) profiles and simulated lidar, radar and radiometer observations. The characteristics of the instruments e.g. frequencies, sensitivities, etc. are set based on the expected characteristics of instruments of the Atmosphere Observing System (AOS) mission. A hold-out validation methodology is used to assess the accuracy of the IWC profiles retrieved from various combinations of observations from the three instruments. Specifically, the IWC and associated observations are randomly divided into two datasets, one for training and the other for evaluation. The training dataset is used to train the retrieval algorithm, while the evaluation dataset is used to assess the retrieval performance. The dataset of IWC profiles is derived from CloudSat reflectivity and CALIOP lidar observations. The retrieval of the ice water content IWC profiles from the computed observations is achieved in two steps. In the first step, a class, out of 18 potential classes characterized by different vertical distribution of IWC, is estimated from the observations. The 18 classes are predetermined based on the k-Means clustering algorithm. In the second step, the IWC profile is estimated using an Ensemble Kalman Smoother (EKS) algorithm that uses the estimated class as a priori information. The results of the study show that the synergy of lidar, radar, and radiometer observations is significant in the retrieval of the IWC profiles. Nevertheless, it should be mentioned that this synergy was found under idealized conditions, and additional work might be required to materialize it in practice. The inclusion of the lidar backscatter observations in the retrieval process has a larger impact on the retrieval performance than the inclusion of the radar observations. As ice clouds have a significant impact on atmospheric radiative processes, this work is relevant to ongoing efforts to reduce uncertainties in climate analyses and projections.

Mircea Grecu↗
DOE OSTI2021

Error-controlled, progressive, and adaptable retrieval of scientific data with multilevel decomposition

Extreme-scale simulations and high-resolution instruments have been generating an increasing amount of data, which poses significant challenges to not only data storage during the run, but also post-processing where data will be repeatedly retrieved and analyzed for a long period of time. The challenges in satisfying a wide range of post-hoc analysis needs while minimizing the I/O overhead caused by inappropriate and/or excessive data retrieval should never be left unmanaged. In this paper, we propose a data refactoring, compressing, and retrieval framework capable of 1) fine-grained data refactoring with regard to precision; 2) incrementally retrieving and recomposing the data in terms of various error bounds; and 3) adaptively retrieving data in multi-precision and multi-resolution with respect to different analysis. With the progressive data re-composition and the adaptable retrieval algorithms, our framework significantly reduces the amount of data retrieved when multiple incremental precision are requested and/or the downstream analysis time when coarse resolution is used. Experiments show that the amount of data retrieved under the same progressively requested error bound using our framework is 64% less than that using state-of-the-art single-error-bounded approaches. Parallel experiments with up to 1, 024 cores and ~ 600 GB data in total show that our approach yields 1.36× and 2.52× performance over existing approaches in writing to and reading from persistent storage systems, respectively.

Liang, Xin↗
NASA NTRS1985

Pattern recognition in the satellite temperature retrieval problem

Pattern recognition procedures have been developed in order to improve the first-guess fields for satellite temperature retrievals. The first procedure is used to select one or more historical radiosonde temperature profiles as analog estimates of ambient thermal structure. The second procedure is used to organize a priori data into shape-coherent pattern libraries using structural information inherent in the data itself. On the basis of independent tests of about 800 temperature retrievals, it was found that: (1) the pattern recognition techniques reduced first-guess profile errors by nearly 50 percent in comparison with traditional partitioning schemes; and (2) with regression and physical-iterative retrieval algorithms, however, the effect of pattern recognition on temperature retrieval error was insignificant. Analysis of individual retrieval errors showed that poor retrievals may outweigh the potential benefits of both pattern recognition techniques.

Thompson, O. E.↗