Results for “retrievals” — Page 63

NASA NTRSDate not supplied

A Machine Learning Approach for the Remote Sensing Retrieval of Oil Spills from Polarimetric Measurements

The Fresnel laws of specular reflection directly connect remote sensing observations of light polarization within the sunglint region to the ocean surface refractive index. This parameter is instrumental to identify areas affected by oil, or any other floating substance capable of modifying the refractive index of pure seawater. In preparation for the NASA Plankton, Aerosol, ocean Ecosystem (PACE) mission, we are developing an advanced retrieval scheme that exploits such measurements to deliver the refractive index as an operational product. The original method was developed based on observations of the airborne Research Scanning Polarimeter. Here we present several aspects related to the extension of this technique to the PACE HARP-2 sensor (especially regarding the projected accuracy), and discuss preliminary results obtained by applying neural-network trainings to look-up tables produced with the forward radiative transfer code, with the goal of improving the computational performance. Success in the final implementation will guarantee a version of the retrieval algorithm suitable to fast-response needs and disaster management.

machine learning↗

NASA NTRSDate not supplied

BERT-based Topic Modeling and Information Retrieval to Support Fishbone Diagramming for Safe Integration of Unmanned Aircraft Systems in Wildfire Response

Recent concepts for emerging wildfire response operations have included unmanned aircraft systems (UAS) due to their increasing accessibility and capabilities. To integrate UAS into wildfire response safely, researchers have studied the use of large repositories of historic incident reports to improve the scope of root cause analysis. Recent work has emphasized applying state-of-the-art natural language processing techniques to extract useful information from these repositories. However, it has not yet been studied how these results can be interpreted and integrated into the systems engineering process. In this work, we propose a process in which Bidirectional Encoder Representations from Transformers (BERT)-based topic modeling and information retrieval are applied to a relevant set of documents in order to support the development of a fishbone diagram in a semiautomated process. High-level themes in the document set are identified using topic modeling, which are then refined and interpreted by a human analyst. Then, the themes are used to guide a finer search using information retrieval, which returns specific incident reports of relevance. This provides traceability to specific incidents as well as broader categorizations that comprise the fishbone branches. We apply the proposed process to relevant documents from NASA’s Aviation Safety Reporting System (ASRS). The proposed process is widely applicable when relevant documents are available, and the results from this study will be useful to identifying potential causes of wildfire response UAS incidents.

hazard analysis↗

NASA NTRSDate not supplied

BERT-based Topic Modeling and Information Retrieval to Support Fishbone Diagramming for Safe Integration of Unmanned Aircraft Systems in Wildfire Response

Recent concepts for emerging wildfire response operations have included unmanned aircraft systems (UAS) due to their increasing accessibility and capabilities. To integrate UAS into wildfire response safely, researchers have studied the use of large repositories of historic incident reports to improve the scope of root cause analysis. Recent work has emphasized applying state-of-the-art natural language processing techniques to extract useful information from these repositories. However, it has not yet been studied how these results can be interpreted and integrated into the systems engineering process. In this work, we propose a process in which Bidirectional Encoder Representations from Transformers (BERT)-based topic modeling and information retrieval are applied to a relevant set of documents in order to support the development of a fishbone diagram in a semiautomated process. High-level themes in the document set are identified using topic modeling, which are then refined and interpreted by a human analyst. Then, the themes are used to guide a finer search using information retrieval, which returns specific incident reports of relevance. This provides traceability to specific incidents as well as broader categorizations that comprise the fishbone branches. We apply the proposed process to relevant documents from NASA’s Aviation Safety Reporting System (ASRS). The proposed process is widely applicable when relevant documents are available, and the results from this study will be useful to identifying potential causes of wildfire response UAS incidents.

hazard analysis↗

NASA NTRSDate not supplied

Fast Radiative Transfer Model and Retrieval Algorithm Development for Satellite Remote Sensing Applications

The radiative transfer model (RTM) has a wide range of applications in satellite remote sensing and atmospheric radiation studies. For example, it can be used as a forward model for an inversion algorithm and a satellite data assimilation system, or as a L1 data simulator for pre-launch end-to-end satellite sensor performance studies. However, millions of line-by-line (LBL) radiative transfer calculations at fine monochromatic frequencies are needed in order to properly calculate spectral contributions of water vapor and trace gases in the atmosphere in infrared and solar spectral regions. Therefore, fast, and accurate radiative transfer models are needed. A Principal Component-based radiative transfer model (PCRTM) was developed at NASA Langley to fulfil this need. The PCRTM can simulate the top-of-atmosphere (TOA) radiance or reflectance spectra from 250 nm to 2000 micrometers with several orders of magnitude faster speed as compared to a LBL RTM. It is also extremely accurate compared to LBL RTM benchmarks. The PCRTM model has been developed for hyperspectral sensors such as AIRS, CrIS, IASI, NAST-I, SHIS, CPF, TEMPO, EMIT, OMI, and SCIAMACHY. By using the PCRTM as forward model for an inversion algorithm, one can reduce the data dimension significantly while maintaining original information content by compressing the TOA radiance spectrum into PC-scores. The PCRTM can directly compute the PC-scores and their derivatives with respect to retrieved parameters. Examples of using various PCRTM inversion algorithms to retrieve atmospheric temperature, water vapor, and trace gas profiles, as well as cloud and surface properties from satellite hyperspectral remote sensors will be given. Some of the algorithms have been transitioned to NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) for public access of high-quality L2 and L3 data.

Xu Liu↗

NASA NTRSDate not supplied

Retrieval-Augmented Generation and LLM Agents for Biomimicry Design Solutions

We present BIDARA, a Bio-Inspired Design And Research Assistant, to address the complexity of biomimicry – the practice of designing modern-day engineering solutions inspired by biological phenomena. Large Language Models (LLMs) have been shown to act as sufficient general purpose task solvers, but they often hallucinate and fail in regimes that require domain-specific and up-to-date knowledge. We integrate Retrieval-Augmented Generation (RAG) and Reasoning-and-Action agents to aid LLMs in avoiding hallucination and utilizing updated knowledge during generation of biomimetic design solutions. We find that incorporating RAG increases the feasibility of the design solutions in both prompting and agent settings, and we use these findings to guide our ongoing work. To the extent of our knowledge, this is the first work that integrates and evaluates Retrieval-Augmented Generation within LLM-generated biomimetic design solutions.

biomimicry↗

NASA NTRS2023

Evaluation of Snowfall Retrieval Performance of Gpm Constellation Radiometers Relative to Spaceborne Radars

This study assesses the level-2 snowfall retrieval results from 11 passive microwave radiometers generated by the version 5 Goddard profiling algorithm (GPROF) relative to two spaceborne radars: CloudSat Cloud Profiling Radar (CPR) and Global Precipitation Measurement (GPM) Ku-band Precipitation Radar (KuPR). These 11 radiometers include six conical scanning radiometers [Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E), its successor sensor AMSR2, GPM Microwave Imager (GMI), and three Special Sensor Microwave Imager/Sounders (SSMIS)] and five cross-track scanning radiometers [Advanced Technology Microwave Sounder (ATMS) and four Microwave Humidity Sounders (MHS)]. Results show that over ocean conical scanning radiometers have better detection and intensity estimation skills than cross-track sensors, likely due to the availability and usage of the low-frequency channels (e.g., 19 and 37 GHz). Over land, AMSR-E and AMSR2 have noticeably worse performance than other sensors, primarily due to the lack of higher than 89-GHz channels (e.g., 150, 166, and 183 GHz). Over both land and ocean, all 11 sensors severely underestimate the snowfall intensity, which propagates to the widely used level 3 precipitation product [i.e., Integrated Multi-satelliteE Retrievals for GPM (IMERG)]. These conclusions hold regardless of using either KuPR or CPR as the reference, though the statistical metrics vary quantitatively. The conclusions drawn from these comparisons apply solely to the GPROF version 5 algorithm.

Yalei You↗

NASA NTRSDate not supplied

Creating Regional and Seasonal Climatologies of Marine and Dusty Marine Aerosol Lidar Ratios using MODIS AOD Constrained Retrievals and GOCART Model Simulations

The CALIPSO aerosol algorithms currently assign one lidar ratio (LR) value globally for each of the seven tropospheric aerosol types. In this study, MODIS total column aerosol optical depths (AODs) are used to constrain collocated CALIOP backscatter profiles in a Fernald inversion that infers aerosol LRs for CALIOP-classified marine and dusty marine aerosols. The GOCART aerosol model is leveraged to estimate the sea salt volume fractions (SSVFs) that are collocated with the CALIOP+MODIS LR retrievals. An inverse empirical relationship is found between the SSVFs and LRs (i.e., smaller SSVFs and larger LRs near coastlines, but the opposite in the remote oceans). This SSVF/LR relationship is applied to create regional and seasonal hybrid (i.e., retrieval & model-assisted) climatological LR maps so as to develop more robust LR selections for marine and dusty marine aerosols in the CALIPSO algorithms. These analyses also provide critical LR information for the next generation of spaceborne elastic backscatter lidars.

Travis D. Toth↗

NASA NTRSDate not supplied

Retrieval-Augmented Generation and LLM Agents for Biomimicry Design Solutions

We present BIDARA, a Bio-Inspired Design And Research Assistant, to address the complexity of biomimicry – the practice of designing modern-day engineering solutions inspired by biological phenomena. Large Language Models (LLMs) have been shown to act as sufficient general purpose task solvers, but they often hallucinate and fail in regimes that require domain-specific and up-to-date knowledge. We integrate Retrieval-Augmented Generation (RAG) and Reasoning-and-Action agents to aid LLMs in avoiding hallucination and utilizing updated knowledge during generation of biomimetic design solutions. We find that incorporating RAG increases the feasibility of the design solutions in both prompting and agent settings, and we use these findings to guide our ongoing work. To the extent of our knowledge, this is the first work that integrates and evaluates Retrieval-Augmented Generation within LLM-generated biomimetic design solutions.

biomimicry↗

NASA NTRS2023

Decoupling in the Vertical Shape of HCHO During a Sea Breeze Event: the Effect on Trace Gas Satellite Retrievals and Column-to-Surface Translation

The effect of sea breeze circulation on stratification of the vertical formaldehyde (HCHO) concentration vertical profiles is explored using a regional atmospheric chemical transport model (CTM) for three synoptically stagnant days focused on the east coast of the U.S in June 2018. During this event, a significant thermal contrast between the Atlantic Ocean and the terrestrial regions (12–17 °C), observed by moderate resolution imaging spectroradiometer (MODIS) and well-captured by the WRF-CMAQ model (15–18 °C), is conducive to monsoon-like flow, perpendicular to the shorelines, carrying clean marine air masses over the land within a few hundreds of meters above the surface. In contrast, the westerly continental polluted air masses prevail in higher altitudes. These two conflicting flows result in atypical vertical shapes of HCHO concentrations increasing with altitude. This decoupling pattern is so pronounced that we observe total column HCHO negatively correlate with surface concentrations. Comparisons of an accredited global model, GEOS-CF, to surface wind measurements and MODIS skin temperature indicate its poor representation of the sea breeze timing and strength, resulting in GEOS-CF HCHO vertical shapes being drastically different from the WRF-CMAQ. Based on radiative transfer calculations, the differences in the vertical distribution of HCHO between the WRF-CMAQ and that of GEOS-CF in the first 3 km are sufficient to induce a 20–30% error in air mass factors (thus total vertical HCHO column abundances). Through an experiment involving converting HCHO total columns to surface mixing ratios, we demonstrate that GEOS-CF allocates noticeably more HCHO molecules (40–150%) to the surface layer due to the misrepresentation of the vertical shape of HCHO during the sea breeze event. It is known that a significant fraction of the human population lives in coastal areas prone to detrimental effects caused by air pollution, and elevated pollutant concentrations usually occur in synoptically stagnant atmospheric conditions when local circulation patterns come into play; accordingly, our experiments emphasize the importance of the effect a priori profiles can have on satellite-derived applications under such conditions. To ensure that the quantitative representation of satellite-based trace gas retrievals on a daily basis is trustworthy and useable for air quality applications, atmospheric models providing a priori profiles for satellite retrievals should be well-tuned to reproduce complex local circulation such as sea-land breezes.

sea breeze↗

NASA NTRSDate not supplied

Development of Radiative Transfer Models and Retrieval Algorithms for Satellite Remote Sensors

Hyperspectral IR sounders such as AIRS on Aqua, CrIS on S-NPP, NOAA20 and JPSS-2, IASI on Metop A, B, and C provide high-quality atmospheric temperature, water, vapor, and greenhouse gas vertical profiles. Additionally, they provide atmospheric cloud properties, surface emissivity, and surface skin temperatures. We have developed two algorithms which can consistently derive these products from multiple IR sounders. The first one is a Single Field-of-view Sounder Atmospheric Product (SIFSAP) algorithm and the second one is a Climate Fingerprinting Sounder Product (ClimFiSP) algorithm. The SiFSAP algorithm performs one retrieval for each FOV using an all-sky optimal estimation approach. The core of the SiFSAP algorithm is an accurate and fast Principal Component-based Radiative Transfer Model (PCRTM), which can calculate hyperspectral radiance spectra under both clear and cloudy conditions. The PCRTM was developed in the past decade using consistent reference line-by-line radiative transfer model and spectroscopy for hyperspectral sounders such as AIRS, CrIS, IASI, NAST-I, and S-HIS. The ClimFiSP algorithm, which performs retrievals from spatiotemporally averaged L1 hyperspectral radiances directly, will be orders of magnitude faster than traditional method. he ClimFiSP algorithm uses consistent radiative kernels and a robust spectral fingerprinting method. It provides accurate data climate data fusion products from multiple satellite sensors. Both SiFSAP and ClimFiSP will be available at NASA GES DISC data center for public access.

Xu Liu↗

NASA NTRSDate not supplied

Creating Regional and Seasonal Climatologies of Marine and Dusty Marine Aerosol Lidar Ratios using MODIS AOD Constrained Retrievals and GOCART Model Simulations

The CALIPSO aerosol algorithms currently assign one lidar ratio (LR) value globally for each of the seven tropospheric aerosol types. In this study, MODIS total column aerosol optical depths (AODs) are used to constrain collocated CALIOP backscatter profiles in a Fernald inversion that infers aerosol LRs for CALIOP-classified marine and dusty marine aerosols. The GOCART aerosol model is leveraged to estimate the sea salt volume fractions (SSVFs) that are collocated with the CALIOP+MODIS LR retrievals. An inverse empirical relationship is found between the SSVFs and LRs (i.e., smaller SSVFs and larger LRs near coastlines, but the opposite in the remote oceans). This SSVF/LR relationship is applied to create regional and seasonal hybrid (i.e., retrieval & model-assisted) climatological LR maps so as to develop more robust LR selections for marine and dusty marine aerosols in the CALIPSO algorithms. These analyses also provide critical LR information for the next generation of spaceborne elastic backscatter lidars.

Travis D. Toth↗

NASA NTRSDate not supplied

Integrated Multi-Satellite Retrievals for GPM (IMERG)

The Integrated Multi-satellitE Retrievals for GPM (IMERG) product from the U.S. Science Team of the NASA-JAXA Global Precipitation Measurement (GPM) mission provides global satellite precipitation estimates for a wide range of scientific research and societal applications. By adopting a constellation approach using low-Earth orbit passive microwave and geosynchronous-orbit infrared observations from domestic and international partners, IMERG is able to achieve a high resolution of 0.1° every half-hour globally, with three Runs to cater to applications with different latency requirements. With the completion of the reprocessing of the latest version, IMERG V07 now provides improved global satellite precipitation estimates for a period of more than 20 years. This presentation summarizes background on retrievals, the IMERG algorithm, and access to the data. As well, it showcases select results from the data, which might give participants ideas about how they can analyze the data themselves. The presentation ends with a prospectus for the timeline for the upcoming Version 08 and provides a list of references.

IMERG↗

NASA NTRSDate not supplied

Spaceborne Lidar Retrievals of PM2.5 for Air Quality Studies and Applications

Fine particulate matter (PM2.5) substantially contributes to air pollution and negatively affects human health. While many studies have investigated the use of passive column-integrated aerosol optical depth to infer surface PM2.5, the use of lidar observations for air quality characterization is not nearly as extensive. Lidar measurements are critical, however, due to the vertical aerosol information they provide, including near the surface. In this presentation, we first provide an overview of various lidar-based approaches for estimating PM2.5 concentrations and then discuss how lidar measurements can assist other air quality applications. For example, estimates of PM2.5 have been obtained in a physics-based approach through CALIOP near-surface aerosol extinction retrievals, assumptions on the mass extinction efficiency, and incorporating other parameters (an aerosol hygroscopic growth factor and PM2.5/PM10 ratio). Application of this algorithm over the contiguous United States (CONUS) from 2006 to 2018 yielded larger PM2.5 values over the eastern and western CONUS (~10-15 μg/m³) and lower PM2.5 levels in the central CONUS (~5 μg/m³). These spatial patterns were similar to those from gridded PM2.5 concentrations obtained through in situ measurements at ground stations operated by the US Environmental Protection Agency. In another approach, the Cloud Aerosol Transport System (CATS) lidar was used with the Goddard Earth Observing System (GEOS) model in a 1D ensemble-based variational technique to obtain PM2.5 over the US and Europe, and the spatial patterns of the CATS/GEOS based PM2.5 concentrations generally captured those from surface stations (with corresponding hourly EPA PM2.5 vs CATS PM2.5 statistics of R=0.4 and bias=1.5 μg/m³). In our recent work, as part of the Models, In situ, and Remote sensing of Aerosols (MIRA) Working Group, we have applied both the CALIOP and CATS/GEOS based approaches over the highly polluted country of India during the post-monsoon season (September-October 2016). We derived elevated levels of two-month mean PM2.5 (~100 μg/m³) in northern India, especially near New Delhi. These high PM2.5 concentrations in the Indo-Gangetic plain are driven in large part from the seasonal burning of crop residue and meteorological conditions typical at this time of the year, such as low wind speeds and a shallow boundary layer. While the satellite-derived PM2.5 moderately replicates (R = ~0.7-0.9) the spatial variability in the two-month mean of surface in situ PM2.5 from monitoring sites operated by the Central and State Pollution Control Boards, we show results from specific scenes for which there are large deviations between the satellite-derived PM2.5 and in situ measurements. Other current work on this topic focuses on developing PM2.5 estimates using airborne high spectral resolution lidar measurements through machine learning regression algorithms and involves several parameters (e.g., aerosol extinction, color ratio, lidar ratio). Application of this method over major metropolitan areas in the US and Asia have resulted in high correlations (R = 0.93) with surface measurements. This airborne lidar approach can be adapted to spaceborne lidar measurements, and all three of these approaches can be applied to ESA’s EarthCARE Atmospheric Lidar instrument, setting the stage for the future Cloud Aerosol Lidar for Global Scale Observations of the Ocean-Land Atmosphere System (CALIGOLA) mission. Ultimately, beyond estimates of PM2.5, the aerosol vertical distribution from lidars can benefit studies involving passive sensor approaches for PM2.5 proxies (including from geostationary satellites), wildfire smoke plume injection heights, volcanic emissions (e.g., ash height retrievals), and aerosol/air quality model assimilation, evaluation, and forecasts.

Travis D Toth↗

DOE OSTI2020

Study of Waste Generated by Retrieval of Fuel Debris at Fukushima Daiichi Nuclear Power Station - 20178

As a member of International Research Institute for Nuclear Decommissioning (IRID), we organized information on waste generated from the fuel debris retrieval, and considered containment, transport and storage processes. An important safety function to consider for these wastes is not only the handling of ordinary high-dose waste, but also the prevention of diffusion of fuel component contamination and the countermeasures against hydrogen gas generation. In order to satisfy these safety functions, we considered guideline for waste generated from the fuel debris retrieval, and proposed an example of handling process that includes generation of waste, container storage, on-site transfer and storage in a storage building. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2025

Large Language Model Integration for Knowledge Retrieval and Interaction for the DUNE Experiment

The Deep Underground Neutrino Experiment (DUNE) is a next-generation neutrino experiment that will generate an unprecedented volume of heterogeneous information-from documentation and technical notes to experimental data and reconstruction pipelines. Efficient knowledge retrieval and contextual understanding are increasingly critical for collaboration-wide productivity and onboarding. In this work, we present DUNE-GPT, a prototype framework that leverages large language models (LLMs) and retrieval-augmented generation (RAG) to enable natural-language querying of DUNE's internal documentation and technical resources. The system provides an intelligent interface for DUNE collaborators to interact with experiment-specific knowledge while maintaining data privacy and infrastructure compliance within Fermilab computing resources.

Rafique, A. [Argonne (main)]↗

DOE OSTI2026

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗

DOE OSTI2020

Ptychographic phase retrieval by proximal algorithms

We derive a set of ptychography phase-retrieval iterative engines based on proximal algorithms originally developed in convex optimization theory, and discuss their connections with existing ones. The use of proximal operator creates a simple frame work that allows us to incorporate the effect of noise from a maximum-likelihood (ML) principle. We focus on three particular algorithms, namely proximal minimization, alternating direction method of multiplier and accelerated proximal gradient (APG). We benchmark their performance with numerical simulations, and discuss their optimal conditions for convergence and accuracy. An experimental dataset is used to demonstrate their effectiveness as well, in which case an array of cubic Au nanoparticles with a size of 50 nm is imaged. We show that with the presence of Poisson noise, a dataset with photon counts up to 10 4 at one detector pixel already requires ML-based methods to achieve a stable convergence. Among the three algorithms derived in this work, APG method is reported first time for its application in ptychographic reconstruction and shows superior performance in terms of both accuracy and convergence rate with a noisy dataset.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Multigrid Optimization for Large-Scale Ptychographic Phase Retrieval

Ptychography is a popular imaging technique that combines diffractive imaging with scanning microscopy. The technique consists of a coherent beam that is scanned across an object in a series of overlapping positions, leading to reliable and improved reconstructions. Ptychographic microscopes allow for large fields to be imaged at high resolution at the cost of additional computational expense. Herein, we propose a multigrid-based optimization framework to reduce the computational burdens of large-scale ptychographic phase retrieval. Our proposed method exploits the inherent hierarchical structures in ptychography through tailored restriction and prolongation operators for the object and data domains. Our numerical results show that our proposed scheme accelerates the convergence of its underlying solver and outperforms the ptychographical iterative engine, a workhorse in the optics community.

97 MATHEMATICS AND COMPUTING↗