Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “retrievals”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Near‐Cloud Aerosol Retrieval Using Machine Learning Techniques, and Implied Direct Radiative Effects

Abstract There is a lack of satellite‐based aerosol retrievals in the vicinity of low‐topped clouds, mainly because reflectance from aerosols is overwhelmed by three‐dimensional cloud radiative effects. To account for cloud radiative effects on reflectance observations, we develop a Convolutional Neural Network and retrieve aerosol optical depth (AOD) with 100–500 m horizontal resolution for all cloud‐free regions regardless of their distances to clouds. The retrieval uncertainty is 0.01 + 5%AOD, and the mean bias is approximately −2%. In an application to satellite observations, aerosol hygroscopic growth due to humidification near clouds enhances AOD by 100% in regions within 1 km of cloud edges. The humidification effect leads to an overall 55% increase in the clear‐sky aerosol direct radiative effect. Although this increase is based on a case study, it highlights the importance of aerosol retrievals in near‐cloud regions, and the need to incorporate the humidification effect in radiative forcing estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Exploring Mission Design for Imaging Spectroscopy Retrievals for Land and Aquatic Ecosystems

The retrieval algorithms used for optical remote sensing satellite data to estimate Earth's geophysical properties have specific requirements for spatial resolution, temporal revisit, spectral range and resolution, and instrument signal-to-noise ratio (SNR) performance to meet biogeoscience objectives. Studies to estimate surface properties from hyperspectral data use a range of algorithms sensitive to various sources of spectroscopic uncertainty, which are in turn influenced by mission architecture choices. Retrieval algorithms vary across scientific fields and may be more or less sensitive to mission architecture choices that affect spectral, spatial, or temporal resolutions and spectrometer SNR. We used representative remote sensing algorithms across terrestrial and aquatic study domains to inform aspects of mission design that are most important for impacting accuracy in each scientific area. We simulated the propagation of uncertainties in the retrieval process including the effects of different instrument configuration choices. We found that retrieval accuracy and information content degrade consistently at >10 nm spectral resolution, >30 m spatial resolution, and >8-day revisit. In these studies, the noise reduction associated with lower spatial resolution improved accuracy vis à vis high spatial resolution measurements. The interplay between spatial resolution, temporal revisit, and SNR can be quantitatively assessed for imaging spectroscopy missions and used to identify key components of algorithm performance and mission observing criteria.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Molecular structure retrieval directly from laboratory-frame photoelectron spectra in laser-induced electron diffraction

Ubiquitous to most molecular scattering methods is the challenge to retrieve bond distance and angle from the scattering signals since this requires convergence of pattern matching algorithms or fitting methods. This problem is typically exacerbated when imaging larger molecules or for dynamic systems with little a priori knowledge. Here, we employ laser-induced electron diffraction (LIED) which is a powerful means to determine the precise atomic configuration of an isolated gas-phase molecule with picometre spatial and attosecond temporal precision. We introduce a simple molecular retrieval method, which is based only on the identification of critical points in the oscillating molecular interference scattering signal that is extracted directly from the laboratory-frame photoelectron spectrum. The method is compared with a Fourier-based retrieval method, and we show that both methods correctly retrieve the asymmetrically stretched and bent field-dressed configuration of the asymmetric top molecule carbonyl sulfide (OCS), which is confirmed by our quantum-classical calculations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Atomic resolution coherent x-ray imaging with physics-based phase retrieval

Coherent x-ray imaging and scattering from accelerator based sources such as synchrotrons continue to impact biology, medicine, technology, and materials science. Many synchrotrons around the world are currently undergoing major upgrades to increase their available coherent x-ray flux by approximately two orders of magnitude. The improvement of synchrotrons may enable imaging of materials in operando at the atomic scale which may revolutionize battery and catalysis technologies. Current algorithms used for phase retrieval in coherent x-ray imaging are based on the projection onto sets method. These traditional iterative phase retrieval methods will become more computationally expensive as they push towards atomic resolution and may struggle to converge. Additionally, these methods do not incorporate physical information that may additionally constrain the solution. In this work, we present an algorithm which incorporates molecular dynamics into Bragg coherent diffraction imaging (BCDI). This algorithm, which we call PRAMMol (Phase Retrieval with Atomic Modeling and Molecular Dynamics) combines statistical techniques with molecular dynamics to solve the phase retrieval problem. We present several examples where our algorithm is applied to simulated coherent diffraction from 3D crystals and show convergence to the correct solution at the atomic scale.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Light storage, retrieval, and controllable interference in an atomic tripod system

Highly efficient quantum memories are essential for advancing quantum information processing technologies, including scalable quantum computing and quantum networks. We experimentally demonstrate a light storage and retrieval protocol in a tripod system using an ensemble of laser-cooled 87 Rb atoms. The tripod system, which consists of three ground states and an excited state, offers rich dynamics: its use to coherently store and retrieve a weak probe pulse in the 87 Rb 𝐹 = 1 ground-state manifold leads to the interference of two spin-wave excitations during storage time that translate to an interference in the peak intensity of the retrieved probe pulse. Our work shows that these interferences, which manifest when varying the pulse sequence or energy level structure, can be controlled experimentally by varying the storage time, optical phase, and magnetic field strength. Theoretical simulations exhibit excellent agreement with the experimental results. In conclusion, this work demonstrates the rich dynamics and versatile capabilities of atomic tripod systems for light storage and retrieval, with key advantages over conventional Λ systems, highlighting the potential of atomic tripod systems for applications in quantum information processing, quantum synchronization, and atomic memory protocols.

Coherent control↗
DOE OSTI2022

Genetic-algorithm retrieval of the molecular alignment distribution with high-order harmonics generated from transiently aligned CO 2 molecules

Using genetic algorithm, we propose a method to retrieve the alignment distribution of transiently aligned CO 2 molecules from the high-order harmonic generation (HHG) spectra. The retrieval method is based on the quantitative rescattering (QRS) model where averaged photorecombination transition dipole can be factored out from the parallel (or perpendicular) harmonic spectra after the propagation of the harmonic fields in the gas medium. We examine how the retrieved alignment distributions are affected by uncertainty in alignment dependent ionization probability and on multiple orbital contribution to the HHG. We further confirm that alignment distribution is more accurately retrieved by using the minima in the HHG spectra driven by a long-wavelength laser. In addition, we show that earlier experimental data on the ratios between the perpendicular and the parallel HHG components of aligned CO 2 molecules are in better agreement with the QRS model if the macroscopic propagation and multiple orbital interference are included in the theoretical calculation.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2022

Retrieval of the molecular orientation distribution from atom-pair angular distributions

Imaging laser-induced rotational dynamics is an important and active field due to its applications in capturing reactions in the molecular frame and in molecular imaging. Experimental measurement of the molecular orientation distribution, as a function of the Euler angles, has only been demonstrated for special cases when the detectable signal is generated along the molecular symmetry axis. Here we developed the general theory that maps the probability density distribution of the molecular orientation to the atom-pair angular distributions for nonlinear molecules. With the theory, the molecular orientation distribution can be retrieved from the measured atom-pair angular distribution, which we demonstrate experimentally using ultrafast electron diffractive imaging of impulsively aligned trifluoro-iodomethane molecules. Here, the retrieved molecular orientation distribution is in good agreement with direct numerical simulations of the time-dependent Schrodinger equation using the experimental conditions. Unlike the existing retrieval methods, the retrieval method does not require solving Schrodinger equation, works for any alignment method, and is in principle applicable to asymmetric top molecules.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

ARCS: Agentic Retrieval-Augmented Code Synthesis with Iterative Refinement

Agentic Retrieval-Augmented Code Synthesis with Iterative RefinementIn supercomputing, efficient and optimized code generation is essential to leverage high-performance systems effectively. We have developed Agentic Retrieval-Augmented Code Synthesis (ARCS), an advanced framework for accurate, robust, and efficient code generation, completion, and translation. ARCS integrates Retrieval-Augmented Generation (RAG) with Chain-of-Thought (CoT) reasoning to systematically break down and iteratively refine complex programming tasks. An agent-based RAG mechanism retrieves relevant code snippets, while real-time execution feedback drives the synthesis of candidate solutions. This process is formalized as a state-action search tree optimization, balancing code correctness with editing efficiency. Evaluations on the Geeks4Geeks and HumanEval benchmarks demonstrate that ARCS significantly outperforms traditional prompting methods in translation and generation quality. By enabling scalable and precise code synthesis, ARCS offers transformative potential for automating and optimizing code development in supercomputing applications, enhancing computational resource utilization

Bhattarai, Manish [Los Alamos National Labs]↗
DOE OSTI2020

Columnar Vertical Profile (CVP) Methodology for Validating Polarimetric Radar Retrievals in Ice Using In Situ Aircraft Measurements

Abstract A novel way to process polarimetric radar data collected via plan position indicator (PPI) scans and display those data in a time–height format is introduced. The columnar vertical profile (CVP) methodology uses radar data collected via multiple elevation scans, limited to data within a set region in range and azimuth relative to the radar, to create vertical profiles of polarimetric radar data representative of that limited region in space. This technique is compared to others existing in the literature, and various applications are discussed. Polarimetric ice microphysical retrievals are performed on CVPs created within the stratiform rain region of two mesoscale convective systems sampled during two field campaigns, where CVPs follow the track of research aircraft. Aircraft in situ data are collocated to microphysical retrieval data, and the accuracy of these retrievals is tested against other retrieval techniques in the literature.

Engineering↗
DOE OSTI2024

Retrieval Augmented Generation for Robust Cyber Defense

In cybersecurity, the ability to efficiently analyze and respond to vulnerabilities, weaknesses, attack patterns, and threat tactics is critical for effective defense strategies. With the increasing complexity and volume of cybersecurity data, traditional methods of querying and retrieving information are often inadequate. To address this challenge, we implemented Retrieval-Augmented Generation (RAG) systems—CyRAG and GraphCyRAG—that integrate large language models (LLMs) with both structured data from relational databases and knowledge graphs such as Neo4j. CyRAG is designed to handle structured data, focusing on CVE (Common Vulnerabilities and Exposures) and CWE (Common Weakness Enumeration) entities to generate accurate and context-rich responses. In contrast, GraphCyRAG leverages Neo4j knowledge graphs to retrieve interconnected information from CVE, CWE, CAPEC (Common Attack Pattern Enumeration and Classification), and ATT&CK (Adversarial Tactics, Techniques, and Common Knowledge) datasets. By utilizing Neo4j’s graph-based framework, GraphCyRAG enables deeper traversal of relationships between vulnerabilities and attack patterns, providing cybersecurity analysts with more comprehensive insights into potential attack vectors and mitigation strategies. Our preliminary results demonstrate that integrating knowledge graphs with RAG significantly enhances both the accuracy and depth of threat analysis, allowing for the retrieval of dynamic, real-time data and the generation of contextually aware responses. This approach helps analysts uncover hidden relationships between cyber entities, predict exploit paths, and prioritize mitigation efforts effectively. The integration of RAG with cybersecurity knowledge graphs represents a significant advancement in cybersecurity threat intelligence, enabling more informed decision-making and stronger defense strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Evaluation of the Self Retrieval Augmented Generation Technique on Common Security Advisory Framework Data

This small experimental report evaluates a variation of Retrieval Augmented Generation (RAG), called Self-RAG. This method uses a generative language model that incorporates retrieved facts into its generation and is explicitly trained to be able to determine whether retrieved information is enough to answer the input query, with a user-defined threshold for confidence. We performed an experiment using data from the publicly available CISA Common Security Advisory Framework (CSAF) repository (https://github.com/cisagov/CSAF) as the database of facts to be used in retrieval. Qualitative results from the experiment demonstrate that the Self-RAG method has some ability to provide reasonable answers to queries that are in the dataset and will often ignore irrelevant information when asked outside of domain questions (e.g., general facts). In settings with deliberately confusing questions (the question is within domain, but asks about a fabricated advisory), it was able to refuse 40% of the time without further adjustments to the original framework. While this performance is not sufficient for current practical use, further improvements to data formatting, disambiguating results, and leveraging threshold values could improve performance significantly. However, evaluating this will require more extensive evaluations on larger datasets and potentially better models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

NANT Site - Microwave Radiometer Thermodynamic Retrievals TROPoe / Derived Data

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous brightness temperature measurements at 35 channels observed with a microwave radiometer MP3000A operated by NOAA Physical Sciences Laboratory on Nantucket Island for WFIP3. Additional input data in TROPoe are cloud base height from a collocated ceilometer operated by NOAA GML and temperature, water vapor mixing ratio, and pressure from a sensor attached to the MWR housing. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) that provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see, e.g., Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at Upton, NY.

17 WIND ENERGY↗
DOE OSTI2025

NOAA PSL Microwave Radiometer Block Island / Thermodynamic retrievals TROPoe

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous brightness temperature measurements at 35 channels observed with a microwave radiometer MP3000A operated by NOAA Physical Sciences Laboratory on the Block Island for WFIP3. Additional input data in TROPoe are cloud base height from a collocated ceilometer operated by NOAA GML and temperature, water vapor mixing ratio, and pressure from a sensor attached to the MWR housing. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) that provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see, e.g., Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at Upton, NY.

17 WIND ENERGY↗
DOE OSTI2020

H- and Dissociation in Ultra-hot Jupiters: A Retrieval Case Study of WASP-18b

Atmospheres of a number of ultra-hot Jupiters (UHJs) with temperatures ≳2000 K have been observed recently. Many of these planets show largely featureless thermal spectra in the near-infrared observed with the HST WFC3 spectrograph (1.1–1.7 μm) even though this spectral range contains strong H{sub 2}O opacity. Recent works have proposed the possibility of H- opacity masking the H{sub 2}O feature and/or thermal dissociation of H{sub 2}O causing its apparent depletion at the high temperatures of UHJs. In this work, we test these hypotheses using observations of the exoplanet WASP-18b as a case study. We report detailed atmospheric retrievals of the planet using the HyDRA retrieval code, extended to include the effects of H- opacity and thermal dissociation. We report constraints on the H{sub 2}O, CO, and H- abundances as well as the pressure–temperature profile of the dayside atmosphere for retrievals with and without H-/dissociation for each data set. We find that the H{sub 2}O and H- abundances are relatively unconstrained given the featureless WFC3 spectra. We do not conclusively detect H- in the planet, contrary to previous studies that used equilibrium models to infer its presence. The constraint on the CO abundance depends on the combination of WFC3 and Spitzer data, ranging from solar to super-solar CO values. We additionally see signs of a thermal inversion from two of the data sets. Our study demonstrates the potential of atmospheric retrievals of UHJs, including the effects of H- and thermal dissociation of molecules.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Triple-frequency radar retrieval of microphysical properties of snow

Abstract. An algorithm based on triple-frequency (X, Ka, W) radar measurements that retrieves the size, water content and degree of riming of ice clouds is presented. This study exploits the potential of multi-frequency radar measurements to provide information on bulk snow density that should underpin better estimates of the snow characteristic size and content within the radar volume. The algorithm is based on Bayes' rule with riming parameterised by the “fill-in” model. The radar reflectivities are simulated with a range of scattering models corresponding to realistic snowflake shapes. The algorithm is tested on multi-frequency radar data collected during the ESA-funded Radar Snow Experiment For Future Precipitation Mission. During this campaign, in situ microphysical probes were mounted on the same aeroplane as the radars. This nearly perfectly co-located dataset of the remote and in situ measurements gives an opportunity to derive a combined multi-instrument estimate of snow microphysical properties that is used for a rigorous validation of the radar retrieval. Results suggest that the triple-frequency retrieval performs well in estimating ice water content (IWC) and mean mass-weighted diameters obtaining root-mean-square errors of 0.13 and 0.15, respectively, for log 10IWC and log 10Dm. The retrieval of the degree of riming is more challenging, and only the algorithm that uses Doppler information obtains results that are highly correlated with the in situ data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

High-fidelity retrieval from instantaneous line-of-sight returns of nacelle-mounted lidar including supervised machine learning

Abstract. Wind turbine applications that leverage nacelle-mounted Doppler lidar are hampered by several sources of uncertainty in the lidar measurement, affecting both bias and random errors. Two problems encountered especially for nacelle-mounted lidar are solid interference due to intersection of the line of sight with solid objects behind, within, or in front of the measurement volume and spectral noise due primarily to limited photon capture. These two uncertainties, especially that due to solid interference, can be reduced with high-fidelity retrieval techniques (i.e., including both quality assurance/quality control and subsequent parameter estimation). Our work compares three such techniques, including conventional thresholding, advanced filtering, and a novel application of supervised machine learning with ensemble neural networks, based on their ability to reduce uncertainty introduced by the two observed nonideal spectral features while keeping data availability high. The approach leverages data from a field experiment involving a continuous-wave (CW) SpinnerLidar from the Technical University of Denmark (DTU) that provided scans of a wide range of flows both unwaked and waked by a field turbine. Independent measurements from an adjacent meteorological tower within the sampling volume permit experimental validation of the instantaneous velocity uncertainty remaining after retrieval that stems from solid interference and strong spectral noise, which is a validation that has not been performed previously. All three methods perform similarly for non-interfered returns, but the advanced filtering and machine learning techniques perform better when solid interference is present, which allows them to produce overall standard deviations of error between 0.2 and 0.3 m s−1, or a 1 %–22 % improvement versus the conventional thresholding technique, over the rotor height for the unwaked cases. Between the two improved techniques, the advanced filtering produces 3.5 % higher overall data availability, while the machine learning offers a faster runtime (i.e., ∼ 1 s to evaluate) that is therefore more commensurate with the requirements of real-time turbine control. The retrieval techniques are described in terms of application to CW lidar, though they are also relevant to pulsed lidar. Previous work by the authors (Brown and Herges, 2020) explored a novel attempt to quantify uncertainty in the output of a high-fidelity lidar retrieval technique using simulated lidar returns; this article provides true uncertainty quantification versus independent measurement and does so for three techniques rather than one.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Evaluation of cloud height, optical thickness, and phase retrievals from the CHROMA algorithm applied to Sentinel-3 OLCI data

We previously developed the Cloud Height Retrieval from O 2 Molecular Absorption (CHROMA) algorithm for the Ocean Color Instrument (OCI) on the new NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission. Here, we apply CHROMA to observations from the Ocean Land Colour Instrument (OLCI) to guide expectations for PACE, as it will take some time to obtain large-scale validation data for OCI. We use cloud top height (CTH), phase, and (for liquid clouds) cloud optical thickness (COT) data from the ground-based Atmospheric Radiation Measurement (ARM) network to evaluate the OLCI retrievals. We found that OLCI and Moderate Resolution Imaging Spectroradiometer (MODIS) CTH compare similarly well to the ARM reference. OLCI has a tendency to underestimate CTH as CTH increases, and algorithm assumptions about cloud geometric thickness may contribute to this. ARM COT from multifilter shadowband radiometers (MFRSR) and Sun photometers are well-correlated with one another, albeit with a roughly 30 % offset on average; OLCI and MODIS COT agree more closely with the MFRSR data. OLCI retrieval uncertainty estimates show skill at telling low-uncertainty cases from high-uncertainty ones, although CTH uncertainties are underestimated. Additionally, we compare the OLCI data to satellite retrievals based on thermal infrared measurements from MODIS and Sea and Land Surface Temperature Radiometer (SLSTR) data. Differences are broadly consistent with physical expectations based on the A-band vs. thermal techniques, although one key challenge in such aggregated comparisons is different cloud masking sensitivities and algorithm failure rates meaning additional sampling differences are introduced. We conclude by discussing the transition to and possible enhancements for PACE OCI.

Sayer, Andrew M. [Univ. of Maryland Baltimore Coun↗
DOE OSTI2026

Improving the Confidence in Retrievals of Vertical Distributions of Cloud Condensation Nuclei Number Concentration from ARM Supported by Aircraft In Situ Observations

Accurate quantification of the vertical distribution of cloud condensation nuclei (CCN) number concentrations is critical for improving our understanding of aerosol–cloud interactions. Ground-based Raman lidars operated by the Atmospheric Radiation Measurement (ARM) program, together with surface CCN measurements, are used to retrieve vertically resolved CCN number concentrations (Retrieved Number concentration of CCN, RNCCN). These retrievals rely on several assumptions, including that aerosol composition is vertically homogeneous. To assess this assumption, we developed and tested a framework to infer the dominant aerosol classes/types at different altitudes. This was done by applying a k-Nearest-Neighbors (kNN) algorithm to lidar ratio and linear depolarization ratio measurements from Raman lidar. We evaluated the framework using aircraft aerosol and CCN measurements from the ARM Holistic Interactions of Shallow Clouds, Aerosols, and Land Ecosystems (HI-SCALE) field campaign. The results show that RNCCN performance degrades as vertical aerosol complexity increases, i.e., RNCCN agrees with the aircraft CCN in vertically homogeneous conditions, but closure decreases in layered aerosol structures. To generalize beyond individual examples, we introduce a metric (heterogeneity index) that quantifies the vertical complexity by assessing the variation of inferred aerosol classes/types. Case-level statistics show a tendency for RNCCN and aircraft differences to increase with this metric. By detecting retrievals that are likely compromised by aerosol vertical heterogeneity, the proposed framework improves the interpretability and effective use of RNCCN used for long-term evaluation of models and aerosol–cloud interactions.

Tian, Jingjing↗