Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “retrievals”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan↗
DOE OSTI2021

Examination of Humidity and Ice Supersaturation Profiles Over West Antarctica Using Ground-Based G-Band Radiometer Retrievals

Humidity profiles retrieved from a ground-based millimeter-wave radiometer located at McMurdo Station, Antarctica and the West Antarctica Ice Sheet Divide are presented and their suitability to study the humidity of the polar climate is assessed. The dry conditions of the Antarctic winter and spring are ideal for ground-based millimeter-wave measurements and the retrievals appear to realistically reproduce the spatial and temporal variability of humidity at both sites. Furthermore, the radiometer has the ability to capture daily variability of very low humidity (0.5 to 4 g/kg) in the low-to-mid troposphere with an uncertainty of 10-20% during the Antarctic winter, spring, and summer. Despite the coarse vertical resolution (200-600 m in the first 4 km), the retrievals provide additional information with respect to the European Centre for Medium Range Weather Forecasts (ECMWF) profiles used as background information. The radiometer is also able to realistically identify the location and frequency of supersaturated layers with respect to ice in the mid troposphere. The occurrence of supersaturated layers is correlated with the occurrence of ice clouds identified by a cloud mask. Overall, results show that ground-based microwave and millimeter-wave radiometry is a viable complement to satellite observations to provide continuous information on the thermodynamic state of the low-to-mid troposphere at high latitudes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Evaluation of Physical Microphysical Property Retrieval Algorithms During the 2020 IMPACTS Field Campaign

The NASA Investigation of Microphysics and Precipitation for Atlantic Coast Threatening Snowstorms (IMPACTS) field campaign provides high-quality, high-altitude aircraft lidar (532 nm), radar (W-band) and in-cloud microphysical aircraft data taken during wintertime storm events impacting the United States. This study evaluates two mass-dimensional relationships (Brown and Francis (1995, BF95); Heymsfield (2014, H14) and two lidar-radar microphysical retrieval algorithms (Cloudsat and CALIPSO Ice Cloud Property Product (2C-ICE); VarPy (a variational method derived from the satellite lidar-radar data community)) to estimate aircraft-retrieved volume extinction coefficient (σ), ice water content (IWC), and effective radius (r e ) during the 2020 IMPACTS deployment. BF95 and H14 have a close 1:1 correlation (R 2 = 0.98) with in-situ observations of σ. However, only BF95 displays a linear, consistent, and almost temperature-independent low bias for IWC and r e , which likely arises from the environmental conditions used to determine each. Unlike the field-campaign-derived BF95 and H14 relationships, VarPy and 2C-ICE directly ingest the aircraft-based lidar and radar data to simulate σ, IWC, and r e . For all three microphysical parameters, VarPy and 2C-ICE retrieval errors became notably more pronounced around the dendritic growth zone (-15°C to -10°C) and near freezing (≥-5°C), which suggests that both algorithms experience difficulty addressing riming and aggregation processes and with larger particles (dendrites and plates) due in part to their simplified ice particle assumptions. However, the mean-melt diameter ice-particle assumption did yield more accurate IWC estimates, which led to slightly better overall results for VarPy.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Retrieval of Tank Waste from Storage

This book will provide an overview of the key elements in remediating complex waste sites using the Hanford Site as a case study. In this chapter, the existing infrastructure to store and transfer Hanford wastes, a short history of operations in Hanford Tank Farms, the SST retrieval needs and subsequent DST waste handling operations for retrieval, treatment, and closure are discussed. Waste retrieval operational examples are summarized.

Fountain, Matthew S.↗
DOE OSTI2025

Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram

X-ray phase contrast imaging significantly improves the visualization of structures with weak or uniform absorption, broadening its applications across a wide range of scientific disciplines. Propagation-based phase contrast is particularly suitable for time- or dose-critical in vivo/in situ/operando (tomography) experiments because it requires only a single intensity measurement. However, the phase information of the wave field is lost during the measurement and must be recovered. Conventional algebraic and iterative methods often rely on specific approximations or boundary conditions that may not be met by many samples or experimental setups. In addition, they require manual tuning of reconstruction parameters by experts, making them less adaptable for complex or variable conditions. Here we present a self-learning approach for solving the inverse problem of phase retrieval in the near-field regime of Fresnel theory using a single intensity measurement (hologram). A physics-informed generative adversarial network is employed to reconstruct both the phase and absorbance of the unpropagated wave field in the sample plane from a single hologram. Unlike most state-of-the-art deep learning approaches for phase retrieval, our approach does not require paired, unpaired, or simulated training data. This significantly broadens the applicability of our approach, as acquiring or generating suitable training data remains a major challenge due to the wide variability in sample types and experimental configurations. The algorithm demonstrates robust and consistent performance across diverse imaging conditions and sample types, delivering quantitative, high-quality reconstructions for both simulated data and experimental datasets acquired at beamline P05 at PETRA III (DESY, Hamburg), operated by Helmholtz-Zentrum Hereon. Furthermore, it enables the simultaneous retrieval of both phase and absorption information.

36 MATERIALS SCIENCE↗
DOE OSTI2026

The ABCs of phase retrieval: Connecting the acronyms of scanning transmission electron microscopy

High-resolution scanning transmission electron microscopy (S/TEM) is an indispensable tool for characterizing the structure and properties of materials down to the atomic scale. Conventional S/TEM imaging, however, is limited by the phase problem, whereby the phase of the electron exit wave is lost upon detection. Recent advances in diffractive imaging and 4D-STEM have enabled a range of phase-retrieval techniques that computationally reconstruct the missing information encoded in the phase of the transmission function. These approaches offer improved dose efficiency and enhanced sensitivity to weakly scattering signals, extending quantitative imaging to beam-sensitive materials composed of light elements. In this work, we introduce the phase problem in electron microscopy and survey the diverse landscape of phase-retrieval techniques used in the field. Despite their many acronyms and algorithmic variations, these techniques share a common physical and mathematical foundation. We present a unified framework that connects these seemingly distinct methods, from parallax imaging and tilt-corrected bright-field (tcBF-STEM), to aberration-corrected bright-field (acBF-STEM), optimum bright-field (OBF-STEM) and single-sideband (SSB) ptychography, as well as first-moment integrated center of mass techniques (iCOM) and iterative ptychographic algorithms. Based on these insights, we discuss the opportunities and practical limitations of applying these methods across different materials systems, detector designs, and microscope configurations.Graphical abstractRepresentative electron microscopy configurations used for phase retrieval and diffractive imaging in S/TEM: (a) Zernike phase-contrast transmission electron microscopy (TEM), (b) small-convergence-angle four-dimensional scanning transmission electron microscopy (4D-STEM) for nanobeam-based phase reconstruction methods, and (c) large-convergence-angle 4D-STEM for ptychographic and related diffractive imaging techniques reviewed in this work.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to solve these issues by retrieving relevant information from external data sources and augment the training process. These models helps to trace evidence from an externally provided knowledge base allowing the model predictions to be better interpreted and verified. In this work, we critically evaluate these models in their ability to perform in scientific document reasoning tasks. To this end, we tuned multiple such model variants with science-focused instructions and evaluated them on a scientific document reasoning benchmark for the usefulness of the retrieved document passages. Our findings suggest that models justify predictions in science tasks with fabricated evidence and leveraging scientific corpus as pretraining data does not alleviate the risk of evidence fabrication.

• Artificial intelligence (AI) / machine learning ↗
DOE OSTI2020

MWRRETV2 Value-Added Product Report: The Retrieval of Liquid Water Path and Precipitable Water Vapor from Microwave Radiometer – 3-Channel (MWR3C) Data Sets

This report provides a short description of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Microwave Radiometer – 3-Channel (MWR3C) Retrieval (MWRRETV2) Value-Added Product (VAP) algorithm. MWRRETV2 is an updated version of MWRRET, which extends the physical-iterative retrieval of liquid water path (LWP) and precipitable water vapor PWV) to 3-channel microwave radiometers beyond ARM's original standard 2-channel (23-and 31-GHz) systems. The 89-GHz channel in the 3-channel microwave radiometers has approximately three times the sensitivity to liquid water as the 31-GHz channel, thus improving LWP retrieval accuracy when LWP is less than 100 g/m2. We present a general overview of the technique, input parameters, and output products, and describe data quality checks.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Evaluation of Technology for Dry Retrieval of Tank Waste

The Hanford Roadmap report (NNLEMS-2022-00005) identified Dry Retrieval as an opportunity to make a significant impact on accelerating the Department of Energy-Environmental Management tank waste mission. Several commercially available technologies have been identified that hold the potential to enable Single Shell Tank retrieval without large infrastructure investments. The opportunity exists to leverage the technologies of the commercial mining, food, chemical, and pharmaceutical industries with advances in robotics for the tank waste retrieval mission.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

PyDDA: A Pythonic Direct Data Assimilation Framework for Wind Retrievals

This software assimilates data from an arbitrary number of weather radars together with other spatial wind fields (eg numerical weather forecasting model data) in order to retrieve high resolution three dimensional wind fields. PyDDA uses NumPy and SciPy’s optimization techniques combined with the Python Atmospheric Radiation Measurement (ARM) Radar Toolkit (Py-ART) in order to create wind fields using the 3D variational technique (3DVAR). PyDDA is hosted and distributed on GitHub at https://github.com/openradar/PyDDA. PyDDA has the potential to be used by the atmospheric science community to develop high resolution wind retrievals from radar networks. These retrievals can be used for the evaluation of numerical weather forecasting models and plume modelling. This paper shows how wind fields from 2 NEXt generation RADar (NEXRAD) WSR-88D radars and the High Resolution Rapid Refresh can be assimilated together using PyDDA to create a high resolution wind field inside Hurricane Florence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

CACTI CSAPR2 Taranis Retrievals

Taranis is an end-to-end processing chain for radar data written in Python with C extension for computation performance. Features include: masking for quality control, specific differential phase (Kdp), attenuation correction for reflectivity factor (Z) and differential reflectivity (Zdr) in rain, and additional geophysical retrievals. Retrievals are mostly drawn from literature or open-source software when appropriate, and have been tested, tuned, and modified to work with one another cohesively rather than using isolated off-the-shelf algorithms. Incorporated algorithms include hydrometeor (echo) identification, rain water content, raindrop mass-weighted mean diameter (gamma size distribution assumption), and rainfall rate (QPE). Taranis data sets exist for CSAPR2 PPI, HSRHI, and sector RHI scans. Cartesian-gridded data sets were also produced as well as a near-surface rain rate retrieval. More details can be found in the README.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Beyond Contrast Transfer: Spectral SNR as a Finite-Dose Metric for STEM Phase Retrieval

The contrast transfer function (CTF) is widely used to evaluate phase retrieval methods in scanning transmission electron microscopy (STEM), including center-of-mass imaging, parallax imaging, direct ptychography, and iterative ptychography. However, the CTF reflects only the maximum usable signal, neglecting the effects of finite electron fluence and the Poisson-limited nature of detection. As a result, it can significantly overestimate practical performance, especially in low-dose regimes. Here, we employ the spectral signal-to-noise ratio (SSNR), as a finite-dose statistical framework to evaluate the recoverable signal as a function of spatial frequency. Using numerical reconstructions of white-noise objects, we show that center-of-mass, parallax, and direct ptychography exhibit dose-independent SSNRs, with close-form analytic expressions. In contrast, iterative ptychography exhibits a surprising dose dependence: at low fluence, its SSNR converges to that of direct ptychography; at high fluence, it saturates at a value consistent with the maximum detective quantum efficiency predicted by recent quantum Fisher information bounds. The results highlight the limitations of CTF-based evaluation and motivate SSNR as a more accurate, finite-dose metric for assessing STEM phase retrieval methods.

STEM phase retrieval↗
DOE OSTI2025

Direct structural retrieval from gas-phase ultrafast diffraction data using a genetic algorithm

Ultrafast scattering techniques such as ultrafast electron diffraction and ultrafast x-ray diffraction have been utilized to elucidate the structural dynamics, reaction intermediates, and final products in molecular reactions following photoexcitation. The time-dependent structures are typically not directly retrieved from the experimental data, but they rely on comparison with calculations. The genetic algorithm (GA), a global optimization strategy, can be used to retrieve the molecular structures directly from diffraction patterns without any theoretical input. However, the robustness of the GA with respect to real experimental conditions such as a limited momentum transfer range, noise, and artifacts has not been studied in detail. In this work, we characterize the performance of the GA with simulated data that mimic realistic experimental conditions. We have developed and implemented a variant of the GA specific to diffraction measurements which performs better in the presence of imperfect data compared to the standard implementation of the GA. We demonstrate this method with both synthetic data and experimental ultrafast electron diffraction data on the UV-induced photodissociation of trifluoroiodomethane (C⁢F 3⁡ I) molecules.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2026

Adaptively coupled phase retrieval in multi-peak Bragg coherent diffraction imaging

Recent advances in Bragg coherent diffraction imaging (BCDI) experimental techniques permit routine measurement of multiple Bragg peaks from a single crystalline grain. The resulting images contain the full lattice distortion vector field which can be differentiated to provide lattice strain and rotation. With the advent of fourth-generation synchrotron light sources, such multi-peak datasets are produced at high rates, facilitating the need for rapid phase retrieval of the multiple peaks and subsequent image analysis. Here we describe and demonstrate a new implementation of a coupled phase retrieval technique for multi-peak BCDI which simultaneously treats each Bragg peak of the dataset and produces a three-dimensional image of the crystal's morphology and lattice distortion field. In addition, this method uses the redundant information contained in the various Bragg diffraction patterns to detect and suppress spurious signal appearing on the detector in a subset of the measurements. Compared with manual data editing, adaptive coupling produces a more consistent phase profile in reciprocal space and sharper surfaces in direct space, with no significant difference in computational cost. These improvements reduce the need for manual preprocessing and enable robust high-throughput analysis of multi-peak BCDI data, supporting near-real-time strain microscopy at modern synchrotron facilities.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Retrieving images from tarnished daguerreotypes using X-ray fluorescence imaging with an X-ray micro beam with tunable energy

We report recent observations using a synchrotron X-ray micro-beam to retrieve images from tarnished 19th century daguerreotypes. We confirm that high quality image can always be retrieved from tarnished plates using Hg L α XRF as long as the bulk of the image particles and their distribution remains intact. We also report results from using tunable tender X-rays (2 - 7 keV) to conduct imaging in high vacuum at energy above the Ag L-edge and the Hg M-edge, extracting images using Ag L α and Hg M α , respectively among others (e.g., S to track corrosion). Images obtained with the surface sensitive total electron yield (TEY) and the bulk sensitive fluorescence yield (FLY) as well as corresponding micro-XANES are reported. Flux tolerance to high intensity X-beam is also explored. These results and their implications for cultural heritage research are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Climatology of the Vertical Profiles of Polarimetric Radar Variables and Retrieved Microphysical Parameters in Continental/Tropical MCSs and Landfalling Hurricanes

Most existing cloud models tend to overestimate the size of cloud ice particles and underestimate their concentration. This emphasizes the need to provide a reliable observational reference to optimize cloud model performance, particularly in areas of high concentration of ice at high altitudes. The dual-polarization radars give the community a unique opportunity to quantify cloud ice with a good accuracy using polarimetric radar retrievals. Here, in this study, we utilize the network of operational WSR-88D radars to build a climatology of the vertical profiles of radar variables, such as radar reflectivity Z, differential reflectivity Z DR , and specific differential phase K DP as well as the radar-retrieved vertical profiles of ice water content (IWC) above the melting layer and liquid water content below it, mean volume diameter D m , and total number concentration N t of ice and liquid particles. Such climatology was created for continental/marine mesoscale convective systems (MCSs) and tropical cyclones including hurricanes. The dataset includes 13 continental MCSs, 10 marine MCSs, and 11 tropical cyclones. Separate statistics of the “background” vertical profiles and the ones associated with high IWC aloft have been obtained in the course of this study. It is shown that continental MCSs exhibit larger size of ice in lower concentration aloft compared to the marine MCSs and especially tropical cyclones/hurricanes. A combination of high KDP and low Z aloft signifies lower D m , higher N t , and often substantial IWC.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A Robust Estimate of Continental-Scale Terrestrial Carbon Sinks Using GOSAT XCO 2 Retrievals

Satellite XCO 2 retrievals could improve the estimates of surface carbon fluxes, but it remains unknown on what scales these estimates are robust. Here, we use the time-dependent Bayesian synthesis top-down method and prior net ecosystem exchanges (NEEs) from 12 terrestrial biosphere models (TBMs) to infer the monthly carbon fluxes of 51 land regions with constraints by GOSAT XCO 2 retrievals. We find that the uncertainty (standard deviation of 12 TBMs) reduction rates (uncertainty reduction rate (URR)) decrease significantly at decreasing spatial scales. On the continental-scale, the mean URR is about 57%, and the annual and seasonal cycle estimates of NEE are rather robust. The evaluation shows that the posterior CO 2 concentrations are significantly improved at the continental scale. Our study suggests that the GOSAT XCO 2 can only promise a robust continental-scale NEE estimate and improving the XCO 2 accuracy is an effective way to achieve robust estimates on smaller scales under current spatial coverage.

58 GEOSCIENCES↗
DOE OSTI2024

Refining Planetary Boundary Layer Height Retrievals From Micropulse‐Lidar at Multiple ARM Sites Around the World

Abstract Knowledge of the planetary boundary layer height (PBLH) is crucial for various applications in atmospheric and environmental sciences. Lidar measurements are frequently used to monitor the evolution of the PBLH, providing more frequent observations than traditional radiosonde‐based methods. However, lidar‐derived PBLH estimates have substantial uncertainties, contingent upon the retrieval algorithm used. In addressing this, we applied the Different Thermo‐Dynamic Stabilities (DTDS) algorithm to establish a PBLH data set at five separate Department of Energy's Atmospheric Radiation Measurement sites across the globe. Both the PBLH methodology and the products are subject to rigorous assessments in terms of their uncertainties and constraints, juxtaposing them with other products. The DTDS‐derived product consistently aligns with radiosonde PBLH estimates, with correlation coefficients exceeding 0.77 across all sites. This study delves into a detailed examination of the strengths and limitations of PBLH data sets with respect to both radiosonde‐derived and other lidar‐based estimates of the PBLH by exploring their respective errors and uncertainties. It is found that varying techniques and definitions can lead to diverse PBLH retrievals due to the inherent intricacy and variability of the boundary layer. Our DTDS‐derived PBLH data set outperforms existing products derived from ceilometer data, offering a more precise representation of the PBLH. This extensive data set paves the way for advanced studies and an improved understanding of boundary‐layer dynamics, with valuable applications in weather forecasting, climate modeling, and environmental studies.

54 ENVIRONMENTAL SCIENCES↗