Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Retrieval Algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Tansey_MICRE_D98_microphysics_V5

This data file contains retrievals of cloud-effective radius and cloud-droplet-number concentration for low clouds based on the Dong et al. 1998 retrieval technique for the MICRE campaign. The retrieval is based on observed downwelling broadband shortwave (SW) fluxes and microwave-radiometer-retrieved-liquid-water-path averaged on a 5-minute time scale (mean when low cloud is present). Details on the algorithm and analysis of results are given in Tansey et al. 2024 (submitted DOI: 10.22541/essoar.173482310.03809503/v1). The data are limited to the period of 20160410 to 20160612 and 20170103 to 20170214 during which time good quality microwave radiometer measurements are available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

CACTI CSAPR2 Taranis Retrievals

Taranis is an end-to-end processing chain for radar data written in Python with C extension for computation performance. Features include: masking for quality control, specific differential phase (Kdp), attenuation correction for reflectivity factor (Z) and differential reflectivity (Zdr) in rain, and additional geophysical retrievals. Retrievals are mostly drawn from literature or open-source software when appropriate, and have been tested, tuned, and modified to work with one another cohesively rather than using isolated off-the-shelf algorithms. Incorporated algorithms include hydrometeor (echo) identification, rain water content, raindrop mass-weighted mean diameter (gamma size distribution assumption), and rainfall rate (QPE). Taranis data sets exist for CSAPR2 PPI, HSRHI, and sector RHI scans. Cartesian-gridded data sets were also produced as well as a near-surface rain rate retrieval. More details can be found in the README.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram

X-ray phase contrast imaging significantly improves the visualization of structures with weak or uniform absorption, broadening its applications across a wide range of scientific disciplines. Propagation-based phase contrast is particularly suitable for time- or dose-critical in vivo/in situ/operando (tomography) experiments because it requires only a single intensity measurement. However, the phase information of the wave field is lost during the measurement and must be recovered. Conventional algebraic and iterative methods often rely on specific approximations or boundary conditions that may not be met by many samples or experimental setups. In addition, they require manual tuning of reconstruction parameters by experts, making them less adaptable for complex or variable conditions. Here we present a self-learning approach for solving the inverse problem of phase retrieval in the near-field regime of Fresnel theory using a single intensity measurement (hologram). A physics-informed generative adversarial network is employed to reconstruct both the phase and absorbance of the unpropagated wave field in the sample plane from a single hologram. Unlike most state-of-the-art deep learning approaches for phase retrieval, our approach does not require paired, unpaired, or simulated training data. This significantly broadens the applicability of our approach, as acquiring or generating suitable training data remains a major challenge due to the wide variability in sample types and experimental configurations. The algorithm demonstrates robust and consistent performance across diverse imaging conditions and sample types, delivering quantitative, high-quality reconstructions for both simulated data and experimental datasets acquired at beamline P05 at PETRA III (DESY, Hamburg), operated by Helmholtz-Zentrum Hereon. Furthermore, it enables the simultaneous retrieval of both phase and absorption information.

36 MATERIALS SCIENCE↗
DOE OSTI2021

An Improved Algorithm for Estimating Surface Shortwave Radiation: Preliminary Evaluation With MODIS Products

Cloud parameters, as key inputs in radiative transfer algorithms, have a critical impact on surface shortwave radiation (SSR) computation. By introducing a parameterization of cloud transmittance and reflectance, based on radiative transfer simulations, this study improves the accuracy of an existing physically based model which severely underestimates SSR under thick cloud conditions. The cloud parameterization adopts the single-layer cloud model and simulates cloud transmittances and reflectances by varying cloud optical thickness, cloud particle size, and solar zenith angle. The revised model is applied to estimate instantaneous SSR using Moderate-resolution Imaging Spectroradiometer (MODIS) atmospheric and land products. The retrieved SSR is evaluated against observation data from 41 Baseline Surface Radiation Network (BSRN) stations and is also compared with the MODIS official SSR product. The root mean square error (RMSE) of the estimated instantaneous radiation is approximately 52 and 98 W m -2 under clear-sky and all-sky conditions, respectively. The accuracy of the improved parameterization is higher than that of the original model, and there is no obvious underestimation of SSR in the case of high cloud optical thickness. Therefore, the new algorithm improves the accuracy of SSR estimates in the presence of thick clouds. Retrievals with the improved model also achieve higher accuracy than the MODIS official SSR product (MCD18A1). To conclude, the reliable performance of the scheme at most BSRN stations illustrates that the improved model can be used to map SSR on a global scale.

42 ENGINEERING↗
DOE OSTI2025

Combining Observations and Models: A Review of the CARDAMOM Framework for Data‐Constrained Terrestrial Ecosystem Modeling

The rapid increase in the volume and variety of terrestrial biosphere observations (i.e., remote sensing data and in situ measurements) offers a unique opportunity to derive ecological insights, refine process‐based models, and improve forecasting for decision support. However, despite their potential, ecological observations have primarily been used to benchmark process‐based models, as many past and current models lack the capability to directly integrate observations and their associated uncertainties for parameterization. In contrast, data assimilation frameworks such as the CARbon DAta MOdel fraMework (CARDAMOM) and its suite of process‐based models, known as the Data Assimilation Linked Ecosystem Carbon Model (DALEC), are specifically designed for model‐data fusion. This review, motivated by a recent CARDAMOM community workshop, examines the development and applications of CARDAMOM, with an emphasis on its role in advancing ecosystem process understanding. CARDAMOM employs a Bayesian approach, using a Markov Chain Monte Carlo algorithm to enable data‐driven calibration of DALEC parameters and initial states (i.e., carbon pool sizes) through observation operators. CARDAMOM's unique ability to retrieve localized model process parameters from diverse datasets—ranging from in situ measurements to global satellite observations—makes it a highly flexible tool for analyzing spatially variable ecosystem responses to environmental change. However, assimilating these data also presents challenges, including data quality issues that propagate into model skill, as well as trade‐offs between model complexity, parameter equifinality, and predictive performance. We discuss potential solutions to these challenges, such as reducing parameter equifinality by incorporating new observations. This review also offers community recommendations for incorporating emerging datasets, integrating machine learning techniques, strengthening collaboration with remote sensing, field, and modeling communities, and expanding CARDAMOM's relevance for localized ecosystem monitoring and decision‐making. CARDAMOM enables a deep, mechanistic understanding of terrestrial ecosystem dynamics that cannot be achieved through empirical analyses of observational datasets or weakly constrained models alone.

Bayesian inference↗
DOE OSTI2025

Acoustic Tomography of the Atmosphere: A Large-Eddy Simulation Sensitivity Study

Accurate measurement of atmospheric turbulent fluctuations is critical for understanding environmental dynamics and improving models in applications such as wind energy. Advanced remote sensing technologies are essential for capturing instantaneous velocity and temperature fluctuations. Acoustic tomography (AT) offers a promising approach that utilizes sound travel times between an array of transducers to reconstruct turbulence fields. This study presents a systematic evaluation of the time-dependent stochastic inversion (TDSI) algorithm for AT using synthetic travel-time measurements derived from large-eddy simulation (LES) fields under both neutral and convective atmospheric boundary-layer conditions. Unlike prior work that relied on field observations or idealized fields, the LES framework provides a ground-truth atmospheric state, enabling quantitative assessment of TDSI retrieval reliability, sensitivity to travel-time measurement noise, and dependence on covariance model parameters and temporal data integration. A detailed sensitivity analysis was conducted to determine the best-fit model parameters, identify the tolerance thresholds for parameter mismatch, and establish a maximum spatial resolution. The TDSI algorithm successfully reconstructed large-scale velocity and temperature fluctuations with root mean square errors ( RMSE s) below 0.35 m/s and 0.12 K, respectively. Spectral analysis established a maximum spatial resolution of approximately 1.4 m, and reconstructions remained robust for travel-time measurement uncertainties up to 0.002 s. These findings provide critical insights into the operational limits of TDSI and inform future applications of AT for atmospheric turbulence characterization and system design.

17 WIND ENERGY↗
DOE OSTI2020

Retrieval of energy spectra for all flavours of neutrinos from core-collapse supernova with multiple detectors

ABSTRACT We present a new method by which to retrieve energy spectrum for all falvours of neutrinos from core-collapse supernova (CCSN). In the retrieval process, we do not assume any analytic formulas to express the energy spectrum of neutrinos but rather take a direct way of spectrum reconstruction from the observed data; the singular value decomposition algorithm with a newly developed adaptive energy-gridding technique is adopted. We employ three independent reaction channels having different flavour sensitivity to neutrinos. Two reaction channels, inverse beta decay on proton and elastic scattering on electrons, from a water Cherenkov detector such as Super-Kamiokande (SK) and Hyper-Kamiokande (HK), and a charged current reaction channel with Argon from the Deep Underground Neutrino Experiment (DUNE) are adopted. Given neutrino oscillation models, we iteratively search the neutrino energy spectra at the CCSN source until they provide the consistent event counts in the three reaction channels. We test the capability of our method by demonstrating the spectrum retrieval to a theoretical neutrino data computed by our recent three-dimensional CCSN simulation. Although the energy spectrum with either electron-type or electron-type antineutrinos at the CCSN source has relatively large error compared to that of other species, the joint analysis with HK + DUNE or SK + DUNE will provide precise energy spectrum of all flavours of neutrinos at the source. Finally, we discuss perspectives for improvements of our method by using neutrino data of other detectors.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Arctic Cloud‐Base Ice Precipitation Properties Retrieved Using Bayesian Inference

Abstract Cloud‐climate feedbacks are still the greatest source of uncertainty in current climate projections. Arctic clouds, which are predominantly stratiform and supercooled, often long‐lived, and nearly continuously precipitate ice particles, contribute roughly 10% of the uncertainty attributed to the global cloud feedback. This Arctic cloud uncertainty is driven by incomplete observational and theoretical knowledge required to estimate and explain the state and active processes occurring in those clouds. A focus on ice precipitation properties at Arctic cloud base rather than the surface deconfounds the product of cloud condensate sink processes from the influence of the atmospheric thermodynamic state below cloud base, rendering cloud‐base properties a more appealing target for inference and evaluation of model simulations. Here I describe an inverse model for the estimation of cloud base ice precipitation properties over Utqiagvik, North Slope of Alaska, using the synthesis of ground‐based radar and lidar measurements. By leveraging a Markov Chain Monte Carlo algorithm as the core of the inverse model, a wide range of particle size distributions are sampled, and different combinations of ice habit models are examined, both of which are typically fixed in other retrieval methods. Results show intriguing links between different cloud base thermodynamic and ice precipitation properties. Apparent ice number concentration enhancements at temperatures of −5 and −15°C suggest possible secondary ice production (SIP). The analysis alludes to an overestimation of SIP occurrence and intensity, especially in studies relying only on radar or lidar measurements. Finally, reflectivity‐dependent ice precipitation rate and ice water content parameterizations are presented.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Randomized probe imaging through deep k-learning

Randomized probe imaging (RPI) is a single-frame diffractive imaging method that uses highly randomized light to reconstruct the spatial features of a scattering object. The reconstruction process, known as phase retrieval, aims to recover a unique solution for the object without measuring the far-field phase information. Typically, reconstruction is done via time-consuming iterative algorithms. In this work, we propose a fast and efficient deep learning based method to reconstruct phase objects from RPI data. The method, which we call deep k-learning, applies the physical propagation operator to generate an approximation of the object as an input to the neural network. This way, the network no longer needs to parametrize the far-field diffraction physics, dramatically improving the results. Deep k-learning is shown to be computationally efficient and robust to Poisson noise. The advantages provided by our method may enable the analysis of far larger datasets in photon starved conditions, with important applications to the study of dynamic phenomena in physical science and biological engineering.

Guo, Zhen (ORCID:0000000213473451)↗
DOE OSTI2025

WREF Halo Streamline scanning lidar / Derived data / RHI

This dataset contains streamwise velocity retrieved from the Range Height Indicator (RHI) scans done by the UC Davis scanning Lidar. The quality control of the radial wind speed is performed following the algorithm of Beck & Kuhn (2017). Instantaneous realizations characterized by wind misalignment greater than 60 degrees (based on the closest VAD scan in time) are discarded.

17 WIND ENERGY↗
DOE OSTI2021

Climatology of Melting Layer Heights Estimated From Cloud Radar Observations at Various Locations

A melting layer (ML) detection algorithm for cloud radar with polarimetric capability was developed and applied to the cloud radar data collected from five different sites around the world for several years. The retrieved melting layer top height (MLH) showed a very good correspondence with the ECMWF Reanalysis 5 zero degree level data for all five sites. The ML characteristics were distinctively different for different sites, revealing climatological characteristics of ML forming clouds in different regions. Generally, ML tended to occur more frequently in summer than in winter except for a maritime site, where low stratiform clouds formed frequently in summer, the top of which might be lower than the freezing level. In contrast, at two Arctic sites, ML occurred almost exclusively in summer because it was too cold to have an ML in the other seasons. The MLH also varied significantly from site to site but generally was higher during warmer seasons. Based on MLH, two new indices, bulk temperature lapse rate (BLR) and relative depth (RD) of liquid cloud below MLH (RD) were developed, which were useful to explain the environmental characteristics of the five sites. BLR generally increased with the surface temperature at all sites except at the marine site that showed an opposite trend, where a unique synoptic pattern in winter generated high BLR in this cold season. Finally, these findings confirm that studies on thermodynamic structures using cloud radars can be broadened, taking advantage of BLR and RD information, as these indices can represent environmental thermodynamic characteristics of the clouds that have ML.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Developing a simulator-based satellite dataset for using machine learning techniques to derive aerosol-cloud-precipitation interactions in models and observations in a consistent framework

Aerosol-cloud-precipitation interactions (ACPI) remain a major uncertainty in understanding the Earth’s radiation budget and water cycle (including extremes). After decades of active research, various observationally based metrics have been developed to constrain ACPI in Earth System Models (ESMs), but direct comparison of model and data estimates can confound scientific understanding because limitations and uncertainties in sampling and retrieval procedures may combine with model deficiencies in process representations of ACPI to obstruct understanding. Furthermore, conventional ACPI metrics often vary from one regime to another, and the ACPI process representation in ESMs is also typically derived based on only a limited area/regime (even though the parameterization applies globally). To bridge the gap between models and data and to correctly describe ACPI in all regimes, we propose to construct a new CALIPSO-CloudSat merged dataset that is produced by the same algorithms used in satellite simulators in ESMs, and to use machine learning techniques to derive new ACPI metrics that can be accurately estimated by satellites and can provide meaningful constraints on cloud microphysical process representations in ESMs. The dataset will include measured and retrieved variables for aerosol, cloud, and precipitation from CALIPSO and CloudSat, and environmental variables from meteorological reanalysis. The data will be used to train a neural network to construct the ACPI metrics as a function of environmental conditions. The new ACPI formula will be used to constrain the ACPI in the Energy Exascale Earth System Model (E3SM), and to augment/reformulate the ACPI process representation in the E3SM to improve the simulation of the evolution of the atmosphere under different environmental conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (Biometrika 81(3):425–455, 1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform simulated and real data Monte Carlo experiments to quantify the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Evaluation of Methods for Causal Discovery in Hydrometeorological Systems

Understanding causal relations is of utmost importance in hydrology and climate research for systems identification, prediction, and understanding systems behavior in a changing climate. Traditionally, researchers in hydrometeorology attempted to study causal questions by conducting controlled experiments using numerical models. This approach, however, in most cases of interest provides uncertain results because the models are approximate representation of the natural system. An alternative approach that has recently drawn significant attention in several fields is to infer causal relations from purely observational data. It possesses several traits to its utility particularly in hydrometeorology due to the rapid accumulation of in situ and remotely sensed data records. The first objective of this study is to present a brief description of four causal discovery methods (Granger causality, Transfer Entropy, graph-based algorithms, and Convergent Cross Mapping) with special emphasis on the assumptions on which they are built. Second, using synthetic data generated from a hydrological model, we assess their performance in retrieving causal information taking into account sensitivity to sample size and presence of noise. Last, we use causal analysis to examine and formulate hypotheses on causal drivers of evapotranspiration in a shrubland region during summer and winter seasons. An interpretation of the hypotheses based on canopy seasonal dynamics and evapotranspiration processes is presented. It is hoped that the results presented here can be useful in guiding researchers studying hydrometeorological systems as to which causal method is most appropriate to the characteristics of the system under study.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

TRACER SPARC AERI Data

These files contain 24 hour periods of retrieved thermodynamic profiles derived from observations collected by the University of Wisconsin–Madison Space Science and Engineering Center Portable Atmospheric Research Center (SPARC) Atmospheric Emitted Radiance Interferometer (AERI). The TROPoe algorithm is a python equivalent to the AERIoe algorithm (see Turner and Loehnert, 2014; Turner and Blumberg 2019). These data were collected during the TRACER project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Improving the Confidence in Retrievals of Vertical Distributions of Cloud Condensation Nuclei Number Concentration from ARM Supported by Aircraft In Situ Observations

Accurate quantification of the vertical distribution of cloud condensation nuclei (CCN) number concentrations is critical for improving our understanding of aerosol–cloud interactions. Ground-based Raman lidars operated by the Atmospheric Radiation Measurement (ARM) program, together with surface CCN measurements, are used to retrieve vertically resolved CCN number concentrations (Retrieved Number concentration of CCN, RNCCN). These retrievals rely on several assumptions, including that aerosol composition is vertically homogeneous. To assess this assumption, we developed and tested a framework to infer the dominant aerosol classes/types at different altitudes. This was done by applying a k-Nearest-Neighbors (kNN) algorithm to lidar ratio and linear depolarization ratio measurements from Raman lidar. We evaluated the framework using aircraft aerosol and CCN measurements from the ARM Holistic Interactions of Shallow Clouds, Aerosols, and Land Ecosystems (HI-SCALE) field campaign. The results show that RNCCN performance degrades as vertical aerosol complexity increases, i.e., RNCCN agrees with the aircraft CCN in vertically homogeneous conditions, but closure decreases in layered aerosol structures. To generalize beyond individual examples, we introduce a metric (heterogeneity index) that quantifies the vertical complexity by assessing the variation of inferred aerosol classes/types. Case-level statistics show a tendency for RNCCN and aircraft differences to increase with this metric. By detecting retrievals that are likely compromised by aerosol vertical heterogeneity, the proposed framework improves the interpretability and effective use of RNCCN used for long-term evaluation of models and aerosol–cloud interactions.

Tian, Jingjing↗
DOE OSTI2026

Towards retrieving cloud top entrainment velocities from MISR cloud motion vectors

Although important, direct retrievals of entrainment rates in cloud-topped planetary boundary layer (PBL) remain elusive. Here we present a novel technique for retrieving cloud-top entrainment velocities using only Multi-angle Imaging Spectro-Radiometer (MISR) stereoscopic retrievals of cloud-motion vectors (CMVs) and cloud-top heights (CTHs). Mesoscale vertical air velocity at CTH is diagnosed from the continuity equation and then used to derive entrainment velocities from the PBL mass-budget equation. The algorithm is demonstrated through a case of marine stratocumulus deck off the California coast, with comparisons made against data from the European Centre for Medium-range Weather Forecasts (ECMWF) reanalysis (ERA5) and the data from other satellites. MISR low-cloud CTH for this case were lower than the ERA5 reported PBL depth by 189 ± 87 m. These differences in cloud top heights partly modulate the differences in the ERA5 and MISR horizontal winds, with larger differences in meridional over zonal wind components. Average difference between ERA5 and MISR derived mesoscale vertical air motion at cloud top was 0.14 ± 0.73 cm s −1 , while the same for entrainment rate was −0.09 ± 0.46 cm s −1 . The uncertainties in the utilized CTHs and CMVs are propagated to derive systematic and random retrieval uncertainties. Fractional uncertainty is lower than 25 % when the retrieved mesoscale vertical air motion is stronger than ±0.04 cm s −1 and entrainment velocities are stronger than ±0.03 cm s −1 . These results showcase the ability to derive mesoscale vertical air motion and entrainment rates from MISR observations and motivate its extension to generate a global climatology leveraging its full 23-year record (2000–2022). Nonetheless comprehensive validation of the retrievals is warranted through comparisons with estimates from an independent dataset across diverse weather conditions.

Mitra, Arka [Argonne National Laboratory (ANL), Ar↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗