Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Imaging pyrometry for most color cameras using a triple pass filter

A simple combination of the Planck blackbody emission law, optical filters, and digital image processing is demonstrated to enable most commercial color cameras (still and video) to be used as an imaging pyrometer for flames and explosions. The hardware and data processing described take advantage of the color filter array (CFA) that is deposited on the surface of the light sensor array present in most digital color cameras. In this work, a triple-pass optical filter incorporated into the camera lens allows light in three 10-nm wide bandpass regions to reach the CFA/light sensor array. These bandpass regions are centered over the maxima in the blue, green, and red transmission regions of the CFA, minimizing the spectral overlap of these regions normally present. A computer algorithm is used to retrieve the blue, green, and red image matrices from camera memory and correct for remaining spectral overlap. A second algorithm calibrates the corrected intensities to a gray body emitter of known temperature, producing a color intensity correction factor for the camera/filter system. The Wien approximation to the Planck blackbody emission law is used to construct temperature images from the three color (blue, green, red) matrices. A short pass filter set eliminates light of wavelengths longer than 750 nm, providing reasonable accuracy (±10%) for temperatures between 1200 and 6000 K. The effectiveness of this system is demonstrated by measuring the temperature of several systems for which the temperature is known.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Retrieval of the molecular orientation distribution from atom-pair angular distributions

Imaging laser-induced rotational dynamics is an important and active field due to its applications in capturing reactions in the molecular frame and in molecular imaging. Experimental measurement of the molecular orientation distribution, as a function of the Euler angles, has only been demonstrated for special cases when the detectable signal is generated along the molecular symmetry axis. Here we developed the general theory that maps the probability density distribution of the molecular orientation to the atom-pair angular distributions for nonlinear molecules. With the theory, the molecular orientation distribution can be retrieved from the measured atom-pair angular distribution, which we demonstrate experimentally using ultrafast electron diffractive imaging of impulsively aligned trifluoro-iodomethane molecules. Here, the retrieved molecular orientation distribution is in good agreement with direct numerical simulations of the time-dependent Schrodinger equation using the experimental conditions. Unlike the existing retrieval methods, the retrieval method does not require solving Schrodinger equation, works for any alignment method, and is in principle applicable to asymmetric top molecules.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, and robustness. Inspired by the concept of Edge Artificial Intelligence (Edge AI), we propose a robust approach that enables fast FLI with no degradation of accuracy. This approach couples a recurrent neural network (RNN), which is trained to estimate the fluorescence lifetime directly from raw timestamps without building histograms, to SPAD TCSPC systems, thereby drastically reducing transfer data volumes and hardware resource utilization, and enabling real-time FLI acquisition. We train two variants of the RNN on a synthetic dataset and compare the results to those obtained using center-of-mass method (CMM) and least squares fitting (LS fitting). Results demonstrate that two RNN variants, gated recurrent unit (GRU) and long short-term memory (LSTM), are comparable to CMM and LS fitting in terms of accuracy, while outperforming them in the presence of background noise by a large margin. To explore the ultimate limits of the approach, we derive the Cramer-Rao lower bound of the measurement, showing that RNN yields lifetime estimations with near-optimal precision. To demonstrate real-time operation, we build a FLI microscope based on an existing SPAD TCSPC system comprising a 32 x 32 SPAD sensor named Piccolo. Four quantized GRU cores, capable of processing up to 4 million photons per second, are deployed on the Xilinx Kintex-7 FPGA that controls the Piccolo. Powered by the GRU, the FLI setup can retrieve real-time fluorescence lifetime images at up to 10 frames per second. The proposed FLI system is promising and ideally suited for biomedical applications, including biological imaging, biomedical diagnostics, and fluorescence-assisted surgery, etc.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Registration and fusion of large-scale melt pool temperature and morphology monitoring data demonstrated for surface topography prediction in LPBF

In-situ monitoring technologies for laser powder bed fusion (LPBF) additive manufacturing often face one key challenge, extracting the ultrafast melt pool (MP) signatures for understanding the localized part properties. Further, the spatial information of each monitored MP signature is essential for correlating the MP – part property. This spatial information is often unavailable especially from commercial LPBF printers. Many MP monitoring methods have been reported and utilized. However, very few of these have the MP’s spatial information. To overcome this challenge, in this work we report a method for spatially registering the key MP signatures (MP intensity, temperature, and area) to the monitored print parts. The MP signatures are obtained from our coaxial high-speed single-camera based two-wavelength imaging pyrometry (STWIP) system and the MP spatial information is obtained from an off-axis camera system. A machine learning aided image analysis method is employed to retrieve the spatial distribution of MPs within the corresponding part’s coordinates system. Then, the MP signature maps (MPSMs) are reconstructed by mapping the STWIP measured MP signatures to the registered MP coordinates. Further, a long short-term memory (LSTM) neural network is developed for estimating the layer surface topography from the registered MPSMs. The obtained results indicate that the layer surface topography can be more accurately estimated by using MP temperature signature rather than MP intensity and/or area signatures as in common practice. Finally, our developed methods for MP monitoring, registration, and MP-surface topography prediction offer advanced capabilities for the online detection of process anomalies and part defects.

36 MATERIALS SCIENCE↗
DOE OSTI2020

AI-enabled high-resolution scanning coherent diffraction imaging

Ptychographic imaging is a powerful means of imaging beyond the resolution limits of typical x-ray optics. Capturing recovered images from raw ptychographic data, however, requires the solution of an inverse problem, namely, phase retrieval. Phase retrieval algorithms are computationally expensive, which precludes real-time imaging. In this work, we propose PtychoNN, an approach to solve the ptychography data inversion problem based on a deep convolutional neural network. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. Our results demonstrate the practical application of machine learning to recover high fidelity amplitude and phase contrast images of a real sample hundreds of times faster than current ptychography reconstruction packages. Furthermore, by overcoming the constraints of iterative model-based methods, we can significantly relax sampling constraints on data acquisition while still producing an excellent image of the sample. Besides drastically accelerating acquisition and analysis, this capability has profound implications for the imaging of dose sensitive, dynamic, and extremely voluminous samples.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Towards real-time monitoring: data assimilated time-lapse full waveform inversion for seismic velocity and uncertainty estimation

SUMMARY Rapid development of time-lapse seismic monitoring instrumentations has made it possible to collect dense time-lapse data for tomographically retrieving time-lapse (even continuous) images of subsurface changes. While traditional time-lapse full waveform inversion (TLFWI) algorithms are designed for sparse time-lapse surveys, they lack of effective temporal constraint on time-lapse data, and, more importantly, lack of the uncertainty estimation of the TLFWI results that is critical for further interpretation. Here, we propose a new data assimilation TLFWI method, using hierarchical matrix powered extended Kalman filter (HiEKF) to quantify the image uncertainty. Compared to existing Kalman filter algorithms, HiEKF allows to store and update a data-sparse representation of the cross-covariance matrices and propagate model errors without expensive operations involving covariance matrices. Hence, HiEKF is computationally efficient and applicable to 3-D TLFWI problems. Then, we reformulate TLFWI in the framework of HiEKF (termed hereafter as TLFWI-HiEKF) to predict time-lapse images of subsurface spatiotemporal velocity changes and simultaneously quantify the uncertainty of the inverted velocity changes over time. We demonstrate the validity and applicability of TLFWI–HiEKF with two realistic CO2 monitoring models derived from Frio-II and Cranfield CO2 injection sites, respectively. In both 2-D and 3-D examples, the inverted high-resolution time-lapse velocity results clearly reveal a continuous velocity reduction due to the injection of CO2. Moreover, the accuracy of the model is increasing over time by assimilating more time-lapse data while the standard deviation is decreasing over lapsed time. We expect TLFWI-HiEKF to be equipped with real-time seismic monitoring systems for continuously imaging the distribution of subsurface gas and fluids in the future large-scale CO2 sequestration experiments and reservoir management.

58 GEOSCIENCES↗
DOE OSTI2020

Ptychography at the Linac Coherent Light Source in a parasitic geometry

X-ray free-electron lasers (FELs) are being recognized as a powerful tool in an ever-increasing number of research fields, but are very limited as to the number of experiments that they can support. This work shows that more beamtime could be made available by using `parasitic' geometries, where a secondary experiment uses the X-ray beam that the primary experiment does not utilize. The first successful ptychography experiment, a scanning coherent diffractive imaging technique, in a parasitic geometry at an X-ray FEL is demonstrated. Utilizing the CXI hutch at the Linac Coherent Light Source (LCLS), it is shown that the obtained data are of high quality and that characterizing the beam using ptychography can be much faster than traditional imprinting methods.

42 ENGINEERING↗
DOE OSTI2024

HERMES

HERMES - High-speed Event Retrieval and Management for Enhanced Spectral imaging code. This code is meant to unpack and process neutron imaging data from the TPX3Cam made by Amsterdam Scientific Instruments. The TPX3Cam utilizes the Timepix3 chip in a single photon counting mode of image acquisition. The photon counting data streaming off the TPX3Cam needs to be process and analyzed in order to create final images. Therefore we are developing both python and cpp codes to allow for users of the TPX3Cam to efficiently analyze data and create images.

Long, Alexander↗
DOE OSTI2026

The ABCs of phase retrieval: Connecting the acronyms of scanning transmission electron microscopy

High-resolution scanning transmission electron microscopy (S/TEM) is an indispensable tool for characterizing the structure and properties of materials down to the atomic scale. Conventional S/TEM imaging, however, is limited by the phase problem, whereby the phase of the electron exit wave is lost upon detection. Recent advances in diffractive imaging and 4D-STEM have enabled a range of phase-retrieval techniques that computationally reconstruct the missing information encoded in the phase of the transmission function. These approaches offer improved dose efficiency and enhanced sensitivity to weakly scattering signals, extending quantitative imaging to beam-sensitive materials composed of light elements. In this work, we introduce the phase problem in electron microscopy and survey the diverse landscape of phase-retrieval techniques used in the field. Despite their many acronyms and algorithmic variations, these techniques share a common physical and mathematical foundation. We present a unified framework that connects these seemingly distinct methods, from parallax imaging and tilt-corrected bright-field (tcBF-STEM), to aberration-corrected bright-field (acBF-STEM), optimum bright-field (OBF-STEM) and single-sideband (SSB) ptychography, as well as first-moment integrated center of mass techniques (iCOM) and iterative ptychographic algorithms. Based on these insights, we discuss the opportunities and practical limitations of applying these methods across different materials systems, detector designs, and microscope configurations.Graphical abstractRepresentative electron microscopy configurations used for phase retrieval and diffractive imaging in S/TEM: (a) Zernike phase-contrast transmission electron microscopy (TEM), (b) small-convergence-angle four-dimensional scanning transmission electron microscopy (4D-STEM) for nanobeam-based phase reconstruction methods, and (c) large-convergence-angle 4D-STEM for ptychographic and related diffractive imaging techniques reviewed in this work.

36 MATERIALS SCIENCE↗
DOE OSTI2020

ExoReL{sup R}: A Bayesian Inverse Retrieval Framework for Exoplanetary Reflected Light Spectra

The high-contrast imaging technique is meant to provide insight into those planets orbiting several astronomical units from their host star. Space missions such as Wide-Field InfraRed Survey Telescope, Habitable Exoplanet Imaging Mission, and Large Ultra-Violet/Optical/InfraRed Surveyor will measure reflected light spectra of cold gaseous and rocky planets. To interpret these observations, we introduce ExoReL{sup R} (Exoplanetary Reflected Light Retrieval), a novel Bayesian retrieval framework to retrieve cloud properties and atmospheric structures from exoplanetary reflected light spectra. As a unique feature, it assumes a vertically nonuniform volume mixing ratio (VMR) profile of water and ammonia, and uses it to construct cloud densities. In this way, clouds and molecular mixture ratios are consistent. We apply ExoReL{sup R} on three test cases: two exoplanets (υ And e and 47 Uma b) and Jupiter. We show that we are able to retrieve the concentration of methane in the atmosphere, and estimate the position of clouds when the signal-to-noise ratio of the spectrum is higher than 15, in line with previous works. Moreover, we described the ability of our model to give a chemical identity to clouds, and we discussed whether or not we can observe this difference in the planetary reflection spectrum. Finally, we demonstrate how it could be possible to retrieve molecular concentrations (water and ammonia in this work) below the clouds by linking the nonuniform VMR profile to the cloud presence. This will help to constrain the concentration of water and ammonia unseen in direct measurements.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Relationships between summertime surface albedo and melt pond fraction in the central Arctic Ocean: The aggregate scale of albedo obtained on the MOSAiC floe

As part of the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC), the HELiX uncrewed aircraft system (UAS) was deployed over the sea ice in the central Arctic Ocean during summer 2020. Albedo measurements were obtained with stabilized pyranometers, and melt pond fraction was calculated from orthomosaic imagery from a surface-imaging multispectral camera. This study analyzed HELiX flight data to provide insights on the temporal and spatial evolution of albedo and melt pond fraction of the MOSAiC floe during the melt season as it drifted south through Fram Strait. The surface albedo distributions showed peak values changing from high albedo (0.55–0.6) to lower values (0.3) as the season advanced. Inspired by methods developed for satellite data, an algorithm was established to retrieve melt pond fraction from the orthomosaic images. We demonstrate that the near-surface observations of melt pond fraction were highly dependent on sample area, offering insight into the influence of subgrid scale features and spatial heterogeneity in satellite observations. Vertical observations conducted with the HELiX were used to quantify the influence of melt pond scales on observed surface albedo as a function of sensor footprint. These scaling results were used to link surface-based measurements collected during MOSAiC to broader-scale satellite data to investigate the influence of surface features on observed albedo. Albedo values blend underlying features within the sensor footprint, as determined by the melt pond size and concentration. This study framed the downscaling (upscaling) problem related to the airborne (surface) observations of surface albedo across a variety of spatial scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A general approach to seismic inversion with automatic differentiation

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient efficiently; however, its implementation can be time-consuming and difficult. We develop a general seismic inversion framework to calculate gradients using reverse-mode automatic differentiation. The central idea is that adjoint-state methods and reverse-mode automatic differentiation are mathematically equivalent. Here, the mapping between numerical PDE simulation and deep learning allows us to build a seismic inverse modeling library, ADSeismic, based on deep learning frameworks, which supports high performance reverse-mode automatic differentiation on CPUs and GPUs. We demonstrate the performance of ADSeismic on inverse problems related to velocity model estimation, rupture imaging, earthquake location, and source time function retrieval. ADSeismic has the potential to solve a wide variety of inverse modeling applications within a unified framework.

58 GEOSCIENCES↗
DOE OSTI2024

The Effect of Physically Based Ice Radiative Processes on Greenland Ice Sheet Albedo and Surface Mass Balance in E3SM

Abstract A significant portion of surface melt on the Greenland Ice Sheet (GrIS) is due to dark ice regions in the ablation zone, where solar absorption is influenced by the physical properties of the ice, light absorbing constituents (LACs), and the overlying crustal surface or melt ponds. Earth system models (ESMs) typically prescribe the albedo of ice surfaces as a constant value in the visible and near‐infrared spectral regions. This work advances ESM ice radiative transfer modeling by (a) incorporating a physically based radiative transfer model (SNow, ICe and Aerosol Radiation model Adding‐Doubling Version 4; SNICAR‐ADv4) into the Energy Exascale Earth System Model (E3SM), (b) determining spatially and temporally varying bare ice physical properties over the GrIS ablation zone from satellite observations to inform SNICAR‐ADv4, and (c) assessing the impacts on simulated GrIS albedo and surface mass balance associated with modeling of more realistic bare ice albedo. GrIS‐wide bare ice albedo in E3SMv2 is overestimated by ∼4% in the visible and ∼7% in the near‐infrared wavelengths compared to the Moderate Resolution Imaging Spectroradiometer. Our bare ice physical property retrieval method found that LACs, ice crustal surfaces, and melt ponds reduce visible albedo by 30% in the bare ice region of the GrIS ablation zone. The realistic bare ice albedo reduces surface mass balance by ∼145 Gt, or 0.4 mm of sea‐level equivalent between 2000 and 2021 compared to the default E3SM. This work highlights the importance of simulating bare ice albedo accurately and realistically to improve our ability to quantify changes in the GrIS surface mass and radiative energy budgets.

58 GEOSCIENCES↗
DOE OSTI2021

AD_LTEM

This software uses AI tools for enhanced functional imaging using Lorentz transmission electron microscopy by retrieving phase shift at higher spatial resolution, and under noisy conditions. This is a companion code for a publication that is currently being submitted (APT # 164160).

PHATAK, CHARUDATTA↗
DOE OSTI2025

Evaluation of cloud height, optical thickness, and phase retrievals from the CHROMA algorithm applied to Sentinel-3 OLCI data

We previously developed the Cloud Height Retrieval from O 2 Molecular Absorption (CHROMA) algorithm for the Ocean Color Instrument (OCI) on the new NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission. Here, we apply CHROMA to observations from the Ocean Land Colour Instrument (OLCI) to guide expectations for PACE, as it will take some time to obtain large-scale validation data for OCI. We use cloud top height (CTH), phase, and (for liquid clouds) cloud optical thickness (COT) data from the ground-based Atmospheric Radiation Measurement (ARM) network to evaluate the OLCI retrievals. We found that OLCI and Moderate Resolution Imaging Spectroradiometer (MODIS) CTH compare similarly well to the ARM reference. OLCI has a tendency to underestimate CTH as CTH increases, and algorithm assumptions about cloud geometric thickness may contribute to this. ARM COT from multifilter shadowband radiometers (MFRSR) and Sun photometers are well-correlated with one another, albeit with a roughly 30 % offset on average; OLCI and MODIS COT agree more closely with the MFRSR data. OLCI retrieval uncertainty estimates show skill at telling low-uncertainty cases from high-uncertainty ones, although CTH uncertainties are underestimated. Additionally, we compare the OLCI data to satellite retrievals based on thermal infrared measurements from MODIS and Sea and Land Surface Temperature Radiometer (SLSTR) data. Differences are broadly consistent with physical expectations based on the A-band vs. thermal techniques, although one key challenge in such aggregated comparisons is different cloud masking sensitivities and algorithm failure rates meaning additional sampling differences are introduced. We conclude by discussing the transition to and possible enhancements for PACE OCI.

Sayer, Andrew M. [Univ. of Maryland Baltimore Coun↗
DOE OSTI2025

Can We Rely on Satellite Visible/Infrared Microphysical Retrievals of Boundary Layer Clouds in Partially Cloudy Scenes? Implications for Climate Research

This study addresses the longstanding question of the reliability of gridded visible/infrared satellite cloud properties in partially cloudy scenes. By using in-situ cloud probes and airborne Research Scanning Polarimeter (RSP) observations, we analyze bias changes in satellite retrievals from the Spinning Enhanced Visible Infra-Red Imager (SEVIRI) geostationary sensor during the ORACLES campaign. Biases in cloud optical depth (τ) and droplet effective radius (r e ) modestly change for cloud area fraction greater than 35%. The agreement between SEVIRI and RSP r e substantially improves when the retrievals are averaged after removing pixels with τ < 3.0, yielding biases indistinguishable from overcast scenes. In addition, satellite and RSP show an excellent agreement for closed- and open-cell stratocumulus clouds, showing that the satellite retrievals capture spatial changes of r e , and confirming that satellites can faithfully reproduce real physical features for optically thick and partially cloudy scenes. We demonstrate that a simple methodology can minimize uncertainties in satellite-based climate studies.

Painemal, David [NASA Langley Research Center, Ham↗