Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

The Use of Long-wave Infrared Cameras for Hazardous Waste Remediation - 20457

For over fifty years, infrared cameras have been used in military applications, nondestructive testing, condition monitoring, and predictive maintenance. As infrared cameras continue to become more sophisticated and less expensive, they are providing value in an ever-increasing variety of unique applications, including hazardous waste remediation. This paper describes several instances of how infrared cameras have been used within the US Department of Defense and the US Department of Energy in support of waste remediation projects, including the author's recent use of an infrared camera in support of the Calcine Retrieval Project at the Idaho National Laboratory. Infrared cameras provide images of infrared radiation, or heat energy, which is otherwise invisible to the unaided eye. Infrared radiation is part of the electromagnetic spectrum, which includes visible light. But unlike visible light, infrared has wavelengths longer than the human eye can detect. Infrared is emitted by everything with a temperature above absolute zero (-273 deg. C, or -459 deg. F); the higher the temperature, the greater the infrared thermal radiation, or heat, that is emitted. Even objects that feel cold to us, like ice, emit thermal radiation and can be imaged by infrared cameras. These cameras are typically used to look for abnormally hot or cold spots on a component or target area under normal operating conditions. The method provides a rapid, wide-area, noncontact technique for identifying problems associated with a temperature differential. All infrared cameras can provide qualitative thermal information by displaying relative differences in temperatures within a two-dimensional image. More expensive infrared cameras can also provide quantitative information where an absolute temperature value is assigned to each pixel associated with the displayed two-dimensional image. Proper camera calibration and a solid understanding of heat transfer and thermography techniques are required when using an infrared camera to obtain quantitative information. Case studies outlined in this paper include the rapid, non-intrusive detection of hazardous decontamination solution within one-ton shipping containers at Pine Bluff Arsenal, the non-intrusive identification of residual elemental sodium within the cooling loops of the Experimental Breeder Reactor II (EBR-II) reactor at the Idaho National Laboratory, process monitoring of heat exchanger melt-and-drain efforts during EBR-II decommissioning, and the remote detection of internal steel supports within calcine storage bins prior to bin penetration. For each use of thermography, the author describes a summary of the waste remediation effort, the infrared camera used, the thermal imaging technique employed, and the results obtained. The paper concludes with a discussion on common mistakes to avoid for similar applications of thermography. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Distributed Optimization for Nonrigid Nano-Tomography

Resolution level and reconstruction quality in nano-computed tomography (nano-CT) are in part limited by the stability of microscopes, because the magnitude of mechanical vibrations during scanning becomes comparable to the imaging resolution, and the ability of the samples to resist radiation induced deformations during data acquisition. In such cases, there is no incentive in recovering the sample state at different time steps like in time-resolved reconstruction methods, but instead the goal is to retrieve a single reconstruction at the highest possible spatial resolution and without any imaging artifacts. Here we propose a distributed optimization solver for tomographic imaging of samples at the nanoscale. Our approach solves the tomography problem jointly with projection data alignment, nonrigid sample deformation correction, and regularization. Projection data consistency is regulated by dense optical flow estimated by Farneback's algorithm, leading to sharp sample reconstructions with less artifacts. Synthetic data tests show robustness of the method to Poisson and low-frequency background noise. We accelerated the solver on multi-GPU systems and validated the method on three nano-imaging experimental data sets.

97 MATHEMATICS AND COMPUTING↗

Ultrafast Bragg coherent diffraction imaging of epitaxial thin films using deep complex-valued neural networks

Abstract Domain wall structures form spontaneously due to epitaxial misfit during thin film growth. Imaging the dynamics of domains and domain walls at ultrafast timescales can provide fundamental clues to features that impact electrical transport in electronic devices. Recently, deep learning based methods showed promising phase retrieval (PR) performance, allowing intensity-only measurements to be transformed into snapshot real space images. While the Fourier imaging model involves complex-valued quantities, most existing deep learning based methods solve the PR problem with real-valued based models, where the connection between amplitude and phase is ignored. To this end, we involve complex numbers operation in the neural network to preserve the amplitude and phase connection. Therefore, we employ the complex-valued neural network for solving the PR problem and evaluate it on Bragg coherent diffraction data streams collected from an epitaxial La 2-x Sr x CuO 4 (LSCO) thin film using an X-ray Free Electron Laser (XFEL). Our proposed complex-valued neural network based approach outperforms the traditional real-valued neural network methods in both supervised and unsupervised learning manner. Phase domains are also observed from the LSCO thin film at an ultrafast timescale using the complex-valued neural network.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

A Comprehensive Northern Hemisphere Particle Microphysics Data Set From the Precipitation Imaging Package

Microphysical observations of precipitating particles are critical data sources for numerical weather prediction models and remote sensing retrieval algorithms. However, obtaining coherent data sets of particle microphysics is challenging as they are often unindexed, distributed across disparate institutions, and have not undergone a uniform quality control process. This work introduces a unified, comprehensive Northern Hemisphere particle microphysical data set from the National Aeronautics and Space Administration precipitation imaging package (PIP), accessible in a standardized data format and stored in a centralized, public repository. Data is collected from 10 measurement sites spanning 34° latitude (37°N–71°N) over 10 years (2014–2023), which comprise a set of 1,070,000 precipitating minutes. The provided data set includes measurements of a suite of microphysical attributes for both rain and snow, including distributions of particle size, vertical velocity, and effective density, along with higher-order products including an approximation of volume-weighted equivalent particle densities, liquid equivalent snowfall, and rainfall rate estimates. The data underwent a rigorous standardization and quality assurance process to filter out erroneous observations to produce a self-describing, scalable, and achievable data set. Case study analyses demonstrate the capabilities of the data set in identifying physical processes like precipitation phase-changes at high temporal resolution. Bulk precipitation characteristics from a multi-site intercomparison also highlight distinct microphysical properties unique to each location. This curated PIP data set is a robust database of high-quality particle microphysical observations for constraining future precipitation retrieval algorithms, and offers new insights toward better understanding regional and seasonal differences in bulk precipitation characteristics.

54 ENVIRONMENTAL SCIENCES↗

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples.

Cherukara, Mathew J↗

Element differentiation with a Hartmann- based X-ray phase imaging system

Significant efforts are currently ongoing in X-ray imaging to provide multimodal imaging systems, targeting better sensitivity and specificity for both biomedical or non-destructive testing applications. Knowing the elemental composition of specific structures, such as breast microcalcifications in mammography, would help to differentiate malign and benign tumours. Standard X-ray Phase Contrast Imaging techniques provide only qualitative information on elements with similar absorption properties. However, their chemical composition can be determined from the measurement of the phase as it is directly related to the optical index of elemental materials. We will show new experimental results obtained with an X-ray phase imaging system based on a Hartmann mask. Early data treatment succeeded in retrieving both the real and imaginary parts of the refractive index. The system demonstrates the capability to discriminate materials based on elemental composition.

36 MATERIALS SCIENCE↗

Understanding processes that control dust spatial distributions with global climate models and satellite observations

Dust aerosol is important in modulating the climate system at local and global scales, yet its spatiotemporal distributions simulated by global climate models (GCMs) are highly uncertain. In this study, we evaluate the spatiotemporal variations of dust extinction profiles and dust optical depth (DOD) simulated by the Community Earth System Model version 1 (CESM1) and version 2 (CESM2), the Energy Exascale Earth System Model version 1 (E3SMv1), and the Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) against satellite retrievals from Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), Moderate Resolution Imaging Spectroradiometer (MODIS), and Multi-angle Imaging SpectroRadiometer (MISR). We find that CESM1, CESM2, and E3SMv1 underestimate dust transport to remote regions. E3SMv1 performs better than CESM1 and CESM2 in simulating dust transport and the northern hemispheric DOD due to its higher mass fraction of fine dust. CESM2 performs the worst in the Northern Hemisphere due to its lower dust emission than in the other two models but has a better dust simulation over the Southern Ocean due to the overestimation of dust emission in the Southern Hemisphere. DOD from MERRA-2 agrees well with CALIOP DOD in remote regions due to its higher mass fraction of fine dust and the assimilation of aerosol optical depth. The large disagreements in the dust extinction profiles and DOD among CALIOP, MODIS, and MISR retrievals make the model evaluation of dust spatial distributions challenging. Our study indicates the importance of representing dust emission, dry/wet deposition, and size distribution in GCMs in correctly simulating dust spatiotemporal distributions.

54 ENVIRONMENTAL SCIENCES↗

Enhance Low Level Temperature and Moisture Profiles Through Combining NUCAPS, ABI Observations, and RTMA Analysis

Thermodynamic information from low levels in the atmosphere is crucial for operational weather forecasts and meteorological researchers. The NOAA Unique Combined Atmospheric Processing System (NUCAPS) sounding products have been proven beneficial to fill the data gap between synoptic radiosonde observations (RAOBs). However, compared with the upper troposphere, the accuracy of NUCAPS soundings in the low levels still needs improvement. In this study, a deep neural network (DNN) is applied to fuse multiple data sources to enhance the NUCAPS temperature and moisture profiles in the lower atmosphere. The network is developed by combining satellite observations, including NUCAPS sounding retrievals and high resolution geostationary satellite observations from the Advanced Baseline Imager, and surface analysis from the Real-Time Mesoscale Analysis (RTMA) as inputs, while collocated soundings from ECMWF re-analysis version 5 are used as the benchmark for the training. The performance of the model is evaluated by using the independent testing data set, data from a different year, as well as collocated RAOBs, showing improvement to the temperature and moisture profiles by reducing the root-mean-squared-error (RMSE) by more than 30% in the lower atmosphere (from 700 hPa to surface) in both clear sky and partially cloudy conditions. A convective event from June 18, 2017 is presented to illustrate the application of the enhanced low level soundings on high impact weather events. The enhanced soundings from fused data capture the large surface-based convective available potential energy structures in the preconvection environment, which is very useful for severe storm nowcasting and forecasting applications.

54 ENVIRONMENTAL SCIENCES↗

Stochastic minibatch approach to the ptychographic iterative engine

The ptychographic iterative engine (PIE) is a widely used algorithm that enables phase retrieval at nanometer-scale resolution over a wide range of imaging experiment configurations. By analyzing diffraction intensities from multiple scanning locations where a probing wavefield interacts with a sample, the algorithm solves a difficult optimization problem with constraints derived from the experimental geometry as well as sample properties. The effectiveness at which this optimization problem is solved is highly dependent on the ordering in which we use the measured diffraction intensities in the algorithm, and random ordering is widely used due to the limited ability to escape from stagnation in poor-quality local solutions. In this study, we introduce an extension to the PIE algorithm that uses ideas popularized in recent machine learning training methods, in this case minibatch stochastic gradient descent. Our results demonstrate that these new techniques significantly improve the convergence properties of the PIE numerical optimization problem.

47 OTHER INSTRUMENTATION↗

Deep learning-based temporal deconvolution for photon time-of-flight distribution retrieval

The acquisition of the time of flight (ToF) of photons has found numerous applications in the biomedical field. Over the last decades, a few strategies have been proposed to deconvolve the temporal instrument response function (IRF) that distorts the experimental time-resolved data. However, these methods require burdensome computational strategies and regularization terms to mitigate noise contributions. Herein, we propose a deep learning model specifically to perform the deconvolution task in fluorescence lifetime imaging (FLI). The model is trained and validated with representative simulated FLI data with the goal of retrieving the true photon ToF distribution. Its performance and robustness are validated with well-controlled in vitro experiments using three time-resolved imaging modalities with markedly different temporal IRFs. The model aptitude is further established with in vivo preclinical investigation. Overall, these in vitro and in vivo validations demonstrate the flexibility and accuracy of deep learning model-based deconvolution in time-resolved FLI and diffuse optical imaging.

Pandey, Vikas (ORCID:0000000154771095)↗

Stratospheric temperature measurements from nanosatellite stellar occultation observations of refractive bending

Abstract. Stellar occultation observations from space can probe the stratosphere and mesosphere at a fine vertical scale around the globe. Unlike other measurement techniques like radiosondes and aircraft, stellar occultation has the potential to observe the atmosphere above 30 km, and unlike radio occultation, stellar occultation probes fine-scale phenomena with potential to observe atmospheric turbulence. We imaged the refractive bending angle of a star centroid for a series of occultations by the atmosphere. Atmospheric refractivity, density, and then temperature are retrieved from the bending observations with the Abel transformation and Edlén's law, the hydrostatic equation, and the ideal gas law. The retrieval technique is applied to data collected by two nanosatellites operated by Terran Orbital. Measurements were primarily taken by the GEOStare SV2 mission, with a dedicated imaging telescope, supplemented with images captured by spacecraft bus sensors, namely the star trackers on other Terran Orbital missions. The bending angle noise floor is 10 and 30 arcsec for the star tracker and GEOStare SV2 data, respectively. The most significant sources of uncertainty are due to centroiding errors due to the fairly low-resolution stellar images and telescope pointing knowledge derived from noisy satellite attitude sensors. The former mainly affects the star tracker data, while the latter limits the GEOStare SV2 accuracy, with both providing low vertical resolution. This translates to a temperature profile retrieval up to roughly 20 km for both star tracker and GEOStare SV2 datasets. In preparation of an upcoming 2023 mission designed to correct these deficiencies, SOHIP, we simulated bending angle measurements with varying magnitudes of error. The expected maximum altitude of retrieved temperature is 41 km on average for these simulated measurements with a noise floor of 0.39 arcsec. Our work highlights the capabilities of stellar occultation observations from nanosatellites for atmospheric sounding. Future work will investigate high-frequency observations of atmospheric gravity waves and turbulence, mitigating the major uncertainties observed in these datasets.

54 ENVIRONMENTAL SCIENCES↗

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗

Real-space imaging of periodic nanotextures in thin films via phasing of diffraction data

New properties and exotic quantum phenomena can form due to periodic nanotextures, including Moire patterns, ferroic domains, and topologically protected magnetization and polarization textures. Despite the availability of powerful tools to characterize the atomic crystal structure, the visualization of nanoscale strain-modulated structural motifs remains challenging. Here, we develop nondestructive real-space imaging of periodic lattice distortions in thin epitaxial films and report an emergent periodic nanotexture in a Mott insulator. Specifically, we combine iterative phase retrieval with unsupervised machine learning to invert the diffuse scattering pattern from conventional X-ray reciprocal-space maps into real-space images of crystalline displacements. Our imaging in PbTiO 3 /SrTiO 3 superlattices exhibiting checkerboard strain modulation substantiates published phase-field model calculations. Furthermore, the imaging of biaxially strained Mott insulator Ca 2 RuO 4 reveals a strain-induced nanotexture comprised of nanometer-thin metallic-structure wires separated by nanometer-thin Mott-insulating-structure walls, as confirmed by cryogenic scanning transmission electron microscopy (cryo-STEM). The nanotexture in Ca 2 RuO 4 film is induced by the metal-to-insulator transition and has not been reported in bulk crystals. We expect the phasing of diffuse X-ray scattering from thin crystalline films in combination with cryo-STEM to open a powerful avenue for discovering, visualizing, and quantifying the periodic strain-modulated structures in quantum materials.

Science & Technology - Other Topics↗

Beyond Contrast Transfer: Spectral SNR as a Finite-Dose Metric for STEM Phase Retrieval

The contrast transfer function (CTF) is widely used to evaluate phase retrieval methods in scanning transmission electron microscopy (STEM), including center-of-mass imaging, parallax imaging, direct ptychography, and iterative ptychography. However, the CTF reflects only the maximum usable signal, neglecting the effects of finite electron fluence and the Poisson-limited nature of detection. As a result, it can significantly overestimate practical performance, especially in low-dose regimes. Here, we employ the spectral signal-to-noise ratio (SSNR), as a finite-dose statistical framework to evaluate the recoverable signal as a function of spatial frequency. Using numerical reconstructions of white-noise objects, we show that center-of-mass, parallax, and direct ptychography exhibit dose-independent SSNRs, with close-form analytic expressions. In contrast, iterative ptychography exhibits a surprising dose dependence: at low fluence, its SSNR converges to that of direct ptychography; at high fluence, it saturates at a value consistent with the maximum detective quantum efficiency predicted by recent quantum Fisher information bounds. The results highlight the limitations of CTF-based evaluation and motivate SSNR as a more accurate, finite-dose metric for assessing STEM phase retrieval methods.

STEM phase retrieval↗

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they arc only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

47 OTHER INSTRUMENTATION↗

Recovered supernova Ia rate from simulated LSST images

Aims.TheVera C. RubinObservatory’s Legacy Survey of Space and Time (LSST) will revolutionize time-domain astronomy by detecting millions of different transients. In particular, it is expected to increase the number of known type Ia supernovae (SN Ia) by a factor of 100 compared to existing samples up to redshift ∼1.2. Such a high number of events will dramatically reduce statistical uncertainties in the analysis of the properties and rates of these objects. However, the impact of all other sources of uncertainty on the measurement of the SN Ia rate must still be evaluated. The comprehension and reduction of such uncertainties will be fundamental both for cosmology and stellar evolution studies, as measuring the SN Ia rate can put constraints on the evolutionary scenarios of different SN Ia progenitors. Methods.We used simulated data from the Dark Energy Science Collaboration (DESC) Data Challenge 2 (DC2) and LSST Data Preview 0 to measure the SN Ia rate on a 15 deg 2 region of the “wide-fast-deep” area. We selected a sample of SN candidates detected in difference images, associated them to the host galaxy with a specially developed algorithm, and retrieved their photometric redshifts. We then tested different light-curve classification methods, with and without redshift priors (albeit ignoring contamination from other transients, as DC2 contains only SN Ia). We discuss how the distribution in redshift measured for the SN candidates changes according to the selected host galaxy and redshift estimate. Results.We measured the SN Ia rate, analyzing the impact of uncertainties due to photometric redshift, host-galaxy association and classification on the distribution in redshift of the starting sample. We find that we are missing 17% of the SN Ia, on average, with respect to the simulated sample. As 10% of the mismatch is due to the uncertainty on the photometric redshift alone (which also affects classification when used as a prior), we conclude that this parameter is the major source of uncertainty. We discuss possible reduction of the errors in the measurement of the SN Ia rate, including synergies with other surveys, which may help us to use the rate to discriminate different progenitor models.

Astronomy & Astrophysics↗

Large Game Distribution Camera Study at Los Alamos National Laboratory [Poster]

The unique habitats at the Laboratory support a diverse community of wildlife. The habitat types that include Pinon Juniper, Ponderosa Pine, and Mixed-conifer forests each provide different resources important for a variety of species. Wildlife monitoring for large game animals can be challenging because they avoid interactions with humans, and prefer undeveloped areas. This study was conducted to analyze the distribution of predators and other game animals seasonally across the Laboratory. The data gathered will be used to make recommendations regarding wildlife management for conservation and protection. Utilizing game cameras to remotely monitor wildlife was determined to be the most effective, noninvasive method to gather the necessary data. As camera technology has advanced, game cameras have become adequate for documenting individuals, and are commonly used in wildlife studies on predation, abundance, occupancy, diversity, and endangered species detection. Twenty cameras were placed across the LANL landscape using a modified systematic sampling design. They were deployed in February 2018 and retrieved in January 2019, thus each camera sampled for one full year. All images were reviewed and the species, number, age, and sex of all animals in the photo were recorded. Here we present data for the most abundant species encountered: deer, elk, coyote, bear, bobcat, mountain lion, and fox respectively. The data were summarized by species and season. Future work will include occupancy modelling for each species. This will allow the development of heat maps showing species distributions across the Laboratory.

54 ENVIRONMENTAL SCIENCES↗

Large Game Distribution Camera Study at Los Alamos National Laboratory

The unique habitats at the Laboratory support a diverse community of wildlife. The habitat types that include Pinon Juniper, Ponderosa Pine, and Mixed-conifer forests each provide different resources important for a variety of species. Wildlife monitoring for large game animals can be challenging because they avoid interactions with humans, and prefer undeveloped areas. This study was conducted to analyze the distribution of predators and other game animals seasonally across the Laboratory. This research informs decisions regarding wildlife management recommendations for conservation and protection. This study utilized game cameras to remotely monitor wildlife. As camera technology has advanced, game cameras have become adequate for documenting individuals, and are commonly used in wildlife studies on predation, abundance, occupancy, diversity, and endangered species detection. Twenty cameras were placed across the LANL landscape using a modified systematic sampling design. They were deployed in February 2018 and retrieved in January 2019, thus each camera sampled for one full year. All images were reviewed and the species, number, age, and sex of all animals in the photo were recorded. Here we present data for the most abundant species encountered: deer, elk, coyote, bear, bobcat, mountain lion, and fox respectively. The data were summarized by species and season. Future work will include occupancy modelling for each species. This will allow the development of heat maps showing species distributions across the Laboratory.

59 BASIC BIOLOGICAL SCIENCES↗