Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Fluid Structure Interaction of Parachutes in Supersonic Planetary Entry

A research program to provide physical insight into disk-gap-band parachute operation in the supersonic regime on Mars was conducted. The program included supersonic wind tunnel tests, computational fluid dynamics and fluid structure interaction simulations. Specifically, the nature and cause of the "area oscillation" phenomenon were investigated to determine the scale, aerodynamic, and aero-elastic dependence of the supersonic parachute collapse and re-inflation event. A variety of non-intrusive, temporally resolved, and high resolution diagnostic techniques were used to interrogate the flow and generate validation datasets. The results of flow visualization, particle image velocimetry, load measurements, and photogrammetric reconstruction will be presented. Implications to parachute design, use, and verification will also be discussed.

parachute↗

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Atmospheric 3D winds in the horizontal and vertical directions are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we use a state-of-the-art convolutional neural network for optical flow (FlowNetS) in a physics-guided deep learning framework for predicting AMVs in the horizontal direction. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations (DYAMOND) for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

geostationary↗

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Observations of atmospheric 3D winds are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we compare state-of-the-art convolutional neural networks for optical flow in a physics-guided deep learning framework for predicting AMVs. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

Geostationary↗

Sub-pixel high-resolution imaging of high-energy x-rays inspired by sub-wavelength optical imaging

We have developed and demonstrated an image super-resolution method—XR-UNLOC: X-Ray UNsupervised particle LOCalization—for hard x-rays measured with fast-frame-rate detectors that is an adaptation of the principle of photo-activated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), which enabled biological fluorescence imaging at sub-optical-wavelength scales. We demonstrate the approach on experimental coherent Bragg diffraction data measured with 52 keV x-rays from a nanocrystalline sample. From this sample, we resolve the fine fringe detail of a high-energy x-ray Bragg coherent diffraction pattern to an upsampling factor of 16 of the native pixel pitch of 30 μ m of a charge-integrating fastCCD detector. This was accomplished by analysis of individual photon locations in a series of “nearly-dark” instances of the diffraction pattern that each contain only a handful of photons. Central to our approach was the adaptation of the UNLOC photon fitting routine for PALM/STORM to the hard x-ray regime to handle much smaller point spread functions, which required a different statistical test for photon detection and for sub-pixel localization. A comparison to a photon-localization strategy used in the x-ray community (“droplet analysis”) showed that XR-UNLOC provides significant improvement in super-resolution. We also developed a metric by which to estimate the limit of reliable upsampling with XR-UNLOC under a given set of experimental conditions in terms of the signal-to-noise ratio of a photon detection event and the size of the point spread function for guiding future x-ray experiments in many disciplines where detector pixelation limits must be overcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Dramatic Improvements to Feature Based Stereo

The camera registration extracted from feature based stereo is usually considered sufficient to accurately localize the 3D points. However, for natural scenes the feature localization is not as precise as in man-made environments. This results in small camera registration errors. We show that even very small registration errors result in large errors in dense surface reconstruction. We describe a method for registering entire images to the inaccurate surface model. This gives small, but crucially important improvements to the camera parameters. The new registration gives dramatically better dense surface reconstruction.

Smelyansky, V. N.↗

The Nagoya cosmic-ray muon spectrometer 3, part 4: Track reconstruction method

One of the greatest problems in measuring particle trajectories with an optical or visual detector system, is the reconstruction of trajectories in real space from their recorded images. In the Nagoya cosmic-ray muon spectrometer, muon tracks are detected by wide gap spark chambers and their images are recorded on the photographic film through an optical system of 10 mirrors and two cameras. For the spatial reconstruction, 42 parameters of the optical system should be known to determine the configuration of this system. It is almost impossible to measure this many parameters directly with usual techniques. In order to solve this problem, the inverse transformation method was applied. In this method, all the optical parameters are determined from the locations of fiducial marks in real space and the locations of their images on the photographic film by the non-linear least square fitting.

Shibata, S.↗

Efficient reconstruction and validation of heterogeneous microstructures for energy applications

The digital reconstruction of microstructures is necessary for simulations in fields ranging from geology to electrochemistry, but the state-of-the-art digital reconstruction techniques often compromise between resolution and field of view. It is challenging to retain detailed microstructure information in large-scale reconstructions. Here, this study investigates different aspects of the Yeong-Torquato algorithm based on correlation functions to make it more efficient. We achieve this goal by reducing the computational complexity of the chord-length distribution function and the two-point correlation function, applying the random sphere-packing method as the initial condition, and restricting potential voxel swaps to interfaces. In addition, a novel superposition parallel scheme is introduced to aid in searching for potential voxel swaps. The algorithm proposed is validated by comparing the pore-size distributions of reconstructed 3D custom battery electrodes from a sample dataset obtained from transmission X-ray microscopy. From a sample image with 200 x 200 pixels, the code can reconstruct a 300 x 300 x 300 structure in under 22 h and reconstruct a 400 x 400 x 400 structure in 43 h with eight cores.

42 ENGINEERING↗

Evidence for large baryonic feedback at low and intermediate redshifts from kinematic Sunyaev-Zel’dovich observations with ACT and DESI photometric galaxies

Recent advances in cosmological observations have provided an unprecedented opportunity to investigate the distribution of baryons relative to the underlying matter. In this work, we show that the gas is more extended than the dark matter, and the amount of baryonic feedback at $z \lesssim 1$ disfavors low-feedback models such as that of state-of-the-art hydrodynamical simulation IllustrisTNG compared with high-feedback models such as that of the original Illustris simulation. This has important implications for bridging the gap between theory and observations and understanding galaxy formation and evolution. Furthermore, a better grasp of the baryon-dark matter link is critical to future cosmological analyses, which are currently impeded by our limited knowledge of baryonic feedback. Here, we measure the kinematic Sunyaev-Zel'dovich (kSZ) effect from the Atacama Cosmology Telescope (ACT), stacked on the luminous red galaxy (LRG) sample of the Dark Energy Spectroscopic Instrument (DESI) imaging survey. This is the first analysis to use photometric redshifts for reconstructing galaxy velocities. Due to the large number of galaxies comprising the DESI imaging survey, this is the highest signal-to-noise stacked kSZ measurement to date: we detect the signal at 13$σ$, finding strong evidence that the gas is more spread out than the dark matter, as well as a preference for larger feedback compared to some commonly used state-of-the-art hydrodynamical simulations. Here, our work opens up the possibility of recalibrating large hydrodynamical simulations using the kSZ effect. In addition, our findings highlight the importance of properly accounting for baryonic feedback with future surveys such as LSST through direct probes such as the kSZ, and shed light on long-standing enigmas in astrophysics, such as the “missing baryon” problem.

79 ASTRONOMY AND ASTROPHYSICS↗

Venus in 3D

Stereographic images of the surface of Venus which enable geologists to reconstruct the details of the planet's evolution are discussed. The 120-meter resolution of these 3D images make it possible to construct digital topographic maps from which precise measurements can be made of the heights, depths, slopes, and volumes of geologic structures.

Plaut, Jeffrey J.↗

Image analysis techniques associated with automatic data base generation.

This paper considers some basic problems relating to automatic data base generation from imagery, the primary emphasis being on fast and efficient automatic extraction of relevant pictorial information. Among the techniques discussed are recursive implementations of some particular types of filters which are much faster than FFT implementations, a 'sequential similarity detection' technique of implementing matched filters, and sequential linear classification of multispectral imagery. Several applications of the above techniques are presented including enhancement of underwater, aerial and radiographic imagery, detection and reconstruction of particular types of features in images, automatic picture registration and classification of multiband aerial photographs to generate thematic land use maps.

Bond, A. D.↗

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deep learning enables nanoscale X-ray 3D imaging with limited data

Deep neural network can greatly improve tomography reconstruction with limited data. A recent effort of combining ptycho-tomography model with the 3D U-net demonstrated a significant reduction in both the number of projections and computation time, and showed its potential for integrated circuit imaging that requires high-resolution and fast measurement speed.

47 OTHER INSTRUMENTATION↗

Atomic-scale cryogenic electron microscopy imaging of self-assembled peptoid nanostructures

Amphiphilic polypeptoids with defined sequences, versatile in forming various nanostructures, are ideal for mimicking biomacromolecular structures. The predictive design of nanostructures depends on our understanding of the relationship between molecular structure and the locations of atoms in the nanostructure. Factors of importance include chain conformation, crystal motifs, and the arrangement of the molecules within the nanostructure. Here, this review introduces the cryogenic transmission electron microscopy (cryo-TEM) method, sorting and averaging unit cells in nanosheets for resolution enhancement and identifying structural heterogeneity. The resulting atomic-scale images reveal the presence of two types of crystal motifs. The impact of processing conditions, capping group chemistry, and side chain chemistry on structural heterogeneity and crystal motifs can be quantified. The 3D reconstruction of nanosheets, wherein atomic-scale corrugations were revealed, is introduced in this review. New developments in cryo-TEM, such as phase retrieval reconstruction, hold great promise for atomic-scale imaging of soft nanostructures.

36 MATERIALS SCIENCE↗

Equalizing the Pixel Response of the Imaging Photoelectric Polarimeter Onboard the IXPE Mission

The Gas Pixel Detector is a gas detector, sensitive to the polarization of X-rays, currently flying onboard the Imaging X-ray Polarimetry Explorer (IXPE)—the first observatory dedicated to X-ray polarimetry. It detects X-rays and their polarization by imaging the ionization tracks generated by photoelectrons absorbed in the sensitive volume, and then reconstructing the initial direction of the photoelectrons. The primary ionization charge is multiplied and ultimately collected on a finely pixellated ASIC specifically developed for X-ray polarimetry. The signal of individual pixels is processed independently and gain variations can be substantial, of the order of 20%. Such variations need to be equalized to correctly reconstruct the track shape, and therefore its polarization direction. The method to do such equalization is presented here and is based on the comparison between the mean charge of a pixel with respect to the other pixels for equivalent events. The method is shown to finely equalize the response of the detectors onboard IXPE, allowing a better track reconstruction and energy resolution, and can in principle be applied to any imaging detector based on tracks.

79 ASTRONOMY AND ASTROPHYSICS↗

An Interdisciplinary Method for the Visualization of Novel High-Resolution Precision Photography and Micro-XCT Data Sets of NASA's Apollo Lunar Samples and Antarctic Meteorite Samples to Create Combined Research-Grade 3D Virtual Samples for the Benefit of Astromaterials Collections Conservation, Curation, Scientific Research and Education

New technologies make possible the advancement of documentation and visualization practices that can enhance conservation and curation protocols for NASA's Astromaterials Collections. With increasing demands for accessibility to updated comprehensive data, and with new sample return missions on the horizon, it is of primary importance to develop new standards for contemporary documentation and visualization methodologies. Our interdisciplinary team has expertise in the fields of heritage conservation practices, professional photography, photogrammetry, imaging science, application engineering, data curation, geoscience, and astromaterials curation. Our objective is to create virtual 3D reconstructions of Apollo Lunar and Antarctic Meteorite samples that are a fusion of two state-of-the-art data sets: the interior view of the sample by collecting Micro-XCT data and the exterior view of the sample by collecting high-resolution precision photography data. These new data provide researchers an information-rich visualization of both compositional and textural information prior to any physical sub-sampling. Since January 2013 we have developed a process that resulted in the successful creation of the first image-based 3D reconstruction of an Apollo Lunar Sample correlated to a 3D reconstruction of the same sample's Micro- XCT data, illustrating that this technique is both operationally possible and functionally beneficial. In May of 2016 we began a 3-year research period during which we aim to produce Virtual Astromaterials Samples for 60 high-priority Apollo Lunar and Antarctic Meteorite samples and serve them on NASA's Astromaterials Acquisition and Curation website. Our research demonstrates that research-grade Virtual Astromaterials Samples are beneficial in preserving for posterity a precise 3D reconstruction of the sample prior to sub-sampling, which greatly improves documentation practices, provides unique and novel visualization of the sample's interior and exterior features, offers scientists a preliminary research tool for targeted sub-sample requests, and additionally is a visually engaging interactive tool for bringing astromaterials science to the public.

Blumenfeld, E. H.↗

Holographic Optical Data Storage

Although the basic idea may be traced back to the earlier X-ray diffraction studies of Sir W. L. Bragg, the holographic method as we know it was invented by D. Gabor in 1948 as a two-step lensless imaging technique to enhance the resolution of electron microscopy, for which he received the 1971 Nobel Prize in physics. The distinctive feature of holography is the recording of the object phase variations that carry the depth information, which is lost in conventional photography where only the intensity (= squared amplitude) distribution of an object is captured. Since all photosensitive media necessarily respond to the intensity incident upon them, an ingenious way had to be found to convert object phase into intensity variations, and Gabor achieved this by introducing a coherent reference wave along with the object wave during exposure. Gabor's in-line recording scheme, however, required the object in question to be largely transmissive, and could provide only marginal image quality due to unwanted terms simultaneously reconstructed along with the desired wavefront. Further handicapped by the lack of a strong coherent light source, optical holography thus seemed fated to remain just another scientific curiosity, until the field was revolutionized in the early 1960s by some major breakthroughs: the proposition and demonstration of the laser principle, the introduction of off-axis holography, and the invention of volume holography. Consequently, the remainder of that decade saw an exponential growth in research on theory, practice, and applications of holography. Today, holography not only boasts a wide variety of scientific and technical applications (e.g., holographic interferometry for strain, vibration, and flow analysis, microscopy and high-resolution imagery, imaging through distorting media, optical interconnects, holographic optical elements, optical neural networks, three-dimensional displays, data storage, etc.), but has become a prominent am advertising, and security medium as well. The evolution of holographic optical memories has followed a path not altogether different from holography itself, with several cycles of alternating interest over the past four decades. P. J. van Heerden is widely credited for being the first to elucidate the principles behind holographic data storage in a 1963 paper, predicting bit storage densities on the order of 1/lambda(sup 3) with source wavelength lambda - a fantastic capacity of nearly 1 TB/cu cm for visible light! The science and engineering of such a storage paradigm was heavily pursued thereafter, resulting in many novel hologram multiplexing techniques for dense data storage, as well as important advances in holographic recording materials. Ultimately, however, the lack of such enabling technologies as compact laser sources and high performance optical data I/O devices dampened the hopes for the development of a commercial product. After a period of relative dormancy, successful applications of holography in other arenas sparked a renewed interest in holographic data storage in the late 1980s and the early 1990s. Currently, with most of the critical optoelectronic device technologies in place and the quest for an ideal holographic recording medium intensified, holography is once again considered as one of several future data storage paradigms that may answer our constantly growing need for higher-capacity and faster-access memories.

Timucin, Dogan A.↗

Augmented signal processing in Liquid Argon Time Projection Chambers with a deep neural network

The Liquid Argon Time Projection Chamber (LArTPC) is an advanced neutrino detector technology widely used in recent and upcoming accelerator neutrino experiments. It features a low energy threshold and high spatial resolution that allow for comprehensive reconstruction of event topologies. In current-generation LArTPCs, the recorded data consist of digitized waveforms on wires produced by induced signal on wires of drifting ionization electrons, which can also be viewed as two-dimensional (2D) (time versus wire) projection images of charged-particle trajectories. For such an imaging detector, one critical step is the signal processing that reconstructs the original charge projections from the recorded 2D images. For the first time, we introduce a deep neural network in LArTPC signal processing to improve the signal region of interest detection. By combining domain knowledge (e.g., matching information from multiple wire planes) and deep learning, this method shows significant improvements over traditional methods. This work details the method, software tools, and performance evaluated with realistic detector simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Two-Dimensional Synthetic-Aperture Radiometer

A two-dimensional synthetic-aperture radiometer, now undergoing development, serves as a test bed for demonstrating the potential of aperture synthesis for remote sensing of the Earth, particularly for measuring spatial distributions of soil moisture and ocean-surface salinity. The goal is to use the technology for remote sensing aboard a spacecraft in orbit, but the basic principles of design and operation are applicable to remote sensing from aboard an aircraft, and the prototype of the system under development is designed for operation aboard an aircraft. In aperture synthesis, one utilizes several small antennas in combination with a signal processing in order to obtain resolution that otherwise would require the use of an antenna with a larger aperture (and, hence, potentially more difficult to deploy in space). The principle upon which this system is based is similar to that of Earth-rotation aperture synthesis employed in radio astronomy. In this technology the coherent products (correlations) of signals from pairs of antennas are obtained at different antenna-pair spacings (baselines). The correlation for each baseline yields a sample point in a Fourier transform of the brightness-temperature map of the scene. An image of the scene itself is then reconstructed by inverting the sampled transform. The predecessor of the present two-dimensional synthetic-aperture radiometer is a one-dimensional one, named the Electrically Scanned Thinned Array Radiometer (ESTAR). Operating in the L band, the ESTAR employs aperture synthesis in the cross-track dimension only, while using a conventional antenna for resolution in the along-track dimension. The two-dimensional instrument also operates in the L band to be precise, at a frequency of 1.413 GHz in the frequency band restricted for passive use (no transmission) only. The L band was chosen because (1) the L band represents the long-wavelength end of the remote- sensing spectrum, where the problem of achieving adequate spatial resolution is most critical and (2) imaging airborne instruments that operate in this wavelength range and have adequate spatial resolution are difficult to build and will be needed in future experiments to validate approaches for remote sensing of soil moisture and ocean salinity. The two-dimensional instrument includes a rectangular array of patch antennas arranged in the form of a cross. The ESTAR uses analog correlation for one dimension, whereas the two-dimensional instrument uses digital correlation. In two dimensions, many more correlation pairs are needed and low-power digital correlators suitable for application in spaceborne remote sensing will help enable this technology. The two-dimensional instrument is dual-polarized and, with modification, capable of operating in a polarimetric mode. A flight test of the instrument took place in June 2003 and it participated in soil moisture experiments during the summers of 2003 and 2004.

LeVine, David M.↗