Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Ultra-Structural Imaging Provides 3D Organization of 46 Chromosomes of a Human Lymphocyte Prophase Nucleus

Three dimensional (3D) ultra-structural imaging is an important tool for unraveling the organizational structure of individual chromosomes at various stages of the cell cycle. Performing hitherto uninvestigated ultra-structural analysis of the human genome at prophase, we used serial block-face scanning electron microscopy (SBFSEM) to understand chromosomal architectural organization within 3D nuclear space. Acquired images allowed us to segment, reconstruct, and extract quantitative 3D structural information about the prophase nucleus and the preserved, intact individual chromosomes within it. Our data demonstrate that each chromosome can be identified with its homolog and classified into respective cytogenetic groups. Thereby, we present the first 3D karyotype built from the compact axial structure seen on the core of all prophase chromosomes. The chromosomes display parallel-aligned sister chromatids with familiar chromosome morphologies with no crossovers. Furthermore, the spatial positions of all 46 chromosomes revealed a pattern showing a gene density-based correlation and a neighborhood map of individual chromosomes based on their relative spatial positioning. A comprehensive picture of 3D chromosomal organization at the nanometer level in a single human lymphocyte cell is presented.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Sensor fusion V; Proceedings of the Meeting, Boston, MA, Nov. 15-17, 1992

Topics addressed include 3D object perception, human-machine interface in multisensor systems, sensor fusion architecture, fusion of multiple and distributed sensors, interface and decision models for sensor fusion, computational networks, simple sensing for complex action, multisensor-based control, and metrology and calibration of multisensor systems. Particular attention is given to controlling 3D objects by sketching 2D views, the graphical simulation and animation environment for flexible structure robots, designing robotic systems from sensorimotor modules, cylindrical object reconstruction from a sequence of images, an accurate estimation of surface properties by integrating information using Bayesian networks, an adaptive fusion model for a distributed detection system, multiple concurrent object descriptions in support of autonomous navigation, robot control with multiple sensors and heuristic knowledge, and optical array detectors for image sensors calibration. (No individual items are abstracted in this volume)

Schenker, Paul S.↗

The three-dimensional structure of the solar corona

Due to the rotation of the sun the solar corona can be observed under different directions at different times. Using methods of computer tomography the three-dimensional structure of the emissivity of the solar corona can be reconstructed. We discuss the feasibility of this method for stationary and for non-stationary corona and also for incomplete and finite resolution data. As example we present reconstructions based on YOHKOH-images, and we compare the results with ground-based optical corona observations. Structures are interpreted in terms of the solar magnetic field topology.

Zidowitz, S.↗

Computational optical physical unclonable function

A system or method for encryption of data includes a light source, a random optical element and a light detection element. The light source is arranged to transmit an input data signal to the random optical element. The light source is incident on the random optical element such that the input data signal is randomly scattered by the random optical element to generate an image at on the detector disposed at an output of the random optical element. The image received by the detector is applied to a compressive sensing algorithm to generate a transfer function. The transfer function defines a relationship between the input data signal and the image to enable estimation and reconstruction of the input data signal.

Birch, Gabriel Carlisle↗

Average Cross-Sectional Area of DebriSat Fragments Using Volumetrically Constructed 3D Representations

Debris fragments from the hypervelocity impact testing of DebriSat are being collected and characterized for use in updating existing satellite breakup models. One of the key parameters utilized in these models is the ballistic coefficient of the fragment which is directly related to its area‐to‐mass ratio. However, since the attitude of fragments varies during their orbital lifetime, it is customary to use the average cross‐sectional area in the calculation of the area‐to‐mass ratio. The average cross‐sectional area is defined as the average of the projected surface areas perpendicular to the direction of motion and has been shown to be equal to one‐fourth of the total surface area of a convex object. Unfortunately, numerous fragments obtained from the DebriSat experiment show significant concavity (i.e., shadowing) and thus we have explored alternate methods for computing the average cross‐sectional area of the fragments. An imaging system based on the volumetric reconstruction of a 3D object from multiple 2D photographs of the object was developed for use in determining the size characteristic (i.e., characteristics length) of the DebriSat fragments. For each fragment, the imaging system generates N number of images from varied azimuth and elevation angles and processes them using a space‐carving algorithm to construct a 3D point cloud of the fragment. This paper describes two approaches for calculating the average cross‐sectional area of debris fragments based on the 3D imager. Approach A utilizes the constructed 3D object to generate equally distributed cross‐sectional area projections and then averages them to determine the average cross‐sectional area. Approach B utilizes a weighted average of the area of the 2D photographs to directly compute the average cross‐sectional area. A comparison of the accuracy and computational needs of each approach is described as well as preliminary results of an analysis to determine the "optimal" number of images needed for the 3D imager to accurately measure the average cross sectional area of objects with known dimensions.

Scruggs, T.↗

Trigger and Reconstruction Algorithms for the Japanese Experiment Module- Extreme Universe Space Observatory (JEM-EUSO)

The JEM-EUSO collaboration intends to study high energy cosmic ray showers using a large downward looking telescope mounted on the Japanese Experiment Module of the International Space Station. The telescope focal plane is instrumented with approx.300k pixels operating as a digital camera, taking snapshots at approx. 1MHz rate. We report an investigation of the trigger and reconstruction efficiency of various algorithms based on time and spatial analysis of the pixel images. Our goal is to develop trigger and reconstruction algorithms that will allow the instrument to detect energies low enough to connect smoothly to ground-based observations.

Adams, J. H., Jr.↗

Source shape estimation for neutron imaging systems using convolutional neural networks

Neutron imaging systems are important diagnostic tools for characterizing the physics of inertial confinement fusion reactions at the National Ignition Facility (NIF). In particular, neutron images give diagnostic information on the size, symmetry, and shape of the fusion hot spot and surrounding cold fuel. Images are formed via collection of neutron flux from the source using a system of aperture arrays and scintillator-based detectors. Currently, reconstruction of fusion source geometry from the collected neutron images is accomplished by solving a computationally intensive maximum likelihood estimation problem via expectation maximization. In contrast, it is often useful to have simple representations of the overall source geometry that can be computed quickly. In this work, we develop convolutional neural networks (CNNs) to reconstruct the outer contours of simple source geometries. We compare the performance of the CNN for penumbral and pinhole data and provide experimental demonstrations of our methods on both non-noisy and noisy data.

Machine learning, neutron imaging, source reconstr↗

Towards Full Field-of-View Fourier Ptychography for Extreme Ultraviolet Microscope

We evaluate various Fourier ptychographic microscopy (FPM) reconstruction algorithms using both simulated and experimental data acquired from an Extreme Ultraviolet (EUV, 13.5 nm wavelength) microscope. We specifically focus on the algorithms' ability to robustly address field-dependent aberrations, which enables increased spatial resolution and quantitative phase imaging across an expanded field of view. We systematically compare the algorithms' performance under aberrations for a single zoneplate imaging system, utilizing Fourier Ring Correlation (FRC) as a systematic metric for assessing reconstruction quality. Furthermore, we explore the impact of systematic errors on the reconstruction of experimental data, aiming to increase the effective field of view by 25-fold, from the nominal 5x5 um2 diffraction-limited area. Additionally, our evaluation incorporates innovative FPM-adjacent methodologies, including the Angular Ptychographic Imaging with Closed-form method (APIC), for reconstructing EUV images.

Gu, Chaoying↗

High compression image and image sequence coding

The digital representation of an image requires a very large number of bits. This number is even larger for an image sequence. The goal of image coding is to reduce this number, as much as possible, and reconstruct a faithful duplicate of the original picture or image sequence. Early efforts in image coding, solely guided by information theory, led to a plethora of methods. The compression ratio reached a plateau around 10:1 a couple of years ago. Recent progress in the study of the brain mechanism of vision and scene analysis has opened new vistas in picture coding. Directional sensitivity of the neurones in the visual pathway combined with the separate processing of contours and textures has led to a new class of coding methods capable of achieving compression ratios as high as 100:1 for images and around 300:1 for image sequences. Recent progress on some of the main avenues of object-based methods is presented. These second generation techniques make use of contour-texture modeling, new results in neurophysiology and psychophysics and scene analysis.

Kunt, Murat↗

Reconstructing the exit wave of 2D materials in high-resolution transmission electron microscopy using machine learning

Reconstruction of the exit wave function is an important route to interpreting high-resolution transmission electron microscopy (HRTEM) images. Here we demonstrate that convolutional neural networks can be used to reconstruct the exit wave from a short focal series of HRTEM images, with a fidelity comparable to conventional exit wave reconstruction. We use a fully convolutional neural network based on the U-Net architecture, and demonstrate that we can train it on simulated exit waves and simulated HRTEM images of graphene-supported molybdenum disulphide (an industrial desulfurization catalyst). We then apply the trained network to analyse experimentally obtained images from similar samples, and obtain exit waves that clearly show the atomically resolved structure of both the MoS 2 nanoparticles and the graphene support. We also show that it is possible to successfully train the neural networks to reconstruct exit waves for 3400 different two-dimensional materials taken from the Computational 2D Materials Database of known and proposed two-dimensional materials.

2D materials↗

Imaging mechanism for hyperspectral scanning probe microscopy via Gaussian process modelling

We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We further show that BE data set tends to be oversampled in the spatial domains, with ~30% of original data set sufficient for high-quality reconstruction, potentially enabling faster BE imaging. At the same time, reliable reconstruction along the frequency domain requires the resonance peak to be within the measured band. This behavior suggests the optimal strategy for the BE imaging on unknown samples. Finally, we discuss how GP can be used for automated experimentation in SPM, by combining GP regression with non-rectangular scans.

47 OTHER INSTRUMENTATION↗

OASIS: Offsetting Active Reconstruction Attacks in Federated Learning

Federated Learning (FL) has garnered significant attention for its potential to protect user privacy while enhancing model training efficiency. For that reason, FL has found its use in various domains, from health care to industrial engineering, especially where data cannot be easily exchanged due to sensitive information or privacy laws. However, recent research has demonstrated that FL protocols can be easily compromised by active reconstruction attacks executed by dishonest servers. These attacks involve the malicious modification of global model parameters, allowing the server to obtain a verbatim copy of users' private data by inverting their gradient updates. Tackling this class of attack remains a crucial challenge due to the strong threat model. In this paper, we propose a defense mechanism, namely OASIS, based on image augmentation that effectively counteracts active reconstruction attacks while preserving model performance. We first uncover the core principle of gradient inversion that enables these attacks and theoretically identify the main conditions by which the defense can be robust regardless of the attack strategies. We then construct our defense with image augmentation showing that it can undermine the attack principle. Comprehensive evaluations demonstrate the efficacy of the defense mechanism highlighting its feasibility as a solution.

deep neural networks↗

Stereo Cameras for Clouds (STEREOCAM) Instrument Handbook

The three pairs of stereo camera setups aim to provide synchronized and stereo calibrated time series of images that can be used for 3D cloud mask reconstruction. Each camera pair is positioned at approximately 120 degrees from the other pair, with a 17o-19o pitch angle from the ground, and at 5-6 km distance from the U.S. Department of Energy (DOE) Central Facility at the Atmospheric Radiation Measurement (ARM) Climate Research Facility Southern Great Plains (SGP) observatory to cover the region from northeast, northwest, and southern views. Images from both cameras of the same stereo setup can be paired together to obtain 3D reconstruction by triangulation. 3D reconstructions from the ring of three stereo pairs can be combined together to generate a 3D mask from surrounding views. This handbook delivers all stereo reconstruction parameters of the cameras necessary to make 3D reconstructions from the stereo camera images.

47 OTHER INSTRUMENTATION↗

Path-Based Dictionary Augmentation: A Framework for Improving $k$ -Sparse Image Processing

In this study, we have previously shown that augmenting orthogonal matching pursuit (OMP) with an additional step in the identification stage of each pursuit iteration yields improved $k$ -sparse reconstruction and denoising performance relative to baseline OMP. At each iteration a “path” or geodesic, is generated between the two dictionary atoms that are most correlated with the residual and from this path a new atom that has a greater correlation to the residual than either of the two bracketing atoms is selected. Here, we provide new computational results illustrating improvements in sparse coding and denoising on canonical datasets using both learned and structured dictionaries. The two methods of constructing a path are investigated for each dictionary type: the Euclidean geodesic formed by a linear combination of the two atoms and the 2-Wasserstein geodesic corresponding to the optimal transport map between the atoms. We prove here the existence of a higher-correlation atom in the Euclidean case under assumptions on the two bracketing atoms and introduce algorithmic modifications to improve the likelihood that the bracketing atoms meet those conditions. Although, we demonstrate our augmentation on OMP alone, in general it may be applied to any reconstruction algorithm that relies on the selection and sorting of high-similarity atoms during an analysis or identification phase.

97 MATHEMATICS AND COMPUTING↗

Experimental observations of detached bow shock formation in the interaction of a laser-produced plasma with a magnetized obstacle

The magnetic field produced by planets with active dynamos, like the Earth, can exert sufficient pressure to oppose supersonic stellar wind plasmas, leading to the formation of a standing bow shock upstream of the magnetopause, or pressure-balance surface. Scaled laboratory experiments studying the interaction of an inflowing solar wind analog with a strong, external magnetic field are a promising new way to study magnetospheric physics and to complement existing models, although reaching regimes favorable for magnetized shock formation is experimentally challenging. This paper presents experimental evidence of the formation of a magnetized bow shock in the interaction of a supersonic, super-Alfvenic plasma with a strongly magnetized obstacle at the OMEGA laser facility. The solar wind analog is generated by the collision and subsequent expansion of two counterpropagating, laser-driven plasma plumes. The magnetized obstacle is a thin wire, driven with strong electrical currents. Hydrodynamic simulations using the FLASH code predict that the colliding plasma source meets the criteria for bow shock formation. Spatially resolved, optical Thomson scattering measures the electron number density, and optical emission lines provide a measurement of the plasma temperature, from which we infer the presence of a fast magnetosonic shock far upstream of the obstacle. Proton images provide a measure of large-scale features in the magnetic field topology, and reconstructed path-integrated magnetic field maps from these images suggest the formation of a bow shock upstream of the wire and as a transient magnetopause. Finally, we compare features in the reconstructed fields to two-dimensional MHD simulations of the system.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Hierarchical image coding with diamond-shaped sub-bands

We present a sub-band image coding/decoding system using a diamond-shaped pyramid frequency decomposition to more closely match visual sensitivities than conventional rectangular bands. Filter banks are composed of simple, low order IIR components. The coder is especially designed to function in a multiple resolution reconstruction setting, in situations such as variable capacity channels or receivers, where images must be reconstructed without the entire pyramid of sub-bands. We use a nonlinear interpolation technique for lost subbands to compensate for loss of aliasing cancellation.

Li, Xiaohui↗

Deep learning enhanced super-resolution x-ray fluorescence microscopy by a dual-branch network

X-ray fluorescence (XRF) microscopy is a powerful technique for quantifying the distribution of elements in complex materials, which makes it a crucial imaging technique across a wide range of disciplines in physical and biological sciences, including chemistry, materials science, microbiology, and geosciences. However, as a scanning microscopy technique, the spatial resolution of XRF imaging is inherently constrained by the x-ray probe profile and scanning step size. Here we propose a dual-branch machine learning (ML) model, which can extract scale-variant features and bypass abundant low-frequency information separately, to enhance the spatial resolution of the XRF images by mitigating the effects of blurring from the probe profile. The model is trained by simulated natural images, and a two-stage training strategy is used to overcome the domain gap between the natural images and experimental data. The tomography reconstruction from enhanced XRF projections shows an improvement in resolution by a scale factor of four and reveals distinct internal features invisible in low-resolution XRF within a battery sample. This study offers a promising approach for obtaining high-resolution XRF imaging from its low-resolution version, paving the way for future investigations in a broader range of disciplines and materials.

36 MATERIALS SCIENCE↗