Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

ICER-3D Hyperspectral Image Compression Software

Software has been developed to implement the ICER-3D algorithm. ICER-3D effects progressive, three-dimensional (3D), wavelet-based compression of hyperspectral images. If a compressed data stream is truncated, the progressive nature of the algorithm enables reconstruction of hyperspectral data at fidelity commensurate with the given data volume. The ICER-3D software is capable of providing either lossless or lossy compression, and incorporates an error-containment scheme to limit the effects of data loss during transmission. The compression algorithm, which was derived from the ICER image compression algorithm, includes wavelet-transform, context-modeling, and entropy coding subalgorithms. The 3D wavelet decomposition structure used by ICER-3D exploits correlations in all three dimensions of sets of hyperspectral image data, while facilitating elimination of spectral ringing artifacts, using a technique summarized in "Improving 3D Wavelet-Based Compression of Spectral Images" (NPO-41381), NASA Tech Briefs, Vol. 33, No. 3 (March 2009), page 7a. Correlation is further exploited by a context-modeling subalgorithm, which exploits spectral dependencies in the wavelet-transformed hyperspectral data, using an algorithm that is summarized in "Context Modeler for Wavelet Compression of Hyperspectral Images" (NPO-43239), which follows this article. An important feature of ICER-3D is a scheme for limiting the adverse effects of loss of data during transmission. In this scheme, as in the similar scheme used by ICER, the spatial-frequency domain is partitioned into rectangular error-containment regions. In ICER-3D, the partitions extend through all the wavelength bands. The data in each partition are compressed independently of those in the other partitions, so that loss or corruption of data from any partition does not affect the other partitions. Furthermore, because compression is progressive within each partition, when data are lost, any data from that partition received prior to the loss can be used to reconstruct that partition at lower fidelity. By virtue of the compression improvement it achieves relative to previous means of onboard data compression, this software enables (1) increased return of hyperspectral scientific data in the presence of limits on the rates of transmission of data from spacecraft to Earth via radio communication links and/or (2) reduction in spacecraft radio-communication power and/or cost through reduction in the amounts of data required to be downlinked and stored onboard prior to downlink. The software is also suitable for compressing hyperspectral images for ground storage or archival purposes.

Xie, Hua↗
DOE OSTI2024

Imaging the magnetic nanowire cross section and magnetic ordering within a suspended 3D artificial spin-ice

Artificial spin-ice systems are patterned arrays of magnetic nanoislands arranged into frustrated geometries and provide insight into the physics of ordering and emergence. The majority of these systems have been realized in two-dimensions, mainly due to the ease of fabrication, but with recent developments in advanced nanolithography, three-dimensional artificial spin ice (ASI) structures have become possible, providing a new paradigm in their study. Such artificially engineered 3D systems provide new opportunities in realizing tunable ground states, new domain wall topologies, monopole propagation, and advanced device concepts, such as magnetic racetrack memory. Direct imaging of 3DASI structures with magnetic force microscopy has thus far been key to probing the physics of these systems but is limited in both the depth of measurement and resolution, ultimately restricting measurement to the uppermost layers of the system. In this work, a method is developed to fabricate 3DASI lattices over an aperture using two-photon lithography, thermal evaporation, and oxygen plasma exposure, allowing the probe of element-specific structural and magnetic information using soft x-ray microscopy with x-ray magnetic circular dichroism (XMCD) as magnetic contrast. The suspended polymer–permalloy lattices are found to be stable under repeated soft x-ray exposure. Analysis of the x-ray absorption signal allows the complex cross section of the magnetic nanowires to be reconstructed and demonstrates a crescent-shaped geometry. Measurement of the XMCD images after the application of an in-plane field suggests a decrease in magnetic moment on the lattice surface due to oxidation, while a measurable signal is retained on sub-lattices below the surface.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Design and calibration of an optically segmented single volume scatter camera for neutron imaging

The Optically Segmented Single Volume Scatter Camera (OS-SVSC) aims to image neutron sources for non-proliferation applications using the kinematic reconstruction of elastic double-scatter events. Our prototype system consists of 64 EJ-204 organic plastic scintillator bars, each measuring 5mm × 5mm × 200mm and individually wrapped in Teflon tape. The scintillator array is optically coupled to two silicon photomultiplier ArrayJ-60035 64P-PCB arrays, each comprised of 64 individual 6x6mm J-Series sensors arranged in an 8 × 8 array. We report on the design details, including component selections, mechanical design and assembly, and the electronics system. The described design leveraged existing off-the-shelf solutions to support the rapid development of a phase 1 prototype. Several valuable lessons were learned from component and system testing, including those related to the detector's mechanical structure and electrical crosstalk that we conclude originates in the commercial photodetector arrays and the associated custom breakout cards. We detail our calibration efforts, beginning with calibrations for the electronics, based on the IRS3D application-specific integrated circuits, and their associated timing resolutions, ranging from 3090ps. With electronics calibrations applied, energy and position calibrations were performed for a set of edge bars using 22 Na and 90 Sr, respectively, reporting an average resolution of 12.07±0.03mm for energy depositions between 900keVee and 1000keVee. We further demonstrate a position calibration method for the internal bars of the matrix using cosmic-ray muons as an alternative to emission sources that cannot easily access these bars, with an average measured resolution of 14.86+-0.29mm for depositions between 900keVee and 1000keVee. The coincident time resolution reported between pairs of bars measured up to 400ps from muon acquisitions. Energy and position calibration values measured with muons are consistent with those obtained using particle emission sources.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

On the Abuse and Detection of Polyglot Files

A polyglot is a file that is valid in two or more formats. Polyglot files pose a problem for file-upload and generative AI web interfaces that rely on format identification to determine how to securely handle incoming files. In this work we found that existing file-format and embedded-file detection tools, even those developed specifically for polyglot files, fail to reliably detect polyglot files used in the wild. To address this issue, we studied the use of polyglot files by malicious actors in the wild, finding 30 polyglot samples and 15 attack chains that leveraged polyglot files. Using knowledge from our survey of polyglot usage in the wild---the first of its kind---we created a novel data set based on adversary techniques. We then trained a machine learning detection solution, PolyConv, using this data set. PolyConv achieves a precision-recall area-under-curve score of 0.999 with an F1 score of 99.20% for polyglot detection and 99.47% for file-format identification, significantly outperforming all other tools tested. We developed a content disarmament and reconstruction tool, ImSan, that successfully sanitized 100% of the tested image-based polyglots, which were the most common type found via the survey. Our work provides concrete tools and suggestions to enable defenders to better defend themselves against polyglot files, as well as directions for future work to create more robust file specifications and methods of disarmament.

Oesch, T [ORNL] (ORCID:0000000269091022)↗
DOE OSTI2021

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they arc only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

47 OTHER INSTRUMENTATION↗
NASA NTRS1973

Photogrammetric evaluation of Mariner 9 photography

Some attempts to produce, with an AP/C analytical plotter, stereo models using Mariner 9 pictures are reported. The first attempt using geometrically uncorrected mission test video system (MTVS) imagery failed; the second, using corrected reduced data record (RDR) pictures also failed, probably because they were reconstructed through a vidicon display which introduces additional distortion. By using images obtained from RDR tape data through the Optronics Photowrite device, models were successfully obtained.

Wu, S. S. C.↗
NASA NTRS1986

Virtual space and 2-dimensional effects in perspective displays

When interpreting three dimensional spatial relationships presented on a two dimensional display surface, the viewer is required to mentally reconstruct the original information. This reconstruction is influenced by both the perspective geometry of the displayed image and the viewer's eye position relative to the display. In a study which manipulated these variables, subjects judged the azimuth direction of a target object relative to a reference object fixed in the center of a perspective display. The results support a previously developed model which predicted that the azimuth judgement error would be a sinusoidal function of stimulus azimuth. The amplitude of this function was correctly predicted to be systematically modulated by both the perspective geometry of the image and the viewer's eye position relative to the screen. Interaction of the two components of the model, the virtual space effect and the 3D-to-2D projection effect, predicted the relative amplitudes of the sinusoidal azimuth error functions for the various conditions of the experiment. Mean azimuth judgements in some directions differed by as much as 25 degrees as a result of different combinations of eye position and image geometry. The results illustrate the need to consider the effects of perspective geometry when designing spatial information instruments, and show the model to be a reliable predictor of average performance.

Mcgreevy, M. W.↗
DOE OSTI2021

Malicious activity detection in a memory

A method and apparatus for monitoring a volatile memory in a computer system. Samples of compressed data from locations in the volatile memory in the computer system are read. Data in the volatile memory is reconstructed using the samples of compressed data. The data is an image of the volatile memory. The image enables determining whether an undesired process is present in the volatile memory.

Wheeler, Jason W.↗
DOE OSTI2022

Semi-Automated, Object-Based Tomography of Dislocation Structures

The characterization of the three-dimensional arrangement of dislocations is important for many analyses in materials science. Dislocation tomography in transmission electron microscopy is conventionally accomplished through intensity-based reconstruction algorithms. Although such methods work successfully, a disadvantage is that they require many images to be collected over a large tilt range. Here, we present an alternative, semi-automated object-based approach that reduces the data collection requirements by drawing on the prior knowledge that dislocations are line objects. Our approach consists of three steps: (1) initial extraction of dislocation line objects from the individual frames, (2) alignment and matching of these objects across the frames in the tilt series, and (3) tomographic reconstruction to determine the full three-dimensional configuration of the dislocations. Drawing on innovations in graph theory, we employ a node-line segment representation for the dislocation lines and a novel arc-length mapping scheme to relate the dislocations to each other across the images in the tilt series. We demonstrate the method for a dataset collected from a dislocation network imaged by diffraction-contrast scanning transmission electron microscopy. Based on these results and a detailed uncertainty analysis for the algorithm, we discuss opportunities for optimizing data collection and further automating the method.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

The Double-edged Sword of Data-driven Super-Resolution: Adversarial Super-resolution Models

Data-driven super-resolution (SR) methods are often integrated into imaging pipelines as preprocessing steps to improve downstream tasks such as classification and detection. However, these SR models introduce a previously unexplored attack surface into imaging pipelines. In this paper, we present AdvSR, a framework demonstrating that adversarial behavior can be embedded directly into SR model weights during training, requiring no access to inputs at inference time. Unlike prior attacks that perturb inputs or rely on backdoor triggers, AdvSR operates entirely at the model level. By jointly optimizing for reconstruction quality and targeted adversarial outcomes, AdvSR produces models that appear benign under standard image quality metrics while inducing downstream misclassification. We evaluate AdvSR on three SR architectures (SRCNN, EDSR, SwinIR) paired with a YOLOv11 classifier and demonstrate that AdvSR models can achieve high attack success rates with minimal quality degradation. These findings highlight a new model-level threat for imaging pipelines, with implications for how practitioners source and validate models in safety-critical applications.

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗
DOE OSTI2024

AI-enabled Lorentz microscopy for quantitative imaging of nanoscale magnetic spin textures

The manipulation and control of nanoscale magnetic spin textures are of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the nanoscale, but quantitative characterization of in situ data is extremely challenging. Here, we present an AI-enabled phase-retrieval method based on integrating a generative deep image prior with an image formation forward model for LTEM. Our approach uses a single out-of-focus image for phase retrieval and achieves significantly higher accuracy and robustness to noise compared to existing methods. Furthermore, our method is capable of isolating sample heterogeneities from magnetic contrast, as shown by application to simulated and experimental data. This approach allows quantitative phase reconstruction of in situ data and can also enable near real-time quantitative magnetic imaging.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Understanding hadronic interactions using advanced reconstruction techniques

ProtoDUNE-SP served as the prototype of the future Deep Underground Neutrino Experiment (DUNE). With a total liquid argon mass of 0.77 kt, it stood as the most extensive monolithic single-phase Liquid Argon Time Projection Chamber (LArTPC) ever constructed. Strategically located and operated at CERN, ProtoDUNE-SP benefited from a specialized charged-particle test beam, offering a momentum range of 0.3 - 7 GeV/c. This setup provided a unique opportunity to conduct in-depth studies on hadronic interactions within argon. Hadronic interactions play a fundamental role in neutrino physics, particularly in the intricacies of neutrino detection. We depend on analyzing the outcomes of these interactions to accurately determine both the flavor and energy of the interacting neutrinos. Pions, as one of the primary byproducts of neutrino interactions, are crucial for understanding the overall dynamics and kinematics of these processes. Accurately characterizing and understanding the interaction of pions with argon can significantly enhance the precision of neutrino simulations and measurements.Being a Liquid Argon Time Projection Chamber (LArTPC), ProtoDUNE-SP is distinguished by its ability to produce high-definition images of charged particles as they traverse through the detector's active volume. Yet, accurately reconstructing these particle interactions and determining their kinematic attributes remains a challenging task. The successes of deep learning in diverse domains, especially in image recognition, provide a promising approach for addressing this challenge in ProtoDUNE. This thesis discusses a measurement of the Piplus - argon inelastic cross section in the energy range of 2400 to 3000 MeV, using data taken by protoDUNE during the fall of 2018. Additionally, panoptic segmentation, a machine learning technique, is introduced and validated through its application in the reconstruction of the neutral pion rest mass. The aim is to showcase how these advanced methods can enhance the quality of event reconstruction.

Sarasty Segura, Carlos Eduardo↗
NASA NTRS2019

Lens Model and Source Reconstruction Reveal the Morphology and Star Formation Distribution in the Cool Spiral LIRG SGAS J143845.1+145407

We present Hubble Space Telescope (HST) imaging and grism spectroscopy of a strongly lensed LIRG at z = 0.816, SGAS 143845.1+145407, and use the magnification boost of gravitational lensing to study the distribution of star formation throughout this galaxy. Based on the HST imaging data, we create a lens model for this system; we compute the mass distribution and magnification map of the z = 0.237 foreground lens. We find that the magnification of the lensed galaxy ranges between 2 and 10, with a total magnification (measured over all the images of the source) of μ = ${11.8}_{-2.4}^{+4.6}$. We find that the total projected mass density within ∼34 kpc of the brightest cluster galaxy is 6.0(+0.3,-0.7) x 10^(12)Mꙩ. Using the lens model we create a source reconstruction for SGAS 143845.1+145407, which, paired with a faint detection of Hα in the grism spectroscopy, allows us to finally comment directly on the distribution of star formation in a z ∼ 1 LIRG. We find widespread star formation across this galaxy, in agreement with the current understanding of these objects. However, we note a deficit of Hα emission in the nucleus of SGAS 143845.1+145407, likely due to dust extinction.

Samuel J. Dunham↗
NASA NTRS1979

Feasibility of automated dropsize distributions from holographic data using digital image processing techniques

An automated technique for measuring particle diameters and their spatial coordinates from holographic reconstructions is being developed. Preliminary tests on actual cold-flow holograms of impinging jets indicate that a suitable discriminant algorithm consists of a Fourier-Gaussian noise filter and a contour thresholding technique. This process identifies circular as well as noncircular objects. The desired objects (in this case, circular or possibly ellipsoidal) are then selected automatically from the above set and stored with their parametric representations. From this data, dropsize distributions as a function of spatial coordinates can be generated and combustion effects due to hardware and/or physical variables studied.

Feinstein, S. P.↗
DOE OSTI2023

Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data

High-energy large-scale particle colliders produce data at high speed in the order of 1 terabytes per second in nuclear physics and petabytes per second in high energy physics. Developing real-time data compression algorithms to reduce such data at high throughput to fit permanent storage has drawn increasing attention. Specifically, at the newly constructed sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC), a time projection chamber is used as the main tracking detector, which records particle trajectories in a volume of three-dimensional (3D) cylinder. The resulting data are usually very sparse with occupancy around 10.8%. Such sparsity presents a challenge to conventional learning-free lossy compression algorithms, such as SZ, ZFP, and MGARD. The 3D convolutional neural network (CNN)-based approach, Bicephalous Convolutional Autoencoder (BCAE), outperforms traditional methods both in compression rate and reconstruction accuracy. BCAE can also utilize the computation power of graphical processing units suitable for deployment in a modern heterogeneous highperformance computing environment. This work introduces two BCAE variants: BCAE++ and BCAE-2D. BCAE++ achieves a 15% better compression ratio and a 77% better reconstruction accuracy measured in mean absolute error compared with BCAE. BCAE-2D treats the radial direction as the channel dimension of an image, resulting in a 3× speedup in compression throughput. In addition, we demonstrate an unbalanced autoencoder with a larger decoder can improve reconstruction accuracy without significantly sacrificing throughput. Lastly, we observe both the BCAE++ and BCAE-2D can benefit more from using half-precision mode in throughput (76 - 79% increase) without loss in reconstruction accuracy. The source code and links to data and pretrained models can be found at https://github.com/BNL-DAQ-LDRD/NeuralCompression_v2

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Joint iterative reconstruction and 3D rigid alignment for X-ray tomography

X-ray tomography is widely used for three-dimensional structure determination in many areas of science, from the millimeter to the nanometer scale. The resolution and quality of the 3D reconstruction is limited by the availability of alignment parameters that correct for the mechanical shifts of the sample or sample stage for the images that constitute a scan. In this paper we describe an algorithm for marker-free, fully automated and accurately aligned and reconstructed X-ray tomography data. Our approach solves the tomographic reconstruction jointly with projection data alignment based on a rigid-body deformation model. We demonstrate the robustness of our method on both synthetic phantom and experimental data and show that our method is highly efficient in recovering relatively large alignment errors without prior knowledge of a low resolution approximation of the 3D structure or a reasonable estimate of alignment parameters.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Cross-Modal Guidance for Fast Diffusion-Based Computed Tomography

Diffusion models have emerged as powerful priors for solving inverse problems in computed tomography (CT). In certain applications, such as neutron CT, it can be expensive to collect large amounts of measurements even for a single scan leading to sparse data sets from which it is challenging to obtain high quality reconstructions even with diffusion models. One strategy to mitigate this challenge is to leverage a complementary, easily available imaging modality; however, such approaches typically require retraining the diffusion model with large datasets. In this work, we propose incorporating an additional modality without retraining the diffusion prior, enabling accelerated imaging of costly modalities. We further examine the impact of imperfect side modalities on cross-modal guidance. Our method is evaluated on sparse-view neutron computed tomography, where reconstruction quality is substantially improved by incorporating X-ray computed tomography of the same samples.

Efimov, Timofey [ORNL] (ORCID:000900090098471X)↗
NASA NTRSDate not supplied

Least Squares Reverse Time Migration (LSRTM) for Damage Imaging in Composite Laminates

A method for adapting least squares reverse time migration (LSRTM) for ultrasonic guided wave imaging of composite laminates is proposed in this paper. As composites become more widely used in fields such as the aerospace industry, the need for high-resolution imaging in structural health monitoring (SHM) and nondestructive evaluation (NDE) is also growing. For instance, delamination is a common problem in composite laminates, which has led to a certain degree of apprehension in the use of composite materials for load-bearing structures. Although the solver-based imaging techniques using conventional reverse time migration (RTM) methods illuminate damage with a wide range of damage-scattering effects, the resulting images do not fully define the damage regions due to the limited data acquisition aperture, sensor density, frequencies/wavelengths, and incompleteness of adjoint reconstruction. Previously, the LSRTM theory was derived by incorporating a least squares migration (LSM) algorithm into RTM, and benchmarked its high-resolution damage imaging performance for isotropic plates. To improve damage imaging in composite laminates, a process to create an ultrasonic guided wave-based LSRTM method for anisotropic materials is proposed in this paper. The derivation of the forward modeling operator and the adjoint operator is presented. Numerical case studies were conducted to show the improvement of LSRTM over RTM in mapping damage in composite plates. Multiple damage sites or damage with a complex shape were created in the numerical studies based on 1) Born approximation-based modeling or 2) reduction of the plate stiffness-based modeling. LSRTM begins by using a forward modeling process. The forward modeling accuracy for the flexural wave solver used in this study for LSRTM was also compared with the results from a three-dimensional rotated staggered grid (RSG) elastodynamic finite difference solver, previously open-sourced by NASA Langley Research Center. These benchmarking studies have shown that the LSRTM method is more effective in reducing artifacts, improving resolution, and enhancing damage model reconstruction compared to RTM in composite laminates.

Jiaze He↗