Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Observing cosmic-ray extensive air showers with a silicon imaging detector

Extensive air showers induced from high-energy cosmic rays provide a window into understanding the most energetic phenomena in the universe. We present a new method for observing these showers using the silicon imaging detector Subaru Hyper Suprime-Cam (HSC). This method has the advantage of being able to measure individual secondary particles. When paired with a surface detector array, silicon imaging detectors like Subaru HSC will be useful for studying the properties of extensive air showers in detail. The following report outlines the first results of observing extensive air showers with Subaru HSC. The potential for reconstructing the incident direction of primary cosmic rays is demonstrated and possible interdisciplinary applications are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Unsupervised classification for region of interest in X-ray ptychography

X-ray ptychography offers high-resolution imaging of large areas at a high computational cost due to the large volume of data provided. To address the cost issue, we propose a physics-informed unsupervised classification algorithm that is performed prior to reconstruction and removes data outside the region of interest (RoI) based on the multimodal features present in the diffraction patterns. The preprocessing time for the proposed method is inconsequential in contrast to the resource-intensive reconstruction process, leading to an impressive reduction in the data workload to a mere 20% of the initial dataset. This capability consequently reduces computational time dramatically while preserving reconstruction quality. Through further segmentation of the diffraction patterns, our proposed approach can also detect features that are smaller than beam size and correctly classify them as within the RoI.

97 MATHEMATICS AND COMPUTING↗

Deblending galaxies with variational autoencoders: A joint multiband, multi-instrument approach

ABSTRACT Blending of galaxies has a major contribution in the systematic error budget of weak-lensing studies, affecting photometric and shape measurements, particularly for ground-based, deep, photometric galaxy surveys, such as the Rubin Observatory Legacy Survey of Space and Time (LSST). Existing deblenders mostly rely on analytic modelling of galaxy profiles and suffer from the lack of flexible yet accurate models. We propose to use generative models based on deep neural networks, namely variational autoencoders (VAE), to learn probabilistic models directly from data. We train a VAE on images of centred, isolated galaxies, which we reuse, as a prior, in a second VAE-like neural network in charge of deblending galaxies. We train our networks on simulated images including six LSST bandpass filters and the visible and near-infrared bands of the Euclid satellite, as our method naturally generalizes to multiple bands and can incorporate data from multiple instruments. We obtain median reconstruction errors on ellipticities and r-band magnitude between ±0.01 and ±0.05, respectively, in most cases, and ellipticity multiplicative bias of 1.6 per cent for blended objects in the optimal configuration. We also study the impact of decentring and prove the method to be robust. This method only requires the approximate centre of each target galaxy, but no assumptions about the number of surrounding objects, pointing to an iterative detection/deblending procedure we leave for future work. Finally, we discuss future challenges about training on real data and obtain encouraging results when applying transfer learning.

Arcelin, Bastien↗

ArCS: A Magnetized LArTPC in a Test Beam

Over the past few decades, Liquid Argon Time Projection Chambers (LArTPCs) have emerged as a central technology for rare-event detection, due to their calorimetric and imaging capabilities. Adding a magnetic field to LArTPCs would enable charge identification and momentum measurements via curvature. For neutrino experiments, this is crucial for wrong-sign neutrino rejection, electron/positron and electron/photon discrimination, and improved momentum reconstruction. The ArCS (Argon detector with Charge Separation) experiment at Fermilab's Test Beam Facility will place a 47 40 90 cm LArTPC inside a 0.7 T magnet to: (i) establish charge sign discrimination for electrons and positrons, (ii) reconstruct particle momenta via curvature, and (iii) determine the minimal magnetic field needed for these measurements. This poster will present the project status, with updates on installation and simulations of expected performance.

Cicogna, Giulia [Bologna U.]↗

Are suspensory ligaments important for middle ear reconstruction?

As the resolution of 3D printing techniques improves, the possibility of individualized, 3-ossicle constructions adds a new dimension to middle ear prostheses. In order to optimize these designs, it is essential to understand how the ossicles and ligaments work together to transmit sound, and thus how ligaments should be replicated in a middle ear reconstruction. The middle ear ligaments are thought to play a significant role in maintaining the position of the ossicles and constraining axis of rotation. Paradoxically, investigations of the role of ligaments to date have shown very little impact on middle ear sound transmission. We explored the role of the two attachments in the gerbil middle ear analogous to human ligaments, the posterior incudal ligament and the anterior mallear process, severing both attachments and measuring change in hearing sensitivity. The impact of severing the attachments on the position of the ossicular chain was visualized using synchrotron microtomography imaging of the middle ear. In contrast to previous studies, a threshold change on the order of 20 dB across a wide range of frequencies was found when both ligaments were severed. Concomitantly, a shift in position of the ossicles was observed from the x-ray imaging and 3D renderings of the ossicular chain. These findings contrast with previous studies, demonstrating that these ligaments play a significant role in the transmission of sound through the middle ear. It appears that both mallear and incudal ligaments must be severed in order to impair sound transmission. The results of this study have significance for middle ear reconstructive surgery and the design of 3D-printed three-ossicle biocompatible prostheses.

3D printing↗

CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-Net

Picking protein particles in cryo-electron microscopy (cryo-EM) micrographs is a crucial step in the cryo-EM-based structure determination. However, existing methods trained on a limited amount of cryo-EM data still cannot accurately pick protein particles from noisy cryo-EM images. The general foundational artificial intelligence–based image segmentation model such as Meta’s Segment Anything Model (SAM) cannot segment protein particles well because their training data do not include cryo-EM images. Here, we present a novel approach (CryoSegNet) of integrating an attention-gated U-shape network (U-Net) specially designed and trained for cryo-EM particle picking and the SAM. The U-Net is first trained on a large cryo-EM image dataset and then used to generate input from original cryo-EM images for SAM to make particle pickings. CryoSegNet shows both high precision and recall in segmenting protein particles from cryo-EM micrographs, irrespective of protein type, shape and size. On several independent datasets of various protein types, CryoSegNet outperforms two top machine learning particle pickers crYOLO and Topaz as well as SAM itself. The average resolution of density maps reconstructed from the particles picked by CryoSegNet is 3.33 Å, 7% better than 3.58 Å of Topaz and 14% better than 3.87 Å of crYOLO. It is publicly available at https://github.com/jianlin-cheng/CryoSegNet

59 BASIC BIOLOGICAL SCIENCES↗

Fast Scanning Probe Microscopy via Machine Learning: Non-Rectangular Scans with Compressed Sensing and Gaussian Process Optimization

Fast scanning probe microscopy enabled via machine learning allows for a broad range of nanoscale, temporally resolved physics to be uncovered. However, such examples for functional imaging are few in number. Here, using piezoresponse force microscopy (PFM) as a model application, a factor of 5.8 reduction in data collection using a combination of sparse spiral scanning with compressive sensing and Gaussian process regression reconstruction is demonstrated. It is found that even extremely sparse spiral scans offer strong reconstructions with less than 6% error for Gaussian process regression reconstructions. Further, the error associated with each reconstructive technique per reconstruction iteration is analyzed, finding the error is similar past ≈15 iterations, while at initial iterations Gaussian process regression outperforms compressive sensing. Finally, this study highlights the capabilities of reconstruction techniques when applied to sparse data, particularly sparse spiral PFM scans, with broad applications in scanning probe and electron microscopies.

36 MATERIALS SCIENCE↗

Bridging microscopy with molecular dynamics and quantum simulations: an atomAI based pipeline

Recent advances in (scanning) transmission electron microscopy have enabled a routine generation of large volumes of high-veracity structural data on 2D and 3D materials, naturally offering the challenge of using these as starting inputs for atomistic simulations. In this fashion, the theory will address experimentally emerging structures, as opposed to the full range of theoretically possible atomic configurations. However, this challenge is highly nontrivial due to the extreme disparity between intrinsic timescales accessible to modern simulations and microscopy, as well as latencies of microscopy and simulations per se. Addressing this issue requires as a first step bridging the instrumental data flow and physics-based simulation environment, to enable the selection of regions of interest and exploring them using physical simulations. Here we report the development of the machine learning workflow that directly bridges the instrument data stream into Python-based molecular dynamics and density functional theory environments using pre-trained neural networks to convert imaging data to physical descriptors. Additionally, the pathways to ensure structural stability and compensate for the observational biases universally present in the data are identified in the workflow. This approach is used for a graphene system to reconstruct optimized geometry and simulate temperature-dependent dynamics including adsorption of Cr as an ad-atom and graphene healing effects. However, it is universal and can be used for other material systems.

36 MATERIALS SCIENCE↗

Learning robust parameter inference and density reconstruction in flyer plate impact experiments

Estimating physical parameters or material properties from experimental observations is a common objective in many areas of physics and material science. In many experiments, especially in shock physics, radiography is the primary means of observing the system of interest. However, radiography does not provide direct access to key state variables, such as density, which prevents the application of traditional parameter estimation approaches. Here we focus on flyer plate impact experiments on porous materials, and resolving the underlying parameterized equation of state (EoS) and crush porosity model parameters given radiographic observation(s). We use machine learning as a tool to demonstrate with high confidence that using only high impact velocity data does not provide sufficient information to accurately infer both EoS and crush model parameters, even with fully resolved density fields or a dynamic sequence of images. We thus propose an observable data set consisting of low and high impact velocity experiments/simulations that capture different regimes of compaction and shock propagation, and proceed to introduce a generative machine learning approach which produces a posterior distribution of physical parameters directly from radiographs. We demonstrate the effectiveness of the approach in estimating parameters from simulated flyer plate impact experiments, and show that the obtained estimates of EoS and crush model parameters can then be used in hydrodynamic simulations to obtain accurate and physically admissible density reconstructions. Finally, we examine the robustness of the approach to model mismatches, and find that the learned approach can provide useful parameter estimates in the presence of out-of-distribution radiographic noise and previously unseen physics, thereby promoting a potential breakthrough in estimating material properties from experimental radiographic images.

97 MATHEMATICS AND COMPUTING↗

4D-STEM of Beam-Sensitive Materials

We report that a scanning electron nanobeam diffraction, or 4D-STEM (four-dimensional scanning transmission electron microscopy), is a flexible and powerful approach to elucidate structure from "soft" materials that are challenging to image in the transmission electron microscope because their structure is easily damaged by the electron beam. In a 4D-STEM experiment, a converged electron beam is scanned across the sample, and a pixelated camera records a diffraction pattern at each scan position. This four-dimensional data set can be mined for various analyses, producing maps of local crystal orientation, structural distortions, crystallinity, or different structural classes. Holding the sample at cryogenic temperatures minimizes diffusion of radicals and the resulting damage and disorder caused by the electron beam. The total fluence of incident electrons can easily be controlled during 4D-STEM experiments by careful use of the beam blanker, steering of the localized electron dose, and by minimizing the fluence in the convergent beam thus minimizing beam damage. This technique can be applied to both organic and inorganic materials that are known to be beam-sensitive; they can be highly crystalline, semicrystalline, mixed phase, or amorphous. One common example is the case for many organic materials that have a π-π stacking of polymer chains or rings on the order of 3.4-4.2 Å separation. If these chains or rings are aligned in some regions, they will produce distinct diffraction spots (as would other crystalline spacings in this range), though they may be weak or diffuse for disordered or weakly scattering materials. We can reconstruct the orientation of the π-π stacking, the degree of π-π stacking in the sample, and the domain size of the aligned regions. This Account summarizes illumination conditions and experimental parameters for 4D-STEM experiments with the goal of producing images of structural features for materials that are beam-sensitive. We will discuss experimental parameters including sample cooling, probe size and shape, fluence, and cameras. 4D-STEM has been applied to a variety of materials, not only as an advanced technique for model systems, but as a technique for the beginning microscopist to answer materials science questions. It is noteworthy that the experimental data acquisition does not require an aberration-corrected TEM but can be produced on a variety of instruments with the right attention to experimental parameters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic 3D reconstruction of cracked polycrystalline NMC particles using 2D SEM data

Li-ion battery performance is strongly influenced by the 3D microstructure of its cathode particles. Cracks within these particles develop during calendaring and cycling, reducing connectivity but increasing reactive surface, making their impact on battery performance complex. Understanding these contradictory effects requires a quantitative link between particle morphology and battery performance. However, informative 3D imaging techniques are time-consuming, costly and rarely available, such that analyses often have to rely on 2D image data. This paper presents a novel stereological approach for generating virtual 3D cathode particles exhibiting crack networks that are statistically equivalent to those observed in 2D sections of experimentally measured particles. Consequently, 2D image data suffices for deriving a full 3D characterization of cracked cathodes particles. Such virtually generated 3D particles could serve as geometry input for spatially resolved electro-chemo-mechanical simulations to enhance our understanding of structure-property relationships of cathodes in Li-ion batteries.

36 MATERIALS SCIENCE↗

Coalescence of GaP on V-Groove Si

In recent years, better understanding and control over the formation of crystalline defects during the direct epitaxy of III-V semiconductors on Si substrates via metal organic vapor phase epitaxy (MOVPE) has enabled large gains in III-V-on-Si solar cell efficiency, pointing to pathway to lower-cost, high-performance III-V solar cells. However, such results have only been achieved on costly chemo-mechanically-polished (CMP) Si wafers. The use of V-groove nanopatterned Si substrates has demonstrated similarly high-crystalline-quality III-V-on-Si epitaxy, but also can be combined with lower-cost polishing techniques. Although they offer a potential cost advantage, growth on V-groove substrates adds challenges not present for epitaxy on planar wafers (the III-V material must be coalesced into a thin film after an initial nucleation stage). MOVPE growth conditions that promote highly facet-selective lateral growth needed for coalescence are generally actively avoided for conventional thin fim growth, so growth conditions need to be re-developed for V-groove-based epitaxy. Additionally, coalescence add complexity to the dislocation dynamics related to lattice relaxation, so strategies used to keep threading dislocation density (TDD) low on planar substrates need to be re-tuned for V-grooves. We have studied the morphological evolution and dislocation dynamics of GaP grown on V-groove Si by MOVPE. Growth conditions of V/III=5,000 and Tg=800 degrees C were uniquely found to produce extremely smooth coalesced thin films, with an RMS roughness of 0.2 nm measured by AFM. Additionally, at this growth condition, we identified two regimes of growth determined by the width of the SiNx cap (a remnant of the nanopatterning process) at the top of the V-grooves. For narrow caps, the GaP coalesces into a thin film, and for wide caps, the GaP evolves into {1 1 1}-faceted diamonds that do not coalesce. We suggest the influence of Si from the sidewalls of the V-grooves on the surface reconstruction of the GaP as the mechanism for this effect, with reflection difference spectroscopy (RDS) and Si doping experiments supporting this theory. In addition to morphology, the dislocation dynamics of the system were studied with electron channeling contrast imaging (ECCI) and transmission electron microscopy (TEM). The TDD of the coalesced GaP films was found to be 5 x 10^7 cm^-2 after coalescence via ECCI, a level still too high for high-quality solar cells. However, misfit dislocations crossing multiple grooves greater than 20 micrometers long were observed in ECCI, suggesting that the V-grooves do not block dislocation glide. TEM prior to and after coalescence was used to distinguish between dislocation creation driven by growth conditions and coalescence. Finally, strategies to reduce the dislocation density to levels acceptable for solar cells will be discussed.

GaP↗

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems

Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.

42 ENGINEERING↗

Three-dimensional reconstruction of inertial confinement fusion hot-spot plasma from x-ray and nuclear diagnostics on OMEGA

Multidimensional effects degrade the neutron yield and the compressed areal density of laser-direct-drive inertial confinement fusion implosions of layered deuterium–tritium cryogenic targets on the OMEGA Laser System with respect to 1D radiation-hydrodynamic simulation predictions. A comprehensive physics-informed 3D reconstruction effort is under way to infer hot-spot and shell conditions at stagnation from four x-ray and seven neutron detectors distributed around the OMEGA target chamber. Neutron diagnostics, providing measurements of the neutron yield, hot-spot flow velocity, and apparent ion-temperature distribution, are used to infer the mode-1 perturbation at stagnation. The x-ray imagers record the shape of the hot-spot plasma to diagnose mode-1 and mode-2 perturbations. A deep-learning convolutional neural network trained on an extensive set of 3D radiation-hydrodynamic simulations is used to interpret the x-ray and nuclear measurements to infer the 3D profiles of the hot-spot plasma conditions and the amount of laser energy coupled to the hot-spot plasma. A 3D simulation database shows that larger mode-1 asymmetries are correlated with higher hot-spot flow velocities and reduced laser-energy coupling and neutron yield. Three-dimensional hot-spot reconstructions from x-ray measurements indicate that higher amounts of residual kinetic energy are correlated with higher measured hot-spot flow velocities, consistent with 3D simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Unsupervised anomaly detection in MeV ultrafast electron diffraction

MeV ultrafast electron diffraction (MUED) is a pump-probe technique used to study the dynamic structural evolution of materials. An ultrashort laser pulse triggers structural changes, which are then probed by an ultrashort relativistic electron beam. To overcome low signal-to-noise ratios, diffraction patterns are averaged over thousands of shots. However, shot-to-shot instabilities in the electron beam can distort individual patterns, introducing uncertainty. Improving MUED accuracy requires detecting and removing these anomalous patterns from large datasets. In this work, we developed a fully unsupervised methodology for the detection of anomalous diffraction patterns. Using a convolutional autoencoder, we calculate the reconstruction mean squared error of the diffraction patterns. Based on the statistical analysis of this error, we provide the user an estimation of the probability that the pattern is normal, which also allows a posterior visual inspection of the images that are difficult to classify. This method has been trained with only 100 diffraction patterns and tested on 1521 patterns, resulting in a false positive rate between 0.2% and 0.4%, with a training time of 10 s per image and a test time of about 1 s per image. Here, the proposed methodology can also be applied to other diffraction techniques in which large datasets are collected that include faulty images due to instrumental instabilities.

43 PARTICLE ACCELERATORS↗

Simulation-guided analysis of resonant soft X-ray scattering for determining the microstructure of triblock copolymers

Resonant soft X-ray scattering (RSoXS) probes structure with chemical sensitivity that is useful for determining the morphology of multiblock copolymers. However, the hyperspectral scattering data produced by this technique can be challenging to interpret. Here, in this study, we use computational scattering simulations to extract the microstructure of a model triblock copolymer from the energy-dependent scattering from RSoXS. An ABC triblock terpolymer formed from poly(4-methylcaprolactone) (P4MCL), poly(2,2,2-trifluoroethylacrylate) (PTFEA), and poly (dodecylacrylate) (PDDA), P4MCL-block-PTFEA-block-PDDA, was synthesized as the model triblock system. Through quantitative evaluation of simulated scattering data from a physics-informed set of candidate structure models against experimental RSoXS data, we find the best agreement with hexagonally packed core–shell cylinders. This result is also consistent with electron-density reconstruction from hard X-ray scattering data evaluated against electron-density maps generated with the same model set. These results demonstrate the utility of simulation-guided scattering analysis to study complex microstructures that are challenging to image by microscopy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VIIRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project at https://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗