Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Online randomized interpolative decomposition with a posteriori error estimator for temporal PDE data reduction

Traditional low-rank approximation is a powerful tool for compressing large data matrices that arise in simulations of partial differential equations (PDEs), but suffers from high computational cost and requires several passes over the PDE data. The compressed data may also lack interpretability thus making it difficult to identify feature patterns from the original data. Here, to address these issues, we present an online randomized algorithm to compute the interpolative decomposition (ID) of large-scale data matrices in situ. Compared to previous randomized IDs that used the QR decomposition to determine the column basis, we adopt a streaming ridge leverage score-based column subset selection algorithm that dynamically selects proper basis columns from the data and thus avoids an extra pass over the data to compute the coefficient matrix of the ID. In particular, we adopt a single-pass error estimator based on the non-adaptive Hutch++ algorithm to provide real-time error approximation for determining the best coefficients. As a result, our approach only needs a single pass over the original data and thus is suitable for large and high-dimensional matrices stored outside of core memory or generated in PDE simulations. A strategy to improve the accuracy of the reconstructed data gradient, when desired, within the ID framework is also presented. We provide numerical experiments on turbulent channel flow and ignition simulations, and on the NSTX Gas Puff Image dataset, comparing our algorithm with the offline ID algorithm to demonstrate its utility in real-world applications.

Column subset selection↗
DOE OSTI2023

Resolution-enhanced X-ray fluorescence microscopy via deep residual networks

Abstract Multimodal hard X-ray scanning probe microscopy has been extensively used to study functional materials providing multiple contrast mechanisms. For instance, combining ptychography with X-ray fluorescence (XRF) microscopy reveals structural and chemical properties simultaneously. While ptychography can achieve diffraction-limited spatial resolution, the resolution of XRF is limited by the X-ray probe size. Here, we develop a machine learning (ML) model to overcome this problem by decoupling the impact of the X-ray probe from the XRF signal. The enhanced spatial resolution was observed for both simulated and experimental XRF data, showing superior performance over the state-of-the-art scanning XRF method with different nano-sized X-ray probes. Enhanced spatial resolutions were also observed for the accompanying XRF tomography reconstructions. Using this probe profile deconvolution with the proposed ML solution to enhance the spatial resolution of XRF microscopy will be broadly applicable across both functional materials and biological imaging with XRF and other related application areas.

36 MATERIALS SCIENCE↗
DOE OSTI2025

hdsullivan/ResSR

This is the official implementation of ResSR [1]. ResSR is a computationally efficient MSI-SR method that achieves high-quality reconstructions by using a closed-form spectral decomposition along with a spatial residual correction. ResSR applies singular value decomposition to identify correlations across spectral bands, uses pixel-wise computation to upsample the MSI, and then applies a residual correction process to correct the high-spatial frequency components of the upsampled bands. While ResSR is formulated as the solution to a spatially-coupled optimization problem, we use pixel-wise regularization and derive an approximate closed-form solution, resulting in a pixel-wise algorithm with a dramatic reduction in computation that achieves state-of-the-art reconstructions. [1] Duba-Sullivan, H., Reid, E. J., Voisin, S., Bouman, C. A., & Buzzard, G. T. (2024). ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images. arXiv preprint arXiv:2408.13225.

Duba-Sullivan, Haley [Oak Ridge National Laborator↗
DOE OSTI2024

Thermonuclear performance variability near ignition at the National Ignition Facility

We describe our current understanding of the variability and degradation mechanisms observed through a series of five indirectly driven inertial fusion implosions fielded at the National Ignition Facility in the fall of 2021, four of which attempted to reproduce the first experiment to achieve Lawson's criterion for ignition with a thermonuclear yield of 1.35 MJ on August 8, 2021. A large number of absolutely calibrated (imaging, time-resolved, and spectrally resolved) x-ray and neutron diagnostics are fielded on the NIF along multiple lines of sight for each experiment. This allows for a reconstruction of the DT fuel and ablator mix injected into the hotspot around peak burn. We show that nuclear yield variations are well reproduced by numerical modeling when the measured low mode asymmetries and mix mass are included. Furthermore, these observed perturbations during burn are linked to small variations in laser delivery and capsule defects. Stringent specifications are then set to achieve robust ignition with the implosion design studied in this paper.

Divol, L. (ORCID:0000000269699898)↗
DOE OSTI2026

Deep Learning and Photogrammetric Reconstruction for Automated Crack Detection and Dimensional Measurement in Mining Operations

Surface crack detection and dimensional measurement at active mining sites present significant safety and operational challenges. Manual inspection methods are labor-intensive, spatially incomplete, and expose personnel to hazardous environments, while existing automated approaches have been developed primarily for concrete civil infrastructure and have not been validated on the complex, variable surfaces characteristic of mining environments. This dissertation presents an automated pipeline that integrates deep learning semantic segmentation with Structure-from-Motion photogrammetry to detect surface cracks and measure their aperture, length, and vertical displacement from standard RGB imagery acquired during routine Uncrewed Aerial Vehicle (UAV) survey operations, without requiring additional sensor hardware or manual measurement. The pipeline combines a U-Net architecture with an EfficientNet-B0 encoder, pretrained on the SDNET2018 concrete crack dataset and fine-tuned on a mining-specific dataset spanning laboratory concrete specimens, coal refuse impoundment embankments, and post-blast limestone quarry benches. Photogrammetric reconstruction is performed using COLMAP Structure-from-Motion and Multi-View Stereo, with crack segmentation masks projected into the reconstructed point cloud to enable three-dimensional vertical displacement measurement through local plane fitting and bimodal surface detection. The pipeline was validated across 36 controlled laboratory specimens at three imaging distances and four vertical displacement levels, achieving aperture measurement RMSE of 0.047 cm and R² of 0.954, and vertical displacement RMSE of 0.140 cm and R² of 0.966, against independent caliper measurements. Field application at a coal refuse impoundment in southwestern Pennsylvania detected 71 crack components across the embankment crest, with a dominant longitudinal crack exhibiting aperture values reaching 28 cm and a 95th percentile vertical displacement of 35.53 cm, consistent in magnitude and spatial distribution with simultaneously acquired LiDAR-derived estimates. Application across four post-blast limestone quarry bench datasets in California successfully characterized blast-induced fracture networks at ground sampling distances ranging from 0.59 to 1.23 cm/pixel, with detected crack geometries physically consistent with observable surface conditions at each site. The results demonstrate that deep learning-based crack detection and photogrammetric measurement can be integrated into routine UAV inspection workflows at mining sites, providing repeatable, scalable, and quantitative crack characterization across surface types, crack scales, and displacement magnitudes not previously addressed in the literature. The pipeline requires no dedicated surveying equipment beyond the UAV platforms already deployed at mine sites for survey and monitoring purposes, supporting practical adoption within existing operational workflows.

Crack detection, Dimensional Measurement↗
DOE OSTI2025

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A super-resolution technique to analyze single-crystal inelastic neutron scattering measurements using direct-geometry chopper spectrometers

Direct-geometry time-of-flight chopper neutron spectroscopy is instrumental in studying dynamics in liquid, powder, and single crystal systems. We report here that real-space techniques in optical imagery can be adapted to obtain reciprocal-space super resolution dispersion for phonon or magnetic excitations from single-crystal neutron spectroscopy measurements. The procedure to reconstruct super-resolution energy dispersion of excitations relies on an accurate determination of the momentum and energy-dependent point spread function and a dispersion correction technique inspired by an image disparity calculation technique commonly used in stereo imaging. Here by, applying these methods to spinwave dispersion data from a virtual neutron experiment demonstrates ~5-fold improvement over nominal energy resolution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

NucD-23 Nuclear Diagnostics Development: The future of neutron imaging and gamma reaction history

The Neutron Imaging team has deployed novel, active detection systems along two lines of sight at NIF. Studies aimed to characterize NIS sensitivity to implosion shape will be carried out to further extend reconstruction capabilities. Additionally, an improved camera timing system that will reduce uncertainties stemming from bang time jitter will also be fielded. The NIF GRH data recording system is more then 10 years old needs to be updated. Bandwidth and noise are a key limiting factor for improving data quality. New high bandwidth and low noise components will be tested at OMEGA in advance before fielding the components at NIF.

42 ENGINEERING↗
DOE OSTI2022

Analysis of Defects in Metal Additive Manufacturing with Augmented Data Generation

Laser powder bed fusion (LPBF) is a method of additive manufacturing (AM) that selectively melts and fuses together microscopic metallic powder. LPBF offers the benefit of producing custom structures out of high strength metals that can be difficult to fabricate with conventional methods. The challenge of LPBF is that 3D printed structures often have internal pores due to process flaws. Pulsed thermal tomography (PTT) is a method for reconstructing the depth profile of materials, allowing the visualization internal voids in solids. In prior work, we developed a convolutional neural network (CNN) which, having been trained on simulated 2D PTT images of subsurface elliptical defects, was able to classify the semi-major radii, semi-minor radii, and angular orientation of the best-fit ellipses in previously unseen PTT images. The unseen PTT images contained subsurface irregular defect shapes imported from scanning electron microscopy (SEM) images of metallic LPBF-printed specimens. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Evaluating Neural Radiance Fields for Commercial Satellite Video

We evaluate neural radiance fields (NeRFs) as a method for reconstructing 3D volumetric scenes from low Earth orbit satellite imagery. We leverage commercial satellite data to reconstruct a scene using existing software tools. In doing so, we identify difficulties in these mapping datasets for NeRF generation. We propose potential applications in geospatial intelligence for context and improved image interpretation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Calibrating the DUNE LArTPC detectors for precision physics

The Deep Underground Neutrino Experiment (DUNE) is an international collaboration focused on studying neutrino oscillation over a long baseline (1300 km). DUNE will make use of a near detector and $\mathcal{O}$(GeV) neutrino beam originating at Fermilab in Batavia, IL, and a far detector operating 1.5 km underground at the Sanford Underground Research Facility in Lead, South Dakota. The near and far detectors will use the LArTPC (Liquid Argon Time Projection Chamber) technology to image neutrino interactions. In order to make precise physics measurements at DUNE, such as the amount of CP violation in the neutrino sector, it is essential to be able to accurately reconstruct particle energies and other kinematic quantities; this in turn necessitates an extensive calibration program for DUNE s LArTPC detectors. In this presentation, we describe the requirements for calibrating the DUNE detectors, emphasizing the challenges of massive multi-kiloton LArTPC detectors which are to operate for multiple years deep underground. A preliminary DUNE detector calibration program, including use of both dedicated calibration hardware and cosmogenic/beam-induced calibration sources, is presented. First results on detector calibration at the ProtoDUNE-SP prototype detector located at CERN, and associated impact on calibrations at the DUNE far detector, are also emphasized.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

ForSE: A GAN-based Algorithm for Extending CMB Foreground Models to Subdegree Angular Scales

We present ForSE (Foreground Scale Extender), a novel Python package that aims to overcome the current limitations in the simulation of diffuse Galactic radiation, in the context of cosmic microwave background (CMB) experiments. ForSE exploits the ability of generative adversarial neural networks (GANs) to learn and reproduce complex features present in a set of images, with the goal of simulating realistic and non-Gaussian foreground radiation at subdegree angular scales. This is of great importance in order to estimate the foreground contamination to lensing reconstruction, delensing, and primordial B-modes for future CMB experiments. We applied this algorithm to Galactic thermal dust emission in both total intensity and polarization. Our results show how ForSE is able to generate small-scale features (at 12') having as input the large-scale ones (80'). The injected structures have statistical properties, evaluated by means of the Minkowski functionals, in good agreement with those of the real sky and which show the correct amplitude scaling as a function of the angular dimension. Furthermore, the obtained thermal dust Stokes Q and U full-sky maps as well as the ForSE package are publicly available for download.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Deep learning approaches to semantic segmentation of fatigue cracking within cyclically loaded nickel superalloy

Improvements to synchrotron-based micro-computed tomography scanning capabilities have gifted researchers the ability to characterize 4D material thermomechanical responses more thoroughly than ever before. These advancements, however, have brought about new challenges in analyzing the resulting deluge of data. We report on a nickel-based superalloy specimen imaged 26 times in-situ during cyclic loading at Argonne National Laboratory Advanced Photon Source beamline 1ID, in order to monitor crack growth within the microstructure. Therefore, several deep learning approaches which utilize convolutional neural networks are implemented to segment crack features from reconstructed tomography scans. U-Net architecture implementations are found to be especially effective, achieving IoU = 0.995 +/- 0.004 and Matthews correlation coefficient scores of Φ = 0.826 +/- 0.085. These advancements broaden possibilities for scientists seeking to automate segmentation analyses of similar large datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Facile hermetic TEM grid preparation for molecular imaging of hydrated biological samples at room temperature

Abstract Although structures of vitrified supramolecular complexes have been determined at near-atomic resolution, elucidating in situ molecular structure in living cells remains a challenge. Here, we report a straightforward liquid cell technique, originally developed for real-time visualization of dynamics at a liquid-gas interface using transmission electron microscopy, to image wet biological samples. Due to the scattering effects from the liquid phase, the micrographs display an amplitude contrast comparable to that observed in negatively stained samples. We succeed in resolving subunits within the protein complex GroEL imaged in a buffer solution at room temperature. Additionally, we capture various stages of virus cell entry, a process for which only sparse structural data exists due to their transient nature. To scrutinize the morphological details further, we used individual particle electron tomography for 3D reconstruction of each virus. These findings showcase this approach potential as an efficient, cost-effective complement to other microscopy technique in addressing biological questions at the molecular level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Experimental demonstration of coupled multi-peak Bragg coherent diffraction imaging with genetic algorithms

Bragg coherent diffraction imaging has the potential to provide significant insight into the structure-properties relationship for crystalline materials by imaging, with nanoscale resolution, three-dimensional strain fields within individual grains and nanoparticles. The capability of present-day synchrotrons to locate and measure a multiplicity of Bragg reflections from a single grain makes it possible to recover the full strain tensor with nanometer resolution. Recent methods for coupling reconstructions from several peaks to determine the strain tensor have been developed and applied to synthetic data, but have not been applied to experimental data. Here, using a coupled genetic reconstruction algorithm, we reconstruct an experimental data set and demonstrate improvements in the ability to resolve vector-valued displacement fields internal to the particle as compared to what is achieved with a noncoupled approach. The coupled approach developed in this work was also validated on simulated data sets. In both simulated and experimental data, reconstructions from our coupled Bragg peak algorithm show improvements over the noncoupled independent reconstruction method of 5% in terms of accuracy and 53% in terms of consistency.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Toward nanoscale molecular mass spectrometry imaging via physically constrained machine learning on co-registered multimodal data

Mass spectrometry imaging (MSI) plays a pivotal role in investigating the chemical nature of complex systems that underly our understanding in biology and medicine. Multiple fields of life science such as proteomics, lipidomics and metabolomics benefit from the ability to simultaneously identify molecules and pinpoint their distribution across a sample. However, achieving the necessary submicron spatial resolution to distinguish chemical differences between individual cells and generating intact molecular spectra is still a challenge with any single imaging approach. Here, we developed an approach that combines two MSI techniques, matrix-assisted laser desorption/ionization (MALDI) and time-of-flight secondary ion mass spectrometry (ToF-SIMS), one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The known relationships between the two MSI channels of information are enforced via a physically constrained machine-learning approach and directly incorporated in the data processing. We demonstrate the robustness of this method by generating intact molecular MALDI-type spectra and chemical maps at ToF-SIMS resolution when imaging mouse brain thin tissue sections. This approach can be readily adopted for other types of bioimaging where physical relationships between methods have to be considered to boost the confidence in the reconstruction product.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Dynamic molecular architecture of the synaptonemal complex

During meiosis, pairing between homologous chromosomes is stabilized by the assembly of the synaptonemal complex (SC). The SC ensures the formation of crossovers between homologous chromosomes and regulates their distribution. However, how the SC regulates crossover formation remains elusive. We isolated an unusual mutation in Caenorhabditis elegans that disrupts crossover interference but not SC assembly. This mutation alters the unique C terminal domain of an essential SC protein, SYP-4, a likely ortholog of the vertebrate SC protein SIX6OS1. We use three-dimensional stochastic optical reconstruction microscopy (3D-STORM) to interrogate the molecular architecture of the SC from wild-type and mutant C. elegans animals. Using a probabilistic mapping approach to analyze super-resolution image data, we detect changes in the organization of the synaptonemal complex in wild-type animals that coincide with crossover designation. We also found that our syp-4 mutant perturbs SC architecture. Our findings add to growing evidence that the SC is an active material whose molecular organization contributes to chromosome-wide crossover regulation.

59 BASIC BIOLOGICAL SCIENCES↗