Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Bragg edge imaging (BEI) of B12W and M8N socket sections of the Arecibo telescope

From neutron user principal investigator: We kindly request the public release of three neutron imaging datasets through ONCat. All datasets were collected from two forensic specimens, B12W and M8N, sectioned from zinc-filled steel-wire sockets recovered from the collapsed Arecibo Telescope. The dataset titled “Neutron radiographs of B12W and M8N socket sections of the Arecibo telescope” contains normalized two-dimensional (2D) neutron radiographs of the specimens, showing the geometry and spatial distribution of the steel wires embedded within the zinc matrix, as well as internal features such as voids and cracks. The dataset titled “Neutron computed tomography of B12W and M8N socket sections of the Arecibo telescope” contains normalized 2D neutron projection images acquired over a range of specimen rotation angles for one selected region of each specimen. These projection images were used to reconstruct three-dimensional (3D) tomographic volumes that reveal the embedded-wire geometry and internal defects. The dataset titled “Bragg edge imaging (BEI) of B12W and M8N socket sections of the Arecibo telescope” contains six time-of-flight (TOF) neutron imaging datasets, three from each specimen, acquired at regions of interest selected based on the radiographs. The spatially resolved 2D TOF images show the zinc matrix and embedded steel wires, and the wavelength-dependent neutron transmission data were used to characterize crystallographic texture within the zinc. All components and their condition are in the public domain as they are the property of the National Science Foundation (NSF). The neutron imaging data, part geometries, and detailed forensic information have been widely published in the Arecibo Telescope Collapse Forensic Report by Thornton Tomasetti Engineers and others (NASA report and NASEM report).

Bilheux, Hassina↗

All Optical Neural Networks for Low Power Edge Computing

We developed a simplistic physics-based model of an all-optical neural network that mimics the encoder part of an autoencoder neural network for image compression. Our approach relies on the generation of a MATLAB-based model for both data compression and decompression and utilizes MATLAB's built-in autoencoder networks in combination with simple propagation of optical fields between layers constituting phase elements via Fourier transform. We optimize the phase elements using the particle swarm optimization technique and using our model, we demonstrate a compression ratio of 25% for 2828-pixel input images containing numeric digits from 0 to 9.

97 MATHEMATICS AND COMPUTING↗

Large-scale physically accurate modelling of real proton exchange membrane fuel cell with deep learning

Proton exchange membrane fuel cells, consuming hydrogen and oxygen to generate clean electricity and water, suffer acute liquid water challenges. Accurate liquid water modelling is inherently challenging due to the multi-phase, multi-component, reactive dynamics within multi-scale, multi-layered porous media. In addition, currently inadequate imaging and modelling capabilities are limiting simulations to small areas (<1 mm 2 ) or simplified architectures. Herein, an advancement in water modelling is achieved using X-ray micro-computed tomography, deep learned super-resolution, multi-label segmentation, and direct multi-phase simulation. The resulting image is the most resolved domain (16 mm 2 with 700 nm voxel resolution) and the largest direct multi-phase flow simulation of a fuel cell. This generalisable approach unveils multi-scale water clustering and transport mechanisms over large dry and flooded areas in the gas diffusion layer and flow fields, paving the way for next generation proton exchange membrane fuel cells with optimised structures and wettabilities.

25 ENERGY STORAGE↗

Evaluation of camera-based freehand SPECT in preoperative sentinel lymph node mapping for melanoma patients

Assessment of lymphatic status via sentinel lymph node (SLN) biopsy is an integral and crucial part of melanoma surgical oncology. The most common technique for sentinel node mapping is preoperative planar scintigraphy of an injected gamma-emitting lymphatic tracer followed by intraoperative node localization using a non-imaging gamma probe with auditory feedback. In recent years, intraoperative visualization of SLNs in 3D has become possible by coupling the probe to an external system capable of tracking its location and orientation as it is read out, thereby enabling computation of the 3D distribution of the tracer (freehand SPECT). In this project, the non-imaging probe of the fhSPECT system was replaced by a unique handheld gamma camera containing an array of sodium iodide crystals optically coupled to an array of silicon photomultipliers (SiPMs). A feasibility study was performed in which preoperative SLN mapping was performed using camera fhSPECT and the number of detected nodes was compared to that visualized by lymphoscintigraphy, probe fhSPECT, and to the number ultimately excised under non-imaging probe guidance. Among five subjects, SLNs were detected in nine lymphatic basins, with one to five SLNs detected per basin. A basin-by-basin comparison showed that the number of SLNs detected using camera fhSPECT exceeded that using lymphoscintigraphy and probe fhSPECT in seven of nine basins and five of five basins, respectively. (Probe fhSPECT scans were not performed for four basins.) It exceeded the number excised under non-imaging probe guidance for seven of nine basins and equaled the number excised for the other two basins. Freehand SPECT using a prototype SiPM-based gamma camera demonstrates high sensitivity for detection of SLNs in a preoperative setting. Camera fhSPECT is a potential means for efficiently obtaining real-time 3D activity distribution maps in applications such as image-guided percutaneous biopsy, and surgical SLN biopsy or radioguided tumor excision.

60 APPLIED LIFE SCIENCES↗

Artificial intelligence velocimetry and microaneurysm-on-a-chip for three-dimensional analysis of blood flow in physiology and disease

Significance Microfluidics is an important in vitro platform to gain insights into mechanics of blood flow and mechanisms of pathophysiology of human diseases. Extraction of 3D fields in microfluidics with dense cell suspensions remains a formidable challenge. We present artificial-intelligence velocimetry (AIV) as a general platform to determine 3D flow fields and a microaneurysm-on-a-chip to simulate blood flow in microaneurysms in patients with diabetic retinopathy. AIV is built on physics-informed neural networks that integrate seamlessly 2D images from microfluidic experiments or in vivo observations with physical laws to estimate full 3D velocity and stress fields. AIV could be integrated into imaging technologies to automatically infer key hemodynamic metrics from in vivo and in vitro biomedical images.

42 ENGINEERING↗

A tweezer array with 6,100 highly coherent atomic qubits

Optical tweezer arrays have transformed atomic and molecular physics, now forming the backbone for a range of leading experiments in quantum computing, simulation and metrology. Typical experiments trap tens to hundreds of atomic qubits and, recently, systems with around 1,000 atoms were realized without defining qubits or demonstrating coherent control. However, scaling to thousands of atomic qubits with long coherence times and low-loss and high-fidelity imaging is an outstanding challenge and critical for progress in quantum science, particularly towards quantum error correction (QEC). Here we experimentally realize an array of optical tweezers trapping more than 6,100 neutral atoms in around 12,000 sites, simultaneously surpassing state-of-the-art performance for several metrics that underpin the success of the platform. Specifically, while scaling to such a large number of atoms, we demonstrate a coherence time of 12.6(1) s, a record for hyperfine qubits in an optical tweezer array. We show room-temperature trapping lifetimes of about 23 min, enabling record-high imaging survival of 99.98952(1)% with an imaging fidelity of more than 99.99%. We present a plan for zone-based quantum computing and demonstrate necessary coherence-preserving qubit transport and pick-up/drop-off operations on large spatial scales, characterized through interleaved randomized benchmarking. Our results, along with recent developments, indicate that universal quantum computing and QEC with thousands to tens of thousands of physical qubits could be a near-term prospect.

atomic and molecular physics↗

Qualification and Quantification of Porosity at the Top of the Fuel Pins in Metallic Fuels Using Image Processing

Approximately 130,000 metal fuel pins were irradiated in the Experimental Breeder Reactor II (EBR-II) during its 30 years of operation to develop and characterize existing and prospective fuels. For many of the metal fuel irradiation experiments, neutron radiography imaging was performed to characterize fuel behavior, such as fuel axial expansion. While several fuel expansion results obtained from neutron radiography imaging have been published, the analysis of neutron radiography for the purpose of describing statistical properties of porous matter formed on top of the fuel pins, also referred to as fluff in previous publications, is significantly less represented in the literature with just a single paper so far. This study aims to validate and augment results reported in previous publications using automated image processing. The paper describes the statistical properties of the porous matter in terms of nine parameters derived from radiography images and correlates those parameters with such fuel properties as composition, expansion, temperature, and burnup. The reported results are based on 1097 fuel pins of eight different fuel compositions. For three major fuel types, U-10Zr, U-8Pu-10Zr, and U-19Pu-10Zr, a clear negative correlation is found between the Pu content and five parameters describing the amount of porous matter generated. The parameters describing granularity properties, however, showed either negative correlation or nonlinear dependency from fuel composition. The parameters describing the amount showed a positive correlation with fuel axial expansion, while granularity parameters showed a negative correlation with axial expansion. The dependency on cladding temperature was found to be weak. A positive correlation is demonstrated for volume parameters and fuel burnup. In general, reported results confirm and validate findings published in previous studies using a much larger number of pins and automated processing techniques, which easily lend themselves to reproducibility, thus avoiding subjective bias.

36 MATERIALS SCIENCE↗

Interlaboratory Study of Digital Volume Correlation Error Due to X-Ray Computed Tomography Equipment and Scan Parameters: an Update from the DVC Challenge

Background: The quality of Digital Volume Correlation (DVC) full-field displacement measurements depends directly on the characteristics of the X-ray Computed Tomography (XCT) equipment, and scan procedures used to acquire the tomographic images. Objective: In this work, we seek to experimentally study the effects of XCT equipment and tomographic scan procedures on the quality of these images for DVC analysis, and to survey the level of DVC error that may be achieved using standard XCT operating procedures. Methods: Six participants in an interlaboratory study acquired high-quality XCT scans of a syntactic foam before and after rigid body motion. The resulting images were correlated using commercial DVC software to quantify error sources due to random image noise, reconstruction artifacts, as well as systematic spatial or temporal distortion. Results: In the absence of rigid body motion, the standard deviation of the displacement measurements ranged from 0.012 to 0.043 voxels using a moderate subvolume size, indicating that subvoxel measurement resolution could readily be achieved with a variety of XCT equipment and scan recipes. Comparison of consecutive scans without rigid body motion showed transient dilatational displacement gradients due to self-heating of the X-ray source and/or thermal expansion of the foam. Evaluation of the scans after rigid body motion showed significant, machine-specific spatial distortion in the displacement fields of up to 0.5 voxels; new approaches to remove this error need to be developed. Conclusions: Analysis of the scan protocols used in the interlaboratory study, as well as a complementary parametric sensitivity study, showed that the DVC error was strongly influenced by the XCT equipment, but could be mitigated by adjusting the total scan duration.

47 OTHER INSTRUMENTATION↗

Identification of Metal Stresses in Arabidopsis thaliana Using Hyperspectral Reflectance Imaging

Industrial accidents, such as the Fukushima and Chernobyl disasters, release harmful chemicals into the environment, covering large geographical areas. Natural flora may serve as biological sensors for detecting metal contamination, such as cesium. Spectral detection of plant stresses typically employs a few select wavelengths and often cannot distinguish between different stress phenotypes. In this study, we apply hyperspectral reflectance imaging in the visible and near-infrared along with multivariate curve resolution (MCR) analysis to identify unique spectral signatures of three stresses in Arabidopsis thaliana : salt, copper, and cesium. While all stress conditions result in common stress physiology, hyperspectral reflectance imaging and MCR analysis produced unique spectral signatures that enabled classification of each stress. As the level of potassium was previously shown to affect cesium stress in plants, the response of A. thaliana to cesium stress under variable levels of potassium was also investigated. Increased levels of potassium reduced the spectral response of A. thaliana to cesium and prevented changes to chloroplast cellular organization. While metal stress mechanisms may vary under different environmental conditions, this study demonstrates that hyperspectral reflectance imaging with MCR analysis can distinguish metal stress phenotypes, providing the potential to detect metal contamination across large geographical areas.

multivariate curve resolution↗

Assessment of Dynamic Fracture in Ultra-High Performance Concrete Using Synchrotron X-ray Source

Ultra-high-performance concretes (UHPCs) retain higher ultimate (compressive) strengths and greater durability relative to traditional concrete materials. As a result, they are enabling construction materials for blast resistant structures, where a higher capacity for energy absorption is required. In past investigations, the strength of UHPCs was shown to retain a dependency on strain rate. Still, the failure mechanisms which govern this rate dependency have yet to be completely elucidated. In the current study, the dynamic fracture behavior of Cor-tuf UHPC was assessed, in-situ, using a Synchrotron X-ray source in phase contrast imaging (PCI) mode. Prior to testing, the material’s morphology was characterized using X-ray computed tomography (CT) and scanning electron microscopy (SEM). A polychromatic pulsed X-ray source, high-speed camera and Kolsky bar apparatus were used in tandem, to observe the transient failure modes. A pin was placed at the end of the incident bar to control the location of damage initiation, and tests were performed at a constant velocity of ~6 m/s. These test conditions were observed to yield cracks with median and/or cone like geometries. Despite the variation in the crack paths, a significant difference in peak load was not observed. The failure mode was also observed to depend on the microstructure of the concrete samples.

Kolsky bar↗

Time‐Lapse Image Classification Using a Diffractive Neural Network

Diffractive deep neural networks (D 2 NNs), comprised of spatially engineered passive surfaces, collectively process optical input information at the speed of light propagation through a thin diffractive volume, without any external computing power. Diffractive networks were demonstrated to achieve all‐optical object classification and perform universal linear transformations. Herein, a “time‐lapse” image classification scheme using a diffractive network is demonstrated for the first time, significantly advancing its classification accuracy and generalization performance on complex input objects by using the lateral movements of the input objects and/or the diffractive network, relative to each other. In a different context, such relative movements of the objects and/or the camera are routinely being used for image super‐resolution applications; inspired by their success, a time‐lapse diffractive network is designed to benefit from the complementary information content created by controlled or random lateral shifts. The design space and performance limits of time‐lapse diffractive networks are numerically explored, revealing a blind testing accuracy of 62.03% on the optical classification of objects from the CIFAR‐10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network on the CIFAR‐10 dataset. Time‐lapse diffractive networks will be broadly useful for the spatiotemporal analysis of input signals using all‐optical processors.

36 MATERIALS SCIENCE↗

Deep-Learning-Based Segmentation of Keyhole in In-Situ X-ray Imaging of Laser Powder Bed Fusion

In laser powder bed fusion processes, keyholes are the gaseous cavities formed where laser interacts with metal, and their morphologies play an important role in defect formation and the final product quality. The in-situ X-ray imaging technique can monitor the keyhole dynamics from the side and capture keyhole shapes in the X-ray image stream. Keyhole shapes in X-ray images are then often labeled by humans for analysis, which increasingly involves attempting to correlate keyhole shapes with defects using machine learning. However, such labeling is tedious, time-consuming, error-prone, and cannot be scaled to large data sets. To use keyhole shapes more readily as the input to machine learning methods, an automatic tool to identify keyhole regions is desirable. In this paper, a deep-learning-based computer vision tool that can automatically segment keyhole shapes out of X-ray images is presented. The pipeline contains a filtering method and an implementation of the BASNet deep learning model to semantically segment the keyhole morphologies out of X-ray images. The presented tool shows promising average accuracy of 91.24% for keyhole area, and 92.81% for boundary shape, for a range of test dataset conditions in Al6061 (and one AliSi10Mg) alloys, with 300 training images/labels and 100 testing images for each trial. Prospective users may apply the presently trained tool or a retrained version following the approach used here to automatically label keyhole shapes in large image sets.

36 MATERIALS SCIENCE↗

Homography generation for image registration in inlier-poor domains

A method for efficient image registration between two images in the presence of inlier-poor domains includes receiving a set of candidate correspondences between the two images. An approximate homography between the two images is generated based upon a first correspondence in the correspondences. The set of candidate correspondences is filtered to identify inlier correspondences based upon the approximate homography. A candidate homography is computed based upon the inlier correspondences. The candidate homography can be selected as a final homography between the two images based upon a support of the candidate homography against the set of candidate correspondences. An image registration is performed between the two images based upon the candidate homography being selected as the final homography.

Gonzales, Antonio↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

LoTToR: An Algorithm for Missing-Wedge Correction of the Low-Tilt Tomographic 3D Reconstruction of a Single-Molecule Structure (LoTToR) v1.0

The low-tilt tomographic reconstruction (LoTToR) method is a post-processing method to correct the missing-wedge artifact, which contains a model-free iteration process under a set of constraints in real and reciprocal spaces. A proof of concept is conducted by using the LoTToR on a phantom, i.e., a simulated 3D reconstruction from a low-tilt series of images, including that within a tilt range of ±15°. The method is validated by using both negative-staining (NS) and cryo-electron tomography (cryo-ET) experimental data. A significantly reduced missing-wedge artifact verifies the capability of LoTToR, suggesting a new tool to support the future study of macromolecular dynamics, fluctuation and chemical activity from the viewpoint of single-molecule 3D structure determination. Moreover, the software can be used for hospital computer tomography (CT) to reduce the radiation damage to patients without reducing the CT image quality.

Ren, Gang↗

Location generalizability of image-based air quality models

This paper is to be submitted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Computer Vision for Earth Observation workshop. The full paper abstract is below: The ability to rapidly quantify atmospheric pollutants is important both for global emissions monitoring and for mitigating the adverse effects that follow a hazardous chemical release. In the aftermath of a chemical release, imagery is often the only available resource to assess local conditions. Recent work has demonstrated initial success in predicting particulate matter pollution from imagery; however, these results are tied to a specific site and do not generalize to new geographic locations. In this work, we seek to understand how easily deep learning models generalize to new locations in the context of image-based air quality assessments, targeting two distinct tasks: (1) broad measures of particulate matter pollution, and (2) the mass of a given chemical released in hazardous plumes. For the latter, we focus on sulfur dioxide, a toxic aerosol and a major component of particulate matter pollution caused by industrial fossil fuel consumption. To develop a model that operates in the widest possible range of environments, we test different training strategies, including the use of new geolocation foundation models. The best performing models achieve >80% accuracy when evaluating unseen imagery at previously seen sites, but we find significant drops in performance when evaluating imagery from unseen sites, at best 65%. Additionally, we present the public release of the National Parks Air Quality Index Dataset, a new medium-sized dataset that pairs imagery with sensor-based air quality measurements at 15 different national parks.

Byler, Eleanor B. [BATTELLE (PACIFIC NW LAB)]↗

Iterative multi-task learning and inference from seismic images

Seismic interpretation aims to extract quantitative and interpretable attributes from a seismic image produced using some migration method to inform characteristics of a subsurface reservoir or target of interest. Current paradigms for computing seismic attributes mostly rely on single-task algorithms. We develop an iterative, multi-task machine learning method to learn and infer multiple attributes from a seismic image. This method is composed of two stages: a multi-task inference stage and a multi-modal, multi-task refinement stage. The basic mechanism of this method is that we train a multi-task inference neural network (NN) to estimate a set of attributes, including a relative geological time (RGT), a denoised higher-resolution (DHR) seismic image, and multiple fault attributes (including probability, dip, and strike), from a low-resolution, noisy seismic image; then we input the inferred attributes to a multi-task refinement NN to enhance the raw inference results iteratively. The two multi-task NNs are trained separately based on synthetic seismic images and associated attributes generated by a geological modeling algorithm. The software we intend to release is a PyTorch implementation of this multi-task learning method for both 2D and 3D cases along with scripts to run the training/validation. The algorithm and software can be a useful tool for automatic seismic interpretation.

Gao, Kai↗

Using Pilot Jobs and CernVM File System for Simplified Use of Containers and Software Distribution

High Energy Physics (HEP) experiments entail an abundance of computing resources, i.e. sites, to run simulations and analyses by processing data. This requirement is fulfilled by local batch farms, grid sites, private/commercial clouds, and supercomputing centers via High Throughput Computing (HTC). The growing needs of such experiments and resources being prone to trends of heterogeneity make it difficult for physicists to handle these resources directly. Additionally, HEP collaborations heavily rely on data and software releases, typically in the order of tens of gigabytes, while conducting simulations and analyses. Hence, aspects of scalability, reliability, and maintenance become crucial with regards to the distribution of the necessary data and software stack. The GlideinWMS [4] framework helps with the resource management problem by using pilot jobs, aka Glideins, to provision reliable elastic virtual clusters. Glideins are submitted to unreliable heterogeneous resources which are validated and customized by the Glideins to make the worker nodes available for end-user job execution. On the other hand, the CernVM File System (CernVM-FS or CVMFS) [1] helps with data distribution. It is a write-once, read-everywhere filesystem used to deploy scientific software to thousands of nodes on a worldwide distributed computing infrastructure. CVMFS is based on the Hyper Text Transfer Protocol and has been widely used within the particle physics community for (1) distributing experiment software and data such as calibrations, and (2) facilitating containerization by efficiently hosting container images along with providing containerization software, especially Singularity [3] GlideinWMS relies on CVMFS installed locally on the computing resources to satisfy the experiments' software needs. This requires system administrators' effort to install and maintain CVMFS at the sites and limits the use of sites, especially HPC resources, that do not have CVMFS installed. This poster presents a solution, taking advantage of Glideins to provide CVMFS at most sites without the need for a local installation. Doing so expands the pool of resources available for HEP experiments and reduces the effort of system administrators for current resources. Additionally, the proposed solution allows GlideinWMS to also start Singularity [3], a containerization software that can run unprivileged, on sites where neither CVMFS nor Singularity are available, including HPC sites. The benefits provided by this solution are: (1) lower overhead for site administrators in that they have less software to install, (2) an expanded pool of resources that run user jobs with easy access to software and data provided by CVMFS, thus making life easier for the scientists, and (3) improved flexibility to use HPC resources by enabling GlideinWMS pilot jobs to support HPC sites.

Urs, Namratha↗