Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

Bioimaging Science Program Principal Investigator Meetings Proceedings (2021)

As part of the 2021 Biological Systems Science Division (BSSD) Principal Investigator (PI) Meeting, the Bioimaging Science program (BSP), within BSSD's Biomolecular Characterization and Imaging Science portfolio, held its annual PI meeting virtually February 22–23. BSP's mission is to understand the translation of genomic information into the mechanisms that power living cells, communities of cells, and whole organisms. The goal of BSP is to develop new imaging and measurement technologies to visualize the spatial and temporal relationships of key metabolic processes governing phenotypic expression in plants and microbes. BSP convenes annual PI meetings to bring together its contributing investigators to review progress and current state-of-the-art bioimaging research. Holding the BSP meeting as part of the broader BSSD PI meeting allowed researchers to interact with the extended Genomic Science program community. This convergence provided a platform for networking and exchange of ideas, helping to forge new multidisciplinary collaborations among investigators from the two sister programs. An important highlight of the BSP meeting was the keynote presentation “Enhancing Fluorescence Microscopy with Computation” by Dr. Hari Shroff of the NIH National Institute of Biomedical Imaging and Bioengineering. All the BSP PIs made presentations describing their research focus and progress, and these were followed by roundtable discussions of each project. The meeting’s proceedings provide an outline of the program’s current state and potential future directions and opportunities.

59 BASIC BIOLOGICAL SCIENCES↗

Multimodal imaging and machine learning to enhance microscope images of shale

A machine learning based image processing workflow is presented to enhance shale source rock microscopic images obtained using diverse imaging platforms. Images were acquired from a 30 μm diameter cylindrical Vaca Muerta shale sample using both nondestructive Transmission X-Ray Microscopy (TXM, alternately referred to as nano computed tomography) and destructive Focused Ion Beam-Scanning Electron Microscopy (FIB-SEM). Output cross-sectional images from each modality were aligned using a combination of manual and automated registration techniques to create a registered image dataset. We then apply this dataset for two image processing tasks: prediction of image cross sections with SEM-like resolution from nondestructive TXM data and repair of charged region artifacts (localized accumulation of electrons) within SEM images. The image processing algorithms for both tasks use deep learning models, specifically image-to-image Convolutional Neural Networks (CNNs) and conditional Generative Adversarial Networks (cGANs). In the image enhancement tasks, we are able to achieve significant qualitative and quantitative improvement in TXM images. Here, the best model reaches an average Peak Signal to Noise Ratio (PSNR) of 15.8 dB. Conditioning on TXM data is also shown to reduce artifacts from SEM charging, achieving an average PSNR of 25.8 dB. Furthermore, our results suggest that properly trained and validated networks are capable of significant enhancement of images obtained using nondestructive techniques, thereby improving interpretation of two- and three-dimensional images while preserving samples for future use.

58 GEOSCIENCES↗

Web-based Preprocessing and Visualization of 3D FIB Tomography Data for Nuclear Fuel Characterization

Three-dimensional (3D) focused ion beam (FIB) tomography enables reconstruction of internal nuclear fuel features that can't be fully evaluated through surface imaging alone. This capability supports characterization of fuel constituents and defects under thermal and irradiation conditions relevant to microreactor development. However, large tomography datasets can create data-handling, loading, and visualization challenges, especially when image-stack preparation and file conversion must be completed with separate tools. The Computational Ultraspatial Tomography Toolkit for High-Resolution Object Analysis Tools (CUTTRHOAT) is an open-source web application being developed to display FIB tomography datasets available through the Nuclear Research Data System (NRDS). The current alpha version requires prepared HDF5 datasets and has limited integrated data-preparation capabilities. This project improves CUTTHROAT by adding dataset-folder selection, automatic input detection, dataset scanning, missing-slice identification, blank-slice insertion, and image-stack-to-HDF5 conversion. Two applications will be compared: the baseline CUTTHROAT alpha workflow and the updated application containing the integrated data-handling and preprocessing functions. Evaluation will consider dataset detection accuracy, conversion success, loading time, rendering responsiveness, application stability, and user interaction. Preliminary results demonstrate successful loading of existing HDF5 files and converted image stacks, while testing also identified performance reductions caused by excessive blank-slice generation. The updated workflow reduces reliance on external preparation tools and supports more direct movement from image stacks to color-code 3D visualization. Future work includes refining missing-slice handling, integrating additional preprocessing functions, like a denoising feature, parsing TIFF metadata for automatic voxel scaling, and adding manual X, Y, and Z voxel-spacing inputs for PNG and JPEG.

36 - MATERIALS SCIENCE↗

Utilizing computer vision and artificial intelligence algorithms to predict and design the mechanical compression response of direct ink write 3D printed foam replacement structures

Additive Manufacturing (AM) of porous polymeric materials, such as foams, recently became a topic of intensive research due their unique combination of low density, impressive mechanical properties, and stress dissipation capabilities. Conventional methods for fabricating foams rely on complex and stochastic processes, making it challenging to achieve precise architectural control of structured porosity. In contrast, AM provides access to a wide range of printable materials, where precise spatial control over structured porosity can be modulated during the fabrication process enabling the production of foam replacement structures (FRS). Current approaches for designing FRS are based on intuitive understanding of their properties or an extensive number of finite element method (FEM) simulations. These approaches, however, are computationally expensive and time consuming. As such, in this work, we present a novel methodology for determining the mechanical compression response of direct ink write (DIW) 3D printed FRS using a simple cross-sectional image. By obtaining measurement data for a relatively small number of samples, an artificial neural network (ANN) was trained, and a computer vision algorithm was used to make inferences about foam compression characteristics from a single cross-sectional image. Finally, a genetic algorithm (GA) was used to solve the inverse design problem, generating the AM printing parameters that an engineer should use to achieve a desired compression response from a DIW printed FRS. The methods developed herein present an avenue for entirely autonomous design and analysis of additively manufactured structures using artificial intelligence.

36 MATERIALS SCIENCE↗

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗

Application of deep neural networks to improve diagnostic accuracy of rheumatoid arthritis using diffuse optical tomography

A set of deep neural network models for rheumatoid arthritis (RA) classification using a highway network, a convolutional neural network and a residual network is proposed based on the data of diffuse optical tomography (DOT) utilising near-infrared light, which ensures early diagnosis of pathophysiological changes resulting from inflammation. A numerical model of the finger is used to generate images to overcome the inherent problem of insufficient clinical DOT images available. The proposed deep neural network models are applied to automatically classify simulated DOT images of inflamed and non-inflamed joints and transfer learning is also used to improve the performance of the classification. The results demonstrate that all three deep neural network methods improve the diagnostic accuracy as compared to the widely applied support vector machine (SVM), especially for high inter-subject variability databases. In cases of distinct modelled severity of disease, residual network achieved the highest accuracy (> 99 %), and both of highway and convolutional neural networks reached 99 %, respectively. However, as the severity of the modelled disease is reduced, this accuracy is reduced to 75.2 % for residual networks. The results indicate that transfer learning can improve the performance of deep neural network methods on RA classification from DOT data and highlight their potential as a computer aided tool in DOT diagnostic systems. (paper)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗

Stable parallel training of Wasserstein conditional generative adversarial neural networks

In this work, we propose a stable, parallel approach to train Wasserstein conditional generative adversarial neural networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques, our approach avoids inter-process communications, reduces the risk of mode collapse and enhances scalability by using multiple generators, each one of them concurrently trained on a single data label. The use of the Wasserstein metric also reduces the risk of cycling by stabilizing the training of each generator. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets, three standard benchmark image datasets, maintaining the original resolution of the images for each dataset. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources. To measure accuracy, we use the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks as well as an improvement of image quality of the new images created by the GANs approach. Weak scaling is attained on both datasets using up to 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗

Characterization of Porous Transport Layers Towards the Development of Efficient Proton Exchange Membrane Water Electrolysis

The current goals for implementing the hydrogen economy have highlighted a need to further optimize water-splitting technologies for clean hydrogen production. Proton exchange membrane water electrolysis (PEMWE) is a leading technology, but further optimizations of anode materials including the porous transport layer (PTL) and the adjacent catalyst layer (CL) are required to increase overall cell performance and reduce cost. This literature review describes advances in PTL development and characterization, highlighting early PTL characterization work and most common methods including capillary flow porometry and mercury intrusion porometry, optical imaging, neutron and x-ray radiography, and x-ray computed tomography. The article also discusses PTL protective coatings and their characterizations, focusing on platinum group metal (PGM)-based coatings, alternative non-PGM-based coatings, post-treated PTLs, and investigations into thin PGM-based coatings. Furthermore, it highlights the integration of the PTL and the adjacent CL along with associated characterization challenges. Lastly, this review discusses future developments in the characterization needed to improve PEMWE's performance and long-term durability are discussed.

08 HYDROGEN↗

Evaluation of a Variable-Aperture Full-Ring SPECT System using Large-Area Pixelated CZT Modules: A Simulation Study for Brain SPECT Applications

Single photon emission computed tomography (SPECT) scanner using cadmium zinc telluride (CZT) offers improved imaging capability over conventional NaI (Tl)-based SPECT scanner. We aim to demonstrate a full-ring SPECT system design with eight large-area CZT detectors that can be used for a broad spectrum of SPECT radiopharmaceuticals and provides higher sensitivity and better spatial resolution than those of conventional NaI (Tl)-based gamma cameras. A newly-designed full-ring SPECT system is composed of 8 large-area CZT cameras (128 mm × 179.2 mm effective area) that can be independently swiveled around their own axes of rotation independently and can have radial motion for varying aperture sizes that can be adapted to different sizes of imaging volume. Extended projection data were generated by conjoining projections of two adjacent detectors to overcome the limited field-of-view (FOV) by each CZT camera. Using Monte Carlo simulations, we evaluated this new system design with digital phantoms including a Derenzo hot-rod phantom and a Zubal brain phantom. Comparison of performance metrics such as spatial resolution, sensitivity, contrast-to-noise ratio (CNR), and contrast-recovery ratio were made between our design and a conventional SPECT scanner. The proposed scanner could result in up to about 3 times faster in acquisition time over conventional scan time at same acquisition time per step. The spatial resolution of our proposed scanner was similar or better to that of the conventional scanner, and there was significant performance improvement over the conventional scanner particularly in sensitivity (approximately 4 times). Overall, we successfully reconstructed the phantom image for both 99 mTc-based perfusion and 123 I-based dopamine transporter (DaT) brain studies simulated for our new design. In particular, the striatal/background contrast-recovery ratio in 3-to-1 reference ratio was over the 0.8 for the 123 I-based DaT study. In conclusion, we demonstrated the potential of our new full-ring CZT SPECT design, showing improved performance metrics such as improved system sensitivity and CNR while maintaining other important imaging parameters such as spatial resolution.

36 MATERIALS SCIENCE↗

It’s Not What You Take Up, It’s What You Keep: How Discoveries from Diverse Disciplines Directed the Development of the FDG PET/CT Scan

Although imaging glucose metabolism with positron emission tomography combined with X-ray CT (FDG-PET/CT) has become a standard diagnostic modality for the discovery and surveillance of malignant tumors and inflammatory processes, its origins extend back to more than a century of notable discoveries in the fields of inorganic and organic chemistry, nuclear physics, mathematics, biochemistry, solute transport physiology, metabolism, and imaging, accomplished by pioneering and driven investigators, of whom at least ten were recipients of the Nobel Prize. These tangled and diverse roots eventually coalesced into the FDG-PET/CT method, that through its many favorable characteristics inherent in the isotope used ( 18 F), the accurate imaging derived from coincidence detection of positron annihilation radiation combined with computed tomography, and the metabolic trapping of 2-deoxy-2-[ 18 F] fluoro-d-glucose (FDG) in tissues, provides safety, sensitivity, and specificity for tumor and inflammation detection. Here, the authors hope that this article will increase the appreciation among its readers of the insight, creativity, persistence, and drive of the many investigators who made this technique possible. This article is followed by a review of the many applications of FDG-PET/CT to the gastrointestinal tract and hepatobiliary system (Mandelkern in Dig Dis Sci 2022)

2-DG↗

X-ray computed tomography-based porosity analysis: Algorithms and application for porous woody biomass

The properties of lignocellulosic biomass, such as bulk physical, thermal, and mechanical properties, as well as the mobility of enzymes or catalysts, are largely affected by porosity, pore structures, and pore size distribution. While X-ray computed tomography (CT) has been introduced to effectively produce 3D volumetric images of material microstructure, a quantitative porosity analysis from the 3D images has never been done. This work introduces a first-of-its-kind X-ray CT-based quantitative porosity analysis method and applies the developed toolkit to characterize the internal porosity distribution of loblolly pine. A sample loblolly pine chip was scanned by a nano-resolution X-ray CT system and digitally reconstructed after a sequence of image processing operations. Here, a comprehensive porosity analysis was then performed to quantify the envelope porosity, the spatial distribution of local porosity, and the directional porosity. Solutions to the various challenges in image processing, porosity calculation, and large data handling are provided.

42 ENGINEERING↗

Processing Full-Scale Square Kilometre Array Data on the Summit Supercomputer

This work presents a workflow for simulating and processing the full-scale low-frequency telescope data of the Square Kilometre Array (SKA) Phase 1. The SKA project will enter the construction phase soon, and once completed, it will be the world’s largest radio telescope and one of the world’s largest data generators. The authors used Summit to mimic an endto-end SKA workflow, simulating a dataset of a typical 6 hour observation and then processing that dataset with an imaging pipeline. This workflow was deployed and run on 4,560 compute nodes, and used 27,360 GPUs to generate 2.6 PB of data. This was the first time that radio astronomical data were processed at this scale. Results show that the workflow has the capability to process one of the key SKA science cases, an Epoch of Reionization observation. This analysis also helps reveal critical design factors for the next-generation radio telescopes and the required dedicated processing facilities.

Wang, Ruonan↗