Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

MIGHTEE: total intensity radio continuum imaging and the COSMOS/XMM-LSS Early Science fields

ABSTRACT MIGHTEE is a galaxy evolution survey using simultaneous radio continuum, spectropolarimetry, and spectral line observations from the South African MeerKAT telescope. When complete, the survey will image ∼20 deg2 over the COSMOS, E-CDFS, ELAIS-S1, and XMM-Newton Large Scale Structure field (XMM-LSS) extragalactic deep fields with a central frequency of 1284 MHz. These were selected based on the extensive multiwavelength data sets from numerous existing and forthcoming observational campaigns. Here, we describe and validate the data processing strategy for the total intensity continuum aspect of MIGHTEE, using a single deep pointing in COSMOS (1.6 deg2) and a three-pointing mosaic in XMM-LSS (3.5 deg2). The processing includes the correction of direction-dependent effects, and results in thermal noise levels below 2 $\mathrm{\mu }$Jy beam−1 in both fields, limited in the central regions by classical confusion at ∼8 arcsec angular resolution, and meeting the survey specifications. We also produce images at ∼5 arcsec resolution that are ∼3 times shallower. The resulting image products form the basis of the Early Science continuum data release for MIGHTEE. From these images we extract catalogues containing 9896 and 20 274 radio components in COSMOS and XMM-LSS, respectively. We also process a close-packed mosaic of 14 additional pointings in COSMOS and use these in conjunction with the Early Science pointing to investigate methods for primary beam correction of broad-band radio images, an analysis that is of relevance to all full-band MeerKAT continuum observations, and wide-field interferometric imaging in general. A public release of the MIGHTEE Early Science continuum data products accompanies this article.

Heywood, I. (ORCID:0000000168645057)↗
DOE OSTI2022

Realistic galaxy image simulation via score-based generative models

ABSTRACT We show that a denoising diffusion probabilistic model (DDPM), a class of score-based generative model, can be used to produce realistic mock images that mimic observations of galaxies. Our method is tested with Dark Energy Spectroscopic Instrument (DESI) grz imaging of galaxies from the Photometry and Rotation curve OBservations from Extragalactic Surveys (PROBES) sample and galaxies selected from the Sloan Digital Sky Survey. Subjectively, the generated galaxies are highly realistic when compared with samples from the real data set. We quantify the similarity by borrowing from the deep generative learning literature, using the ‘Fréchet inception distance’ to test for subjective and morphological similarity. We also introduce the ‘synthetic galaxy distance’ metric to compare the emergent physical properties (such as total magnitude, colour, and half-light radius) of a ground truth parent and synthesized child data set. We argue that the DDPM approach produces sharper and more realistic images than other generative methods such as adversarial networks (with the downside of more costly inference), and could be used to produce large samples of synthetic observations tailored to a specific imaging survey. We demonstrate two potential uses of the DDPM: (1) accurate inpainting of occluded data, such as satellite trails, and (2) domain transfer, where new input images can be processed to mimic the properties of the DDPM training set. Here we ‘DESI-fy’ cartoon images as a proof of concept for domain transfer. Finally, we suggest potential applications for score-based approaches that could motivate further research on this topic within the astronomical community.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

2022 Prentice Award Lecture: Advancing Retinal Imaging and Visual Function in Patient Management and Disease Mechanisms

Patient-based research plays a key role in probing basic visual mechanisms. Less-well recognized is the role of patient-based retinal imaging and visual function studies in elucidating disease mechanisms, which are accelerated by advances in imaging and function techniques and are most powerful when combined with the results from histology and animal models. A patient's visual complaints can be one key to patient management, but human data are also key to understanding disease mechanisms. Unfortunately, pathological changes can be difficult to detect. Before advanced retinal imaging, the measurement of visual function indicated the presence of pathological changes that were undetectable with existing clinical examination. Over the past few decades, advances in retinal imaging have increasingly revealed the unseen. This has led to great strides in the management of many diseases, particularly diabetic retinopathy and macular edema, and age-related macular degeneration. It is likely widely accepted that patient-based research, as in clinical trials, led to such positive outcomes. Both visual function measures and advanced retinal imaging have clearly demonstrated differences among retinal diseases. Contrary to initial thinking, sight-threatening damage in diabetes occurs to the outer retina and not only to the inner retina. This has been clearly indicated in patient results but has only gradually entered the clinical classifications and understanding of disease etiology. There is strikingly different pathophysiology for age-related macular degeneration compared with photoreceptor and retinal pigment epithelial genetic defects, yet research models and even some treatments confuse these. It is important to recognize the role that patient-based research plays in probing basic visual mechanisms and elucidating disease mechanisms, combining these findings with the concepts from histology and animal models. Thus, this article combines sample instrumentation from my laboratory and progress in the fields of retinal imaging and visual function.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Direct detection of dark matter substructure in strong lens images with convolutional neural networks

Strong gravitational lensing is a potential way of uncovering the nature of dark matter, by finding perturbations to images that cannot be accounted for well by modeling the lens galaxy without additional structure, be it subhalos (smaller halos within the smooth lens) or line-of-sight (LOS) halos. Here, we introduce results attempting to infer the presence of substructure from images without requiring an intermediate step in which a smooth model has to be subtracted, using a simple convolutional neural network (CNN). We find that the network is only able to infer the presence of subhalos with greater than 75% accuracy when they have masses of greater than or equal to 5 × 10 9 M ⊙ if they lie within the main lens galaxy. Since less massive foreground LOS halos can have the same effect as higher-mass subhalos, the CNN can probe lower masses in the halo mass function. The accuracy does not improve significantly if we add a population of less massive subhalos. With the expectation of experiments such as Hubble Space Telescope and Euclid yielding thousands of high-quality strong lensing images in the next years, having a way of analyzing images quickly to identify candidates that merit further analysis to determine individual subhalo properties while preventing extensive resources being used for images that would yield null detections could be very useful. By understanding the sensitivity as a function of substructure mass, nondetections could be combined with the information from images with substructure to constrain the cold dark matter scenario, in particular if the sensitivity can be pushed to lower masses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Proton imaging of high-energy-density laboratory plasmas

Proton imaging has become a key diagnostic for measuring electromagnetic fields in high-energy-density (HED) laboratory plasmas. Compared to other techniques for diagnosing fields, proton imaging is a measurement that can simultaneously offer high spatial and temporal resolution and the ability to distinguish between electric and magnetic fields without the protons perturbing the plasma of interest. Consequently, proton imaging has been used in a wide range of HED experiments, from inertial-confinement fusion to laboratory astrophysics. An overview is provided on the state of the art of proton imaging, including a discussion of experimental considerations like proton sources and detectors, the theory of proton-imaging analysis, and a survey of experimental results demonstrating the breadth of applications. As a result, topics at the frontiers of proton-imaging development are also described, along with an outlook on the future of the field.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Bragg Spot Finder (BSF): a new machine-learning-aided approach to deal with spot finding for rapidly filtering diffraction pattern images

Macromolecular crystallography contributes significantly to understanding diseases and, more importantly, how to treat them by providing atomic resolution 3D structures of proteins. This is achieved by collecting X-ray diffraction images of protein crystals from important biological pathways. Spotfinders are used to detect the presence of crystals with usable data, and the spots from such crystals are the primary data used to solve the relevant structures. Having fast and accurate spot finding is essential, but recent advances in synchrotron beamlines used to generate X-ray diffraction images have brought us to the limits of what the best existing spotfinders can do. This bottleneck must be removed so spotfinder software can keep pace with the X-ray beamline hardware improvements and be able to see the weak or diffuse spots required to solve the most challenging problems encountered when working with diffraction images. In this paper, we first present Bragg Spot Detection (BSD), a large benchmark Bragg spot image dataset that contains 304 images with more than 66 000 spots. We then discuss the open source extensible U-Net-based spotfinder Bragg Spot Finder (BSF), with image pre-processing, a U-Net segmentation backbone, and post-processing that includes artifact removal and watershed segmentation. Finally, we perform experiments on the BSD benchmark and obtain results that are (in terms of accuracy) comparable to or better than those obtained with two popular spotfinder software packages ( Dozor and DIALS ), demonstrating that this is an appropriate framework to support future extensions and improvements.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Beamline K11 DIAD: a new instrument for dual imaging and diffraction at Diamond Light Source

The Dual Imaging and Diffraction (DIAD) beamline at Diamond Light Source is a new dual-beam instrument for full-field imaging/tomography and powder diffraction. This instrument provides the user community with the capability to dynamically image 2D and 3D complex structures and perform phase identification and/or strain mapping using micro-diffraction. The aim is to enable in situ and in operando experiments that require spatially correlated results from both techniques, by providing measurements from the same specimen location quasi-simultaneously. Using an unusual optical layout, DIAD has two independent beams originating from one source that operate in the medium energy range (7–38 keV) and are combined at one sample position. Here, either radiography or tomography can be performed using monochromatic or pink beam, with a 1.4 mm × 1.2 mm field of view and a feature resolution of 1.2 µm. Micro-diffraction is possible with a variable beam size between 13 µm × 4 µm and 50 µm × 50 µm. One key functionality of the beamline is image-guided diffraction, a setup in which the micro-diffraction beam can be scanned over the complete area of the imaging field-of-view. This moving beam setup enables the collection of location-specific information about the phase composition and/or strains at any given position within the image/tomography field of view. The dual beam design allows fast switching between imaging and diffraction mode without the need of complicated and time-consuming mode switches. Real-time selection of areas of interest for diffraction measurements as well as the simultaneous collection of both imaging and diffraction data of (irreversible) in situ and in operando experiments are possible.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Methods for In Situ Electroluminescence Imaging of Photovoltaic Modules Under Varying Environmental Conditions

Electroluminescence (EL) imaging is a powerful tool used to identify defects in photovoltaic solar cells. Typically, this type of characterization is performed in the dark using a current injection that equals short-circuit current measured at standard test conditions (STC). Restricting imaging to such a temperature range limits the information obtained about the module and cells. However, it is not trivial to develop a tool that would allow for EL imaging to be performed under a wider range of temperatures. Here we demonstrate an in situ EL imaging capability developed within an environmental chamber that allows for control of sample temperatures between –40 and 90 °C. Additionally, we demonstrate EL imaging of 4-cell mini-modules (MiMo) under front-side mechanical loading. A Raspberry Pi-connected camera with short-pass filter removed is used for EL imaging. The camera is low-cost with a small form-factor, appropriate for use in a harsh, enclosed environment. The camera is installed within a thermally isolating housing mounted within the environmental chamber. Three example cases are given for MiMos that exhibit various forms of degradation including solder fatigue and cell cracking. It is shown that by measuring at conditions above and below STC, different behaviors may be identified. In some cases, restricting characterization to STC may lead to a failure to detect damage existing in the sample.

14 SOLAR ENERGY↗
DOE OSTI2023

Automatic Crack Segmentation and Feature Extraction in Electroluminescence Images of Solar Modules

The effect of cracks in solar cells on the long-term degradation of photovoltaic (PV) modules remains to be determined. To investigate this effect in future studies, it is necessary to quantitatively describe the crack features (e.g., length) and correlate them with module power loss. Electroluminescence (EL) imaging is a common technique for identifying cracks. However, it is currently challenging and time-consuming to identify cracks in a large number of EL images and quantify complex crack features by human inspection. This article introduces a fast semantic segmentation method (~0.18 s/cell) to automatically segment cracks from EL images and algorithms to extract crack features. Here we fine-tuned a UNet neural network model using pretrained VGG16 as the encoder and obtained an average F1 score of 0.875 and an intersection over union score of 0.782 on the testing set. With cracks and busbars segmented, we developed algorithms for extracting crack features, including the crack-isolated area, the brightness inside the isolated area, and the crack length. We also developed an automatic preprocessing tool for cropping individual cell images from EL images of PV modules (~0.72 s/module). Our codes are published as open-source an software, and our annotated dataset composed of various types of cells is published as a benchmark for crack segmentation in EL images.

14 SOLAR ENERGY↗
DOE OSTI2020

Interactive Visual Study of Multiple Attributes Learning Model of X-Ray Scattering Images

Existing interactive visualization tools for deep learning are mostly applied to the training, debugging, and refinement of neural network models working on natural images. However, visual analytics tools are lacking for the specific application of x-ray image classification with multiple structural attributes. In this paper, we present an interactive system for domain scientists to visually study the multiple attributes learning models applied to x-ray scattering images. It allows domain scientists to interactively explore this important type of scientific images in embedded spaces that are defined on the model prediction output, the actual labels, and the discovered feature space of neural networks. Users are allowed to flexibly select instance images, their clusters, and compare them regarding the specified visual representation of attributes. The exploration is guided by the manifestation of model performance related to mutual relationships among attributes, which often affect the learning accuracy and effectiveness. The system thus supports domain scientists to improve the training dataset and model, find questionable attributes labels, and identify outlier images or spurious data clusters. Case studies and scientists feedback demonstrate its functionalities and usefulness.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fast widefield imaging of neuronal structure and function with optical sectioning in vivo

Optical microscopy, owing to its noninvasiveness and subcellular resolution, enables in vivo visualization of neuronal structure and function in the physiological context. Optical-sectioning structured illumination microscopy (OS-SIM) is a widefield fluorescence imaging technique that uses structured illumination patterns to encode in-focus structures and optically sections 3D samples. However, its application to in vivo imaging has been limited. In this study, we optimized OS-SIM for in vivo neural imaging. We modified OS-SIM reconstruction algorithms to improve signal-to-noise ratio and correct motion-induced artifacts in live samples. Incorporating an adaptive optics (AO) module to OS-SIM, we found that correcting sample-induced optical aberrations was essential for achieving accurate structural and functional characterizations in vivo. With AO OS-SIM, we demonstrated fast, high-resolution in vivo imaging with optical sectioning for structural imaging of mouse cortical neurons and zebrafish larval motor neurons, and functional imaging of quantal synaptic transmission at Drosophila larval neuromuscular junctions.

42 ENGINEERING↗
DOE OSTI2022

RASER MRI: Magnetic resonance images formed spontaneously exploiting cooperative nonlinear interaction

The spatial resolution of magnetic resonance imaging (MRI) is limited by the width of Lorentzian point spread functions associated with the transverse relaxation rate 1/T 2 * . Here, we show a different contrast mechanism in MRI by establishing RASER (radio-frequency amplification by stimulated emission of radiation) in imaged media. RASER imaging bursts emerge out of noise and without applying radio-frequency pulses when placing spins with sufficient population inversion in a weak magnetic field gradient. Small local differences in initial population inversion density can create stronger image contrast than conventional MRI. This different contrast mechanism is based on the cooperative nonlinear interaction between all slices. On the other hand, the cooperative nonlinear interaction gives rise to imaging artifacts, such as amplitude distortions and side lobes outside of the imaging domain. Contrast mechanism and artifacts are explored experimentally and predicted by simulations on the basis of a proposed RASER MRI theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Super-resolution image display using diffractive decoders

High-resolution image projection over a large field of view (FOV) is hindered by the restricted space-bandwidth product (SBP) of wavefront modulators. We report a deep learning–enabled diffractive display based on a jointly trained pair of an electronic encoder and a diffractive decoder to synthesize/project super-resolved images using low-resolution wavefront modulators. The digital encoder rapidly preprocesses the high-resolution images so that their spatial information is encoded into low-resolution patterns, projected via a low SBP wavefront modulator. The diffractive decoder processes these low-resolution patterns using transmissive layers structured using deep learning to all-optically synthesize/project super-resolved images at its output FOV. This diffractive image display can achieve a super-resolution factor of ~4, increasing the SBP by ~16-fold. We experimentally validate its success using 3D-printed diffractive decoders that operate at the terahertz spectrum. This diffractive image decoder can be scaled to operate at visible wavelengths and used to design large SBP displays that are compact, low power, and computationally efficient.

36 MATERIALS SCIENCE↗
DOE OSTI2024

High-Throughput Computing: Case Study of Medical Image Processing Applications

HPC is designed for large-scale simulations using monolithic codes of tightly coupled processes highly optimized to deliver decreased time to solution. Medical image processing is not a traditional field of HPC. Similar to AI applications, medical image processing parses large datasets, typically multiple times, to support a variety of studies for classification, diagnosis or monitoring purposes. The convergence of AI, HPC and Big Data encouraged more fields using image processing to transition to HPC. However, not all applications benefit from the same optimizations. In this paper we focus on high throughput medical image processing applications that analyze a huge dataset of small MRI images and that require HPC systems to decrease the time of parsing the entire dataset and not individual MRIs. We show in this research the performance of running SLANT, an image processing application for a whole brain segmentation, on large-scale systems and highlight performance limitations. We present optimizations prioritizing throughput that exhibit a 3.5x speed-up on the Summit Supercomputer that can be used as a baseline for building a high-throughput execution framework for other HPC systems.

Predescu, Maria↗
DOE OSTI2021

A Review of Doses for Dental Imaging in 2010–2020 and Development of a Web Dose Calculator

Dental imaging is one of the most common types of diagnostic radiological procedures in modern medicine. We introduce a comprehensive table of organ doses received by patients in dental imaging procedures extracted from literature and a new web application to visualize the summarized dose information. We analyzed articles, published after 2010, from PubMed on organ and effective doses delivered by dental imaging procedures, including intraoral radiography, panoramic radiography, and cone-beam computed tomography (CBCT), and summarized doses by dosimetry method, machine model, patient age, and technical parameters. Mean effective doses delivered by intraoral, 1.32 (0.60–2.56) μSv, and panoramic, 17.93 (3.47–75.00) μSv, procedures were found to be about1% and 15% of that delivered by CBCT, 121.09 (17.10–392.20) μSv, respectively. In CBCT imaging, child phantoms received about 29% more effective dose than the adult phantoms received. The effective dose of a large field of view (FOV) (>150 cm2) was about 1.6 times greater than that of a small FOV (<50 cm2). The maximum CBCT effective dose with a large FOV for children, 392.2 μSv, was about 13% of theeffective dose that a person receives on average every year from natural radiation, 3110 μSv. Monte Carlo simulations of representative cases of the three dental imaging procedures were then conducted to estimate and visualize the dose distribution within the head. The user-friendly interactive web application (available at http://dentaldose.org) receives user input, such as the number of intraoral radiographs taken, and displays total organ and effective doses, dose distribution maps, and a comparison with other medical and natural sources of radiation. The web dose calculator provides a practical resource for patients interested in understanding the radiation doses delivered by dental imaging procedures.

Lee, Hawon↗
DOE OSTI2026

Hyperdimensional computing for image classification (HDC) v1.0

This is an implementation of the hyperdimensional computing technique to classify images. It consists of a python script that trains the system for a set of images from a set of images (dataset) specified by the user. This training produces hardware configuration parameters and description vectors that are then loaded into the hardware description part of the project. The hardware description consists of hardware described in Verilog (a well known language for this purpose) that is synthesizable and can be implemented in a real chip. This hardware received the training information generated by python, and then is able to accept images to produce answers for each image on which category (class) from the pre-=trained ones the image belongs to. The hardware and python training scripts are configurable and documented. The advantage of hyperdimensional computing is its robustness to errors and the easy capability for online learning (refining the training during inference slowly over time), which this implementation supports.

Michelogiannakis, Georgios [Lawrence Berkeley Nati↗
DOE OSTI2023

Machine learning and deep learning for brain tumor MRI image segmentation

Brain tumors are often fatal. Therefore, accurate brain tumor image segmentation is critical for the diagnosis, treatment, and monitoring of patients with these tumors. Magnetic resonance imaging (MRI) is a commonly used imaging technique for capturing brain images. Both machine learning and deep learning techniques are popular in analyzing MRI images. This article reviews some commonly used machine learning and deep learning techniques for brain tumor MRI image segmentation. The limitations and advantages of the reviewed machine learning and deep learning methods are discussed. Even though each of these methods has a well-established status in their individual domains, the combination of two or more techniques is currently an emerging trend.

Research & Experimental Medicine↗
DOE OSTI2022

Installation and imaging of thousands of minirhizotrons to phenotype root systems of field-grown plants

Roots are vital to plant performance because they acquire resources from the soil and provide anchorage. However, it remains difficult to assess root system size and distribution because roots are inaccessible in the soil. Existing methods to phenotype entire root systems range from slow, often destructive, methods applied to relatively small numbers of plants in the field to rapid methods that can be applied to large numbers of plants in controlled environment conditions. Much has been learned recently by extensive sampling of the root crown portion of field-grown plants. But, information on large-scale genetic and environmental variation in the size and distribution of root systems in the field remains a key knowledge gap. Minirhizotrons are the only established, non-destructive technology that can address this need in a standard field trial. Prior experiments have used only modest numbers of minirhizotrons, which has limited testing to small numbers of genotypes or environmental conditions. This study addressed the need for methods to install and collect images from thousands of minirhizotrons and thereby help break the phenotyping bottleneck in the field. Over three growing seasons, methods were developed and refined to install and collect images from up to 3038 minirhizotrons per experiment. Modifications were made to four tractors and hydraulic soil corers mounted to them. High quality installation was achieved at an average rate of up to 84.4 minirhizotron tubes per tractor per day. A set of four commercially available minirhizotron camera systems were each transported by wheelbarrow to allow collection of images of mature maize root systems at an average rate of up to 65.3 tubes per day per camera. This resulted in over 300,000 images being collected in as little as 11 days for a single experiment. The scale of minirhizotron installation was increased by two orders of magnitude by simultaneously using four tractor-mounted, hydraulic soil corers with modifications to ensure high quality, rapid operation. Image collection can be achieved at the corresponding scale using commercially available minirhizotron camera systems. Along with recent advances in image analysis, these advances will allow use of minirhizotrons at unprecedented scale to address key knowledge gaps regarding genetic and environmental effects on root system size and distribution in the field.

54 ENVIRONMENTAL SCIENCES↗