Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Data fusion enhanced multi-modality wellbore integrity inspection system

A downhole multi-modality inspection system includes a first imaging device operable to generate first imaging data and a second imaging device operable to generate second imaging data. The first imaging device includes a first source operable to emit energy of a first modality, and a first detector operable to detect returning energy induced by the emitted energy of the first modality. The second imaging device includes a second source operable to emit energy of a second modality, and a second detector operable to detect returning energy induced by the emitted energy of the second modality. The system further includes a processor configured to receive the first imaging data and the second imaging data, and integrate the first imaging data with the second imaging data into an enhanced data stream. The processor correlates the first imaging data and the second imaging data to provide enhanced data for detecting potential wellbore anomalies.

Kasten, Ansas Matthias↗

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗

2D-to-3D image translation of complex nanoporous volumes using generative networks

Image-based characterization offers a powerful approach to studying geological porous media at the nanoscale and images are critical to understanding reactive transport mechanisms in reservoirs relevant to energy and sustainability technologies such as carbon sequestration, subsurface hydrogen storage, and natural gas recovery. Nanoimaging presents a trade off, however, between higher-contrast sample-destructive and lower-contrast sample-preserving imaging modalities. Furthermore, high-contrast imaging modalities often acquire only 2D images, while 3D volumes are needed to characterize fully a source rock sample. In this work, we present deep learning image translation models to predict high-contrast focused ion beam-scanning electron microscopy (FIB-SEM) image volumes from transmission X-ray microscopy (TXM) images when only 2D paired training data is available. We introduce a regularization method for improving 3D volume generation from 2D-to-2D deep learning image models and apply this approach to translate 3D TXM volumes to FIB-SEM fidelity. We then segment a predicted FIB-SEM volume into a flow simulation domain and calculate the sample apparent permeability using a lattice Boltzmann method (LBM) technique. Results show that our image translation approach produces simulation domains suitable for flow visualization and allows for accurate characterization of petrophysical properties from non-destructive imaging data.

58 GEOSCIENCES↗

Co-notch and independent windowing to mitigate interference in SAR-based imagery

Various technologies for mitigating distortion in coherent image products generated from SAR data are described herein. Synthetic aperture radar (SAR) datasets generated based upon SAR returns from first and second passes of a SAR platform over a scene are received. The SAR datasets can be co-notched at matching sample indices to improve coherence of SAR images generated from the datasets. Windowed SAR data is generated by applying independent windows to subsets of each of the datasets to reduce sidelobe levels of their image impulse responses. Coherent image products are generated based upon the windowed SAR data, wherein an image quality of the coherent image products is improved as compared to coherent image products generated based upon the SAR datasets.

47 OTHER INSTRUMENTATION↗

Image-driven discriminative and generative machine learning algorithms for establishing microstructure–processing relationships

We investigate methods of microstructure representation for the purpose of predicting processing condition from microstructure image data. A binary alloy that is currently under development as a nuclear fuel was studied for the purpose of developing an improved machine learning approach to image recognition, characterization, and building predictive capabilities linking microstructure to processing conditions. Here, we test different microstructure representations and evaluate model performance based on classification accuracy. A classification accuracy of 95.8% was achieved fordistinguishing between micrographs corresponding to ten different thermo-mechanical material processing conditions.We find that our newly developed microstructure representation describes image data well, and the traditional approachof utilizing area fractions of different phases is insufficient for distinguishing between multiple classes using a relativelysmall, imbalanced original data set of 272 images. To explore the applicability of generative methods for supplementing such limited data sets, generative adversarial networks were trained to generate artificial microstructure images. Two different generative networks were trained and tested to assess performance. Challenges and best practices associated with applying machine learning to limited microstructure image data sets is also discussed. Our work has implications for quantitative microstructure analysis, and development of microstructure-processing relationships in limited data sets typical of metallurgical process design studies.

36 MATERIALS SCIENCE↗

System and method for x-ray compatible 2D streak camera for a snapshot multiframe imager

The present disclosure is directed to a snapshot multiframe imager having an aperture element having at least one aperture, an adjacently positioned random mask, an imaging element and a computer. The random mask has a plurality of micron scale apertures and receives light passing through the aperture element, which represents the spatial information from the scene being imaged, and generates a plurality of image frames encoded in a spatial domain. The imaging element may operate in a drift-scan mode receives the encoded image frames and generates a streaked pattern of electrons representing a plurality of images of the scene at a plurality of different times. The computer analyzes the streaked pattern of electrons and mathematically reconstructs the plurality of images.

Dayton, Matthew S.↗

Ghost imaging second harmonic generation microscopy

Second harmonic generation (SHG) microscopy is useful for visualizing interfaces and sub-structures within a wide range of materials due to the propensity for SHG to occur in non-centrosymmetric environments. However, since SHG is a nonlinear process generally necessitating small focal sizes for higher peak powers, a raster scanning approach is usually needed to build an SHG image over a significant sample size. While raster scanning is effective, there is a cost in terms of the time needed to acquire the image and, also, some materials cannot withstand the higher optical intensities within the small focal volume. As such, we describe a SHG microscopy approach based on ghost imaging (GI), which enables imaging data to be collected in parallel rather than sequentially as in raster scanning techniques. We experimentally demonstrate the approach and combine GI-SHG with compressive sensing to make further substantial gains in reducing the amount of sampling required for image reconstruction. Furthermore, GI-SHG is shown to have significant advantages for imaging in highly scattering environments, partly because GI is a background-free approach requiring spatial correlations between photons that travel two paths, with one path entirely devoid of sample interaction. This basic property of GI means that only the photons that travel unimpeded through the sample preserve the spatial correlations needed to reconstruct the image, while more scattered photons do not contribute to the overall GI signal. Finally, we compare the image quality and sampling properties of three different reconstruction algorithms used for compressive sensing.

47 OTHER INSTRUMENTATION↗

Automatic MCNP File Generation for Cherenkov Imaging Simulations [Slides]

Overview: Creating physics models to accurately simulate a variety of spent fuel assemblies. These characterized simulations will then be used to create a well documented repository that encompasses a wide variety of different fuel assemblies, burn-up and spent fuel pool conditions, and defects. The final project will use our simulations to train an AI, and for it to be effective it has to have a lot of reliable data; Automating an arbitrary amount of created spent fuel pins with materials, that will be passed into AI models for it to "learn" what a good spent nuclear fuel cell looks like and what a non-spent nuclear fuel cell looks like.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Machine learning informed control systems for extrusion printing processes

Systems and methods for controlling a material extrusion device to extrude a filament of an ink are provided. An extrusion printing control system collects from one or more sensors measurements representing an internal state of material extrusion processing during extrusion of the filament. In addition, the system collects an image of the filament as the filament is extruded. The system applies a classifier to the collected image to generate an image-derived state characterizing the filament. Based on the internal state and the image-derived state, the system estimates a derived state using a model. The system determines control parameters using the model to achieve a desired quality of the filament by minimizing a cost function based on the internal state, the image-derived state, the derived state, and constraints of the material extrusion device. Finally, the system provides the control parameters to a controller of the material extrusion device.

Howell, Brian↗

Grating-Based Imaging-Scattering with Portable Neutron Generator

Company: Adelphi Technology, Inc. Title: Grating-Based Imaging-Scattering with Portable Neutron Generator PI: Dr. Jay Theodore Cremer, Jr. Topic: 26a Statement of the problem or situation that is being addressed. Successful plant growth depends upon an efficient and robust root system. The plant root is part of a larger system of water and microbial flows in the soil system. While much effort has been exerted to develop an imaging system for water, microbes, and roots, the problem is challenging, and no widely accepted imaging method currently exists. The optical solutions use a highly modified soil system. X-ray imaging methods are insensitive to the soft tissues in the presence of sand. Thermal neutron imaging has been often tested, but found inadequate, due to limited access and low image resolution. This project will develop a new strategy for neutron imaging of plant/soil systems. The project will allow long duration experiments in greenhouse environments and increase the image information content to the micron scale. General statement of how this problem is being addressed. Portable, rugged thermal and fast neutron sources are being developed where portable means a two-soldier team can carry the source and power unit to survey rough terrain for explosives. In the past decade, microfabrication of X-ray and thermal/cold neutron optics has opened a new imaging strategy. The standard transmission image is now supplemented with simultaneous acquisition of a phase contrast image and an image revealing scattering features. In materials science, the interferometric neutron scattering image has been used to detect early crack formation in stressed additive manufacturing test samples. The detection requires sensitivity to scattering features at the 1-micron scale. By addition of our proposed grating-optic to Adelphi Technology’s radiographic/tomographic imaging system, which is based on portable thermal neutron source, the resulting thermal neutron scatter image of the plant/soil system, will reveal details at 1-micron. Commercial Applications and Other Benefits Neutron interferometry imaging has greater penetration through large metal components compared to industrial X-ray imaging. The low-cost, large area optics developed for greenhouse applications, combined with the robust, portable neutron generator, can then be marketed as a system for inspection of additive manufactured components. In the aerospace industry, all freshly printed components are validated with X-ray CT. Scheduled maintenance again requires X-ray CT as the ability to predict aerospace component lifetime does not yet exist. Large aerospace components are only partially observed with X-ray imaging. Key Words Neutron radiography/tomography, grating interferometry, thermal neutron generator imaging, plant root and soil imaging, rhizosphere imaging, deployable neutron imaging systems Summary for Members of Congress A rugged, portable source of thermal neutrons is adapted for neutron interferometry imaging with the addition of low-cost, 3D printed optics. The first application of our proposed deployable, compact thermal neutron generator imaging system, using a grating optic, is plant root/soil science in greenhouse settings and agricultural laboratories.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to enhancements in image quality.

60 APPLIED LIFE SCIENCES↗

Report on the AAPM grand challenge on deep generative modeling for learning medical image statistics

Abstract Background The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. Purpose The goal of this challenge was to promote the development of deep generative models for medical imaging and to emphasize the need for their domain‐relevant assessments via the analysis of relevant image statistics. Methods As part of this Grand Challenge, a common training dataset and an evaluation procedure was developed for benchmarking deep generative models for medical image synthesis. To create the training dataset, an established 3D virtual breast phantom was adapted. The resulting dataset comprised about 108 000 images of size 512 512. For the evaluation of submissions to the Challenge, an ensemble of 10 000 DGM‐generated images from each submission was employed. The evaluation procedure consisted of two stages. In the first stage, a preliminary check for memorization and image quality (via the Fréchet Inception Distance [FID]) was performed. Submissions that passed the first stage were then evaluated for the reproducibility of image statistics corresponding to several feature families including texture, morphology, image moments, fractal statistics, and skeleton statistics. A summary measure in this feature space was employed to rank the submissions. Additional analyses of submissions was performed to assess DGM performance specific to individual feature families, the four classes in the training data, and also to identify various artifacts. Results Fifty‐eight submissions from 12 unique users were received for this Challenge. Out of these 12 submissions, 9 submissions passed the first stage of evaluation and were eligible for ranking. The top‐ranked submission employed a conditional latent diffusion model, whereas the joint runners‐up employed a generative adversarial network, followed by another network for image superresolution. In general, we observed that the overall ranking of the top 9 submissions according to our evaluation method (i) did not match the FID‐based ranking, and (ii) differed with respect to individual feature families. Another important finding from our additional analyses was that different DGMs demonstrated similar kinds of artifacts. Conclusions This Grand Challenge highlighted the need for domain‐specific evaluation to further DGM design as well as deployment. It also demonstrated that the specification of a DGM may differ depending on its intended use.

Radiology, Nuclear Medicine & Medical Imaging↗

Grain2mesh: A Python and cubit mesh generator from unprocessed mesoscale images

Predicting bulk behavior from microscale features constitutes a key objective in multiscale modeling research, often involving numerical models composed of finite elements that capture the diversity of constituent phases, shapes, and orientations within the material. The Grain2mesh toolbox allows the user to input unprocessed mesoscopic images for automatic segmentation, pre-processing, quality control, and numerical mesh generation. The numerical mesh generation incorporates Cubit routines to generate robust multi-phase mesh structure for use in computational mechanics solvers. The python classes developed contain detailed documentation and examples to support standard usage and case-specific alternative options.

58 GEOSCIENCES↗

Generative Patch Priors for Practical Compressive Image Recovery

In this work, we propose the generative patch prior (GPP) that defines a generative prior for compressive image recovery, based on patch-manifold models. Unlike learned, image-level priors that are restricted to the range space of a pre-trained generator, GPP can recover a wide variety of natural images using a pre-trained patch generator. Additionally, GPP retains the benefits of generative priors like high reconstruction quality at extremely low sensing rates, while also being much more generally applicable. We show that GPP outperforms several unsupervised and supervised techniques on three different sensing models – linear compressive sensing with known, and unknown calibration settings, and the non-linear phase retrieval problem. Finally, we propose an alternating optimization strategy using GPP for joint calibration-and-reconstruction which performs favorably against several baselines on a real world, uncalibrated compressive sensing dataset. The code and models for GPP are available on github.

compressed sensing↗

Time-resolved detectors for quantum ghost imaging

Quantum ghost imaging is a method that utilizes the correlated detection of two photons to generate an image. One photon is detected by an imaging sensor and the other by a single-element bucket detector. The selection of the imaging sensor and its capabilities relative to the bucket detector impact the quality of the ghost images. This work examines a SPAD array and a photocathode detector as imaging sensors for quantum ghost imaging. We discuss how to achieve optimal images using these two technologies. We also demonstrate that these devices are able to generate ghost images at 1Hz frame rates, expanding the technique to biologically relevant time scales.

36 MATERIALS SCIENCE↗