Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Path-Integrated X-Ray Digital Image Correlation using Synthetic Reference Images

X-rays can provide images when an object is visibly obstructed, allowing for motion measurements via x-ray digital image correlation (DIC). However, x-ray images are path-integrated and contain data for all objects between the source and detector. If multiple objects are present in the x-ray path, conventional DIC algorithms may fail to correlate the x-ray images. A new DIC algorithm called path-integrated (PI)-DIC addresses this issue by reformulating the matching criterion for DIC to account for multiple, independently-moving objects. PI-DIC requires a set of reference x-ray images of each independent object. However, due to experimental constraints, such reference images might not be obtainable from the experiment. Here, this work focuses on the reliability of synthetically-generated reference images, in such cases. A simplified exemplar is used for demonstration purposes, consisting of two aluminum plates with tantalum x-ray DIC patterns undergoing independent rigid translations. Synthetic reference images based on the “as-designed” DIC patterns were generated. However, PI-DIC with the synthetic images suffered some biases due to manufacturing defects of the patterns. A systematic study of seven identified defect types found that an incorrect feature diameter was the most influential defect. Synthetic images were re-generated with the corrected feature diameter, and PI-DIC errors were improved by a factor of 3-4. Final biases ranged from 0.00-0.04 px, and standard uncertainties ranged from 0.06-0.11 px. In conclusion, PI-DIC accurately measured the independent displacement of two plates from a single series of path-integrated x-ray images using synthetically-generated reference images, and the methods and conclusions derived here can be extended to more generalized cases involving stereo PI-DIC for arbitrary specimen geometry and motion. This work thus extends the application space of x-ray imaging for full-field DIC measurements of multiple surfaces or objects in extreme environments where optical DIC is not possible.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Score-based diffusion models for generating liquid argon time projection chamber images

For the first time, we show high-fidelity generation of Liquid Argon Time Projection Chamber (LArTPC-like) data using a generative neural network. This demonstrates that methods developed for natural images do transfer to LArTPC-produced images, which, in contrast to natural images, are globally sparse but locally dense. We present the score-based diffusion method employed. We evaluate the fidelity of the generated images using several quality metrics, including modified measures used to evaluate natural images, comparisons between high-dimensional distributions, and comparisons relevant to LArTPC experiments. Published by the American Physical Society 2024

Astronomy & Astrophysics↗
DOE OSTI2022

Utilizing machine learning to improve the precision of fluorescence imaging of cavity-generated spin squeezed states

We present a supervised learning model to calibrate the photon collection rate during the fluorescence imaging of cold atoms. The linear regression model finds the collection rate at each location on the sensor such that the atomic population difference equals that of a highly precise optical cavity measurement. This 192 variable regression results in a measurement variance 27% smaller than our previous single variable regression calibration. The measurement variance is now in agreement with the theoretical limit due to other known noise sources. This model efficiently trains in less than a minute on a standard personal computer's CPU and requires less than 10 min of data collection. Furthermore, the model is applicable across a large change in population difference and across data collected on different days.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

System and method to fuse multiple sources of optical data to generate a high-resolution, frequent and cloud-/gap-free surface reflectance product

Aspects of the subject disclosure may include, for example, performing, by a processing system, image fusion using two or more groups of images to generate predicted images, wherein each group of the two or more groups has one of a different resolution, a different frequency temporal pattern or a combination thereof than another of the two or more groups. Gap filling can be performed by the processing system to correct images of the two or more groups. Additional embodiments are disclosed.

Guan, Kaiyu↗
DOE OSTI2023

A synthetic Roman Space Telescope High-Latitude Time-Domain Survey: supernovae in the deep field

ABSTRACT NASA will launch the Nancy Grace Roman Space Telescope (hereafter Roman) in the second half of this decade, which will allow for a generation-defining measurement of dark energy through multiple probes, including Type Ia supernovae (SNe Ia). To improve decisions on survey strategy, we have created the first simulations of realistic Roman images that include artificial SNe Ia injected as point sources in the images. Our analysis combines work done on Roman simulations for weak gravitational lensing studies as well as catalogue-level simulations of SN Ia samples. We have created a time series of images over 2 yr containing ∼1050 SNe Ia, covering a 1 deg2 subarea of a planned 5 deg2 deep survey. We have released these images publicly for community use along with input catalogues of all injected sources. We create secondary products from these images by generating coadded images and demonstrating recovery of transient sources using image subtraction. We perform first-use analyses on these images in order to measure galaxy detection efficiency, point source detection efficiency, and host-galaxy association biases. The simulated images can be found here at https://roman.ipac.caltech.edu/sims/SN_Survey_Image_sim.html.

Astronomy & Astrophysics↗
DOE OSTI2021

Neutron Transmission Imaging with a Portable D-T Neutron Generator

Fast-neutron transmission imaging provides complementary information to x-ray transmission imaging. While fast neutron imaging resolution is generally below x-ray imaging, 14-MeV neutrons have an advantage over portable x-ray systems. Neutrons have higher transmission through high-Z materials due to a more uniform attenuation as a function of material atomic number Z compared to X-rays, and can therefore image low-Z materials inside high-Z materials. As a result, portable neutron transmission imaging has many applications, including inspection of concrete and welds for corrosion in vehicles, bridges, and other infrastructure, measurement of material levels in containers, and inspection of suspicious packages. Fast-neutron imaging is also more practical for field use than thermal-neutron imaging due to the size and shielding requirements typical of thermal-imaging systems compared to the availability of small 14.1 MeV D-T neutron generators. However, there are limitations in portable fast-neutron imaging systems, including limited neutron output, limited light produced by neutron scintillators, and lower resolution due to neutron source spot size and 2-3 mm scintillator thickness. In addition, digital-panel dark-noise is roughly 100x higher than neutron scintillator light, and variations in noise across the panel and in time is comparable to the imaging signal. Here we discuss recent efforts in developing a portable fast-neutron radiography system, including an improved neutron scintillator, mitigation of panel noise, and new commercial portable D-T neutron generators. We also present MCNP efforts to model neutron imaging, including scintillator resolution and the effects of neutron scattering from the object and surrounding materials.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

What’s the Difference? The Potential for Convolutional Neural Networks for Transient Detection without Template Subtraction

Abstract We present a study of the potential for convolutional neural networks (CNNs) to enable separation of astrophysical transients from image artifacts, a task known as “real–bogus” classification, without requiring a template-subtracted (or difference) image, which requires a computationally expensive process to generate, involving image matching on small spatial scales in large volumes of data. Using data from the Dark Energy Survey, we explore the use of CNNs to (1) automate the real–bogus classification and (2) reduce the computational costs of transient discovery. We compare the efficiency of two CNNs with similar architectures, one that uses “image triplets” (templates, search, and difference image) and one that takes as input the template and search only. We measure the decrease in efficiency associated with the loss of information in input, finding that the testing accuracy is reduced from ∼96% to ∼91.1%. We further investigate how the latter model learns the required information from the template and search by exploring the saliency maps. Our work (1) confirms that CNNs are excellent models for real–bogus classification that rely exclusively on the imaging data and require no feature engineering task and (2) demonstrates that high-accuracy (>90%) models can be built without the need to construct difference images, but some accuracy is lost. Because, once trained, neural networks can generate predictions at minimal computational costs, we argue that future implementations of this methodology could dramatically reduce the computational costs in the detection of transients in synoptic surveys like Rubin Observatory's Legacy Survey of Space and Time by bypassing the difference image analysis entirely.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Enabling dynamic 3D coherent diffraction imaging via adaptive latent space tuning of generative autoencoders

Abstract Coherent diffraction imaging (CDI) is an advanced non-destructive 3D X-ray imaging technique for measuring a sample’s electron density. The main challenge of CDI is loss of phase information in diffraction intensity measurements, resulting in lengthy iterative reconstruction processes that can return non-unique solutions, which pose challenges for experiments attempting to track dynamic sample evolution through multiple states. As the increased brightness of fourth-generation light sources enables faster sample measurements and drives operando experiments with Bragg CDI, there is a growing need for faster reconstruction techniques that can keep pace. We have developed an adaptive generative autoencoder approach for uniquely tracking a sample’s electron density as it dynamically evolves. Our approach adaptively tunes the low-dimensional latent embedding of a generative autoencoder, enabling a computationally efficient manner to account for time-varying shifting distributions in real-time. Analytic proof of convergence is provided as well as numerical demonstration of sample tracking with noisy measurements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Image Characterization of Reactions Generated by an Aeroengine Micromixing Injector for Lean Direct Injection of Hydrogen and Hydrogen/Natural Gas Blend

An aeroengine micromixing injector, originally designed for lean direct injection of jet fuel, was adapted to work with hydrogen, natural gas, and any blend in between. The ultimate goal of the design was to achieve low NOx emissions when operated on pure hydrogen; to better characterize its performance, flame imaging diagnostics was implemented. Three types of cameras mounted parallel to the injector base and pointing towards the quartz combustor cylinder with the same angle were operated simultaneously: Nikon D90, Dynacolor FB-N9-U, and Phantom v7.1, to capture the visible spectrum, OH* chemiluminescence, and dynamic behavior of the flames, respectively. The current work also includes the overlapping of visible spectrum and OH* chemiluminescence, as an effort to qualitatively define the heat release over the flame area, i.e., UV over visible domain. Additionally, a z-type schlieren configuration was employed to reinforce the presence of some small-scale details occurring near the injector outlet ports. Using the airbox pressure drop, preheat temperature, fuel composition and flame temperature as the factors of study, a Box Behnken model was designed yielding into a 16-points matrix for the operability region, at atmospheric pressure. The main responses were extracted from the OH* images, because of its correlation with the flame heat release, these being the flame area and its average brightness, the heat release area and its center of gravity and leading edge. To assess the importance of the main factors and their interactions, an analysis of variance (ANOVA) was performed for each response, considering as significant each contributor with a p-value below 0.05. For these five responses it was found that all four main factors need to be included into the model (most of them because its own significance, others to ensure the model hierarchy), as well as some common interactions as the preheat and flame temperatures or pressure drop and fuel composition, and quadratic terms from fuel composition or flame temperature. Three of the five models presented R2 and coefficient of variance (C.V.) indicators around 0.97 and 5%, respectively; the leading edge ANOVA yielded into R2=0.78 and C.V.=18.88%; and the heat release area showed R2=0.91 and C.V.=24.13%. Lastly, the confinement ratio effect of the combustor over the flame structure was quantified, for three different conditions: the original 80 mm inner diameter and 200 mm length cylinder was compared against a shorter 150 mm tube (same inner diameter) and a narrower 47 mm inner diameter one (same 200 mm length). The length had a smaller effect than the inner diameter, even though both factors were not strong enough to make a significant deviation on most of the flame parameters: the difference was within the repeatability margin of error for the brightness, flame area, and center of gravity and leading edge of the heat release area.

Imaging diagnostics, flame characterization, OH* c↗
DOE OSTI2023

Fast and accurate simulations of calorimeter showers with normalizing flows

In this study, we introduce caloflow, a fast detector simulation framework based on normalizing flows. For the first time, we demonstrate that normalizing flows can reproduce many-channel calorimeter showers with extremely high fidelity, providing a fresh alternative to computationally expensive geant4 simulations, as well as other state-of-the-art fast simulation frameworks based on generative adversarial networks (GANs) or variational autoencoders (VAEs). In addition to the usual histograms of physical features and images of calorimeter showers, we introduce a new metric for judging the quality of generative modeling: the performance of a classifier trained to differentiate real from generated images. We show that GAN-generated images can be identified by the classifier with nearly 100% accuracy, while images generated from caloflow are better able to fool the classifier. More broadly, normalizing flows offer several advantages compared to other state-of-the-art approaches (GANs and VAEs), including tractable likelihoods, stable and convergent training, and principled model selection. Normalizing flows also provide a bijective mapping between data and the latent space, which could have other applications beyond simulation, for example, to detector unfolding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Scalable balanced training of conditional generative adversarial neural networks on image data

Here, we propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data labels, and enhances scalability by performing a parallel training where multiple generators are concurrently trained, each one of them focusing on a single data label. Performance is assessed in terms of inception score, Fréchet inception distance, and image quality on MNIST, CIFAR10, CIFAR100, and ImageNet1k datasets, showing a significant improvement in comparison to state-of-the-art techniques to training DC-CGANs. Weak scaling is attained on all the four datasets using up to 1000 processes and 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Dataset of CFD Simulated Industrial Furnace Images for Conditional Automatic Generation with GANs

The steel industry is constantly looking for ways to automate processes and improve efficiency. A standard practice in industry is to simulate how complex systems will operate before they are actually used. Some complex systems, including steel industry processes such as blast furnaces, require complex physics-based simulations utilizing computational fluid dynamics (CFD). These CFD physics-based simulations are very accurate but can take significant time and computational resources to process, resulting in challenges for the implementation of the models in real-world operational environments. In recent years, deep learning (DL) has been considered as a substitute for these CFD models. DL models can be trained on validated CFD simulation data and then used for industrial process inference. Previous DL-based solutions have made great contributions for industrial automation but are currently missing the additional visualization component that CFD simulations also provide. In this paper, we propose a dataset for simple DL generative approaches that can help to address this issue. The dataset and methodology under development to approach this prediction are discussed in this work.

Calix, Ricardo↗
DOE OSTI2025

FORECASTOR – II. Simulating galaxy surveys with the Cosmological Advanced Survey Telescope for Optical and UV Research

The Cosmological Advanced Survey Telescope for Optical and UV Research (CASTOR) is a planned flagship space telescope, covering the blue-optical and UV part of the spectrum. Here, we introduce the CASTOR image simulator, a python GalSim package-based script capable of generating mock CASTOR images from an input catalogue. We generate example images from the CASTOR Wide, Deep, and Ultra-Deep surveys using simulated lightcones from the Santa Cruz semi-analytic model. We make predictions for the performance of these surveys by comparing galaxies that are extracted from each image using Source Extractor to the input catalogue. We find that the Wide, Deep, and Ultra-Deep surveys will be 75 per cent complete for point sources down to $\sim 27$, 29, and 30 mag, respectively, in the UV, u, and g filters, with the UV-split and u-split filters reaching a shallower depth. With a large area of $\sim 2200$ deg$^2$, the Wide survey will detect hundreds of millions of galaxies out to $z\sim 4$, mostly with $M_\ast \gtrsim 10^{9}\,{\rm M}_{\odot }$. The Ultra-Deep survey will probe to $z\sim 5$, detecting galaxies with $M_\ast \gtrsim 10^{7}{\rm M}_{\odot }$. These galaxy samples will enable precision measurements of the distribution of star formation in the cosmic web, connecting the growth of stellar mass to the assembly of dark matter haloes over two thirds of the history of the Universe, and other core goals of CASTOR’s legacy surveys. These image simulations and the tools developed to generate them will be a vital planning tool to estimate CASTOR’s performance and iterate the telescope and survey designs prior to launch.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Evaluating generative networks using Gaussian mixtures of image features

We develop a measure for evaluating the performance of generative networks given two sets of images. A popular performance measure currently used to do this is the Fréchet Inception Distance (FID). However, FID assumes that images featurized using the penultimate layer of Inception follow a Gaussian distribution. This assumption allows FID to be easily computed, since FID uses the 2-Wasserstein distance of two Gaussian distributions fitted to the featurized images. However, we show that Inception features of the ImageNet dataset are not Gaussian; in particular, each marginal is not Gaussian. To remedy this problem, we model the featurized images using Gaussian mixture models (GMMs) and compute the 2-Wasserstein distance restricted to GMMs. We define a performance measure, which we call WaM, on two sets of images by using inception (or another classifier) to featurize the images, estimate two GMMs, and use the restricted 2-Wasserstein distance to compare the GMMs. We experimentally show the advantages of WaM over FID, including how FID is more sensitive than WaM to image perturbations. By modelling the non-Gaussian features obtained from inception as GMMs and using a GMM metric, we can more accurately evaluate generative network performance.

machine learning, genrative adversarial networks↗
DOE OSTI2021

Mimicking of corruption in images

Methods and systems are provided to generate an uncorrupted version of an image given an observed image that is a corrupted version of the image. In some embodiments, a corruption mimicking (“CM”) system iteratively trains a corruption mimicking network (“CMN”) to generate corrupted images given modeled images, updates latent vectors based on differences between the corrupted images and observed images, and applies a generator to the latent vectors to generate modeled images. The training, updating, and applying are performed until modeled images that are input to the CMN result in corrupted images that approximate the observed images. Because the CMN is trained to mimic the corruption of the observed images, the final modeled images represented the uncorrupted version of the observed images.

Anirudh, Rushil↗
DOE OSTI2021

Computational optical physical unclonable function

A system or method for encryption of data includes a light source, a random optical element and a light detection element. The light source is arranged to transmit an input data signal to the random optical element. The light source is incident on the random optical element such that the input data signal is randomly scattered by the random optical element to generate an image at on the detector disposed at an output of the random optical element. The image received by the detector is applied to a compressive sensing algorithm to generate a transfer function. The transfer function defines a relationship between the input data signal and the image to enable estimation and reconstruction of the input data signal.

Birch, Gabriel Carlisle↗
DOE OSTI2023

Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties

Here we introduce a denoising diffusion algorithm to discover microstructures with nonlinear fine-tuned properties. Denoising diffusion probabilistic models are generative models that use diffusion-based dynamics to gradually denoise images and generate realistic synthetic samples. By learning the reverse of a Markov diffusion process, we design an artificial intelligence to efficiently manipulate the topology of microstructures to generate a massive number of prototypes that exhibit constitutive responses sufficiently close to designated nonlinear constitutive behaviors. To identify the subset of microcstructures with sufficiently precise fine-tuned properties, a convolutional neural network surrogate is trained to replace high-fidelity finite element simulations to filter out prototypes outside the admissible range. Results of this study indicate that the denoising diffusion process is capable of creating microstructures of fine-tuned nonlinear material properties within the latent space of the training data. More importantly, this denoising diffusion algorithm can be easily extended to incorporate additional topological and geometric modifications by introducing high-dimensional structures embedded in the latent space. Numerical experiments are conducted on the open-source mechanical MNIST data set (Lejeune, 2020). Consequently, this algorithm is not only capable of performing inverse design of nonlinear effective media, but also learns the nonlinear structure–property map to quantitatively understand the multiscale interplay among the geometry, topology, and their effective macroscopic properties.

42 ENGINEERING↗