Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Wind Turbine Blade Finishing Automation: Robotic Toolpath Generation

Wind turbine blades are now over 100 meters long and can reach heights of several meters while in the finishing area of the factory. Because of this, automation should be used to lower the manufacturing cost and make the process safer for blade manufacturing technicians. This session will present a novel method that generates a six degree of freedom robotic toolpath with 3D cameras for the finishing of wind turbine blades to drive down the levelized cost and make wind energy even more competitive in the utility scale energy generation industry.

3d imaging↗

PyCMG-based Simulation of Volumetric Concrete Microstructure

Concrete is a complex, heterogeneous material with a microstructure composed of aggregates, cement paste, and pores spanning multiple length scales. Understanding this microstructure is critical for advancing the performance, durability, and modeling of concrete-based systems. While experimental imaging such as X-ray computed tomography (XCT) provides valuable insights, generating large datasets with detailed ground truth annotations is both costly and labor-intensive due to challenges in segmenting similar phases, such as aggregates and cement paste, that often share similar attenuation properties. To address this, we developed a pipeline to simulate realistic 3D concrete microstructures using the open-source Python package PyCMG. This simulation effort focuses on generating high-fidelity, annotated microstructures that can serve as training or benchmarking datasets for image analysis, segmentation algorithms, and machine learning models, particularly in scenarios where experimental data is scarce.

Ziabari, Amir [Oak Ridge National Laboratory; ORNL↗

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they arc only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

47 OTHER INSTRUMENTATION↗

A machine-learning approach to measure 3D sample properties from 2D Transmission Electron Microscopy images

Transmission Electron Microscopy (TEM) is a powerful tool for the characterization of materials at the nanoscale; however, its inherent two-dimensional (2D) nature poses significant challenges to accurately measure three-dimensional (3D) properties. We introduce a supervised machine-learning model that predicts 3D structural information, such as sample thickness and curvature, from a series of conventional 2D TEM images. The model, a U-Net convolutional neural network, is trained on a large synthetic dataset generated from dynamical diffraction simulations that model TEM’s complex, nonlinear image formation, accounting for sample thickness and curvature. This physically realistic framework enables exploration of a broad parameter space impractical to sample experimentally. We demonstrate that the trained model has accurate predictions for experimental single-crystal silicon samples, achieving performance comparable to established measurement techniques. This work highlights the critical role of robust, simulation-based training in overcoming the limitations of real-world imaging artifacts and inconsistent sample geometries. By integrating machine learning with numerical simulations, we offer an efficient and scalable framework for quantitative TEM analysis, paving the way for more sophisticated 3D characterization of complex materials.

Dynamical diffraction↗

Autonomous adaptive data acquisition for scanning hyperspectral imaging

Non-invasive and label-free spectral microscopy (spectromicroscopy) techniques can provide quantitative biochemical information complementary to genomic sequencing, transcriptomic profiling, and proteomic analyses. However, spectromicroscopy techniques generate high-dimensional data; acquisition of a single spectral image can range from tens of minutes to hours, depending on the desired spatial resolution and the image size. This substantially limits the timescales of observable transient biological processes. To address this challenge and move spectromicroscopy towards efficient real-time spatiochemical imaging, we developed a grid-less autonomous adaptive sampling method. Our method substantially decreases image acquisition time while increasing sampling density in regions of steeper physico-chemical gradients. When implemented with scanning Fourier Transform infrared spectromicroscopy experiments, this grid-less adaptive sampling approach outperformed standard uniform grid sampling in a two-component chemical model system and in a complex biological sample, Caenorhabditis elegans. We quantitatively and qualitatively assess the efficiency of data acquisition using performance metrics and multivariate infrared spectral analysis, respectively.

47 OTHER INSTRUMENTATION↗

TomoGAN: low-dose synchrotron x-ray tomography with generative adversarial networks: discussion

Synchrotron-based x-ray tomography is a noninvasive imaging technique that allows for reconstructing the internal structure of materials at high spatial resolutions from tens of micrometers to a few nanometers. In order to resolve sample features at smaller length scales, however, a higher radiation dose is required. Therefore, the limitation on the achievable resolution is set primarily by noise at these length scales. We present TomoGAN, a denoising technique based on generative adversarial networks, for improving the quality of reconstructed images for low-dose imaging conditions. We evaluate our approach in two photon-budget-limited experimental conditions: (1) sufficient number of low-dose projections (based on Nyquist sampling), and (2) insufficient or limited number of high-dose projections. In both cases, the angular sampling is assumed to be isotropic, and the photon budget throughout the experiment is fixed based on the maximum allowable radiation dose on the sample. Evaluation with both simulated and experimental datasets shows that our approach can significantly reduce noise in reconstructed images, improving the structural similarity score of simulation and experimental data from 0.18 to 0.9 and from 0.18 to 0.41, respectively. Furthermore, the quality of the reconstructed images with filtered back projection followed by our denoising approach exceeds that of reconstructions with the simultaneous iterative reconstruction technique, showing the computational superiority of our approach.

42 ENGINEERING↗

Pan-sharpening for microscopy

Techniques for generating full-spatial resolution, full spectral resolution image(s) from a 3D spectral-data cube for any spectral value within a given spectral range are provided without requiring the acquisition of all full-spatial resolution, full spectral resolution data by an instrument. The 3D spectral-data cube is generated from a limited number of full-spatial resolution, sparse spectral resolution data and a sparse-spatial resolution, full-spectral resolution data of the same area of the sample. The use of the 3D spectral-data cube reduces the data acquisition time.

Ovchinnikova, Olga S.↗

The Illumination of Thunderclouds by Lightning: 4. Volumetric Thunderstorm Imagery

Optical instruments such as the Geostationary Lightning Mapper (GLM) detect lightning based on transient changes in cloud illumination. The horizontal location of lightning is determined from the coordinates of the pixels on the imaging array illuminated during the flash. However, the vertical position of the lightning pulses (approximated by GLM “groups”) below the cloud top cannot be routinely measured from a single space-based instrument. In our prior work, we have developed a machine learning algorithm that can infer optical source altitude for a given pulse based on how the optical energy is distributed across the group footprint and the local Advanced Baseline Imager Cloud-Top Height (CTH). In this fourth part of our thundercloud illumination study, we leverage these source altitudes to generate volumetric GLM imagery of a Colombia thunderstorm. We find that 3D versions of the current GLM meteorological imagery products (that describe thunderstorm kinematics) and thundercloud imagery products (that depict how the flashes appear from space) provide additional insights into lightning activity in the thunderstorm that are lost in the vertical integration used to generate the current 2D GLM gridded products. This new volumetric imaging capability provides a more comprehensive picture of where lightning occurs in the storm, how its physical characteristics vary across three-dimensional space, and how its optical emissions interact with surrounding the cloud medium.

54 ENVIRONMENTAL SCIENCES↗

Exploring Gradient-Based Multi-directional Controls in GANs

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-box, leaving its controllable generation an open problem, especially when spurious correlations between different semantic attributes exist in the image distributions. To address this problem, previous methods typically learn linear directions or individual channels that control semantic attributes in the image space. However, they often suffer from imperfect disentanglement, or are unable to obtain multi-directional controls. Furthermore, in this work, in light of the above challenges, we propose a novel approach that discovers nonlinear controls, which enables multi-directional manipulation as well as effective disentanglement, based on gradient information in the learned GAN latent space. More specifically, we first learn interpolation directions by following the gradients from classification networks trained separately on the attributes, and then navigate the latent space by exclusively controlling channels activated for the target attribute in the learned directions. Empirically, with small training data, our approach is able to gain fine-grained controls over a diverse set of bi-directional and multi-directional attributes, and we showcase its ability to achieve disentanglement significantly better than state-of-the-art methods both qualitatively and quantitatively.

97 MATHEMATICS AND COMPUTING↗

Systems and methods for in situ assessment of mooring lines

A system can include at least one measuring device that captures and collects multiple two-dimensional images of a mooring line disposed in water. The system can also include a mooring line assessment system that includes a controller communicably coupled to the at least one measuring device. The controller can receive the two-dimensional images from the at least one measuring device. The controller can also generate a three-dimensional reconstruction of the mooring line based on the two-dimensional images. The controller can further present the three-dimensional reconstruction to a user. The two-dimensional images can be captured and the recommendation can be made while the mooring line is in situ.

47 OTHER INSTRUMENTATION↗

2024 roadmap on magnetic microscopy techniques and their applications in materials science

Considering the growing interest in magnetic materials for unconventional computing, data storage, and sensor applications, there is active research not only on material synthesis but also characterisation of their properties. In addition to structural and integral magnetic characterisations, imaging of magnetisation patterns, current distributions and magnetic fields at nano- and microscale is of major importance to understand the material responses and qualify them for specific applications. In this roadmap, we aim to cover a broad portfolio of techniques to perform nano- and microscale magnetic imaging using superconducting quantum interference devices, spin centre and Hall effect magnetometries, scanning probe microscopies, x-ray- and electron-based methods as well as magnetooptics and nanoscale magnetic resonance imaging. The roadmap is aimed as a single access point of information for experts in the field as well as the young generation of students outlining prospects of the development of magnetic imaging technologies for the upcoming decade with a focus on physics, materials science, and chemistry of planar, three-dimensional and geometrically curved objects of different material classes including two-dimensional materials, complex oxides, semi-metals, multiferroics, skyrmions, antiferromagnets, frustrated magnets, magnetic molecules/nanoparticles, ionic conductors, superconductors, spintronic and spinorbitronic materials.

2D materials↗

Referenceless, grating-based, single shot X-ray phase contrast imaging with optimized laser-driven K-α sources

With its ability to efficiently probe low-Z materials, X-ray phase imaging methods have recently raised high interest in multiple fields from biology and medical applications to high energy density (HED) physics. Initially developed with synchrotron light and X-ray tubes, we present a novel grating based Talbot X-ray deflectometer (TXD) diagnostic that was coupled with laser-generated K-α X-ray sources. The multi-terawatt laser (I > 1 × 10 14 W cm -2 ) was used as a testbed for diagnostic development. It was found that X-ray source chromaticity plays an important role in TXD. Indeed, the broadband spectrum of laser-generated X-ray sources may strongly impact image quality and thus diagnostic performance. We qualified X-ray emission from different laser-produced sources and determined laser, target, and deflectometer parameters that optimize TXD performance. We present the first results of referenceless grating-based X-ray imaging at high-power laser facilities and discuss the implications of this new development in HED research.

47 OTHER INSTRUMENTATION↗

In situ Detection of Plasma Induced Surface Interaction based on Deep Learning based Visual Diagnostics (Technical Report)

It is characteristic for many plasma devices to undergo plasma-material interaction leading to surface erosion. These processes, often not easily detectable, lead to changes in device performance and lifespan. State-of-the-art lifetime tests and wear experiments require over 1000s hours. A self-consistent model for accurately predicting the erosion's effects is not available. In situ detection of these processes is not a trivial task since the surface variations at the early stages have a micron scale. Such limitations not only restrict testing and prediction capabilities but also slow the development of new thrusters and limit mission duration. To address these challenges, an in-situ diagnostic for real-time erosion assessment has been developed, aiming to expedite lifetime testing and broaden experimental campaigns. Several works were dedicated to real-time and in situ monitoring of material erosion during plasma exposure using laser holography, microscopy, and with telemicroscopes. However, the applicability of these approaches is limited due to complexity, cost and less flexibility as they often require placing diagnostic equipment inside the vacuum chamber. In collaboration with Princeton Collaborative Research Facility (PCRF), Princeton Plasma Physics Laboratory (PPPL), a new diagnostic approach is developed, where geometry modifications to the ceramic channel walls were introduced that would result in accelerated channel erosion. We employed Long-distance microscope (LDM) imagery, combined with Deep-Learning based Shape from focus or depth from focus (DFF or SFF) approach, that provides an accessible and cost-effective solution. LDM employs focus variation techniques to continuously capture multiple images of the target object at distinct focal planes. DFF, an optical focus variation method, generates a 3D topographical surface depth map from a sequence of variably focused images. Combined with the developed diagnostic, this approach offers a controllable means to study erosion under accelerated conditions. In this work, we develop Neural Network-based DFF algorithm applicable for LDM data to quantitatively evaluate plasma induced surface modification from LDM data. Next, we develop Deep Learning-based super-resolution depth map image reconstruction technique to increase the resolution of depth maps obtained from DFF algorithm to improve the accuracy of erosion measurements. Thirdly, we develop several image processing techniques to remove noise and improve the quality of depth map image. Here we report the results of initial tests for this approach. An experimental setup designed and built in PPPL was employed that consists of a 3-cm gridded ion source that produces a neutralized argon beam with energies up to 600 eV. A hexagonal boron nitride (h-BN) ceramic target, designed based on computational predictions, was used. Tests were conducted to reconstruct the complex geometry of the target under the lighting conditions of the operated ion source.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

TRINIDI: Time-of-Flight Resonance Imaging With Neutrons for Isotopic Density Inference

Accurate reconstruction of 2D and 3D isotope densities is a desired capability with great potential impact in applications such as evaluation and development of next-generation nuclear fuels. Neutron time-of-flight (TOF) resonance imaging offers a potential approach by exploiting the characteristic neutron absorption spectra of each isotope. However, it is a major challenge to compute quantitatively accurate images due to a variety of confounding effects such as severe Poisson noise, background scatter, beam non-uniformity, absorption non-linearity, and extended source pulse duration. We present the TRINIDI algorithm which is based on a two-step process in which we first estimate the neutron flux and background counts, and then reconstruct the areal densities of each isotope and pixel. Both components are based on the inversion of a forward model that accounts for the highly non-linear absorption, energy-dependent emission profile, and Poisson noise, while also modeling the substantial spatio-temporal variation of the background and flux. Further, to do this, we formulate the non-linear inverse problem as two optimization problems that are solved in sequence. We demonstrate on both synthetic and measured data that TRINIDI can reconstruct quantitatively accurate 2D views of isotopic areal density that can then be reconstructed into quantitatively accurate 3D volumes of isotopic volumetric density.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Physical Models from Physical Templates Using Biocompatible Liquid Crystal Elastomers as Morphologically Programmable Inks For 3D Printing

Advanced manufacturing has received considerable attention as a tool for the fabrication of cell scaffolds however, finding ideal biocompatible and biodegradable materials that fit the correct parameters for 3D printing and guide cells to align remain a challenge. Herein, a photocrosslinkable smectic-A (Sm-A) liquid crystal elastomer (LCE) designed for 3D printing is presented, that promotes cell proliferation but most importantly induces cell anisotropy. The LCE-based bio-ink allows the 3D duplication of a highly complex brain structure generated from an animal model. Vascular tissue models are generated from fluorescently stained mouse tissue spatially imaged using confocal microscopy and subsequently processed to create a digital 3D model suitable for printing. The 3D structure is reproduced using a Digital Light Processing (DLP) stereolithography (SLA) desktop 3D printer. Synchrotron Small-Angle X-ray Diffraction (SAXD) data reveal a strong alignment of the LCE layering within the struts of the printed 3D scaffold. The resultant anisotropy of the LCE struts is then shown to direct cell growth. This study offers a simple approach to produce model tissues built within hours that promote cellular alignment.

3D cell culture↗

Comparison of open‐source three‐dimensional reconstruction pipelines for maize‐root phenotyping

Abstract Understanding three‐dimensional (3D) root traits is essential to improve water uptake, increase nitrogen capture, and raise carbon sequestration from the atmosphere. However, quantifying 3D root traits by reconstructing 3D root models for deeper field‐grown roots remains a challenge due to the unknown tradeoff between 3D root‐model quality and 3D root‐trait accuracy. Therefore, we performed two computational experiments. We first compared the 3D model quality generated by five state‐of‐the‐art open‐source 3D model reconstruction pipelines on 12 contrasting genotypes of field‐grown maize roots. These pipelines included COLMAP, COLMAP+PMVS (Patch‐based Multi‐View Stereo), VisualSFM, Meshroom, and OpenMVG+MVE (Multi‐View Environment). The COLMAP pipeline achieved the best performance regarding 3D model quality versus computational time and image number needed. In the second test, we compared the accuracy of 3D root‐trait measurement generated by the Digital Imaging of Root Traits 3D pipeline (DIRT/3D) using COLMAP‐based 3D reconstruction with our current DIRT/3D pipeline that uses a VisualSFM‐based 3D reconstruction on the same dataset of 12 genotypes, with 5–10 replicates per genotype. The results revealed that (1) the average number of images needed to build a denser 3D model was reduced from 3000 to 3600 (DIRT/3D [VisualSFM‐based 3D reconstruction]) to around 360 for computational test 1, and around 600 for computational test 2 (DIRT/3D [COLMAP‐based 3D reconstruction]); (2) denser 3D models helped improve the accuracy of the 3D root‐trait measurement; (3) reducing the number of images can help resolve data storage problems. The updated DIRT/3D (COLMAP‐based 3D reconstruction) pipeline enables quicker image collection without compromising the accuracy of 3D root‐trait measurements.

09 BIOMASS FUELS↗

Microstructure reconstruction of battery polymer separators by fusing 2D and 3D image data for transport property analysis

A new approach to generate high-fidelity 3D microstructure reconstructions by leveraging resolution and sample volume characteristics from 2D and 3D microscopy methods is presented here. This approach is employed to model the microstructure of a highly orthotropic polypropylene separator used in lithium-ion batteries, which have challenging multi-scale features of fibrils (<100 nm) and lamellae (>100 nm) to resolve in 3D. Phase contrast nano X-ray computed tomographic data are used to reconstruct the lamellae phase, while 2D scanning electron microscopy data are used to characterize sub-100 nm microstructure features such as the thin fibrils that are beyond the effective resolution of X-ray computed tomography. Fibril geometries are reconstructed stochastically based on the 2D higher resolution data, and integrated with the lamellae geometries in 3D space. Transport property analyses are performed to investigate the bias of microstructure models without considering the fibrils. A sensitivity study is also conducted to facilitate understanding of the relationship between microstructure characteristics and transport properties.

25 ENERGY STORAGE↗

Combined Optical and Radio–Frequency Perspectives on the Time Evolution of Lightning Measured by the FORTE Satellite

We use a cluster feature data set for the Fast On-orbit Recording of Transient Events (FORTE) satellite that combines detections from its pixelated Lightning Locating System (LLS), photodiode detector (PDD) and Radio-Frequency (RF) instrumentation to generate statistics describing the frequency and timing of lightning events detected by each instrument during lightning flashes. Coincident observations from the same vantage point allow us to directly compare flash details that can be resolved by the wide Field of View (FOV) instruments relative to the pixelated LLS—whose design is based on NASA's Lightning Imaging Sensor. We find that both the PDD and RF system typically generate more detections than the lightning imager (mean: 1.5 PDD events per LLS group, 2 RF events per LLS group) from pulses that are either not sufficiently bright in the optical band (in the case of RF) or that lack the optical energy density (in the case of the PDD) required to trigger one of the pixels on the LLS imaging array. This includes additional activity before the first LLS group or after the final LLS group. These FORTE results demonstrate that certain lightning processes would be better resolved by wide-FOV optical and RF instruments than lightning imagers. Current/future space-based missions that use/plan to use similar instruments will improve our understanding of flash evolution by resolving details missed by lightning imagers.

47 OTHER INSTRUMENTATION↗