SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Deciphering Discrepancies: A Comparative Analysis of Docker Image Security

As the use of microservices continues to grow and become a foundational approach to architecting software solutions, ensuring the security of microservices is paramount. Docker images have emerged as the predominant solution to containerize microservices–and thus, Docker images are becoming a large attack surface. Thus, reducing vulnerabilities in Docker images will reduce microservice cyberattacks. A common way to find vulnerabilities in Docker images employs static analysis tools like Trivy and Grype. However, these tools frequently generate disparate vulnerability reports when analyzing the same Docker image, thus causing uncertainty in tool selection. We collected 927 Docker images, analyzed them with Trivy and Grype, and compared the vulnerabilities reported in each image. Among the 865 images found to have vulnerabilities, Trivy and Grype disagreed on both the number of vulnerabilities and the vulnerability IDs found therein. Since both tools interface with external vulnerability databases, some discrepancies can be attributed to how the tools interface with these external resources. The external vulnerability databases partially overlap and frequently contradict one another, thereby creating challenges for static analysis tool developers and end users alike. This New Ideas and Emerging Results (NIER) study contains new and critical information that practitioners need for selecting and using static analysis tools–given that increases in the use of Docker technologies means increases in the size of the attack surfaces.

Boles, Brittany [Montana State University]↗

DOE OSTI2023

From Images to Dark Matter: End-to-end Inference of Substructure from Hundreds of Strong Gravitational Lenses

Abstract Constraining the distribution of small-scale structure in our universe allows us to probe alternatives to the cold dark matter paradigm. Strong gravitational lensing offers a unique window into small dark matter halos (<10 10 M ⊙ ) because these halos impart a gravitational lensing signal even if they do not host luminous galaxies. We create large data sets of strong lensing images with realistic low-mass halos, Hubble Space Telescope (HST) observational effects, and galaxy light from HST’s COSMOS field. Using a simulation-based inference pipeline, we train a neural posterior estimator of the subhalo mass function (SHMF) and place constraints on populations of lenses generated using a separate set of galaxy sources. We find that by combining our network with a hierarchical inference framework, we can both reliably infer the SHMF across a variety of configurations and scale efficiently to populations with hundreds of lenses. By conducting precise inference on large and complex simulated data sets, our method lays a foundation for extracting dark matter constraints from the next generation of wide-field optical imaging surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Imaging the Future Threats of the Sand Dunes Along the Northwestern Coast of Nile Delta Using SAR

Although the Sand dunes screen the coastal cities from the sand dunes hazards and their infrastructures from rising sea levels and storms, they might threaten and hide the surrounding developmental projects. Thus, imaging these coastal dunes' internal anatomy and dynamics are crucial to protect the environment. In this study, the Optical and Synthetic Aperture Radar (SAR) images were processed and integrated with field observations and surveys to extract information about the past, current, and future behavior of coastal dunes in the Nile Delta-Northwest sector. A conventional change detection method using the supervised Landsat-8 images for the years 2015 and 2017 were generated to show a rapid change in the sand dune cover, where the high-resolution images of Google Earth were used to digitize the dune crests and measure its encroachment rate, which has been reached about 4 m/year with the NW–SE direction. The full-polarimetric ALOS/PALSAR-2 images from the years 2015 and 2017 show very low coherence for the sand dunes, which means these dunes are dynamic, where the changes in both power and phase imbalances of different dune fields during the investigated years (2015 and 2017) show high differences in values, which reached 40 dB and 0.06°, respectively. Finally, the extracted radar facies from the field survey show two successive groups of coastal sand dunes show a decline in the heavy minerals content to a level that might threaten the properties at the shoreline due to sea level rise and wave storms if mitigation actions are not taken place soon.

Ramadan, Rabab↗

DOE OSTI2025

Point cloud-based diffusion models for the Electron-Ion Collider

At high-energy collider experiments, generative models can be used for a wide range of tasks, including fast detector simulations, unfolding, searches of physics beyond the Standard Model, and inference tasks. In particular, it has been demonstrated that score-based diffusion models can generate high-fidelity and accurate samples of jets or collider events. This work expands on previous generative models in three distinct ways. First, our model is trained to generate entire collider events, including all particle species with complete kinematic information. We quantify how well the model learns event-wide constraints such as the conservation of momentum and discrete quantum numbers. We focus on the events at the future Electron-Ion Collider, but we expect that our results can be extended to proton-proton and heavy-ion collisions. Second, previous generative models often relied on image-based techniques. The sparsity of the data can negatively affect the fidelity and sampling time of the model. We address these issues using point clouds and a novel architecture combining edge creation with transformer modules called Point Edge Transformers. Third, we adapt the foundation model OmniLearn, to generate full collider events. This approach may indicate a transition toward adapting and fine-tuning foundation models for downstream tasks instead of training new models from scratch.

Araz, Jack Y. [Stony Brook Univ., NY (United State↗

DOE OSTI2023

Virtual Volumetric Additive Manufacturing (VirtualVAM)

Abstract Tomographic volumetric additive manufacturing (VAM) produces arbitrary 3D geometries by exposure of a rotating volume of photopolymer resin to tomographically‐patterned illumination. This enables high speed, layer‐less printing of parts from a wide range of photopolymers not amenable to layer‐by‐layer processes. Since the entire geometry is produced at once over the course of a few seconds to minutes, molecular diffusion length scales become significant to the printing process. Understanding these molecular reaction and diffusion processes is imperative for advancing VAM to a usable technology. These processes are experimentally very difficult to monitor and measure. Herein, VirtualVAM ‐ a simulation framework for modeling the tomographic VAM process, is developed and experimentally validated. VirtualVAM simulates reaction, diffusion, and heat generation processes over the course of a print with single‐voxel resolution. From a few experimentally‐determined input parameters and a set of images for projection, VirtualVAM is able to generate a large spatio‐temporal data set for any given tomographic VAM print. Using VirtualVAM, a number of experimentally‐unattainable aspects of the VAM process are investigated such as single‐voxel conversion profiles, effect of molecular oxygen, and stopping time determination. VirtualVAM also enables the optimization of exposure patterns to further improve contrast between in‐part and out‐of‐part delivered dose.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Dynamics of Product Branching from Radical Intermediates in Elementary Combustion Reactions (Final Technical Report)

While the total rate constant for many elementary reactions is well-characterized, understanding the product branching in complex reactions presents a formidable challenge. To gain an incisive probe of such reactions, our experiments investigate the dynamics of the product channels that arise from transient radical intermediates along the bimolecular reaction coordinates. Our recent published work uses the methodology developed in my group in the last fifteen years, using both imaging and scattering apparatuses. The experiments generate a particular isomeric form of an unstable radical intermediate along a bimolecular reaction coordinate and study the branching between the ensuing product channels of the energized radical as a function of its internal rotational and vibrational energy under collision-less conditions. The experiments use a combination of: 1) measurement of product velocity and angular distributions in a crossed laser-molecular beam apparatus, with electron bombardment detection in my lab in Chicago or 2) with tunable vacuum ultraviolet photoionization detection at Taiwan's National Synchrotron Radiation Research Center (NSRRC), and 3) velocity map imaging using state-selective REMPI and single photon VUV ionization of radical intermediates and reaction products. We also employ tunable VUV photoionization detection in our imaging apparatus, using difference frequency four-wave mixing to produce photoionization light tunable from 8 to 10.8 eV. This year of support funded our work to photolytically generate the radical intermediate important in the OH + propene reaction when OH adds to an end carbon. Our other major result this past year was on the photoionization detection of vinoxy radicals. Our experiments at the NSRRC definitively show that vinoxy dissociatively ionizes to both CH 3 + and HCO + , and establishes the absolute partial photoionization cross section of vinoxy to CH 3 + at 10.5 and 11.44 eV. This should allow experimentalists detecting vinoxy radicals produced in bimolecular reactions such as OH + propene to get good branching fractions to that product channel. Finally we initiated studies of the photodissociation of 1-bromo-2-chloroethane and 1,1-bromochloroethane at 193 nm at the NSRRC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

PRMI: A Dataset of Minirhizotron Images for Diverse Plant Root Study

Understanding a plant's root system architecture (RSA) is crucial for a variety of plant science problem domains including sustainability and climate adaptation. Minirhizotron (MR) technology is a widely-used approach for phenotyping RSA non-destructively by capturing root imagery over time. Precisely segmenting roots from the soil in MR imagery is a critical step in studying RSA features. In this paper, we introduce a large-scale dataset of plant root images captured by MR technology. In total, there are over 72K RGB root images across six different species including cotton, papaya, peanut, sesame, sunflower, and switchgrass in the dataset. The images span a variety of conditions including varied root age, root structures, soil types, and depths under the soil surface. All of the images have been annotated with weak image-level labels indicating whether each image contains roots or not. The image-level labels can be used to support weakly supervised learning in plant root segmentation tasks. In addition, 63K images have been manually annotated to generate pixel-level binary masks indicating whether each pixel corresponds to root or not. These pixel-level binary masks can be used as ground truth for supervised learning in semantic segmentation tasks. By introducing this dataset, we aim to facilitate the automatic segmentation of roots and the research of RSA with deep learning and other image analysis algorithms.

Xu, Weihuang↗

DOE OSTI2026

MHD-induced SOL filaments and divertor heat flux striations in NSTX

Magnetohydrodynamic (MHD) activity in NSTX has been found to induce striated heat flux patterns at the divertor. These striated heat fluxes were previously interpreted as strike-point splitting caused by stochastic magnetic lobes near the X-point. Recent analysis indicates that MHD can directly generate filaments in the scrape-off layer (SOL), and the MHD-related filaments are consistent with the rotation and the frequency of the MHD. Magnetic field line tracing from the mid-plane of the MHD-related filaments to the divertor is consistent with the location of striated heat fluxes on the divertor. Additionally, gas puff imaging (GPI) diagnostic data shows the generation of regular blobs following each edge harmonic oscillation (EHO) toroidal mode number n = 1 perturbation, which indicates that the MHD perturbation directly drives the blobs. These blobs are responsible for the divertor heat flux striations. Here, this finding provides a new framework for understanding MHD-induced edge transport and has important implications for heat-load control in NSTX-U and future spherical tokamaks.

MHD↗

DOE OSTI2024

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Austenitic 347H stainless steel offers superior mechanical properties and corrosion resistance required for extreme operating conditions such as high temperature. The change in microstructure due to composition and process variations is expected to impact material properties. Identifying microstructural features such as grain boundaries thus becomes an important task in the process-microstructure-properties loop. Applying convolutional neural network (CNN)-based deep learning models is a powerful technique to detect features from material micrographs in an automated manner. In contrast to microstructural classification, supervised CNN models for segmentation tasks require pixel-wise annotation labels. However, manual labeling of the images for the segmentation task poses a major bottleneck for generating training data and labels in a reliable and reproducible way within a reasonable timeframe. Microstructural characterization especially needs to be expedited for faster material discovery by changing alloy compositions. Here, in this study, we attempt to overcome such limitations by utilizing multimodal microscopy to generate labels directly instead of manual labeling. We combine scanning electron microscopy images of 347H stainless steel as training data and electron backscatter diffraction micrographs as pixel-wise labels for grain boundary detection as a semantic segmentation task. The viability of our method is evaluated by considering a set of deep CNN architectures. We demonstrate that despite producing instrumentation drift during data collection between two modes of microscopy, this method performs comparably to similar segmentation tasks that used manual labeling. Additionally, we find that naïve pixel-wise segmentation results in small gaps and missing boundaries in the predicted grain boundary map. By incorporating topological information during model training, the connectivity of the grain boundary network and segmentation performance is improved. Finally, our approach is validated by accurate computation on downstream tasks of predicting the underlying grain morphology distributions which are the ultimate quantities of interest for microstructural characterization.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Lasing from Finite Plasmonic Nanoparticle Lattices

Small lasers can generate coherent light for integrated photonics, in-vivo cellular imaging, and solid-state lighting. Unlike conventional lasers, plasmonic lasers can generate coherent light at sub-wavelength scales, although cavity architectures based on metal films and semiconducting gain exhibit large radiative losses and lack directional emission. In contrast, two-dimensional (2D) metal nanoparticle arrays surrounded by organic dyes can support lasing with high directionality at room temperature. Yet, the relationship between the number of nanoparticles in a finite lattice and their lasing emission characteristics is unknown. Here we show that the number of units in 2D gold nanoparticle lattices is critical to generate robust cavity resonances and lasing emission. Narrower lattice plasmons associated with stronger electromagnetic near fields are observed as nanoparticle number increases. Experimentally, we demonstrate lasing from a 30x30 nanoparticle lattice. Semi-quantum modeling indicates lower lasing thresholds and faster population inversion dynamics with higher nanoparticle numbers. These findings indicate that finite lattices of nanoparticles integrated with gain can function as independent, coherent light sources for optical multiplexing and lab-on-a-chip applications.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2025

A bi-channel aided stitching of atomic force microscopy images

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.

Atomic force microscopy↗

DOE OSTI2022

Synthetic Data Generation Using Machine Learning

Robust machine learning techniques for image analysis require a substantial amount of data to yield confident results. In the nuclear domain, data scarcity is a substantial challenge because there are so few facilities worldwide. This research focuses on being able alleviate the data scarcity problem by generating synthetic data to bridge the gap between large and small datasets. This work achieves that goal using a Generative Adversarial Network (GAN) architectural approach, by training a model on real-world data and expands that small dataset through synthetic data amendments. Model performance is impacted by the size of the real-world dataset and the number of training epochs utilized. This means that 1) It is important to develop your GAN to be optimized with the specific data type, and 2) approaches taken when training the GAN should be specialized to encompass important aspects of the dataset that it is generating. By taking a step to improve dataset sizes in this way, the gap between models trained by parties with significant amount of data and those without access to large data, closes, allowing for robust analyses of satellite imagery for nuclear domain applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Random Walks With Tweedie: A Unified View of Score-Based Diffusion Models [In the Spotlight]

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals—particularly natural images—and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, in this study, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

In situ tumor model for longitudinal in silico imaging trials

Abstract Objective.In this article, we introduce a computational model for simulating the growth of breast cancer lesions accounting for the stiffness of surrounding anatomical structures.Approach.In our model, ligaments are classified as the most rigid structures while the softer parts of the breast are occupied by fat and glandular tissues As a result of these variations in tissue elasticity, the rapidly proliferating tumor cells are met with differential resistance. It is found that these cells are likely to circumvent stiffer terrains such as ligaments, instead electing to proliferate preferentially within the more yielding confines of the breast’s soft topography. By manipulating the interstitial tumor pressure in direct proportion to the elastic constants of the tissues surrounding the tumor, this model thus creates the potential for realizing a database of unique lesion morphology sculpted by the distinctive topography of each local anatomical infrastructure. We modeled the growth of simulated lesions within volumes extracted from fatty breast models, developed by Graffet alwith a resolution of 50μm generated with the open-source and readily available Virtual Imaging Clinical Trials for Regulatory Evaluation (VICTRE) imaging pipeline. To visualize and validate the realism of the lesion models, we leveraged the imaging component of the VICTRE pipeline, which replicates the siemens mammomat inspiration mammography system in a digital format. This system was instrumental in generating digital mammogram (DM) images for each breast model containing the simulated lesions.Results.By utilizing the DM images, we were able to effectively illustrate the imaging characteristics of the lesions as they integrated with the anatomical backgrounds. Our research also involved a reader study that compared 25 simulated DM regions of interest (ROIs) with inserted lesions from our models with DM ROIs from the DDSM dataset containing real manifestations of breast cancer. In general the simulation time for the lesions was approximately 2.5 hours, but it varied depending on the lesion’s local environment.Significance.The lesion growth model will facilitate and enhance longitudinal in silico trials investigating the progression of breast cancer.

Engineering↗

DOE OSTI2022

Material Characterization of Grade 91 Steel Welds using, Micro-resolution Ultrasonic Imaging System

Grade 91 (9Cr-1Mo-V) steel is a common structural material for fossil-fuel fired and nuclear power plants because of its creep strength and oxidation resistance at high temperatures. In this research, we studied the feasibility of correlating the high-resolution images obtained from the immersion ultrasonic imaging technique to microstructure regions in Grade 91 steel plate weldments. The high-resolution ultrasonic images presented in this paper were generated using a 20-MHz focused transducer as the transmitter, and a laser vibrometer as the receiver in the through transmission configuration to produce longitudinal and shear waves. This nondestructive evaluation (NDE) method was used to identify the Fusion Zone (FZ), Heat-Affected Zone (HAZ), and Base Metal (BM) regions of Grade 91 cold metal transfer (CMT) and flux core arc welds (FCAW). The ultrasonic imaging results were analyzed using beam propagation amplitudes and homogeneity, which in turn were used to relate the different microstructure regions of the FCAW and CMT welded samples. With this study, we were able to identify highly susceptible microstructures in the weld that could potentially promote creep type failures.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2021

High-sensitivity gas-mapping 3D imager and method of operation

Measurement apparatuses and methods are disclosed for generating high-precision and -accuracy gas concentration maps that can be overlaid with 3D topographic images by rapidly scanning one or several modulated laser beams with a spatially-encoded transmitter over a scene to build-up imagery. Independent measurements of the topographic target distance and path-integrated gas concentration are combined to yield a map of the path-averaged concentration between the sensor and each point in the image. This type of image is particularly useful for finding localized regions of elevated (or anomalous) gas concentration making it ideal for large-area leak detection and quantification applications including: oil and gas pipeline monitoring, chemical processing facility monitoring, and environmental monitoring.

Kreitinger, Aaron Thomas↗

DOE OSTI2023

High-sensitivity gas-mapping 3D imager and method of operation

Kreitinger, Aaron Thomas↗

DOE OSTI2023

Enhancing Nanoparticle Detection in Interferometric Scattering (iSCAT) Microscopy Using a Mask R-CNN

Interferometric scattering microscopy (iSCAT) is a label-free optical microscopy technique that enables imaging of individual nano-objects such as nanoparticles, viruses, and proteins. Essential to this technique is the suppression of background scattering and identification of signals from nano-objects. In the presence of substrates with high roughness, scattering heterogeneities in the background, when coupled with tiny stage movements, cause features in the background to be manifested in background-suppressed iSCAT images. Traditional computer vision algorithms detect these background features as particles, limiting the accuracy of object detection in iSCAT experiments. Here, in this paper, we present a pathway to improve particle detection in such situations using supervised machine learning via a mask region-based convolutional neural network (mask R-CNN). Using a model iSCAT experiment of 19.2 nm gold nanoparticles adsorbing to a rough layer-by-layer polyelectrolyte film, we develop a method to generate labeled datasets using experimental background images and simulated particle signals and train the mask R-CNN using limited computational resources via transfer learning. We then compare the performance of the mask R-CNN trained with and without inclusion of experimental backgrounds in the dataset against that of a traditional computer vision object detection algorithm, Haar-like feature detection, by analyzing data from the model experiment. Results demonstrate that including representative backgrounds in training datasets improved the mask R-CNN in differentiating between background and particle signals and elevated performance by markedly reducing false positives. The methodology for creating a labeled dataset with representative experimental backgrounds and simulated signals facilitates the application of machine learning in iSCAT experiments with strong background scattering and thus provides a useful workflow for future researchers to improve their image processing capabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗