Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “synthetic images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Wrap-Around Out-the-Window Sensor Fusion System

The Advanced Cockpit Evaluation System (ACES) includes communication, computing, and display subsystems, mounted in a van, that synthesize out-the-window views to approximate the views of the outside world as it would be seen from the cockpit of a crewed spacecraft, aircraft, or remote control of a ground vehicle or UAV (unmanned aerial vehicle). The system includes five flat-panel display units arranged approximately in a semicircle around an operator, like cockpit windows. The scene displayed on each panel represents the view through the corresponding cockpit window. Each display unit is driven by a personal computer equipped with a video-capture card that accepts live input from any of a variety of sensors (typically, visible and/or infrared video cameras). Software running in the computers blends the live video images with synthetic images that could be generated, for example, from heads-up-display outputs, waypoints, corridors, or from satellite photographs of the same geographic region. Data from a Global Positioning System receiver and an inertial navigation system aboard the remote vehicle are used by the ACES software to keep the synthetic and live views in registration. If the live image were to fail, the synthetic scenes could still be displayed to maintain situational awareness.

Fox, Jeffrey↗
NASA NTRS2011

Visual Object Recognition and Tracking of Tools

A method has been created to automatically build an algorithm off-line, using computer-aided design (CAD) models, and to apply this at runtime. The object type is discriminated, and the position and orientation are identified. This system can work with a single image and can provide improved performance using multiple images provided from videos. The spatial processing unit uses three stages: (1) segmentation; (2) initial type, pose, and geometry (ITPG) estimation; and (3) refined type, pose, and geometry (RTPG) calculation. The image segmentation module files all the tools in an image and isolates them from the background. For this, the system uses edge-detection and thresholding to find the pixels that are part of a tool. After the pixels are identified, nearby pixels are grouped into blobs. These blobs represent the potential tools in the image and are the product of the segmentation algorithm. The second module uses matched filtering (or template matching). This approach is used for condensing synthetic images using an image subspace that captures key information. Three degrees of orientation, three degrees of position, and any number of degrees of freedom in geometry change are included. To do this, a template-matching framework is applied. This framework uses an off-line system for calculating template images, measurement images, and the measurements of the template images. These results are used online to match segmented tools against the templates. The final module is the RTPG processor. Its role is to find the exact states of the tools given initial conditions provided by the ITPG module. The requirement that the initial conditions exist allows this module to make use of a local search (whereas the ITPG module had global scope). To perform the local search, 3D model matching is used, where a synthetic image of the object is created and compared to the sensed data. The availability of low-cost PC graphics hardware allows rapid creation of synthetic images. In this approach, a function of orientation, distance, and articulation is defined as a metric on the difference between the captured image and a synthetic image with an object in the given orientation, distance, and articulation. The synthetic image is created using a model that is looked up in an object-model database. A composable software architecture is used for implementation. Video is first preprocessed to remove sensor anomalies (like dead pixels), and then is processed sequentially by a prioritized list of tracker-identifiers.

English, James↗
NASA NTRS2013

Synthetic Foveal Imaging Technology

Apparatuses and methods are disclosed that create a synthetic fovea in order to identify and highlight interesting portions of an image for further processing and rapid response. Synthetic foveal imaging implements a parallel processing architecture that uses reprogrammable logic to implement embedded, distributed, real-time foveal image processing from different sensor types while simultaneously allowing for lossless storage and retrieval of raw image data. Real-time, distributed, adaptive processing of multi-tap image sensors with coordinated processing hardware used for each output tap is enabled. In mosaic focal planes, a parallel-processing network can be implemented that treats the mosaic focal plane as a single ensemble rather than a set of isolated sensors. Various applications are enabled for imaging and robotic vision where processing and responding to enormous amounts of data quickly and efficiently is important.

Monacos, Steve P.↗
DOE OSTI2025

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks↗
NASA NTRS1993

Inverting Image Data For Optical Testing And Alignment

Data from images produced by slightly incorrectly figured concave primary mirror in telescope processed into estimate of spherical aberration of mirror, by use of algorithm finding nonlinear least-squares best fit between actual images and synthetic images produced by multiparameter mathematical model of telescope optical system. Estimated spherical aberration, in turn, converted into estimate of deviation of reflector surface from nominal precise shape. Algorithm devised as part of effort to determine error in surface figure of primary mirror of Hubble space telescope, so corrective lens designed. Modified versions of algorithm also used to find optical errors in other components of telescope or of other optical systems, for purposes of testing, alignment, and/or correction.

Shao, Michael↗
NASA NTRS2019

Spectrally Resolved Synthetic Aperture Imaging Interferometer: Final Report of NASA Innovative Advanced Concepts - Phase 1 Study

The Spectrally Resolved Synthetic-Aperture Imaging Interferometer (SRSAII) is a system proposed to provide high-resolution and high-sensitivity measurements of astronomical objects. SRSAII uses long baseline interferometric methods to achieve the resolution and low-noise, high time-precision detection to achieve the sensitivity. The primary goal of the SRSAII study was to lay out a framework for using new optical physics technologies to directly resolve, both spatially and spectrally, the disk of an exoplanet. In addition to the ambitious goal of directly resolving an exoplanet, the SRSAII team also sought to identify science opportunities achievable with intermediate system configurations which may offer resolution significantly higher than the current state of the art, but insufficient for direct resolution of an exoplanetary disk. An operational SRSAII system can function with essentially arbitrarily large baselines, achieving correspondingly high angular resolution. The primary limitation occurs in the system sensitivity, which became the major technical focus for study. In this report, we compare the predicted performance (sensitivity in SNR (Signal-to-Noise Ratio) along with angular resolution) of three interferometric techniques: direct detection (also known as homodyne interferometry), multi-channel intensity interferometry (using the Hanbury Brown and Twiss effect), and multi-channel heterodyne interferometry (using an optical frequency comb as a local oscillator). Additionally, quantum-assisted interferometry is also explored as a prospective enhancement of established methods. This report presents a survey of the technologies that enable the SRSAII techniques - optical frequency combs, single photon detectors, and photonic integrated circuits. These technologies are the basis of methods critical to SRSAII's success: precision timing, length and frequency metrology, sensitive photodetection, fine-scale wavelength filtering, and dense multi-channel operation. Lastly, we give some notional performance metrics and propose some possible experimental observations.

High Resolultion↗
DOE OSTI2023

Path-Integrated X-Ray Images for Multi-Surface Digital Image Correlation (PI-DIC)

X-ray imaging offers unique possibilities for Digital Image Correlation (DIC), opening the door for full-field deformation measurements of a test article in complex environments where optical DIC suffers severe biases or is impossible. While X-ray DIC has been performed in the past with standard DIC codes designed for optical images, the path-integrated nature of X-ray images places constraints on the experimental setup, predominantly that only a single surface of interest moves/deforms. These requirements are difficult to realize for many practical situations and limit the amount of information that can be garnered in a single test. Other X-ray based diagnostics such as Digital Volume Correlation (DVC) and Projection DVC (P-DVC) overcome these obstacles, but DVC is limited to quasi-static tests, and both DVC and P-DVC necessitate high-resolution computed tomography (CT) scan(s) and often require a potentially invasive pattern throughout the volume of the specimen. Here this work presents a novel approach to measure time-resolved displacements and strains on multiple surfaces from a single series of 2D, path-integrated (PI) X-ray images, called PI-DIC. The principle of optical flow or conservation of intensity—the foundation of DIC—was reframed for path-integrated images, for an exemplar setup comprised of two plates moving and deforming independently. Synthetic images were generated for rigid translations, rigid rotations, and uniform stretches, where each plate underwent a unique motion/deformation. Experimental specimens were fabricated (either an aluminum plate with tantalum features or a plastic plate with steel features) and the two specimens were independently translated. PI-DIC was successfully demonstrated with the synthetic images and validated with the experimental images. Prescribed displacements were recovered for each plate from the single set of path-integrated, deformed images. Errors were approximately 0.02 px for the synthetic images with 1.5% image noise, and 0.05 px for the experimental images. These results provide the foundation for PI-DIC to measure motion and deformation of multiple, independent surfaces with subpixel accuracy from a single series of path-integrated X-ray images.

47 OTHER INSTRUMENTATION↗
NASA NTRS1977

Precipitation mapping with an airborne synthetic aperture imaging radar

Use of an airborne synthetic-aperture radar (SAR) of 3.1-cm wavelength for the detection and mapping of precipitation echoes is described. Difficulties in mapping related to the incoherence of the echoes are discussed; methods of increasing resolution by Doppler filtering are suggested. Observations made with a vertical side-looking SAR system flying above a stratiform storm were found to resemble vertical cross sections obtained with conventional radar showing snow streamers, the bright band and rain. However, the actual section sampled by the SAR after filtering for zero Doppler is shown to depend upon both the relative motion of the particles and the relative winds below the aircraft. Knowledge of the relative winds, deduced from Doppler spectrum variations, and of the particle fall speeds permits the generation of horizontal and vertical cross sections displaced from the aircraft's position.

Atlas, D.↗
DOE OSTI2020

Predicting 3D Motions from Single-Camera Optical Test Data

In a typical optical test, a stereo camera pair is required to measure the three-dimensional motion of a test article; one camera typically only measures motions in the image plane of the camera, and measurements in the out-of-plane direction are missing. Finite element expansion techniques provide a path to estimate responses from a test at unmeasured degrees of freedom. Treating the case of a single camera as a measurement with unmeasured degrees of freedom, a finite element model is used to expand to the missing third dimension of the image data, allowing a full-field, three-dimensional measurement to be obtained from a set of images from a single camera. The key to this technique relies on the mapping of finite element deformations to image deformations, creating a set of mode shape images that are used to filter the response in the image into modal responses. These modal responses are then applied to the finite element model to estimate physical responses at all finite element model degrees of freedom. The mapping from finite element model to image is achieved using synthetic images produced by a rendering software. Finally, the technique is applied first to a synthetic deformation image, and then is validated using an experimental set of images.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Windowed Fourier transform and cross-correlation algorithms for molecular tagging velocimetry

In this study, simulated and experimental molecular tagging velocimetry (MTV) images have been analyzed with a technique commonly used to process grid images on surfaces, the windowed Fourier transform with local spectrum analysis (WFT-LSA). A systematic synthetic image study of the modulation transfer function (MTF) and error tendencies of the WFT-LSA was performed and compared with a PIV-style cross-correlation algorithm to see if advanced strategies such as iterative image deformation can improve analysis of gridded images with high noise levels. Testing of single-pass algorithms showed that in typical MTV images, the WFT-LSA yields significantly lower bias errors than cross-correlation (CC) at displacements greater than 1 pixel but slightly higher random error at all displacements and image conditions. Analysis of the MTF shows that CC provided better resolution of spatial fluctuations than the WFT-LSA in many combinations of grid size and interrogation window. Tests of image deformation algorithms showed that the gap in performance between CC and WFT-LSA is maintained even as both methods improve. Additionally, WFT-LSA and CC methods are applied to real MTV experiments in high-speed gas jet flows. A preliminary analysis of phosphorescence lifetime provided by acetone vapor excited at 266 nm is used for assessing the required gas speeds for making MTV application feasible. The application of WFT-LSA to real MTV images demonstrates the ability of the algorithm to handle further real-world effects that could not be considered in the synthetic image analysis, like reduced signal-to-noise ratio and non-uniform intensity of the tagging grid across the image introduced by the actual laser beam energy distribution. With experimental images, CC is more accurate with shear flows but less robust to high noise levels than WFT-LSA, as predicted by the synthetic image analysis.

42 ENGINEERING↗
NASA NTRS1982

Spaceborne synthetic-aperture imaging radars - Applications, techniques, and technology

In June 1978, the Seasat satellite was placed into orbit around the earth with a synthetic-aperture imaging radar (SAR) as one of the payload sensors. The Seasat SAR provided, for the first time, synoptic radar images of the earth's surface with a resolution of 25 m. In November 1981, the second imaging radar was successfully operated from space on the Shuttle. The Shuttle Imaging Radar-A acquired images over a variety of regions around the world with an imaging geometry different from the one used by the Seasat SAR. The spaceborne SAR principle is discussed, taking into account ambiguities, orbital and environmental factors, range curvature and range walk, surface interaction mechanisms, thermal and speckle noise, key tradeoff parameters, and nonconventional SAR systems. Attention is also given to spaceborne SAR sensors, the digital processing of spaceborne SAR data, the optical processing of spaceborne SAR data, postimage formation processing, data interpretation techniques and applications, and the next decade.

Elachi, C.↗
NASA NTRS1991

Randomization of dust-ejecta motions and the observed morphology of cometary heads

The computer code that has been used over years to study the dust-coma morphology of comets and to generate their synthetic images is upgraded by introducing two categories of random perturbations into the motions of dust particles ejected from discrete sources of activity on the nucleus surface. The new technique is applied to three types of morphological features: multiple concentric halos, a system of spiral jets, and a sunward fan-shaped coma. The results indicate that inclusion of random perturbations substantially enhances the capability for generating synthetic images that faithfully simulate the observed appearance of dust comets. By increasing the magnitude of perturbations in the synthetic images beyond a certain limit, it is possible to 'erase' morphological features characteristic of the ejection process. This implies that the lack of distinct morphology in the head of a comet cannot be interpreted as the absence of discrete sources of activity on the nucleus surface. The effects of varying random perturbations on the appearance of the computer-generated images are investigated in detail and the suspected major role that imperfect flow collimation (or flow divergence) in dust jets plays with regard to the observed coma morphology is discussed.

Sekanina, Zdenek↗
NASA NTRS1983

Remote sensing with spaceborne synthetic aperture imaging radars: A review

A review is given of remote sensing with Spaceborne Synthetic Aperture Radars (SAR's). In 1978, a spaceborne SA was flown on the SEASAT satellite. It acquired high resulution images over many regions in North America and the North Pacific. The acquired data clearly demonstrate the capability of spaceborne SARs to: image and track polar ice floes; image ocean surface patterns including swells, internal waves, current boundaries, weather boundaries and vessels; and image land features which are used to acquire information about the surface geology and land cover. In 1981, another SAR was flown on the second shuttle flight. This Shuttle Imaging Radar (SIR-A) acquired land and ocean images over many areas around the world. The emphasis of the SIR-A experiment was mainly toward geologic mapping. Some of the key results of the SIR-A experiment are given.

Cimino, J. B.↗
NASA NTRS2019

Target Optimal Aperture Selection

This document describes the computation of optimal pixels for planetary transit targets. The method we describe is based on that used in the End-to-End Model (ETEM), which simulates Kepler science output. An optimal aperture for a target is defined as the set of pixels which maximizes the signal-to-noise ratio (SNR) for that target. The optimal aperture for a target is determined by using catalog data to generate, for that target, a synthetic image with all background stars and signals and a second synthetic image with the target star's flux only. These images are incorporated into a noise model, from which the SNR of each pixel is computed. The pixels around a target are summed in an order that maximizes the SNR with each term. As dimmer and dimmer pixels contribute to this sum, the SNR reaches a maximum and further terms decrease the SNR. The set of pixels whose SNR sums to this maximum value defines the optimal aperture.

Bryson, Stephen↗
DOE OSTI2023

Multi-Task Learning of Scanning Electron Microscopy and Synthetic Thermal Tomography Images for Detection of Defects in Additively Manufactured Metals

One of the key challenges in laser powder bed fusion (LPBF) additive manufacturing of metals is the appearance of microscopic pores in 3D-printed metallic structures. Quality control in LPBF can be accomplished with non-destructive imaging of the actual 3D-printed structures. Thermal tomography (TT) is a promising non-contact, non-destructive imaging method, which allows for the visualization of subsurface defects in arbitrary-sized metallic structures. However, because imaging is based on heat diffusion, TT images suffer from blurring, which increases with depth. We have been investigating the enhancement of TT imaging capability using machine learning. In this work, we introduce a novel multi-task learning (MTL) approach, which simultaneously performs the classification of synthetic TT images, and segmentation of experimental scanning electron microscopy (SEM) images. Synthetic TT images are obtained from computer simulations of metallic structures with subsurface elliptical-shaped defects, while experimental SEM images are obtained from imaging of LPBF-printed stainless-steel coupons. MTL network is implemented as a shared U-net encoder between the classification and the segmentation tasks. Results of this study show that the MTL network performs better in both the classification of synthetic TT images and the segmentation of SEM images tasks, as compared to the conventional approach when the individual tasks are performed independently of each other.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Dynamic Differential Image Circle Diameter Measurement Precision Assessment: Application to Burning Droplets

Dynamic measurement precision assessment has been achieved for a differential circle measurement application. Differential circle diameter measurement, in image analysis, typically requires fitting a circle model that optimizes for image distortions, defects or occlusions. The differential task occurs when precise measurements of diameter change are required given object size variation with time. An automated system was designed to provide diameter measurements and associated measurement precision of images of a fuel droplet undergoing combustion in zero gravity for the FLEX-2 dataset. An image gradient-based, least-squares boundary point fitting method to a circle or ellipse model is used for diameter measurement. The presence of soot aggregates poses significant challenges for diameter measurements when it occludes part of the droplet boundary. The precision of the diameter measurements depends upon the image quality. Using synthetic image simulations that model the soot behavior, we developed a model based on image quality measures that assesses the measurement precision for each individual diameter measurement. Thus, diameter measurements with precision assessments were made available for follow-up scientific analysis. As a result, the algorithm's success rate for measurable runs was 98%. In cases of limited occlusion, a measurement precision of ±0.2 pixels for the FLEX-2 dataset was achieved.

42 ENGINEERING↗
NASA NTRS1992

Geometric ortho-rectification and generation of sigma(0) image products from multiple incidence synthetic aperture radar images

The results of the first phase of a cooperative effort in geometric orthorectification and generation of sigma(0) images of multiple incidence SAR images are presented. The geometric accuracy of the final image products is approximately 18 m or 1.5 pixels. A method for registering radar imagery collected from an airborne platform to an existing digital elevation model despite the effects of unmodeled variations in the flight path of the platform is demonstrated. The results indicate the requirements for a more detailed digital elevation model.

Curlander, James↗