Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Wind Turbine Blade Finishing Automation: Robotic Toolpath Generation

Wind turbine blades are now over 100 meters long and can reach heights of several meters while in the finishing area of the factory. Because of this, automation should be used to lower the manufacturing cost and make the process safer for blade manufacturing technicians. This session will present a novel method that generates a six degree of freedom robotic toolpath with 3D cameras for the finishing of wind turbine blades to drive down the levelized cost and make wind energy even more competitive in the utility scale energy generation industry.

3d imaging↗
NASA NTRS2017

Lessons Learned from OSIRIS-Rex Autonomous Navigation Using Natural Feature Tracking

The Origins, Spectral Interpretation, Resource Identification, Security-Regolith Explorer (Osiris-REx) spacecraft is scheduled to launch in September, 2016 to embark on an asteroid sample return mission. It is expected to rendezvous with the asteroid, Bennu, navigate to the surface, collect a sample (July 20), and return the sample to Earth (September 23). The original mission design called for using one of two Flash Lidar units to provide autonomous navigation to the surface. Following Preliminary design and initial development of the Lidars, reliability issues with the hardware and test program prompted the project to begin development of an alternative navigation technique to be used as a backup to the Lidar. At the critical design review, Natural Feature Tracking (NFT) was added to the mission. NFT is an onboard optical navigation system that compares observed images to a set of asteroid terrain models which are rendered in real-time from a catalog stored in memory on the flight computer. Onboard knowledge of the spacecraft state is then updated by a Kalman filter using the measured residuals between the rendered reference images and the actual observed images. The asteroid terrain models used by NFT are built from a shape model generated from observations collected during earlier phases of the mission and include both terrain shape and albedo information about the asteroid surface. As a result, the success of NFT is highly dependent on selecting a set of topographic features that can be both identified during descent as well as reliably rendered using the shape model data available. During development, the OSIRIS-REx team faced significant challenges in developing a process conducive to robust operation. This was especially true for terrain models to be used as the spacecraft gets close to the asteroid and higher fidelity models are required for reliable image correlation. This paper will present some of the challenges and lessons learned from the development of the NFT system which includes not just the flight hardware and software but the development of the terrain models used to generate the onboard rendered images.

Navigation↗
NASA NTRS2012

Current Usage and Future Prospects of Multispectral (RGB) Satellite Imagery in Support of NWS Forecast Offices and National Centers

Current and future satellite sensors provide remotely sensed quantities from a variety of wavelengths ranging from the visible to the passive microwave, from both geostationary and low-Earth orbits. The NASA Short-term Prediction Research and Transition (SPoRT) Center has a long history of providing multispectral imagery from the Moderate Resolution Imaging Spectroradiometer (MODIS) aboard NASA s Terra and Aqua satellites in support of NWS forecast office activities. Products from MODIS have recently been extended to include a broader suite of multispectral imagery similar to those developed by EUMETSAT, based upon the spectral channel s available from the Spinning Enhanced Visible and InfraRed Imager (SEVIRI) aboard METEOSAT-9. This broader suite includes products that discriminate between air mass types associated with synoptic-scale features, assists in the identification of dust, and improves upon paired channel difference detection of fog and low cloud events. Similarly, researchers at NOAA/NESDIS and CIRA have developed air mass discrimination capabilities using channels available from the current GOES Sounders. Other applications of multispectral composites include combinations of high and low frequency, horizontal and vertically polarized passive microwave brightness temperatures to discriminate tropical cyclone structures and other synoptic-scale features. Many of these capabilities have been transitioned for evaluation and operational use at NWS Weather Forecast Offices and National Centers through collaborations with SPoRT and CIRA. Future instruments will continue the availability of these products and also expand upon current capabilities. The Advanced Baseline Imager (ABI) on GOES-R will improve the spectral, spatial, and temporal resolution of our current geostationary capabilities, and the recent launch of the Suomi National Polar-Orbiting Partnership (S-NPP) carries instruments such as the Visible Infrared Imager Radiometer Suite (VIIRS), the Cross-track Infrared Sounder (CrIS), and the Advanced Technology Microwave Sounder (ATMS), which have unrivaled spectral and spatial resolution, as precursors to the JPSS era (i.e., the next generation of polar orbiting satellites). At the same time, new image manipulation and display capabilities are available within AWIPS II, the next generation of the NWS forecaster decision support system. This presentation will present a review of SPoRT, CIRA, and NRL collaborations regarding multispectral satellite imagery and articulate an integrated and collaborative path forward with Raytheon AWIPS II development staff for integrating current and future capabilities that support new satellite instrumentation and the AWIPS II decision support system.

Molthan, Andrew L.↗
NASA NTRS1976

Precision processing of earth image data

Precise corrections of Landsat data are useful for generating land-use maps, detecting various crops and determining their acreage, and detecting changes. The paper discusses computer processing and visualization techniques for Landsat data so that users can get more information from the imagery. The elementary unit of data in each band of each scene is the integrated value of intensity of reflected light detected in the field of view by each sensor. To develop the basic mathematical approach for precision correction of the data, differences between positions of ground control points on the reference map and the observed control points in the scene are used to evaluate the coefficients of cubic time functions of roll, pitch, and yaw, and a linear time function of altitude deviation from normal height above local earth's surface. The resultant equation, termed a mapping function, corrects the warped data image into one that approximates the reference map. Applications are discussed relative to shade prints, extraction of road features, and atlas of cities.

Bernstein, R.↗
DOE OSTI2025

PyCMG-based Simulation of Volumetric Concrete Microstructure

Concrete is a complex, heterogeneous material with a microstructure composed of aggregates, cement paste, and pores spanning multiple length scales. Understanding this microstructure is critical for advancing the performance, durability, and modeling of concrete-based systems. While experimental imaging such as X-ray computed tomography (XCT) provides valuable insights, generating large datasets with detailed ground truth annotations is both costly and labor-intensive due to challenges in segmenting similar phases, such as aggregates and cement paste, that often share similar attenuation properties. To address this, we developed a pipeline to simulate realistic 3D concrete microstructures using the open-source Python package PyCMG. This simulation effort focuses on generating high-fidelity, annotated microstructures that can serve as training or benchmarking datasets for image analysis, segmentation algorithms, and machine learning models, particularly in scenarios where experimental data is scarce.

Ziabari, Amir [Oak Ridge National Laboratory; ORNL↗
DOE OSTI2021

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they arc only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

47 OTHER INSTRUMENTATION↗
NASA NTRS2005

A back-illuminated megapixel CMOS image sensor

In this paper, we present the test and characterization results for a back-illuminated megapixel CMOS imager. The imager pixel consists of a standard junction photodiode coupled to a three transistor-per-pixel switched source-follower readout [1]. The imager also consists of integrated timing and control and bias generation circuits, and provides analog output. The analog column-scan circuits were implemented in such a way that the imager could be configured to run in off-chip correlated double-sampling (CDS) mode. The imager was originally designed for normal front-illuminated operation, and was fabricated in a commercially available 0.5 pn triple-metal CMOS-imager compatible process. For backside illumination, the imager was thinned by etching away the substrate was etched away in a post-fabrication processing step.

Complementary Metal Oxide Semiconductor imager (CM↗
NASA NTRS2012

Common-Path Wavefront Sensing for Advanced Coronagraphs

Imaging of faint companions around nearby stars is not limited by either intrinsic resolution of a coronagraph/telescope system, nor is it strictly photon limited. Typically, it is both the magnitude and temporal variation of small phase and amplitude errors imparted to the electric field by elements in the optical system which will limit ultimate performance. Adaptive optics systems, particularly those with multiple deformable mirrors, can remove these errors, but they need to be sensed in the final image plane. If the sensing system is before the final image plane, which is typical for most systems, then the non-common path optics between the wavefront sensor and science image plane will lead to un-sensed errors. However, a new generation of high-performance coronagraphs naturally lend themselves to wavefront sensing in the final image plane. These coronagraphs and the wavefront sensing will be discussed, as well as plans for demonstrating this with a high-contrast system on the ground. Such a system will be a key system-level proof for a future space-based coronagraph mission, which will also be discussed.

adaptive optics↗
NASA NTRS2020

CyberGAN: Generating High-fidelity Cybersecurity Data With Generative Adversarial Networks

Machine learning for cyber defense offers the promise of detecting adversarial activity against the ground data systems managing critical space assets. A fundamental challenge facing machine learning research in cybersecurity is the lack of high-fidelity, shareable datasets for robust evaluation and testing of machine learning-based solutions. High-fidelity, real-world datasets are necessary for reliable benchmarking of nominal system behavior and malicious activity. Unfortunately, such realistic datasets of both nominal and adversarial activity are rarely shared publicly by data owners due to security and privacy concerns. Besides, the available adversarial data is sparse, which makes training models on malicious activity much harder. This situation has impeded and continues to impede the research and successful adoption of machine learning methods for cyber defense. Researchers have dealt with this problem by generating data within a low-fidelity lab environment, using classified and thus unshareable datasets, or downloading low-fidelity public datasets made available by others. We propose an innovative solution to the problem by employing machine learning methods to generate high-fidelity data. Specifically, we propose the use of Generative Adversarial Networks (GANs) to generate high-fidelity data for cybersecurity purposes. GANs have found successful image processing and natural language applications, but have not yet been investigated for cyber data generation. Our proposed approach first involves training the `discriminator' network of the GAN with a sample of real-world data consisting of malicious and nominal samples. We then use the `generator' network to generate new high-fidelity data samples consisting of an appropriate mix of malicious and nominal activity. We demonstrate applications of our architecture by generating high-fidelity cybersecurity data containing both malicious and nominal samples. We thoroughly evaluate the fidelity of our generated data using heuristics and evaluate its usefulness for machine learning applications using three different datasets. Overall, our approach results in high-fidelity, shareable datasets.

Zhang, Yuening↗
DOE OSTI2025

A machine-learning approach to measure 3D sample properties from 2D Transmission Electron Microscopy images

Transmission Electron Microscopy (TEM) is a powerful tool for the characterization of materials at the nanoscale; however, its inherent two-dimensional (2D) nature poses significant challenges to accurately measure three-dimensional (3D) properties. We introduce a supervised machine-learning model that predicts 3D structural information, such as sample thickness and curvature, from a series of conventional 2D TEM images. The model, a U-Net convolutional neural network, is trained on a large synthetic dataset generated from dynamical diffraction simulations that model TEM’s complex, nonlinear image formation, accounting for sample thickness and curvature. This physically realistic framework enables exploration of a broad parameter space impractical to sample experimentally. We demonstrate that the trained model has accurate predictions for experimental single-crystal silicon samples, achieving performance comparable to established measurement techniques. This work highlights the critical role of robust, simulation-based training in overcoming the limitations of real-world imaging artifacts and inconsistent sample geometries. By integrating machine learning with numerical simulations, we offer an efficient and scalable framework for quantitative TEM analysis, paving the way for more sophisticated 3D characterization of complex materials.

Dynamical diffraction↗
NASA NTRS1994

Climatic, eustatic, and tectnoic controls on Quarternary deposits and landforms, Red Sea coast, Egypt

The degree to which local climatic variations, eustatic sea level fluctuations, and tectonic uplift have influenced the development of Quaternary marine and fluvial landforms and deposits along the Red Sea coast, Eastern Desert, was investigated using a combination of remote sensing and field data, age determinations of corals, and numerical simulations. False color composites generated from Landsat Thematic Mapper and SPOT image data, digital elevation models derived from sterophotogrammetric analysis of SPOT data, and field observations document that a approximately 10-km wide swath inland from the coast is covered in many places with coalescing alluvial fans of Quaternary age. Wadis cutting through the fans exhibit several pairs of fluvial terraces, and wadi walls expose alluvium interbedded with corraline limestone deposits Further, three distinct coral terraces are evident along the coatline. Climatic, eustatic, and tectonic uplift controls on the overall system were simulated using a cellular automata algorithm with the following characteristics: (1) uplift as a function of position and time, as defined by the elevations and ages of corals; (2) climatic variations driven by insolation changes associated with Milankovitch cycles; (3) sea level fluctuations based on U/Th ages of coral terraces and eustatic data; and (4) parametrized fluvial erosion and deposition. Results imply that the fans and coralline limestones were generated in a setting in which the tectonic uplift rate decreased over the Quarternary to negligible values at present. Coralline limestones formed furing eustatic highstands when alluvium was trapped uspstream and wadis filled with debris. During lowstands, wadis cut into sedimentary deposits; coupled with continuing uplift, fans were dissected, leaving remnant surfaces, and wadi-related terraces were generated by down cutting. Only landforms from the past three to four eustatic sea level cycles (i.e., approximately 300 to 400 kyr) are likely to have survived erosion and deposition associated with fluvial processes.

Arvidson, Raymond↗
NASA NTRS1983

Geometric correction process for the Landsat-4 Thematic Mapper

The processing approaches which form the basis of the Landsat-4 Thematic Mapper (TM) geometric correction system are summarized. The correction is accomplished in two phases. In the first phase, correction data are generated. The spacecraft position, TM frame attitude, TM scanning mirror position, and detector sampling are found as a function of time through a combination of flight segment measurements, ground segment modeling, and control point information. The data, along with the earth position and geoid model, are used to determine the earth location for each TM image sample. Then, using map projections, correction data can be generated which define the location of each TM image sample on the output coordinate system. In the second phase, the correction data are used to resample TM detector samples onto the output coordinate system.

Beyer, E. P.↗
DOE OSTI2020

Autonomous adaptive data acquisition for scanning hyperspectral imaging

Non-invasive and label-free spectral microscopy (spectromicroscopy) techniques can provide quantitative biochemical information complementary to genomic sequencing, transcriptomic profiling, and proteomic analyses. However, spectromicroscopy techniques generate high-dimensional data; acquisition of a single spectral image can range from tens of minutes to hours, depending on the desired spatial resolution and the image size. This substantially limits the timescales of observable transient biological processes. To address this challenge and move spectromicroscopy towards efficient real-time spatiochemical imaging, we developed a grid-less autonomous adaptive sampling method. Our method substantially decreases image acquisition time while increasing sampling density in regions of steeper physico-chemical gradients. When implemented with scanning Fourier Transform infrared spectromicroscopy experiments, this grid-less adaptive sampling approach outperformed standard uniform grid sampling in a two-component chemical model system and in a complex biological sample, Caenorhabditis elegans. We quantitatively and qualitatively assess the efficiency of data acquisition using performance metrics and multivariate infrared spectral analysis, respectively.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

TomoGAN: low-dose synchrotron x-ray tomography with generative adversarial networks: discussion

Synchrotron-based x-ray tomography is a noninvasive imaging technique that allows for reconstructing the internal structure of materials at high spatial resolutions from tens of micrometers to a few nanometers. In order to resolve sample features at smaller length scales, however, a higher radiation dose is required. Therefore, the limitation on the achievable resolution is set primarily by noise at these length scales. We present TomoGAN, a denoising technique based on generative adversarial networks, for improving the quality of reconstructed images for low-dose imaging conditions. We evaluate our approach in two photon-budget-limited experimental conditions: (1) sufficient number of low-dose projections (based on Nyquist sampling), and (2) insufficient or limited number of high-dose projections. In both cases, the angular sampling is assumed to be isotropic, and the photon budget throughout the experiment is fixed based on the maximum allowable radiation dose on the sample. Evaluation with both simulated and experimental datasets shows that our approach can significantly reduce noise in reconstructed images, improving the structural similarity score of simulation and experimental data from 0.18 to 0.9 and from 0.18 to 0.41, respectively. Furthermore, the quality of the reconstructed images with filtered back projection followed by our denoising approach exceeds that of reconstructions with the simultaneous iterative reconstruction technique, showing the computational superiority of our approach.

42 ENGINEERING↗
NASA NTRS1973

Results of precision processing (scene correction) of ERTS-1 images using digital image processing techniques

ERTS-1 MSS and RBV data recorded on computer compatible tapes have been analyzed and processed, and preliminary results have been obtained. No degradation of intensity (radiance) information occurred in implementing the geometric correction. The quality and resolution of the digitally processed images are very good, due primarily to the fact that the number of film generations and conversions is reduced to a minimum. Processing times of digitally processed images are about equivalent to the NDPF electro-optical processor.

Bernstein, R.↗
NASA NTRS1993

Earth-based measurement of lunar topography using delayed radar interferometry

Radar interferometry has been applied to radar mapping of the surface of Venus to resolve the ambiguity in the backscatter from the areas with the same delay-Doppler coordinates. For observations of the Moon these points are usually isolated by the small extent of the area illuminated by the radar beam so that interferometric techniques can be used to determine a third dimension to the location of the radar backscatter. Recent observations of Sinus Iridum (41.5 deg N, 31.0 deg W) using the Arecibo Observatory S-Band radar system (12.6 cm wavelength) in Apr. and Aug. 1992 have yielded a pair of images viewed with a very small 0.0420 deg difference in incidence angle. These images can be used as a delay interferometric pair and have been correlated to generate phase fringes that are related to topography. The spatial resolution of the images are 18 m in delay and 33 m in cross range (Doppler). The anticipated topographic resolution once the phase fringes have been unwrapped is approximately +/- 10 m.

Stacy, N. J. S.↗
NASA NTRS2015

Simulation of Wake Vortex Radiometric Detection via Jet Exhaust Proxy

This paper describes an analysis of the potential of an airborne hyperspectral imaging IR instrument to infer wake vortices via turbine jet exhaust as a proxy. The goal was to determine the requirements for an imaging spectrometer or radiometer to effectively detect the exhaust plume, and by inference, the location of the wake vortices. The effort examines the gas spectroscopy of the various major constituents of turbine jet exhaust and their contributions to the modeled detectable radiance. Initially, a theoretical analysis of wake vortex proxy detection by thermal radiation was realized in a series of simulations. The first stage used the SLAB plume model to simulate turbine jet exhaust plume characteristics, including exhaust gas transport dynamics and concentrations. The second stage used these plume characteristics as input to the Line By Line Radiative Transfer Model (LBLRTM) to simulate responses from both an imaging IR hyperspectral spectrometer or radiometer. These numerical simulations generated thermal imagery that was compared with previously reported wake vortex temperature data. This research is a continuation of an effort to specify the requirements for an imaging IR spectrometer or radiometer to make wake vortex measurements. Results of the two-stage simulation will be reported, including instrument specifications for wake vortex thermal detection. These results will be compared with previously reported results for IR imaging spectrometer performance.

Daniels, Taumi S.↗
DOE OSTI2022

Pan-sharpening for microscopy

Techniques for generating full-spatial resolution, full spectral resolution image(s) from a 3D spectral-data cube for any spectral value within a given spectral range are provided without requiring the acquisition of all full-spatial resolution, full spectral resolution data by an instrument. The 3D spectral-data cube is generated from a limited number of full-spatial resolution, sparse spectral resolution data and a sparse-spatial resolution, full-spectral resolution data of the same area of the sample. The use of the 3D spectral-data cube reduces the data acquisition time.

Ovchinnikova, Olga S.↗