Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

AesFA: An Aesthetic Feature-Aware Arbitrary Neural Style Transfer

Neural style transfer (NST) has evolved significantly in recent years. Yet, despite its rapid progress and advancement, existing NST methods either struggle to transfer aesthetic information from a style effectively or suffer from high computational costs and inefficiencies in feature disentanglement due to using pre-trained models. This work proposes a lightweight but effective model, AesFA---Aesthetic Feature-Aware NST. The primary idea is to decompose the image via its frequencies to better disentangle aesthetic styles from the reference image while training the entire model in an end-to-end manner to exclude pre-trained models at inference completely. Finally, to improve the network's ability to extract more distinct representations and further enhance the stylization quality, this work introduces a new aesthetic feature: contrastive loss. Extensive experiments and ablations show the approach not only outperforms recent NST methods in terms of stylization quality, but it also achieves faster inference. Codes are available at https://github.com/Sooyyoungg/AesFA.

97 MATHEMATICS AND COMPUTING↗

An Overview of SHERLOC Raman and Fluorescence Spectroscopy Results Obtained During Perseverance’s Green Zone Campaign at Jezero Crater, Mars

The Perseverance rover landed in Jezero crater, Mars, in February 2021. The field site was chosen because orbiter data provided evidence that the crater hosted an ancient (>2.7 Ga) fluvio-lacustrine environment. The Octavia E. Butler landing site is located ~1.9 km east of the erosional remnant of the Jezero river delta. Scanning Habitable Environments with Raman and Luminescence for Organics and Chemicals (SHERLOC) is an arm-mounted instrument that combines fluorescence and Raman spectroscopy with microscopic imaging to analyze geological materials in order to better understand the history of the environments recorded in the rocks within Jezero crater and to search for potential biosignatures. SHERLOC has two microscopic cameras, the Autofocus and Context Imager (ACI) and the Wide-Angle Topographic Sensor for Operations and eNgineering, (WATSON). These subsystems obtain high spatial resolution (10.1–100 µm/pixel) images to identify grain-scale structure and texture. SHERLOC spectroscopy enables high-sensitivity detection, characterization, and spatially-resolved correlation of trace organic materials. SHERLOC’s 248.6 nm deep UV laser generates a 100 µm-diameter spot. Photons generated by Raman scattering and fluorescence emission are collected and the spectra are downlinked to Earth for analysis. Knowledge of where the laser is pointed allows for mineral and compositional maps to be generated and overlain in ACI and WATSON images. Early spectroscopy observations focused on natural rock surfaces at targets named Nataani (sol 83), Bi_la_sana (sol 98) and Foux (sol 141). These surfaces included patches of aeolian dust that had settled upon the rocks. Perseverance’s abrasion tool is expected to become available in August 2021; it will grind to depths of 14 mm to remove dust and penetrate coatings and weathering rinds. This presentation will summarize major results from analysis of the rocks examined by SHERLOC during Perseverance’s first science and sample coring campaign (Green Zone Campaign).

Luther W Beegle↗

Next-Generation Sensing Technologies for Exploring Ocean Worlds

Dr. Ved Chirayath's plenary presentation will highlight two instrument technologies he invented at NASA including Fluid Lensing, the first remote sensing technology capable of imaging through ocean waves in 3D at sub-cm resolutions, and MiDAR (Multispectral Imaging, Detection and Active Reflectance), a next-generation active hyperspectral remote sensing and optical communications instrument. Fluid Lensing has been used to provide the first 3D multispectral imagery of shallow marine systems from unmanned aerial vehicles (UAVs, or drones), including coral reefs in American Samoa and stromatolite reefs in Hamelin Pool, Western Australia. MiDAR is being deployed on aircraft, and underwater remotely operated vehicles (ROVs) as a new method to remotely sense living and nonliving structures in extreme environments. MiDAR images targets with high-intensity narrowband structured optical radiation to measure an object's non-linear spectral reflectance, image through fluid interfaces such as ocean waves with active fluid lensing, and simultaneously transmit high-bandwidth data. As an active instrument, MiDAR is capable of remotely sensing reflectance at the centimeter (cm) spatial scale with a signal-to-noise ratio (SNR) multiple orders of magnitude higher than passive airborne and spaceborne remote sensing systems with significantly reduced integration time. This allows for rapid video-frame-rate hyperspectral sensing into the far ultraviolet and VNIR wavelengths. Finally, Chirayath will present preliminary results from NASA NeMO-Net (Neural Multi-Modal Observation and Training Network), the first neural network for global coral reef classification using fluid lensing and MiDAR.

Technologies↗

Effects of magnification and visual accommodation on aimpoint estimation in simulated landings with real and virtual image displays

Twenty professional pilots observed a computer-generated airport scene during simulated autopilot-coupled night landing approaches and at two points (20 sec and 10 sec before touchdown) judged whether the airplane would undershoot or overshoot the aimpoint. Visual accommodation was continuously measured using an automatic infrared optometer. Experimental variables included approach slope angle, display magnification, visual focus demand (using ophthalmic lenses), and presentation of the display as either a real (direct view) or a virtual (collimated) image. Aimpoint judgments shifted predictably with actual approach slope and display magnification. Both pilot judgments and measured accommodation interacted with focus demand with real-image displays but not with virtual-image displays. With either type of display, measured accommodation lagged far behind focus demand and was reliably less responsive to the virtual images. Pilot judgments shifted dramatically from an overwhelming perceived-overshoot bias 20 sec before touchdown to a reliable undershoot bias 10 sec later.

Randle, R. J.↗

Landsat 8 Remote Sensing Reflectance (Rrs) Products: Evaluations, Intercomparisons, and Enhancements

The Operational Land Imager (OLI) onboard Landsat-8 is generating high-quality aquatic science products, the most critical of which is the remote sensing reflectance (Rrs), defined as the ratio of water-leaving radiance to the total downwelling irradiance just above water. The quality of the Rrs products has not, however, been extensively assessed. This manuscript provides a comprehensive evaluation of Level-1B, i.e., top of atmosphere reflectance, and Rrs products available from OLI imagery under near-ideal atmospheric conditions in moderately turbid waters. The procedure includes a) evaluations of the Rrs products at sites included in the Ocean Color component of the Aerosol Robotic Network (AERONET-OC), b) intercomparisons and cross-calibrations against other ocean color products, and c) optimizations of vicarious calibration gains across the entire OLI observing swath. Results indicate that the near-infrared and shortwave infrared (NIR-SWIR) band combinations yield the most robust and stable Rrs retrievals in moderately turbid waters. Intercomparisons against products derived from the Visible Infrared Imaging Radiometer Suite (VIIRS) and the Moderate Resolution Imaging Spectroradiometer onboard the Aqua platform (MODISA) indicate slight across-track non-uniformities (<1%) associated with OLI scenes in the blue bands. In both product domains (TOA and Rrs), on average, the OLI products were found larger in radiometric responses in the blue channels. Following the implementation of updated vicarious calibration gains and accounting for across-track non-uniformities, matchup analyses using independent in-situ validation data confirmed improvements in Rrs products. These findings further support high-fidelity OLI-derived aquatic science products in terms of both demonstrating a robust atmospheric correction method and providing consistent products across OLI's imaging swath.

Pahlevan, Nima↗

Development of Natural Flaw Samples for Evaluating Nondestructive Testing Methods for Foam Thermal Protection Systems

Low density polyurethane foam has been an important insulation material for space launch vehicles for several decades. The potential for damage from foam breaking away from the NASA External Tank was not realized until the foam impacts on the Columbia Orbiter vehicle caused damage to its Leading Edge thermal protection systems (TPS). Development of improved inspection techniques on the foam TPS is necessary to prevent similar occurrences in the future. Foamed panels with drilled holes for volumetric flaws and Teflon inserts to simulate debonded conditions have been used to evaluate and calibrate nondestructive testing (NDT) methods. Unfortunately the symmetric edges and dissimilar materials used in the preparation of these simulated flaws provide an artificially large signal while very little signal is generated from the actual defects themselves. In other words, the same signal are not generated from the artificial defects in the foam test panels as produced when inspecting natural defect in the ET foam TPS. A project to create more realistic voids similar to what actually occurs during manufacturing operations was began in order to improve detection of critical voids during inspections. This presentation describes approaches taken to create more natural voids in foam TPS in order to provide a more realistic evaluation of what the NDT methods can detect. These flaw creation techniques were developed with both sprayed foam and poured foam used for insulation on the External Tank. Test panels with simulated defects have been used to evaluate NDT methods for the inspection of the External Tank. A comparison of images between natural flaws and machined flaws generated from backscatter x-ray radiography, x-ray laminography, terahertz imaging and millimeter wave imaging show significant differences in identifying defect regions.

Workman, Gary L.↗

Photoneutron Production Using an Electron Linear Accelerator for Applications in Neutron Imaging

Photoneutron production is possible using an electron linear accelerator and a target capable of generating photonuclear reactions. A short pulse neutron source can be useful for neutron imaging dynamic experiments. This study is aimed at the feasibility of photoneutron production using a 20 MeV electron linear accelerator and tungsten and depleted uranium targets of various thicknesses. MCNP6 (Monte Carlo N-Particle) code will be used to develop a computational model to estimate total neutron yield, and this will be verified at the Idaho State University’s Accelerator Center. After verification of the neutron yield and energy spectra, an additional MCNP6 model will be developed to analyze the neutron imaging processes. This study will potentially prove it is possible to conduct multi-mode imaging experiments on the anticipated Scorpius electron linear accelerator at the Nevada National Security Sites.

43 PARTICLE ACCELERATORS↗

Instance Segmentation for Direct Measurements of Satellites in Metal Powders and Automated Microstructural Characterization from Image Data

In this work, we propose instance segmentation as a useful tool for image analysis in materials science. Instance segmentation is an advanced technique in computer vision which generates individual segmentation masks for every object of interest that is recognized in an image. Using an out-of-the-box implementation of Mask R-CNN, instance segmentation is applied to images of metal powder particles produced through gas atomization. Leveraging transfer learning allows for the analysis to be conducted with a very small training set of labeled images. As well as providing another method for measuring the particle size distribution, we demonstrate the first direct measurements of the satellite content in powder samples. After analyzing the results for the labeled data dataset, the trained model was used to generate measurements for a much larger set of unlabeled images. The resulting particle size measurements showed reasonable agreement with laser scattering measurements. The satellite measurements were self-consistent and showed good agreement with the expected trends for different samples. Finally, we present a small case study showing how instance segmentation can be used to measure spheroidite content in the UltraHigh Carbon Steel DataBase, demonstrating the flexibility of the technique.

36 MATERIALS SCIENCE↗

Analysis of the dynamics of African vegetation using the normalized difference vegetation index

Images at a resolution of 8 km are currently being generated for the whole of Africa, displaying the normalized difference vegetation index (NDVI). These images have undergone a process of temporal compositing to reduce the effects of cloud cover and atmospheric variation. When the NDVI is plotted against time, different cover types are shown to have characteristic profiles corresponding closely with their phenology. The resultant pattern of NDVI values displayed on the images is analyzed in terms of the cover types present and local variations in rainfall. Comparison between images for 1983 and 1984 overall showed considerable similarities, but significant differences were observed in the northward extent of the greening wave in the Sahel, the greening up of the Kalahari Desert and East African communities. It is concluded that vegetation monitoring using NDVI images needs to be associated with scene stratification according to cover type.

Townshend, J. R. G.↗

Variable Shadow Screens for Imaging Optical Devices

Variable shadow screens have been proposed for reducing the apparent brightnesses of very bright light sources relative to other sources within the fields of view of diverse imaging optical devices, including video and film cameras and optical devices for imaging directly into the human eye. In other words, variable shadow screens would increase the effective dynamic ranges of such devices. Traditionally, imaging sensors are protected against excessive brightness by use of dark filters and/or reduction of iris diameters. These traditional means do not increase dynamic range; they reduce the ability to view or image dimmer features of an image because they reduce the brightness of all parts of an image by the same factor. On the other hand, a variable shadow screen would darken only the excessively bright parts of an image. For example, dim objects in a field of view that included the setting Sun or bright headlights could be seen more readily in a picture taken through a variable shadow screen than in a picture of the same scene taken through a dark filter or a narrowed iris. The figure depicts one of many potential variations of the basic concept of the variable shadow screen. The shadow screen would be a normally transparent liquid-crystal matrix placed in front of a focal-plane array of photodetectors in a charge-coupled-device video camera. The shadow screen would be placed far enough from the focal plane so as not to disrupt the focal-plane image to an unacceptable degree, yet close enough so that the out-of-focus shadows cast by the screen would still be effective in darkening the brightest parts of the image. The image detected by the photodetector array itself would be used as feedback to drive the variable shadow screen: The video output of the camera would be processed by suitable analog and/or digital electronic circuitry to generate a negative partial version of the image to be impressed on the shadow screen. The parts of the shadow screen in front of those parts of the image with brightness below a specified threshold would be left transparent; the parts of the shadow screen in front of those parts of the image where the brightness exceeded the threshold would be darkened by an amount that would increase with the excess above the threshold.

Lu, Ed↗

Innovative Video Diagnostic Equipment for Material Science

Materials science experiments under microgravity increasingly rely on advanced optical systems to determine the physical properties of the samples under investigation. This includes video systems with high spatial and temporal resolution. The acquisition, handling, storage and transmission to ground of the resulting video data are very challenging. Since the available downlink data rate is limited, the capability to compress the video data significantly without compromising the data quality is essential. We report on the development of a Digital Video System (DVS) for EML (Electro Magnetic Levitator) which provides real-time video acquisition, high compression using advanced Wavelet algorithms, storage and transmission of a continuous flow of video with different characteristics in terms of image dimensions and frame rates. The DVS is able to operate with the latest generation of high-performance cameras acquiring high resolution video images up to 4Mpixels@60 fps or high frame rate video images up to about 1000 fps@512x512pixels.

Capuano, G.↗

Compressive Sensing Based Data Acquisition Architecture for Transient Stellar Events in Crowded Star Fields

Compressive sensing is a mathematical technique for simultaneous data acquisition and compression. In this work, we show a CS based architecture for acquiring and reconstructing transient stellar events. This architecture reconstructs a differenced image itself, eliminating the need for any sparse domain transforms, otherwise required for traditional CS reconstruction. The resulting reconstructed differenced image is of critical importance as the information required for generating a time-series photometric light curve is obtained only from a differenced image. Hence, reconstructing a crowded star spatial image, followed by differencing is wasteful. This architecture eliminates the need to 1.) transform an image to a sparse domain, 2.) Reconstruct a dense field, and then apply differencing on the image to obtain the image of critical value. We study the case of microlensing to depict a star source experiencing magnification in time. Our results show that this architecture is able to reconstruct star source magnitudes with magnification factors greater than 1 for clean images with error less than 2% using only 10% of the Nyquist rate samples.

Asmita Korde-Patel↗

Compressive Sensing Based Data Acquisition Architecture for Transient Stellar Events in Crowded Star Fields

Compressive sensing is a mathematical technique for simultaneous data acquisition and compression. In this work, we show a CS based architecture for acquiring and reconstructing transient stellar events. This architecture recon-structs a differenced image itself, eliminating the need for any sparse domain transforms, otherwise required for traditional CS reconstruction. The resulting reconstructed differenced image is of critical importance as the information required for generating a time-series photometric light curve is obtained only from a differenced image. Hence, reconstructing a crowded star spatial image, followed by differencing is wasteful. This architecture eliminates the need to 1.) transform an image to a sparse domain, 2.) Reconstruct a dense field, and then apply differencing on the image to obtain the image of critical value. We study the case of microlensing to depict a star source experiencing magnification in time. Our results show that this architecture is able to reconstruct star source magnitudes with magnification factors greater than 1 for clean images with error less than 2% using only 10% of the Nyquist rate samples.

Compressive Sensing, Data acquisition, Image diffe↗

Compressive Sensing Based Data Acquisition Architecture for Transient Stellar Events in Crowded Star Fields

Compressive sensing is a mathematical technique for simultaneous data acquisition and compression. In this work, we show a CS based architecture for acquiring and reconstructing transient stellar events. This architecture recon-structs a differenced image itself, eliminating the need for any sparse domain transforms, otherwise required for traditional CS reconstruction. The resulting reconstructed differenced image is of critical importance as the information required for generating a time-series photometric light curve is obtained only from a differenced image. Hence, reconstructing a crowded star spatial image, followed by differencing is wasteful. This architecture eliminates the need to 1.) transform an image to a sparse domain, 2.) Reconstruct a dense field, and then apply differencing on the image to obtain the image of critical value. We study the case of microlensing to depict a star source experiencing magnification in time. Our results show that this architecture is able to reconstruct star source magnitudes with magnification factors greater than 1 for clean images with error less than 2% using only 10% of the Nyquist rate samples.

Asmita Korde-patel↗

Retroreflective Background Oriented Schlieren Imaging Results from the NASA Plume/Shock Interaction Test

In support of NASA's Commercial Supersonics Technology (CST) project, a test was conducted in the 9-by-7 ft. supersonic section of the NASA Ames Unitary Plan Wind Tunnel (UPWT). The tests were designed to study the interaction of shocks with a supersonic jet characteristic of those that may occur on a commercial supersonic aircraft. Multiple shock generating geometries were tested to examine the interaction dynamics as they pertain to sonic boom mitigation. An integral part of the analyses of these interactions are the interpretation of the data generated from the retroreflective Background Oriented Schlieren (RBOS) imaging technique employed for this test. The regularization- based optical flow methodology used to generate these data is described. Sample results are compared to those using normalized cross-correlation. The reduced noise, additional feature detail, and fewer false artifacts provided by the optical flow technique produced clearer time-averaged images, allowing for better interpretation of the underlying flow phenomena. These images, coupled with pressure signatures in the near field, are used to provide an overview of the detailed interaction flowfields.

optical flow↗

Fast and bright scintillators for ultrafast materials dynamics using 4th generation synchrotron

We present recent advances in fast and bright scintillators for ultrafast X-ray phase contrast imaging of dynamic materials experiments at the upgraded Advanced Photon Source (APS-U), a fourth generation synchrotron. APS-U enables hard X-ray imaging at frame rates of at least 13 MHz (corresponding to 77 ns or shorter interframe intervals), creating a new need for scintillators with faster response and higher light output than lutetium yttrium oxyorthosilicate (LYSO). For indirect imaging and diffraction with ultrafast cameras, commercial lanthanum bromide (LaBr3) and cerium bromide (CeBr3) are promising candidates. These materials exhibit decay times approximately a factor of two shorter than LYSO (around 40 ns) and lutetium oxyorthosilicate (LSO), while maintaining comparable light yield per incident X-ray photon. However, their implementation at APS-U requires addressing several challenges, including material limitations due to hygroscopicity, efficient optical coupling to imaging systems, and high quantum efficiency for conversion of scintillation light, predominantly at wavelengths below 400 nm, into detectable electronic signals. We report results from material characterization, detector integration and packaging, and beamline experiments of materials with impact. In addition, emerging scintillator classes, including perovskites and high-entropy materials, are discussed as potential alternatives for next-generation ultrafast X-ray diagnostics.

Wang, Zhehui [Los Alamos] (ORCID:0000000178264063)↗

"Virtual Cockpit Window" for a Windowless Aerospacecraft

A software system processes navigational and sensory information in real time to generate a three-dimensional-appearing image of the external environment for viewing by crewmembers of a windowless aerospacecraft. The design of the particular aerospacecraft (the X-38) is such that the addition of a real transparent cockpit window to the airframe would have resulted in unacceptably large increases in weight and cost. When exerting manual control, an aircrew needs to see terrain, obstructions, and other features around the aircraft in order to land safely. The X-38 is capable of automated landing, but even when this capability is utilized, the crew still needs to view the external environment: From the very beginning of the United States space program, crews have expressed profound dislike for windowless vehicles. The wellbeing of an aircrew is considerably promoted by a three-dimensional view of terrain and obstructions. The present software system was developed to satisfy the need for such a view. In conjunction with a computer and display equipment that weigh less than would a real transparent window, this software system thus provides a virtual cockpit window. The key problem in the development of this software system was to create a realistic three-dimensional perspective view that is updated in real time. The problem was solved by building upon a pre-existing commercial program LandForm C3 that combines the speed of flight-simulator software with the power of geographic-information-system software to generate real-time, three-dimensional-appearing displays of terrain and other features of flight environments. In the development of the present software, the pre-existing program was modified to enable it to utilize real-time information on the position and attitude of the aerospacecraft to generate a view of the external world as it would appear to a person looking out through a window in the aerospacecraft. The development included innovations in realistic horizon-limit modeling, three-dimensional stereographic display, and interfaces for utilization of data from inertial-navigation devices, Global Positioning System receivers, and laser rangefinders.

Abernathy, Michael F.↗

Virtual Sensors: Using Data Mining to Efficiently Estimate Spectra

Detecting clouds within a satellite image is essential for retrieving surface geophysical parameters, such as albedo and temperature, from optical and thermal imagery because the retrieval methods tend to be valid for clear skies only. Thus, routine satellite data processing requires reliable automated cloud detection algorithms that are applicable to many surface types. Unfortunately, cloud detection over snow and ice is difficult due to the lack of spectral contrast between clouds and snow. Snow and clouds are both highly reflective in the visible wavelen,ats and often show little contrast in the thermal Infrared. However, at 1.6 microns, the spectral signatures of snow and clouds differ enough to allow improved snow/ice/cloud discrimination. The recent Terra and Aqua Moderate Resolution Imaging Spectro-Radiometer (MODIS) sensors have a channel (channel 6) at 1.6 microns. Presently the most comprehensive, long-term information on surface albedo and temperature over snow- and ice-covered surfaces comes from the Advanced Very High Resolution Radiometer ( AVHRR) sensor that has been providing imagery since July 1981. The earlier AVHRR sensors (e.g. AVHRR/2) did not however have a channel designed for discriminating clouds from snow, such as the 1.6 micron channel available on the more recent AVHRR/3 or the MODIS sensors. In the absence of the 1.6 micron channel, the AVHRR Polar Pathfinder (APP) product performs cloud detection using a combination of time-series analysis and multispectral threshold tests based on the satellite's measuring channels to produce a cloud mask. The method has been found to work reasonably well over sea ice, but not so well over the ice sheets. Thus, improving the cloud mask in the APP dataset would be extremely helpful toward increasing the accuracy of the albedo and temperature retrievals, as well as extending the time-series of albedo and temperature retrievals from the more recent sensors to the historical ones. In this work, we use data mining methods to construct a model of MODIS channel 6 as a function of other channels that are common to both MODIS and AVHRR. The idea is to use the model to generate the equivalent of MODIS channel 6 for AVHRR as a function of the AVHRR equivalents to MODIS channels. We call this a Virtual Sensor because it predicts unmeasured spectra. The goal is to use this virtual channel 6. to yield a cloud mask superior to what is currently used in APP . Our results show that several data mining methods such as multilayer perceptrons (MLPs), ensemble methods (e.g., bagging), and kernel methods (e.g., support vector machines) generate channel 6 for unseen MODIS images with high accuracy. Because the true channel 6 is not available for AVHRR images, we qualitatively assess the virtual channel 6 for several AVHRR images.

Srivastava, Ashok↗