Results for “image and signal processing” — Page 17

NASA NTRS1990

Ge/Si Integrated Circuit For Infrared Imaging

Proposed integrated circuit consists of focal-plane array of metal/germanium Schottky-barrier photodetectors on same chip with silicon-based circuits that processes signals from photodetectors. Made compatible with underlying silicon-based circuitry by growing germanium epitaxially on silicon circuit wafers. Metal deposited in ultrahigh vacuum immediately after growth of germanium. Combination of described techniques results in high-resolution infrared-imaging circuits of superior performance.

Fathauer, Robert W.↗

NASA NTRS1996

Spectral imaging applications: Remote sensing, environmental monitoring, medicine, military operations, factory automation and manufacturing

This paper reviews the activities at OKSI related to imaging spectroscopy presenting current and future applications of the technology. The authors discuss the development of several systems including hardware, signal processing, data classification algorithms and benchmarking techniques to determine algorithm performance. Signal processing for each application is tailored by incorporating the phenomenology appropriate to the process, into the algorithms. Pixel signatures are classified using techniques such as principal component analyses, generalized eigenvalue analysis and novel very fast neural network methods. The major hyperspectral imaging systems developed at OKSI include the Intelligent Missile Seeker (IMS) demonstration project for real-time target/decoy discrimination, and the Thermal InfraRed Imaging Spectrometer (TIRIS) for detection and tracking of toxic plumes and gases. In addition, systems for applications in medical photodiagnosis, manufacturing technology, and for crop monitoring are also under development.

National Defense↗

NASA NTRS2018

Two and Three Dimensional near Infrared Subcutaneous Structure Imager Using Real Time Nonlinear Video Processing

An imager is provided for viewing subcutaneous structures. In an embodiment of the invention, the imager includes a camera configured to generate a video frame, and an adaptive nonlinear processor. The adaptive nonlinear processor is configured to adjust a signal of the video frame below a first threshold to a maximum dark level and to adjust the signal of the video frame above a second threshold to a maximum light level. The imager further includes a display, configured to display the processed video frame.

Krasowski, Michael J↗

NASA NTRS2006

Sensing Super-position: Visual Instrument Sensor Replacement

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This project addresses the technical feasibility of augmenting human vision through Sensing Super-position using a Visual Instrument Sensory Organ Replacement (VISOR). The current implementation of the VISOR device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of the human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system.

Maluf, David A.↗

NASA NTRS2007

Sensing Super-Position: Human Sensing Beyond the Visual Spectrum

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This paper addresses the technical feasibility of augmenting human vision through Sensing Super-position by mixing natural Human sensing. The current implementation of the device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of Lie human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system. The human brain is superior to most existing computer systems in rapidly extracting relevant information from blurred, noisy, and redundant images. From a theoretical viewpoint, this means that the available bandwidth is not exploited in an optimal way. While image-processing techniques can manipulate, condense and focus the information (e.g., Fourier Transforms), keeping the mapping as direct and simple as possible might also reduce the risk of accidentally filtering out important clues. After all, especially a perfect non-redundant sound representation is prone to loss of relevant information in the non-perfect human hearing system. Also, a complicated non-redundant image-to-sound mapping may well be far more difficult to learn and comprehend than a straightforward mapping, while the mapping system would increase in complexity and cost. This work will demonstrate some basic information processing for optimal information capture for headmounted systems.

Maluf, David A.↗

DOE OSTI2020

A holey cavity for single-transducer 3D ultrasound imaging with physical optimization

Within the compressive sensing (CS) framework, one effective way to increase the likelihood of successful signal reconstruction is to employ random processes in the construction of the sensing matrix. This work presents a 3D holey cavity, with diverse frequency modes, to spectrally code, that is, randomize, the ultrasound wave fields. The simulated results show that the use of such a cavity enables imaging simple or complex targets, such as spheres or the letter E, by only a single transceiver—something that is not possible without the use of a coding structure like the cavity. The effect of noise on imaging results and the size of the targets on the first-order Born approximation (BA) are also investigated. Moreover, this study attempts to optimize the cavity, based on a single numerical metric, such as the sum of singular values (SSV) or mutual coherence (MC). Yet, it will be shown that neither of these metrics can consistently compare the norm-one imaging performance between two cavities of different materials or hole sizes. This leaves finding a quantitative metric for these kinds of optimizations an open problem.

42 ENGINEERING↗

NASA NTRS2013

Ionospheric Specifications for SAR Interferometry (ISSI)

The ISSI software package is designed to image the ionosphere from space by calibrating and processing polarimetric synthetic aperture radar (PolSAR) data collected from low Earth orbit satellites. Signals transmitted and received by a PolSAR are subject to the Faraday rotation effect as they traverse the magnetized ionosphere. The ISSI algorithms combine the horizontally and vertically polarized (with respect to the radar system) SAR signals to estimate Faraday rotation and ionospheric total electron content (TEC) with spatial resolutions of sub-kilometers to kilometers, and to derive radar system calibration parameters. The ISSI software package has been designed and developed to integrate the algorithms, process PolSAR data, and image as well as visualize the ionospheric measurements. A number of tests have been conducted using ISSI with PolSAR data collected from various latitude regions using the phase array-type L-band synthetic aperture radar (PALSAR) onboard Japan Aerospace Exploration Agency's Advanced Land Observing Satellite mission, and also with Global Positioning System data. These tests have demonstrated and validated SAR-derived ionospheric images and data correction algorithms.

Pi, Xiaoqing↗

NASA NTRS2008

On Convergence of Development Costs and Cost Models for Complex Spaceflight Instrument Electronics

Development costs of a few recent spaceflight instrument electrical and electronics subsystems have diverged from respective heritage cost model predictions. The cost models used are Grass Roots, Price-H and Parametric Model. These cost models originated in the military and industry around 1970 and were successfully adopted and patched by NASA on a mission-by-mission basis for years. However, the complexity of new instruments recently changed rapidly by orders of magnitude. This is most obvious in the complexity of representative spaceflight instrument electronics' data system. It is now required to perform intermediate processing of digitized data apart from conventional processing of science phenomenon signals from multiple detectors. This involves on-board instrument formatting of computational operands from row data for example, images), multi-million operations per second on large volumes of data in reconfigurable hardware (in addition to processing on a general purpose imbedded or standalone instrument flight computer), as well as making decisions for on-board system adaptation and resource reconfiguration. The instrument data system is now tasked to perform more functions, such as forming packets and instrument-level data compression of more than one data stream, which are traditionally performed by the spacecraft command and data handling system. It is furthermore required that the electronics box for new complex instruments is developed for one-digit watt power consumption, small size and that it is light-weight, and delivers super-computing capabilities. The conflict between the actual development cost of newer complex instruments and its electronics components' heritage cost model predictions seems to be irreconcilable. This conflict and an approach to its resolution are addressed in this paper by determining the complexity parameters, complexity index, and their use in enhanced cost model.

Kizhner, Semion↗

NASA NTRS1982

Image Processing

Images are prepared from data acquired by the multispectral scanner aboard Landsat, which views Earth in four ranges of the electromagnetic spectrum, two visible bands and two infrared. Scanner picks up radiation from ground objects and converts the radiation signatures to digital signals, which are relayed to Earth and recorded on tape. Each tape contains "pixels" or picture elements covering a ground area; computerized equipment processes the tapes and plots each pixel, line be line to produce the basic image. Image can be further processed to correct sensor errors, to heighten contrast for feature emphasis or to enhance the end product in other ways. Key factor in conversion of digital data to visual form is precision of processing equipment. Jet Propulsion Laboratory prepared a digital mosaic that was plotted and enhanced by Optronics International, Inc. by use of the company's C-4300 Colorwrite, a high precision, high speed system which manipulates and analyzes digital data and presents it in visual form on film. Optronics manufactures a complete family of image enhancement processing systems to meet all users' needs. Enhanced imagery is useful to geologists, hydrologists, land use planners, agricultural specialists geographers and others.

Source record↗

DOE OSTI2025

Random Walks With Tweedie: A Unified View of Score-Based Diffusion Models [In the Spotlight]

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals—particularly natural images—and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, in this study, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1995

High-performance passive microwave survey on Josephson Junctions

The quasi-optical generations of images of objects with their internal structure in millimeter (MM) and submillimeter (SMM) bands is one of prime problems of modern radioelectronics. The main advantage of passive MM imaging systems in comparison with visible and infrared (IR) systems is small attenuation of signals in fog, cloud, smoke, dust and other obscurants. However, at a panoramic scanning of space the observation time lengthens and thereby the information processing rate becomes restricted so that single-channel system cannot image in real time. Therefore we must use many radiometers in parallel to reduce the observation time. Such system must contain receiving sensors as pixels in multibeam antenna. The use of Josephson Junctions (JJ) for this purpose together with the cryoelectronic devices like GaAs FET (field effect transistors) or SQUIDS for signal amplifications after JJ is of particular interest in this case.

Denisov, A. G.↗

NASA NTRS1988

Image-gathering system design for information and fidelity

Image gathering and processing are assessed in terms of information and fidelity, and the relationship between these two figures of merit is examined. It is assumed that the system is linear and isoplanatic and that the signal and noise amplitudes are Gaussian, wide-sense stationary, and statistically independent. Within these constraints, it is found that the combined process of image gathering and reconstruction (which is intended to reproduce the output of the image-gathering system) behaves as optical, or photographic, image formation in that the informationally optimized design of the image-gathering system ordinarily does not maximize the fidelity of the reconstructed image. The combined process of image gathering and restoration (which is intended to reproduce the input of the image-gathering system) behaves more as a communication channel in that the informationally optimized design of the image-gathering system tends to maximize the fidelity of optimally restored representations of the input.

Huck, Friedrich O.↗

NASA NTRSDate not supplied

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC for Lunar Exploration: Differential Dynamic Microscopy to Spectroscopy to Computer Vision

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha Ray↗

NASA NTRSDate not supplied

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC for Lunar Exploration: Differential Dynamic Microscopy to Spectroscopy to Computer Vision

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface. In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha-Ray↗

NASA NTRSDate not supplied

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC for Lunar Exploration: Differential Dynamic Microscopy to Spectroscopy to Computer Vision

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha Ray↗

NASA NTRSDate not supplied

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha Ray↗

DOE OSTI2025

High-resolution high-throughput spatiotemporal strain imaging reveals loss mechanisms in a surface acoustic wave device

Surface acoustic wave devices are key components for processing radio frequency signals in wireless communication because these devices offer simultaneously high performance, compact size and low cost. The optimization of the device structure requires a quantitative understanding of energy conversion and loss mechanisms. Here we use stroboscopic full-field diffraction x-ray microscopy to reveal an unanticipated acoustic loss in a prototypical one-port resonator device. A non-uniform acoustic excitation in the active area was responsible for the substantial end and side leakages observed at the design frequency. Quantitative analysis of the strain amplitude using a wave decomposition method allowed the determination of several key device parameters. This high-resolution high-throughput spatiotemporal strain imaging technique is more generally applicable to the study of dynamic strain modulation in nanoscale acoustic, electronic, optical and quantum devices. The high sensitivity allows precise measurement of the strain modulation with picometer-scale amplitude.

Zhou, Tao [ESRF - The European Synchrotron, Grenob↗

DOE OSTI2022

Bootstrap estimation of the effect of instrument response function uncertainty on the reconstruction of fusion neutron sources

Neutron imagers are important diagnostics for the inertial confinement fusion implosions at the National Ignition Facility. They provide two- and three-dimensional reconstructions of the neutron source shape that are key indicators of the overall performance. To interpret the shape results properly, it is critical to estimate the uncertainty in those reconstructions. There are two main sources of uncertainties: limited neutron statistics, leading to random errors in the reconstructed images, and incomplete knowledge of the instrument response function (the pinhole-dependent point spread function). While the statistical errors dominate the uncertainty for lower yield deuterium-tritium (DT) shots, errors due to the instrument response function dominate the uncertainty for DT yields on the order of 10 16 neutrons or higher. In this work, a bootstrapping method estimates the uncertainty in a reconstructed image due to the incomplete knowledge of the instrument response function. The main reconstruction is created from the fixed collection of pinhole images that are best aligned with the neutron source. Additional reconstructions are then built using subsets of that collection of images. Variations in the shapes of these additional reconstructions originate solely from uncertainties in the instrument response function, allowing us to use them to provide an additional systematic uncertainty estimate.

47 OTHER INSTRUMENTATION↗