Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Ground-Based Localization of Mars Rovers

The document discusses a procedure for localizing the Mars rovers in site frame, a locally defined reference frame on the Martian surface. MER onboard position within a site frame is estimated onboard and is based on wheel odometry. Odometry estimation of rover position is only reliable over relatively short distances assuming no wheel slip, sinkage, etc. As the rover traverses, its onboard estimate of position in the current site frame accumulates errors and will need to be corrected on occasions via relocalization on the ground (mission operations). The procedure provides a systematic process for ground operators to localize the rover. The method focuses on analysis of acquired images used to declare a site frame and images acquired post-drive. Target selection is performed using two main steps. In the first step, the user identifies features of interest from the images used to declare the current site. Each of the selected target s position in site frame is recorded. In the second step, post-traverse measurements of the selected features positions are recorded again, this time in rover frame, using images acquired post-traverse. In the third step, we transform the post-traverse target s positions to local level frame. In the fourth step, we compute the delta differences in the pre- and post-traverse target s position. In the fifth step, we analyze the delta differences with techniques that compute their statistics to determine the rover s position in the site frame.

Trebi-Ollennu, Ashitey↗

Passive IFF: Autonomous Nonintrusive Rapid Identification of Friendly Assets

A proposed optoelectronic instrument would identify targets rapidly, without need to radiate an interrogating signal, apply identifying marks to the targets, or equip the targets with transponders. The instrument was conceived as an identification, friend or foe (IFF) system in a battlefield setting, where it would be part of a targeting system for weapons, by providing rapid identification for aimed weapons to help in deciding whether and when to trigger them. The instrument could also be adapted to law-enforcement and industrial applications in which it is necessary to rapidly identify objects in view. The instrument would comprise mainly an optical correlator and a neural processor (see figure). The inherent parallel-processing speed and capability of the optical correlator would be exploited to obtain rapid identification of a set of probable targets within a scene of interest and to define regions within the scene for the neural processor to analyze. The neural processor would then concentrate on each region selected by the optical correlator in an effort to identify the target. Depending on whether or not a target was recognized by comparison of its image data with data in an internal database on which the neural processor was trained, the processor would generate an identifying signal (typically, friend or foe ). The time taken for this identification process would be less than the time needed by a human or robotic gunner to acquire a view of, and aim at, a target. An optical correlator that has been under development for several years and that has been demonstrated to be capable of tracking a cruise missile might be considered a prototype of the optical correlator in the proposed IFF instrument. This optical correlator features a 512-by-512-pixel input image frame and operates at an input frame rate of 60 Hz. It includes a spatial light modulator (SLM) for video-to-optical image conversion, a pair of precise lenses to effect Fourier transforms, a filter SLM for digital-to-optical correlation-filter data conversion, and a charge-coupled device (CCD) for detection of correlation peaks. In operation, the input scene grabbed by a video sensor is streamed into the input SLM. Precomputed correlation-filter data files representative of known targets are then downloaded and sequenced into the filter SLM at a rate of 1,000 Hz. When there occurs a match between the input target data and one of the known-target data files, the CCD detects a correlation peak at the location of the target. Distortion- invariant correlation filters from a bank of such filters are then sequenced through the optical correlator for each input frame. The net result is the rapid preliminary recognition of one or a few targets.

Moynihan, Philip↗

Modified Polar-Format Software for Processing SAR Data

HMPF is a computer program that implements a modified polar-format algorithm for processing data from spaceborne synthetic-aperture radar (SAR) systems. Unlike prior polar-format processing algorithms, this algorithm is based on the assumption that the radar signal wavefronts are spherical rather than planar. The algorithm provides for resampling of SAR pulse data from slant range to radial distance from the center of a reference sphere that is nominally the local Earth surface. Then, invoking the projection-slice theorem, the resampled pulse data are Fourier-transformed over radial distance, arranged in the wavenumber domain according to the acquisition geometry, resampled to a Cartesian grid, and inverse-Fourier-transformed. The result of this process is the focused SAR image. HMPF, and perhaps other programs that implement variants of the algorithm, may give better accuracy than do prior algorithms for processing strip-map SAR data from high altitudes and may give better phase preservation relative to prior polar-format algorithms for processing spotlight-mode SAR data.

Chen, Curtis↗

Filling-in of Far-Red and Near-Infrared Solar Lines by Terrestrial and Atmospheric Effects: Simulations and Space-Based Observations from SCHIAMACHY and GOSAT

Mapping of terrestrial vegetation fluorescence from space is of interest because it can potentially provide global information on the functional status of vegetation including light use efficiency and global primary productivity that can be used for global carbon cycle modeling. Space-based measurement of solar-induced chlorophyll fluorescence is challenging, because its signal is small as compared with the much larger reflectance signal. Ground- and aircraft-based approaches have made use of the dark and spectrally-wide 02-A (approx 760 nm) and O2-B (approx 690 nm) atmospheric features to detect the weak fluorescence signal. More recently, Joiner et a1. and Frankenberg et a1. focused on longer-wavelength solar Fraunhofer lines that can be observed with space-based instruments such as the currently operational GOSAT. They showed that fluorescence can be detected using Fraunhofer lines away from the far-red chlorophyll-a fluorescence peak even when the surface is relatively bright. Here, we build on that work by developing methodology to correct for instrumental artifacts that produce false filling-in signals that can bias fluorescence retrievals. We also examine other potential sources of filling-in at far-red and NIR wavelengths. Another objective is to explore the possibility of making fluorescence measurements from space with lower spectral resolution instrumentation than the GOSAT interferometer. We focus on the 866 nm Ca II solar Fraunhofer line. Very few laboratory and ground-based measurements of vegetation fluorescence have been reported at wavelengths longer than 800 mn. Some results of fluorescence measurements of corn leaves acquired in the laboratory using polychromatic excitation at wavelengths shorter than 665 nm show that at 866 nm, the measured signal is of the order of 0.1-0.2 mw/sq m/nm/sr. In this work we use the following satellite observations: We use SCIAMACHY channel 5 in nadir mode that covers wavelengths between 773 and 1063 nm at a spectral resolution of 0.54 nm. GOSAT has two instrument packages: the Thermal And Near-infrared Sensor for carbon Observation-Fourier Transform Spectrometer (TANSO-FTS) and the Cloud and Aerosol Imager (CAI). We use TANSO-FTS band 1, which extends from approximately 758 to 775 mn and we use cloud fraction derived from the CAL We compare satellite-derived fluorescence with the Enhanced Vegetation Index (EVI), an Aqua/MODIS-derived vegetation reflectance-based index that indicates relative greenness and is used to infer photosynthetic function.

Joiner, J.↗

Filling-in of Far-Red and Near-Infrared Solar Lines by Terrestrial and Atmospheric Effects: Simulations and Space-Based Observations from SCIAMACHY and GOSAT

Mapping of terrestrial vegetation fluorescence from space is of interest because it can potentially provide global information on the functional status of vegetation including light use efficiency and global primary productivity that can be used for global carbon cycle modeling. Space-based measurement of solar-induced chlorophyll fluorescence is challenging, because its signal is small as compared with the much larger reflectance signal. Ground- and aircraft-based approaches have made use of the dark and spectrally-wide O2-A ( approx 760 nm) and O2-B (approx 690 nm) atmospheric features to detect the weak fluorescence signal. More recently, Joiner et al. and Frankenberg et al. focused on longer-wavelength solar Fraunhofer lines that can be observed with space-based instruments such as the currently operational GOSAT. They showed that fluorescence can be detected using Fraunhofer lines away from the far-red chlorophyll-a fluorescence peak even when the surface is relatively bright. Here, we build on that work by developing methodology to correct for instrumental artifacts that produce false filling-in signals that can bias fluorescence retrievals. We also examine other potential sources of filling-in at far-red and NIR wavelengths. Another objective is to explore the possibility of making fluorescence measurements from space with lower spectral resolution instrumentation than the GOSAT interferometer. We focus on the 866nm Ca II solar Fraunhofer line. Very few laboratory and ground-based measurements of vegetation fluorescence have been reported at wavelengths longer than 800 nm. Some results of fluorescence measurements of corn leaves acquired in the laboratory using polychromatic excitation at wavelengths shorter than 665nm show that at 866 nm, the measured signal is of the order of 0.1-0.2 mW/sq m/nm/sr. In this work, we use the following satellite observations: We use SCIAMACHY channel 5 in nadir mode that covers wavelengths between 773 and 1063nm at a spectral resolution of 0.54 nm. GOSAT has two instrument packages: the Thermal And Near-infrared Sensor for carbon Observation-Fourier Transform Spectrometer (TANSO-FTS) and the Cloud and Aerosol Imager (CAI). We use TANSO-FTS band 1, which extends from approximately 758 to 775nm and we use cloud fraction derived from the CAI. We compare satellite-derived fluorescence with the Enhanced Vegetation Index (EVI), an Aqua/MODIS-derived vegetation reflectance-based index that indicates relative greenness and is used to infer photosynthetic function.

Joiner, J.↗

Implementation of a Wavefront-Sensing Algorithm

A computer program has been written as a unique implementation of an image-based wavefront-sensing algorithm reported in "Iterative-Transform Phase Retrieval Using Adaptive Diversity" (GSC-14879-1), NASA Tech Briefs, Vol. 31, No. 4 (April 2007), page 32. This software was originally intended for application to the James Webb Space Telescope, but is also applicable to other segmented-mirror telescopes. The software is capable of determining optical-wavefront information using, as input, a variable number of irradiance measurements collected in defocus planes about the best focal position. The software also uses input of the geometrical definition of the telescope exit pupil (otherwise denoted the pupil mask) to identify the locations of the segments of the primary telescope mirror. From the irradiance data and mask information, the software calculates an estimate of the optical wavefront (a measure of performance) of the telescope generally and across each primary mirror segment specifically. The software is capable of generating irradiance data, wavefront estimates, and basis functions for the full telescope and for each primary-mirror segment. Optionally, each of these pieces of information can be measured or computed outside of the software and incorporated during execution of the software.

Smith, Jeffrey S.↗

Range and Intensity Image-Based Terrain and Vehicle Relative Pose Estimation System

A navigation system includes an image acquisition device for acquiring a range image of a target vehicle, at least one processor, a memory including a target vehicle model and computer readable program code, where the processor and the computer readable program code are configured to cause the navigation system to convert the range image to a point cloud having three dimensions, compute a transform from the target vehicle model to the point cloud, and use the transform to estimate the target vehicle's attitude and position for capturing the target vehicle.

Gill, Nathaniel↗

Harnessing Artificial Intelligence for Medical Diagnosis and Treatment During Space Exploration Missions

BACKGROUND The medical capabilities necessary for long-duration exploration missions (LDEMs) will differ tremendously from those currently available to crew medical officers (CMOs) on the International Space Station (ISS). Ground support will be more challenging due to distance-related communication delays and data transmission, and resource utilization must be optimized given limited ability for resupply. Clinical decision support systems (CDSSs) can help mitigate these limitations. The recent launch of generative artificial intelligence (AI) tools based upon large language models (LLM) support the creation of a smart assistant for onboard triage, diagnosis, and guided treatment of medical conditions during these missions. The Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool can help predict which clinical problems and outcomes are likely to occur for a design reference mission (DRM) and assist Medical Operations and systems engineering teams in creating a medical system that may optimally mitigate the predicted risks. The purpose of this study was to identify AI tools currently available or in development for the assistive diagnosis and care of medical conditions predicted for an extended duration Lunar mission. METHODS The 119 medical conditions currently built into the IMPACT suite were categorized into systems, and these diagnoses were used as keywords for our literature search. Using PubMed and Google Scholar, we performed a literature survey of AI tools applicable to these conditions. Article inclusion criteria included publication between the years 2017-2023, as the sentinel paper discussing the “selective attention” driving ChatGPT and other generative transformer models was published in June 2017. Where applicable, we reviewed only the top 1000 research articles (based on relevance) for each of the keywords/phrases. AI tools whose training sets were exclusive to a pediatric patient population were excluded. We also excluded any medical diagnostic tools (such as CT, MRI, mass spectrometry) or procedures (such as endoscopy, surgery) that are unlikely to be available during LDEMs due to mass and volume constraints, CMO knowledge, skills, and abilities, and/or inherent procedural risks. RESULTS Our survey highlighted several AI-driven tools for the triage, diagnosis, and management of those medical conditions highlighted by IMPACT. Selected publications for each medical condition were then screened for inclusion within ten systems-based categories including: general diagnostic tools (25), tools to diagnose and manage respiratory (40), dermatologic (34), neurologic (28), auditory and vestibular (30), ophthalmic (34), musculoskeletal (104), infection-associated (92), and gynecologic (19) conditions, as well as tools that could be deployed in the setting of trauma and emergency (34). CONCLUSIONS Numerous AI-driven tools were highlighted within this literature survey, ranging from chatbot assistants that triage knee pain to vision transformer models for diagnosis of ophthalmic conditions using ocular surface images captured with a mobile phone. Remaining challenges include optimizing connectivity and integration of existing and developing systems into the vehicles or habitats. Notably, findings from this survey could help guide the initial design of an all-encompassing, onboard medical AI assistant for use during future LDEMs.

R A Lacinski↗

Information extraction from multivariate images

An overview of several multivariate image processing techniques is presented, with emphasis on techniques based upon the principal component transformation (PCT). Multiimages in various formats have a multivariate pixel value, associated with each pixel location, which has been scaled and quantized into a gray level vector, and the bivariate of the extent to which two images are correlated. The PCT of a multiimage decorrelates the multiimage to reduce its dimensionality and reveal its intercomponent dependencies if some off-diagonal elements are not small, and for the purposes of display the principal component images must be postprocessed into multiimage format. The principal component analysis of a multiimage is a statistical analysis based upon the PCT whose primary application is to determine the intrinsic component dimensionality of the multiimage. Computational considerations are also discussed.

Park, S. K.↗

Programmable Remapper

Input image remapped rapidly and accurately onto different coordinate grid. Analog/digital electronic image-processing system developed to warp input images onto arbitrary coordinate grids at video rates. Advantages of system include antialiasing effect of many-to-one data path and speed of lookup-table operation. Lookup tables reprogrammed easily with help of computer that generates table values from mathematical description of desired transformation. Applications include real-time corrections of distortions in input optics of image sensors, corrections for repeatable nonlinear scanning, and aiding persons of impaired vision by deliberately distorting images onto remaining functional portions of retinas.

Juday, Richard D.↗

Digital processing considerations for extraction of ocean wave image spectra from raw synthetic aperture radar data

The digital processing requirements of several algorithms for extracting the spectrum of a detected synthetic aperture radar (SAR) image from the raw SAR data are described and compared. The most efficient algorithms for image spectrum extraction from raw SAR data appear to be those containing an intermediate image formation step. It is shown that a recently developed compact formulation of the image spectrum in terms of the raw data is computationally inefficient when evaluated directly, in comparison with the classical method where matched-filter image formation is an intermediate result. It is also shown that a proposed indirect procedure for digitally implementing the same compact formulation is somewhat more efficient than the classical matched-filtering approach. However, this indirect procedure includes the image formation process as part of the total algorithm. Indeed, the computational savings afforded by the indirect implementation are identical to those obtained in SAR image formation processing when the matched-filtering algorithm is replaced by the well-known 'dechirp-Fourier transform' technique. Furthermore, corrections to account for slant-to-ground range conversion, spherical earth, etc., are often best implemented in the image domain, making intermediate image formation a valuable processing feature.

Lahaie, I. J.↗

The Stellar Imager (SI) - A Mission to Resolve Stellar Surfaces, Interiors, and Magnetic Activity

The Stellar Imager (SI) is a UV/Optical, Space-Based Interferometer designed to enable 0.1 milli-arcsecond (mas) spectral imaging of stellar surfaces and, via asteroseismology, stellar interiors and of the Universe in general. The ultra-sharp images of the Stellar Imager will revolutionize our view of many dynamic astrophysical processes by transforming point sources into extended sources, and snapshots into evolving views. SI's science focuses on the role of magnetism in the Universe, particularly on magnetic activity on the surfaces of stars like the Sun. SI's prime goal is to enable long-term forecasting of solar activity and the space weather that it drives. SI will also revolutionize our understanding of the formation of planetary systems, of the habitability and climatology of distant planets, and of many magneto-hydrodynamically controlled processes in the Universe. SI is included as a 'Flagship and Landmark Discovery Mission' in the 2005 NASA Sun Solar System Connection (SSSC) Roadmap and as a candidate for a 'Pathways to Life Observatory' in the NASA Exploration of the Universe Division (EUD) Roadmap (May, 2005). In this paper we discuss the science goals and technology needs of, and the baseline design for, the SI Mission (http://hires.gsfc.nasa.gov/si/) its ability to image the 'Biggest, Baddest, Coolest Stars'.

Carpenter, Kenneth↗

The 3-D image recognition based on fuzzy neural network technology

Three dimensional stereoscopic image recognition system based on fuzzy-neural network technology was developed. The system consists of three parts; preprocessing part, feature extraction part, and matching part. Two CCD color camera image are fed to the preprocessing part, where several operations including RGB-HSV transformation are done. A multi-layer perception is used for the line detection in the feature extraction part. Then fuzzy matching technique is introduced in the matching part. The system is realized on SUN spark station and special image input hardware system. An experimental result on bottle images is also presented.

Hirota, Kaoru↗

The electronically steered thinned array radiometer

An L-band radiometer which allows global imaging of soil moisture from LEO is discussed. The system consists of an array of antennas with amplifiers, a device to cross-correlate the signals from the antennas, and a process to translate the resulting data into an image of brightness temperature over the field of view. The process is based on a Fourier transform relation that exists between the incident electric field strength as a function of incidence angle and electric fields across the aperture plane of the antenna. The system's image reconstruction technique and signal-to-noise performance are examined.

Ruf, C. S.↗

Comparison of video fields and frames for transform compression

Because of the interlaced television scan, the two fields that form an interlaced video frame are generated 1/60 of a second apart. If the two fields are compressed independently, the correlation between adjacent lines is unused. The transmission rate can be reduced by using a field memory to form an interlaced frame. Four test images were processed as fields and as interlaced frames, using both theoretical and experimental compression designs. For comparable mean-square error and subjective appearance, field compression requires about one-half bit per sample more than frame compression. However, the overall transmission rate - the number of bits per image times the number of images per second - is more meaningful than the number of bits per sample. When transform compression at low transmission rates merges the adjacent lines, frame compression becomes similar to field repeating, and the memory can be reduced.

Jones, H. W., Jr.↗

Neural-Based Compression Scheme for Solar Image Data

Studying the solar system and especially the Sun relies on the data gathered daily from space missions. These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make. Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis of the data. On the other hand, preserving subtle details in the compressed data requires a high amount of data to be transferred, reducing the desired gains from compression. In this work, we propose a neural network-based lossy compression method to be used in NASA’s data-intensive imagery missions. We chose NASA’s Solar Dynamics Observatory (SDO) mission which transmits 1.4 terabytes of data each day as a proof of concept for the proposed algorithm. In this work, we propose an adversarially trained neural network, equipped with local and non-local attention modules to capture both the local and global structure of the image resulting in a better trade-off in rate-distortion (RD) compared to conventional hand-engineered codecs. The RD variational autoencoder used in this work is jointly trained with a channel-dependent entropy model as a shared prior between the analysis and synthesis transforms to make the entropy coding of the latent code more effective. We also studied how optimizing perceptual losses could help our neural compressor to preserve high-frequency details of the data in the reconstructed compressed image. Our neural image compression algorithm outperforms currently-in-use and state-of-the-art codecs such as JPEG and JPEG-2000 in terms of the RD performance when compressing extreme-ultraviolet (EUV) data. As a proof of concept for use of this algorithm in SDO data analysis, we have performed coronal hole (CH) detection using our compressed images, and generated consistent segmentations, even at a compression rate of ∼ 0.1 bits per pixel (compared to 8 bits per pixel on the original data) using EUV data from SDO.

Image coding↗

Gaussian Mixture Models for Temporal Depth Fusion

Sensing the 3D environment of a moving robot is essential for collision avoidance. Most 3D sensors produce dense depth maps, which are subject to imperfections due to various environmental factors. Temporal fusion of depth maps is crucial to overcome those. Temporal fusion is traditionally done in 3D space with voxel data structures, but it can be approached by temporal fusion in image space, with potential benefits in reduced memory and computational cost for applications like reactive collision avoidance for micro air vehicles. In this paper, we present an efficient Gaussian Mixture Models based depth map fusion approach, introducing an online update scheme for dense representations. The environment is modeled from an ego-centric point of view, where each pixel is represented by a mixture of Gaussian inverse-depth models. Consecutive frames are related to each other by transformations obtained from visual odometry. This approach achieves better accuracy than alternative image space depth map fusion techniques at lower computational cost.

Matthies, Larry↗

Subband And Transform Compression Of Video Signals

Class of hierarchical subband coders developed primarily for compression of image data at video rates. Coders offer good performance with limited computational complexity and with flexibility inherent in subband decomposition.

Sauer, Ken↗