Virtual image out-the-window display system study, volume I
Virtual image out-the-window display system and current approaches to visual simulation
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Virtual image out-the-window display system and current approaches to visual simulation
It has been found that flood boundary information derived from Landsat images, acquired at different flood stages, could be used to develop an empirical model for estimating the extent of flooding on the basis of in situ measurements of river discharge. An investigation was undertaken to determine whether improved results might have been obtained through digital image analysis or by including other Landsat spectral bands. The study area encompasses a highly flood-prone reach of the Black River in Lewis County, NY. It was found that visual analysis of aerial photographs and a Landsat band 7 image gave similar results. Visual and digital analysis of Landsat band 7 data gave similar results, and digital analysis of Landsat band 7 data gave results which were at least as good as digital analysis of combinations of spectral bands.
Visual photometry and methane-band imaging indicate that Neptune underwent a period of atmospheric activity in the 1986-1989 period with an enhancement of 8900 A CH4-band brightness and an increased standard deviation of the mean yearly magnitudes at visual and near-IR wavelengths. These observations are presently interpreted as due to a localized upwelling source that could be similar to the 'great white spots' that have been periodically observed on Saturn.
Solar and Heliospheric Observatory (SOHO) Extreme ultraviolet Imaging Telescope (EIT) data have been visually searched for coronal "EIT wave" transients over the period beginning from 1997 March 24 and extending through 1998 June 24. The dates covered start at the beginning of regular high-cadence (more than one image every 20 minutes) observations, ending at the four-month interruption of SOHO observations in mid-1998. One hundred and seventy six events are included in this catalog. The observations range from "candidate" events, which were either weak or had insufficient data coverage, to events which were well defined and were clearly distinguishable in the data. Included in the catalog are times of the EIT images in which the events are observed, diagrams indicating the observed locations of the wave fronts and associated active regions, and the speeds of the wave fronts. The measured speeds of the wave fronts varied from less than 50 to over 700 km s(exp -1) with "typical" speeds of 200-400 km s(exp -1).
A focus on qualitative methods of presenting data shows that visualization provides a mechanism for browsing independent of the source of data and is an effective alternative to traditional image-based browsing of image data. To be generally applicable, such visualization methods, however, must be based upon an underlying data model with support for a broad class of data types and structures. Interactive, near-real-time browsing for data sets of interesting size today requires a browse server of considerable power. A symmetric multi-processor with very high internal and external bandwidth demonstrates the feasibility of this concept. Although this technology is likely to be available on the desktop within a few years, the increase in the size and complexity of achieved data will continue to exceed the capacity of 'worksation' systems. Hence, a higher class of performance, especially in bandwidth, will generally be required for on-demand browsing. A few experiments with differing digital compression techniques indicates that a MPEG-1 implementation within the context of a high-performance browse server (i.e., parallized) is a practical method of converting a browse product to a form suitable for network or CD-ROM distribution.
INTRODUCTION Ample evidence exists on the effectiveness of ultrasound in the diagnosis of kidney stones. However, terrestrial practice is mostly concerned with diagnosis of clinically significant urolithiasis. Adapting this non-irradiating, low-cost imaging modality for the asymptomatic astronaut population offers high-sensitivity screening and limits their career radiation dose. METHODS NASA developed a novel ultrasound-based detection and surveillance protocol to identify, categorize, and monitor mineralized renal material (MRM) in astronauts. The term MRM was developed to denote abnormal, presumably calcified, focal material of unknown clinical significance in the kidneys. Sonographic criteria for MRMs include measurable echogenic foci, their detectability in multiple, designated imaging plains, posterior shadowing, and “twinkle” pattern visualized in Color Doppler and/or demonstrated in Spectral Doppler modes. The mere discovery of an MRM does not trigger further imaging or intervention, unless the affected crewmember is mission-assigned, or the MRM meets actionable criteria based on size, location, and sonographic characteristics. If the threshold is met, the crew surgeon is notified, and additional diagnostic imaging and urology consultation are considered. RESULTS In total, 73 individuals have been scanned using our specialized methods, 60 have had more than one study done. As of April 2023, 282 total studies have been performed. So far, over 30 pairs of pre-and postflight studies have been obtained, and the findings are presented elsewhere in this panel. DISCUSSION A surveillance program was initiated nine years ago to screen asymptomatic members of the astronaut corps for renal calcifications, from their initial hiring, through their mission timeframes, and throughout their career. The goal is to reduce the probability that an astronaut will fly with a renal stone that may become symptomatic. This also gives NASA the information it needs to improve screening criteria for future long-duration crewed missions.
The Mars Exploration Rovers (MER'03), Spirit and Opportunity, represent the state of the art in rover operations on Mars. This paper presents validation experiments of different visual tracking algorithms using the rover's navigation camera.
The deployment and integration of high-sensitivity infrared cameras in a transonic wind tunnel test environment has resulted in a unique capability to image aerodynamic phenomena in real-time. Multi-camera infrared flow visualization data systems are now routinely utilized at the NASA Ames Unitary Plan Wind Tunnel. The small flow-induced temperature gradients on the surface of the wind tunnel test article coupled with the high bit-depth of the infrared camera sensor makes the processing of the image data critically important. An image processing routine must enhance features of interest with minimal artifacts. Additionally, the production wind tunnel test environment demands that these processed images are made available in a real-time, automatic fashion. Therefore, any image processing routine must be computationally economical and enhance the image data with minimal input from a human operator. The following seeks to qualitatively explore selected image processing techniques by assessing their effectiveness to resolve flow features on a wind tunnel test article. A multi-scale contrast enhancement technique is introduced as well as a new implementation of a multi-scale, non-interpolated adaptive histogram equalization. Finally, a novel method is introduced that demonstrates the ability to resolve flow features imaged on bare-steel test articles possessing low emissivity. This method merges frequency domain analysis with contrast enhancement and has the potential to extend the application of infrared flow-visualization within the wind tunnel test environment.
Viking Orbiter images of the Acheron Fossae on Mars are presented and analyzed, with an emphasis on the impact of image resolution on the interpretation. High-resolution (less than 10 m/pixel) images reveal small mounds which can be interpreted as aeolian dunes, but these features are not evident on images with resolution of 50 m/pixel or greater. Also reported are the results of a visual inspection of 527 usable high-resolution images: it is found that all of the morphological features identified can arise in the absence of subsurface volatiles.
The practical, noiseless and efficient data-compression technique presented involves a conceptual VLSI design which is capable of meeting real-time processing rates and meets low-power, low-weight, and small-volume requirements. This form of data compression is applicable to image data compression aboard future low-budget spaceflight missions, for such instruments as visual-IR mapping spectrometers and high-resolution imaging spectrometers.
Wind tunnels are crucial facilities that support the aerospace industry. However, these facilities are large, complex, and pose unique maintenance and inspection requirements. Manual inspections to identify defects such as cracks, missing fasteners, leaks, and foreign objects are important but labor and schedule intensive. Our goal is to utilize small Unmanned Aircraft Systems (sUAS) and computer vision-based analysis to automate the inspection of the interior and exterior of NASA’s critical wind tunnel facilities. We detect missing fasteners as our defect class, and detect existing fasteners to provide potential future missing fastener sites for preventative maintenance. These detections are done on both 2D raw images and in 3D space to provide a visual reference and real world location to facilitate repairs. A dataset was created consisting of images taken along a grid-like pattern of an interior tunnel section in the AEDC National Full-Scale Aerodynamics Complex (NFAC) at NASA Ames Research Center. Our method uses object detection to create image level bounding boxes of the fasteners and missing fasteners, then uses photogrammetry to create a mapping from 2D image locations to 3D real world locations. The image level bounding boxes and the 2D to 3D mapping are then combined to determine the 3D location of the defects. We describe the data collection, photogrammetry, and computer vision techniques used for object detection as well as a quantitative analysis of the method.
During the Columbia Accident Investigation, imaging teams supporting debris shedding analysis were hampered by poor entry image quality and the general lack of information on optical signatures associated with a nominal Shuttle entry. After the accident, recommendations were made to NASA management to develop and maintain a state-of-the-art imagery database for Shuttle engineering performance assessments and to improve entry imaging capability to support anomaly and contingency analysis during a mission. As a result, the Space Shuttle Program sponsored an observation campaign to qualitatively characterize a nominal Shuttle entry over the widest possible Mach number range. The initial objectives focused on an assessment of capability to identify/resolve debris liberated from the Shuttle during entry, characterization of potential anomalous events associated with RCS jet firings and unusual phenomenon associated with the plasma trail. The aeroheating technical community viewed the Space Shuttle Program sponsored activity as an opportunity to influence the observation objectives and incrementally demonstrate key elements of a quantitative spatially resolved temperature measurement capability over a series of flights. One long-term desire of the Shuttle engineering community is to calibrate boundary layer transition prediction methodologies that are presently part of the Shuttle damage assessment process using flight data provided by a controlled Shuttle flight experiment. Quantitative global imaging may offer a complementary method of data collection to more traditional methods such as surface thermocouples. This paper reviews the process used by the engineering community to influence data collection methods and analysis of global infrared images of the Shuttle obtained during hypersonic entry. Emphasis is placed upon airborne imaging assets sponsored by the Shuttle program during Return to Flight. Visual and IR entry imagery were obtained with available airborne imaging platforms used within DoD along with agency assets developed and optimized for use during Shuttle ascent to demonstrate capability (i.e., tracking, acquisition of multispectral data, spatial resolution) and identify system limitations (i.e., radiance modeling, saturation) using state-of-the-art imaging instrumentation and communication systems. Global infrared intensity data have been transformed to temperature by comparison to Shuttle flight thermocouple data. Reasonable agreement is found between the flight thermography images and numerical prediction. A discussion of lessons learned and potential application to a potential Shuttle boundary layer transition flight test is presented.
Topics discussed in these proceedings include nonlinear processing and communications; feature extraction and recognition; image gathering, interpolation, and restoration; image coding; and wavelet transform. Papers are presented on noise reduction for signals from nonlinear systems; driving nonlinear systems with chaotic signals; edge detection and image segmentation of space scenes using fractal analyses; a vision system for telerobotic operation; a fidelity analysis of image gathering, interpolation, and restoration; restoration of images degraded by motion; and information, entropy, and fidelity in visual communication. Attention is also given to image coding methods and their assessment, hybrid JPEG/recursive block coding of images, modified wavelets that accommodate causality, modified wavelet transform for unbiased frequency representation, and continuous wavelet transform of one-dimensional signals by Fourier filtering.
MISR (Multi-angle Imaging SpectroRadiometer) INteractive eXplorer (MINX) is an interactive visualization program that allows a user to digitize smoke, dust, or volcanic plumes in MISR multiangle images, and automatically retrieve height and wind profiles associated with those plumes. This innovation can perform 9-camera animations of MISR level-1 radiance images to study the 3D relationships of clouds and plumes. MINX also enables archiving MISR aerosol properties and Moderate Resolution Imaging Spectroradiometer (MODIS) fire radiative power along with the heights and winds. It can correct geometric misregistration between cameras by correlating off-nadir camera scenes with corresponding nadir scenes and then warping the images to minimize the misregistration offsets. Plots of BRF (bidirectional reflectance factor) vs. camera angle for points clicked in an image can be displayed. Users get rapid access to map views of MISR path and orbit locations and overflight dates, and past or future orbits can be identified that pass over a specified location at a specified time. Single-camera, level-1 radiance data at 1,100- or 275- meter resolution can be quickly displayed in color using a browse option. This software determines the heights and motion vectors of features above the terrain with greater precision and coverage than previous methods, based on an algorithm that takes wind direction into consideration. Human interpreters can precisely identify plumes and their extent, and wind direction. Overposting of MODIS thermal anomaly data aids in the identification of smoke plumes. The software has been used to preserve graphical and textural versions of the digitized data in a Web-based database.
A computerized flow visualization technique capable of quantifying the flow field automatically has been developed. This technique uses afterglowing effect of optically activated phosphorescent particles to retrieve vectorial information on each trace. By using this information, in conjunction with computer image processing, the flow field of a free surface transient vortex was investigated.
The virtual image symbology of head-up displays (HUDs) is presented at optical infinity to the pilot. This design feature is intended to help pilots maintain visual focus distance at optical infinity. However, the accommodation response could be nearer than optical infinity, due to an individual's dark focus response. Accommodation responses were measured of two age groups of airline pilots to: (1) static symbology on a HUD; (2) a landing site background at optical infinity; (3) the combination of the HUD symbology and the landing site background; and (4) complete darkness. Results indicate that magnitude of accommodation to HUD symbology, with and without the background, is not significantly different from an infinity focus response for either age group. The dark focus response is significantly closer than optical infinity for the younger pilots, but not the older pilots, a finding consistent with previous research.
A system for measuring and visually representing damage in composite specimens while they are being loaded was demonstrated. It uses a hobbiest grade microcomputer system to control data taking and image processing. The system scans operator selected regions of the specimen while it is under load in a tensile test machine and measures internal damage by the attenuation of a 2.5 MHz ultrasonic beam passed through the specimen. The microcomputer dynamically controls the position of ultrasonic transducers mounted on a two axis motor driven carriage. As many as 65,536 samples can be taken and filed on a floppy disk system in less than four minutes.
The Hyperspectral Imager-Tracker (HIT) is a technique for visualization and tracking of low-contrast, fast-moving objects. The HIT architecture is based on an innovative and only recently developed concept in imaging optics. This innovative architecture will give the Light Prescriptions Innovators (LPI) HIT the possibility of simultaneously collecting the spectral band images (hyperspectral cube), IR images, and to operate with high-light-gathering power and high magnification for multiple fast- moving objects. Adaptive Spectral Filtering algorithms will efficiently increase the contrast of low-contrast scenes. The most hazardous parts of a space mission are the first stage of a launch and the last 10 kilometers of the landing trajectory. In general, a close watch on spacecraft operation is required at distances up to 70 km. Tracking at such distances is usually associated with the use of radar, but its milliradian angular resolution translates to 100- m spatial resolution at 70-km distance. With sufficient power, radar can track a spacecraft as a whole object, but will not provide detail in the case of an accident, particularly for small debris in the onemeter range, which can only be achieved optically. It will be important to track the debris, which could disintegrate further into more debris, all the way to the ground. Such fragmentation could cause ballistic predictions, based on observations using high-resolution but narrow-field optics for only the first few seconds of the event, to be inaccurate. No optical imager architecture exists to satisfy NASA requirements. The HIT was developed for space vehicle tracking, in-flight inspection, and in the case of an accident, a detailed recording of the event. The system is a combination of five subsystems: (1) a roving fovea telescope with a wide 30 field of regard; (2) narrow, high-resolution fovea field optics; (3) a Coude optics system for telescope output beam stabilization; (4) a hyperspectral-mutispectral imaging assembly; and (5) image analysis software with effective adaptive spectral filtering algorithm for real-time contrast enhancement.