Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “color vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Stanford/NASA-Ames Center of Excellence in model-based human performance

The human operator plays a critical role in many aeronautic and astronautic missions. The Stanford/NASA-Ames Center of Excellence in Model-Based Human Performance (COE) was initiated in 1985 to further our understanding of the performance capabilities and performance limits of the human component of aeronautic and astronautic projects. Support from the COE is devoted to those areas of experimental and theoretical work designed to summarize and explain human performance by developing computable performance models. The ultimate goal is to make these computable models available to other scientists for use in design and evaluation of aeronautic and astronautic instrumentation. Within vision science, two topics have received particular attention. First, researchers did extensive work analyzing the human ability to recognize object color relatively independent of the spectral power distribution of the ambient lighting (color constancy). The COE has supported a number of research papers in this area, as well as the development of a substantial data base of surface reflectance functions, ambient illumination functions, and an associated software package for rendering and analyzing image data with respect to these spectral functions. Second, the COE supported new empirical studies on the problem of selecting colors for visual display equipment to enhance human performance in discrimination and recognition tasks.

Wandell, Brian A.↗

Developing Methods for Exercise System Kinematics Tracking

BACKGROUND How to quantify the load and forces produced by exercise equipment and their Vibration Isolation and Stabilization (VIS) platforms in-flight is an active area of investigation. Kinematic tracking paired with system modeling can provide insights as well as verification and validation of simulations used for system design and development. Traditional motion capture methods can require significant cost in equipment procurement and crew-time, but newer lessons learned can be leveraged [1]. The VIS systems of current and future exercise hardware on the International Space Station (ISS) such as the Cycle Ergometer with Vibration Isolation System (CEVIS) and the European Enhanced Exploration Exercise Device (E4D) are not currently outfitted with IMUs or similar measurement devices. Video-based methods would enable use of multi-purpose, crew-familiar flight equipment. An initial exploration of video-based solutions was performed utilizing 2-camera video from crew cycling on Teal-CEVIS on the ISS. METHODS AND RESULTS Our group has scoped a variety of video-based object tracking methods. To date, we have primarily investigated computer vision toolkits such as openCV. Techniques explored include key-point detection, background subtraction, region-of interest tracking, color-based tracking, tag masking and tracking, and corner detection. Although object-tracking and 6D pose estimation is a rich field, space applications are a unique problem that are challenging for existing software and toolkits. The majority of the existing object-tracking applications involve vehicles/pedestrians and household objects with simple backgrounds. We have identified the following features which pose particular challenges for on-station exercise equipment tracking: Busy and visually cluttered background Low-textured tracking object with relatively small motions Occlusions and motion by human subject and loose, floating objects Limited number of video cameras with no fixed global references Limited ability to add tags, markers, or visual references to the tracking object Lack of training data for Machine Learning (ML) algorithms CONCLUSION We will summarize the efficacy of techniques tested for a ground mock-trial and the on-station exercise trial. It is likely that human-in-loop feedback or a conglomerate of methods is required. ML-based methods, like those implemented for human body tracking [2], may still be a viable option, but more training data and validation is needed.

L B Nilsson↗

Developing Methods for Exercise System Kinematic Tracking

BACKGROUND How to quantify the load and forces produced by exercise equipment and their Vibration Isolation and Stabilization (VIS) platforms in-flight is an active area of investigation. Kinematic tracking paired with system modeling can provide insights as well as verification and validation of simulations used for system design and development. Traditional motion capture methods can require significant cost in equipment procurement and crew-time, but newer lessons learned can be leveraged [1]. The VIS systems of current and future exercise hardware on the International Space Station (ISS) such as the Cycle Ergometer with Vibration Isolation System (CEVIS) and the European Enhanced Exploration Exercise Device (E4D) are not currently outfitted with IMUs or similar measurement devices. Video-based methods would enable use of multi-purpose, crew-familiar flight equipment. An initial exploration of video-based solutions was performed utilizing 2-camera video from crew cycling on Teal-CEVIS on the ISS. METHODS AND RESULTS Our group has scoped a variety of video-based object tracking methods. To date, we have primarily investigated computer vision toolkits such as open CV. Techniques explored include key-point detection, background subtraction, region-of interest tracking, color-based tracking, tag masking and tracking, and corner detection. Although object-tracking and 6D pose estimation is a rich field, space applications are a unique problem that are challenging for existing software and toolkits. The majority of the existing object-tracking applications involve vehicles/pedestrians and household objects with simple backgrounds. We have identified the following features which pose particular challenges for on-station exercise equipment tracking: 1. Busy and visually cluttered background 2. Low-textured tracking object with relatively small motions 3. Occlusions and motion by human subject and loose, floating objects 4. Limited number of video cameras with no fixed global references 5. Limited ability to add tags, markers, or visual references to the tracking object 6. Lack of training data for Machine Learning (ML) algorithms CONCLUSION We will summarize the efficacy of techniques tested for a ground mock-trial and the on-station exercise trial. It is likely that human-in-loop feedback or a conglomerate of methods is required. ML-based methods, like those implemented for human body tracking [2], may still be a viable option, but more training data and validation is needed.

L Nilsson↗

Comparisons of luminaires: Efficacies and system design

Lighting designs for architectural (aesthetic) purposes, vision and safety, and plant growth have many features in common but several crucial ones that are not. The human eye is very sensitive to the color (wavelength) of light, whereas plants are less so. There are morphological reactions, particularly to the red and blue portions of the light spectrum but, in general, plants appear to accept and use light for photosynthesis everywhere over the PAR region of the spectrum. In contrast, the human eye interprets light intensity on a logarithmic scale, making people insensitive to significant differences of light intensity. As a rough rule, light intensity must change by 30 to 50% for the human eye to recognize the difference. Plants respond much more linearly to light energy, at least at intensities below photosynthetic saturation. Thus, intensity differences not noticeable to the human eye can have significant effects on total plant growth and yield, and crop timing. These factors make luminaire selection and lighting system design particularly important when designing supplemental lighting systems for plant growth. Supplemental lighting for plant growth on the scale of commercial greenhouses is a relatively expensive undertaking. Light intensities are often much higher than required for task (vision) lighting, which increases both installation and operating costs. However, and especially in the northern regions of the United States (and Canada, Europe, etc.), supplemental lighting during winter may be necessary to produce certain crops (e.g., tomatoes) and very useful to achieve full plant growth potential and crop timing with most other greenhouse crops. Operating costs over the life of a luminaire typically will exceed the initial investment, making lighting efficacy a major consideration. This report reviews tests completed to evaluate the efficiencies of various commercially-available High-Pressure Sodium luminaires, and then describes the results of using a commercial lighting design computer program, Lumen-Micro, to explore how to place luminaires within greenhouses and plant growth chambers to achieve light (PAR) uniformity and relatively high lighting efficacies. Several suggestions are presented which could encourage systematic design of plant lighting systems.

Albright, L. D.↗

Experiences in teleoperation of land vehicles

Teleoperation of land vehicles allows the removal of the operator from the vehicle to a remote location. This can greatly increase operator safety and comfort in applications such as security patrol or military combat. The cost includes system complexity and reduced system performance. All feedback on vehicle performance and on environmental conditions must pass through sensors, a communications channel, and displays. In particular, this requires vision to be transmitted by close-circuit television with a consequent degradation of information content. Vehicular teleoperation, as a result, places severe demands on the operator. Teleoperated land vehicles have been built and tested by many organizations, including Sandia National Laboratories (SNL). The SNL fleet presently includes eight vehicles of varying capability. These vehicles have been operated using different types of controls, displays, and visual systems. Experimentation studying the effects of vision system characteristics on off-road, remote driving was performed for conditions of fixed camera versus steering-coupled camera and of color versus black and white video display. Additionally, much experience was gained through system demonstrations and hardware development trials. The preliminary experimental findings and the results of the accumulated operational experience are discussed.

Mcgovern, Douglas E.↗

A Robust Mechanical Sensing System for Unmanned Sea Surface Vehicles

The need for autonomous navigation and intelligent control of unmanned sea surface vehicles requires a mechanically robust sensing architecture that is watertight, durable, and insensitive to vibration and shock loading. The sensing system developed here comprises four black and white cameras and a single color camera. The cameras are rigidly mounted to a camera bar that can be reconfigured to mount multiple vehicles, and act as both navigational cameras and application cameras. The cameras are housed in watertight casings to protect them and their electronics from moisture and wave splashes. Two of the black and white cameras are positioned to provide lateral vision. They are angled away from the front of the vehicle at horizontal angles to provide ideal fields of view for mapping and autonomous navigation. The other two black and white cameras are positioned at an angle into the color camera's field of view to support vehicle applications. These two cameras provide an overlap, as well as a backup to the front camera. The color camera is positioned directly in the middle of the bar, aimed straight ahead. This system is applicable to any sea-going vehicle, both on Earth and in space.

Kulczycki, Eric A.↗

Chip-integrated metasurface full-Stokes polarimetric imaging sensor

Abstract Polarimetric imaging has a wide range of applications for uncovering features invisible to human eyes and conventional imaging sensors. Chip-integrated, fast, cost-effective, and accurate full-Stokes polarimetric imaging sensors are highly desirable in many applications, which, however, remain elusive due to fundamental material limitations. Here we present a chip-integrated Meta surface-based Full-Stokes Polar imetric Im aging sensor (MetaPolarIm) realized by integrating an ultrathin (~600 nm) metasurface polarization filter array (MPFA) onto a visible imaging sensor with CMOS compatible fabrication processes. The MPFA is featured with broadband dielectric-metal hybrid chiral metasurfaces and double-layer nanograting polarizers. This chip-integrated polarimetric imaging sensor enables single-shot full-Stokes imaging (speed limited by the CMOS imager) with the most compact form factor, records high measurement accuracy, dual-color operation (green and red) and a field of view up to 40 degrees. MetaPolarIm holds great promise to enable transformative applications in autonomous vision, industry inspection, space exploration, medical imaging and diagnosis.

47 OTHER INSTRUMENTATION↗

Local heat transfer measurement with liquid crystals on rotating surfaces including non-axisymmetric cases

An overview and summary of test methods and results are given for the problem of measuring local heat transfer on rotating surfaces that model gas turbine engine disks. Disk cavity situations generically similar to those encountered in the high pressure stage disk cooling are considered, with cooling air supplied both at or near the wheel centerline as well as through single or multiple jets impinging outboard on the wheel near the blade attachment region. In some situations provision has been made for ingestion into the disk-cavity from the gas path region radially outboard of the disk. Local heat transfer rates in all cases are determined from the color display from a thin coating of encapsulated liquid crystals sprayed onto the disk, in conjunction with use of a video camera and computer vision system. For cases with axisymmetric disk surfaces, the coated surfaces are illuminated and viewed continuously, and detailed radial distributions of local Nusselt number are obtained. For non-axisymmetric disk surfaces, such as encountered in the vicinity of bolt heads, the disk is illuminated with stroboscopic light, and a method has been developed and used to synchronize the computer frame grabber with the illumination.

Metzger, D. E.↗

Look Sharp While Seeing Sharp

The two scientists James B. Stephens and Dr. Charles G. Miller were tasked with studying the harmful properties of light in space, as well as the artificial radiation produced during laser and welding work, for the purpose of creating an enhanced means of eye protection in industrial welding applications. While working to apply their space research to these terrestrial applications, Stephens and Miller became engrossed with previously discovered research showing evidence that the eyes of hawks, eagles, and other birds of prey contain unique oil droplets that actually protect them from intensely radiated light rays (blue, violet, ultraviolet) while allowing vision-enhancing light rays (red, orange, green) to pass through. These oil droplets absorb short wavelength light rays which, in turn, reduce glare and provide heightened color contrast and definition for optimal visual acuity. Accordingly, birds of prey possess the ability to distinguish their targeted prey in natural surroundings and from great distances. Pairing the findings from their initial studies with what they learned from the bird studies, the scientists devised a methodology to incorporate the light-filtering/vision-enhancing dual-action benefits into a filtering system, using light-filtering dyes and tiny particles of zinc oxide. (Zinc oxide, which absorbs ultraviolet light, is also found in sunscreen lotions that protect the skin from sunburn.)

Source record↗

Displacement thresholds in central and peripheral vision during tracking

The effects of stimulus duration and angular velocity on a subject's judgment of displacement threshold are examined. Twenty-six male subjects between 17-45 years with uncorrected 20:20 distance acuity and normal color perception and stereopsis studied a series of forced choice, paired comparison trials in which a long, thin, collimated horizontally oriented line moved downward through 12 angles ranging from 0.6-60 arcmin and judged which stimulus moved in each pair. The displacements were produced by 0.25, 0.5, 1, 2, and 4 sec stimulus duration and 2.5, 5, 10, and 15 deg/sec angular rates. Stimulus velocity, stimulus duration, mean threshold displacement, and mean confidence results are analyzed. It is observed that displacement judgment accuracy is increased with increasing stimulus duration. The data are compared with the results of Johnson and Leibowitz (1976) and Johnson and Scobey (1982), and good correlation with the Johnson and Leibowitz data is detected. The data reveal that threshold is based on a constant stimulus velocity over this range of durations and velocities. The data are applicable to the study of the final approach to landing of medium and large commercial jet aircraft.

Haines, R. F.↗

CRADA Number NFE-19-07847 with MantaPoole Technologies (CRADA Final Report)

As the world becomes more automated, smart and autonomous systems that utilize advanced 3D machine vision are becoming ever more prevalent. To function autonomously, these smart machines need to be able to identify the “what” and “where” of their application by capturing color and depth information. The color information provides the needed contrast information to identify the “what” of a scene while the depth information allows the smart machine to identify “where” an object in a 3D environment is. To capture both the color and depth information using only a single sensor, MantaPoole Technologies (MPT) is developing a new type of 3D light field camera. The approach leverages MPT’s active micro-optics technology which when aligned and placed over an imaging detector are designed to act as an advanced optical filter that controls the direction of light that reaches the underlying pixels.

47 OTHER INSTRUMENTATION↗

Robotic vision

Robotic vision, involving the use of a vision system to control a process, is discussed. Design and selection of active sensors employing radiation of radio waves, sound waves, and laser light, respectively, to light up unobservable features in the scene are considered, as are design and selection of passive sensors, which rely on external sources of illumination. The segmentation technique by which an image is separated into different collections of contiguous picture elements having such common characteristics as color, brightness, or texture is examined, with emphasis on the edge detection technique. The IMFEX (image feature extractor) system performing edge detection and thresholding at 30 frames/sec television frame rates is described. The template matching and discrimination approach to recognize objects are noted. Applications of robotic vision in industry for tasks too monotonous or too dangerous for the workers are mentioned.

Williams, D. S.↗

Compact Autonomous Hemispheric Vision System

Solar System Exploration camera implementations to date have involved either single cameras with wide field-of-view (FOV) and consequently coarser spatial resolution, cameras on a movable mast, or single cameras necessitating rotation of the host vehicle to afford visibility outside a relatively narrow FOV. These cameras require detailed commanding from the ground or separate onboard computers to operate properly, and are incapable of making decisions based on image content that control pointing and downlink strategy. For color, a filter wheel having selectable positions was often added, which added moving parts, size, mass, power, and reduced reliability. A system was developed based on a general-purpose miniature visible-light camera using advanced CMOS (complementary metal oxide semiconductor) imager technology. The baseline camera has a 92 FOV and six cameras are arranged in an angled-up carousel fashion, with FOV overlaps such that the system has a 360 FOV (azimuth). A seventh camera, also with a FOV of 92 , is installed normal to the plane of the other 6 cameras giving the system a > 90 FOV in elevation and completing the hemispheric vision system. A central unit houses the common electronics box (CEB) controlling the system (power conversion, data processing, memory, and control software). Stereo is achieved by adding a second system on a baseline, and color is achieved by stacking two more systems (for a total of three, each system equipped with its own filter.) Two connectors on the bottom of the CEB provide a connection to a carrier (rover, spacecraft, balloon, etc.) for telemetry, commands, and power. This system has no moving parts. The system's onboard software (SW) supports autonomous operations such as pattern recognition and tracking.

Pingree, Paula J.↗

Digital enhancement of multispectral MSS data for maximum image visibility

A systematic approach to the enhancement of images has been developed. This approach exploits two principal features involved in the observation of images: the properties of human vision and the statistics of the images being observed. The rationale of the enhancement procedure is as follows: in the observation of some features of interest in an image, the range of objective luminance-chrominance values being displayed is generally limited and does not use the whole perceptual range of vision of the observer. The purpose of the enhancement technique is to expand and distort in a systematic way the grey scale values of each of the multispectral bands making up a color composite, to enhance the average visibility of the features being observed.

Algazi, V. R.↗

Evaluation of Equivalent Vision Technologies for Supersonic Aircraft Operations

Twenty-four air transport-rated pilots participated as subjects in a fixed-based simulation experiment to evaluate the use of Synthetic/Enhanced Vision (S/EV) and eXternal Vision System (XVS) technologies as enabling technologies for future all-weather operations. Three head-up flight display concepts were evaluated a monochromatic, collimated Head-up Display (HUD) and a color, non-collimated XVS display with a field-of-view (FOV) equal to and also, one significantly larger than the collimated HUD. Approach, landing, departure, and surface operations were conducted. Additionally, the apparent angle-of-attack (AOA) was varied (high/low) to investigate the vertical field-of-view display requirements and peripheral, side window visibility was experimentally varied. The data showed that lateral approach tracking performance and lateral landing position were excellent regardless of the display type and AOA condition being evaluated or whether or not there were peripheral cues in the side windows. Longitudinal touchdown and glideslope tracking were affected by the display concepts. Larger FOV display concepts showed improved longitudinal touchdown control, superior glideslope tracking, significant situation awareness improvements and workload reductions compared to smaller FOV display concepts.

Kramer, Lynda J.↗

The Spatial Standard Observer

The spatial standard observer is a computational model that provides a measure of the visibility of a target in a uniform background image or of the visual discriminability of two images. Standard observers have long been used in science and industry to quantify the discriminability of colors. Color standard observers address the spectral characteristics of visual stimuli, while the spatial standard observer (SSO), as its name indicates, addresses spatial characteristics. The SSO is based on a model of human vision. The SSO was developed in a process that included evaluation of a number of earlier mathematical models that address optical, physiological, and psychophysical aspects of spatial characteristics of human visual perception. Elements of the prior models are incorporated into the SSO, which is formulated as a compromise between accuracy and simplicity. The SSO operates on a digitized monochrome still image or on a pair of such images. The SSO consists of three submodels that operate sequentially on the input image(s): 1. A contrast model, which converts an input monochrome image to a luminance contrast image, wherein luminance values are expressed as excursions from, and normalized to, a mean; 2. A contrast-sensitivity-filter model that includes an oblique-effect filter (which accounts for the decline in contrast sensitivity at oblique viewing angles); and 3. A spatial summation model, in which responses are spatially pooled by raising each pixel to the power beta, adding the results, and raising the sum to the 1/b power. In this model, b=2.9 was found to be a suitable value. The net effect of the SSO is to compute a numerical measure of the perceptual strength of the single image, or of the visible difference (denoted the perceptual distance) between two images. The unit of a measure used in the SSO is the just noticeable difference (JND), which is a standard measure of perceptual discriminability. A target that is just visible has a measure of 1 JND.

Watson, Andrew B.↗

Daytime Water Detection Based on Sky Reflections

A water body s surface can be modeled as a horizontal mirror. Water detection based on sky reflections and color variation are complementary. A reflection coefficient model suggests sky reflections dominate the color of water at ranges > 12 meters. Water detection based on sky reflections: (1) geometrically locates the pixel in the sky that is reflecting on a candidate water pixel on the ground (2) predicts if the ground pixel is water based on color similarity and local terrain features. Water detection has been integrated on XUVs.

water detections↗

Motion-Base Simulator Evaluation of an Aircraft Using an External Vision System

Twelve air transport-rated pilots participated as subjects in a motion-base simulation experiment to evaluate the use of eXternal Vision Systems (XVS) as enabling technologies for future supersonic aircraft without forward facing windows. Three head-up flight display concepts were evaluated -a monochromatic, collimated Head-up Display (HUD) and a color, non-collimated XVS display with a field-of-view (FOV) equal to and also, one significantly larger than the collimated HUD. Approach, landing, departure, and surface operations were conducted. Additionally, the apparent angle-of-attack (AOA) was varied (high/low) to investigate the vertical field-of-view display requirements and peripheral, side window visibility was experimentally varied. The data showed that lateral approach tracking performance and lateral landing position were excellent regardless of AOA, display FOV, display collimation or whether peripheral cues were present. However, the data showed glide slope approach tracking appears to be affected by display size (i.e., FOV) and collimation. The monochrome, collimated HUD and color, uncollimated XVS with Full FOV display had (statistically equivalent) glide path performance improvements over the XVS with HUD FOV display. Approach path performance results indicated that collimation may not be a requirement for an XVS display if the XVS display is large enough and employs color. Subjective assessments of mental workload and situation awareness also indicated that an uncollimated XVS display may be feasible. Motion cueing appears to have improved localizer tracking and touchdown sink rate across all displays.

Kramer, Lynda J.↗