Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual perception”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

The Spatial Standard Observer

The spatial standard observer is a computational model that provides a measure of the visibility of a target in a uniform background image or of the visual discriminability of two images. Standard observers have long been used in science and industry to quantify the discriminability of colors. Color standard observers address the spectral characteristics of visual stimuli, while the spatial standard observer (SSO), as its name indicates, addresses spatial characteristics. The SSO is based on a model of human vision. The SSO was developed in a process that included evaluation of a number of earlier mathematical models that address optical, physiological, and psychophysical aspects of spatial characteristics of human visual perception. Elements of the prior models are incorporated into the SSO, which is formulated as a compromise between accuracy and simplicity. The SSO operates on a digitized monochrome still image or on a pair of such images. The SSO consists of three submodels that operate sequentially on the input image(s): 1. A contrast model, which converts an input monochrome image to a luminance contrast image, wherein luminance values are expressed as excursions from, and normalized to, a mean; 2. A contrast-sensitivity-filter model that includes an oblique-effect filter (which accounts for the decline in contrast sensitivity at oblique viewing angles); and 3. A spatial summation model, in which responses are spatially pooled by raising each pixel to the power beta, adding the results, and raising the sum to the 1/b power. In this model, b=2.9 was found to be a suitable value. The net effect of the SSO is to compute a numerical measure of the perceptual strength of the single image, or of the visible difference (denoted the perceptual distance) between two images. The unit of a measure used in the SSO is the just noticeable difference (JND), which is a standard measure of perceptual discriminability. A target that is just visible has a measure of 1 JND.

Watson, Andrew B.↗
NASA NTRS2014

Visual Image Sensor Organ Replacement

This innovation is a system that augments human vision through a technique called "Sensing Super-position" using a Visual Instrument Sensory Organ Replacement (VISOR) device. The VISOR device translates visual and other sensors (i.e., thermal) into sounds to enable very difficult sensing tasks. Three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. Because the human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns, the translation of images into sounds reduces the risk of accidentally filtering out important clues. The VISOR device was developed to augment the current state-of-the-art head-mounted (helmet) display systems. It provides the ability to sense beyond the human visible light range, to increase human sensing resolution, to use wider angle visual perception, and to improve the ability to sense distances. It also allows compensation for movement by the human or changes in the scene being viewed.

Maluf, David A.↗
NASA NTRS2017

Color Algebras

A color algebra refers to a system for computing sums and products of colors, analogous to additive and subtractive color mixtures. The difficulty addressed here is the fact that, because of metamerism, we cannot know with certainty the spectrum that produced a particular color solely on the basis of sensory data. Knowledge of the spectrum is not required to compute additive mixture of colors, but is critical for subtractive (multiplicative) mixture. Therefore, we cannot predict with certainty the multiplicative interactions between colors based solely on sensory data. There are two potential applications of a color algebra: first, to aid modeling phenomena of human visual perception, such as color constancy and transparency; and, second, to provide better models of the interactions of lights and surfaces for computer graphics rendering.

color rendering↗
NASA NTRS2019

The Fine Motor Skills and Cognition Test Batteries: Normative Data and Interdependencies

Fine motor skills and cognitive abilities are major contributors to crew performance on essentially all extravehicular and intra-vehicular activities during spaceflight. It is critical for the crew’s safety, and for mission productivity, to know if, and when, motor skills or cognitive abilities are compromised so that countermeasures may be introduced. NASA has developed two test batteries to measure and monitor astronaut cognitive and fine motor skills. The Cognition Test Battery contains 10 sub-tests that assess cognitive behaviors ranging from low level visual perception to high level decision-making. The Fine Motor Skills Test Battery contains 4 sub-tests that assess finger dexterity, manual dexterity and wrist-finger speed. This study sought to determine acceptable norms for both batteries in an astronaut-like population and to identify the extent to which fine motor skills contribute to cognitive test scores.

Normative Data↗
NASA NTRSDate not supplied

Transcriptomic Analysis of Irradiated Mouse Retina Following Readaptation

Rodent models are used as analogs for studying the effects of spaceflight. NASA GeneLab provides access to relevant omics datasets generated from spaceflight and ground-based experiments allowing for additional retrospective analysis. In this study, we used GeneLab’s GLDS-203, a dataset generated by researchers at Loma Linda University to study the impact of prolonged unloading and/or low-dose radiation on mouse retina. We analyzed transcriptomics data from retina of mice irradiated with gamma-rays for 21 days followed by 7 days, 1 month, or 4 months of readaptation. We obtained raw gene counts from GeneLab and performed differential gene expression analysis after data normalization. For each of the three timepoints, we performed differential expression analysis to compare transcriptional profiles for retina from irradiated vs. non-irradiated (controls) mice, all exposed to gravity. We observed the highest number of differentially expressed genes at 7 days, followed by 1 month and 4 months. Enrichment analysis showed top pathways (adjusted p-value < 0.05) were related to transport along microtubule and photoreceptor cell development in the 7-day readaptation group. Fewer significantly enriched pathways were observed for the 1-month group and included mRNA metabolic processes and neuron differentiation. No significantly enriched pathways were found in the 4-month group. The Gene Ontology biological processes common between the 7 days and 1-month groups include visual perception, synapse organization, and perception of light stimulus. This analysis is part of a larger effort to characterize the molecular mechanisms involved in retinal readaptation following radiation exposure. Future analyses will include other related retina datasets in GeneLab repository to assess whether gene expression patterns are consistent across different study cohorts.

Prachi Kothiyal↗
NASA NTRSDate not supplied

Assumption Generation for the Verification of Learning-Enabled Autonomous Systems

Providing safety guarantees for autonomous systems is difficultas these systems operate in complex environments that require the use of learning-enabled components, such as deep neural networks (DNNs) for visual perception. DNNs are hard to analyze due to their size (they can have thousands or millions of parameters), lack of formal specifications (DNNs are typically learnt from labeled data, in the absence of any formal or informal requirements), and sensitivity to small changes in the environment. We present an assume-guarantee style compositional approach for the formal verification of system-level safety properties of such autonomous systems. Our insight is that we can analyze the system in the absence of the DNN perception components by automatically synthesizing assumptions on the DNN behaviour that guarantee the satisfaction of the required safety properties. The synthesized assumptions are the weakest in the sense that they characterize the output sequences of all the possible DNNs that, plugged into the autonomous system, guarantee the required safety properties. The assumptions can be leveraged as run-time monitors over a deployed DNN to guarantee the safety of the overall system; they can also be mined to extract local specifications for use during training and testing of DNNs. We illustrate our approach on a case study taken from the autonomous airplanes domain that uses a complex DNN for perception

Autonomous systems↗
NASA NTRSDate not supplied

Intelligent Change Detection System: Autonomous Intelligent Machine Agent Model Development

NASA’s significant role in facilitating the harmonious integration of unmanned aircraft systems (UAS), with other aerial vehicles operating in the National Airspace System (NAS), has revealed a need for more advanced technological tools than are being utilized currently. This technology would lend itself to significantly assisting Direct-Action Aviation Personnel (DAAP) with the ingress and egress of UAS operations within the NAS. Providing research findings that would reduce technical barriers, associated with UAS-NAS integration, has been a persistent effort by both NASA and the FAA. One such research effort, pursued by NASA’s Transformative Tools and Technologies – Revolutionary Aviation Mobility (T3-RAM) project, is the development of an autonomous intelligent machine (AIM) agent that would aid DAAP functioning as implemented in remote ground control stations (RGCS). This evolution of the “human-machine” symbiosis, within the aviation environment, is necessary for many reasons. For example, there are projections of large increases to the 864,000 registered UAS and 45,000 aviation operations taking place in the NAS each day. With a data output range from 1 to 20 terabytes per flight or each aerial vehicle, which is projected to have proportional rate increase to that of registered UASs. It is evident, that due to the projected increase of UASs and their generated data, the human-agent’s data managing capabilities will be quickly overwhelmed by the enormous amounts of data emanating in the NAS. The research efforts presented in this paper puts forward results from the development, assessment, and verification of a previously conceptualized AIM-Agent that combats actionable-data (information) errors resulting from the visual perception phenomenon known as “change blindness” (CB). CB has been identified as one of the main culprits of information erroring encountered within the ground control station operator (GCSO) community.

Change Blindness↗
NASA NTRS2000

Visual motion integration for perception and pursuit

To examine the relationship between visual motion processing for perception and pursuit, we measured the pursuit eye-movement and perceptual responses to the same complex-motion stimuli. We show that humans can both perceive and pursue the motion of line-figure objects, even when partial occlusion makes the resulting image motion vastly different from the underlying object motion. Our results show that both perception and pursuit can perform largely accurate motion integration, i.e. the selective combination of local motion signals across the visual field to derive global object motion. Furthermore, because we manipulated perceived motion while keeping image motion identical, the observed parallel changes in perception and pursuit show that the motion signals driving steady-state pursuit and perception are linked. These findings disprove current pursuit models whose control strategy is to minimize retinal image motion, and suggest a new framework for the interplay between visual cortex and cerebellum in visuomotor control.

NASA Center ARC↗
NASA NTRS1993

Comparative measurement of visual stability in Earth and cosmic space (L-4)

The frequency and the intensity of space motion sickness was reviewed and investigated. Unusual induced-gravity situations, such as rotation, linear acceleration, parallel swinging etc. were investigated as well. Visually-induced motion sensation or distorted perception were evaluated with respect to visual stability by many investigators. These studies are all concerned with the effect of gravity and the induction of motion sickness through human visual perception. Direct investigation under the microgravity situation, such as parabolic flight, Skylab, and Spacelab, was carried out. These studies focused on how human visual stability is established through various sensory afferents in specific gravity conditions. Results from these investigations indicate that sensory mismatch probably plays an important role in space motion sickness. The interaction of visual, vestibular, and somatosensory perception is smoothly coordinated under normal gravitational conditions on the Earth in our daily life. When the cooperation is destroyed or a mismatch occurs among them, motion sickness may develop not only on the Earth but also in microgravity. The latter case may be the cause of space motion sickness or space adaption syndrome. How human beings obtain visual stability even with posture changes on the ground was investigated. Visual stability can be categorized as static or dynamic. Static visual stability is concerned with orientation and dynamic stability is concerned with object motion perception. The perception of visual stability is modified by many other sensations, such as somatosensory, vestibular, and muscle tension. We will mainly focus on modifications by vestibular inputs to visual perception produced by eye movements in microgravity. The Vestibular-Oscular Reflex (VOR) is a well-known characteristic which results from the relationship between eye mobility and vestibular afferent inputs. Eye movements also modify dynamic visual perception, such as perceived object motion velocity. The VOR is constantly simulated under 1-g conditions on Earth. In fact, human beings have been habituated and 'programmed' for orientation (visual stability) in their everyday, 1-g environment. When humans are exposed to a different gravity situation, this programmed behavior must change; that is, it is reprogrammed. This is called habituation or familiarization. We hope to examine how object motion perception is perturbed and subsequently adapted in the microgravity environment. This experiment is focused on the cooperation of visual, vestibular, and somatosensory perception coordination and how it is changed or reduced in space compared to 1-g environment. We will obtain information on the coordination between eye movement and neck muscle activity by using EOG and EMG. We will also collect data from Payload Specialists using a self-diagnostic questionnaire concerned with perceptual abnormality. When each sensory input function and its integration in the higher nervous system are well-characterized, then more effective techniques to control SAS may be developed.

Koga, Kazugo↗
NASA NTRS1979

Perception and performance in flight simulators: The contribution of vestibular, visual, and auditory information

The pilot's perception and performance in flight simulators is examined. The areas investigated include: vestibular stimulation, flight management and man cockpit information interfacing, and visual perception in flight simulation. The effects of higher levels of rotary acceleration on response time to constant acceleration, tracking performance, and thresholds for angular acceleration are examined. Areas of flight management examined are cockpit display of traffic information, work load, synthetic speech call outs during the landing phase of flight, perceptual factors in the use of a microwave landing system, automatic speech recognition, automation of aircraft operation, and total simulation of flight training.

Source record↗
NASA NTRS1991

Pictorial communication in virtual and real environments

Papers about the communication between human users and machines in real and synthetic environments are presented. Individual topics addressed include: pictorial communication, distortions in memory for visual displays, cartography and map displays, efficiency of graphical perception, volumetric visualization of 3D data, spatial displays to increase pilot situational awareness, teleoperation of land vehicles, computer graphics system for visualizing spacecraft in orbit, visual display aid for orbital maneuvering, multiaxis control in telemanipulation and vehicle guidance, visual enhancements in pick-and-place tasks, target axis effects under transformed visual-motor mappings, adapting to variable prismatic displacement. Also discussed are: spatial vision within egocentric and exocentric frames of reference, sensory conflict in motion sickness, interactions of form and orientation, perception of geometrical structure from congruence, prediction of three-dimensionality across continuous surfaces, effects of viewpoint in the virtual space of pictures, visual slant underestimation, spatial constraints of stereopsis in video displays, stereoscopic stance perception, paradoxical monocular stereopsis and perspective vergence. (No individual items are abstracted in this volume)

Ellis, Stephen R.↗
NASA NTRS2006

Tilt and Translation Motion Perception during Pitch Tilt with Visual Surround Translation

The central nervous system must resolve the ambiguity of inertial motion sensory cues in order to derive an accurate representation of spatial orientation. Previous studies suggest that multisensory integration is critical for discriminating linear accelerations arising from tilt and translation head motion. Visual input is especially important at low frequencies where canal input is declining. The NASA Tilt Translation Device (TTD) was designed to recreate postflight orientation disturbances by exposing subjects to matching tilt self motion with conflicting visual surround translation. Previous studies have demonstrated that brief exposures to pitch tilt with foreaft visual surround translation produced changes in compensatory vertical eye movement responses, postural equilibrium, and motion sickness symptoms. Adaptation appeared greatest with visual scene motion leading (versus lagging) the tilt motion, and the adaptation time constant appeared to be approximately 30 min. The purpose of this study was to compare motion perception when the visual surround translation was inphase versus outofphase with pitch tilt. The inphase stimulus presented visual surround motion one would experience if the linear acceleration was due to foreaft self translation within a stationary surround, while the outofphase stimulus had the visual scene motion leading the tilt by 90 deg as previously used. The tilt stimuli in these conditions were asymmetrical, ranging from an upright orientation to 10 deg pitch back. Another objective of the study was to compare motion perception with the inphase stimulus when the tilts were asymmetrical relative to upright (0 to 10 deg back) versus symmetrical (10 deg forward to 10 deg back). Twelve subjects (6M, 6F, 22-55 yrs) were tested during 3 sessions separated by at least one week. During each of the three sessions (out-of-phase asymmetrical, in-phase asymmetrical, inphase symmetrical), subjects were exposed to visual surround translation synchronized with pitch tilt at 0.1 Hz for a total of 30 min. Tilt and translation motion perception was obtained from verbal reports and a joystick mounted on a linear stage. Horizontal vergence and vertical eye movements were obtained with a binocular video system. Responses were also obtained during darkness before and following 15 min and 30 min of visual surround translation. Each of the three stimulus conditions involving visual surround translation elicited a significantly reduced sense of perceived tilt and strong linear vection (perceived translation) compared to pre-exposure tilt stimuli in darkness. This increase in perceived translation with reduction in tilt perception was also present in darkness following 15 and 30 min exposures, provided the tilt stimuli were not interrupted. Although not significant, there was a trend for the inphase asymmetrical stimulus to elicit a stronger sense of both translation and tilt than the out-of-phase asymmetrical stimulus. Surprisingly, the inphase asymmetrical stimulus also tended to elicit a stronger sense of peak-to-peak translation than the inphase symmetrical stimulus, even though the range of linear acceleration during the symmetrical stimulus was twice that of the asymmetrical stimulus. These results are consistent with the hypothesis that the central nervous system resolves the ambiguity of inertial motion sensory cues by integrating inputs from visual, vestibular, and somatosensory systems.

O'Sullivan, Brita M.↗