Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual perception”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
NASA NTRS1987

Development of Moire machine vision

Three dimensional perception is essential to the development of versatile robotics systems in order to handle complex manufacturing tasks in future factories and in providing high accuracy measurements needed in flexible manufacturing and quality control. A program is described which will develop the potential of Moire techniques to provide this capability in vision systems and automated measurements, and demonstrate artificial intelligence (AI) techniques to take advantage of the strengths of Moire sensing. Moire techniques provide a means of optically manipulating the complex visual data in a three dimensional scene into a form which can be easily and quickly analyzed by computers. This type of optical data manipulation provides high productivity through integrated automation, producing a high quality product while reducing computer and mechanical manipulation requirements and thereby the cost and time of production. This nondestructive evaluation is developed to be able to make full field range measurement and three dimensional scene analysis.

Harding, Kevin G.↗
NASA NTRS1999

Visualizing Mars Using Virtual Reality: A State of the Art Mapping Technique Used on Mars Pathfinder

We describe an interactive terrain visualization system which rapidly generates and interactively displays photorealistic three-dimensional (3-D) models produced from stereo images. This product, first demonstrated in Mars Pathfinder, is interactive, 3-D, and can be viewed in an immersive display which qualifies it for the name Virtual Reality (VR). The use of this technology on Mars Pathfinder was the first use of VR for geologic analysis. A primary benefit of using VR to display geologic information is that it provides an improved perception of depth and spatial layout of the remote site. The VR aspect of the display allows an operator to move freely in the environment, unconstrained by the physical limitations of the perspective from which the data were acquired. Virtual Reality offers a way to archive and retrieve information in a way that is intuitively obvious. Combining VR models with stereo display systems can give the user a sense of presence at the remote location. The capability, to interactively perform measurements from within the VR model offers unprecedented ease in performing operations that are normally time consuming and difficult using other techniques. Thus, Virtual Reality can be a powerful a cartographic tool. Additional information is contained in the original extended abstract.

Stoker, C.↗
NASA NTRS1995

Model-based VQ for image data archival, retrieval and distribution

An ideal image compression technique for image data archival, retrieval and distribution would be one with the asymmetrical computational requirements of Vector Quantization (VQ), but without the complications arising from VQ codebooks. Codebook generation and maintenance are stumbling blocks which have limited the use of VQ as a practical image compression algorithm. Model-based VQ (MVQ), a variant of VQ described here, has the computational properties of VQ but does not require explicit codebooks. The codebooks are internally generated using mean removed error and Human Visual System (HVS) models. The error model assumed is the Laplacian distribution with mean, lambda-computed from a sample of the input image. A Laplacian distribution with mean, lambda, is generated with uniform random number generator. These random numbers are grouped into vectors. These vectors are further conditioned to make them perceptually meaningful by filtering the DCT coefficients from each vector. The DCT coefficients are filtered by multiplying by a weight matrix that is found to be optimal for human perception. The inverse DCT is performed to produce the conditioned vectors for the codebook. The only image dependent parameter used in the generation of codebook is the mean, lambda, that is included in the coded file to repeat the codebook generation process for decoding.

Manohar, Mareboyana↗
NASA NTRS1999

Electroencephalographic imaging of higher brain function

High temporal resolution is necessary to resolve the rapidly changing patterns of brain activity that underlie mental function. Electroencephalography (EEG) provides temporal resolution in the millisecond range. However, traditional EEG technology and practice provide insufficient spatial detail to identify relationships between brain electrical events and structures and functions visualized by magnetic resonance imaging or positron emission tomography. Recent advances help to overcome this problem by recording EEGs from more electrodes, by registering EEG data with anatomical images, and by correcting the distortion caused by volume conduction of EEG signals through the skull and scalp. In addition, statistical measurements of sub-second interdependences between EEG time-series recorded from different locations can help to generate hypotheses about the instantaneous functional networks that form between different cortical regions during perception, thought and action. Example applications are presented from studies of language, attention and working memory. Along with its unique ability to monitor brain function as people perform everyday activities in the real world, these advances make modern EEG an invaluable complement to other functional neuroimaging modalities.

Non-NASA Center↗
NASA NTRS1992

Angular relation of axes in perceptual space

The geometry of perceptual space needs to be known to model spatial orientation constancy or to create virtual environments. To examine one main aspect of this geometry, the angular relation between the three spatial axes was measured. Experiments were performed consisting of a perceptual task in which subjects were asked to set independently their apparent vertical and horizontal plane. The visual background provided no other stimuli to serve as optical direction cues. The task was performed in a number of different body tilt positions with pitches and rolls varied in steps of 30 degs. The results clearly show the distortion of orthogonality of the perceptual space for nonupright body positions. Large interindividual differences were found. Deviations from orthogonality up to 25 deg were detected in the pitch as well as in the roll direction. Implications of this nonorthogonality on further studies of spatial perception and on the construction of virtual environments for human interaction is also discussed.

Bucher, Urs↗
NASA NTRS2024

Evaluation of Intranasal Scopolamine for the Prevention of Wave Motion Induced Motion Sickness While Maintaining Performance on Operationally Relevant Tasks

Motion sickness represents one of the greatest clinical challenges impacting crew activities during and following g-transitions. Our overall goal is to characterize the effectiveness of motion sickness countermeasures during controlled laboratory experiments using capsule wave motion simulation and during field testing in operational environments. This laboratory study focused on prevention of motion sickness using intranasal scopolamine using a double-blinded repeated measures design in 30 subjects (19M, 11F). Intranasal scopolamine was provided by Defender Pharmaceuticals, Inc. (DPI-386 Nasal Gel, referred to as Inscop) self-administered by a nasal pump (Aptar Pharma) that delivers 0.4 mg dose (0.2 mg / nostril). During each session, subjects were exposed to complex wave motion on a six degree-of-freedom platform that included pitch, roll and heave at provocative stimulus frequencies (0.1-0.25 Hz) while seated in an illuminated cabin deprived of external visual cues. Motion sickness symptoms were compared across treatment and placebo control sessions counterbalanced across subjects and separated by at least one week. The time-to-motion sickness endpoint was based on severe malaise, defined as symptom score of ≥8 points using the Pensacola Diagnostic Index [1]. The bioavailability of scopolamine for each session was estimated from plasma concentrations obtained every 15 min[2]. Side effects during the treatment session were minimal, and performance was not impaired on a test battery including motion perception tracking, tablet-based eye-hand coordination and psychomotor vigilance testing. The plasma concentration remained near-peak levels throughout the 45 min motion sickness testing for most subjects. The percentile ranking on the Motion Sickness Susceptibility Questionnaire [MSSQ, 3]was moderately correlated with the motion sickness time-to-endpoint during the placebo control session (rho = –0.3, p=0.056). Seventeen subjects did not reach an endpoint during their placebo session and were eliminated from subsequent analysis. Another subject was excluded due to insufficient plasma concentration during the treatment session. For the remaining 12 subjects, the change in time-to-motion sickness endpoint between placebo and treatment sessions was moderately correlated with plasma concentration (rho =0.48, p = 0.056), improving on average 4.4 ± 18.4 min, mean ± std with Inscop versus placebo. Our results are consistent with previous findings that intranasal delivery of scopolamine can be effective at reducing motion sickness symptoms with minimal cognitive or sedative side effects. Future work is needed to optimize the delivery of Inscop for rescue (treatment) of symptoms following g-transitions as one of the key advantages of this formulation is self-administration in a suited environment. We will also explore how the combination of Inscop with non-pharmaceutical sensory aids, e.g., vibrotactile feedback of Earth vertical, may further mitigate motion sickness and improve task performance.

S J Wood↗
NASA NTRS1996

The barberplaid illusion: plaid motion is biased by elongated apertures

The perceived direction of motion of plaids windowed by elongated spatial Gaussians is biased toward the window's long axis. The bias increases as the relative angle between the plaid motion and the long axis of the window increases, peaks at a relative angle of approximately 45 deg, and then decreases. The bias increases as the window is made narrower (at fixed height) and decreases as the component spatial frequency increases (at fixed aperture size). We examine several models of human motion processing (cross-correlation, motion-energy, intersection-of-constraints, and vector-sum), and show that none of these standard models can predict our data. We conclude that spatial integration of motion signals plays a crucial role in plaid motion perception and that current models must be explicitly expanded to include such spatial interactions.

NASA Center ARC↗
NASA NTRS2001

Spatial orientation and balance control changes induced by altered gravitoinertial force vectors

To better understand the mechanisms of human adaptation to rotating environments, we exposed 19 healthy subjects and 8 vestibular-deficient subjects ("abnormal"; four bilateral and four unilateral lesions) to an interaural centripetal acceleration of 1 g (resultant 45 degrees roll-tilt of 1.4 g) on a 0.8-m-radius centrifuge for periods of 90 min. The subjects sat upright (body z-axis parallel to centrifuge rotation axis) in the dark with head stationary, except during 4 min of every 10 min, when they performed head saccades toward visual targets switched on at 3- to 5-s intervals at random locations (within +/- 30 degrees) in the earth-horizontal plane. Eight of the normal subjects also performed the head saccade protocol in a stationary chair adjusted to a static roll-tilt angle of 45 degrees for 90 min (reproducing the change in orientation but not the magnitude of the gravitoinertial force on the centrifuge). Eye movements, including voluntary saccades directed along perceived earth- and head-referenced planes, were recorded before, during, and immediately after centrifugation. Postural center of pressure (COP) and multisegment body kinematics were also gathered before and within 10 min after centrifugation. Normal subjects overestimated roll-tilt during centrifugation and revealed errors in perception of head-vertical provided by directed saccades. Errors in this perceptual response tended to increase with time and became significant after approximately 30 min. Motion-sickness symptoms caused approximately 25% of normal subjects to limit their head movements during centrifugation and led three normal subjects to stop the test early. Immediately after centrifugation, subjects reported feeling tilted 10 degrees in the opposite direction, which was in agreement with the direction of their earth-referenced directed saccades. Postural COP, segmental body motion amplitude, and hip-sway frequency increased significantly after centrifugation. These postural effects were short-lived, however, with a recovery time of several postural test trials (minutes). There were also asymmetries in the direction of postcentrifugation COP and head tilt which depended on the subject's orientation during the centrifugation adaptation period (left ear or right ear out). The amount of total head movements during centrifugation correlated poorly or inversely with postcentrifugation postural stability, and the most unstable subject made no head movements. There was no decrease in postural stability after static tilt, although these subjects also reported a perceived tilt briefly after return to upright, and they also had COP asymmetries. Abnormal subjects underestimated roll-tilt during centrifugation, and their directed saccades revealed permanent spatial distortions. Bilateral abnormal subjects started out with poor postural control, but showed no postural decrements after centrifugation, while unilateral abnormal subjects had varying degrees of postural decrement, both in their everyday function and as a result of experiencing the centrifugation. In addition, three unilateral, abnormal subjects, who rode twice in opposite orientations, revealed a consistent orthogonal pattern of COP offsets after centrifugation. These results suggest that both orientation and magnitude of the gravitoinertial vector are used by the central nervous system for calibration of multiple orientation systems. A change in the background gravitoinertial force (otolith input) can rapidly initiate postural and perceptual adaptation in several sensorimotor systems, independent of a structured visual surround.

Clinical Trial↗
DOE OSTI2023

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Recommended methods for conducting human factors experiments on the subjective evaluation of colour rendition

This article explores the best practices for conducting psychophysical experiments that investigate how colour rendition influences the perception of architectural environments. Here, we offer guidance that covers all stages of research from preliminary development to publication, focusing especially on experiments that investigate qualities such as perceived naturalness, vividness, preference or acceptability in response to changes in the spectral power distribution of light sources. This article is intended to be a consolidated guide for researchers and reviewers of this type of research. Key recommendations include: (1) New work should be motivated by clearly expressed research questions and, when possible, explicit hypotheses that build on the existing body of knowledge, (2) visual stimuli comprising spectral power distributions and visual targets should be deliberately engineered to probe the research questions, (3) experiments should be designed to lessen potential biases, (4) reporting of experimental conditions and statistical analyses should be thorough and (5) Results should be contextual, resisting overgeneralization that cannot be supported by the data. Our motivation is to encourage high-quality research that is credible and discourage poor quality research that slows scientific progress and misuses resources.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
NASA NTRS2021

Multi-Resolution Elevation Mapping and Safe Landing Site Detection with Applications to Planetary Rotorcraft

In this paper, we propose a resource-efficient approach to provide an autonomous UAV with an on-board perception method to detect safe, hazard-free landing sites during flights over complex 3D terrain. We aggregate 3D measurements acquired from a sequence of monocular images by a Structure-from-Motion approach into a local, robot-centric, multi-resolution elevation map of the overflown terrain, which fuses depth measurements according to their lateral surface resolution (pixel-footprint) in a probabilistic framework based on the concept of dynamic Level of Detail. Map aggregation only requires depth maps and the associated poses, which are obtained from an on-board Visual Odometry algorithm. An efficient landing site detection method then exploits the features of the underlying multi-resolution map to detect safe landing sites based on the slope, roughness, and quality of the reconstructed terrain surface. The evaluation of the performance of the mapping and landing site detection modules are analyzed independently and jointly in simulated and realworld experiments in order to establish the efficacy of the proposed approach.

Brockers, Roland↗
NASA NTRS2021

Dense 3D-Reconstruction from Monocular Image Sequences for Computationally Constrained UAS

The ability to find safe landing sites over complex 3D terrain is an essential safety feature for fully autonomous small unmanned aerial systems (UAS), which requires on-board perception for 3D reconstruction and terrain analysis if the overflown terrain is unknown. This is a challenge for UAS that are limited in size, weight and computational power, such as small rotorcrafts executing autonomous missions on Earth, or in planetary applications such as the Mars Helicopter. For such a computationally constraint system, we propose a structure from motion approach that uses inputs from a single downward facing camera to produce dense point clouds of the overflown terrain in real time. In contrast to existing approaches, our method uses metric pose information from a visual-inertial odometry algorithm as camera pose priors, which allows deploying a fast pose refinement step to align camera frames such that a conventional stereo algorithm can be used for dense 3D reconstruction. We validate the performance of our approach with extensive evaluations in simulation, and demonstrate the feasibility with data from UAS flights.

Brockers, Roland↗
NASA NTRS1999

Yaw and pitch visual-vestibular interaction in weightlessness

Both yaw and pitch visual-vestibular interactions at two separate frequencies of chair rotation (0.2 and 0.8 Hz) in combination with a single velocity of optokinetic stimulus (36 degrees/s) were used to investigate the effects of sustained weightlessness on neural strategies adopted by astronaut subjects to cope with the stimulus rearrangement of spaceflight. Pitch and yaw oscillation in darkness at 0.2 and 0.8 Hz without optokinetic stimulation, and constant velocity linear optokinetic stimulation at 18, 36, and 54 degrees/s presented relative to the head with the subject stationary, were used as controls for the visual-vestibular interactions. The results following 8 days of space flight showed no significant changes in: (1) either the horizontal and vertical vestibulo-ocular reflex (VOR) gain, phase, or bias; (2) the yaw visual-vestibular response (VVR); or (3) the horizontal or vertical optokinetic (OKN) slow phase velocity (SPV). However, significant changes were observed: (1) when during pitch VVR at 0.2 Hz late inflight, the contribution of the optokinetic input to the combined oculomotor response was smaller than during the stationary OKN SPV measurements, followed by an increased contribution during the immediate postflight testing; and (2) when during pitch VVR at 0.8 Hz, the component of the combined oculomotor response due to the underlying vertical VOR was more efficiently suppressed early inflight and less suppressed immediately postflight compared with preflight observations. The larger OKN response during pitch VVR at 0.2 Hz and the better suppression of VOR during pitch VVR at 0.8 Hz postflight are presumably due to the increased role of vision early inflight and immediately after spaceflight, as previously observed in various studies. These results suggest that the subjects adopted a neural strategy to structure their spatial orientation in weightlessness by reweighting visual, otolith, and perhaps tactile/somatic signals.

NASA Center JSC↗
NASA NTRS1984

Rheoceptive mediators of graviperception in a water flea: Morphological implications of antennal-socket setae in daphnia magna

Aquatic microcrustaceans of the genus Daphnia are known to orient to light during the day. At night, in the absence of visual cues, daphnids were suspected of maintaining equilibrium by monitoring the direction of gravity through their swimming antennae. Recent investigations using simulated, weightlessness conditions coupled with absence of illumination revealed hair like structures or setae on the basal, articulating socket of the antennae that, when surgically removed, resulted in disorientation. Given the simulated weightlessness or neutrally buoyant condition that eliminated sinking of the normally negatively buoyant Daphnia, it was proposed that the antennal socket setae function as rheoceptors stimulated by the upward rush of water currents during gravity induced, sinking phase of daphnid swimming movements. This rheoceptively mediated, gravity perception hypothesis is further supported by morphological investigations. Scanning electron micrographs indicate that antennal socket setae are anatomically similar to proprioceptors used by higher crustaceans to monitor gravitational direction.

Meyers, D. G.↗
NASA NTRS1991

Visually guided control of movement in the context of multimodal stimulation

Flight simulation has been almost exclusively concerned with simulating the motions of the aircraft. Physically distinct subsystems are often combined to simulate the varieties of aircraft motion. Visual display systems simulate the motion of the aircraft relative to remote objects and surfaces (e.g., other aircraft and the terrain). 'Motion platform' simulators recreate aircraft motion relative to the gravitoinertial vector (i.e., correlated rotation and tilt as opposed to the 'coordinated turn' in flight). 'Control loaders' attempt to simulate the resistance of the aerodynamic medium to aircraft motion. However, there are few operational systems that attempt to simulate the motion of the pilot relative to the aircraft and the gravitoinertial vector. The design and use of all simulators is limited by poor understanding of postural control in the aircraft and its effect on the perception and control of flight. Analysis of the perception and control of flight (real or simulated) must consider that: (1) the pilot is not rigidly attached to the aircraft; and (2) the pilot actively monitors and adjusts body orientation and configuration in the aircraft. It is argued that this more complete approach to flight simulation requires that multimodal perception be considered as the rule rather than the exception. Moreover, the necessity of multimodal perception is revealed by emphasizing the complementarity rather than the redundancy among perceptual systems. Finally, an outline is presented for an experiment to be conducted at NASA ARC. The experiment explicitly considers possible consequences of coordination between postural and vehicular control.

Riccio, Gary E.↗
NASA NTRS1972

Visual light flash phenomenon, part C

The Apollo 16 mission provided the opportunity to obtain additional data on the characteristics and frequency of the light flashes and also provided the first opportunity to obtain a direct physical record of incident cosmic ray particles with the Apollo light flash moving emulsion detector (ALFMED). The ALFMED is an electromechanical device that is worn on the head like a helmet and supports cosmic radiation-sensitive emulsions around the head of the test subject. Two light flash observation sessions were conducted during the mission: one during translunar coast and the second during transearth coast. Characteristics of the light flashes observed and reported by the Apollo crew members were generally similar to those reported on previous missions. Analyses of the ALFMED emulsion plates are proceeding as scheduled, although results are not yet available. The ALFMED results should provide conclusive evidence establishing the correlation, if any, between the incident cosmic ray particles and the perception of light flashes as reported by Apollo crew members.

Richard E. Benson↗
NASA NTRS1995

Human Performance Issues of Lunar-Sited Teleoperations

Teleoperations in terrestrial environments present a number of challenges to system operators and designers. Transmission lags, restricted visual fields, and reduced or distorted tactile/kinesthetic feedback can compromise performance, especially for innerloop control tasks (e.g., vehicle or manipulator control). These problems are likely to be exacerbated in lunar operations, since teleoperation may occur across large distances. Further, the lunar environment will introduce unique concerns. For example, the teleoperated systems will reflect the reduced gravity of the moon. In addition to the novelty of these dynamics, operators will often have to cope with them while physically located in a terrestrial or microgravity environment. Similarly, the optical characteristics of the lunar environment differ from our usual experience (e.g., lack of atmospheric attenuation) in ways that may impact normative depth, distance, and motion perception. These human factors issues are related to the question of humans adapting to a lunar environment. However, teleoperations requires the operator to maintain functionality in both the control station and end-effector environments, defeating more straightforward environmental adaptation strategies.

Kaiser, Mary K.↗
NASA NTRS1991

Percepts of rigid motion within and across apertures

Humans consistently err in their percepts of rotational motion viewed through an aperture. Such errors provide insight into the constraints observers use to interpret retinal images. In the first of two experiments, Ss consistently perceived the fixed center of rotation for an unmarked line viewed through an aperture as located on the line, regardless of its actual location. Accuracy greatly improved with visible line endings. This finding was extended to explain why a square appears nonrigid when it rotates behind a partial occluder. This illusion may result from observers misperceiving the center of rotation of the unmarked square sides. In this situation, Ss seemed unable to apply an object rigidity constraint across apertures. These findings support a conceptualization of the visual system in which consistent local information must be clearly present before prior knowledge can be used to interpret retinal stimulation.

Shiffrar, Maggie↗