Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VISUAL STIMULI”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Instrument scan - Is it an indicator of the pilot's workload

Results of an investigation of the relationship between an aircraft pilot's visual scanning of instruments and the level of mental activity during a simulated approach and landing are presented. Noting that periods of activity which demand either close to 100% of human capacity or low levels of capacity are the times when most errors are committed, trials were conducted with three NASA test pilots in a terminal configured vehicle simulator. The pilots flew a normal approach while verbally responding to three digit stimuli to be judged plus or minus according to an order of magnitude scheme, and also while using a control stick to extinguish a light that came on and off to the right and left of the instrument panel. Eyescans of the instrumentation were monitored, and determinations were made of the most common instruments used during approach and flare. Fixation on instruments was found to increase with the arithmetic tasks.

Ephrath, A. R.↗

Tutorial on the Psychophysics and Technology of Virtual Acoustic Displays

Virtual acoustics, also known as 3-D sound and auralization, is the simulation of the complex acoustic field experienced by a listener within an environment. Going beyond the simple intensity panning of normal stereo techniques, the goal is to process sounds so that they appear to come from particular locations in three-dimensional space. Although loudspeaker systems are being developed, most of the recent work focuses on using headphones for playback and is the outgrowth of earlier analog techniques. For example, in binaural recording, the sound of an orchestra playing classical music is recorded through small mics in the two "ear canals" of an anthropomorphic artificial or "dummy" head placed in the audience of a concert hall. When the recorded piece is played back over headphones, the listener passively experiences the illusion of hearing the violins on the left and the cellos on the right, along with all the associated echoes, resonances, and ambience of the original environment. Current techniques use digital signal processing to synthesize the acoustical properties that people use to localize a sound source in space. Thus, they provide the flexibility of a kind of digital dummy head, allowing a more active experience in which a listener can both design and move around or interact with a simulated acoustic environment in real time. Such simulations are being developed for a variety of application areas including architectural acoustics, advanced human-computer interfaces, telepresence and virtual reality, navigation aids for the visually-impaired, and as a test bed for psychoacoustical investigations of complex spatial cues. The tutorial will review the basic psychoacoustical cues that determine human sound localization and the techniques used to measure these cues as Head-Related Transfer Functions (HRTFs) for the purpose of synthesizing virtual acoustic environments. The only conclusive test of the adequacy of such simulations is an operational one in which the localization of real and synthesized stimuli are directly compared in psychophysical studies. To this end, the results of psychophysical experiments examining the perceptual validity of the synthesis technique will be reviewed and factors that can enhance perceptual accuracy and realism will be discussed. Of particular interest is the relationship between individual differences in HRTFs and in behavior, the role of reverberant cues in reducing the perceptual errors observed with virtual sound sources, and the importance of developing perceptually valid methods of simplifying the synthesis technique. Recent attempts to implement the synthesis technique in real time systems will also be discussed and an attempt made to interpret their quoted system specifications in terms of perceptual performance. Finally, some critical research and technology development issues for the future will be outlined.

Wenzel, Elizabeth M.↗

Dynamic posture analysis of Spacelab-1 crew members

Dynamic posture testing was conducted on the science crew of the Spacelab-1 mission on a single axis linear motion platform. Tests took place in pre- and post-flight sessions lasting approximately 20 min each. The pre-flight tests were widely spaced over the several months prior to the mission while the post-flight tests were conducted over the first, second, fourth, and sixth days after landing. Two of the crew members were also tested on the day of landing. Consistent with previous postural testing conducted on flight crews, these crew members were able to complete simple postural tasks to an acceptable level even in the first few hours after landing. Our tests were designed to induce dynamic postural responses using a variety of stimuli and from these responses, evaluate subtle changes in the postural control system which had occurred over the duration of the flight. Periodic sampling post-flight allowed us to observe the time course of readaptation to terrestrial life. Our observations of hip and shoulder position, when subjected to careful analysis, indicated modification of the postural response from pre- to post-flight and that demonstrable adjustments in the dynamic control of their postural systems were taking place in the first few days after flight. For transient stimuli where the platform on which they were asked to stand quickly moved a few centimeters fore or aft then stopped, ballistic or open loop 'programs' would closely characterize the response. During these responses the desired target position was not always achieved and of equal importance not always properly corrected some 15 seconds after the platform ceased to move. The persistent observation was that the subjects had a much stronger dependence on visual stabilization post-flight than pre-flight. This was best illustrated by a slow or only partial recovery to an upward posture after a transient base-of-support movement with eyes open. Postural responses to persistent wideband pseudorandom base-of-support translation were modeled as time invarient linear systems arrived at by Kalman adaptive filter techniques. Derived model parameters such as damping factor and fundamental frequency of the closed loop system showed significant modification between pre- and post-flight. This phenomenon is best characterized by movement of the poles toward increasing stability. While pre-flight data tended to show shoulders and hips moving in phase with each other, post-flight data showed a more disjoint behavior.(ABSTRACT TRUNCATED AT 400 WORDS).

Non-NASA Center↗

Motion coherence affects human perception and pursuit similarly

Pursuit and perception both require accurate information about the motion of objects. Recovering the motion of objects by integrating the motion of their components is a difficult visual task. Successful integration produces coherent global object motion, while a failure to integrate leaves the incoherent local motions of the components unlinked. We compared the ability of perception and pursuit to perform motion integration by measuring direction judgments and the concomitant eye-movement responses to line-figure parallelograms moving behind stationary rectangular apertures. The apertures were constructed such that only the line segments corresponding to the parallelogram's sides were visible; thus, recovering global motion required the integration of the local segment motion. We investigated several potential motion-integration rules by using stimuli with different object, vector-average, and line-segment terminator-motion directions. We used an oculometric decision rule to directly compare direction discrimination for pursuit and perception. For visible apertures, the percept was a coherent object, and both the pursuit and perceptual performance were close to the object-motion prediction. For invisible apertures, the percept was incoherently moving segments, and both the pursuit and perceptual performance were close to the terminator-motion prediction. Furthermore, both psychometric and oculometric direction thresholds were much higher for invisible apertures than for visible apertures. We constructed a model in which both perception and pursuit are driven by a shared motion-processing stage, with perception having an additional input from an independent static-processing stage. Model simulations were consistent with our perceptual and oculomotor data. Based on these results, we propose the use of pursuit as an objective and continuous measure of perceptual coherence. Our results support the view that pursuit and perception share a common motion-integration stage, perhaps within areas MT or MST.

NASA Center ARC↗

Extracting Depth From Motion Parallax in Real-World and Synthetic Displays

In psychophysical studies on human sensitivity to visual motion parallax (MP), the use of computer displays is pervasive. However, a number of potential problems are associated with such displays: cue conflicts arise when observers accommodate to the screen surface, and observer head and body movements are often not reflected in the displays. We investigated observers' sensitivity to depth information in MP (slant, depth order, relative depth) using various real-world displays and their computer-generated analogs. Angle judgments of real-world stimuli were consistently superior to judgments that were based on computer-generated stimuli. Similar results were found for perceived depth order and relative depth. Perceptual competence of observers tends to be underestimated in research that is based on computer generated displays. Such findings cannot be generalized to more realistic viewing situations.

Hecht, Heiko↗

Head-eye tracking in two-dimensional pursuit tasks

The neurological control systems for the eye and head are studied by investigating dynamic eye and head rotations in two degrees of freedom using bandlimited, white noise stimuli, nominally wide field of view stimulus presentations of + or - 10 deg and power spectral analysis of the data to produce input/output transfer and coherence functions. Determined were frequency response characteristics of these systems, the linearity of the transfer functions in both coupled and decoupled vertical and horizontal stimulus/response reference axes and the amount of cross axis coupling present in system responses. A comparative study was also conducted to assess the differences in response characteristics between single axis and dual axis visual stimulation for the same subject.

Shirachi, D. K.↗

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗

Reactions of Air Transport Flight Crews to Displays of Weather During Simulated Flight

Display of information in the cockpit has long been a challenge for aircraft designers. Given the limited space in which to present information, designers have had to be extremely selective about the types and amount of flight related information to present to pilots. The general goal of cockpit display design and implementation is to ensure that displays present information that is timely, useful, and helpful. This suggests that displays should facilitate the management of perceived workload, and should allow maximal situation awareness. The formatting of current and projected weather displays represents a unique challenge. As technologies have been developed to increase the variety and capabilities of weather information available to flight crews, factors such as conflicting weather representations and increased decision importance have increased the likelihood for errors. However, if formatted optimally, it is possible that next generation weather displays could allow for clearer indications of weather trends such as developing or decaying weather patterns. Important issues to address include the integration of weather information sources, flight crew trust of displayed weather information, and the teamed reactivity of flight crews to displays of weather. Past studies of weather display reactivity and formatting have not adequately addressed these issues; in part because experimental stimuli have not approximated the complexity of modern weather displays, and in part because they have not used realistic experimental tasks or participants. The goal of the research reported here was to investigate the influence of onboard and NEXRAD agreement, range to the simulated potential weather event, and the pilot flying on flight crew deviation decisions, perceived workload, and perceived situation awareness. Fifteen pilot-copilot teams were required to fly a simulated route while reacting to weather events presented in two graphical formats on a separate visual display. Measures of flight crew reactions included performance-based measures such as deviation decision accuracy, and judgment-based measures such as perceived decision confidence, workload, situation awareness, and display trust. Results demonstrated that pilots adopted a conservative reaction strategy, often choosing to deviate from weather rather than ride through it. When onboard and NEXRAD displays did not agree, flight crews reacted in a complex manner, trusting the onboard system more but using the NEXRAD system to augment their situation awareness. Distance to weather reduced situation awareness and heightened workload levels. Overall, flight crews tended to adopt a participative leadership style marked by open communication. These results suggest that future weather displays should exploit the existing benefits of NEXRAD presentation for situation awareness while retaining the display structure and logic inherent in the onboard system.

Bliss, James P.↗

The relationship between perceived length and egocentric location in Muller-Lyer figures with one versus two chevrons

We examined the apparent dissociation of perceived length and perceived position with respect to the Muller-Lyer (M-L) illusion. With the traditional (two-chevron) figure, participants made accurate open-loop pointing responses at the endpoints of the shaft, despite the presence of a strong length illusion. This apparently non-Euclidean outcome replicated that of Mack, Heuer, Villardi, and Chambers (1985) and Gillam and Chambers (1985) and contradicts any theory of the M-L illusion in which mislocalization of shaft endpoints plays a role. However, when one of the chevrons was removed, a constant pointing error occurred in the predicted direction, as well as a strong length illusion. Thus, with one-chevron stimuli, perceived length and location were no longer completely dissociated. We speculated that the presence of two opposing chevrons suppresses the mislocalizing effects of a single chevron, especially for figures with relatively short shafts.

NASA Center ARC↗

Differentially Variable Component Analysis (dVCA): Identifying Multiple Evoked Components using Trial-to-Trial Variability

Electric potentials and magnetic fields generated by ensembles of synchronously active neurons in response to external stimuli provide information essential to understanding the processes underlying cognitive and sensorimotor activity. Interpreting recordings of these potentials and fields is difficult as each detector records signals simultaneously generated by various regions throughout the brain. We introduce the differentially Variable Component Analysis (dVCA) algorithm, which relies on trial-to-trial variability in response amplitude and latency to identify multiple components. Using simulations we evaluate the importance of response variability to component identification, the robustness of dVCA to noise, and its ability to characterize single-trial data. Finally, we evaluate the technique using visually evoked field potentials recorded at incremental depths across the layers of cortical area VI, in an awake, behaving macaque monkey.

Knuth, Kevin H.↗

Evaluation of image quality

This presentation outlines in viewgraph format a general approach to the evaluation of display system quality for aviation applications. This approach is based on the assumption that it is possible to develop a model of the display which captures most of the significant properties of the display. The display characteristics should include spatial and temporal resolution, intensity quantizing effects, spatial sampling, delays, etc. The model must be sufficiently well specified to permit generation of stimuli that simulate the output of the display system. The first step in the evaluation of display quality is an analysis of the tasks to be performed using the display. Thus, for example, if a display is used by a pilot during a final approach, the aesthetic aspects of the display may be less relevant than its dynamic characteristics. The opposite task requirements may apply to imaging systems used for displaying navigation charts. Thus, display quality is defined with regard to one or more tasks. Given a set of relevant tasks, there are many ways to approach display evaluation. The range of evaluation approaches includes visual inspection, rapid evaluation, part-task simulation, and full mission simulation. The work described is focused on two complementary approaches to rapid evaluation. The first approach is based on a model of the human visual system. A model of the human visual system is used to predict the performance of the selected tasks. The model-based evaluation approach permits very rapid and inexpensive evaluation of various design decisions. The second rapid evaluation approach employs specifically designed critical tests that embody many important characteristics of actual tasks. These are used in situations where a validated model is not available. These rapid evaluation tests are being implemented in a workstation environment.

Pavel, M.↗

Expansion of direction space around the cardinal axes revealed by smooth pursuit eye movements

It is well established that perceptual direction discrimination shows an oblique effect; thresholds are higher for motion along diagonal directions than for motion along cardinal directions. Here, we compare simultaneous direction judgments and pursuit responses for the same motion stimuli and find that both pursuit and perceptual thresholds show similar anisotropies. The pursuit oblique effect is robust under a wide range of experimental manipulations, being largely resistant to changes in trajectory (radial versus tangential motion), speed (10 versus 25 deg/s), directional uncertainty (blocked versus randomly interleaved), and cognitive state (tracking alone versus concurrent tracking and perceptual tasks). Our data show that the pursuit oblique effect is caused by an effective expansion of direction space surrounding the cardinal directions and the requisite compression of space for other directions. This expansion suggests that the directions around the cardinal directions are in some way overrepresented in the visual cortical pathways that drive both smooth pursuit and perception.

Visual Pathways/physiology↗

Virtual acoustic displays

A 3D auditory display can potentially enhance information transfer by combining directional and iconic information in a quite naturalistic representation of dynamic objects in the interface. Another aspect of auditory spatial clues is that, in conjunction with other modalities, it can act as a potentiator of information in the display. For example, visual and auditory cues together can reinforce the information content of the display and provide a greater sense of presence or realism in a manner not readily achievable by either modality alone. This phenomenon will be particularly useful in telepresence applications, such as advanced teleconferencing environments, shared electronic workspaces, and monitoring telerobotic activities in remote or hazardous situations. Thus, the combination of direct spatial cues with good principles of iconic design could provide an extremely powerful and information-rich display which is also quite easy to use. An alternative approach, recently developed at ARC, generates externalized, 3D sound cues over headphones in realtime using digital signal processing. Here, the synthesis technique involves the digital generation of stimuli using Head-Related Transfer Functions (HRTF's) measured in the two ear-canals of individual subjects. Other similar approaches include an analog system developed by Loomis, et. al., (1990) and digital systems which make use of transforms derived from normative mannikins and simulations of room acoustics. Such an interface also requires the careful psychophysical evaluation of listener's ability to accurately localize the virtual or synthetic sound sources. From an applied standpoint, measurement of each potential listener's HRTF's may not be possible in practice. For experienced listeners, localization performance was only slightly degraded compared to a subject's inherent ability. Alternatively, even inexperienced listeners may be able to adapt to a particular set of HRTF's as long as they provide adequate cues for localization. In general, these data suggest that most listeners can obtain useful directional information from an auditory display without requiring the use of individually-tailored HRTF's.

Wenzel, Elizabeth M.↗

Spatial Orientation and Balance Control Changes Induced by Altered Gravito-Inertial Force Vectors

Seventeen healthy and eight vestibular deficient subjects were exposed to an interaural centripetal acceleration of 1 G (resultant 45 deg roll tilt of 1.4 G) on a 0.8 meter radius centrifuge for a period of 90 minutes in the dark. The subjects sat with head fixed upright, except every 4 of 10 minutes when instructed to rotate their head so that their nose and eyes pointed towards a visual point switched on every 3 to 5 seconds at random places (within +/- 30 deg) in the Earth horizontal plane. Motion sickness caused some subjects to limit their head movements during significant portions of the 90 minute period, and led three normal subjects to stop the test earlier. Eye movements, including directed saccades for subjective Earth- and head-referenced planes, were recorded before, during, and immediately after centrifugation using electro-oculography. Postural stability measurements were made before and within ten minutes after centrifugation. In normal subjects, postural sway and multisegment body kinematics were gathered during an eyes-closed head movement cadence (sway-referenced support platform), and in response to translational/rotational platform perturbations. A significant increase in postural sway, segmental motion amplitude and hip frequency was observed after centrifugation. This effect was short-lived, with a recovery time of several postural test trials. There were also asymmetries in the direction of post-centrifugation center of sway and head tilt which depended on the subject's orientation during the centrifugation adaptation period (left ear or right ear out). To delineate the effect of the magnitude of the gravito-inertial vector versus its direction during the adaptive centrifugation period, we tilted eight normal subjects in the roll axis at a 45 deg angle in the dark for 90 minutes without rotational motion. Their postural responses did not change following the period of tilt. Based on verbal reports, normal subjects overestimated roll-tilt during 90 minutes of both tilt and centrifugation stimuli. Subjective estimates of head-horizontal, provided by directed saccades, revealed significant errors after approximately 30 minutes that tended to increase only in the group who underwent centrifugation. Immediately after centrifugation, subjects reported feeling tilted on average 10 degrees in the opposite direction, which was in agreement with the direction of their earth-directed saccades. In vestibular deficient (VD) subjects, postural sway was measured using a sway-referenced or earth-fixed support surface, and with or without a head movement sequence. 'Me protocol was selected for each patient during baseline testing, and corresponded to the most challenging condition in which the patient was able to maintain balance with eyes closed. Bilaterally VD subjects showed no postural decrement after centrifugation, while unilateral VD subjects had varying degrees of decrement. Unilateral VD subjects were tested twice; they underwent centrifugation both with right ear out and left ear out. Their post-centrifuation center of sway shifted at right angles depending on the centrifuge GIF orientation. Bilateral VD subjects bad shifts as well, but no consistent directional trend. VD subjects underestimated roll-tilt during centrifugation, These results suggest that orientation of the gravito-inertial vector and its magnitude arc both used by the central nervous system for calibration of multiple orientation systems. A change in the background gravito-inertial force (otolith input) can rapidly initiate postural and perceptual adaptation in several sensorimotor systems, independent of a structured visual surround.

Kaufman, Galen D.↗

Neural activation during response competition

The flanker task, introduced by Eriksen and Eriksen [Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & Psychophysics, 16, 143--149], provides a means to selectively manipulate the presence or absence of response competition while keeping other task demands constant. We measured brain activity using functional magnetic resonance imaging (fMRI) during performance of the flanker task. In accordance with previous behavioral studies, trials in which the flanking stimuli indicated a different response than the central stimulus were performed significantly more slowly than trials in which all the stimuli indicated the same response. This reaction time effect was accompanied by increases in activity in four regions: the right ventrolateral prefrontal cortex, the supplementary motor area, the left superior parietal lobe, and the left anterior parietal cortex. The increases were not due to changes in stimulus complexity or the need to overcome previously learned associations between stimuli and responses. Correspondences between this study and other experiments manipulating response interference suggest that the frontal foci may be related to response inhibition processes whereas the posterior foci may be related to the activation of representations of the inappropriate responses.

Brain Mapping/methods↗

Assessing Visual Delays using Pupil Oscillations

Stark (1962) demonstrated vigorous pupil oscillations by illuminating the retina with a beam of light focussed to a small spot near the edge of the pupil. Small constrictions of the pupil then are sufficient to completely block the beam, amplifying the normal relationship between pupil area and retinal illuminance. In addition to this simple and elegant method, Stark also investigated more complex feedback systems using an electronic "clamping box" which provided arbitrary gain and phase delay between a measurement of pupil area and an electronically controlled light source. We have replicated Stark's results using a video-based pupillometer to control the luminance of a display monitor. Pupil oscillations were induced by imposing a linear relationship between pupil area and display luminance, with a variable delay. Slopes of the period-vs-delay function for 3 subjects are close to the predicted value of 2 (1.96-2.39), and the implied delays range from 254 to 376 508 to 652 milliseconds. Our setup allows us to extend Stark's work by investigating a broader class of stimuli.

Mulligan, Jeffrey B.↗

Dynamic properties of the human vestibulo-ocular reflex during head rotations in roll

We investigated the dynamic properties of the human vestibulo-ocular reflex (VOR) during roll head rotations in three human subjects using the magnetic search coil technique. In the first of two experiments, we quantify the behavior of the ocular motor plant in the torsional plane. The subject's eye was mechanically displaced into intorsion, extorsion or abduction, and the dynamic course of return of the eye to its resting position was measured. The mean predominant time constants of return were 210 msec from intorsion, 83 msec from extorsion, and 217 msec from abduction, although there was considerable variability of results from different trials and subjects. In the second experiment, we quantify the efficacy of velocity-to-position integration of the vestibular signal. Position-step stimuli were used to test the torsional or horizontal VOR, being applied with subjects heads erect or supine. After a torsional position-step, the eye drifted back to its resting position, but after a horizontal position-step the eye held its new horizontal position. To interpret these responses we used a simple model of the VOR with parameters of the ocular motor plant set to values determined during Exp 1. The time constant of the velocity-to-position neural integrator was smaller (typically 2 sec) in the torsional plane than in the horizontal plane (> 20 sec). No disconjugacy of torsional eye movements was observed. Thus, the dynamic properties of the VOR in roll differ significantly from those of the VOR in yaw, reflecting different visual demands placed on this reflex in these two planes.

NASA Discipline Neuroscience↗

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.

Zheng, Weijian↗