Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual perception”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Neurophysiology Summary

The terrestrial gravitational field serves as an important orientation reference for human perception and movement, being continually monitored by sensory receptors in the skin, muscles, joints, and vestibular otolith organs. Cues from these graviceptors are used by the brain to estimate spatial orientation and to control balance and movement. Changes in these cues associated with the tonic changes in gravity (gravito-inertial force),during the launch and entry phases of space flight missions result in altered perceptions, degraded motor control performance, and in some cases, "motion" sickness during, and for a period of time after, the g-transitions. In response to these transitions, however, physiological and behavioral response mechanisms are triggered to compensate for altered graviceptor cues and/or to adapt to the new sensory environment. Basic research in the neurophysiology discipline is focused on understanding the characteristic features of and the underlying mechanisms for the normal human response to tonic changes in the gravito-inertial force environment. These studies address fundamental questions regarding the role of graviceptors in orientation and movement in the terrestrial environment, as well as the capacity, specificity, and modes for neural plasticity in the sensory-motor and perceptual systems of the brain. At the 2001 workshop basic research studies were presented addressing: neuroanatomical responses to altered gravity environments, the neural mechanisms for resolving the ambiguity between tilting and translational stimuli in otolith organ sensory input, interactions between the vestibular system and the autonomic nervous system , the roles of haptic and visual cues in spatial orientation, mechanisms for training environment-appropriate sensorimotor responses triggered by environment-specific context cues, and studies of sensori-motor control of posture and locomotion in the terrestrial environment with and without recent exposure to space flight. Building on these basic research studies are more applied studies focused on the development of countermeasures to the untoward neurophysiological responses to space flight. At the 2001 workshop, applied research studies were presented addressing issues related to the use of rotational artificial gravity (centripetal acceleration) as a multisystem (bone, muscle, cardiovascular, and, perhaps, neurovestibular) countermeasure. Also presented was a clinical study reporting on a new rating system for clinical evaluation of postflight functional neurological status.

Paloski, William H.↗

Effect of contrast on human speed perception

This study is part of an ongoing collaborative research effort between the Life Science and Human Factors Divisions at NASA ARC to measure the accuracy of human motion perception in order to predict potential errors in human perception/performance and to facilitate the design of display systems that minimize the effects of such deficits. The study describes how contrast manipulations can produce significant errors in human speed perception. Specifically, when two simultaneously presented parallel gratings are moving at the same speed within stationary windows, the lower-contrast grating appears to move more slowly. This contrast-induced misperception of relative speed is evident across a wide range of contrasts (2.5-50 percent) and does not appear to saturate (e.g., a 50 percent contrast grating appears slower than a 70 percent contrast grating moving at the same speed). The misperception is large: a 70 percent contrast grating must, on average, be slowed by 35 percent to match a 10 percent contrast grating moving at 2 deg/sec (N = 6). Furthermore, it is largely independent of the absolute contrast level and is a quasilinear function of log contrast ratio. A preliminary parametric study shows that, although spatial frequency has little effect, the relative orientation of the two gratings is important. Finally, the effect depends on the temporal presentation of the stimuli: the effects of contrast on perceived speed appears lessened when the stimuli to be matched are presented sequentially. These data constrain both physiological models of visual cortex and models of human performance. We conclude that viewing conditions that effect contrast, such as fog, may cause significant errors in speed judgments.

Stone, Leland S.↗

Shuttle Topography Data Inform Solar Power Analysis

The next time you flip on a light switch, there s a chance that you could be benefitting from data originally acquired during the Space Shuttle Program. An effort spearheaded by Jet Propulsion Laboratory (JPL) and the National Geospatial-Intelligence Agency (NGA) in 2000 put together the first near-global elevation map of the Earth ever assembled, which has found use in everything from 3D terrain maps to models that inform solar power production. For the project, called the Shuttle Radar Topography Mission (SRTM), engineers at JPL designed a 60-meter mast that was fitted onto Shuttle Endeavour. Once deployed in space, an antenna attached to the end of the mast worked in combination with another antenna on the shuttle to simultaneously collect data from two perspectives. Just as having two eyes makes depth perception possible, the SRTM data sets could be combined to form an accurate picture of the Earth s surface elevations, the first hight-detail, near-global elevation map ever assembled. What made SRTM unique was not just its surface mapping capabilities but the completeness of the data it acquired. Over the course of 11 days, the shuttle orbited the Earth nearly 180 times, covering everything between the 60deg north and 54deg south latitudes, or roughly 80 percent of the world s total landmass. Of that targeted land area, 95 percent was mapped at least twice, and 24 percent was mapped at least four times. Following several years of processing, NASA released the data to the public in partnership with NGA. Robert Crippen, a member of the SRTM science team, says that the data have proven useful in a variety of fields. "Satellites have produced vast amounts of remote sensing data, which over the years have been mostly two-dimensional. But the Earth s surface is three-dimensional. Detailed topographic data give us the means to visualize and analyze remote sensing data in their natural three-dimensional structure, facilitating a greater understanding of the features and processes taking place on Earth."

Source record↗

LIPA: Lunar Ice Perception Algorithm

Introduction: The highest concentration of Lu-nar water-ice stores exists within the Permanently Shadowed Regions (PSRs) of the Lunar South Pole [1-3]. As such, the ability to locate in situ water-ice stores in an accurate, systematic, and safe manner will prove vital for future Lunar activities which rely on hydrogen-based resources. Here we show how the strong absorptive properties of ice can be exploited so that surface ice located in PSRs can be easily differentiated from the surrounding frozen regolith. Testbeds which simulate an icy lunar landscape were created and then systematically imaged using a mid-wave infrared (MWIR) camera system. Testbeds were imaged under two filter modes (1) high-absorption (high-abs) mode: whereby imagery captured were confined to a single central wave-length (CWL) of 3.15 ± 0.03 μm and (2) low-absorption (low-abs) mode: whereby imagery cap-tured were confined to a single CWL of 3.80 ± 0.04 μm (Figure 1). High- and low-absorption modes are related to the absorptive properties of ice at each selected wavelength, respectively. Corresponding images from each filter mode were differenced (i.e., pixels were subtracted) to enhance contrast between ice-bearing and non-ice-bearing pixels, and then fed into a semantic segmen-tation model. The model was trained to detect and differentiate between water, ice, shadows, and lunar regolith. Results: Modeling results accurately discrimi-nated ice from other materials (such as frozen lunar regolith) and were used to visually resolve the spa-tial extent of surface ice. Further, outputs produced through semantic segmentation were used to estimate water-ice contents in collected imagery [(Pixels with Class = “Water Ice”)/(Sum of Pixels)*100]. Summary: These works prove promising for future in situ resource utilization (ISRU) missions which employ robotics in combination with infrared camera systems to advance science objectives (e.g., locate water-ice in frozen regolith) on the lunar sur-face. References: [1] Cannon K. M., Deutsch A. N., Head J. W., and Britt D. T. (2020) Geophysical Re-search Letters, 46, e2020GL088920. [2] Honniball C. I. et al. (2021) Nature Astronomy 5, no. 2, 121-127. [3] Li S. et al. (2018) Proceedings of the National Academy of Sciences, 115(36), 8907-8912.

A. Slabic↗

Improving Sensorimotor Function and Adaptation using Stochastic Vestibular Stimulation

Astronauts experience sensorimotor changes during adaption to G-transitions that occur when entering and exiting microgravity. Post space flight, these sensorimotor disturbances can include postural and gait instability, visual performance changes, manual control disruptions, spatial disorientation, and motion sickness, all of which can hinder the operational capabilities of the astronauts. Crewmember safety would be significantly increased if sensorimotor changes brought on by gravitational changes could be mitigated and adaptation could be facilitated. The goal of this research is to investigate and develop the use of electrical stochastic vestibular stimulation (SVS) as a countermeasure to augment sensorimotor function and facilitate adaptation. For this project, SVS will be applied via electrodes on the mastoid processes at imperceptible amplitude levels. We hypothesize that SVS will improve sensorimotor performance through the phenomena of stochastic resonance, which occurs when the response of a nonlinear system to a weak input signal is optimized by the application of a particular nonzero level of noise. In line with the theory of stochastic resonance, a specific optimal level of SVS will be found and tested for each subject [1]. Three experiments are planned to investigate the use of SVS in sensory-dependent tasks and performance. The first experiment will aim to demonstrate stochastic resonance in the vestibular system through perception based motion recognition thresholds obtained using a 6-degree of freedom Stewart platform in the Jenks Vestibular Laboratory at Massachusetts Eye and Ear Infirmary. A range of SVS amplitudes will be applied to each subject and the subjectspecific optimal SVS level will be identified as that which results in the lowest motion recognition threshold, through previously established, well developed methods [2,3,4]. The second experiment will investigate the use of optimal SVS in facilitating sensorimotor adaptation to system disturbances. Subjects will adapt to wearing minifying glasses, resulting in decreased vestibular ocular reflex (VOR) gain. The VOR gain will then be intermittently measured while the subject readapts to normal vision, with and without optimal SVS. We expect that optimal SVS will cause a steepening of the adaptation curve. The third experiment will test the use of optimal SVS in an operationally relevant aerospace task, using the tilt translation sled at NASA Johnson Space Center, a test platform capable of recreating the tilt-gain and tilt-translation illusions associated with landing of a spacecraft post-space flight. In this experiment, a perception based manual control measure will be used to compare performance with and without optimal SVS. We expect performance to improve in this task when optimal SVS is applied. The ultimate goal of this work is to systematically investigate and further understand the potential benefits of stochastic vestibular stimulation in the context of human space flight so that it may be used in the future as a component of a comprehensive countermeasure plan for adaptation to G-transitions.

Galvan, R. C.↗

Low-Frequency Otolith Function in Microgravity: A Re-Evaluation of the Otolith Tilt-Translation Reinterpretation (OTTR) Hypothesis

On Earth, the low-frequency afferent signal from the otoliths encodes head tilt with respect to the gravitational vertical, and the higher frequency components reflect both tilt and linear acceleration of the head. In microgravity, static tilt of the head does not influence otolith output, and the relationship between sensory input from the vestibular organs, and the visual, proprioceptive and somatosensory systems, would be disrupted. Several researchers have proposed that in 0-g this conflict may induce a reinterpretation of all otolith signals by the brain to encode only linear translation (otolith tilt-translation reinterpretation or OTTR). Ocular counter-rolling (OCR) is a low-frequency otolith-mediated reflex, which generates compensatory torsional eye movements (rotation about the visual axis) towards the spatial vertical during static roll tilt with a gain of approximately 10%. Transient linear acceleration and off-axis centrifugation at a constant angular velocity can also generate OCR. According to the OTTR hypothesis, OCR should be reduced in microgravity, and immediately upon return from a 0-g environment. Results to date have been inconclusive. OCR was reduced following the 10 day Spacelab-1 mission in response to leftward roll tilts (28-56% in 3 subjects and unchanged in one subject), and sinusoidal linear oscillations at 0.4 and 0.8 Hz. OCR gain declined 70% in four monkeys following a 14 day COSMOS mission. Following a 30 day MIR mission OCR gain decreased in one astronaut, but increased in two others following a 180 day mission. We have studied the affect of microgravity on low-frequency otolith function as part of a larger study of the interaction of vision and the vestibular system. This experiment (E-047) involved off-axis centrifugation of payload crewmembers and flew aboard the recent Neurolab mission (STS 90). Presented below are preliminary results focusing on perception and the OCR response during both centrifugation and static tilt.

Moore, Steven T.↗

Repetition blindness has a perceptual locus: evidence from online processing of targets in RSVP streams

Four experiments tested whether repetition blindness (RB; reduced accuracy reporting repetitions of briefly displayed items) is a perceptual or a memory-recall phenomenon. RB was measured in rapid serial visual presentation (RSVP) streams, with the task altered to reduce memory demands. In Experiment 1 only the number of targets (1 vs. 2) was reported, eliminating the need to remember target identities. Experiment 2 segregated repeated and nonrepeated targets into separate blocks to reduce bias against repeated targets. Experiments 3 and 4 required immediate "online" buttonpress responses to targets as they occurred. All 4 experiments showed very strong RB. Furthermore, the online response data showed clearly that the 2nd of the repeated targets is the one missed. The present results show that in the RSVP paradigm, RB occurs online during initial stimulus encoding and decision making. The authors argue that RB is indeed a perceptual phenomenon.

Form Perception↗

Mining the Gravity Mutants of Arabidopsis

Gravity mutants are a valuable resource for understanding gravity perception, signaling, and response in plants. A review of 190 publications resulted in a list of 97 loci with mutations that caused a gravitropic phenotype. While all these mutants show some form of gravity phenotype, several are also generally defective in growth. After removing these nonspecific mutants, 76 loci were deemed to have true gravity mutants. The gene list was then used to create a sortable database containing key factors of gravity signaling as well as data on methodologies and the development of mutant lines. Indexing this database has allowed us to pull out trends that were not visible in individual publications. For example, mutants that are unable to rearrange starch statoliths make up a larger proportion of the described inflorescence stems mutants than any other organ. Comparing these statolith mutants across organs shows that root and inflorescence stems consistently display different phenotypes for the same class of defect. The more severe gravity defects are most commonly described in root tissue while other tissues are more likely to show only a delayed or reduced response to gravity. The experience of members of the GeneLab plant Analytics Working Group (AWG) in data visualization and gene mapping have sparked new ideas for utilizing this database. Knowledge of shared traits, mutant development, and growth can provide a new resource for the production of seed lines specialized for their response to gravity.

gravitropism↗

Word-identification priming for ignored and attended words

Three experiments examined contributions of study phase awareness of word identity to subsequent word-identification priming by manipulating visual attention to words at study. In Experiment 1, word-identification priming was reduced for ignored relative to attended words, even though ignored words were identified sufficiently to produce negative priming in the study phase. Word-identification priming was also reduced after color naming relative to emotional valence rating (Experiment 2) or word reading (Experiment 3), even though an effect of emotional valence upon color naming (Experiment 2) indicated that words were identified at study. Thus, word-identification priming was reduced even when word identification occurred at study. Word-identification priming may depend on awareness of word identity at the time of study.

Mental Recall↗

Visual-Motion Cueing in Altitude and Yaw Control

Research conducted using the Vertical Motion Simulator at the NASA Ames Research Center examined the contributions of platform motion and visual level-of-detail (LOD) cueing to tasks that required altitude and/or yaw control in a simulated AH-64 Apache helicopter. Within the altitude control tasks the LOD manipulation caused optical density to change across altitudes by a small, moderate, or large amount; while platform motion was either present or absent. The results from these tasks showed that both constant optical density and platform motion improved altitude awareness in an altitude repositioning task, while the presence of platform motion also led to improved performance in a vertical rate control task. The yaw control tasks had pilots'sit 4.5 ft in front of the center of rotation, thus subjecting them to both rotational and lateral motions during a yaw. The pilots were required to regulate their yaw, while the platform motion was manipulated in order to present all combinations of the resulting rotational and lateral motion components. Ratings of simulation fidelity and sensed platform motion showed that the pilots were relatively insensitive to the rotational component, but highly aware of the lateral component. Together these findings show that: 1) platform motion cues are important when speed regulation is required during altitude change; 2) platform motion contributes to the perception of movement amplitude; 3) lateral, but not rotational, motion cues are essential to the perception of vehicle yaw; and 4) LOD management yielding constant optical density across altitudes improves altitude awareness.

Johnson, Walter W.↗

Direct Numerical Simulation of Transitional Multicomponent-Species Gaseous and Multicomponent-Liquid Drop-Laden Mixing

A model of multicomponent-liquid (MC-liquid) drop evaporation in a three-dimensional mixing layer is here exercised at larger Reynolds numbers than in a previous study, and transitional states are obtained. The gas phase is followed in an Eulerian frame and the multitude of drops is described in a Lagrangian frame. Complete coupling between phases is included with source terms in the gas conservation equations accounting for the drop/flow interaction in terms of drop drag, drop heating and species evaporation. The liquid composition, initially specified as a single-Gamma (SG) probability distribution function (PDF) depending on the molar mass is allowed to evolve into a linear combination of two SGPDFs, called the double-Gamma PDF (DGPDF). The compositions of liquid and vapor emanating from the drops are calculated through four moments of the DGPDFs, which are drop-specific and location-specific, respectively. The mixing layer is initially excited to promote the double pairing of its four initial spanwise vortices into an ultimate vortex in which small scales proliferate. Simulations are performed for four liquids of different compositions and the effect of the initial mass loading and initial free-stream gas temperature are explored. For reference, Simulations are also performed for gaseous multicomponent mixing layers for which the effect of Reynolds number is investigated. The results encompass examination of the global layer characteristics, flow visualizations and homogeneous-plane statistics at transition. Comparisons are performed with previous pre-transitional MC-liquid simulations and with transitional single-component (SC) liquid studies. It is found that MCC flows at transition, the classical energy cascade is of similar strength, but that the smallest scales contain orders of magnitude less energy than SC flows, which is confirmed by the larger viscous dissipation in the former case. Contrasting to pre-transitional MC flows, the vorticity and drop organization depend on the initial gas temperature, this being due to the drop/turbulence coupling. The vapor-composition mean molar mass and standard deviation distributions strongly correlate with the initial liquid-composition PDF; such a correlation only exists for the magnitude of the mean but not for that of the standard deviation. Unlike in pre-transitional situations, regions of large composition standard deviation no longer necessarily coincide with regions of large mean molar mass. The kinetic energy, rotational and composition characteristics, and dissipation are liquid specific and the variation among liquids is amplified with increasing free-stream gas temperature. Eulerian and Lagrangian statistics of gas-phase quantities show that the different. Observation framework may affect the perception of the flow characteristics. The gas composition, of which the first four moments are calculated, is shown to be close to, but distinct from a SGPDF. The PDF of the scalar dissipation rate is calculated for drop-laden layers and is shown to depart more significantly from the typically assumed Gaussian in gaseous flows than experimentally measured gaseous scalar dissipation rates, this being attributed to the increased heterogeneity due to drop/flow interactions.

tubulent multicompenent-species↗

Integration of vestibular and head movement signals in the vestibular nuclei during whole-body rotation

Single-unit recordings were obtained from 107 horizontal semicircular canal-related central vestibular neurons in three alert squirrel monkeys during passive sinusoidal whole-body rotation (WBR) while the head was free to move in the yaw plane (2.3 Hz, 20 degrees /s). Most of the units were identified as secondary vestibular neurons by electrical stimulation of the ipsilateral vestibular nerve (61/80 tested). Both non-eye-movement (n = 52) and eye-movement-related (n = 55) units were studied. Unit responses recorded when the head was free to move were compared with responses recorded when the head was restrained from moving. WBR in the absence of a visual target evoked a compensatory vestibulocollic reflex (VCR) that effectively reduced the head velocity in space by an average of 33 +/- 14%. In 73 units, the compensatory head movements were sufficiently large to permit the effect of the VCR on vestibular signal processing to be assessed quantitatively. The VCR affected the rotational responses of different vestibular neurons in different ways. Approximately one-half of the units (34/73, 47%) had responses that decreased as head velocity decreased. However, the responses of many other units (24/73) showed little change. These cells had signals that were better correlated with trunk velocity than with head velocity. The remaining units had responses that were significantly larger (15/73, 21%) when the VCR produced a decrease in head velocity. Eye-movement-related units tended to have rotational responses that were correlated with head velocity. On the other hand, non-eye-movement units tended to have rotational responses that were better correlated with trunk velocity. We conclude that sensory vestibular signals are transformed from head-in-space coordinates to trunk-in-space coordinates on many secondary vestibular neurons in the vestibular nuclei by the addition of inputs related to head rotation on the trunk. This coordinate transformation is presumably important for controlling postural reflexes and constructing a central percept of body orientation and movement in space.

Non-NASA Center↗

Videopanorama Frame Rate Requirements Derived from Visual Discrimination of Deceleration During Simulated Aircraft Landing

In order to determine the required visual frame rate (FR) for minimizing prediction errors with out-the-window video displays at remote/virtual airport towers, thirteen active air traffic controllers viewed high dynamic fidelity simulations of landing aircraft and decided whether aircraft would stop as if to be able to make a turnoff or whether a runway excursion would be expected. The viewing conditions and simulation dynamics replicated visual rates and environments of transport aircraft landing at small commercial airports. The required frame rate was estimated using Bayes inference on prediction errors by linear FRextrapolation of event probabilities conditional on predictions (stop, no-stop). Furthermore estimates were obtained from exponential model fits to the parametric and non-parametric perceptual discriminabilities d' and A (average area under ROC-curves) as dependent on FR. Decision errors are biased towards preference of overshoot and appear due to illusionary increase in speed at low frames rates. Both Bayes and A - extrapolations yield a framerate requirement of 35 < FRmin < 40 Hz. When comparing with published results [12] on shooter game scores the model based d'(FR)-extrapolation exhibits the best agreement and indicates even higher FRmin > 40 Hz for minimizing decision errors. Definitive recommendations require further experiments with FR > 30 Hz.

deceleration perception↗

A dual-task investigation of automaticity in visual word processing

An analysis of activation models of visual word processing suggests that frequency-sensitive forms of lexical processing should proceed normally while unattended. This hypothesis was tested by having participants perform a speeded pitch discrimination task followed by lexical decisions or word naming. As the stimulus onset asynchrony between the tasks was reduced, lexical-decision and naming latencies increased dramatically. Word-frequency effects were additive with the increase, indicating that frequency-sensitive processing was subject to postponement while attention was devoted to the other task. Either (a) the same neural hardware shares responsibility for lexical processing and central stages of choice reaction time task processing and cannot perform both computations simultaneously, or (b) lexical processing is blocked in order to optimize performance on the pitch discrimination task. Either way, word processing is not as automatic as activation models suggest.

Attention↗

Global Variability in Sonic Boom Exposure due to Macroscopic Effects

Supersonic flight over land has been prohibited since 1973 due to the loudness of sonic booms. NASA is building the X-59 aircraft as part of its Quesst mission to demonstrate low-loudness shaped sonic booms, or “sonic thumps.” The Quesst mission will gather human perception data via a series of community noise surveys across the USA. The noise dose and perceptual response data will be provided to the International Civil Aviation Organization (ICAO) and the Federal Aviation Administration for use in determining potential future supersonic aircraft noise certification standards, effectively changing the prohibition from a speed limit to a noise limit. These noise regulations must be globally effective, as long travel distances see the largest benefit to supersonic flight. The state of the atmosphere through which a sonic boom travels affects the size of the region exposed to sound, the “carpet width” (CW), as well as the loudness. The focus of this dissertation is to understand and quantify the expected loudness and CW of sonic booms due to the macroscopic atmospheric effects around the world. A pair of large-scale propagation simulation studies were conducted using the NASA PCBoom code to compare predicted sonic boom loudness and CW statistics first across the USA and then across the world. For the USA study, near-field data of the X-59 in steady cruise was propagated at 4 cardinal headings at 138 locations through 5 years of Climate Forecast System Version 2 (CFSv2) atmospheric profiles. Results of a bootstrap forest predictor screening model indicated the importance of climate zone, latitude, ground elevation, season, and heading. It also noted the unimportance of time of day for predicting loudness and CW. The data is visualized in aggregate, and then broken out geographically, by season and heading, and by climate zone. Multiple linear regression models were fit to the data from the 138 locations so that estimates of the loudness and CW can be produced anywhere in the US. The results can aid in planning when and where to fly the X-59. For the global study, near-field data from three aircraft, the X-59 in a quiet and loud configuration, B-58, and Concorde, were propagated at four cardinal headings through data from three atmospheric models, the CFSv2, the Global Forecast System (GFS), and the ECMWF Reanalysis Version 5 (ERA5), at 100 global locations over 1 year. Results of a bootstrap forest predictor screening model indicated the importance of climate zone, ground elevation, season, and heading. Similar to the US study, the model indicated time of day was not an important predictor. The model also indicated that choice of weather model was not important, so the atmospheric model data are effectively interchangeable. The ERA5 model was chosen for use in an extension of the study to include 18 additional locations to ensure sampling of every climate zone. Loudness and CW results are shown in aggregate, and split geographically and by heading, season, and climate. Multiple linear regression models were fit to the data from the 118 locations so that estimates of loudness and CW can be produced around the world. N-waves and shaped booms did not have the same global variability. Koppen-Geiger climate zones were used as the climate zone definition for the global study. These are available as present-day and future climate projections. Making use of the multiple linear regression models, the future climate zones were input to estimate the effect of the changing climate on sonic boom loudness and CW. Results indicate that a changing climate would have little impact on the effectiveness of noise regulations.

X-59↗

Manual Crew Override of Vehicle Landings Following G-Transitions

BACKGROUND Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during g-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that needs to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition to develop appropriate countermeasures. METHODS In this study, we will examine operational piloting tasks following International Space Station (ISS) missions in a simulated lunar landing using a six-degree-of-freedom (6DOF) motion base. The motion-based simulation will be implemented in our laboratory at the Johnson Space Center (JSC) and will be available within hours following the return from commercial crew landings. The primary goals of this study are (1) to understand the impact of spaceflight on crew ability to perform manual crew override tasks, (2) to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency, and (3) compare performance during late “just-in-time” on-board training with early post-flight crew performance. The impact of spaceflight on piloting capability will be assessed from pre- versus post-flight changes in crewmembers assigned to either short duration (< 30 day) or long duration (~6- month) missions to the International Space Station (ISS). Individual differences in post-flight vestibular and cognitive changes include motion sickness reports, measures of tilt motion perception accuracy and precision, and dual-task tracking. During the 6DOF lunar simulation, the crew will manually takeover attitude and rate-of-descent to the nominal or re-designated landing aim point during the approach phase. The outcome measures for the lunar crew override tasks will be the percent time maintaining actual vehicle states, e.g., attitude and rate-of-descent, within recommended guidance during the landing approach, number and maximum deviation outside limits, and root mean square error (RMSE). Given that “just-in-time” (JIT) training is an operational expectation for the Human Landing System (HLS) program, all participants will perform late inflight JIT training for each manual crew override task in which they will participate. Crew proficiency will be captured inflight during JIT training that will be implemented on a laptop with hand controllers to allow the crewmember to practice the landing task procedures like the approach implemented for JIT training with Shuttle landing and ISS telerobotic tasks. COUNTERMEASURE UPDATES The lunar lander simulation has been implemented onto a two-laptop display system where subjects select from alternative landing points, based upon avoiding hazards that the on-board system identifies during the landing. The subject makes inputs using a rotational hand controller (i.e., joystick) and a translational hand controller, which are processed by simulated vehicle dynamics to update the vehicle attitude and rate of descent. Subjects will utilize a combination of flight, situation, and status displays to monitor the state of the simulated vehicle. The simulation exports tilt and translation movements to a 6DOF motion base synced to visual movements and provides representative vestibular cues to the subject while performing the task inside an enclosed cabin featuring a simulated lunar out-the-window view and a heads-down lander cockpit view. RELEVANCE This project will deliver an operational demonstration of crew override capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew override performance will help better characterize the manual control risks associated with sensorimotor alterations. The inclusion of “just-in-time” on-board training will ensure we are characterizing changes in override proficiency with this expected countermeasure in place. ACKNOWLEDGEMENTS: The authors acknowledge contributions from Draper, HLS Joint Test Panel, Crew HLS Interfaces for Piloting Working Group, and Dynamic Skills Trainer (DST) Lab toward the development of the lunar landing simulation. This project is funded by the Human Health Countermeasures Element.

Austin M Bollinger↗

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include realtime, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identify & other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include real-time, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identity other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗