Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “situated visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

Demonstration of a Spoken Dialogue Interface for Planning Activities of a Semi-autonomous Robot

Planning and scheduling in the face of uncertainty and change pushes the capabilities of both planning and dialogue technologies by requiring complex negotiation to arrive at a workable plan. Planning for use of semi-autonomous robots involves negotiation among multiple participants with competing scientific and engineering goals to co-construct a complex plan. In NASA applications this plan construction is done under severe time pressure so having a dialogue interface to the plan construction tools can aid rapid completion of the process. But, this will put significant demands on spoken dialogue technology, particularly in the areas of dialogue management and generation. The dialogue interface will need to be able to handle the complex dialogue strategies that occur in negotiation dialogues, including hypotheticals and revisions, and the generation component will require an ability to summarize complex plans. This demonstration will describe a work in progress towards building a spoken dialogue interface to the EUROPA planner for the purposes of planning and scheduling the activities of a semi-autonomous robot. A prototype interface has been built for planning the schedule of the Personal Satellite Assistant (PSA), a mobile robot designed for micro-gravity environments that is intended for use on the Space Shuttle and International Space Station. The spoken dialogue interface gives the user the capability to ask for a description of the plan, ask specific questions about the plan, and update or modify the plan. We anticipate that a spoken dialogue interface to the planner will provide a natural augmentation or alternative to the visualization interface, in situations in which the user needs very targeted information about the plan, in situations where natural language can express complex ideas more concisely than GUI actions, or in situations in which a graphical user interface is not appropriate.

Dowding, John↗
NASA NTRSDate not supplied

Development of a Virtual Tool to Connect Classrooms to NASA Airborne Science Missions

The NASA Airborne Science Program (ASP) conducts research around the world using various aircraft systems. Researchers have studied monsoons in the Philippines, clouds in Bermuda, fires over the United States, the atmosphere over Antarctica, and so much more. Each of these missions is not only a chance to discover more about our planet, but also to connect students with the scientists making these discoveries. The NASA Airborne Science Mission Tool Suite (MTS) supports NASA flight projects by providing easy to access web-based tools to support planning, communication, and discovery. At its core, MTS links ground science support and flight scientists and provides aircraft situational awareness and visualization of real time data collected during flight. Each mission has different needs, and the basic tools MTS provides are reconfigured for every flight mission. One instance of the MTS, called MTS-Outreach or MTS-O, is being developed and refined to focus on facilitating outreach with students in K-12 schools. As MTS-O continues to be improved and revitalized, versions of it have already been used for group discussions with students in classrooms worldwide. Students using MTS-O can chat with scientists on NASA airborne missions while those scientists fly on the plane and collect data. During the pandemic, this tool was extremely beneficial as in-person classroom visits were not possible. As the tool continues to be refined and developed, we will summarize how it has been used and share its potential applications for the future.

Brenna Crawford Biggs↗
NASA NTRS2016

Automatic Dependent Surveillance Broadcast (ADS-B) System for Ownership and Traffic Situational Awareness

The present invention proposes an automatic dependent surveillance broadcast (ADS-B) architecture and process, in which priority aircraft and ADS-B IN traffic information are included in the transmission of data through the telemetry communications to a remote ground control station. The present invention further proposes methods for displaying general aviation traffic information in three and/or four dimension trajectories using an industry standard Earth browser for increased situation awareness and enhanced visual acquisition of traffic for conflict detection. The present invention enable the applications of enhanced visual acquisition of traffic, traffic alerts, and en-route and terminal surveillance used to augment pilot situational awareness through ADS-B IN display and information in three or four dimensions for self-separation awareness.

Arteaga, Ricardo A.↗
NASA NTRS1999

Visual Orientation in Unfamiliar Gravito-Inertial Environments

The goal of this project is to better understand the process of spatial orientation and navigation in unfamiliar gravito-inertial environments, and ultimately to use this new information to develop effective countermeasures against the orientation and navigation problems experienced by astronauts. How do we know our location, orientation, and motion of our body with respect to the external environment ? On earth, gravity provides a convenient "down" cue. Large body rotations normally occur only in a horizontal plane. In space, the gravitational down cue is absent. When astronauts roll or pitch upside down, they must recognize where things are around them by a process of mental rotation which involves three dimensions, rather than just one. While working in unfamiliar situations they occasionally misinterpret visual cues and experience striking "visual reorientation illusions" (VRIs), in which the walls, ceiling, and floors of the spacecraft exchange subjective identities. VRIs cause disorientation, reaching errors, trigger attacks of space motion sickness, and potentially complicate emergency escape. MIR crewmembers report that 3D relationships between modules - particularly those with different visual verticals - are difficult to visualize, and so navigating through the node that connects them is not instinctive. Crew members learn routes, but their apparent lack of survey knowledge is a concern should fire, power loss, or depressurization limit visibility. Anecdotally, experience in mockups, parabolic flight, neutral buoyancy and virtual reality (VR) simulators helps. However, no techniques have been developed to quantify individual differences in orientation and navigation abilities, or the effectiveness of preflight visual. orientation training. Our understanding of the underlying physiology - for example how our sense of place and orientation is neurally coded in three dimensions in the limbic system of the brain - is incomplete. During the 16 months that this human and animal research project has been underway, we have obtained several results that are not only of basic research interest, but which have practical implications for the architecture and layout of spacecraft interiors and for the development of astronaut spatial orientation training countermeasures.

Oman, Charles M.↗
NASA NTRS1998

Situation Awareness Information Requirements for Commercial Airline Pilots

Situation awareness is presented as a fundamental requirement for good airmanship, forming the basis for pilot decision making and performance. To develop a better understanding of the role of situation awareness in flying, an analysis was performed to determine the specific situation awareness information requirements for commercial aircraft pilots. This was conducted as a goal-directed task analysis in which pilots' major goals, subgoals, decisions, and associated situation awareness information requirements were delineated based on elicitation from experienced commercial airline pilots. A determination of the major situation awareness information requirements for visual and instrument flight was developed from this analysis, providing a foundation for future system development which seeks to enhance pilot situation awareness and provide a basis for the development of situation awareness measures for commercial flight.

Endsley, Mica R.↗
NASA NTRS1991

Applications of dark central ground interferometry

The application of dark central ground interferometry in a supersonic wind tunnel is presented. Examples of this method as a quantitative flow visualization technique for several types of supersonic flowfields are presented. Theoretical work is presented regarding the effects of vibrations and filter size. The method is shown to be an inexpensive, easy to use tool for situations requiring interferograms for flow visualization.

Loomis, Mark P.↗
NASA NTRSDate not supplied

Lunar Instrument Data Integration Into the Virtual Reality Mission Simulation System for Decision Communication and Situational Awareness

In situ resource utilization (ISRU) technologies are a key advancement required to make human habitation on the Moon and Mars viable. The upcoming Volatiles Investigating Polar Exploration Rover (VIPER) mission will provide crucial correlations between volatiles and lunar geology to understand the water content available for ISRU on the moon. The mission will require the coordination of multi-disciplinary teams across the country making real time decisions based on rover instrument data. The virtual reality Mission Simulation System (vMSS) is a virtual reality platform designed at MIT by the Resource Exploration and Science of our Cosmic Environment (RESOURCE) team to provide teams with a collaboration interface for planetary missions like VIPER. Herein we determine the integration pathway for analog based datasets that are examples of VIPER's two main instruments, the near-infrared volatile spectrometer subsystem (NIRVSS) and the neutron spectrometer subsystem (NSS), into vMSS to provide the most valuable visualization tools. Focusing on improving situational awareness, decision making, reducing task load and incorporating comments from scientists working previous analogs and on the current VIPER mission, we recommend critical elements to implement into vMSS and the best approaches for data visualization. We present a review of relevant analogs and state of the art mission software. We have developed a design concept and path to flight of analysed instrument data integrated with data maps that allow for virtual manipulation and annotation between non-co-located team members. We focus on pre-mission mapping of a priori data for improved situational awareness, layering of analysed instrument data, correlative mapping and interactive capabilities for in-mission decision making, as well as archiving and annotation tools for post-mission analysis. Finally, we lay out the roadmap for the future development of immersive sample site visualization capabilities and the use of integrated instrument data in vMSS with automated temporal and geospatial planning.

Cody Alison Paige↗
NASA NTRS1991

Pictorial communication in virtual and real environments

Papers about the communication between human users and machines in real and synthetic environments are presented. Individual topics addressed include: pictorial communication, distortions in memory for visual displays, cartography and map displays, efficiency of graphical perception, volumetric visualization of 3D data, spatial displays to increase pilot situational awareness, teleoperation of land vehicles, computer graphics system for visualizing spacecraft in orbit, visual display aid for orbital maneuvering, multiaxis control in telemanipulation and vehicle guidance, visual enhancements in pick-and-place tasks, target axis effects under transformed visual-motor mappings, adapting to variable prismatic displacement. Also discussed are: spatial vision within egocentric and exocentric frames of reference, sensory conflict in motion sickness, interactions of form and orientation, perception of geometrical structure from congruence, prediction of three-dimensionality across continuous surfaces, effects of viewpoint in the virtual space of pictures, visual slant underestimation, spatial constraints of stereopsis in video displays, stereoscopic stance perception, paradoxical monocular stereopsis and perspective vergence. (No individual items are abstracted in this volume)

Ellis, Stephen R.↗
NASA NTRS1995

Simulator Investigation of Pilot Aids for Helicopter Terminal Area Operations with One Engine Inoperative

Two recent piloted simulation experiments have investigated advanced display concepts applied to civil transport helicopter terminal area operations. Civil Category A helicopter operations apply to multi-engine helicopters wherein a safe recovery (land or fly out) is required in the event of a single engine failure. The investigation used the NASA Ames Research Center Vertical Motion Simulator, which has a full six degrees of freedom, to simulate the flight task as closely as possible. The goal of these experiments was to use advanced cockpit displays to improve flight safety and enhance the mission performance of Category A terminal area operations in confined areas. The first experiment investigated the use of military display formats to assist civil rotorcraft in performing a Category A takeoff in confined terminal areas. Specifically, it addressed how well a difficult hovering backup path could be followed using conventional instruments in comparison to panel mounted integrated displays. The hovering backup takeoff, which enables pilots to land back to the confined area pad in the event of an engine failure, was chosen since it is a difficult task to perform. Seven NASA and Army test pilots participated in the experiment. Evaluations, based on task performance and pilot workload, showed that an integrated display enabled the pilot to consistently achieve adequate or desired performance with reasonable pilot workload. Use of conventional instruments, however, frequently resulted in unacceptable performance (poor flight path tracking), higher pilot workload, and poor situational awareness. Although OEI landbacks were considered a visual task, the improved performance on the backup portion, in conjunction with increased situational awareness resulting from use of integrated displays, enabled the pilots to handle an engine failure and land back safely. In contrast, use of conventional instruments frequently led to excessive rates of sink at touchdown. A second simulation (in progress - July - August) is being conducted to investigate the use of advanced displays to perform vertical and short takeoffs and landings. One Engine Inoperative trajectories, which were optimized based on safety of flight restrictions, are utilized. Based on comments from the first experiment and further analytic development, appropriate fly out and approach guidance was added. Displays include conventional instruments with raw data, and the following integrated displays: multi-view and side-view hover displays based on the Apache Pilot Night Vision System, and variations of the pathway-in-the-sky displays with a flight-path-vector, a leader and flight director modifications. Panel mounted and head-up displays are being evaluated. Engine modifications have been incorporated to simulate 30 second and 2 minute contingency power ratings. Evaluations are based on task performance and pilot workload. NASA, Army, FAA, and industry test pilots participated. Details concerning the design, conduct, and the results of the experiment will be reported in the proposed paper.

Iseler, Laura↗
NASA NTRS1988

Space spider crane

A space spider crane for the movement, placement, and or assembly of various components on or in the vicinity of a space structure is described. As permanent space structures are utilized by the space program, a means will be required to transport cargo and perform various repair tasks. A space spider crane comprising a small central body with attached manipulators and legs fulfills this requirement. The manipulators may be equipped with constant pressure gripping end effectors or tools to accomplish various repair tasks. The legs are also equipped with constant pressure gripping end effectors to grip the space structure. Control of the space spider crane may be achieved either by computer software or a remotely situated human operator, who maintains visual contact via television cameras mounted on the space spider crane. One possible walking program consists of a parallel motion walking program whereby the small central body alternatively leans forward and backward relative to end effectors.

Macconochie, Ian O.↗
NASA NTRS1995

Automated Selection Of Pictures In Sequences

Method of automated selection of film or video motion-picture frames for storage or examination developed. Beneficial in situations in which quantity of visual information available exceeds amount stored or examined by humans in reasonable amount of time, and/or necessary to reduce large number of motion-picture frames to few conveying significantly different information in manner intermediate between movie and comic book or storyboard. For example, computerized vision system monitoring industrial process programmed to sound alarm when changes in scene exceed normal limits.

Rorvig, Mark E.↗
NASA NTRS1962

VISUAL CONTROL OF RENDEZVOUS

Space rendezvous involving human occupants will be required in many phases of space flight. In order that rendezvous capability be concurrent with other phases of manned space flight to insure that such tasks as the rotation and addition of crews for manned space station, supply of stations and launching complexes for deep-space probes, and the emergency rescue of personnel may be carried out, it is desirable to determine the ability of a human pilot to control the rendezvous maneuver. The National Aeronautics and Space Administration has conducted a study program to determine vehicle requirements and control techniques for a number of proposed methods for performing piloted space rendezvous. The final step in each phase of the rendezvous study program has been a simulation of the man-machine combination to test its feasibility. Initially, an analytical study was conducted to determine a range of conditions that would exist at the beginning of the terminal phase of rendezvous (ref. 1). Piloted systems were investigated for rendezvous control using these initial conditions. One such study of piloted rendezvous in which all the required control information was displayed to the simulator pilot on instruments is presented in reference 2. While the control of the rendezvous maneuver by use of the instrument display was shown to be feasible, the sufficiently accurate measurement of the necessary information to operate the instrument was realized to be a difficult problem. Consideration was therefore given to the possibility of maneuvering range and range rate required for the control of the rendezvous from visual sightings made during the initial control application. To provide this capability, an analytical study was made. This analytical study, presented in reference 3, derived three techniques for obtaining range and range rate visually and conducted a simplified preliminary situation to test the three analytical techniques. The study reported herein is a continuation of the simulation work begun in reference 3, and is aimed at determining the ability of a pilot to use visual information to reduce or eliminate the need for some or all of the data that would normally be displayed on instruments.

Rendezvous↗
NASA NTRS1997

Studies of the Interactions Between Vestibular Function and Tactual Orientation Display Systems

When humans experience conditions in which internal vestibular cues to movement or spatial location are challenged or contradicted by external visual information, the result can be spatial disorientation, often leading to motion sickness. Spatial disorientation can occur in any situation in which the individual is passively moved in the environment, but is most common in automotive, aircraft, or undersea travel. Significantly, the incidence of motion sickness in space travel is great: The majority of individuals in Shuttle operations suffer from the syndrome. Even after the space-sickness-producing influences of spatial disorientation dissipate, usually within several days, there are other situations in which, because of the absence of reliable or familiar vestibular cues, individuals in space still experience disorientation, resulting in a reliance on the already preoccupied sense of vision. One possible technique to minimize the deleterious effects of spatial disorientation might be to present attitude information (including orientation, direction, and motion) through another less-used sensory modality - the sense of touch. Data from experiences with deaf and blind persons indicate that this channel can provide useful communication and mobility information on a real-time basis. More recently, technologies have developed to present effective attitude information to pilots in situations in which dangerously ambiguous and conflicting visual and vestibular sensations occur. This summers project at NASA-Johnson Space Center will evaluate the influence of motion-based spatial disorientation on the perception of tactual stimuli representing veridical position and orientation information, presented by new dynamic vibrotactile array display technologies. In addition, the possibility will be explored that tactile presentations of motion and direction from this alternative modality might be useful in mitigating or alleviating spatial disorientation produced by multi-axis rotatory systems, monitored by physiological recording techniques developed at JSC.

Cholewiak, Roger W.↗
NASA NTRS1973

Evaluation of tactual displays for flight control

Manual tracking experiments were conducted to determine the suitability of tactual displays for presenting flight-control information in multitask situations. Although tracking error scores are considerably greater than scores obtained with a continuous visual display, preliminary results indicate that inter-task interference effects are substantially less with the tactual display in situations that impose high visual scanning workloads. The single-task performance degradation found with the tactual display appears to be a result of the coding scheme rather than the use of the tactual sensory mode per se. Analysis with the state-variable pilot/vehicle model shows that reliable predictions of tracking errors can be obtained for wide-band tracking systems once the pilot-related model parameters have been adjusted to reflect the pilot-display interaction.

Levison, W. H.↗
NASA NTRS1993

Comparative measurement of visual stability in Earth and cosmic space (L-4)

The frequency and the intensity of space motion sickness was reviewed and investigated. Unusual induced-gravity situations, such as rotation, linear acceleration, parallel swinging etc. were investigated as well. Visually-induced motion sensation or distorted perception were evaluated with respect to visual stability by many investigators. These studies are all concerned with the effect of gravity and the induction of motion sickness through human visual perception. Direct investigation under the microgravity situation, such as parabolic flight, Skylab, and Spacelab, was carried out. These studies focused on how human visual stability is established through various sensory afferents in specific gravity conditions. Results from these investigations indicate that sensory mismatch probably plays an important role in space motion sickness. The interaction of visual, vestibular, and somatosensory perception is smoothly coordinated under normal gravitational conditions on the Earth in our daily life. When the cooperation is destroyed or a mismatch occurs among them, motion sickness may develop not only on the Earth but also in microgravity. The latter case may be the cause of space motion sickness or space adaption syndrome. How human beings obtain visual stability even with posture changes on the ground was investigated. Visual stability can be categorized as static or dynamic. Static visual stability is concerned with orientation and dynamic stability is concerned with object motion perception. The perception of visual stability is modified by many other sensations, such as somatosensory, vestibular, and muscle tension. We will mainly focus on modifications by vestibular inputs to visual perception produced by eye movements in microgravity. The Vestibular-Oscular Reflex (VOR) is a well-known characteristic which results from the relationship between eye mobility and vestibular afferent inputs. Eye movements also modify dynamic visual perception, such as perceived object motion velocity. The VOR is constantly simulated under 1-g conditions on Earth. In fact, human beings have been habituated and 'programmed' for orientation (visual stability) in their everyday, 1-g environment. When humans are exposed to a different gravity situation, this programmed behavior must change; that is, it is reprogrammed. This is called habituation or familiarization. We hope to examine how object motion perception is perturbed and subsequently adapted in the microgravity environment. This experiment is focused on the cooperation of visual, vestibular, and somatosensory perception coordination and how it is changed or reduced in space compared to 1-g environment. We will obtain information on the coordination between eye movement and neck muscle activity by using EOG and EMG. We will also collect data from Payload Specialists using a self-diagnostic questionnaire concerned with perceptual abnormality. When each sensory input function and its integration in the higher nervous system are well-characterized, then more effective techniques to control SAS may be developed.

Koga, Kazugo↗
NASA NTRS2010

360-Degree Visual Detection and Target Tracking on an Autonomous Surface Vehicle

This paper describes perception and planning systems of an autonomous sea surface vehicle (ASV) whose goal is to detect and track other vessels at medium to long ranges and execute responses to determine whether the vessel is adversarial. The Jet Propulsion Laboratory (JPL) has developed a tightly integrated system called CARACaS (Control Architecture for Robotic Agent Command and Sensing) that blends the sensing, planning, and behavior autonomy necessary for such missions. Two patrol scenarios are addressed here: one in which the ASV patrols a large harbor region and checks for vessels near a fixed asset on each pass and one in which the ASV circles a fixed asset and intercepts approaching vessels. This paper focuses on the ASV's central perception and situation awareness system, dubbed Surface Autonomous Visual Analysis and Tracking (SAVAnT), which receives images from an omnidirectional camera head, identifies objects of interest in these images, and probabilistically tracks the objects' presence over time, even as they may exist outside of the vehicle's sensor range. The integrated CARACaS/SAVAnT system has been implemented on U.S. Navy experimental ASVs and tested in on-water field demonstrations.

ASV (AUTONOMOUS SEA SURFACE VEHICLE)↗
NASA NTRS1985

Seeing tones and hearing rectangles - Attending to simultaneous auditory and visual events

The allocation of attention in dual-task situations depends on both the overall and the momentary demands associated with both tasks. Subjects in an inclusive- or reaction-time task responded to changes in simultaneous sequences of discrete auditory and visual stimuli. Performance on individual trials was affected by (1) the ratio of stimuli in the two tasks, (2) response demands of the two tasks, and (3) patterns inherent in the demands of one task.

Casper, Patricia A.↗