Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “situated visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

A Virtual Reality Planning Environment for High-Risk, High-Latency Teleoperation

In-Space Servicing, Assembly, and Manufacturing has the potential to enable larger-scale and longer-lived infrastructure projects in space. Servicing in particular has the potential to vastly increase the usable lifetimes of satellites, both newly launched and existing. However, some of these servicing tasks require delicate manipulation and, to apply to existing satellites, need to be able to operate on structures that were not designed for servicing and, in some cases, where the exact shape of the structure is not known in advance. For this reason, human-in-the-loop ground-based teleoperation is the only option for some missions. Ground-based teleoperation presents its own difficulties. In addition to the challenge of performing delicate operations in constrained spaces, communication with the servicing platform is subject to a variable time delay on the order of 2-7 seconds, and the only visual feedback comes from camera views with limited situational awareness and viewing angles.

Teleoperation↗
NASA NTRS2014

NASA VERVE: Interactive 3D Visualization Within Eclipse

At NASA, we develop myriad Eclipse RCP applications to provide situational awareness for remote systems. The Intelligent Robotics Group at NASA Ames Research Center has developed VERVE - a high-performance, robot user interface that provides scientists, robot operators, and mission planners with powerful, interactive 3D displays of remote environments.VERVE includes a 3D Eclipse view with an embedded Java Ardor3D scenario, including SWT and mouse controls which interact with the Ardor3D camera and objects in the scene. VERVE also includes Eclipse views for exploring and editing objects in the Ardor3D scene graph, and a HUD (Heads Up Display) framework allows Growl-style notifications and other textual information to be overlayed onto the 3D scene. We use VERVE to listen to telemetry from robots and display the robots and associated scientific data along the terrain they are exploring; VERVE can be used for any interactive 3D display of data.VERVE is now open source. VERVE derives from the prior Viz system, which was developed for Mars Polar Lander (2001) and used for the Mars Exploration Rover (2003) and the Phoenix Lander (2008). It has been used for ongoing research with IRG's K10 and KRex rovers in various locations. VERVE was used on the International Space Station during two experiments in 2013 - Surface Telerobotics, in which astronauts controlled robots on Earth from the ISS, and SPHERES, where astronauts control a free flying robot on board the ISS.We will show in detail how to code with VERVE, how to interact between SWT controls to the Ardor3D scenario, and share example code.

3D Visualization↗
NASA NTRS1972

The measurement of driver describing functions in simulated steering control tasks

Measurements of driver describing functions in steering control tasks have been made using a driving simulator. The task was to regulate against a random crosswind gust input on a straight roadway, in order to stay in the center of the lane. Although driving is a multiloop task in general, the forcing function and situation were configured so that an inner-loop visual cue feedback of heading angle of heading rate would dominate, and the driver's response was interpreted to be primarily single-loop. The driver describing functions were measured using an STI describing function analyzer. Three replications for each subject showed good repeatability within a subject. There were some intersubject differences as expected, but the crossover frequencies, effective time delays, and stability margins were generally consistent with the prior data and models for similar manual control tasks. The results further confirm the feasibility of measuring human operator response properties in nominal control tasks with full (real-world) visual field displays.

Weir, D. H.↗
NASA NTRS1999

Re-Design and Beat Testing of the Man-Machine Integration Design and Analysis System: MIDAS

The Man-machine Design and Analysis System (MIDAS) is a human factors design and analysis system that combines human cognitive models with 3D CAD models and rapid prototyping and simulation techniques. MIDAS allows designers to ask 'what if' types of questions early in concept exploration and development prior to actual hardware development. The system outputs predictions of operator workload, situational awareness and system performance as well as graphical visualization of the cockpit designs interacting with models of the human in a mission scenario. Recently, MIDAS was re-designed to enhance functionality and usability. The goals driving the redesign include more efficient processing, GUI interface, advances in the memory structures, implementation of external vision models and audition. These changes were detailed in an earlier paper. Two Beta test sites with diverse applications have been chosen. One Beta test site is investigating the development of a new airframe and its interaction with the air traffic management system. The second Beta test effort will investigate 3D auditory cueing in conjunction with traditional visual cueing strategies including panel-mounted and heads-up displays. The progress and lessons learned on each of these projects will be discussed.

Shively, R. Jay↗
NASA NTRS1998

Dual adaptation and adaptive generalization of the human vestibulo-ocular reflex

In two experiments, we examined the possibility that the human vestibulo-ocular reflex (VOR) is subject to dual adaptation (the ability to adapt to a sensory rearrangement more rapidly and/or more completely after repeated experience with it) and adaptive generalization (the ability to adapt more readily to a novel sensory rearrangement as a result of prior dual adaptation training). In Experiment 1, the subjects actively turned the head during alternating exposure to a visual-vestibular rearrangement (target/head gain = 0.5) and the normal situation (target/head gain = 0.0). These conditions produced both adaptation and dual adaptation of the VOR but no evidence of adaptive generalization when tested with a target/head gain of 1.0. Experiment 2, in which exposure to the 0.5 gain entailed externally controlled (i.e., passive) whole body rotation, resulted in VOR adaptation but no dual adaptation. As in Experiment 1, no evidence of adaptive generalization was found.

NASA Discipline Neuroscience↗
NASA NTRS2009

Synthetic and Enhanced Vision System for Altair Lunar Lander

Past research has demonstrated the substantial potential of synthetic and enhanced vision (SV, EV) for aviation (e.g., Prinzel & Wickens, 2009). These augmented visual-based technologies have been shown to significantly enhance situation awareness, reduce workload, enhance aviation safety (e.g., reduced propensity for controlled flight -into-terrain accidents/incidents), and promote flight path control precision. The issues that drove the design and development of synthetic and enhanced vision have commonalities to other application domains; most notably, during entry, descent, and landing on the moon and other planetary surfaces. NASA has extended SV/EV technology for use in planetary exploration vehicles, such as the Altair Lunar Lander. This paper describes an Altair Lunar Lander SV/EV concept and associated research demonstrating the safety benefits of these technologies.

Prinzell, Lawrence J., III↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates.We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions. We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of "activities," each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar & Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2015

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval.We present two methods for comparing sequences of this sort, one based on computing the time varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. Using these criteria, we have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Gontar Hoermann, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

Mulligan, Jeffrey B.↗
NASA NTRS2020

Honeywell Enhancing Airplane State Awareness (EASA) Project: Final Report on Refinement and Evaluation of Candidate Solutions for Airplane System State Awareness

The loss of pilot airplane state awareness (ASA) has been implicated as a factor in several aviation accidents identified by the Commercial Aviation Safety Team (CAST). These accidents were investigated to identify precursors to the loss of ASA and develop technologies to address the loss of ASA. Based on a gap analysis, two technologies were prototyped and assessed with a formative pilot-in-the-loop evaluation in NASA Langley’s full-motion Research Flight Deck. The technologies address: 1) data source anomaly detection in real-time, and 2) intelligent monitoring aids to provide nominal and predictive awareness of situations to be monitored and a mission timeline to visualize events of interest. The evaluation results indicated favorable impressions of both technologies for mitigating the loss of ASA in terms of operational utility, workload, acceptability, complexity, and usability. The team concludes that there is a feasible retrofit solution for improving ASA that would minimize certification risk, integration costs, and training impact.

Whitlow, Stephen D.↗
NASA NTRS2006

Advanced Visualization of Experimental Data in Real Time Using LiveView3D

LiveView3D is a software application that imports and displays a variety of wind tunnel derived data in an interactive virtual environment in real time. LiveView3D combines the use of streaming video fed into a three-dimensional virtual representation of the test configuration with networked communications to the test facility Data Acquisition System (DAS). This unified approach to real time data visualization provides a unique opportunity to comprehend very large sets of diverse forms of data in a real time situation, as well as in post-test analysis. This paper describes how LiveView3D has been implemented to visualize diverse forms of aerodynamic data gathered during wind tunnel experiments, most notably at the NASA Langley Research Center Unitary Plan Wind Tunnel (UPWT). Planned future developments of the LiveView3D system are also addressed.

Schwartz, Richard J.↗
NASA NTRS1972

Apollo experience report: The application of a computerized visualization capability to lunar missions

The development of a computerized capability to depict views from the Apollo spacecraft during a lunar mission was undertaken before the Apollo 8 mission. Such views were considered valuable because of the difficulties in visualizing the complex geometry of the Earth, Moon, Sun, and spacecraft. Such visualization capability originally was desired for spacecraft attitude verification and contingency situations. Improvements were added for later Apollo flights, and results were adopted for several real time and preflight applications. Some specific applications have included crewmember and ground control personnel familiarization, nominal and contingency mission planning, definition of secondary attitude checks for all major thrust maneuvers, and preflight star selection for navigation and for platform alinement. The use of this computerized visualization capability should prove valuable for any future space program as an aid to understanding the geometrical relationships between the spacecraft and the celestial surroundings.

Hyle, C. T.↗
NASA NTRS2004

Sizing Up the Situation

Hailstorm damage to the Space Shuttle's External Tank inspired a NASA innovation with extensive photography applications. In order to measure the defects caused by the storm, Kennedy Space Center used telephoto lenses to zoom in on the tank and view the damage clearly. However, since there was no reference object in the image, the engineers could not determine the scale of the damage. In photographic situations similar to this, an object, such as a ruler, is placed within the field of view. This allows a person to look at a photograph and have a visual indication of the scale of the objects in it. In the External Tank situation, however, this procedure was not possible. As a solution, Kennedy developed the Scaling and Measurement Device for Photographic Images, which provides a non-intrusive means of adding a scale to a photograph. In addition to meeting Kennedy's needs, scaling images is extremely important in crime and accident scene investigations, oil and chemical tank monitoring, and aerial photography. The innovation consists of a tool that attaches directly to a camera or charge coupled device using a standard screw. Two lasers fitted to the device provide parallel beams that are set 1 inch apart. These lasers enable the device to project a pattern into the field of view. When a photograph is taken, the image of the laser pattern appears, along with the image of the object under investigation, allowing the viewer quantifiable information as to the size of the object. The laser beams are accurate to approximately 200 feet. Windows-based software was developed to work with the scaling device tool. The software provides further techniques to measure objects in photographs and digital images. By using the software, any object in the image can be measured diagonally, vertically, and horizontally. The device and its software enable the user to determine two-dimensional measurements within a photograph.

Source record↗
NASA NTRS2000

Geographical Database Integrity Validation

Airport Safety Modeling Data (ASMD) was developed at the request of a 1997 White House Conference on Aviation Safety and Security. Politicians, military personnel, commercial aircraft manufacturers and the airline industry attended the conference. The objective of the conference was to study the airline industry and make recommendations to improve safety and security. One of the topics discussed at the conference was the loss of situational awareness by aircraft pilots. Loss of situational awareness occurs when a pilot loses his geographic position during flight and can result in crashes into terrain and obstacles. It was recognized at the conference that aviation safety could be improved by reducing the loss of situational awareness. The conference advised that a system be placed in the airplane cockpit that would provide pilots with a visual representation of the terrain around airports. The system would prevent airline crashes during times of inclement weather and loss of situational awareness. The system must be based on accurate data that represents terrain around airports. The Department of Defense and the National Imagery and Mapping Agency (NIMA) released ASMD to be used for the development of a visual system for aircraft pilots. ASMD was constructed from NIMA digital terrain elevation data (DTED).

Jacobs, Derya↗
NASA NTRS1995

Helicopter Human Factors

Even under optimal conditions, helicopter flight is a most demanding form of human-machine interaction, imposing continuous manual, visual, communications, and mental demands on pilots. It is made even more challenging by small margins for error created by the close proximity of terrain in NOE flight and missions flown at night and in low visibility. Although technology advances have satisfied some current and proposed requirements, hardware solutions alone are not sufficient to ensure acceptable system performance and pilot workload. However, human factors data needed to improve the design and use of helicopters lag behind advances in sensor, display, and control technology. Thus, it is difficult for designers to consider human capabilities and limitations when making design decisions. This results in costly accidents, design mistakes, unrealistic mission requirements, excessive training costs, and challenge human adaptability. NASA, in collaboration with DOD, industry, and academia, has initiated a program of research to develop scientific data bases and design principles to improve the pilot/vehicle interface, optimize training time and cost, and maintain pilot workload and system performance at an acceptable level. Work performed at Ames, and by other research laboratories, will be reviewed to summarize the most critical helicopter human factors problems and the results of research that has been performed to: (1) Quantify/model pilots use of visual cues for vehicle control; (2) Improve pilots' performance with helmet displays of thermal imagery and night vision goggles for situation awareness and vehicle control; (3) Model the processes by which pilots encode maps and compare them to the visual scene to develop perceptually and cognitively compatible electronic map formats; (4) Evaluate the use of spatially localized auditory displays for geographical orientation, target localization, radio frequency separation; (5) Develop and flight test control/display concepts; (6) Quantify, model, predict, and improve pilots, workload-management strategies; and (7) Design computer-game trainers to reduce training time and cost.

Hart, Sandra G.↗
NASA NTRS1973

A tactual pilot aid for the approach-and-landing task: Inflight studies

A pilot aid -- a kinesthetic-tactual compensatory display -- for assisting novice pilots in various inflight situations has undergone preliminary inflight testing. The efficacy of this display, as compared with two types of visual displays, was evaluated in both a highly structured approach-and-landing task and a less structured test involving tight turns about a point. In both situations, the displayed quantity was the deviation (alpha sub 0 - alpha) in angle at attack from a desired value alpha sub 0. In the former, the performance with the tactual display was comparable with that obtained using a visual display of (alpha sub 0 - alpha), while in the later, substantial improvements (reduced tracking error (55%), decreased maximum altitude variations (67%), and decreased speed variations (43%)), were obtained using the tactual display. It appears that such a display offers considerable potential for inflight use.

Gilson, R. D.↗
NASA NTRS1991

Display formatting techniques for improving situation awareness in the aircraft cockpit

Possible modifications of primary flight instruments for attitude control and navigation were examined including a display perspective, frames of reference, and the incorporation of directional color to enhance visual momentum. A low-fidelity fixed-wing flight simulation was evaluated. It is concluded that situation awareness measured by flight performance and recovery from disorientation events, was best maintained with the planar outside-in display, whereas color coding improved the performance on the planar inside-out display.

Andre, Anthony D.↗
NASA NTRS2012

Sensing and Virtual Worlds - A Survey of Research Opportunities

Virtual Worlds (VWs) have been used effectively in live and constructive military training. An area that remains fertile ground for exploration and a new vision involves integrating various traditional and now non-traditional sensors into virtual worlds. In this paper, we will assert that the benefits of this integration are several. First, we maintain that virtual worlds offer improved sensor deployment planning through improved visualization and stimulation of the model, using geo-specific terrain and structure. Secondly, we assert that VWs enhance the mission rehearsal process, and that using a mix of live avatars, non-player characters, and live sensor feeds (e.g. real time meteorology) can help visualization of the area of operations. Finally, tactical operations are improved via better collaboration and integration of real world sensing capabilities, and in most situations, 30 VWs improve the state of the art over current "dots on a map" 20 geospatial visualization. However, several capability gaps preclude a fuller realization of this vision. In this paper, we identify many of these gaps and suggest research directions

Moore, Dana↗