Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “situated visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates.We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions. We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of "activities," each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar & Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2015

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval.We present two methods for comparing sequences of this sort, one based on computing the time varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. Using these criteria, we have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Gontar Hoermann, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

Mulligan, Jeffrey B.↗
NASA NTRS2020

Honeywell Enhancing Airplane State Awareness (EASA) Project: Final Report on Refinement and Evaluation of Candidate Solutions for Airplane System State Awareness

The loss of pilot airplane state awareness (ASA) has been implicated as a factor in several aviation accidents identified by the Commercial Aviation Safety Team (CAST). These accidents were investigated to identify precursors to the loss of ASA and develop technologies to address the loss of ASA. Based on a gap analysis, two technologies were prototyped and assessed with a formative pilot-in-the-loop evaluation in NASA Langley’s full-motion Research Flight Deck. The technologies address: 1) data source anomaly detection in real-time, and 2) intelligent monitoring aids to provide nominal and predictive awareness of situations to be monitored and a mission timeline to visualize events of interest. The evaluation results indicated favorable impressions of both technologies for mitigating the loss of ASA in terms of operational utility, workload, acceptability, complexity, and usability. The team concludes that there is a feasible retrofit solution for improving ASA that would minimize certification risk, integration costs, and training impact.

Whitlow, Stephen D.↗
NASA NTRS2006

Advanced Visualization of Experimental Data in Real Time Using LiveView3D

LiveView3D is a software application that imports and displays a variety of wind tunnel derived data in an interactive virtual environment in real time. LiveView3D combines the use of streaming video fed into a three-dimensional virtual representation of the test configuration with networked communications to the test facility Data Acquisition System (DAS). This unified approach to real time data visualization provides a unique opportunity to comprehend very large sets of diverse forms of data in a real time situation, as well as in post-test analysis. This paper describes how LiveView3D has been implemented to visualize diverse forms of aerodynamic data gathered during wind tunnel experiments, most notably at the NASA Langley Research Center Unitary Plan Wind Tunnel (UPWT). Planned future developments of the LiveView3D system are also addressed.

Schwartz, Richard J.↗
NASA NTRS1972

Apollo experience report: The application of a computerized visualization capability to lunar missions

The development of a computerized capability to depict views from the Apollo spacecraft during a lunar mission was undertaken before the Apollo 8 mission. Such views were considered valuable because of the difficulties in visualizing the complex geometry of the Earth, Moon, Sun, and spacecraft. Such visualization capability originally was desired for spacecraft attitude verification and contingency situations. Improvements were added for later Apollo flights, and results were adopted for several real time and preflight applications. Some specific applications have included crewmember and ground control personnel familiarization, nominal and contingency mission planning, definition of secondary attitude checks for all major thrust maneuvers, and preflight star selection for navigation and for platform alinement. The use of this computerized visualization capability should prove valuable for any future space program as an aid to understanding the geometrical relationships between the spacecraft and the celestial surroundings.

Hyle, C. T.↗
NASA NTRS2004

Sizing Up the Situation

Hailstorm damage to the Space Shuttle's External Tank inspired a NASA innovation with extensive photography applications. In order to measure the defects caused by the storm, Kennedy Space Center used telephoto lenses to zoom in on the tank and view the damage clearly. However, since there was no reference object in the image, the engineers could not determine the scale of the damage. In photographic situations similar to this, an object, such as a ruler, is placed within the field of view. This allows a person to look at a photograph and have a visual indication of the scale of the objects in it. In the External Tank situation, however, this procedure was not possible. As a solution, Kennedy developed the Scaling and Measurement Device for Photographic Images, which provides a non-intrusive means of adding a scale to a photograph. In addition to meeting Kennedy's needs, scaling images is extremely important in crime and accident scene investigations, oil and chemical tank monitoring, and aerial photography. The innovation consists of a tool that attaches directly to a camera or charge coupled device using a standard screw. Two lasers fitted to the device provide parallel beams that are set 1 inch apart. These lasers enable the device to project a pattern into the field of view. When a photograph is taken, the image of the laser pattern appears, along with the image of the object under investigation, allowing the viewer quantifiable information as to the size of the object. The laser beams are accurate to approximately 200 feet. Windows-based software was developed to work with the scaling device tool. The software provides further techniques to measure objects in photographs and digital images. By using the software, any object in the image can be measured diagonally, vertically, and horizontally. The device and its software enable the user to determine two-dimensional measurements within a photograph.

Source record↗
NASA NTRS2000

Geographical Database Integrity Validation

Airport Safety Modeling Data (ASMD) was developed at the request of a 1997 White House Conference on Aviation Safety and Security. Politicians, military personnel, commercial aircraft manufacturers and the airline industry attended the conference. The objective of the conference was to study the airline industry and make recommendations to improve safety and security. One of the topics discussed at the conference was the loss of situational awareness by aircraft pilots. Loss of situational awareness occurs when a pilot loses his geographic position during flight and can result in crashes into terrain and obstacles. It was recognized at the conference that aviation safety could be improved by reducing the loss of situational awareness. The conference advised that a system be placed in the airplane cockpit that would provide pilots with a visual representation of the terrain around airports. The system would prevent airline crashes during times of inclement weather and loss of situational awareness. The system must be based on accurate data that represents terrain around airports. The Department of Defense and the National Imagery and Mapping Agency (NIMA) released ASMD to be used for the development of a visual system for aircraft pilots. ASMD was constructed from NIMA digital terrain elevation data (DTED).

Jacobs, Derya↗
NASA NTRS1995

Helicopter Human Factors

Even under optimal conditions, helicopter flight is a most demanding form of human-machine interaction, imposing continuous manual, visual, communications, and mental demands on pilots. It is made even more challenging by small margins for error created by the close proximity of terrain in NOE flight and missions flown at night and in low visibility. Although technology advances have satisfied some current and proposed requirements, hardware solutions alone are not sufficient to ensure acceptable system performance and pilot workload. However, human factors data needed to improve the design and use of helicopters lag behind advances in sensor, display, and control technology. Thus, it is difficult for designers to consider human capabilities and limitations when making design decisions. This results in costly accidents, design mistakes, unrealistic mission requirements, excessive training costs, and challenge human adaptability. NASA, in collaboration with DOD, industry, and academia, has initiated a program of research to develop scientific data bases and design principles to improve the pilot/vehicle interface, optimize training time and cost, and maintain pilot workload and system performance at an acceptable level. Work performed at Ames, and by other research laboratories, will be reviewed to summarize the most critical helicopter human factors problems and the results of research that has been performed to: (1) Quantify/model pilots use of visual cues for vehicle control; (2) Improve pilots' performance with helmet displays of thermal imagery and night vision goggles for situation awareness and vehicle control; (3) Model the processes by which pilots encode maps and compare them to the visual scene to develop perceptually and cognitively compatible electronic map formats; (4) Evaluate the use of spatially localized auditory displays for geographical orientation, target localization, radio frequency separation; (5) Develop and flight test control/display concepts; (6) Quantify, model, predict, and improve pilots, workload-management strategies; and (7) Design computer-game trainers to reduce training time and cost.

Hart, Sandra G.↗
NASA NTRS1973

A tactual pilot aid for the approach-and-landing task: Inflight studies

A pilot aid -- a kinesthetic-tactual compensatory display -- for assisting novice pilots in various inflight situations has undergone preliminary inflight testing. The efficacy of this display, as compared with two types of visual displays, was evaluated in both a highly structured approach-and-landing task and a less structured test involving tight turns about a point. In both situations, the displayed quantity was the deviation (alpha sub 0 - alpha) in angle at attack from a desired value alpha sub 0. In the former, the performance with the tactual display was comparable with that obtained using a visual display of (alpha sub 0 - alpha), while in the later, substantial improvements (reduced tracking error (55%), decreased maximum altitude variations (67%), and decreased speed variations (43%)), were obtained using the tactual display. It appears that such a display offers considerable potential for inflight use.

Gilson, R. D.↗
NASA NTRS1991

Display formatting techniques for improving situation awareness in the aircraft cockpit

Possible modifications of primary flight instruments for attitude control and navigation were examined including a display perspective, frames of reference, and the incorporation of directional color to enhance visual momentum. A low-fidelity fixed-wing flight simulation was evaluated. It is concluded that situation awareness measured by flight performance and recovery from disorientation events, was best maintained with the planar outside-in display, whereas color coding improved the performance on the planar inside-out display.

Andre, Anthony D.↗
NASA NTRS2012

Sensing and Virtual Worlds - A Survey of Research Opportunities

Virtual Worlds (VWs) have been used effectively in live and constructive military training. An area that remains fertile ground for exploration and a new vision involves integrating various traditional and now non-traditional sensors into virtual worlds. In this paper, we will assert that the benefits of this integration are several. First, we maintain that virtual worlds offer improved sensor deployment planning through improved visualization and stimulation of the model, using geo-specific terrain and structure. Secondly, we assert that VWs enhance the mission rehearsal process, and that using a mix of live avatars, non-player characters, and live sensor feeds (e.g. real time meteorology) can help visualization of the area of operations. Finally, tactical operations are improved via better collaboration and integration of real world sensing capabilities, and in most situations, 30 VWs improve the state of the art over current "dots on a map" 20 geospatial visualization. However, several capability gaps preclude a fuller realization of this vision. In this paper, we identify many of these gaps and suggest research directions

Moore, Dana↗
NASA NTRS2013

Commercial Off-The-Shelf (COTS) Graphics Processing Board (GPB) Radiation Test Evaluation Report

Large round trip communications latency for deep space missions will require more onboard computational capabilities to enable the space vehicle to undertake many tasks that have traditionally been ground-based, mission control responsibilities. As a result, visual display graphics will be required to provide simpler vehicle situational awareness through graphical representations, as well as provide capabilities never before done in a space mission, such as augmented reality for in-flight maintenance or Telepresence activities. These capabilities will require graphics processors and associated support electronic components for high computational graphics processing. In an effort to understand the performance of commercial graphics card electronics operating in the expected radiation environment, a preliminary test was performed on five commercial offthe- shelf (COTS) graphics cards. This paper discusses the preliminary evaluation test results of five COTS graphics processing cards tested to the International Space Station (ISS) low earth orbit radiation environment. Three of the five graphics cards were tested to a total dose of 6000 rads (Si). The test articles, test configuration, preliminary results, and recommendations are discussed.

Salazar, George A.↗
NASA NTRS2015

Avionics Configuration Assessment for Flightdeck Interval Management: A Comparison of Avionics and Notification Methods

Flightdeck Interval Management is one of the NextGen operational concepts that FAA is sponsoring to realize requisite National Airspace System (NAS) efficiencies. Interval Management will reduce variability in temporal deviations at a position, and thereby reduce buffers typically applied by controllers - resulting in higher arrival rates, and more efficient operations. Ground software generates a strategic schedule of aircraft pairs. Air Traffic Control (ATC) provides an IM clearance with the IM spacing objective (i.e., the TTF, and at which point to achieve the appropriate spacing from this aircraft) to the IM aircraft. Pilots must dial FIM speeds into the speed window on the Mode Control Panel in a timely manner, and attend to deviations between actual speed and the instantaneous FIM profile speed. Here, the crew is assumed to be operating the aircraft with autothrottles on, with autopilot engaged, and the autoflight system in Vertical Navigation (VNAV) and Lateral Navigation (LNAV); and is responsible for safely flying the aircraft while maintaining situation awareness of their ability to follow FIM speed commands and to achieve the FIM spacing goal. The objective of this study is to examine whether three Notification Methods and four Avionics Conditions affect pilots' performance, ratings on constructs associated with performance (workload, situation awareness), or opinions on acceptability. Three Notification Methods (alternate visual and aural alerts that notified pilots to the onset of a speed target, conformance deviation from the required speed profile, and reminded them if they failed to enter the speed within 10 seconds) were examined. These Notification Methods were: VVV (visuals for all three events), VAV (visuals for all three events, plus an aural for speed conformance deviations), and AAA (visual indications and the same aural to indicate all three of these events). Avionics Conditions were defined by the instrumentation (and location) used to present IM information to crews: (1) Integrated (IM information is embedded in extant PFD (Primary Flight Display), ND (Navigation Display), EICAS (Engine Indicating and Crew Alerting System) displays); (2) EFB_Aft (IM information is only supplied in an EFB and mounted in location similar to that for MITRE's UPS work); (3) EFB_Fore (IM information is only supplied in an EFB which is mounted more forward, under the side window), and (4) EFB_Aft plus use of an AGD (the same IM information is supplied in an EFB and on an AGD, both mounted in locations similar to that in MITRE's UPS work ). Twelve commercial pilot crews flew descent scenarios (VNAV Speed with the mode control panel (MCP) speed window open until flaps extended, then VNAV Path) in a commercial transport flight simulator with realistic visual scene and communications. The results of this study serve three practical aims: (1) contribute to the down-select of avionics configuration for future assessment of the ASTAR spacing algorithm at NASA; (2) provide information useful to the FAA Human Factors Division (ANG-C1)'s mission to identify issues pertinent to flight certification of, and flight standards; (3) identify methodological considerations in support of future FIM human-in-the-loop (HITL) investigations.

Latorella, Kara A.↗
NASA NTRSDate not supplied

NASA's Research & Development in Airspace Management for Drones, Air Taxis, and Beyond

Today's National Airspace System is extremely safe. Multiple people and organizations are involved in the handling of flights at all phases. We are, however, at the dawn of a new era in aviation where new entrants are emerging from multiple domains. These new entrants will need to be integrated into the airspace safely and given the flexibility to scale. With that integration and flexibility comes the need and responsibility to develop concepts and systems that will work with the regulatory and operational needs of the Federal Aviation Administration while accounting for the needs of industry. NASA is at the leading edge of research, development, and testing across multiple domains to enable the realization of new entrants such as drones, air cargo and taxis, and high altitude vehicles. Addressing the potential for public good coming from these new capabilities is also a NASA focus area. While there has been considerable effort in the engineering aspects of this research, another thrust that is of importance is that of data integration and visualization. With respect to visualization, NASA Ames Research Center has been leading the advancement in data visualization for these new domains and has spent considerable efforts in the exploration of incorporating Augmented and Mixed Reality as a situation awareness platform. This presentation will outline the new developments in airspace integration and tie in NASA's efforts in visualizing the associated operational data.

airspace management↗
NASA NTRS2009

Flight Deck Display Technologies for 4DT and Surface Equivalent Visual Operations

NASA research is focused on flight deck display technologies that may significantly enhance situation awareness, enable new operating concepts, and reduce the potential for incidents/accidents for terminal area and surface operations. The display technologies include surface map, head-up, and head-worn displays; 4DT guidance algorithms; synthetic and enhanced vision technologies; and terminal maneuvering area traffic conflict detection and alerting systems. This work is critical to ensure that the flight deck interface technologies and the role of the human participants can support the full realization of the Next Generation Air Transportation System (NextGen) and its novel operating concepts.

Prinzel, Lawrence J., III↗
NASA NTRS2006

Intelligent Weather Agent

Method and system for automatically displaying, visually and/or audibly and/or by an audible alarm signal, relevant weather data for an identified aircraft pilot, when each of a selected subset of measured or estimated aviation situation parameters, corresponding to a given aviation situation, has a value lying in a selected range. Each range for a particular pilot may be a default range, may be entered by the pilot and/or may be automatically determined from experience and may be subsequently edited by the pilot to change a range and to add or delete parameters describing a situation for which a display should be provided. The pilot can also verbally activate an audible display or visual display of selected information by verbal entry of a first command or a second command, respectively, that specifies the information required.

Spirkovska, Liljana↗
NASA NTRS1994

Flight test of takeoff performance monitoring system

The Takeoff Performance Monitoring System (TOPMS) is a computer software and hardware graphics system that visually displays current runway position, acceleration performance, engine status, and other situation advisory information to aid pilots in their decision to continue or to abort a takeoff. The system was developed at the Langley Research Center using the fixed-base Transport Systems Research Vehicle (TSRV) simulator. (The TSRV is a highly modified Boeing 737-100 research airplane.) Several versions of the TOPMS displays were evaluated on the TSRV B-737 simulator by more than 40 research, United States Air Force, airline and industry and pilots who rated the system satisfactory and recommended further development and testing. In this study, the TOPMS was flight tested on the TSRV. A total of 55 takeoff and 30 abort situations were investigated at 5 airfields. TOPMS displays were observed on the navigation display screen in the TSRV research flight deck during various nominal and off-nominal situations, including normal takeoffs; reduced-throttle takeoffs; induced-acceleration deficiencies; simulated-engine failures; and several gross-weight, runway-geometry, runway-surface, and ambient conditions. All tests were performed on dry runways. The TOPMS software executed accurately during the flight tests and the displays correctly depicted the various test conditions. Evaluation pilots found the displays easy to monitor and understand. The algorithm provides pretakeoff predictions of the nominal distances that are needed to accelerate the airplane to takeoff speed and to brake it to a stop; these predictions agreed reasonably well with corresponding values measured during several fully executed and aborted takeoffs. The TOPMS is operational and has been retained on the TSRV for general use and demonstration.

Middleton, David B.↗