Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Computer Modeling of Real-Time Dynamic Lighting

Space Station tasks involve procedures that are very complex and highly dependent on the availability of visual information. In many situations, cameras are used as tools to help overcome the visual and physical restrictions associated with space flight. However, these cameras are effected by the dynamic lighting conditions of space. Training for these is conditions is necessary. The current project builds on the findings of an earlier NRA funded project, which revealed improved performance by humans when trained with computer graphics and lighting effects such as shadows and glare.

Maida, James C.↗

Foveal vision reduces neural resources in agent-based game learning

Efficient processing of information is crucial for the optimization of neural resources in both biological and artificial visual systems. In this paper, we study the efficiency that may be obtained via the use of a fovea. Using biologically-motivated agents, we study visual information processing, learning, and decision making in a controlled artificial environment, namely the Atari Pong video game. We compare the resources necessary to play Pong between agents with and without a fovea. Our study shows that a fovea can significantly reduce the neural resources, in the form of number of neurons, number of synapses, and number of computations, while at the same time maintaining performance at playing Pong. To our knowledge, this is the first study in which an agent must simultaneously optimize its visual system, along with its decision making and action generation capabilities. That is, the visual system is integral to a complete agent.

60 APPLIED LIFE SCIENCES↗

Using Visualization in Cockpit Decision Support Systems

In order to safely operate their aircraft, pilots must make rapid decisions based on integrating and processing large amounts of heterogeneous information. Visual displays are often the most efficient method of presenting safety-critical data to pilots in real time. However, care must be taken to ensure the pilot is provided with the appropriate amount of information to make effective decisions and not become cognitively overloaded. The results of two usability studies of a prototype airflow hazard visualization cockpit decision support system are summarized. The studies demonstrate that such a system significantly improves the performance of helicopter pilots landing under turbulent conditions. Based on these results, design principles and implications for cockpit decision support systems using visualization are presented.

Aragon, Cecilia R.↗

An information maximization model of eye movements

We propose a sequential information maximization model as a general strategy for programming eye movements. The model reconstructs high-resolution visual information from a sequence of fixations, taking into account the fall-off in resolution from the fovea to the periphery. From this framework we get a simple rule for predicting fixation sequences: after each fixation, fixate next at the location that minimizes uncertainty (maximizes information) about the stimulus. By comparing our model performance to human eye movement data and to predictions from a saliency and random model, we demonstrate that our model is best at predicting fixation locations. Modeling additional biological constraints will improve the prediction of fixation sequences. Our results suggest that information maximization is a useful principle for programming eye movements.

NASA Discipline Neuroscience↗

Model Assessment Wizard (MAW)

SAND2026-18710O The Model Assessment Wizard (MAW) is a tool for evaluating ontologies and provides users with a comprehensive workbench for analysis. MAW features sub-modules for visualization, alignment, Shapes Constraint Language (SHACL) and Web Ontology Language (OWL) constraints, and simplification. Users can upload data, identify missing information, visualize ontologies, and update constraints. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Murdock, Jaimie [Sandia National Lab. (SNL-CA), Li↗

Research and Educational Opportunities with NASA GSFC

The research carried out in the Earth sciences at NASA's Goddard Space Flight Center will be the focus of the presentation. These research interests span the full breath of disciplines in Earth System Science. Branches and research groups focus on areas as diverse as planetary geomagnetics and atmospheric chemistry. There are 4 major laboratories in the directorate and 2 organizations that focus on scientific information technology. These laboratories focus on atmospheric sciences (atmospheric chemistry, climate and radiation, regional processes, atmospheric modeling), hydrological sciences (snow, ice, oceans, and seasonal-to-interannual prediction), terrestrial physics (geology, terrestrial biology, land-atmosphere interactions, geophysics), climate modeling (global warming, greenhouse gases, climate change). Two of the labs also have branches that focus on sensor development especially using lidar and microwave technologies. In the information technologies, areas of scientific and technical research, and expertise include massively parallel computers, technologies for high speed electronic networks, scientific visualization, information systems, archive and distribution systems, and information processing. Examples will be presented from each of these research disciplines.

Meeson, Blanche W.↗

NeuralCubes: Deep Representations for Visual Data Exploration

Visual exploration of large multi-dimensional datasets has seen tremendous progress in recent years, allowing users to express rich data queries that produce informative visual summaries, all in real time. Techniques based on data cubes are some of the most promising approaches. However, these techniques usually require a large memory footprint for large datasets. To tackle this problem, we present NeuralCubes: neural networks that predict results for aggregate queries, similar to data cubes. NeuralCubes learns a function that takes as input a given query, for instance, a geographic region and temporal interval, and outputs the result of the query. The learned function serves as a real-time, low-memory approximator for aggregation queries. Our models are small enough to be sent to the client side (e.g. the web browser for a web-based application) for evaluation, enabling data exploration of large datasets without database/network connection. Here, we demonstrate the effectiveness of NeuralCubes through extensive experiments on a variety of datasets and discuss how NeuralCubes opens up opportunities for new types of visualization and interaction.

97 MATHEMATICS AND COMPUTING↗

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions.This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

synthetic data↗

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions. This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

James Ecker↗

A User-Centered Design Study in Scientific Visualization Targeting Domain Experts

The development of usable visualization solutions is essential for ensuring both their adoption and effectiveness. User-centered design principles, which involve users throughout the entire development process, have been shown to be effective in numerous information visualization endeavors. We describe how we applied these principles in scientific visualization over a two year collaboration to develop a hybrid in situ/post hoc solution tailored towards combustion researcher needs. Lastly, we examine the importance of user-centered design and lessons learned over the design process in an effort to aid others seeking to develop effective scientific visualization solutions.

97 MATHEMATICS AND COMPUTING↗

Proprioceptive information about target location suppresses autokinesis

An experimental study of autokinesis perceived by subjects who had proprioceptive information about target locations was conducted. When subjects were permitted to grasp the target light mount, their perceptions of autokinesis were found to be fewer and of smaller magnitude than when only visual information about the target location was available. The decrease in autokinesis was correlated with an enhancement of oculomotor control.

Lackner, J. R.↗

The effects of viewpoint on the virtual space of pictures

Pictorial displays whose primary purpose is to convey accurate information about the 3-D spatial layout of an environment are discussed. How and how well, pictures can convey such information is discussed. It is suggested that picture perception is not best approached as a unitary, indivisible process. Rather, it is a complex process depending on multiple, partially redundant, interacting sources of visual information for both the real surface of the picture and the virtual space beyond. Each picture must be assessed for the particular information that it makes available. This will determine how accurately the virtual space represented by the picture is seen, as well as how it is distorted when seen from the wrong viewpoint.

Sedgwick, H. A.↗

Learning to predict slip for ground robots

In this paper we predict the amount of slip an exploration rover would experience using stereo imagery by learning from previous examples of traversing similar terrain. To do that, the information of terrain appearance and geometry regarding some location is correlated to the slip measured by the rover while this location is being traversed. This relationship is learned from previous experience, so slip can be predicted later at a distance from visual information only.

robots↗

Changes in apparent body orientation and sensory localization induced by vibration of postural muscles - Vibratory myesthetic illusions

Human experiments are carried out which support the observation of Goodwin (1973) and Goodwin et al. (1972) that vibration of skeletal muscles can elicit illusory limb motion. These experiments extend the class of possible myesthetic illusions by showing that vibration of the appropriate muscles can produce illusory body motion in nearly any desired direction. Such illusory changes in posture occur only when visual information about body orientation is absent; these changes in apparent posture are sometimes accompanied by a slow-phase nystagmus that compensates for the direction of apparent body motion. During illusory body motion a stationary target light that is fixated will appear to move with the body at the same apparent velocity. However, this pattern of apparent body motion and conjoint visual - defined as propriogyral illusion - is suppressed if the subject is in a fully illuminated environment providing cues about true body orientation. Persuasive evidence is thus provided for the contribution of both muscle afferent and touch-pressure information to the supraspinal mechanisms that determine apparent orientation on the basis of ongoing patterns of interoceptive and exteroceptive activity.

Lackner, J. R.↗

Nonlinear encoding in diffractive information processing using linear optical materials

Nonlinear encoding of optical information can be achieved using various forms of data representation. Here, we analyze the performances of different nonlinear information encoding strategies that can be employed in diffractive optical processors based on linear materials and shed light on their utility and performance gaps compared to the state-of-the-art digital deep neural networks. For a comprehensive evaluation, we used different datasets to compare the statistical inference performance of simpler-to-implement nonlinear encoding strategies that involve, e.g., phase encoding, against data repetition-based nonlinear encoding strategies. We show that data repetition within a diffractive volume (e.g., through an optical cavity or cascaded introduction of the input data) causes the loss of the universal linear transformation capability of a diffractive optical processor. Therefore, data repetition-based diffractive blocks cannot provide optical analogs to fully connected or convolutional layers commonly employed in digital neural networks. However, they can still be effectively trained for specific inference tasks and achieve enhanced accuracy, benefiting from the nonlinear encoding of the input information. Our results also reveal that phase encoding of input information without data repetition provides a simpler nonlinear encoding strategy with comparable statistical inference accuracy to data repetition-based diffractive processors. Our analyses and conclusions would be of broad interest to explore the push-pull relationship between linear material-based diffractive optical systems and nonlinear encoding strategies in visual information processors.

42 ENGINEERING↗

The Influence of Loss of Visual Cues on Pilot Performance During the Final Approach and Landing Phase of a Remotely Piloted Vehicle Mission

Remotely piloted research vehicles (RPRVS) are currently being flown from fixed-base control centers, and visual information is supplied to the remote pilot by a TV camera mounted in the vehicle. In these circumstances, the possibility of a TV failure or an interruption in the downlink to the pilot must be considered. To determine the influence of loss of TV information on pilot performance during the final approach and landing phase of a mission, an experiment was conducted in which pilots were asked to fly a fixed-base simulation of a Piper PA-30 aircraft with loss of TV information occurring at altitudes of 15.24, 30.48, and 45.72 m (50, 100, and 150 ft). For this experiment, a specially designed display configuration was presented to four pilots in accordance with a Latin square design. Initial results indicate that pilots could not ensure successful landings from altitudes exceeding 15.24 m (.50 ft) without the visual cues supplied by the TV picture.

Howard, James C.↗

A PARC system for terminal docking

A Panoramic viewing system for Automated Rendezvous and Capture (PARC) has been proposed as a visual information feedback system for terminal docking/berthing. The system relies on a unique Panoramic Annular Lens (PAL) which captures an image of its surroundings in real time. This paper describes the evolution of the PAL along with technical details of its imaging capabilities. Several examples are given of radial metrology, where PAL imaging systems are used to perform visual inspections and measurements. Digital image acquisition and processing techniques, used to interpret various features appearing in the images and to transform images for improved human viewing, are also included. These discussions are followed by a potential application for PARC involving berthing of active and passive mechanical assemblies associated with Space Station Freedom.

Gilbert, John A.↗

SC-228 Inclusion of DAA Warning Alert for TCAS Interoperability

This white paper summarizes NASA research results that have informed Special Committee 228 (SC-228) discussions and decisions regarding the inclusion of a warning-level alert within the detect and avoid (DAA) alerting structure for unmanned aircraft systems (UAS). For UAS, the removal of the pilot from onboard the aircraft has eliminated the ability of the ground-based pilot in command (PIC) to use out-the-window visual information to make judgments about a potential threat of a loss of well clear with another aircraft. As a result, the DAA traffic display will be the primary source of information that the PIC can use to execute the three primary well clear functions: 1) detect a potential loss of well clear, 2) determine a resolution maneuver, and 3) upload that maneuver to the aircraft via the ground control station (GCS). In addition, pilots are required to coordinate with air traffic control (ATC) prior to maneuvering off of their approved flight plan. In determining an appropriate resolution maneuver to avoid a loss of well clear, the PIC must decide both when and how to maneuver, and both the timeliness and the accuracy (i.e., correctness) of the maneuver are critical to reducing the likelihood and/or severity of a loss of well clear. Alerting information is one of three critical components of the DAA display, along with traffic information elements (e.g., relative heading, speed and altitude) and maneuver guidance. Alerting information and maneuver guidance, in particular, have been found to have a significant impact, both statistically and practically, on pilots' ability to avoid and minimize the severity of losses of well clear While all three display components are key to pilots performing the traffic avoidance task of remaining well clear, in general, alerting information provides crucial information about when a resolution maneuver is required while maneuver guidance assists the pilot in determining how best to maneuver. A fundamental task of the DAA alerting system is to provide critical timing information to the pilot about the potential for a loss of well clear with another aircraft. This is done by employing both temporal and spatial thresholds that indicate to the pilot the likelihood and imminence of a loss of well clear. The design of the DAA alerting thresholds is a balancing act between eliciting the desired pilot response in real loss of well clear threat events and reducing excessive, unnecessary, and/or uncoordinated UAS maneuvering within the air traffic environment; larger thresholds, both spatially and temporally, may increase the likelihood of a pilot avoiding a loss of well clear, but it can also increase the frequency of maneuvering - especially in cases where a maneuver is not actually needed to maintain well clear. A series of human in the loop (HITL) simulations have been conducted as part of NASA's Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) project. The purpose of these HITLs has been to provide empirical results in order to inform development of the minimum human-machine interface requirements for the DAA system. This white paper will present those results which provide evidence of a human performance benefit (in terms of response times and ability to remain well clear of other aircraft) of the DAA warning alert both with and without a collision avoidance system on board the aircraft.

TCAS interoperability↗