Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual representations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Factorized visual representations in the primate visual system and deep neural networks

Object classification has been proposed as a principal objective of the primate ventral visual stream and has been used as an optimization target for deep neural network models (DNNs) of the visual system. However, visual brain areas represent many different types of information, and optimizing for classification of object identity alone does not constrain how other information may be encoded in visual representations. Information about different scene parameters may be discarded altogether (‘invariance’), represented in non-interfering subspaces of population activity (‘factorization’) or encoded in an entangled fashion. In this work, we provide evidence that factorization is a normative principle of biological visual representations. In the monkey ventral visual hierarchy, we found that factorization of object pose and background information from object identity increased in higher-level regions and strongly contributed to improving object identity decoding performance. We then conducted a large-scale analysis of factorization of individual scene parameters – lighting, background, camera viewpoint, and object pose – in a diverse library of DNN models of the visual system. Models which best matched neural, fMRI, and behavioral data from both monkeys and humans across 12 datasets tended to be those which factorized scene parameters most strongly. Notably, invariance to these parameters was not as consistently associated with matches to neural and behavioral data, suggesting that maintaining non-class information in factorized activity subspaces is often preferred to dropping it altogether. Thus, we propose that factorization of visual scene information is a widely used strategy in brains and DNN models thereof.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1989

Separate visual representations for perception and for visually guided behavior

Converging evidence from several sources indicates that two distinct representations of visual space mediate perception and visually guided behavior, respectively. The two maps of visual space follow different rules; spatial values in either one can be biased without affecting the other. Ordinarily the two maps give equivalent responses because both are veridically in register with the world; special techniques are required to pull them apart. One such technique is saccadic suppression: small target displacements during saccadic eye movements are not preceived, though the displacements can change eye movements or pointing to the target. A second way to separate cognitive and motor-oriented maps is with induced motion: a slowly moving frame will make a fixed target appear to drift in the opposite direction, while motor behavior toward the target is unchanged. The same result occurs with stroboscopic induced motion, where the frame jump abruptly and the target seems to jump in the opposite direction. A third method of separating cognitive and motor maps, requiring no motion of target, background or eye, is the Roelofs effect: a target surrounded by an off-center rectangular frame will appear to be off-center in the direction opposite the frame. Again the effect influences perception, but in half of the subjects it does not influence pointing to the target. This experience also reveals more characteristics of the maps and their interactions with one another, the motor map apparently has little or no memory, and must be fed from the biased cognitive map if an enforced delay occurs between stimulus presentation and motor response. In designing spatial displays, the results mean that what you see isn't necessarily what you get. Displays must be designed with either perception or visually guided behavior in mind.

Bridgeman, Bruce↗
NASA NTRS2002

The Statistics of Visual Representation

The experience of retinex image processing has prompted us to reconsider fundamental aspects of imaging and image processing. Foremost is the idea that a good visual representation requires a non-linear transformation of the recorded (approximately linear) image data. Further, this transformation appears to converge on a specific distribution. Here we investigate the connection between numerical and visual phenomena. Specifically the questions explored are: (1) Is there a well-defined consistent statistical character associated with good visual representations? (2) Does there exist an ideal visual image? And (3) what are its statistical properties?

Jobson, Daniel J.↗
DOE OSTI2021

Detecting operons in bacterial genomes via visual representation learning

Contiguous genes in prokaryotes are often arranged into operons. Detecting operons plays a critical role in inferring gene functionality and regulatory networks. Human experts annotate operons by visually inspecting gene neighborhoods across pileups of related genomes. These visual representations capture the inter-genic distance, strand direction, gene size, functional relatedness, and gene neighborhood conservation, which are the most prominent operon features mentioned in the literature. By studying these features, an expert can then decide whether a genomic region is part of an operon. We propose a deep learning based method named Operon Hunter that uses visual representations of genomic fragments to make operon predictions. Using transfer learning and data augmentation techniques facilitates leveraging the powerful neural networks trained on image datasets by re-training them on a more limited dataset of extensively validated operons. Our method outperforms the previously reported state-of-the-art tools, especially when it comes to predicting full operons and their boundaries accurately. Furthermore, our approach makes it possible to visually identify the features influencing the network’s decisions to be subsequently cross-checked by human experts.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Numerical and Visual Representations of Uncertainty Lead to Different Patterns of Decision Making

Although visualizations are a useful tool for helping people to understand information, they can also have unintended effects on human cognition. This is especially true for uncertain information, which is difficult for people to understand. Prior work has found that different methods of visualizing uncertain information can produce different patterns of decision making from users. However, uncertainty can also be represented via text or numerical information, and few studies have systematically compared these types of representations to visualizations of uncertainty. We present two experiments that compared visual representations of risk (icon arrays) to numerical representations (natural frequencies) in a wildfire evacuation task. Like prior studies, we found that different types of visual cues led to different patterns of decision making. In addition, our comparison of visual and numerical representations of risk found that people were more likely to evacuate when they saw visualizations than when they saw numerical representations. These experiments reinforce the idea that design choices are not neutral: seemingly minor differences in how information is represented can have important impacts on human risk perception and decision making.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1989

The evaluative imaging of mental models - Visual representations of complexity

The paper deals with some design issues involved in building a system that could visually represent the semantic structures of training materials and their underlying mental models. In particular, hypermedia-based semantic networks that instantiate classification problem solving strategies are thought to be a useful formalism for such representations; the complexity of these web structures can be best managed through visual depictions. It is also noted that a useful approach to implement in these hypermedia models would be some metrics of conceptual distance.

Dede, Christopher↗
NASA NTRS1989

Receptive fields and visual representations

Efficient representation of images for human use requires an understanding of how the brain processes and represents visual information. Spatial imagery is represented in the brain in the receptive fields of visual neurons. Models of these neurons lead to models of image fidelity, and to digital implementations of these neural codes. This approach will be illustrated by two example codes. The advantages and difficulties of this approach will be discussed.

Watson, Andrew B.↗
NASA NTRS2004

Texture-Based Correspondence Display

Texture-based correspondence display is a methodology to display corresponding data elements in visual representations of complex multidimensional, multivariate data. Texture is utilized as a persistent medium to contain a visual representation model and as a means to create multiple renditions of data where color is used to identify correspondence. Corresponding data elements are displayed over a variety of visual metaphors in a normal rendering process without adding extraneous linking metadata creation and maintenance. The effectiveness of visual representation for understanding data is extended to the expression of the visual representation model in texture.

Gerald-Yamasaki, Michael↗
DOE OSTI2023

System and method associated with expedient detection and reconstruction of cyber events in a compact scenario representation using provenance tags and customizable policy

A system associated with detecting a cyber-attack and reconstructing events associated with a cyber-attack campaign, is disclosed. The system performs various operations that include receiving an audit data stream associated with cyber events. The system identifies trustworthiness values in a portion of data associated with the cyber events and assigns provenance tags to the portion of the data based on the identified trustworthiness values. An initial visual representation is generated based on the assigned provenance tags to the portion of the data. The initial visual representation is condensed based on a backward traversal of the initial visual representation in identifying a shortest path from a suspect node to an entry point node. A scenario visual representation is generated that specifies nodes most relevant to the cyber events associated with the cyber-attack based on the identified shortest path.A corresponding method and computer-readable medium are also disclosed.

Source record↗
NASA NTRS2011

Visual Image Sensor Organ Replacement: Implementation

Method and system for enhancing or extending visual representation of a selected region of a visual image, where visual representation is interfered with or distorted, by supplementing a visual signal with at least one audio signal having one or more audio signal parameters that represent one or more visual image parameters, such as vertical and/or horizontal location of the region; region brightness; dominant wavelength range of the region; change in a parameter value that characterizes the visual image, with respect to a reference parameter value; and time rate of change in a parameter value that characterizes the visual image. Region dimensions can be changed to emphasize change with time of a visual image parameter.

Maluf, A. David↗
NASA NTRS1995

Using program visualization to enhance maintainability and promote reuse

Our intuition is that comprehension of visual representations is often quicker than of equivalent text. In the work described in this paper, we explore the application of this intuition to programming languages. The goal of this project is to create visual representation of segments of computer programs that improve the maintenance and reusability of this code. We describe a software tool, a program browser, that provides a visual representation of the function call graph of any C program. This tool is the first in a series of tools that aids program comprehension, making reuse of existing programs more likely. The development of the program browser is itself an example of code reuse as described in the section on implementation. Although our intuition is that some visual display of programs aid understandability, we are looking for experimental verification. Several human factors experiments in this area have contradicted this intuition. We describe reasons for these contradictions, and potential solutions to overcome them.

Ames, Chuck↗
DOE OSTI2023

NeRVI: Compressive neural representation of visualization images for communicating volume visualization results

We present NeRVI, a new deep-learning approach that compresses a large collection of visualization images generated from time-varying data for communicating volume visualization results. Based on an image-based implicit neural representation, our approach represents tens of thousands of high-resolution rendering images parametrized by different parameters via a hybrid model of multilayer perceptrons and convolutional neural networks. Here, our model predicts images and corresponding masks, and the masks are utilized for loss computation and network training to capture fine structural details and small components. In conjunction with model quantization and weight encoding, NeRVI yields highly compact compressive neural representations while preserving the image fidelity well. We demonstrate the effectiveness of NeRVI with isosurface rendering and direct volume rendering images generated from multiple data sets and compare NeRVI with other state-of-the-art deep learning-based (InSituNet, SIREN, NeRF, and NeRV) methods. Quantitative and qualitative results show that NeRVI provides an alternative solution that augments domain scientists' ability to manage, represent, and communicate scientific visualization output.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2004

Microscopic and Metallurgical Aspects of the Space Shuttle Columbia Accident Investigation and Reconstruction

The Space Shuttle Columbia was descending for a landing at the Kennedy Space Center (KSC) on February 1, 2003. Approximately 20 minutes prior to touchdown, the Columbia began disintegrating over the western United States; the majority of debris eventually impacted in eastern Texas and western Louisiana. A monumental effort eventually recovered approximately 84,000 pieces of debris, approximately 38% of the Orbiter's original dry weight. The debris was transported to KSC, where the items were catalogued and evaluated. Critical areas of interest, such as the left and right leading edge surfaces and the underside of the ship, were placed upon a grid to aid in the reconstruction. Items of interest included metallic structures, reinforced carbon-carbon composites, and ceramic heat insulation tiles. Many of the leading edge elements had re-solidified metallic deposits spattered on them. These deposits became known as slag and were one of the main focuses of the investigation. In order to help determine the sequence of events inside the left wing during the accident, the slag's composition, layering order, and directionality of deposition were studied. A myriad of analytical tests were performed in an attempt to ascertain the compositional and depositional characteristics of selected slag deposits, including the ordering of deposited layers within each individual slag deposit harvested. Initially, Scanning Electron Microscopy and Energy Dispersive X-Ray Spectroscopy (SEM/EDX) were performed to quickly characterize the overall composition of individual slag deposits: SEM utilizes a narrowlyfocused high-energy electron beam impinging upon a specimen. The incident beam excites and liberates lower energy secondary electrons, which are detected and analyzed, providing a visual representation of the sample's surface topography. EDX also relies on an incident electron beam, except an EDX unit measures X-ray energies generated by the impinging beam. Each element generates a unique X-ray signature; the EDX detector measures these discreet energies. EDX actually penetrates approximately 2 microns into the bulk of the sample. However, random examination of various portions of slag, coupled with the semiquantitative nature of the SEM/EDX analysis, did not yield convincingly pertinent data. Therefore, X-ray dot mapping was conducted, which provided more understandable data, both in terms of slag layering and composition. An X-ray dot map is generated by performing numerous EDX scans for individual elements, then compiling the scans in a visual representation. Eventually, specimens consisting of not only the slag, but of the adjacent RCC substrate as well were cross-sectioned. X-Ray dot mapping of the materialographicallymounted and -polished cross- sections provided a visual representation of both the layering sequence and compositional characteristics of the slag. Contemporaneously, Electron Spectroscopy for Chemical Analysis/X-Ray Photoelectron Spectroscopy (ESCA/XPS) and powdered X-Ray Diffraction (XRD) were performed to further characterize the deposits and to attempt to identify what, if any, compounds were present. The ESCA/XPS analysis allowed the analyst to "sputter" into the sample with an electron gun, aiding in the identification of the layering sequence. XPS uses photons, rather than electrons, which impinge upon the surface of the sample. XPS measures the electrons emitted from within the first 5 nm of the sample's surface. The XRD measures the scatter angles of incident X-rays; the angle and intensity of scatter depend upon the crystalline structure of the pulverized sample. XRD is considered a qualitative rather than quantitative technique. ESCA/XPS revealed that the final layer to deposit was predominantly carbonaceous. XRD was successful in identifying specific compounds, such as Al 2O3, Al and/or Al3 21SiO47, mullite (3(Al2)O3 -SiO2), and nickel-aluminides. Eventually, Electron MicroProbe Analysis (EMPA) was conducted on the marialographically-prepared cross- sections of selected slag deposits. Microprobe combines SEM and Wavelength Dispersive X-Ray Spectroscopy (WDS), and, like EDX, uses a narrowly-focused high-energy electron beam impinging upon a specimen to elicit, in the case of EPMA, characteristic X-rays with specific wavelengths. This quantitative, analytical tool proved the most useful in determining depositional layering and composition of the slag deposits. This information was utilized in verifying the location of the breach in the left leading edge of the wing of the Columbia.

McDaniels, Steven J.↗
DOE OSTI2019

Visualizing Hierarchical Performance Profiles of Parallel Codes Using CallFlow

Calling context trees (CCTs) couple performance metrics with call paths, helping understand the execution and performance of parallel programs. To identify performance bottlenecks, programmers and performance analysts visually explore CCTs to form and validate hypotheses regarding degraded performance. However, due to the complexity of parallel programs, existing visual representations do not scale to applications running on a large number of processors. In this work, we present CallFlow, an interactive visual analysis tool that provides a high-level overview of CCTs together with semantic refinement operations to progressively explore CCTs. Using a flow-based metaphor, we visualize a CCT by treating execution time as a resource spent during the call chain, and demonstrate the effectiveness of our design with case studies on large-scale, production simulation codes.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1999

Technology Assessment of High Capacity Data Storage Systems: Can We Avoid a Data Survivability Crisis?

In a recent address at the California Science Center in Los Angeles, Vice President Al Gore articulated a Digital Earth Vision. That vision spoke to developing a multi-resolution, three-dimensional visual representation of the planet into which we can roam and zoom into vast quantities of embedded geo-referenced data. The vision was not limited to moving through space, but also allowing travel over a time-line, which can be set for days, years, centuries, or even geological epochs. A working group of Federal Agencies, developing a coordinated program to implement the Vice President's vision, developed the definition of the Digital Earth as a visual representation of our planet that enables a person to explore and interact with the vast amounts of natural and cultural geo-referenced information gathered about the Earth. One of the challenges identified by the agencies was whether the technology existed that would be available to permanently store and deliver all the digital data that enterprises might want to save for decades and centuries. Satellite digital data is growing by Moore's Law as is the growth of computer generated data. Similarly, the density of digital storage media in our information-intensive society is also increasing by a factor of four every three years. The technological bottleneck is that the bandwidth for transferring data is only growing at a factor of four every nine years. This implies that the migration of data to viable long-term storage is growing more slowly. The implication is that older data stored on increasingly obsolete media are at considerable risk if they cannot be continuously migrated to media with longer life times. Another problem occurs when the software and hardware systems for which the media were designed are no longer serviced by their manufacturers. Many instances exist where support for these systems are phased out after mergers or even in going out of business. In addition, survivability of older media can suffer from physical breakdown of components (e.g. tapes simply lose their magnetic properties after a long time in storage). As a result, a potential data survivability crisis is emerging. The scale of the crisis is comparable to that facing the Social Security System. Sometime in one or two decades, the exponential growth of data will become so great that many enterprises will not be able to migrate through their data to more permanent media during the lifetime of the media on which it resides. This will result in significant losses of data and their resultant impacts. To avoid this crisis, we need to plan and devote greater financial and intellectual resources are needed for the development and refinement of new storage media and migration technologies in order to preserve all data any organization determines worth saving permanently. This talk will explore technological solutions and suggested recommendations to address this technological data crisis.

Halem, Milton↗
NASA NTRS2010

COTS/CRS: KSC Evolving Host Initiatives with Commercial Space Partners

NASA's Commercial Crew and Cargo Program Office (C3PO) leads the agency's commercial efforts to stimulate United States private companies as the shuttle program comes to a close. Through the Commercial Orbital Transportation Services (COTS) program, two companies, SpaceX and Orbital, were selected to demonstrate their ability to perform flights to the International Space Station. The Commercial Resupply Services (CRS) Project leverages off the COTS experience, and awarded these two private companies contracts to resupply the International Space Station after shuttle fly out. As a 2010 summer intern, I supported the COTS/CRS team in their team meetings, attended and contributed to project discussions and planning, and assisted in developing visual representations for the variety of processes and organizational endeavors required for the program to run smoothly. One aspect of the COTS/CRS program gives the involved private companies the opportunity to request available services from Kennedy Space Center (KSC); one of my projects included assisting in the development of a related Task Order Request (TOR) process. In addition, an integral part of the project was to maintain and enhance the team database for processing the variety of TORS. My experience in the project gave me great insight into the growing field of commercial space activities. The development of the TOR process involved coordinating representatives from a variety of backgrounds at KSC. A clear and concise visual representation of the TOR process in the form of a flow chart was necessary to successfully implement a task order request from one of NASA's commercial partners. The goals of the process charts were to communicate the team's ideas and foster a common thought process while at the same time allow the process to grow and evolve. It was critical that the requests from the private companies were addressed quickly and thoroughly as the process developed this summer is expected to have extensive future use.

Yohpe, Megan↗