Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

The Solar-Sail Launched Interstellar Probe: Pre-Perihelion Trajectories and Application of Holography

Design of missions beyond our solar system presents many challenges. Here, we consider certain aspects of the solar-sail launched interstellar probe (ISP), a spacecraft slated for launch in the 2010 time period that is planned to reach the heliopause, at 200 Astronomical Units (AU) from the Sun after a flight of about 20-years duration. The baseline mission under consideration by NASA / JPL has a sail radius of 200 m, a science payload of 25 kg, a spacecraft areal mass thickness of about two grams per square meter and is accelerated out of the solar system at about 14 AU per year after performing a perihelion pass of about 0.25 AU. In current plans, the sail is to be dropped near Jupiter's orbit (5.2 AU from the Sun) on the outbound trajectory leg. One aspect of this study is application of a realistic model of sail thermo-optics to sail kinematics that includes diffuse / specular reflectance and sail roughness. The effects of solar-wind degradation of sail material, based on recent measurements at the NASA MSFC (Marshall Space Flight Center) Space Environment Facility were incorporated in the kinematical model. After setting initial and final conditions for the spacecraft, trajectory was optimized using the provision of variable sail aspect angle. The second phase of the study included consideration of rainbow holography as a medium for a message plaque that would be carried aboard the ISP in the spirit of the message plaques aboard Pioneer 10 /11 and Voyager 1 /2. A prototype holographic message plaque was designed and created by artist C. Bangs with the assistance of Ana Maria Nicholson and Dan Schweitzer of the Center for Holographic Arts in Long Island City, NY. The piece was framed by Simon Liu Inc. of Brooklyn, NY. Concurrent to the creation of the prototype message plaque, we explored the potential of this medium to transmit large amounts of visual information to any extraterrestrial civilization that might detect and intercept ISP. It was also necessary to investigate possible degradation of holograms by the space environment. We developed a new way of characterizing the optical quality of holograms.

Gregory L. Matloff↗
NASA NTRS1984

Slow Scan Telemedicine

Originally developed under contract for NASA by Ball Bros. Research Corporation for acquiring visual information from lunar and planetary spacecraft, system uses standard closed circuit camera connected to a device called a scan converter, which slows the stream of images to match an audio circuit, such as a telephone line. Transmitted to its destination, the image is reconverted by another scan converter and displayed on a monitor. In addition to assist scans, technique allows transmission of x-rays, nuclear scans, ultrasonic imagery, thermograms, electrocardiograms or live views of patient. Also allows conferencing and consultation among medical centers, general practitioners, specialists and disease control centers. Commercialized by Colorado Video, Inc., major employment is in business and industry for teleconferencing, cable TV news, transmission of scientific/engineering data, security, information retrieval, insurance claim adjustment, instructional programs, and remote viewing of advertising layouts, real estate, construction sites or products.

Source record↗
NASA NTRS2004

Enhanced Images for Checked and Carry-on Baggage and Cargo Screening

The current X-ray systems used by airport security personnel for the detection of contraband, and objects such as knives and guns that can impact the security of a flight, have limited effect because of the limited display quality of the X-ray images. Since the displayed images do not possess optimal contrast and sharpness, it is possible for the security personnel to miss potentially hazardous objects. This problem is also common to other disciplines such as medical Xrays, and can be mitigated, to a large extent, by the use of state-of-the-art image processing techniques to enhance the contrast and sharpness of the displayed image. The NASA Langley Research Center's Visual Information Processing Group has developed an image enhancement technology that has direct applications to this problem of inadequate display quality. Airport security X-ray imaging systems would benefit considerably by using this novel technology, making the task of the personnel who have to interpret the X-ray images considerably easier, faster, and more reliable. This improvement would translate into more accurate screening as well as minimizing the screening time delays to airline passengers. This technology, Retinex, has been optimized for consumer applications but has been applied to medical X-rays on a very preliminary basis. The resultant technology could be incorporated into a new breed of commercial x-ray imaging systems which would be transparent to the screener yet allow them to see subtle detail much more easily, reducing the amount of time needed for screening while greatly increasing the effectiveness of contraband detection and thus public safety.

Woodell, Glenn↗
NASA NTRS2004

Synthesizing 3D Surfaces from Parameterized Strip Charts

We believe 3D information visualization has the power to unlock new levels of productivity in the monitoring and control of complex processes. Our goal is to provide visual methods to allow for rapid human insight into systems consisting of thousands to millions of parameters. We explore this hypothesis in two complex domains: NASA program management and NASA International Space Station (ISS) spacecraft computer operations. We seek to extend a common form of visualization called the strip chart from 2D to 3D. A strip chart can display the time series progression of a parameter and allows for trends and events to be identified. Strip charts can be overlayed when multiple parameters need to visualized in order to correlate their events. When many parameters are involved, the direct overlaying of strip charts can become confusing and may not fully utilize the graphing area to convey the relationships between the parameters. We provide a solution to this problem by generating 3D surfaces from parameterized strip charts. The 3D surface utilizes significantly more screen area to illustrate the differences in the parameters and the overlayed strip charts, and it can rapidly be scanned by humans to gain insight. The selection of the third dimension must be a parallel or parameterized homogenous resource in the target domain, defined using a finite, ordered, enumerated type, and not a heterogeneous type. We demonstrate our concepts with examples from the NASA program management domain (assessing the state of many plans) and the computers of the ISS (assessing the state of many computers). We identify 2D strip charts in each domain and show how to construct the corresponding 3D surfaces. The user can navigate the surface, zooming in on regions of interest, setting a mark and drilling down to source documents from which the data points have been derived. We close by discussing design issues, related work, and implementation challenges.

Robinson, Peter I.↗
NASA NTRS2004

Enhanced Images for Checked and Carry-on Baggage and Cargo Screening

The current X-ray systems used by airport security personnel for the detection of contraband, and objects such as knives and guns that can impact the security of a flight, have limited effect because of the limited display quality of the X-ray images. Since the displayed images do not possess optimal contrast and sharpness, it is possible for the security personnel to miss potentially hazardous objects. This problem is also common to other disciplines such as medical X-rays, and can be mitigated, to a large extent, by the use of state-of-the-art image processing techniques to enhance the contrast and sharpness of the displayed image. The NASA Langley Research Centers Visual Information Processing Group has developed an image enhancement technology that has direct applications to this problem of inadequate display quality. Airport security X-ray imaging systems would benefit considerably by using this novel technology, making the task of the personnel who have to interpret the X-ray images considerably easier, faster, and more reliable. This improvement would translate into more accurate screening as well as minimizing the screening time delays to airline passengers. This technology, Retinex, has been optimized for consumer applications but has been applied to medical X-rays on a very preliminary basis. The resultant technology could be incorporated into a new breed of commercial x-ray imaging systems which would be transparent to the screener yet allow them to see subtle detail much more easily, reducing the amount of time needed for screening while greatly increasing the effectiveness of contraband detection and thus public safety.

Woodell, Glen↗
NASA NTRS2015

Cloud Computing Technologies Facilitate Earth Research

Under a Space Act Agreement, NASA partnered with Seattle-based Amazon Web Services to make the agency's climate and Earth science satellite data publicly available on the company's servers. Users can access the data for free, but they can also pay to use Amazon's computing services to analyze and visualize information using the same software available to NASA researchers.

Source record↗
NASA NTRS2017

A Virtual Laboratory for Aviation and Airspace Prognostics Research

Integration of Unmanned Aerial Vehicles (UAVs), autonomy, spacecraft, and other aviation technologies, in the airspace is becoming more and more complicated, and will continue to do so in the future. Inclusion of new technology and complexity into the airspace increases the importance and difficulty of safety assurance. Additionally, testing new technologies on complex aviation systems and systems of systems can be challenging, expensive, and at times unsafe when implementing real life scenarios. The application of prognostics to aviation and airspace management may produce new tools and insight into these problems. Prognostic methodology provides an estimate of the health and risks of a component, vehicle, or airspace and knowledge of how that will change over time. That measure is especially useful in safety determination, mission planning, and maintenance scheduling. In our research, we develop a live, distributed, hardware- in-the-loop Prognostics Virtual Laboratory testbed for aviation and airspace prognostics. The developed testbed will be used to validate prediction algorithms for the real-time safety monitoring of the National Airspace System (NAS) and the prediction of unsafe events. In our earlier work1 we discussed the initial Prognostics Virtual Laboratory testbed development work and related results for milestones 1 & 2. This paper describes the design, development, and testing of the integrated tested which are part of milestone 3, along with our next steps for validation of this work. Through a framework consisting of software/hardware modules and associated interface clients, the distributed testbed enables safe, accurate, and inexpensive experimentation and research into airspace and vehicle prognosis that would not have been possible otherwise. The testbed modules can be used cohesively to construct complex and relevant airspace scenarios for research. Four modules are key to this research: the virtual aircraft module which uses the X-Plane simulator and X-PlaneConnect toolbox, the live aircraft module which connects fielded aircraft using onboard cellular communications devices, the hardware in the loop (HITL) module which connects laboratory based bench-top hardware testbeds and the research module which contains diagnostics and prognostics tools for analysis of live air traffic situations and vehicle health conditions. The testbed also features other modules for data recording and playback, information visualization, and air traffic generation. Software reliability, safety, and latency are some of the critical design considerations in development of the testbed.

LVC-DE↗
NASA NTRS2019

A Detect and Avoid System in the Context of Multiple-Unmanned Aircraft Systems Operations

NASA's Unmanned Aircraft Systems Integration into the National Airspace System (UAS in the NAS) project examines the technical barriers associated with the operation of UAS in civil airspace. For UAS, the removal of the pilot from onboard the aircraft has eliminated the ability of the ground-based pilot in command (PIC) to use out-the-window visual information to make judgements about a potential threat of a loss of well clear with another aircraft. NASA's Phase 1 research supported the development of a Detect and Avoid (DAA) system that supports the ground-based pilot's ability to detect potential traffic conflicts and determine a resolution maneuver, but existing display/alerting requirements did not account for multiple UAS control (1:N). Demands for increased scalability of UAS in the NAS operations are expected to create a need for simultaneous control of UAs, and thus, a new DAA HMI design will likely be necessary. Previous research, however, has found performance degradations as the number of vehicles under operator control has increased. The purpose of the current human-in-the-loop (HITL) simulation was to examine the viability of 1:N operations with the Phase 1 DAA alerting and guidance. Sixteen UAS pilots flew three scenarios with varying number of UAs under their control (1:1, 1:3, 1:5). In addition to their supervisory and sensor mission responsibilities, pilots were to utilize the DAA system to remain DAA well clear (DWC) during scripted conflicts of mixed severity. Measured response times, separation performance, mission task data, and subjective feedback were collected to assess how the multi-UAS control configuration impacted pilots' ability to maintain DAA well clear and perform the mission tasks. Overall, the DAA system proved surprisingly adaptive to multi-UAS control for preventing losses of DAA well clear (LoDWC). The findings suggest that, while multi-UAS operators are able to maintain safe separation (DWC) from other traffic, their ability to efficiently perform missions drastically decreases with their number of controlled vehicles. Pilot feedback indicated that, for this context, the use of automation support tools for completing and managing mission tasks would be appropriate and desired, especially for ensuring efficient use of assets. Finally, human-machine interface (HMI) design considerations for multi-UAS operations are discussed.

Monk, Kevin J.↗
DOE OSTI2020

(NOICE) Neural Optical Image Categorizer for the E-log

The Fermilab Accelerator Division Electronic logbook (E-log) is a record of all the activities and events in the Division for the past 10 years and more. The E-log search function is a valuable resource and the institutional memory of the accelerator complex. About 300,000 files are stored in the E-log, of which the vast majority are images attached to entries and comments. The visual information contained in the images is not presently searchable. The goal of team NOICE (Neural Optical Image Categorizer for the E-log) was to design a neural network able to produce label categories for these images for use by searches. The group developed a dataset and trained a convolutional neural network (CNN) with optimized hyperparameter

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Savannah River Site H-Canyon Advancing Technologies for Remote Inspections - 20345

In 2017, the DOE Environmental Management Office of Technology Development (DOE-EM TD) sponsored the H-Canyon Advanced Technology Demonstration (ATD) to demonstrate to DOE facilities the value of using new commercial-off-the-shelf (COTS) and near-ready technologies to solve difficult problems and enhance worker safety. The DOE Savannah River Site (SRS) H-Canyon Air Exhaust Tunnel (HCAEX) inspection task was identified as representative of the hazardous, human denied environments which could benefit from advanced technologies. The HCAEX underground concrete tunnel is visually inspected biannually using a camera mounted on a remotely operated vehicle (ROV) designed and built by SRNL. While tunnel images have provided valuable visual information, it is desirable to have a higher order of understanding of the environment to support a more thorough structural integrity (SI) analysis and for long term planning purposes. As part of the ATD, the Concrete Integrated Product Team (CIPT) was formed to identify and evaluate available sensors and methods mature enough to remotely obtain tunnel concrete characterization data of high value and with a high probability of success. The team included SMEs and H-Canyon stakeholders in the field of concrete, nondestructive examination (NDE), structural integrity, sensors and remote systems from SRNL, SRNS, LANL, DOE-SR and the Army Corps of Engineering. The CIPT completed an in-depth identification of customer concrete inspection needs and potential technology solutions. Sensors and methods were evaluated on performance, data usefulness, cost and the feasibility of a successful deployment given the unique tunnel access challenges and environment. Two technologies were identified as promising by the CIPT for near term demonstration and evaluation: Lidar (Light Detection and Ranging) 3-dimensional (3D) mapping and remote robotic deployment of NDE instrumentation. Laser spectroscopy to characterize tunnel surface chemical changes was also of interest, but presently cost prohibitive. This paper will include a discussion of the two efforts underway to evaluate and implement the CIPT recommendations. First, the status of the November 2019 deployment of Lidar at a single location into the tunnel is presented. This initial deployment provided the team a learning curve and lessons learned on the challenges of tunnel deployment to include remote operation and data collection, stabilization of the sensor in high air flow (∼30 mph), ability to achieve a tolerance accuracy of 0.25-inches, and the probability to identify change in tunnel dimensions over time. Secondly, a discussion on the development of the Robotic Arm Concrete Inspection Test Bed capable of deploying NDE instruments to examine custom concrete forms will be presented. Concrete forms simulating the rough concrete surfaces, strength, composition and potential structural defects that can be found at our DOE EM facilities have been designed and built for the test bed. Two state-of-the art concrete NDE instruments have been identified as having potential to work on rough concrete walls, they are being tested and characterized as to their ability to provide desired structural integrity data to include wall thickness and defect identification on the developed test beams. Lastly, lessons learned, and the path forward will be presented. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection

The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.

Nazmin, Tamanna↗
NASA NTRS1989

Image gathering and coding for digital restoration: Information efficiency and visual quality

Image gathering and coding are commonly treated as tasks separate from each other and from the digital processing used to restore and enhance the images. The goal is to develop a method that allows us to assess quantitatively the combined performance of image gathering and coding for the digital restoration of images with high visual quality. Digital restoration is often interactive because visual quality depends on perceptual rather than mathematical considerations, and these considerations vary with the target, the application, and the observer. The approach is based on the theoretical treatment of image gathering as a communication channel (J. Opt. Soc. Am. A2, 1644(1985);5,285(1988). Initial results suggest that the practical upper limit of the information contained in the acquired image data range typically from approximately 2 to 4 binary information units (bifs) per sample, depending on the design of the image-gathering system. The associated information efficiency of the transmitted data (i.e., the ratio of information over data) ranges typically from approximately 0.3 to 0.5 bif per bit without coding to approximately 0.5 to 0.9 bif per bit with lossless predictive compression and Huffman coding. The visual quality that can be attained with interactive image restoration improves perceptibly as the available information increases to approximately 3 bifs per sample. However, the perceptual improvements that can be attained with further increases in information are very subtle and depend on the target and the desired enhancement.

Huck, Friedrich O.↗
NASA NTRS2014

Virtual Reality as a Medium for Sensorimotor Adaptation Training and Spaceflight Countermeasures

Astronauts experience a profound sensorimotor adaptation during transition to and from the microgravity environment of space. With the upcoming shift to extra‐long duration missions (upwards of 1 year) aboard the International Space Station, the immediate risks to astronauts during these transitory periods become more important than ever to understand and prepare for. Recent advances in virtual reality technology enable everyday adoption of these tools for entertainment and use in training. Embedding an individual in a virtual environment (VE) allows the ability to change the perception of visual flow, elicit automatic motor behavior and produce sensorimotor adaptation, not unlike those required during long duration microgravity exposure. The overall goal of this study is to determine the feasibility of present head mounted display technology (HMD) to produce reliable visual flow information and the expected adaptation associated with virtual environment manipulation to be used in future sensorimotor adaptability countermeasures. To further understand the influence of visual flow on gait adaptation during treadmill walking, a series of discordant visual flow manipulations in a virtual environment are proposed. Six healthy participants (3 male and 3 female) will observe visual flow information via HMD (Oculus Rift DK2) while walking on an instrumented treadmill at their preferred walking speed. Participants will be immersed in a series of VE's resembling infinite hallways with different visual characteristics: an office hallway, a hallway with pillars and the hallway of a fictional spacecraft. Participants will perform three trials of 10 min. each, which include walking on the treadmill while receiving congruent or incongruent visual information via the HMD. In the first trial, participants will experience congruent visual information (baseline) where the hallway is perceived to move at the same rate as their walking speed. The final two trials will be randomized among participants where the hallway is perceived to move at either half (0.5x) or twice (2.0x) their preferred walking speed. Participants will remain on the treadmill between trials and will not be warned of the upcoming change to visual flow to minimize preparatory adjustments. Stride length, step frequency and dual‐support time will be quantified during each trial. We hypothesize that participants will experience a rapid modification in gait performance during periods of adaptive change, expressed as a decrease in step length, an increase in step frequency and an increase in dual‐support time, followed by a period of adaptation where these movement parameters will return to near‐baseline levels. As stride length, step frequency and dual support times return to baseline values, an adaptation time constant will be derived to establish individual time‐to‐adapt (TTA). HMD technology represents a paradigm shift in sensorimotor adaptation training where gait adaptability can be stressed using off‐the‐shelf consumer products and minimal experimental equipment, allowing for greater training flexibility in astronaut and terrestrial applications alike.

Madansingh, S.↗
NASA NTRS1992

Evaluation of force-torque displays for use with space station telerobotic activities

Recent experiments which addressed Space Station remote manipulation tasks found that tactile force feedback (reflecting forces and torques encountered at the end-effector through the manipulator hand controller) does not improve performance significantly. Subjective response from astronaut and non-astronaut test subjects indicated that force information, provided visually, could be useful. No research exists which specifically investigates methods of presenting force-torque information visually. This experiment was designed to evaluate seven different visual force-torque displays which were found in an informal telephone survey. The displays were prototyped in the HyperCard programming environment. In a within-subjects experiment, 14 subjects nullified forces and torques presented statically, using response buttons located at the bottom of the screen. Dependent measures included questionnaire data, errors, and response time. Subjective data generally demonstrate that subjects rated variations of pseudo-perspective displays consistently better than bar graph and digital displays. Subjects commented that the bar graph and digital displays could be used, but were not compatible with using hand controllers. Quantitative data show similar trends to the subjective data, except that the bar graph and digital displays both provided good performance, perhaps do to the mapping of response buttons to display elements. Results indicate that for this set of displays, the pseudo-perspective displays generally represent a more intuitive format for presenting force-torque information.

Hendrich, Robert C.↗
NASA NTRS1980

Multi-modal information processing for visual workload relief

The simultaneous performance of two single-dimensional compensatory tracking tasks, one with the left hand and one with the right hand, is discussed. The tracking performed with the left hand was considered the primary task and was performed with a visual display or a quickened kinesthetic-tactual (KT) display. The right-handed tracking was considered the secondary task and was carried out only with a visual display. Although the two primary task displays had afforded equivalent performance in a critical tracking task performed alone, in the dual-task situation the quickened KT primary display resulted in superior secondary visual task performance. Comparisons of various combinations of primary and secondary visual displays in integrated or separated formats indicate that the superiority of the quickened KT display is not simply due to the elimination of visual scanning. Additional testing indicated that quickening per se also is not the immediate cause of the observed KT superiority.

Burke, M. W.↗
NASA NTRS2016

New Visualizations Highlight New Information on the Contrasting Arctic and Antarctic Sea-Ice Trends Since the Late 1970s

Month-by-month ranking of 37 years (1979-2015) of satellite-derived sea-ice extents in the Arctic and Antarctic reveals interesting new details in the overall trends toward decreasing sea-ice coverage in the Arctic and increasing sea-ice coverage in the Antarctic. The Arctic decreases are so definitive that there has not been a monthly record high in Arctic sea-ice extents in any month since 1986, a time period during which there have been 75 monthly record lows. The Antarctic, with the opposite but weaker trend toward increased ice extents, experienced monthly record lows in 5 months of 1986, then 6 later monthly record lows scattered through the dataset, with the last two occurring in 2006, versus 45 record highs since 1986. However, in the last three years of the 1979-2015 dataset, the downward trends in Arctic sea-ice extents eased up, with no new record lows in any month of 2013 or 2014 and only one record low in 2015,while the upward trends in Antarctic ice extents notably strengthened, with new record high ice extents in 4 months (August-November) of 2013, in 6 months (April- September) of 2014, and in 3 months (January, April, and May) of 2015. Globally, there have been only 3 monthly record highs since 1986 (only one since 1988), whereas there have been 43 record lows, although the last record lows (in the 1979-2015 dataset) occurred in 2012.

Sea Ice↗
NASA NTRS2015

Virtual Reality as a Medium for Sensorimotor Adaptation Training and Spaceflight Countermeasures

With the upcoming shift to extra‐long duration missions (1 year) aboard the ISS, sensorimotor adaptations during transitory periods in‐and‐out of microgravity are more important to understand and prepare for. Advances in virtual reality technology enables everyday adoption of these tools for entertainment and use in training. Experiencing virtual environments (VE) allows for the manipulation of visual flow to elicit automatic motor behavior and produce sensorimotor adaptation (SA). Recently, the ability to train individuals using repeatable and varied exposures to SA challenges has shown success by improving performance during exposure to a novel environment (Batson 2011). This capacity to 'learn to learn' is referred to as sensorimotor adaptive generalizability and, through the use of treadmill training, represents an untapped potential for individualized countermeasures. The goal of this study is to determine the feasibility of present head mounted displays (HMDs) to produce compelling visual flow information and the expected adaptations for use in future SA treadmill‐based countermeasures. Participants experience infinite hallways providing congruent (baseline) or incongruent visual information (half or double speed) via HMD while walking on an instrumented treadmill at 1.1m/s. As gait performance approaches baseline levels, an adaptation time constant is derived to establish individual time‐to‐adapt (TTA). It is hypothesized that decreasing the TTA through SA treadmill training will facilitate sensorimotor adaptation during gravitational transitions. In this way, HMD technology represents a novel platform for SA training using off‐the‐shelf consumer products for greater training flexibility in astronaut and terrestrial applications alike.

Madansingh, S.↗