Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Virtual Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

State of the Art of Molecular Visualization in Immersive Virtual Environments

Abstract Visualization plays a crucial role in molecular and structural biology. It has been successfully applied to a variety of tasks, including structural analysis and interactive drug design. While some of the challenges in this area can be overcome with more advanced visualization and interaction techniques, others are challenging primarily due to the limitations of the hardware devices used to interact with the visualized content. Consequently, visualization researchers are increasingly trying to take advantage of new technologies to facilitate the work of domain scientists. Some typical problems associated with classic 2D interfaces, such as regular desktop computers, are a lack of natural spatial understanding and interaction, and a limited field of view. These problems could be solved by immersive virtual environments and corresponding hardware, such as virtual reality head‐mounted displays. Thus, researchers are investigating the potential of immersive virtual environments in the field of molecular visualization. There is already a body of work ranging from educational approaches to protein visualization to applications for collaborative drug design. This review focuses on molecular visualization in immersive virtual environments as a whole, aiming to cover this area comprehensively. We divide the existing papers into different groups based on their application areas, and types of tasks performed. Furthermore, we also include a list of available software tools. We conclude the report with a discussion of potential future research on molecular visualization in immersive environments.

97 MATHEMATICS AND COMPUTING↗

An Evaluation of Extended Reality Technologies for Use in Verification Testing at NASA 2024 HRP IWS Abstract

BACKGROUND At NASA, verification testing is the formal process of ensuring that a product conforms to requirements set by a project or program. Some verification methods, such as Demonstrations and Test, require either the end product or a mockup of the product with sufficient fidelity to stand-in for the product during the test. Traditionally, these mockups have been physical (e.g., foam-core and wood) but there is growing interest in exploring new methods for testing with these mockups. These methods include virtual reality (VR), mixed reality, and augmented reality which are collectively referred to as eXtended Reality (XR) technologies. VR has already been adopted and used by many in the aerospace industry as a tool for use in early design phases (e.g., developmental testing) and may have the most potential for use in verification tests. Benefits of using VR mockups offer cost effectiveness, ease of iteration, simulation of hazardous conditions (e.g., an egress through a hatch with smoke obscuring vision), and the ability to simulate microgravity conditions, which are challenging to do with physical mockups. However, the validity of test results obtained from VR mockup demonstrations or testing, compared to the current gold standard of physical mockups, remains uncertain. It is unlikely that there is one clean answer as there are many different types of verification outcomes and each XR technology must be evaluated on its own merits. This is not an issue during developmental testing as the design is still in flux and the total success of the design is not dependent upon the results of a developmental test. Verification tests, however, only happen once, assuming no change to the design, and the results are used to certify the product. Therefore, establishing the validity of XR mockup-based verification outcomes is essential before considering them for any use in verification tests. OBJECTIVE AND METHOD To address this concern, the Human Research Program has funded a project to explore and qualify how XR technologies might be used in verification demonstration and testing at NASA. Currently, we are conducting a review of the literature on the utilization of XR mockups for design activities, prototyping, and user testing. We are employing the Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis method to identify the pros, cons, and barriers to adoption of XR technologies for verification testing at NASA. Additionally, we are developing a framework to guide the deployment of XR mockups for verification tests. Building upon available evidence from the literature and subject-matter expert feedback, our goal for the framework is to provide guidelines for which forms of XR mockups are suitable for a given verification test, when only physical mockups should be employed and to highlight areas for which more evidence is needed. To further refine our framework and to contribute to the body of evidence, we are planning a lab-based experiment comparing a VR mockup to a physical twin for a set of select verification outcomes. ANTICIPATED RESULTS In this presentation, we will present the work we conducted to evaluate XR technologies for use in verification tests at NASA. We will summarize and report our findings from the SWOT analysis and our lab-based study, and we will present the current state of the XR Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project. Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project.

Extended Reality↗

Simulation of extra-vehicular activity (EVA) self-rescue

Self-rescue during EVA is examined in terms of the use of a hand-held thruster that is similar to the hand-held maneuvering units HHMU developed for earlier programs. The problem of assessing velocity-increment requirements is addressed by means of examples of simulation technologies for studying EVA. The technologies evaluated include virtual reality systems such as the Virtual Interactive Environment Workstation (VIEW) and the Space Operations Simulator, and standard approaches like the air-bearing floor and the space shuttle. The VIEW is employed for a study of five trained NASA subjects that conduct a simulated return to a spacecraft with an HMMU under variable conditions. The study demonstrates the efficacy of VIEW for obtaining fuel-consumption values, and separation velocity is identified as the most significant determinant of the fuel and time requirements for a self-rescue operation.

Brody, Adam R.↗

Tele Hyper Virtuality

In the future, remote images sent over communication lines will be reproduced in virtual reality (VR). This form of virtual telecommunications, which will allow observers to engage in an activity as though it were real, is the focus of considerable attention. Taken a step further, real and unreal objects will be placed in a single space to create an extremely realistic environment. Here, imaginary and other life forms as well as people and animals in remote locations will gather via telecommunication lines that create a common environment where life forms can work and interact together. Words, gestures, diagrams and other forms of communication will be used freely in performing work. Actual construction of a system based on this new concept will not only provide people with experiences that would have been impossible in the past, but will also inspire new applications in which people will function in environments where it would have been difficult if not impossible for them to function until now. This paper describes Tele Hyper Virtuality concept, its definition, applications, the key technologies to accomplish it and future prospects.

Terashima, Nobuyoshi↗

Venus Quadrangle Geological Mapping: Use of Geoscience Data Visualization Systems in Mapping and Training

We are currently investigating new technological developments in computer visualization and analysis in order to assess their importance and utility in planetary geological analysis and mapping [1,2]. Last year we reported on the range of technologies available and on our application of these to various problems in planetary mapping [3]. In this contribution we focus on the application of these techniques and tools to Venus geological mapping at the 1:5M quadrangle scale. In our current Venus mapping projects we have utilized and tested the various platforms to understand their capabilities and assess their usefulness in defining units, establishing stratigraphic relationships, mapping structures, reaching consensus on interpretations and producing map products. We are specifically assessing how computer visualization display qualities (e.g., level of immersion, stereoscopic vs. monoscopic viewing, field of view, large vs. small display size, etc.) influence performance on scientific analysis and geological mapping. We have been exploring four different environments: 1) conventional desktops (DT), 2) semi-immersive Fishtank VR (FT) (i.e., a conventional desktop with head-tracked stereo and 6DOF input), 3) tiled wall displays (TW), and 4) fully immersive virtual reality (IVR) (e.g., "Cave Automatic Virtual Environment," or Cave system). Formal studies demonstrate that fully immersive Cave environments are superior to desktop systems for many tasks [e.g., 4].

Head, James W.↗

Incorporating Speech Recognition into a Natural User Interface

The Augmented/ Virtual Reality (AVR) Lab has been working to study the applicability of recent virtual and augmented reality hardware and software to KSC operations. This includes the Oculus Rift, HTC Vive, Microsoft HoloLens, and Unity game engine. My project in this lab is to integrate voice recognition and voice commands into an easy to modify system that can be added to an existing portion of a Natural User Interface (NUI). A NUI is an intuitive and simple to use interface incorporating visual, touch, and speech recognition. The inclusion of speech recognition capability will allow users to perform actions or make inquiries using only their voice. The simplicity of needing only to speak to control an on-screen object or enact some digital action means that any user can quickly become accustomed to using this system. Multiple programs were tested for use in a speech command and recognition system. Sphinx4 translates speech to text using a Hidden Markov Model (HMM) based Language Model, an Acoustic Model, and a word Dictionary running on Java. PocketSphinx had similar functionality to Sphinx4 but instead ran on C. However, neither of these programs were ideal as building a Java or C wrapper slowed performance. The most ideal speech recognition system tested was the Unity Engine Grammar Recognizer. A Context Free Grammar (CFG) structure is written in an XML file to specify the structure of phrases and words that will be recognized by Unity Grammar Recognizer. Using Speech Recognition Grammar Specification (SRGS) 1.0 makes modifying the recognized combinations of words and phrases very simple and quick to do. With SRGS 1.0, semantic information can also be added to the XML file, which allows for even more control over how spoken words and phrases are interpreted by Unity. Additionally, using a CFG with SRGS 1.0 produces a Finite State Machine (FSM) functionality limiting the potential for incorrectly heard words or phrases. The purpose of my project was to investigate options for a Speech Recognition System. To that end I attempted to integrate Sphinx4 into a user interface. Sphinx4 had great accuracy and is the only free program able to perform offline speech dictation. However it had a limited dictionary of words that could be recognized, single syllable words were almost impossible for it to hear, and since it ran on Java it could not be integrated into the Unity based NUI. PocketSphinx ran much faster than Sphinx4 which would've made it ideal as a plugin to the Unity NUI, unfortunately creating a C# wrapper for the C code made the program unusable with Unity due to the wrapper slowing code execution and class files becoming unreachable. Unity Grammar Recognizer is the ideal speech recognition interface, it is flexible in recognizing multiple variations of the same command. It is also the most accurate program in recognizing speech due to using an XML grammar to specify speech structure instead of relying solely on a Dictionary and Language model. The Unity Grammar Recognizer will be used with the NUI for these reasons as well as being written in C# which further simplifies the incorporation.

Chapa, Nicholas↗

Towards Determination of Visual Requirements for Augmented Reality Displays and Virtual Environments for the Airport Tower

The visual requirements for augmented reality or virtual environments displays that might be used in real or virtual towers are reviewed wi th respect to similar displays already used in aircraft. As an example of the type of human performance studies needed to determine the use ful specifications of augmented reality displays, an optical see-thro ugh display was used in an ATC Tower simulation. Three different binocular fields of view (14 deg, 28 deg, and 47 deg) were examined to det ermine their effect on subjects# ability to detect aircraft maneuveri ng and landing. The results suggest that binocular fields of view much greater than 47 deg are unlikely to dramatically improve search perf ormance and that partial binocular overlap is a feasible display tech nique for augmented reality Tower applications.

NATO FURNISHED↗

Virtual and Augmented Reality Applications in Science and Engineering

The articles in this special section focus on virtual and augmented reality applications in science and engineering. There has been an explosive growth in visually augmenting the spaces around us by creating environments where visual, aural, and kinesthetic immersive experiences afforded by virtual and augmented reality (AR) powerfully engage us in a way no other medium can. Virtual reality (VR) recreates the sensory world around us entirely through computer-generated signals of sight, sound, touch (and in some cases smell and taste). AR overlays the computer-generated sensory signals on the real world allowing the user to experience a rich juxtaposition of the virtual and the real worlds simultaneously. Together, these technologies are transforming the way people from all walks of life—scientists, engineers, educators, industrial workers, health care professionals, artists, and everyday people— see and use the information that matters most to them, in an intuitive embodied way. Just as mobile technology has revolutionized how we communicate with each other and with our digital worlds, ubiquitous VR and AR will fundamentally alter how our society creates, inspires, engages, and learns from the information-rich and enriched cyberspaces around us. While affordable consumer- quality VR and AR hardware is becoming available, significant work is needed to adopt VR and AR for important and difficult scientific and societal applications.

Virtual Reality, Augmented Reality↗

Virtual and Augmented Realities to Support Development, Training, Deployment, and Operations of Remote Systems - 20516

Throughout the U.S. Department of Energy complex, there is a need to deploy new, unique equipment and systems for cleanup activities, waste processing, infrastructure repair, and decommissioning and demolition in radioactive and hazardous environments. The new equipment often consists of custom systems created by integrating and modifying commercial technologies. In addition, the systems are deployed in unique environments due to limited access, waste properties, and the presence of previously installed equipment or infrastructure that has been left in place. The deployment of custom systems that are 'turnkey' ready for first-time installation and application has its risks. Use of test platforms and mockups for cold (i.e., non-radioactive) testing is one method to mitigate that risk: however, full-scale test mockups for operations such as waste retrieval and tank inspection can be expensive and must be modified to incorporate the uniqueness of each application. An alternative to full-scale mockups is to use three-dimensional (3D) virtual environments and virtual reality (VR) technology to develop interactive virtual test beds. These can be used throughout the down-selection, development, system integration, operational planning, operator training, and mission execution phases of a task. Virtual test beds are readily reconfigured, can be used for multiple tasks, support multiple users in parallel, and can accommodate enhancements and changes not originally planned or conceived in the initial design. Virtual test beds also provide a platform for developing and testing augmented reality (AR) tools for improving operator efficiency. A VR experience has been generated for waste retrieval from a Hanford waste tank to present the potential applications of a virtual test bed. Features of the VR experience are presented, potential applications of VR and AR for remote applications are discussed, and development areas for improving future application are considered. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

EnDEVR: An Environment for Data Engineering in VR

Organizations within the public and private sectors are looking to improve their data science operations for research, development, and operational purposes. As this interest in data science grows, so too does interest in tools and programs that facilitating such operations. This paper presents EnDEVR, the Environment for Data Engineering in Virtual Reality, a user-extensible system that allows for the execution of custom data science functions. We describe the user-centered design process for the EnDEVR system, based on the needs of subject matter experts within the aerospace and aviation industries. Fundamental to this design is a method for users to integrate their existing analysis code (that may leverage third-party vendors) as usable objects in the virtual environment; this allows organizations to operate without the price tag and lifetime obligations associated with commercial data science toolkits, a concept known as “vendor lock-in”. We then present our system design with iterative implementations, and conclude with lessons learned. The presented work may provide insight into future user-centered design processes for VR applications, particularly for digital transformation stakeholders to circumvent vendor lock-in.

Human-centered computing↗

Interacting with the COVID virus model in VR environment

The Disaster Response Complex at Idaho State University (ISU) hosts an annual Disaster Preparedness and Response Conference which will give a bird's eye view of disasters and pandemics in the U.S. We'll demonstrate virtual reality (VR) and augmented reality (AR) capabilities at the conference. This VR demo displays the structure and components of the COVID virus model, and let users to interact with it in an immersive environment. The 3D model used in this demo is open source and downloaded from this site: https://sketchfab.com/GLS.

3D↗

Immersive Visual Analytics for Transformative Neutron Scattering Science

The ORNL Spallation Neutron Source (SNS) provides the most intense pulsed neutron beams in the world for scientific research and development across a broad range of disciplines. SNS experiments produce large volumes of complex data that are analyzed by scientists with varying degrees of experience using 3D visualization and analysis systems. However, it is notoriously difficult to achieve proficiency with 3D visualizations. Because 3D representations are key to understanding the neutron scattering data, scientists are unable to analyze their data in a timely fashion resulting in inefficient use of the limited and expensive SNS beam time. We believe a more intuitive interface for exploring neutron scattering data can be created by combining immersive virtual reality technology with high performance data analytics and human interaction. In this paper, we present our initial investigations of immersive visualization concepts as well as our vision for an immersive visual analytics framework that could lower the barriers to 3D exploratory data analysis of neutron scattering data at the SNS.

data visualization↗

Equitable and Inclusive Public Outreach with the James Webb Space Telescope: Combining Art, Science, and Technology

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

Equitable and Inclusive Public Outreach with the James Webb Space Telescope: Combining Art, Science, and Technology

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

Expanding Impact with the James Webb Space Telescope: Combining Art, Science, and Technology for Public Outreach

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

In Silico Versus In Situ: The Challenging Landscape of Nuclear Criticality Safety Training

Nuclear criticality safety grew out of the ranks of experimentalists studying the physics of chain-reacting systems at critical experiment facilities. Consequently, critical experiment facilities provide the best forum for conducting training in nuclear criticality safety. As the nuclear renaissance gains traction, there is an increased demand to train personnel in nuclear criticality safety (NCS). Strides have been made in both on-line and virtual reality based NCS training. While these are perhaps a necessary component of NCS training, hands-on training at critical experiments facilities remains the most effective means of developing competency for fissionable material handlers, managers of fissionable material operations, criticality safety analysts, and experimentalists. This paper explores the challenges of developing and maintaining workforce competency in nuclear criticality safety to support safe and efficient fissionable material operations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗