Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Virtual Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Upgrading the JET Remote Handling System - 18356

The Joint European Torus (JET) has employed advanced remote-maintenance techniques for over three decades to avoid exposing humans to a potentially hazardous environment and to develop techniques for future power-generating fusion reactors where environments will be too hazardous for any manned maintenance. As a unique application of robotics, virtual reality and operations management systems, JET's remote handling unit, now a part of RACE, has driven the state-of-the-art with each upgrade programme in its history. This conference paper presents the current capabilities of the JET remote handling system, and the future capabilities being delivered by its latest upgrade programme, which makes use of cutting edge advances. RACE (Remote Applications in Challenging Environments) aims to shape the technologies being developed for JET in such a way that they will have wider applications, such as in nuclear decommissioning. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Telerobotic Control of Dexterous Dual-Arm Robots for D and D Operations - 18622

Robotic systems hold the potential to significantly reduce exposure of workers to hazardous environments such as in the deactivation and decommissioning (D and D) of nuclear facilities. Our goal is to enable an operator with minimal training to easily control a remote dual-arm robot to perform demolition tasks with hand tools. We propose a system that combines semi-autonomous coordination of the robot's arms with an intuitive operator interface based on virtual reality (VR) technology. A limb coordination system enables independent control of the robot arms, as well as coupled motion required to hold and manipulate rigid bodies such as reciprocating saws, angle grinders and crow bars. Using a VR head mounted display and stereo video from the robot for situational awareness and tracked VR hand controllers to command robot arm movement, an operator will be able to walk up to the control console, pick up the controllers, engage the manipulators, fly the grippers, grasp a tool with one or both robot arms and easily move them in unison to perform tasks. We present preliminary results using simulation and a physical dual-arm platform based on the Johns Hopkins University Applied Physics Laboratory's Modular Prosthetic Limb, an anthropomorphic device that provides hyper-dexterous human-like manipulation capabilities. Anticipated benefits of the robotic system for D and D operations include improved situational awareness, increased mission complexity, and reduced operator training time, workload, and task execution times. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Innovative Hot Lab Concept for Advanced D and D Application - 19175

Hot Labs are used in the nuclear industry for various purposes: maintenance of nuclear reactor, sampling and testing of fuel, inspection activities and decommissioning. Despite their vast use, their current designs and operations do not meet entirely today's needs and requirements of the operations nor tomorrow's. This paper will give an overview of the research and investigations performed around Hot Cells design and concept in order to integrate new operability modes and functions. The overall idea is to bring modularity, flexibility and adaptability to the Hot Lab nuclear industry. Taking the key principles of Model Based System Engineering, an interoperable data model, the most advanced digital technologies (Building Information Modelling - BIM, Virtual Reality / Augmented Reality, Artificial Intelligence), and looking at all the life-cycle of such a facility, a concept design of a new type of Hot Lab has been developed. Four mains aspects are implemented during this study: Implement the principles of the Industry 4.0; use modular and flexible solutions; explore the concept of in service maintenance and predictive maintenance; optimise the decommissioning and dismantling process by taking into account the entire life-cycle of the facility. The design was developed as a case study taking several assumptions to adapt to any project. The design developed demonstrates that modularity and flexibility can be brought in without compromising the core safety functions of such a facility. This Hot Lab concept brings the current Hot Lab to the next level as the design has been adapted to meet the current operational needs, implement novel ideas and consider its entire life-cycle. This paper will demonstrate how decommissioning and dismantling operations can become more efficient and safer with such a concept. In addition, the Model Based System Engineering approach used from the beginning of the design phase allows to have an optimum architecture during its entire lifetime. It also allowed to flag new topics to be further developed for the benefit of the nuclear industry as a whole. A first example would be the development of the Control System using digital tools and artificial intelligence to run remotely controlled equipment inside the Hot Lab. Assystem is an international engineering group. As a key participant in the nuclear industry for over 50 years, the Group supports its clients in managing their capital expenditure throughout their asset life-cycles. Assystem can offer support in project management, design, digital engineering, industrial control systems, security and safety and industrial digitalisation. Assystem's Imagine program is an internal program intending to serve as an incubator for the development of innovations. The Innovative Hot Lab project integrates one of the four innovation projects Assystem choose to develop and invest in. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Creating 3D Models With The Faro Scanner

The Faro Focus X 330 is a 3D scanner that combines numerous technologies in order to create a precise and life like 3D model. The technologies used by the scanner include: Time of flight (The scanner spins horizontally and vertically while emitting a class 1 laser; The laser beam then bounces off of an object and is captured by a sensor; An extremely precise chronometer tracks the beams flight time; The data is inputted into the simple formula: d=c*t/2). Point cloud system: The exact position of up to 976,000 points per second are registered and combined to form a complete model with up to ±1 mm at 330 m. Camera: Photos are taken of the surroundings that are combined to make a 165 megapixel image. The image is paired with the point cloud system. Scans have been taken of buildings 730-A and 781-A. These scans will be put into different virtual reality programs and used for tours and training. The scans also serve as a proof of concept for the Faro Focus X 330 as well as SRNL's ability to produce accurate scans with numerous useful applications. Work Scope Planning: Scanning will result in higher productivity and reduce the risk by identifying hazards; Blueprints and designs; 3D scans allow greater collaboration between engineers, construction crews, etc. by enabling them to compare blueprints to real time progress and make adjustments. Training and walk-downs: Scans can be made of places where access is not readily available, this could be due to its remote location or hazards such as radioactivity.

42 ENGINEERING↗

Virtual impact: visualizing the potential effects of cosmic impact in human history

Current models indicate that catastrophic impacts by asteroids and comets capable of killing more than one quarter of Earth's human population have occurred on average once every million years; smaller impacts, such the 1908 Tunguska impact that leveled more than 2,000 square km of Siberian forest, occur every 200-300 years. Therefore, cosmic impact likely significantly affected hominine evolution and conceivably played a role in Holocene period human culture history. Regrettably, few archaeologists are trained to appreciate the nature and potential effects of cosmic impact. We have developed a conceptual model for an extensible set of educational and research tools based on virtual reality collaborative environments to engage archaeologists and the general public on the topic of the role of cosmic impact in human history. Our initial focus is on two documented asteroid impacts in Argentina during the period of 4000 to 1000 B.C. Campo del Cicio resulted in an energy release of around 2-3 megatons (100-150 times the Hiroshima atomic weapon), and left several craters and a strewn field covering 493 km{sup 2} in northeastern Argentina. Rio Cuarto was likely more than 1000 megatons and may have devastated an area greater than 50,000 km{sup 2} in central Argentina. We are focusing on reconstructions of these events and their potential effects on contemporary hunter and gatherers. Our vinual reality tools also introduce interactive variables (e.g., impactor physical properties, climate, vegetation, topography, and social complexity) to allow researchers and students to better investigate and evaluate the factors that significantly influence cosmic impact effects.

58 GEOSCIENCES↗

Using Highly Interactive Virtual Environments for Safeguards Activities

Highly interactive virtual environment (HIVE) is a term that refers to interactive educational simulations, serious games and virtual worlds. Studies indicate that learning with the aid of interactive environments produces better retention and depth of knowledge by promoting improved trainee engagement and understanding. Virtual reality or three dimensional (3D) visualization is often used to promote the understanding of something when personal observation, photographs, drawings, and/or sketches are not possible or available. Subjects and situations, either real or hypothetical, can be developed using a 3D model. Models can be tailored to the audience allowing safeguards and security features to be demonstrated for educational purposes in addition to engineering evaluation and performance analysis. Oak Ridge National Laboratory (ORNL) has begun evaluating the feasibility of HIVEs for improving safeguards activities such as training, mission planning, and evaluating worker task performance. This paper will discuss the development workflow of HIVEs and present some recent examples.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

CrystalVR

SAND2022-14694 O CrystalVR is a CAD2VR plugin which enables the import of crystallographic information files (CIF) into a virtual reality (VR) environment for visualization and interaction. Crystallographic data is incredibly complex and difficult to navigate and visualize on a two-dimensional or 2D screen. CrystalVR empowers users to step inside their crystals, allowing them to intuitively grow, shrink, and scale the crystal structure. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Krukar, John↗

Virtual Presence: One Step Beyond Reality

Our primary objective was to team up a group consisting of scientists and engineers from two different NASA cultures, and simulate an interactive teleoperated robot conducting geologic field work on the Moon or Mars. The information derived from the experiment will benefit both the robotics team and the planetary exploration team in the areas of robot design and development, and mission planning and analysis. The Earth Sciences and Space and Life Sciences Division combines the past with the future contributing experience from Apollo crews exploring the lunar surface, knowledge of reduced gravity environments, the performance limits of EVA suits, and future goals for human exploration beyond low Earth orbit. The Automation, Robotics. and Simulation Division brings to the table the technical expertise of robotic systems, the future goals of highly interactive robotic capabilities, treading on the edge of technology by joining for the first time a unique combination of telepresence with virtual reality.

Budden, Nancy Ann↗

Introducing NOODLES: Collaborative Visualization in a Flavorful Package

We introduce NOODLES, a lightweight collaborative visualization and analysis protocol. NOODLES was developed to enable new scientific workflows while enhancing existing pipelines. Using a technology-minimal approach to strengthen applicability, this protocol allows researchers to tie disparate software together as well as making domain specific visualizations accessible across various platforms and form factors. In this talk we discuss background, challenges, and gaps in the current tool landscape that lead to the development of the protocol. We then describe the design of the protocol and present several use cases to demonstrate the efficacy of NOODLES in addressing complex visualization challenges and how it co-exists with existing tools. We conclude by outlining in-progress work and potential avenues for future development within the NOODLES framework.

collaborative analysis↗

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

Simulation Modeling Virtual Reality Immersive Tech↗

Latency and User Performance in Virtual Environments and Augmented Reality

System rendering latency has been recognized by senior researchers, such as Professor Fredrick Brooks of UNC (Turing Award 1999), as a major factor limiting the realism and utility of head-referenced displays systems. Latency has been shown to reduce the user's sense of immersion within a virtual environment, disturb user interaction with virtual objects, and to contribute to motion sickness during some simulation tasks. Latency, however, is not just an issue for external display systems since finite nerve conduction rates and variation in transduction times in the human body's sensors also pose problems for latency management within the nervous system. Some of the phenomena arising from the brain's handling of sensory asynchrony due to latency will be discussed as a prelude to consideration of the effects of latency in interactive displays. The causes and consequences of the erroneous movement that appears in displays due to latency will be illustrated with examples of the user performance impact provided by several experiments. These experiments will review the generality of user sensitivity to latency when users judge either object or environment stability. Hardware and signal processing countermeasures will also be discussed. In particular the tuning of a simple extrapolative predictive filter not using a dynamic movement model will be presented. Results show that it is possible to adjust this filter so that the appearance of some latencies may be hidden without the introduction of perceptual artifacts such as overshoot. Several examples of the effects of user performance will be illustrated by three-dimensional tracking and tracing tasks executed in virtual environments. These experiments demonstrate classic phenomena known from work on manual control and show the need for very responsive systems if they are indented to support precise manipulation. The practical benefits of removing interfering latencies from interactive systems will be emphasized with some classic final examples from surgical telerobotics, and human-computer interaction.

Ellis, Stephen R.↗

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

HITL↗

Simulation Exploration through Immersive Parallel Planes

We present a visualization-driven simulation system that tightly couples systems dynamics simulations with an immersive virtual environment to allow analysts to rapidly develop and test hypotheses in a high-dimensional parameter space. To accomplish this, we generalize the two-dimensional parallel-coordinates statistical graphic as an immersive 'parallel-planes' visualization for multivariate time series emitted by simulations running in parallel with the visualization. In contrast to traditional parallel coordinate's mapping the multivariate dimensions onto coordinate axes represented by a series of parallel lines, we map pairs of the multivariate dimensions onto a series of parallel rectangles. As in the case of parallel coordinates, each individual observation in the dataset is mapped to a polyline whose vertices coincide with its coordinate values. Regions of the rectangles can be 'brushed' to highlight and select observations of interest: a 'slider' control allows the user to filter the observations by their time coordinate. In an immersive virtual environment, users interact with the parallel planes using a joystick that can select regions on the planes, manipulate selection, and filter time. The brushing and selection actions are used to both explore existing data as well as to launch additional simulations corresponding to the visually selected portions of the input parameter space. As soon as the new simulations complete, their resulting observations are displayed in the virtual environment. This tight feedback loop between simulation and immersive analytics accelerates users' realization of insights about the simulation and its output.

97 MATHEMATICS AND COMPUTING↗

A decade of telerobotics in rehabilitation: Demonstrated utility blocked by the high cost of manipulation and the complexity of the user interface

The Stanford/VA Interactive Robotics Laboratory set out in 1978 to test the hypothesis that industrial robotics technology could be applied to serve the manipulation needs of severely impaired individuals. Five generations of hardware, three generations of system software, and over 125 experimental subjects later, we believe that genuine utility is achievable. The experience includes development of over 65 task applications using voiced command, joystick control, natural language command and 3D object designation technology. A brief foray into virtual environments, using flight simulator technology, was instructive. If reality and virtuality come for comparable prices, you cannot beat reality. A detailed review of assistive robot anatomy and the performance specifications needed to achieve cost/beneficial utility will be used to support discussion of the future of rehabilitation telerobotics. Poised on the threshold of commercial viability, but constrained by the high cost of technically adequate manipulators, this worthy application domain flounders temporarily. In the long run, it will be the user interface that governs utility.

Leifer, Larry↗