Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Virtual Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Cognitive factors associated with immersion in virtual environments

Immersion into the dataspace provided by a computer, and the feeling of really being there or 'presence', are commonly acknowledged as the uniquely important features of virtual reality environments. How immersed one feels appears to be determined by a complex set of physical components and affordances of the environment, and as yet poorly understood psychological processes. Pimentel and Teixeira say that the experience of being immersed in a computer-generated world involves the same mental shift of 'suspending your disbelief for a period of time' as 'when you get wrapped up in a good novel or become absorbed in playing a computer game'. That sounds as if it could be right, but it would be good to get some evidence for these important conclusions. It might be even better to try to connect these statements with theoretical positions that try to do justice to complex cognitive processes. The basic precondition for understanding Virtual Reality (VR) is understanding the spatial representation systems that localize our bodies or egocenters in space. The effort to understand these cognitive processes is being driven with new energy by the pragmatic demands of successful virtual reality environments, but the literature is largely sparse and anecdotal.

Psotka, Joseph↗

A microbased shared virtual world prototype

Virtual reality (VR) allows sensory immersion and interaction with a computer-generated environment. The user adopts a physical interface with the computer, through Input/Output devices such as a head-mounted display, data glove, mouse, keyboard, or monitor, to experience an alternate universe. What this means is that the computer generates an environment which, in its ultimate extension, becomes indistinguishable from the real world. 'Imagine a wraparound television with three-dimensional programs, including three-dimensional sound, and solid objects that you can pick up and manipulate, even feel with your fingers and hands.... 'Imagine that you are the creator as well as the consumer of your artificial experience, with the power to use a gesture or word to remold the world you see and hear and feel. That part is not fiction... three-dimensional computer graphics, input/output devices, computer models that constitute a VR system make it possible, today, to immerse yourself in an artificial world and to reach in and reshape it.' Our research's goal was to propose a feasibility experiment in the construction of a networked virtual reality system, making use of current personal computer (PC) technology. The prototype was built using Borland C compiler, running on an IBM 486 33 MHz and a 386 33 MHz. Each game currently is represented as an IPX client on a non-dedicated Novell server. We initially posed the two questions: (1) Is there a need for networked virtual reality? (2) In what ways can the technology be made available to the most people possible?

Pitts, Gerald↗

Object manipulation in immersive virtual environments: Hand Motion tracking technology and snap-to-fit function

There have been recent efforts to use virtual reality and manipulation to train construction workers and inspection. However, there is a lack of research efforts comparing and evaluating virtual manipulation hardware for construction tasks. Moreover, the current practice of virtual manipulation has limited functionality to guide users with the placement of objects in virtual environments. To address these issues, this paper presents 1) a detailed case study that compares three types of manipulation hardware (image-based, infrared-based, and magnetic-based) for construction applications and 2) a snap-to-fit method that improves the VM through solving limitations of the advanced virtual reality interaction metaphors. The latter enhances the placement process for manipulation by comparing two models (e.g., scan and BIM models) for proper placement in assembly scenarios. Finally, the case study results show that magnetic-based systems outperform others in construction scenarios. Lastly, the snap-to-fit function was validated in terms of accuracy and time performance.

42 ENGINEERING↗

2022 Innovation Fair - Simulation Facility to Develop Synchronization Standards for VR Visuals and Motion

Integrating Virtual Reality into the Vertical Motion Simulator for research into the future of simulation and flight To create software and hardware for integration of a Virtual Reality (VR) Head Mounted Display (HMD) into the Ames Vertical Motion Simulator for the purpose of developing and utilizing an empirical human-in-the-loop (HITL) testing method to determine spatial and temporal registration thresholds required for aligning VR Visuals with platform base motion.

Innovation Fair↗

Enhancements to VTK enabling Scientific Visualization in Immersive Environments

Modern scientific, engineering and medical computational sim- ulations, as well as experimental and observational data sens- ing/measuring devices, produce enormous amounts of data. While statistical analysis provides insight into this data, scientific vi- sualization is tactically important for scientific discovery, prod- uct design and data analysis. These benefits are impeded, how- ever, when scientific visualization algorithms are implemented from scratch—a time-consuming and redundant process in im- mersive application development. This process can greatly ben- efit from leveraging the state-of-the-art open-source Visualization Toolkit (VTK) and its community. Over the past two (almost three) decades, integrating VTK with a virtual reality (VR) environment has only been attempted to varying degrees of success. In this pa- per, we demonstrate two new approaches to simplify this amalga- mation of an immersive interface with visualization rendering from VTK. In addition, we cover several enhancements to VTK that pro- vide near real-time updates and efficient interaction. Finally, we demonstrate the combination of VTK with both Vrui and OpenVR immersive environments in example applications.

97 MATHEMATICS AND COMPUTING↗

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗

Immersive Industrialized Construction Environments for Energy Efficiency Construction Workforce

The National Renewable Energy Laboratory is actively developing and testing Immersive Industrialized Construction Environments (IICE) for construction automation and worker-machine interaction to investigate possible solutions and increase workforce productivity. At full scope and matured functionality, IICE allows us to accelerate the development of and better explore industrialized construction approaches such as prefabrication. IICE also enables wider adoption of energy-efficient products and Industry 4.0 construction automation through worker-machine interaction pilots. Industry 4.0 and industrialized construction approaches can encourage workforce specialization in energy efficiency construction, address the lack of multi-skilled workers, and increase workforce productivity with construction automation. However, recent attempts to integrate these concepts with the industry have only been moderately successful. To address this, focusing the pedagogy on using a digital twin, its digital models, and virtual reality could make the experience of continuing education on construction automation more affordable, accessible, scalable, immersive, and safer, and could greatly improve the efficiency and robustness of the building and construction industry. IICE accurately represents the realities of construction uncertainties without having to create full scale physical prototypes of machines. In this paper, we address the following research question: How can a digital twin and its models in virtual reality enhance the learning experience and productivity of energy efficiency construction workers to gain the skills in operating Industry 4.0 components such as construction automation and handling energy-efficient products in industrialized construction factories and on-site? We introduce original research on developing IICE and present preliminary findings from time and motion pilot studies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Spatially Adaptive Tunable Lighting Control System with Expanded Wellness and Energy Saving Benefits

Lighting design is becoming increasingly complex, including active dimming for energy savings and spectral tuning for human wellbeing. Modern commercial lighting control systems are already difficult to use, and maintain, and even with so-called Smart Lighting, optimizing light settings is rapidly exceeding the capabilities of direct human control, limiting the adoption of lighting control systems. The growing importance of Occupancy Centric Controls (OCC) for advanced building management systems can be applied to the development of autonomous lighting system controls needed to drive the adoption of advanced lighting controls for improved adaptive “sculpted illumination” for both greater energy savings and broader human wellbeing perspectives. This project, led by Rensselaer Polytechnic Institute, entitled “Spatially adaptive tunable lighting control system with expanded wellness and energy saving benefits” will develop and test an entirely new platform for automated optimized lighting design and control that requires little or no human engagement, yet contours lighting profiles automatically to minimize lighting energy use. We call this approach to lighting control “dynamic light sculpting” since the right amount of illumination is automatically delivered to occupants in real time. Since the system uses new, privacy-preserving occupant position and pose detection technologies developed by Rensselaer for broad OCC building applications, the control system will analyze how to deliver the right amount of the right type of illumination only where and when it is needed based these OCC platforms. To create these powerful autonomous lighting control platforms, the project will integrate evolving augmented reality (AR) and virtual reality (VR) tools with sophisticated lighting and interior design toolkits to create interactive lighting design and control simulators. Using the quickly growing paradigm of digital twins, these tools will integrate light fixture properties, occupancy sensor data, interior design data, and lighting specifications to accurately visualize how various design concepts interact with simulated yet realistic human activities that occur in commercial office buildings of various types. These advanced digital twin design and simulation tools will be combined with a new class of digitally-programmable LED lighting fixtures that can dynamically change the spectral content and direction of light emission. When fully integrated, the new autonomous lighting control system will take all of the guesswork out of optimizing light quality while minimizing energy consumption. Digital twin tools will simplify the design, installation, commissioning, operation, and maintenance of future energy-efficient lighting systems. It should be possible to reduce lighting energy costs from 40% to 70% with OCC based dynamic light sculpting systems. The work will be led by the Center for Lighting Enabled Systems and Applications (LESA) and the Center for Architectural Science and Ecology (CASE), both at Renssealer Polytechnic Institute; Lumileds, a global leader in the development of advanced LED systems; and HKS, a leading global architecture design firm. This interdisciplinary project team’s experience includes all of the design simulation tools, VR/AR digital twin visualization technology, advanced occupancy sensing technology, and complex control system design capabilities that will revolutionize lighting design and control technology to autonomously deliver high-quality lighting that improves human health and wellbeing while simultaneously maximizing lighting energy savings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multi-modal virtual environment research at Armstrong Laboratory

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Eggleston, Robert G.↗

Biological Visualization, Imaging and Simulation(Bio-VIS) at NASA Ames Research Center: Developing New Software and Technology for Astronaut Training and Biology Research in Space

The Bio- Visualization, Imaging and Simulation (BioVIS) Technology Center at NASA's Ames Research Center is dedicated to developing and applying advanced visualization, computation and simulation technologies to support NASA Space Life Sciences research and the objectives of the Fundamental Biology Program. Research ranges from high resolution 3D cell imaging and structure analysis, virtual environment simulation of fine sensory-motor tasks, computational neuroscience and biophysics to biomedical/clinical applications. Computer simulation research focuses on the development of advanced computational tools for astronaut training and education. Virtual Reality (VR) and Virtual Environment (VE) simulation systems have become important training tools in many fields from flight simulation to, more recently, surgical simulation. The type and quality of training provided by these computer-based tools ranges widely, but the value of real-time VE computer simulation as a method of preparing individuals for real-world tasks is well established. Astronauts routinely use VE systems for various training tasks, including Space Shuttle landings, robot arm manipulations and extravehicular activities (space walks). Currently, there are no VE systems to train astronauts for basic and applied research experiments which are an important part of many missions. The Virtual Glovebox (VGX) is a prototype VE system for real-time physically-based simulation of the Life Sciences Glovebox where astronauts will perform many complex tasks supporting research experiments aboard the International Space Station. The VGX consists of a physical display system utilizing duel LCD projectors and circular polarization to produce a desktop-sized 3D virtual workspace. Physically-based modeling tools (Arachi Inc.) provide real-time collision detection, rigid body dynamics, physical properties and force-based controls for objects. The human-computer interface consists of two magnetic tracking devices (Ascention Inc.) attached to instrumented gloves (Immersion Inc.) which co-locate the user's hands with hand/forearm representations in the virtual workspace. Force-feedback is possible in a work volume defined by a Phantom Desktop device (SensAble inc.). Graphics are written in OpenGL. The system runs on a 2.2 GHz Pentium 4 PC. The prototype VGX provides astronauts and support personnel with a real-time physically-based VE system to simulate basic research tasks both on Earth and in the microgravity of Space. The immersive virtual environment of the VGX also makes it a useful tool for virtual engineering applications including CAD development, procedure design and simulation of human-system systems in a desktop-sized work volume.

Smith, Jeffrey↗

Rapid Model Import Tool (RMIT) User Guide

The NASA Rapid Model Import Tool (RMIT) is designed to import 3D models built in commercially available Computer Aided Design (CAD) and Digital Content Creation (DCC) development software such as; Catia, Creo, 3DS Max, Maya, etc. Upon import, RMIT processes the models to reduce file size and exports the results in a format compatible with Augmented Reality (AR) and Virtual Reality (VR) development software applications. RMIT intends to make CAD models directly accessible to engineers from local AR/VR compatible laptops and desktops.

Joseluis Chavez↗

A VR-based volumetric medical image segmentation and visualization system with natural human interaction

Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.

42 ENGINEERING↗

Developing a Motion-Based System for Lunar Vehicle Handling Qualities Testing

— Motion and visual cue influences are critical in any simulator system, as they impact multiple aspects of the human’s neurovestibular and visual systems. Cues of real motion proceeds to the brain before cues of visual change. It is important therefore for simulator motion cues to exist and to match those realistically with those of the real vehicle to provide transferable training of the activity for operations. The United Kingdom’s Royal Air Force Institute of Aviation Medicine (1989)[1] stated that motion platforms are the only simulation devices capable of fully stimulating the body motion sensors. They confirmed that motion platforms can impart accelerations to the whole body and therefore exercise the automatic motion feedback-loop that operators are used to. With both visual and motion cues handling the vehicle becomes more realistic. Strachan (2019)[1] confirms motion cueing from a well set-up motion platform has been found to be important especially in conditions such as night or reduced visibility where motion cues may be more relied upon. As of this writing, the only lunar rover motion simulator is housed at the General Motors (GM) Milford Proving Ground, which only simulates the motions of a traditional car. A NASA Test Team proposed to complete a motion-based simulation system for NASA’s Lunar Terrain Vehicle (LTV) which resides at Johnson Space Center’s Systems Engineering Simulator facility. This activity integrated existing fixed base simulation capabilities with a newly procured six-degree of freedom motion base platform for the design, development, evaluation, and training associated with the LTV project. This would incorporate a South Pole Lunar virtual reality simulation using Lunar Reconnaissance Orbiter 5m/pixel high-resolution imagery and Unreal 5.2 Virtual Shadow Maps, combined with a virtual reality (VR) headset, integrated within a rover cockpit on a Mikrolar Motion Platform for evaluating human performance and vehicle handling qualities for concept roving vehicle designs. The motion-based system received its Human Rating Certification on March 2023. To begin testing the new facility, a preliminary handling qualities study was conducted. The objectives were to determine if there is a correlation amongst three handling quality methods of performance for a lunar vehicle and to understand the effects of a simulated 1/6-g loads and visuals with a motion platform on the operator while in a 1-g physical environment. The capability this system provides directly benefits the NASA’s Extravehicular Activity and Human Surface Mobility Program and NASA’s Flight Operations Directorate in evaluating the driving qualities of vehicle concepts, human performance related to the operating of a lunar surface vehicle, and assessment of suit related driving impacts. It would also provide direct operational benefit by providing a first-in class and unique simulation platform for the lunar astronaut training curriculum. The empirical knowledge of rover and human performance on this scale is paramount as there is currently no other lunar surface simulator with these capabilities. The result of this study ensures a broadly applicable method of testing for shirtsleeve, unpressurized and pressurized suited rover handling qualities.

Test Track↗

Approaches to the Successful Design and Implementation of VR Applications

The successful design of virtual reality applications involves both "top-down" and "bottom-up" strategies. This talk will broadly outline these strategies: how bottom-up strategies are driven primarily by performance considerations; and how top-down strategies are driven primarily by the application task, the interaction metaphors, and the integration of the virtual environment. How to ensure these two approaches "meet in the middle" through Iterative design processes will be stressed. The discussion will be motivated by examples of both success and failure. The talk contains information bryson presented at SIGGRAPH '93 and Visualization '93, and is a high-level discussion of design principles for virtual reality. There will be essentially no discussion of virtual wind tunnel specific issues or any other matters relating to aerospace, the tutorial is a repeat of the tutorial Bryson and Steve Feiner presented at Visualization '93 In October 1993 in San Jose, CA, and will cite the virtual windtunnel only as an example.

Bryson, Steve↗

The Application of Modeling and Simulation to the Behavioral Deficit of Autism

This abstract describes a research effort to apply technological advances in virtual reality simulation and computer-based games to create behavioral modification programs for individuals with Autism Spectrum Disorder (ASD). The research investigates virtual social skills training within a 3D game environment to diminish the impact of ASD social impairments and to increase learning capacity for optimal intellectual capability. Individuals with autism will encounter prototypical social contexts via computer interface and will interact with 3D avatars with predefined roles within a game-like environment. Incremental learning objectives will combine to form a collaborative social environment. A secondary goal of the effort is to begin the research and development of virtual reality exercises aimed at triggering the release of neurotransmitters to promote critical aspects of synaptic maturation at an early age to change the course of the disease.

Anton, John J.↗

An applications-oriented approach to the development of virtual environments

The field of Virtual Reality (VR) is diverse, ranging in scope from research into fundamental enabling technologies to the building of full-scale entertainment facilities. However, the concept of virtual reality means many things to many people. Ideally, a definition of VR should derive from how it can provide solutions to existing challenges in building advanced human computer interfaces. The measure of success for VR lies in its ability to enhance the assimilation of complex information, whether to aid in difficult decision making processes, or to recreate real experiences in a compelling way. This philosophy is described using an example from a VR-based advertising project. The common and unique elements of this example are explained, though the fundamental development process is the same for all virtual environments that support information transfer. In short, this development approach is an applications oriented approach that begins by establishing and prioritizing user requirements and seeks to add value to the information transfer process through the appropriate use of VR technology.

Crowe, Michael X.↗

Object Creation and Human Factors Evaluation for Virtual Environments

The main objective of this project is to provide test objects for simulated environments utilized by the recently established Army/NASA Virtual Innovations Lab (ANVIL) at Marshall Space Flight Center, Huntsville, Al. The objective of the ANVIL lab is to provide virtual reality (VR) models and environments and to provide visualization and manipulation methods for the purpose of training and testing. Visualization equipment used in the ANVIL lab includes head-mounted and boom-mounted immersive virtual reality display devices. Objects in the environment are manipulated using data glove, hand controller, or mouse. These simulated objects are solid or surfaced three dimensional models. They may be viewed or manipulated from any location within the environment and may be viewed on-screen or via immersive VR. The objects are created using various CAD modeling packages and are converted into the virtual environment using dVise. This enables the object or environment to be viewed from any angle or distance for training or testing purposes.

Lindsey, Patricia F.↗

STS-112 Crew Training Clip

Footage shows the crew of STS-112 (Jeffrey Ashby, Commander; Pamela Melroy, Pilot; David Wolf, Piers Sellers, Sandra Magnus, and Fyodor Yurchikhin, Mission Specialists) during several parts of their training. The video is arranged into short segments. In 'Topside Activities at the NBL', Wolf and Sellers are fitted with EVA suits for pool training. 'Pre-Launch Bailout Training in CCT II' shows all six crew members exiting from the hatch on a model of a shuttle orbiter cockpit. 'EVA Training in the VR Lab' shows a crew member training with a virtual reality simulator, interspersed with footage of Magnus, and Wolf with Melroy, at monitors. There is a 'Crew Photo Session', and 'Pam Melroy and Sandy Magnus at the SES Dome' also features a virtual reality simulator. The final two segments of the video involve hands-on training. 'Post Landing Egress at the FFT' shows the crew suiting up into their flight suits, and being raised on a harness, to practice rapelling from the cockpit hatch. 'EVA Prep and Post at the ISS Airlock' shows the crew assembling an empty EVA suit onboard a model of a module. The crew tests oxygen masks, and Sellers is shown on an exercise bicycle with an oxygen mask, with his heart rate monitored (not shown).

Source record↗