Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Immersive Environment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS1976

Advanced composites: Environmental effects on selected resin matrix materials

The effects that expected space flight environment has upon the mechanical properties of epoxy and polyimide matrix composites were analyzed. Environmental phenomena covered water immersion, high temperature aging, humidity, lightning strike, galvanic action, electromagnetic interference, thermal shock, rain and sand erosion, and thermal/vacuum outgassing. The technology state-of-the-art for graphite and boron reinforced epoxy and polyimide matrix materials is summarized to determine the relative merit of using composites in the space shuttle program. Resin matrix composites generally are affected to some degree by natural environmental phenomena with polyimide resin matrix materials less affected than epoxies.

Welhart, E. K.↗
NASA NTRS1996

A convertor and user interface to import CAD files into worldtoolkit virtual reality systems

Virtual Reality (VR) is a rapidly developing human-to-computer interface technology. VR can be considered as a three-dimensional computer-generated Virtual World (VW) which can sense particular aspects of a user's behavior, allow the user to manipulate the objects interactively, and render the VW at real-time accordingly. The user is totally immersed in the virtual world and feel the sense of transforming into that VW. NASA/MSFC Computer Application Virtual Environments (CAVE) has been developing the space-related VR applications since 1990. The VR systems in CAVE lab are based on VPL RB2 system which consists of a VPL RB2 control tower, an LX eyephone, an Isotrak polhemus sensor, two Fastrak polhemus sensors, a folk of Bird sensor, and two VPL DG2 DataGloves. A dynamics animator called Body Electric from VPL is used as the control system to interface with all the input/output devices and to provide the network communications as well as VR programming environment. The RB2 Swivel 3D is used as the modelling program to construct the VW's. A severe limitation of the VPL VR system is the use of RB2 Swivel 3D, which restricts the files to a maximum of 1020 objects and doesn't have the advanced graphics texture mapping. The other limitation is that the VPL VR system is a turn-key system which does not provide the flexibility for user to add new sensors and C language interface. Recently, NASA/MSFC CAVE lab provides VR systems built on Sense8 WorldToolKit (WTK) which is a C library for creating VR development environments. WTK provides device drivers for most of the sensors and eyephones available on the VR market. WTK accepts several CAD file formats, such as Sense8 Neutral File Format, AutoCAD DXF and 3D Studio file format, Wave Front OBJ file format, VideoScape GEO file format, Intergraph EMS stereolithographics and CATIA Stereolithographics STL file formats. WTK functions are object-oriented in their naming convention, are grouped into classes, and provide easy C language interface. Using a CAD or modelling program to build a VW for WTK VR applications, we typically construct the stationary universe with all the geometric objects except the dynamic objects, and create each dynamic object in an individual file.

Wang, Peter Hor-Ching↗
NASA NTRS2009

Spaceflight Sensorimotor Analogs: Simulating Acute and Adaptive Effects

Adaptive changes in sensorimotor function during spaceflight are reflected by spatial disorientation, motion sickness, gaze destabilization and decrements in balance, locomotion and eye-hand coordination that occur during and following transitions between different gravitational states. The purpose of this study was to conduct a meta-synthesis of data from spaceflight analogs to evaluate their effectiveness in simulating adaptive changes in sensorimotor function. METHODS. The analogs under review were categorized as either acute analogs used to simulate performance decrements accompanied with transient changes, or adaptive analogs used to drive sensorimotor learning to altered sensory feedback. The effectiveness of each analog was evaluated in terms of mechanisms of action, magnitude and time course of observed deficits compared to spaceflight data, and the effects of amplitude and exposure duration. RESULTS. Parabolic flight has been used extensively to examine effects of acute variation in gravitational loads, ranging from hypergravity to microgravity. More recently, galvanic vestibular stimulation has been used to elicit acute postural, locomotor and gaze dysfunction by disrupting vestibular afferents. Patient populations, e.g., with bilateral vestibular loss or cerebellar dysfunction, have been proposed to model acute sensorimotor dysfunction. Early research sponsored by NASA involved living onboard rotating rooms, which appeared to approximate the time course of adaptation and post-exposure recovery observed in astronauts following spaceflight. Exposure to different bed-rest paradigms (6 deg head down, dry immersion) result in similar motor deficits to that observed following spaceflight. Shorter adaptive analogs have incorporated virtual reality environments, visual distortion paradigms, exposure to conflicting tilt-translation cues, and exposure to 3Gx centrifugation. As with spaceflight, there is considerable variability in responses to most of the analogs reviewed. DISCUSSION. A true ground-based flight analog for sensorimotor function is not feasible. A combination of flight analogs; however, can be used to selectively mimic different aspects of the spaceflight-induced sensorimotor performance decrements.

Taylor, Laura C.↗
NASA NTRS1990

Effectiveness of the Space Shuttle anti-exposure system in a cold water environment

The purpose of this study was to evaluate the NASA Space Shuttle launch entry suit (LES) and raft for 24 h of protection against cold water immersion. Two configurations, the LES and the LES with raft (LES/r) were evaluated for antiexposure protection. Conditions were selected to simulate worst-case water and air temperatures along projected Space Shuttle ground tracks; i.e., water temperatures = 4.4 C, air temperature = 5.6 C, 1-foot waves (chop), and constant spray. Four males 31-44 years of age and one 32-year-old female were studied once in each configuration. Trials with and without a raft were scheduled for up to 24 and 6 h, respectively. Mean LES trial durations were 150 + or - 9 min and final rectal temperature (FRT) = 36.5 + or - 0.3 C. Mean LES/r trial durations were 398 + or - 126 min and FRT = 35.6 + or - 0.4 C. LES and LES/r trials were terminated for reaching FRT = 35.0 C or subject-requested termination due to discomfort. The longest LES and LES/r trials were terminated due to subject discomfort. Although not achieving the desired durations, the LES and LES/r did prove capable of protecting individuals, respectively, for up to 3 and 13.5 h. Since the longest runs were terminated due to subjective tolerance, actual survival times greater than 3 and 13.5 h could be expected.

Bagian, James P.↗
DOE OSTI2020

Complex plant-derived organic aerosol as ice-nucleating particles – more than the sums of their parts?

Quantifying the impact of complex organic particles on the formation of ice crystals in clouds remains challenging, mostly due to the vast number of different sources ranging from sea spray to agricultural areas. In particular, there are many open questions regarding the ice nucleation properties of organic particles released from terrestrial sources such as decaying plant material. In this work, we present results from laboratory studies investigating the immersion freezing properties of individual organic compounds commonly found in plant tissue and complex organic aerosol particles from vegetated environments, without specifically investigating the contribution from biological particles, which may contribute to the overall ice nucleation efficiency observed at high temperatures. To characterize the ice nucleation properties of plant-related aerosol samples for temperatures between 242 and 267 K, we used the Aerosol Interaction and Dynamics in the Atmosphere (AIDA) cloud chamber and the Ice Nucleation SpEctrometer of the Karlsruhe Institute of Technology (INSEKT), which is a droplet freezing assay. Individual plant components (polysaccharides, lignin, soy and rice protein) were mostly less ice active, or similarly ice active, compared to microcrystalline cellulose, which has been suggested by recent studies to be a proxy for quantifying the primary cloud ice formation caused by particles originating from vegetation. In contrast, samples from ambient sources with a complex organic matter composition (agricultural soils and leaf litter) were either similarly ice active or up to 2 orders of magnitude more ice active than cellulose. Of all individual organic plant components, only carnauba wax (i.e., lipids) showed a similarly high ice nucleation activity as that of the samples from vegetated environments over a temperature range between 245 and 252 K. Hence, based on our experimental results, we suggest considering cellulose as being representative for the average ice nucleation activity of plant-derived particles, whereas lignin and plant proteins tend to provide a lower limit. In contrast, complex biogenic particles may exhibit ice nucleation activities which are up to 2 orders of magnitude higher than observed for cellulose, making ambient plant-derived particles a potentially important contributor to the population of ice-nucleating particles in the troposphere, even though major uncertainties regarding their transport to cloud altitude remain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1977

A study of the effects of long-term exposure to fuels and fluids on the behavior of advanced composite materials

The Task 1 (thirty-six-month) and Task 2 (twelve-month) exposure of composite materials to fuel and fluid environments are reported. Narmco T300/5209 (Task 1) shows no significant degradation. Slightly lower mechanical properties were obtained from fuel/water immersion exposure of this material. Kevlar 49/2544 (also Task 1) exhibits significant drop in short-beam shear when exposed to fuel/water immersion. Task 2 materials (T300/5208, Kevlar 49 fabric/5209, and Kevlar 49 fibers) have not shown any significant mechanical property degradation to date.

Hendricks, C. L.↗
NASA NTRS1991

Low altitude plume impingement handbook

Plume Impingement modeling is required whenever an object immersed in a rocket exhaust plume must survive or remain undamaged within specified limits, due to thermal and pressure environments induced by the plume. At high altitudes inviscid plume models, Monte Carlo techniques along with the Plume Impingement Program can be used to predict reasonably accurate environments since there are usually no strong flowfield/body interactions or atmospheric effects. However, at low altitudes there is plume-atmospheric mixing and potential large flowfield perturbations due to plume-structure interaction. If the impinged surface is large relative to the flowfield and the flowfield is supersonic, the shock near the surface can stand off the surface several exit radii. This results in an effective total pressure that is higher than that which exists in the free plume at the surface. Additionally, in two phase plumes, there can be strong particle-gas interaction in the flowfield immediately ahead of the surface. To date there have been three levels of sophistication that have been used for low altitude plume induced environment predictions. Level 1 calculations rely on empirical characterizations of the flowfield and relatively simple impingement modeling. An example of this technique is described by Piesik. A Level 2 approach consists of characterizing the viscous plume using the SPF/2 code or RAMP2/LAMP and using the Plume Impingement Program to predict the environments. A Level 3 analysis would consist of using a Navier-Stokes code such as the FDNS code to model the flowfield and structure during a single calculation. To date, Level 1 and Level 2 type analyses have been primarily used to perform environment calculations. The recent advances in CFD modeling and computer resources allow Level 2 type analysis to be used for final design studies. Following some background on low altitude impingement, Level 1, 2, and 3 type analysis will be described.

Smith, Sheldon D.↗
NASA NTRS2007

An Analysis of the Orbital Distribution of Solid Rocket Motor Slag

The contribution made by orbiting solid rocket motors (SRMs) to the orbital debris environment is both potentially significant and insufficiently studied. A combination of rocket motor design and the mechanisms of the combustion process can lead to the emission of sufficiently large and numerous by-products to warrant assessment of their contribution to the orbital debris environment. These particles are formed during SRM tail-off, or the termination of burn, by the rapid expansion, dissemination, and solidification of the molten Al2O3 slag pool accumulated during the main burn phase of SRMs utilizing immersion-type nozzles. Though the usage of SRMs is low compared to the usage of liquid fueled motors, the propensity of SRMs to generate particles in the 100 m and larger size regime has caused concern regarding their contributing to the debris environment. Particle sizes as large as 1 cm have been witnessed in ground tests conducted under vacuum conditions and comparable sizes have been estimated via ground-based telescopic and in-situ observations of sub-orbital SRM tail-off events. Using sub-orbital and post recovery observations, a simplistic number-size-velocity distribution of slag from on-orbit SRM firings was postulated. In this paper we have developed more elaborate distributions and emission scenarios and modeled the resultant orbital population and its time evolution by incorporating a historical database of SRM launches, propellant masses, and likely location and time of particulate deposition. From this analysis a more comprehensive understanding has been obtained of the role of SRM ejecta in the orbital debris environment, indicating that SRM slag is a significant component of the current and future population.

Horstman, Matthew F.↗
NASA NTRS2016

Hybrid Reality Lab Capabilities - Video 2

Our Hybrid Reality and Advanced Operations Lab is developing incredibly realistic and immersive systems that could be used to provide training, support engineering analysis, and augment data collection for various human performance metrics at NASA. To get a better understanding of what Hybrid Reality is, let's go through the two most commonly known types of immersive realities: Virtual Reality, and Augmented Reality. Virtual Reality creates immersive scenes that are completely made up of digital information. This technology has been used to train astronauts at NASA, used during teleoperation of remote assets (arms, rovers, robots, etc.) and other activities. One challenge with Virtual Reality is that if you are using it for real time-applications (like landing an airplane) then the information used to create the virtual scenes can be old (i.e. visualized long after physical objects moved in the scene) and not accurate enough to land the airplane safely. This is where Augmented Reality comes in. Augmented Reality takes real-time environment information (from a camera, or see through window, and places digitally created information into the scene so that it matches with the video/glass information). Augmented Reality enhances real environment information collected with a live sensor or viewport (e.g. camera, window, etc.) with the information-rich visualization provided by Virtual Reality. Hybrid Reality takes Augmented Reality even further, by creating a higher level of immersion where interactivity can take place. Hybrid Reality takes Virtual Reality objects and a trackable, physical representation of those objects, places them in the same coordinate system, and allows people to interact with both objects' representations (virtual and physical) simultaneously. After a short period of adjustment, the individuals begin to interact with all the objects in the scene as if they were real-life objects. The ability to physically touch and interact with digitally created objects that have the same shape, size, location to their physical object counterpart in virtual reality environment can be a game changer when it comes to training, planning, engineering analysis, science, entertainment, etc. Our Project is developing such capabilities for various types of environments. The video outlined with this abstract is a representation of an ISS Hybrid Reality experience. In the video you can see various Hybrid Reality elements that provide immersion beyond just standard Virtual Reality or Augmented Reality.

Delgado, Francisco J.↗
NASA NTRS1991

A method of evaluating efficiency during space-suited work in a neutral buoyancy environment

The purpose was to investigate efficiency as related to the work transmission and the metabolic cost of various extravehicular activity (EVA) tasks during simulated microgravity (whole body water immersion) using three space suits. Two new prototype space station suits, AX-5 and MKIII, are pressurized at 57.2 kPa and were tested concurrently with the operationally used 29.6 kPa shuttle suit. Four male astronauts were asked to perform a fatigue trial on four upper extremity exercises during which metabolic rate and work output were measured and efficiency was calculated in each suit. The activities were selected to simulate actual EVA tasks. The test article was an underwater dynamometry system to which the astronauts were secured by foot restraints. All metabolic data was acquired, calculated, and stored using a computerized indirect calorimetry system connected to the suit ventilation/gas supply control console. During the efficiency testing, steady state metabolic rate could be evaluated as well as work transmitted to the dynamometer. Mechanical efficiency could then be calculated for each astronaut in each suit performing each movement.

Greenisen, Michael C.↗
NASA NTRS1977

Heat Acclimation and Water-Immersion Deconditioning: Fluid Electrolyte Shifts with Tilting

One of the major problems encountered by astronauts exposed to space flight is a reduction of orthostatic tolerance on return to earth. Many studies have been performed in an attempt to define the physiologic mechanism of orthostatic intolerance and to develop some remedial treatment. Exercise training does not appear to enhance orthostatic tolerance . In contrast, heat acclimation (i.e., exercise training in the heat) has been reported to enhance orthostatic tolerance. Since plasma volume increases with both exercise training and heat acclimation, it is not clear what role fluid and electrolytes play in determining tolerance to hydrostatic pressure. The purpose of this study was to compare the effects of exercise training in a cool environment and heat acclimation on resting plasma volume (PV) and the ensuing fluid and electrolyte shifts which occur during head-up tilting before and after water immersion deconditioning.

Conertino, V. A.↗
DOE OSTI2026

Three-Dimensional Grid Visualization for Planning Activities: A Dubai Case Study

National Laboratory of the Rockies (NLR), in collaboration with the Dubai Electricity and Water Authority (DEWA) and Infra-X, has undertaken the Energy Visualization Analysis Project. The aim of this project is to enhance analytical and 3D visualization capabilities for distribution network planning and renewable energy integration. As modern grid continues to evolve with large-scale solar PV deployment and emerging distributed energy resources (DERs), the ability to effectively analyze, visualize, and communicate complex grid behaviors has become increasingly critical. The project focuses on developing empirical use cases based on real distribution feeder data and engineering workflows, ensuring the outcomes are directly aligned with operational environment. Through time-series power flow simulations and nodal hosting capacity analysis, the study quantifies the impacts of high PV penetration on voltage and thermal limits within representative 11 kV feeders. These analyses identify specific nodes and conditions where DER integration challenges arise. Furthermore, a Battery Energy Storage System (BESS) optimization algorithm was applied to determine the optimal size and placement of storage systems that can mitigate network constraints and enhance hosting capacity. The comparative results between base-case and BESS-augmented scenarios clearly demonstrate improvements in network stability and load management efficiency. In parallel, the NLR team developed an immersive 3D visualization framework, enabling interactive exploration of grid simulations using commodity head-mounted display (HMD) systems. This framework transforms conventional 2D simulation data into spatially intuitive visual environments - allowing engineers to analyze feeder conditions, PV hosting potential, and BESS effects in real time. This report represents the first foundational phase in establishing a visualization-driven analytical ecosystem. It provides a methodological foundation for data integration, visualization architecture, and simulation-based decision support, paving the way for large-scale adoption of immersive visualization across DEWA's Smart Grid Initiative, R&D activities, and future network resilience studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2010

Correlation of Wissler Human Thermal Model Blood Flow and Shiver Algorithms

The Wissler Human Thermal Model (WHTM) is a thermal math model of the human body that has been widely used to predict the human thermoregulatory response to a variety of cold and hot environments. The model has been shown to predict core temperature and skin temperatures higher and lower, respectively, than in tests of subjects in crew escape suit working in a controlled hot environments. Conversely the model predicts core temperature and skin temperatures lower and higher, respectively, than in tests of lightly clad subjects immersed in cold water conditions. The blood flow algorithms of the model has been investigated to allow for more and less flow, respectively, for the cold and hot case. These changes in the model have yielded better correlation of skin and core temperatures in the cold and hot cases. The algorithm for onset of shiver did not need to be modified to achieve good agreement in cold immersion simulations

Bue, Grant↗
NASA NTRS2012

A Storm's Approach; Hurricane Shelter Training in a Digital Age

New York City's Office of Emergency Management (OEM) originally ran hundreds of classroom based courses, where they brought together civil servants to learn how to run a Hurricane Shelter (HS). This approach was found to be costly, time consuming and lacked any sense of an impending disaster and need for emergency response. In partnership with the City of New York University School of Professional studies, Gronstedt Group and Daden Limited, the OEM wanted to create a simulation that overcame these issues, providing users with a more immersive and realistic approach at a lower cost. The HS simulation was built in the virtual world Second Life (SL). Virtual worlds are a genre of online communities that often take the form of a computer-based simulated environments, through which users can interact with one another and use or create objects. Using this technology allowed managers to apply their knowledge in both classroom and remote learning environments. The shelter simulation is operational 24/7, guiding users through a 4 1/2 hour narrative from start to finish. This paper will describe the rationale for the project, the technical approach taken - particularly the use of a web based authoring tool to create and manage the immersive simulation, and the results from operational use.

Boyarsky, Andrew↗
DOE OSTI2024

Corrosion of Zinc Cold Spray Coatings in a Wet Sweet and Sour Gas Environment

Internal corrosion is a problem for steel pipelines transporting natural gas or CO 2 containing water and partial pressures of H 2 S higher than 0.3 kPa (0.05 psi). This work aims to mitigate internal corrosion in steel pipelines transporting natural gas containing H 2 S using cold spray coatings. Two types of the cold spray binary metallic coatings (zinc chromium [ZnCr]. zinc niobium [ZnNb]) were studied using electrochemical techniques: potentiodynamic polarization, linear polarization resistance, and electrochemical impedance spectroscopy. The corrosion resistance of cold spray coatings (ZnCr, ZnNb) was evaluated in an environment containing 4 bar CO 2 pressure, simulating the partial pressures found in gas transmission lines over a solution of 3.5 wt% NaCl heated to 40°C. A concentration of 0.003 M Na 2 S 2 O 3 ·5H 2 O, corresponding to H 2 S partial pressures around 0.079 bar (1.146 psi), was used to simulate sour conditions. Postcorrosion surface characterization was performed using a scanning electron microscope (SEM) equipped with an energy-dispersive x-ray spectroscope (EDS) and x-ray diffraction analysis. The data showed that the presence of 0.003 M Na 2 S 2 O 3 ·5H 2 O shifted the corrosion potential to more anodic values and decreased the corrosion current density. Both coatings showed similar behavior after 1 h of exposure in the CO 2 /H 2 S environment, indicating that similar electrochemical reactions were occurring on ZnNb and ZnCr. SEM images and EDS surface analyses for specimens showed a significant change in the surface chemical composition of carbon steel coated with ZnNb and ZnCr after 24 h of immersion. In the presence of thiosulfate (under sour conditions), the formation of corrosion product layers (ZnCO 3 and ZnS) on top of ZnNb and ZnCr coatings increased their corrosion resistance, which helped to reduce their corrosion by a factor of 2. Under a sweet environment, the corrosion rates for steel coated with cold spray coatings after 14 d of exposure are lower than that for galvanized steel by a factor of 5 due to the ZnCO 3 layer formed on top of the coatings. The ZnCO 3 layer formed on the steel surface acts as a physical barrier against corrosion by blocking the diffusion of corrosive species to the surface. No localized attack was observed. ZnCr Cold spray coating with defect showed promising corrosion protection against CO 2 corrosion (sweet corrosion) after 14 d of exposure to a CO 2 environment. Here, the scratch on the coating simulated damage created in service, and it was deep enough to expose the substrate material (steel). The formation of zinc oxide (ZnO) and zinc carbonate (ZnCO 3 ) on the scratch confirmed the cathodic protection of the steel by ZnCr and ZnNb coatings.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

Sim to Flight: Evaluating Flight Path Management Automation in High Density Urban Environments

Combined simulation and flight testing enable the study of single- and multi-aircraft performance of onboard automation systems for dynamic flight path management (FPM). The National Aeronautics and Space Administration (NASA) is investigating system performance and functional capabilities of such automation for immersion into complex, high density, future operations such as Urban Air Mobility (UAM). This paper provides an overview of a series of interdependent sim-to-flight research activities involving large-scale batch simulations, human-in-the-loop verification, and flight-test validation of a research prototype FPM automation system. Together, they significantly contributed to a functional assessment of FPM automation functionality in a live-virtual-constructive (LVC) operating environment characterized by two live aircraft and hundreds of virtual aircraft interacting in a modeled complex urban airspace. Initial simulation and flight test results, future work, and conclusions are presented.

Advanced Air Mobility↗
NASA NTRS2005

Validation of NHB 8060.1C, Test 18 Arc Tracking, September 30, 1991

A test project was conducted to validate Test 18 of NASA Handbook (NHB) 8060.1C and, if necessary, identify and recommend improvements in the procedures or criteria of the test. The NHB 8060.1C, Test 18 test system was modified to produce better discrimination of test results. Changes, and their effects on test results, in the graphite immersion-depth, test timing sequence, and atmospheric conditions were investigated for the wire-insulation constructions tested. Based on the test results, the graphite immersion-depths (between 0.8 mm and 1.6 mm), the timing sequence, and the change in the test conditions from ambient to three environments common in manned spaceflight did not significantly affect test results. The criteria used in Test 18 of NHB 8060.1C was found to be appropriate for qualifying arc-tracking and arc-propagation characteristics of wire-insulation materials, Using the Test 18 criteria, Kapton and ETFE were considered inappropriate for use, while PTFE was considered appropriate. Recommendations from this test project for Test 18 of NHB 8060.1C include changing the experimental setup and configurational tests and performing qualification testing in air rather than in the three environments common in manned spaceflight.

Linley, Larry↗
NASA NTRS2016

The Virtual Tablet: Virtual Reality as a Control System

In the field of human-computer interaction, Augmented Reality (AR) and Virtual Reality (VR) have been rapidly growing areas of interest and concerted development effort thanks to both private and public research. At NASA, a number of groups have explored the possibilities afforded by AR and VR technology, among which is the IT Advanced Concepts Lab (ITACL). Within ITACL, the AVR (Augmented/Virtual Reality) Lab focuses on VR technology specifically for its use in command and control. Previous work in the AVR lab includes the Natural User Interface (NUI) project and the Virtual Control Panel (VCP) project, which created virtual three-dimensional interfaces that users could interact with while wearing a VR headset thanks to body- and hand-tracking technology. The Virtual Tablet (VT) project attempts to improve on these previous efforts by incorporating a physical surrogate which is mirrored in the virtual environment, mitigating issues with difficulty of visually determining the interface location and lack of tactile feedback discovered in the development of previous efforts. The physical surrogate takes the form of a handheld sheet of acrylic glass with several infrared-range reflective markers and a sensor package attached. Using the sensor package to track orientation and a motion-capture system to track the marker positions, a model of the surrogate is placed in the virtual environment at a position which corresponds with the real-world location relative to the user's VR Head Mounted Display (HMD). A set of control mechanisms is then projected onto the surface of the surrogate such that to the user, immersed in VR, the control interface appears to be attached to the object they are holding. The VT project was taken from an early stage where the sensor package, motion-capture system, and physical surrogate had been constructed or tested individually but not yet combined or incorporated into the virtual environment. My contribution was to combine the pieces of hardware, write software to incorporate each piece of position or orientation data into a coherent description of the object's location in space, place the virtual analogue accordingly, and project the control interface onto it, resulting in a functioning object which has both a physical and a virtual presence. Additionally, the virtual environment was enhanced with two live video feeds from cameras mounted on the robotic device being used as an example target of the virtual interface. The working VT allows users to naturally interact with a control interface with little to no training and without the issues found in previous efforts.

virtual control interface↗