Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Virtual Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

An Introduction to 3-D Sound

This talk will overview the basic technologies related to the creation of virtual acoustic images, and the potential of including spatial auditory displays in human-machine interfaces. Research into the perceptual error inherent in both natural and virtual spatial hearing is reviewed, since the formation of improved technologies is tied to psychoacoustic research. This includes a discussion of Head Related Transfer Function (HRTF) measurement techniques (the HRTF provides important perceptual cues within a virtual acoustic display). Many commercial applications of virtual acoustics have so far focused on games and entertainment ; in this review, other types of applications are examined, including aeronautic safety, voice communications, virtual reality, and room acoustic simulation. In particular, the notion that realistic simulation is optimized within a virtual acoustic display when head motion and reverberation cues are included within a perceptual model.

Begault, Durand R.↗

Seeing the Future of Spaceflight: Applications of Extended Reality (XR) Technologies

INTRODUCTION Advances in Earth Independent Medical Operations (EIMO) focused capabilities will be crucial for completing successful beyond low-earth-orbit (LEO) missions, where traditional Earth-based medical support and near real-time communication are limited, intermittent, or absent. In such restricted or limited communication environments, emerging extended reality (ER or XR) technologies may play a vital role in ensuring crew health and safety. Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) are common terms used to describe technologies that "generate or modify" while “extended reality” (ER or XR) is often used as an umbrella term for these technologies. This review explores how such cutting-edge “extended reality” information delivery systems are currently applied across various disciplines within NASA. The review focuses on their capabilities, limitations, and prospective future applications as they pertain to Earth-Independent Medical Operations and its components of pre-mission planning, medical decision making, resource management, and task load management. METHODS/DESIGN The review began with a literature search to identify relevant disciplines (e.g., medical education, austere environments) where XR technologies have been studied to highlight areas where evidence is lacking. Previous and current NASA XR projects and applications, as well as commercial partnerships, such as those with Small Business Innovation Research (SBIR), were identified. Discussions with technical experts involved in the design, development, and application of these technologies allowed for classification based on their respective spaceflight applications. RESULTS AND CONCLUSION This review highlights current and emerging XR technologies that have been developed, tested, and implemented both terrestrially and in spaceflight by NASA, its international partners, the U.S. Armed Forces, and various relevant commercial entities. While these novel information delivery systems vary in their respective technology readiness levels (TRL), they have the potential to be implemented on Earth, in LEO, and during deep space exploration. These systems have the potential for impacting and optimizing many aspects of EIMO.

Yevgeniy Zhivotovskiy↗

Virtual Inspection of Advanced Manufacturing via Process-Scale Digital Twins (Abbreviated Report)

Inspection and certification comprise the most significant bottlenecks in advanced manufacturing for NNSA applications, often requiring far more time and resources than the fabrication of the parts themselves. Traditional methods, such as manual review and X-ray computed tomography, are not only slow and costly, but also struggle to provide a clear connection between manufacturing instructions and the final performance of critical components. This gap limits both the agility and assurance needed to support the modernization and safety of the United States nuclear stockpile. In response, our Strategic Initiative established a digital twin framework that integrates realtime process monitoring, automated data analysis, and immersive virtual reality collaboration into a unified inspection pipeline. By leveraging data from sensors, machine instructions, and imaging, we created high-fidelity virtual models of manufactured parts that could be rapidly analyzed and certified. This approach was first demonstrated with Direct Ink Write, and then extended to other manufacturing settings, including conventional (or “subtractive”) manufacturing and to predict the end of life performance of parts per the aging and lifetimes programs. The result is a transformational capability: inspection times have been reduced by a factor of 120,000 without loss of accuracy and while simultaneously improving traceability and confidence in part quality. This framework not only streamlines certification for critical applications, but also positions the national security enterprise to respond more flexibly to emerging challenges, supporting agile manufacturing and digital engineering practices across a broad range of mission-relevant domains.

42 ENGINEERING↗

Using CLIPS to represent knowledge in a VR simulation

Virtual reality (VR) is an exciting use of advanced hardware and software technologies to achieve an immersive simulation. Until recently, the majority of virtual environments were merely 'fly-throughs' in which a user could freely explore a 3-dimensional world or a visualized dataset. Now that the underlying technologies are reaching a level of maturity, programmers are seeking ways to increase the complexity and interactivity of immersive simulations. In most cases, interactivity in a virtual environment can be specified in the form 'whenever such-and-such happens to object X, it reacts in the following manner.' CLIPS and COOL provide a simple and elegant framework for representing this knowledge-base in an efficient manner that can be extended incrementally. The complexity of a detailed simulation becomes more manageable when the control flow is governed by CLIPS' rule-based inference engine as opposed to by traditional procedural mechanisms. Examples in this paper will illustrate an effective way to represent VR information in CLIPS, and to tie this knowledge base to the input and output C routines of a typical virtual environment.

Engelberg, Mark L.↗

Virtual environment application with partial gravity simulation

To support manned missions to the surface of Mars and missions requiring manipulation of payloads and locomotion in space, a training facility is required to simulate the conditions of both partial and microgravity. A partial gravity simulator (Pogo) which uses pneumatic suspension is being studied for use in virtual reality training. Pogo maintains a constant partial gravity simulation with a variation of simulated body force between 2.2 and 10 percent, depending on the type of locomotion inputs. this paper is based on the concept and application of a virtual environment system with Pogo including a head-mounted display and glove. The reality engine consists of a high end SGI workstation and PC's which drive Pogo's sensors and data acquisition hardware used for tracking and control. The tracking system is a hybrid of magnetic and optical trackers integrated for this application.

Ray, David M.↗

Stereoscopic, Force-Feedback Trainer For Telerobot Operators

Computer-controlled simulator for training technicians to operate remote robots provides both visual and kinesthetic virtual reality. Used during initial stage of training; saves time and expense, increases operational safety, and prevents damage to robots by inexperienced operators. Computes virtual contact forces and torques of compliant robot in real time, providing operator with feel of forces experienced by manipulator as well as view in any of three modes: single view, two split views, or stereoscopic view. From keyboard, user specifies force-reflection gain and stiffness of manipulator hand for three translational and three rotational axes. System offers two simulated telerobotic tasks: insertion of peg in hole in three dimensions, and removal and insertion of drawer.

Kim, Won S.↗

Augmented reality system for remote operation - 200

This paper presents a new approach to applications of augmented reality techniques for performing telerobotic operations in uncertain and hazardous environments. Particular application examples include remote or partially-automated operation of robotic manipulators in nuclear waste facilities, decommissioning sites, or as a part of incident remediation. Recently advances in virtual reality (VR) and augmented reality (AR) technology presents opportunity for enhancing the performance of such remote operations. VR can provide immersive artificial environment for the operator to interact with. As an advanced concept, AR adds to it the blending or artificial contents with real world - users are able to interact with virtual contents in the real world. This work addresses key technological innovations necessary for adopting the VR/AR technologies for the remote operation of hardware robotic systems in real world tasks. To this end, this work focuses on implementation of 'virtual fixtures', which allows intuitive and precise guidance of remote operation, as well as key enhancements in 3D sensing/reconstruction technology. In addition, the implementation details of the integration of the multi-modal augmented reality system to the telerobotic control system are presented. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Use of Human Modeling Simulation Software in the Task Analysis of the Environmental Control and Life Support System Component Installation Procedures

Virtual reality and simulation applications are becoming widespread in human task analysis. These programs have many benefits for the Human Factors Engineering field. Not only do creating and using virtual environments for human engineering analyses save money and time, this approach also promotes user experimentation and provides increased quality of analyses. This paper explains the human engineering task analysis performed on the Environmental Control and Life Support System (ECLSS) space station rack and its Distillation Assembly (DA) subsystem using EAI's human modeling simulation software, Jack. When installed on the International Space Station (ISS), ECLSS will provide the life and environment support needed to adequately sustain crew life. The DA is an Orbital Replaceable Unit (ORU) that provides means of wastewater (primarily urine from flight crew and experimental animals) reclamation. Jack was used to create a model of the weightless environment of the ISS Node 3, where the ECLSS is housed. Computer aided drawings of the ECLSS rack and DA system were also brought into the environment. Anthropometric models of a 95th percentile male and 5th percentile female were used to examine the human interfaces encountered during various ECLSS and DA tasks. The results of the task analyses were used in suggesting modifications to hardware and crew task procedures to improve accessibility, conserve crew time, and add convenience for the crew. This paper will address some of those suggested modifications and the method of presenting final analyses for requirements verification.

Estes, Samantha↗

Holodeck-ISS Experience

For the duration of my internship here at JSC for the summer 2016 session, the main project that I worked on dealt with hybrid reality simulations of the ISS. As an ER6 intern for the spacecraft software division, the main project that I worked alongside others was with regards to the Holodeck Virtual Reality Project, specifically with the ISS experience, with the use of the HTC Vive and controllers.

Rainbolt, Phillip↗

A Virtual Audio Guidance and Alert System for Commercial Aircraft Operations

Our work in virtual reality systems at NASA Ames Research Center includes the area of aurally-guided visual search, using specially-designed audio cues and spatial audio processing (also known as virtual or "3-D audio") techniques (Begault, 1994). Previous studies at Ames had revealed that use of 3-D audio for Traffic Collision Avoidance System (TCAS) advisories significantly reduced head-down time, compared to a head-down map display (0.5 sec advantage) or no display at all (2.2 sec advantage) (Begault, 1993, 1995; Begault & Pittman, 1994; see Wenzel, 1994, for an audio demo). Since the crew must keep their head up and looking out the window as much as possible when taxiing under low-visibility conditions, and the potential for "blunder" is increased under such conditions, it was sensible to evaluate the audio spatial cueing for a prototype audio ground collision avoidance warning (GCAW) system, and a 3-D audio guidance system. Results were favorable for GCAW, but not for the audio guidance system.

Begault, Durand R.↗

Augmented Reality Rendering of Computed Tomography 3-D Density Data

Overall Objectives: Purchase equipment and Software required to develop the technology; Import CT Data for viewing on an AR device; Develop the tools necessary to manipulate the data in AR. With Augmented and Virtual Reality technology becoming more common and affordable everyday, new visualization techniques need to be developed that can leverage this technology to visualize data in new and useful ways. Computed Tomography (CT) scans, are the result of a powerful X-ray machine taking multiple images of the same object. These images represent slices of the original object and have extremely high resolution. Because of the high resolution, CT scanning is often used in the medical field but is becoming increasingly predominate in diverse industrial fields as well. This is an example of a CT scan that shows an object with multiple items inside. These items are represented by different colors in gray scale to indicate different densities. This is also from the data set used for the duration of the project. The data sets usually contain hundreds of slides that looks like just like this. Visualizing these large data sets can be difficult. The general approach for this seedling was to identify the devices and software that are currently in use for data visualization and evaluate them for use in the project. After that a plan was made to convert the data into a format viewable in AR. Tools were then developed to manipulate that data. The project was a success, but there is plenty of room to advance the technology and create better visualizations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology and Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical work load during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2) were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alex Baughman↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology And Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical workload during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2)were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alexander J Baughman↗

Software of Seismic Proportions Promotes Enjoyable Learning

While working for NASA, Jack Sculley and Terry Brooks had a revelation. They wanted to find a novel and unique way to present the scientific principles of NASA research to the public, so as to not only enlighten, but entertain. Suddenly, their revelation morphed into something even grander. "Why stop at NASA?" they asked themselves. With this thought, Sculley and Brooks left NASA and set out to convey voluminous scientific findings from different organizations in the form of digital, interactive media that would enhance the exploration and adventure interests of people of all ages. Sculley, a former researcher at Ames Research Center, the Jet Propulsion Laboratory (JPL), and Apple, Inc. s and LucasFilm Ltd. s multimedia labs, and Brooks, a former public information officer at JPL and an Emmy award-winning documentary film producer, founded Seismic Entertainment in 1989 to communicate their "edutainment" ideas. The two acknowledge that NASA has provided much of the inspiration and content for Seismic Entertainment over the past decade and a half. Additionally, Sculley s experience as a virtual reality and Mars specialist and Brooks s experience creating NASA public access programs were significant to the San Francisco-based company s success. Its most recent project, "Inside NASA," provides virtual tours of NASA s field centers and allows for a comprehensive focus on the broad range of NASA programs for the benefit of the general public

Source record↗

The NASA Ames Controlled Environment Research Chamber: Present status

The Controlled Environment Research Chamber (CERC) at the NASA Ames Research Center was created for early-on investigation of promising new technologies for life support of advanced space exploration missions. The CERC facility is being used to address the advanced technology requirements necessary to implement an integrated working and living environment for a planetary habitat. The CERC, along with a human-powered centrifuge, a planetary terrain simulator, advanced displays, and a virtual reality, is able to develop and demonstrate applicable technologies for future planetary exploration. There will be several robotic mechanisms performing exploration tasks external to the habitat that will be controlled through the virtual environment to provide representative workloads for the crew. Finally, there will be a discussion of innovative new multidisciplinary test facilities, and how effective they are to the investigation of the wide range of human and machine problems inherent in exploration missions.

Gross, Anthony R.↗

The NASA Ames Controlled Environment Research Chamber - Present status

The Controlled Environment Research Chamber (CERC) at the NASA Ames Research Center was created for early-on investigation of promising new technologies for life support of advanced space exploration missions. The CERC facility is being used to address the advanced technology requirements necessary to implement an integrated working and living environment for a planetary habitat. The CERC, along with a human-powered centrifuge, a planetary terrain simulator, advanced displays, and a virtual reality capability, is able to develop and demonstrate applicable technologies for future planetary exploration. There will be several robotic mechanisms performing exploration taskes external to the habitat that will be controlled through the virtual environment to provide representative workloads for the crew. Finally, there will be a discussion of innovative new multidisciplinary test facilities, and how effective they are to the investigation of the wide range of human and machine problems inherent in exploration missions.

Gross, Anthony R.↗

Next Generation Flight Displays Using HTML5

The Human Integrated Vehicles and Environments (HIVE) lab at Johnson Space Center (JSC) is focused on bringing together inter-disciplinary talent to design and integrate innovative human interface technologies for next generation manned spacecraft. As part of this objective, my summer internship project centered on an ongoing investigation in to building flight displays using the HTML5 standard. Specifically, the goals of my project were to build and demo "flight-like" crew and wearable displays as well as create a webserver for live systems being developed by the Advanced Exploration Systems (AES) program. In parallel to my project, a LabVIEW application, called a display server, was created by the HIVE that uses an XTCE (XML (Extensible Markup Language) Telemetry and Command Exchange) parser and CCSDS (Consultative Committee for Space Data System) space packet decoder to translate telemetry items sent by the CFS (Core Flight Software) over User Datagram Protocol (UDP). It was the webserver's job to receive these UDP messages and send them to the displays. To accomplish this functionality, I utilized Node.js and the accompanying Express framework. On the display side, I was responsible for creating the power system (AMPS) displays. I did this by using HTML5, CSS and JavaScript to create web pages that could update and change dynamically based on the data they received from the webserver. At this point, I have not started on the commanding, being able to send back to the CFS, portion of the displays but hope to have this functionality working by the completion of my internship. I also created a way to test the webserver's functionality without the display server by making a JavaScript application that read in a comma-separate values (CSV) file and converted it to XML which was then sent over UDP. One of the major requirements of my project was to build everything using as little preexisting code as possible, which I accomplished by only using a handful of JavaScript libraries. As a side project, I created a model of the HIVE lab and Building 29 using SketchUp. I obtained the floorplans of the building from the JSC Geographic Information Systems (GIS), which were computer-aided design (CAD) files, and imported them into SketchUp. I then took those floorplans and created a 3D model of the building from them. Working in conjunction with the Hybrid Reality lab in Building 32, the SketchUp model was imported into Unreal Engine for use with the HTC Vive. Using the Vive, I was able to interact with the model I created in virtual reality (VR). The purpose of this side project was to be able to visualize potential lab layouts and mockup designs as they are in development in order to finalize design decisions. Pending approval, the model that I created will be used in the Build-As-You-Test: Can Hybrid Reality Improve the SE/HSI Design Process project in the fall. Getting the opportunity to work at NASA has been one of the most memorable experiences of my life. Over the course of my internship, I improved my programming and web development abilities substantially. I will take all the skills and experiences I have had while at NASA back to school with me in the fall and hope to pursue a career in the aerospace industry after graduating in the spring.

Greenwood, Brian↗

UnityMol-APBS

Virtual reality for biomolecular electrostatics UnityMol-APBS (NIH iEdison No. 0685901-19-0009, Grant No. GM069702) Visualization of molecular electrostatics on a two-dimensional screen greatly diminishes the associated depth component. Using a virtual world to explore molecular electrostatics allows researchers to be immersed within their data.

Baker, Nathan↗