SEARCH · Engineering Papers

Results for “Virtual Reality, Augmented Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

83 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2021

HydrogenAR: Interactive Data-Driven Presentation of Dispenser Reliability: Preprint

When delivering presentations to a co-located audience, we typically use slides with text and 2D graphics to complement the spoken narrative. Though presentations have largely been explored on 2D media, augmented reality (AR) allows presentation designers to add data and augmentations to existing physical infrastructure on display. This could provide a more engaging experience to the audience and support comprehension. With HydrogenAR, we present a novel application that leverages the benefits of data-driven storytelling with those of AR to explain the unique challenges of hydrogen dis- penser reliability. Utilizing physical props, situated data, and virtual augmentations and animations, HydrogenAR serves as a unique presentation tool, particularly critical for stakeholders, tour groups, and VIPs. HydrogenAR is a product of multiple collaborative de- sign iterations with a local Hydrogen Fuel research team and is evaluated through interviews with team members and a user study with end-users to evaluate the usability and quality of the interactive AR experience. Through this work, we provide design considera- tions for AR data-driven presentations and discuss how AR could be used for innovative content delivery beyond traditional slide-based presentations.

augmented reality↗

NASA NTRS2023

Joint Augmented Reality Visual Informatics System: Concept of Operations

NASA proposed requirements for a digital display for an EVA spacesuit to provide relevant information to the crew member. The Joint Augmented Reality Visual Informatics System (Joint AR) project pursued four years of research and development towards a suit-display system in a near-eye, AR form factor. The project was responsible for developing software (custom graphics engine and core flight software), physical hardware prototyping (controls, projection display optics, suited display platform), virtual prototyping platform (a virtual reality testbed), and human-in-the-loop (HITL) operational testing informed by EVA flight controllers, crew members, and human factors engineers for con-ops definition. This document contains substantial updates to CTSD-ADV-1788 Rev. Basic. This revision was produced by the project to summarize the use-cases and and user experiences developed throughout the project, and refine the Basic revision originally drafted at the beginning of the project life cycle. The primary purpose of this document is to summarize and make available the scenario development efforts that have been pursued and explored within the Joint AR project. This includes descriptions of the scenarios themselves as well as corresponding potential of advanced informatics displays to support those specified scenarios. In doing so, this document provides a variety of approaches to deconstruct and hypothesize how future technological capabilities so that with future EVA work demands can be satisfied within future human planetary spaceflight missions.

Matthew Miller↗

NASA NTRS2022

Cockpit Interface for Locomotion and Manipulation Control of the NASA Valkyrie Humanoid in Virtual Reality (VR)

A virtual reality (VR) interface is presented for controlling NASA’s Valkyrie humanoid robot with flexible locomotion control options and intuitive teleoperation. Locomotion modes include navigating to a specified waypoint, sending desired velocities with a joystick, or manually placing a sequence of footsteps. On the other hand, teleoperation modes include voice commands to toggle relative whole-body tracking or high-level commandeering, and key bindings for common stored poses such as power grasps. The primary novelties of the interface are in the implementation of the cockpit mode and a floating augmented reality (AR) screen fixed with respect to the robot. The former enables embodied teleoperation and increased awareness during navigation in a mixed-reality setting. The latter preserves depth perception without the disparity clutter from a stereo point cloud. The interface is demonstrated on two real humanoids performing common explosive ordnance disposal (EOD) tasks such as door opening, vehicle inspection, and disruptor placement. Notably, the interface enables a single operator to control multiple humanoids. While the interface is motivated by EOD missions, the presented ideas are usable for other robots employing VR-based control.

Virtual-reality↗

NASA NTRS2000

A Flight Training Simulator for Instructing the Helicopter Autorotation Maneuver (Enhanced Version)

Autorotation is a maneuver that permits a safe helicopter landing when the engine loses power. A catastrophe may occur if the pilot's control inputs are incorrect, insufficient, excessive, or poorly timed. Due to the danger involved, full-touchdown autorotations are very rarely practiced. Because in-flight autorotation training is risky, time-consuming, and expensive, the objective of the project was to develop the first helicopter flight simulator expressly designed to train students in this critical maneuver. A central feature of the project was the inclusion of an enhanced version of the Pilot-Rotorcraft Intelligent Symbology Management Simulator (PRISMS), a virtual-reality system developed by Anacapa Sciences and Thought Wave. A task analysis was performed to identify the procedural steps in the autorotation, to inventory the information needed to support student task performance, to identify typical errors, and to structure the simulator's practice environment. The system provides immediate knowledge of results, extensive practice of perceptual-motor skills, part-task training, and augmented cueing in a realistic cockpit environment. Additional work, described in this report, extended the capabilities of the simulator in three areas: 1. Incorporation of visual training aids to assist the student in learning the proper appearance of the visual scene when the maneuver is being properly performed; 2. Introduction of the requirement to land at a particular spot, as opposed to the wide, flat open field initially used, and development of appropriate metrics of success; and 3. Inclusion of wind speed and wind direction settings (and random variability settings) to add a more realistic challenge in "hitting the spot."

Rogers, Steven P.↗

DOE OSTI2025

Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)

This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1999

Wireless Augmented Reality Prototype (WARP)

Initiated in January, 1997, under NASA's Office of Life and Microgravity Sciences and Applications, the Wireless Augmented Reality Prototype (WARP) is a means to leverage recent advances in communications, displays, imaging sensors, biosensors, voice recognition and microelectronics to develop a hands-free, tetherless system capable of real-time personal display and control of computer system resources. Using WARP, an astronaut may efficiently operate and monitor any computer-controllable activity inside or outside the vehicle or station. The WARP concept is a lightweight, unobtrusive heads-up display with a wireless wearable control unit. Connectivity to the external system is achieved through a high-rate radio link from the WARP personal unit to a base station unit installed into any system PC. The radio link has been specially engineered to operate within the high- interference, high-multipath environment of a space shuttle or space station module. Through this virtual terminal, the astronaut will be able to view and manipulate imagery, text or video, using voice commands to control the terminal operations. WARP's hands-free access to computer-based instruction texts, diagrams and checklists replaces juggling manuals and clipboards, and tetherless computer system access allows free motion throughout a cabin while monitoring and operating equipment.

Devereaux, A. S.↗

NASA NTRS2022

Bringing Planetary Science Mission Outreach to the Deaf and Blind Communities

Introduction: Technology for enhancing outreach, like 3D printing, and science communication products, such as videos and podcasts, can be utilized within the planetary science community, especially for the engagement and excitement of current or upcoming planetary exploration missions. However, these communication products can also be further enhanced for the benefit of the blind and deaf communities. While such products may already be readily available, such projects are not easily accessible to blind and/or deaf certified educators, which often rely on making their own resources or do not have the funds to provide such resources (e.g., cost of 3D printers or cost of braille books). The planetary science community can have better practices to reach these broader audiences. Best practices can include transcripts from podcasts, transcripts in videos, and large-font captions. Images on websites and social media accounts should also include alt-text descriptive captions. 3D printing can also enhance planetary science for the blind community, through tactile posters, maps, and pamphlets. Planetary data can also be augmented by providing different tactile geological maps (e.g., topography or various datasets), and audio-visual videos freely available for educators. Visual Engagement: Visual engagement consists of several avenues to consider, the three main themes includes: 1) swag; 2) videos; 3) interactive exploration. Swag can include the fun visual take-home materials, such as stickers, posters, bookmarks, etc. Videos can include educational-specific videos (available freely via YouTube or by other educational-specific streaming avenues, such as Nebula or Curiosity Stream), provided they have Closed Captioning (CC). The use of QR codes to such videos or websites can also benefit to being added on swag. Interactive exploration can also be sub-divided by different types of engagement. A popular and still fairly new technology for public engagement is the use of virtual reality (VR). While this has been mainly for martian and lunar surface exploration [1], the deaf communities can benefit from VR through a more extensive look at our solar system and beyond (for example, a VR experience of the flight path, or visual map of the heliosphere/dynamics of our Sun). Audio Engagement: Audio tools can also be a useful avenue of communication, especially for the blind communities. Audio archiving can certainly be transcripts from the video engagements, but also the use of podcasts can also be a benefit. Podcasting can take on two forms: 1) interview engagement; and 2) update engagement. For interviews, scientists can communicate with STEM-specific podcast platforms to make other listener-bases aware of what is going on with a specific mission. For update-type communication, missions may opt to have an archived podcast of news, updates, and the teams involved. The most important aspect of such podcasts would be for the need of complimentary transcripts (including descriptive transcripts if sounds are included), and the limited use of jargon. Research Engagement: There have been several examples of involving the blind and low-vision communities in citizen science, such as through the NASA Heliophysics division. Examples include the NASA PUNCH (Polarimeter to Unify the Corona and Heliosphere) mission led by the Southwest Research Institute [2], which include blind and visually-impaired citizens to assist in the Sun’s coronal rhythms.” Another example is the Eclipse Soundscapes: Citizen Science Project (ES:CSP), which documents observations of acoustical changes of nature and ecosystems during solar eclipse events [3]. Inclusivity: A major theme that is necessary for public engagement is inclusivity and the awareness of reaching broader audiences. Outreach to include hearing/seeing impaired communities are still lacking in the sciences. There are several opportunities that the planetary sciences could take. Other projects that have emerged from the space sciences include adding transcripts to visual engagement [4], and the use of 3D printing for the visually-impaired [5]. References: [1] Olgin, J. (2020) 51st LPSC, Abstract 2137. [2] https://scitechdaily.com/outreach-for-nasa-punch-mission-embraces-ancient-and-modern-sun-watching-theme/ [3] https://science.nasa.gov/science-activation-team/eclipse-soundscapes [4] NASA International Observe the Moon Night (Blind and Deaf Accessible), Youtube Video ( https://www.youtube.com/watch?v=neHCfg0S3-Q) [5] Richardson, J., et al. (2018) AGU Fall Meeting, Abstract ED23F-0963.

C J Ahrens↗

NASA NTRS2017

Fireballs in the Sky: An Augmented Reality Citizen Science Program

Fireballs in the Sky is an innovative Australian citizen science program that connects the public with the research of the Desert Fireball Network (DFN). This research aims to understand the early workings of the solar system, and Fireballs in the Sky invites people around the world to learn about this science, contributing fireball sightings via a user-friendly augmented reality mobile app. Tens of thousands of people have downloaded the app world-wide and participated in the science of meteoritics. The Fireballs in the Sky app allows users to get involved with the Desert Fireball Network research, supplementing DFN observations and providing enhanced coverage by reporting their own meteor sightings to DFN scientists. Fireballs in the Sky reports are used to track the trajectories of meteors - from their orbit in space to where they might have landed on Earth. Led by Phil Bland at Curtin University in Australia, the Desert Fireball Network (DFN) uses automated observatories across Australia to triangulate trajectories of meteorites entering the atmosphere, determine pre-entry orbits, and pinpoint their fall positions. Each observatory is an autonomous intelligent imaging system, taking 1000 by 36 megapixel all-sky images throughout the night, using neural network algorithms to recognize events. They are capable of operating for 12 months in a harsh environment, and store all imagery collected. We developed a completely automated software pipeline for data reduction, and built a supercomputer database for storage, allowing us to process our entire archive. The DFN currently stands at 50 stations distributed across the Australian continent, covering an area of 2.5 million square kilometers. Working with DFN's partners at NASA's Solar System Exploration Research Virtual Institute, the team is expanding the network beyond Australia to locations around the world. Fireballs in the Sky allows a growing public base to learn about and participate in this exciting research.

Day, Brian↗

NASA NTRSDate not supplied

Validation of Multisystem Countermeasures Protocol for Spaceflight during Antarctica Winter-over at Palmer Station (Palmer Countermeasures)

Stressors associated with spaceflight induce persistent immune compromise in astronauts which increase subclinical latent virus reactivation. In select crews, adverse clinical events have been documented. Antarctica winter-over (AWO) mission most closely reproduces these mission stressors: prolonged deployment, extreme environment, circadian misalignment, isolation, station lifestyle, and personal risk. The US maintains three primary stations in Antarctica: South Pole Station, McMurdo, and Palmer. Previous studies suggest that stations located near the interior of Antarctica (South Pole, McMurdo) have confounding effects on the immune system due to persistent hypobaric hypoxia. We hypothesized that winter-over at a coastal station (Palmer) would be more akin to spaceflight due to its normoxic but still extreme environment. Therefore, AWO at Palmer Station was selected, and validated in a pilot study [2], as the platform for testing and validating the effectiveness of an immune-restorative countermeasure protocol designed for deep space missions. Specifics include diet modifications, nutritional supplementation (vitamin D, probiotic, etc.), prescribed aerobic and resistive exercise, and a protocol of stress relieving virtual reality exercises. A multitude of biological sample types, including blood, saliva, and hair will be collected in tandem with the countermeasures in order to examine the combined effectiveness of the countermeasures. Samples and logs from subjects will be transported from Palmer Station to Johnson Space Center for further processing and distribution to co-investigators at the end of each winter-over. Extracted samples will be analyzed by appropriate testing platforms (Multiplex, qPCR, ELISA, etc.) to monitor alterations in leukocyte distribution, T cell and NK function, cytokine profiles, reactivation of latent herpesviruses, and nutritional factors. The data collected will be compared to a control year in which no countermeasures were deployed to evaluate the overall effectiveness of the analog and to validate the candidate immune countermeasure strategy. AWO 2023 concluded with the 4th in-mission timepoint conducted in September 2023. Samples for 16 subjects, including blood, saliva, hair, surveys, and PCR data, were all successfully returned from Antarctica to NASA/JSC mid-November 2023. Samples have since been distributed to co-investigators for further processing and analysis. With the completion of the first countermeasure year, preliminary data on the effectiveness of the deep-space protocol is being evaluated, however, no conclusions can be drawn yet until the completion of the second AWO countermeasure year, AWO 2024. AWO 2024 commenced in late-March 2024, with 13 subjects consenting and performing their baseline data collections (BDCs). Unique to the 2024 deployment, NSF lifted certain COVID restrictions and rallied the crewmembers in Punta Arenas, Chile. All NSF activities were transferred to this location and NASA was allowed, for the first time, to perform consent briefings, baseline samplings and training in person. This augment greatly increased the likelihood of success for the overwinter activities.

Cody L Gutierrez↗

NASA NTRSDate not supplied

Validation of Multisystem Countermeasures Protocol for Spaceflight during Antarctica Winter-over at Palmer Station (Palmer Countermeasures)

Stressors associated with spaceflight induce persistent immune compromise in astronauts which increase subclinical latent virus reactivation. In select crews, adverse clinical events have been documented. Antarctica winter-over (AWO) mission most closely reproduces these mission stressors: prolonged deployment, extreme environment, circadian misalignment, isolation, station lifestyle, and personal risk. The US maintains three primary stations in Antarctica: South Pole Station, McMurdo, and Palmer. Previous studies suggest that stations located near the interior of Antarctica (South Pole, McMurdo) have confounding effects on the immune system due to persistent hypobaric hypoxia. We hypothesized that winter-over at a coastal station (Palmer) would be more akin to spaceflight due to its normoxic but still extreme environment. Therefore, AWO at Palmer Station was selected, and validated in a pilot study, as the platform for testing and validating the effectiveness of an immune-restorative countermeasure protocol designed for deep space missions. Specifics include diet modifications, nutritional supplementation (vitamin D, probiotic, etc.), prescribed aerobic and resistive exercise, and a protocol of stress relieving virtual reality exercises. A multitude of biological sample types, including blood, saliva, and hair will be collected in tandem with the countermeasures in order to examine the combined effectiveness of the countermeasures. Samples and logs from subjects will be transported from Palmer Station to Johnson Space Center for further processing and distribution to co-investigators at the end of each winter-over. Extracted samples will be analyzed by appropriate testing platforms (Multiplex, qPCR, ELISA, etc.) to monitor alterations in leukocyte distribution, T cell and NK function, cytokine profiles, reactivation of latent herpesviruses, and nutritional factors. The data collected will be compared to a control year in which no countermeasures were deployed to evaluate the overall effectiveness of the analog and to validate the candidate immune countermeasure strategy. AWO 2023 concluded with the 4th in-mission timepoint conducted in September 2023. Samples for 16 subjects, including blood, saliva, hair, surveys, and PCR data, were all successfully returned from Antarctica to NASA/JSC mid-November 2023. Samples have since been distributed to co-investigators for further processing and analysis. With the completion of the first countermeasure year, preliminary data on the effectiveness of the deep-space protocol is being evaluated, however, no conclusions can be drawn yet until the completion of the second AWO countermeasure year, AWO 2024. AWO 2024 commenced in late-March 2024, with 13 subjects consenting and performing their baseline data collections (BDCs). Unique to the 2024 deployment, NSF lifted certain COVID restrictions and rallied the crewmembers in Punta Arenas, Chile. All NSF activities were transferred to this location and NASA was allowed, for the first time, to perform consent briefings, baseline samplings and training in person. This augment greatly increased the likelihood of success for the overwinter activities.

Cody L Gutierrez↗

NASA NTRSDate not supplied

The Gandalf Staff: A Mobile Tool for Lunar Exploration (2nd year of development)

The Gandalf Staff is a mobile tool designed to be a flexible device supporting crewed and uncrewed operations on the lunar surface. The core of the device is a 24v battery with communications and data storage systems. Initial optional components supporting crewed Extra-Vehicular Activity (EVA) include a LiDAR and 360˚ camera. These provide 3D mapping of the traverse for documentation, and to aid future planning. The mapping also creates outreach opportunities for the public to “stand beside” the astronaut in Virtual Reality (VR). The staff provides external lighting for field site illumination in the south polar region low sun angle environment. Navigation instruments for crew position determination with Lunar Search and Rescue (LunaSAR) are also included. The staff itself can be used as a walking aid or as a splint for Incapacitated Crew Rescue (ICR). As a stand-alone device, the staff operates as a long duration untended science platform collecting environmental data and sending it to a lunar base station. The stand-alone mode requires connection to an auxiliary power source (e.g. solar array) and energy storage system (e.g. battery), so it could become an electrical recharging station. To make rapid progress in the 1st year, and also to demonstrate innovative project management techniques, NASA guided a private industry partner, T STAR, in leading Capstone Engineering student teams at Texas A&M University (TAMU) for proof-of-concept development and testing. These teams developed the power system and demonstrated successful integration of LiDAR, WiFi communications, and external lighting subsystems. Another industry team at Jacobs Technology prototyped a tripod to hold the staff upright. For the 2nd year (FY’22), NASA will again collaborate with partners to prototype enhanced power and lighting concepts. Year 2 will also add new capability for LunaSAR and geophysical science instrumentation using a heat probe. The heat probe is based upon Apollo heritage but modified to measure subsurface volatile ice regimes at the Artemis landing site. Components of the Gandalf Staff can be developed, tested, and deployed independently, or on the integrated staff, rovers, or utility trailers. The project supports crew safety, lunar sample curation, mission science, and public outreach goals of NASA. PLAIN TEST SUMMARY: Gandalf Staff is a 24v battery powered mobile tool for the lunar surface supporting crewed geologic field site exploration, or as a stand-alone science platform. As a tool assisting astronauts conducting field geology, the Gandalf Staff provides external lighting to illuminate shadowed regions on the surface. It also documents the process of collecting rocks and dust samples using a LiDAR (laser range instrument) and cameras. The staff provides a beacon for emergency location of astronauts and augments communications when the astronauts are blocked by large boulders. As a standalone science platform, the Gandalf Staff provides a power system for instruments and sensors to measure the lunar environment over long periods of time. The staff gathers data and sends the results to a lunar base station for analysis.

External Lighting↗