Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Extended Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Seeing the Future of Spaceflight: Applications of Extended Reality (XR) Technologies

INTRODUCTION Advances in Earth Independent Medical Operations (EIMO) focused capabilities will be crucial for completing successful beyond low-earth-orbit (LEO) missions, where traditional Earth-based medical support and near real-time communication are limited, intermittent, or absent. In such restricted or limited communication environments, emerging extended reality (ER or XR) technologies may play a vital role in ensuring crew health and safety. Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) are common terms used to describe technologies that "generate or modify" while “extended reality” (ER or XR) is often used as an umbrella term for these technologies. This review explores how such cutting-edge “extended reality” information delivery systems are currently applied across various disciplines within NASA. The review focuses on their capabilities, limitations, and prospective future applications as they pertain to Earth-Independent Medical Operations and its components of pre-mission planning, medical decision making, resource management, and task load management. METHODS/DESIGN The review began with a literature search to identify relevant disciplines (e.g., medical education, austere environments) where XR technologies have been studied to highlight areas where evidence is lacking. Previous and current NASA XR projects and applications, as well as commercial partnerships, such as those with Small Business Innovation Research (SBIR), were identified. Discussions with technical experts involved in the design, development, and application of these technologies allowed for classification based on their respective spaceflight applications. RESULTS AND CONCLUSION This review highlights current and emerging XR technologies that have been developed, tested, and implemented both terrestrially and in spaceflight by NASA, its international partners, the U.S. Armed Forces, and various relevant commercial entities. While these novel information delivery systems vary in their respective technology readiness levels (TRL), they have the potential to be implemented on Earth, in LEO, and during deep space exploration. These systems have the potential for impacting and optimizing many aspects of EIMO.

Yevgeniy Zhivotovskiy↗
NASA NTRSDate not supplied

An Evaluation of Extended Reality Technologies for Use in Verification Testing at NASA 2024 HRP IWS Abstract

BACKGROUND At NASA, verification testing is the formal process of ensuring that a product conforms to requirements set by a project or program. Some verification methods, such as Demonstrations and Test, require either the end product or a mockup of the product with sufficient fidelity to stand-in for the product during the test. Traditionally, these mockups have been physical (e.g., foam-core and wood) but there is growing interest in exploring new methods for testing with these mockups. These methods include virtual reality (VR), mixed reality, and augmented reality which are collectively referred to as eXtended Reality (XR) technologies. VR has already been adopted and used by many in the aerospace industry as a tool for use in early design phases (e.g., developmental testing) and may have the most potential for use in verification tests. Benefits of using VR mockups offer cost effectiveness, ease of iteration, simulation of hazardous conditions (e.g., an egress through a hatch with smoke obscuring vision), and the ability to simulate microgravity conditions, which are challenging to do with physical mockups. However, the validity of test results obtained from VR mockup demonstrations or testing, compared to the current gold standard of physical mockups, remains uncertain. It is unlikely that there is one clean answer as there are many different types of verification outcomes and each XR technology must be evaluated on its own merits. This is not an issue during developmental testing as the design is still in flux and the total success of the design is not dependent upon the results of a developmental test. Verification tests, however, only happen once, assuming no change to the design, and the results are used to certify the product. Therefore, establishing the validity of XR mockup-based verification outcomes is essential before considering them for any use in verification tests. OBJECTIVE AND METHOD To address this concern, the Human Research Program has funded a project to explore and qualify how XR technologies might be used in verification demonstration and testing at NASA. Currently, we are conducting a review of the literature on the utilization of XR mockups for design activities, prototyping, and user testing. We are employing the Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis method to identify the pros, cons, and barriers to adoption of XR technologies for verification testing at NASA. Additionally, we are developing a framework to guide the deployment of XR mockups for verification tests. Building upon available evidence from the literature and subject-matter expert feedback, our goal for the framework is to provide guidelines for which forms of XR mockups are suitable for a given verification test, when only physical mockups should be employed and to highlight areas for which more evidence is needed. To further refine our framework and to contribute to the body of evidence, we are planning a lab-based experiment comparing a VR mockup to a physical twin for a set of select verification outcomes. ANTICIPATED RESULTS In this presentation, we will present the work we conducted to evaluate XR technologies for use in verification tests at NASA. We will summarize and report our findings from the SWOT analysis and our lab-based study, and we will present the current state of the XR Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project. Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project.

Extended Reality↗
NASA NTRS2020

Developing Extended Reality Projects in Support of Design, Fabrication and Procedure

The goal of this internship was to improve and create virtual reality simulations and visualizations for use in parallel with the design, fabrication, and analysis of flight ready hardware for areas like the Environmental Control and Life Support Systems (ECLSS) and also Space Systems. Specifically, my work was done in the XRSpace lab at Marshall Space Flight Center (MSFC) with assistance directly and indirectly from workers at KSC, JSC and LaRC. Led by David Reynolds, the XRSpace lab develops products for various entities at NASA. The work done in the XRSpace lab focuses on Extended Reality (XR) solutions for both simulations and visualization capabilities. The goal of the lab is to support the larger systems of NASA and to help find ways that XR technologies can streamline and optimize the design process. Extended Reality is an umbrella term that encompasses Mixed Reality, Augmented Reality, and Virtual Reality. In this capacity, I was able to complete several elements in the design, building, testing, and deployment for a variety of immersive experiences, including a VR procedure simulation, visualization aids, and a 360-image capture tool.

Joseph Chambers↗
NASA NTRSDate not supplied

An Analysis of Extended Reality Mockups for Use in Verification: Phase 2

NASA commercial providers are increasing their use of Virtual Reality (VR) and Hybrid Reality (HR) technologies in their system development process. The use of these technologies, collectively referred to as Extended Reality (XR) technologies, has been limited to the development phase, but there have been requests to integrate VR and HR mockups into verifications. Verifications require, at minimum, a high-fidelity mockup for activities involving human participation (tests, demonstrations, inspections). HR technology shares many of the strengths but may not share some of the critical shortcomings of VR. Specifically, HR allows for integrating physical objects, such as a suit, which may be critical to evaluating a system. Adopting HR technology still has many of the same challenges as VR. Namely, there is little to no data about the validity of evaluations conducted with HR mockups, an established process, or criteria for evaluating the appropriateness of HR mockups. Because verifications are final and only need to happen once, HR mockups must be adequately vetted before being approved for use in verifications. Further hindering the adoption of these technologies is the lack of consensus on what constitutes a high-fidelity XR mockup. Even for physical mockups, there are guidelines and common criteria, but nothing has been formalized. Discussion about when an XR mockup can be used would be greatly helped by clearly defining what a high-fidelity XR mockup is and how it might be measured. The team will engage with relevant stakeholders to learn more about the benefits and challenges of adopting hybrid reality mockups for verification. The team will build upon work from Phase 1 by maturing a framework to guide decisions for evaluating XR mockups for use in verifications. The team will also conduct experimental studies to evaluate advantages and tradeoffs of hybrid/mixed reality relative to physical and virtual reality mockups. Finally, data from Phase 1 and Phase 2 will be synthesized into a set of best practices for developing and validating XR mockups for verification. We will highlight the work conducted to date in Phase 2. We will present the status of the XR for Verification Framework, a summary of best practices identified thus far, and give a synopsis of future work.

verification testing↗
NASA NTRSDate not supplied

Development of an Extended Reality (XR) Tool for Earth Science Visualization

In this presentation, we will discuss our work in adapting the NASA open source XR software, the Mixed Reality Exploration Toolkit (MRET), to an earth science domain. MRET is a NASA open source XR software for rapidly building extended reality (XR) environments for NASA domain problems, e.g., pulling in CAD models of thermal vac chamber and Roman Space Telescope to do fit checks. Primarily used for hardware integration & test, we have been adapting and extending MRET for science problems. Traditionally, scientists view and analyze the result of calculated or measured observables with static 1-D, 2-D or 3-D plots. It can be difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. Additionally, numerical models, such as the NASA GEOS climate model, are almost exclusively formulated and analyzed on Eulerian grids with points fixed in space and time. However, atmospheric phenomena such as convective clouds, hurricanes and wildfire smoke plumes move with the 3-D flow field, and it is often difficult and unnatural to understand these phenomena in an Eulerian reference frame as opposed to the Lagrangian reference frame in which nature operates. As part of an Earth Science Technology Office (ESTO) proposal, we have been adapting MRET to be a scientific exploration and analysis XR tool with integrated Lagrangian Dynamics (LD) for the Goddard Earth Observing System (GEOS) numerical weather prediction model. We believe this will help scientists identify, track, and understand the evolution of Earth Science phenomena. This presentation will discuss current results in our work in developing this XR tool for Earth Science.

Thomas G Grubb↗
NASA NTRSDate not supplied

Development of an Extended Reality (XR) Tool for Earth Science Visualization

In this presentation, we will discuss our work in adapting the NASA open source XR software, the Mixed Reality Exploration Toolkit (MRET), to an earth science domain. MRET is a NASA open source XR software for rapidly building extended reality (XR) environments for NASA domain problems, e.g., pulling in CAD models of thermal vac chamber and Roman Space Telescope to do fit checks. Primarily used for hardware integration & test, we have been adapting and extending MRET for science problems. Traditionally, scientists view and analyze the result of calculated or measured observables with static 1-D, 2-D or 3-D plots. It can be difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. Additionally, numerical models, such as the NASA GEOS climate model, are almost exclusively formulated and analyzed on Eulerian grids with points fixed in space and time. However, atmospheric phenomena such as convective clouds, hurricanes and wildfire smoke plumes move with the 3-D flow field, and it is often difficult and unnatural to understand these phenomena in an Eulerian reference frame as opposed to the Lagrangian reference frame in which nature operates. As part of an Earth Science Technology Office (ESTO) proposal, we have been adapting MRET to be a scientific exploration and analysis XR tool with integrated Lagrangian Dynamics (LD) for the Goddard Earth Observing System (GEOS) numerical weather prediction model. We believe this will help scientists identify, track, and understand the evolution of Earth Science phenomena. This presentation will discuss current results in our work in developing this XR tool for Earth Science.

Thomas Grubb↗
NASA NTRSDate not supplied

Using XR for Improving Scientific Discovery With Numerical Weather Models

Our work explores the use of extended reality (XR) to im- prove scientific discovery with numerical weather/climate models that inform Earth science digital twins, specifically the NASA Goddard Earth Observing System (GEOS) global atmospheric model. The overall project is named the Vi- sualization And Lagrangian dynamics Immersive eXtended Reality Toolkit (VALIXR), which has two main areas of focus: (1) enhancing the understanding of and interaction with model output data through advanced visualizations in the XR environment, and (2) the integration of Lagrangian dynamics into the GEOS model, which allows a natural, feature-specific analysis of Earth science phenomena as op- posed to traditional, fixed-point Eulerian dynamics. Here, we report initial work on these focus areas.

Thomas Grubb↗
NASA NTRS2018

The Next Wave: Humans, Computers, and Redefining Reality

The Augmented/Virtual Reality (AVR) Lab at KSC is dedicated to " exploration into the growing computer fields of Extended Reality and the Natural User Interface (it is) a proving ground for new technologies that can be integrated into future NASA projects and programs." The topics of Human Computer Interface, Human Computer Interaction, Augmented Reality, Virtual Reality, and Mixed Reality are defined; examples of work being done in these fields in the AVR Lab are given. Current new and future work in Computer Vision, Speech Recognition, and Artificial Intelligence are also outlined.

Extended Reality↗
DOE OSTI2025

Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)

This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Early Fault Detection in Nuclear Systems: A Digital Engineering Approach

Nuclear energy systems present unique challenges in terms of ensuring safety, reliability, and efficiency during their design and operation. Early fault detection is critical for mitigating risks and fostering system resilience. However, current methods often fall short at identifying faults during early stages, potentially leading to costly delays and safety risks. The present work proposes a comprehensive digital engineering approach that leverages digital twins, digital threads, model-based systems engineering, artificial intelligence, and immersive extended reality to support early fault detection in nuclear systems. Through a series of case studies, we highlight specific gaps in the fault detection mechanisms of traditional nuclear design and operation processes, then demonstrate a suite of solutions we are working to implement to address these shortcomings in similar projects. Our findings suggest that a digital engineering approach to design and operation can significantly improve fault detection, ultimately leading to reductions in risk.

42 - ENGINEERING↗
NASA NTRSDate not supplied

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

Simulation Modeling Virtual Reality Immersive Tech↗