Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “extended reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Integrating extended reality with inspection systems

An extended reality (“XR”) inspection system for inspecting a target is provided. The XR inspection system includes an inspection system and an XR device. The inspection system includes an inspection main unit and an inspection probe. The inspection main unit collects inspection data from the inspection probe, receives commands input by an inspector using the XR device, performs functions associated with the commands, and sends display data to the XR device. The XR device provides an augmented reality display and sensors. The XR device displays display data received from the inspection main unit, receives commands via the sensors from the inspector, and sends the commands to the inspection main unit.

Keene, Lionel↗

Seeing the Future of Spaceflight: Applications of Extended Reality (XR) Technologies

INTRODUCTION Advances in Earth Independent Medical Operations (EIMO) focused capabilities will be crucial for completing successful beyond low-earth-orbit (LEO) missions, where traditional Earth-based medical support and near real-time communication are limited, intermittent, or absent. In such restricted or limited communication environments, emerging extended reality (ER or XR) technologies may play a vital role in ensuring crew health and safety. Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) are common terms used to describe technologies that "generate or modify" while “extended reality” (ER or XR) is often used as an umbrella term for these technologies. This review explores how such cutting-edge “extended reality” information delivery systems are currently applied across various disciplines within NASA. The review focuses on their capabilities, limitations, and prospective future applications as they pertain to Earth-Independent Medical Operations and its components of pre-mission planning, medical decision making, resource management, and task load management. METHODS/DESIGN The review began with a literature search to identify relevant disciplines (e.g., medical education, austere environments) where XR technologies have been studied to highlight areas where evidence is lacking. Previous and current NASA XR projects and applications, as well as commercial partnerships, such as those with Small Business Innovation Research (SBIR), were identified. Discussions with technical experts involved in the design, development, and application of these technologies allowed for classification based on their respective spaceflight applications. RESULTS AND CONCLUSION This review highlights current and emerging XR technologies that have been developed, tested, and implemented both terrestrially and in spaceflight by NASA, its international partners, the U.S. Armed Forces, and various relevant commercial entities. While these novel information delivery systems vary in their respective technology readiness levels (TRL), they have the potential to be implemented on Earth, in LEO, and during deep space exploration. These systems have the potential for impacting and optimizing many aspects of EIMO.

Yevgeniy Zhivotovskiy↗

An Evaluation of Extended Reality Technologies for Use in Verification Testing at NASA 2024 HRP IWS Abstract

BACKGROUND At NASA, verification testing is the formal process of ensuring that a product conforms to requirements set by a project or program. Some verification methods, such as Demonstrations and Test, require either the end product or a mockup of the product with sufficient fidelity to stand-in for the product during the test. Traditionally, these mockups have been physical (e.g., foam-core and wood) but there is growing interest in exploring new methods for testing with these mockups. These methods include virtual reality (VR), mixed reality, and augmented reality which are collectively referred to as eXtended Reality (XR) technologies. VR has already been adopted and used by many in the aerospace industry as a tool for use in early design phases (e.g., developmental testing) and may have the most potential for use in verification tests. Benefits of using VR mockups offer cost effectiveness, ease of iteration, simulation of hazardous conditions (e.g., an egress through a hatch with smoke obscuring vision), and the ability to simulate microgravity conditions, which are challenging to do with physical mockups. However, the validity of test results obtained from VR mockup demonstrations or testing, compared to the current gold standard of physical mockups, remains uncertain. It is unlikely that there is one clean answer as there are many different types of verification outcomes and each XR technology must be evaluated on its own merits. This is not an issue during developmental testing as the design is still in flux and the total success of the design is not dependent upon the results of a developmental test. Verification tests, however, only happen once, assuming no change to the design, and the results are used to certify the product. Therefore, establishing the validity of XR mockup-based verification outcomes is essential before considering them for any use in verification tests. OBJECTIVE AND METHOD To address this concern, the Human Research Program has funded a project to explore and qualify how XR technologies might be used in verification demonstration and testing at NASA. Currently, we are conducting a review of the literature on the utilization of XR mockups for design activities, prototyping, and user testing. We are employing the Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis method to identify the pros, cons, and barriers to adoption of XR technologies for verification testing at NASA. Additionally, we are developing a framework to guide the deployment of XR mockups for verification tests. Building upon available evidence from the literature and subject-matter expert feedback, our goal for the framework is to provide guidelines for which forms of XR mockups are suitable for a given verification test, when only physical mockups should be employed and to highlight areas for which more evidence is needed. To further refine our framework and to contribute to the body of evidence, we are planning a lab-based experiment comparing a VR mockup to a physical twin for a set of select verification outcomes. ANTICIPATED RESULTS In this presentation, we will present the work we conducted to evaluate XR technologies for use in verification tests at NASA. We will summarize and report our findings from the SWOT analysis and our lab-based study, and we will present the current state of the XR Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project. Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project.

Extended Reality↗

Developing Extended Reality Projects in Support of Design, Fabrication and Procedure

The goal of this internship was to improve and create virtual reality simulations and visualizations for use in parallel with the design, fabrication, and analysis of flight ready hardware for areas like the Environmental Control and Life Support Systems (ECLSS) and also Space Systems. Specifically, my work was done in the XRSpace lab at Marshall Space Flight Center (MSFC) with assistance directly and indirectly from workers at KSC, JSC and LaRC. Led by David Reynolds, the XRSpace lab develops products for various entities at NASA. The work done in the XRSpace lab focuses on Extended Reality (XR) solutions for both simulations and visualization capabilities. The goal of the lab is to support the larger systems of NASA and to help find ways that XR technologies can streamline and optimize the design process. Extended Reality is an umbrella term that encompasses Mixed Reality, Augmented Reality, and Virtual Reality. In this capacity, I was able to complete several elements in the design, building, testing, and deployment for a variety of immersive experiences, including a VR procedure simulation, visualization aids, and a 360-image capture tool.

Joseph Chambers↗

An Analysis of Extended Reality Mockups for Use in Verification: Phase 2

NASA commercial providers are increasing their use of Virtual Reality (VR) and Hybrid Reality (HR) technologies in their system development process. The use of these technologies, collectively referred to as Extended Reality (XR) technologies, has been limited to the development phase, but there have been requests to integrate VR and HR mockups into verifications. Verifications require, at minimum, a high-fidelity mockup for activities involving human participation (tests, demonstrations, inspections). HR technology shares many of the strengths but may not share some of the critical shortcomings of VR. Specifically, HR allows for integrating physical objects, such as a suit, which may be critical to evaluating a system. Adopting HR technology still has many of the same challenges as VR. Namely, there is little to no data about the validity of evaluations conducted with HR mockups, an established process, or criteria for evaluating the appropriateness of HR mockups. Because verifications are final and only need to happen once, HR mockups must be adequately vetted before being approved for use in verifications. Further hindering the adoption of these technologies is the lack of consensus on what constitutes a high-fidelity XR mockup. Even for physical mockups, there are guidelines and common criteria, but nothing has been formalized. Discussion about when an XR mockup can be used would be greatly helped by clearly defining what a high-fidelity XR mockup is and how it might be measured. The team will engage with relevant stakeholders to learn more about the benefits and challenges of adopting hybrid reality mockups for verification. The team will build upon work from Phase 1 by maturing a framework to guide decisions for evaluating XR mockups for use in verifications. The team will also conduct experimental studies to evaluate advantages and tradeoffs of hybrid/mixed reality relative to physical and virtual reality mockups. Finally, data from Phase 1 and Phase 2 will be synthesized into a set of best practices for developing and validating XR mockups for verification. We will highlight the work conducted to date in Phase 2. We will present the status of the XR for Verification Framework, a summary of best practices identified thus far, and give a synopsis of future work.

verification testing↗

INL Digital Engineering: Model-Based Design, Digital Threads, Digital Twins, Artificial Intelligence, and Extended Reality for Complex Energy Systems

This presentation showcases digital transformation efforts carried by the Idaho National Laboratory (INL) Digital Innovation Center of Excellence (DICE). Digital Engineering technologies are described, including Model-Based Systems Engineering, Digital Thread, Digital Twins, Artificial Intelligence, and Extended Reality. Selected projects across the laboratory that have used or are currently using a digital engineering design approach are presented.

08 HYDROGEN↗

Development of an Extended Reality (XR) Tool for Earth Science Visualization

In this presentation, we will discuss our work in adapting the NASA open source XR software, the Mixed Reality Exploration Toolkit (MRET), to an earth science domain. MRET is a NASA open source XR software for rapidly building extended reality (XR) environments for NASA domain problems, e.g., pulling in CAD models of thermal vac chamber and Roman Space Telescope to do fit checks. Primarily used for hardware integration & test, we have been adapting and extending MRET for science problems. Traditionally, scientists view and analyze the result of calculated or measured observables with static 1-D, 2-D or 3-D plots. It can be difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. Additionally, numerical models, such as the NASA GEOS climate model, are almost exclusively formulated and analyzed on Eulerian grids with points fixed in space and time. However, atmospheric phenomena such as convective clouds, hurricanes and wildfire smoke plumes move with the 3-D flow field, and it is often difficult and unnatural to understand these phenomena in an Eulerian reference frame as opposed to the Lagrangian reference frame in which nature operates. As part of an Earth Science Technology Office (ESTO) proposal, we have been adapting MRET to be a scientific exploration and analysis XR tool with integrated Lagrangian Dynamics (LD) for the Goddard Earth Observing System (GEOS) numerical weather prediction model. We believe this will help scientists identify, track, and understand the evolution of Earth Science phenomena. This presentation will discuss current results in our work in developing this XR tool for Earth Science.

Thomas G Grubb↗

Development of an Extended Reality (XR) Tool for Earth Science Visualization

In this presentation, we will discuss our work in adapting the NASA open source XR software, the Mixed Reality Exploration Toolkit (MRET), to an earth science domain. MRET is a NASA open source XR software for rapidly building extended reality (XR) environments for NASA domain problems, e.g., pulling in CAD models of thermal vac chamber and Roman Space Telescope to do fit checks. Primarily used for hardware integration & test, we have been adapting and extending MRET for science problems. Traditionally, scientists view and analyze the result of calculated or measured observables with static 1-D, 2-D or 3-D plots. It can be difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. Additionally, numerical models, such as the NASA GEOS climate model, are almost exclusively formulated and analyzed on Eulerian grids with points fixed in space and time. However, atmospheric phenomena such as convective clouds, hurricanes and wildfire smoke plumes move with the 3-D flow field, and it is often difficult and unnatural to understand these phenomena in an Eulerian reference frame as opposed to the Lagrangian reference frame in which nature operates. As part of an Earth Science Technology Office (ESTO) proposal, we have been adapting MRET to be a scientific exploration and analysis XR tool with integrated Lagrangian Dynamics (LD) for the Goddard Earth Observing System (GEOS) numerical weather prediction model. We believe this will help scientists identify, track, and understand the evolution of Earth Science phenomena. This presentation will discuss current results in our work in developing this XR tool for Earth Science.

Thomas Grubb↗

Deploying Extended Reality (XR) for Digital Operations and Maintenance (O&M) at the Mechanisms Engineering Test Loop (METL)

This report documents the preliminary efforts to digitize operation and maintenance (O&M) activities for the Mechanisms Engineering Test Loop (METL). METL became operational in September 2018 with the mission to provide an ecosystem for Advanced Reactor Development (ARD). METLs flagship facility’s primary purpose is conducting small to intermediate scale tests for Sodium Fast Reactors (SFR). Its resemblance to commercial SFR’s intermediate heat transport system, prototypic operating conditions, and industrial construction practices/materials provides the overarching benefit of establishing a proving ground for emerging operations and maintenance (O&M) activities such as incorporating Extended Reality (XR) applications throughout the program lifecycle.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗