JSC Engineering XR Simulation and Training Support for ISS, Gateway and Artemis Programs
Explore the source record for details and available documents.
XR↗
SEARCH · Engineering Papers
Results for “XR Training”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Dying Pulse Trains in Cygnus XR-1: Initial Results of X-Ray Searches
Dying pulse trains (DPT's) are a signature of a black hole as described by general relativity. Detecting DPT's would establish the existence of black holes by ruling out more exotic objects in systems in which a neutron star or white dwarf component has already been excluded by maximum mass arguments. The positive identification of a black hole would also be an additional test of general relativity. Two possible DPT's were detected in W photometry of Cygnus XR-1, the leading candidate for a stellar mass sized BH, in 3 hours of observational data. A search of X-ray photometry of Cygnus XR-1 from the Ross1 X-ray Timing Explorer (RXTE) has begun. No DPT's have been detected in the first 4 hours of data searched. Because of the low event rate detected in the W data, these initial results are consistent with such disparate scenarios as the rate of DPT occurrence being dependent on the luminosity state of the system; or being more difficult to detect in the X-ray region relative to the W region; or occurring at the same rate in the W and X-ray regions; or even not occurring at all from Cygnus XR-1. The search for DPT's in RXTE photometry is continuing.
Dolan, Joseph F.↗
Mixed Reality Training and Workspace Integration
Mixed reality technology is being used across Idaho National Laboratory (INL) to enhance training and workforce development. Projects involving mixed reality such as lockout/tagout , the Industrial Control System Laboratory , and a Department of Defense microreactor demonstration have benefited from these innovative approaches. Several key concerns exist with integrating this new technology, including ease of use, ease of setup, and maintenance through the lifecycle. These aspects need to be properly addressed to ensure that this technology remains attractive and useful to operations teams as well as engineers and researchers at INL. Primarily, this requires buy-in from information technology management, designing software/hardware-agnostic tools, and reducing friction with technology integration. To be successful, regular operational use of this new and unfamiliar technology will require straightforward user interfaces, simple setup processes, and feature-rich experiences that reduce the time needed to benefit from the technology. INL is improving its toolset to allow for a streamlined deployment and use of mixed reality technologies that are directly available to researchers and engineers.
99 GENERAL AND MISCELLANEOUS↗
Limitations and Feasibility of Mini X-Ray Devices in Space Environments
LIMITATIONS AND FEASIBILITY OF MINI X-RAY DEVICES IN SPACE ENVIRONMENTS As space exploration advances toward long-duration missions, reliable medical diagnostic tools become increasingly critical. The miniature x-ray (XR) technology demonstrations by the Exploration Medical Capability (ExMC) and the Exploration Medical Integrated Product Team (XMIPT) aim to assess the feasibility and utility of miniature XR devices in spaceflight. This abstract explores the limitations of current miniature XR systems, the challenges of training crew members, the potential role of clinical decision support systems (CDSS), and the feasibility of ground-based image interpretation. We also propose the integration of miniature XR into other ExMC efforts aimed at identifying the capabilities and resources needed for future exploration class missions. One of the primary challenges with miniature XR devices is the ability to achieve specific anatomical views, particularly in the confined and weightless conditions of a spacecraft. Operators may struggle to acquire diagnostic-quality images when space is limited for proper patient positioning and the volume of the imaging device. Since space radiation and detector limitations may further impact image quality, the flexibility of the operating procedures of these devices will be critical for their success in space applications. CHALLENGES IN TRAINING CREW TO OPERATE IMAGING DEVICES Training in the skills necessary to acquire diagnostic-quality scans may be a barrier for non-clinician crewmembers. The curriculum developed for crew medical officers (CMOs) will require simplification and adaptation to fit into the highly truncated pre-flight training period. Therefore, hands-on familiarization and simulation, both pre-flight and just-in-time training during missions, will be crucial to ensuring the crew can operate the devices in real-life situations. The ability to adjust acquisition parameters must be simplified or made automatic through exam selections on equipment user interfaces, and subject and operator positioning should be assisted with laser guidance and pictorial guides. POTENTIAL FOR CDSS OR ARTIFICIAL INTELLIGENCE (AI)-ASSISTED CDSS CDSS and AI-assisted CDSS offer significant promise in assisting crew members with limited medical training. These systems could provide real-time feedback on image quality and interpretation, helping to mitigate the risks of human error during space missions. Integrating procedural guidance tools, such as virtual and augmented reality, will support crewmembers in accurately positioning patients and obtaining high-quality images. However, the success of such systems will depend on the development of robust training datasets, integration with spaceflight-rated hardware, and the medical decision-making capabilities of operators. FEASIBILITY OF GROUND INTERPRETATION AND DATA TRANSMISSION Reliance on ground-based interpretation may prove difficult for acute care during exploration class-missions due to delays in transmission with increasing distance from Earth or complete communication blackout periods. In such instances where immediate interpretation for clinical intervention is required, crew must be able to interpret the images independently or utilize AI-based assistance to do so. File sizes for XR exams can also be large if numerous images are acquired and bandwidth constraints may limit data transmissions for both radiography and ultrasound exams. FUTURE WORK AND INTEGRATION INTO THE EVIDENCE LIBRARY Future work proposes integrating miniature XR devices into NASA’s Evidence Library to address medical conditions identified as significant contributors to crew morbidity and mortality. The possibility of combining miniature XR with other imaging modalities, such as ultrasound devices, is also under investigation. In conclusion, while miniature XR technology holds potential for extraterrestrial medical systems, there are significant challenges to overcome. Training, integration of AI tools, dedicated exam protocols for microgravity, and improved data transmission systems will be key to realizing the full benefits of miniature XR technology in space.
A M Nelson↗
Enhancing Training Through Extended Reality and Data Fusion
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
Bramley, Shane Michael [Sandia National Laboratori↗
Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations
NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.
Simulation Modeling Virtual Reality Immersive Tech↗
Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations
NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.
HITL↗
Possible Evidence for an Event Horizon in Cyg XR-1
The X-ray emitting component in the Cyg XR-1/HDE226868 system is a leading candidate for identification as a stellar-mass sized black hole. The positive identification of a black hole as predicted by general relativity requires the detection of an event horizon surrounding the point singularity. One signature of such an event horizon would be the existence of dying pulse trains emitted by material spiraling into the event horizon from the last stable orbit around the black hole. We observed the Cyg XR-1 system at three different epochs in a 1400 - 3000 A bandpass with 0.1 ms time resolution using the Hubble Space Telescope's High Speed Photometer. Repeated excursions of the detected flux by more than three standard deviations above the mean are present in the UV flux with FWHM 1 - 10 ms. If any of these excursions are pulses of radiation produced in the system (and not just stochastic variability associated with the Poisson distribution of detected photon arrival times), then this short a timescale requires that the pulses originate in the accretion disk around Cyg XR-1. Two series of pulses with characteristics similar to those expected from dying pulse trains were detected in three hours of observation.
Dolan, Joseph F.↗
Research Needs for Developing Qualification Standards for Flight Simulation Training Devices with Head Mounted Displays
This presentation discusses research needs to support evidence-based qualification standards for Flight Simulation Training Devices (FSTDs) with head mounted displays (HMDs). Currently, the FAA and EASA have no qualification standards specifically for FSTDs using HMDs and extended reality (XR) visuals, and existing qualification standards may not be sufficient. Special Conditions can be prescribed for the evaluation and qualification of individual devices, but these Special Conditions need to be assessed and adjusted on a case-by-case basis resulting in an elaborate process. Furthermore, test tolerances used in Special Conditions are often based on conventional visual systems and may not be adequate. This presentation first identifies gaps in the current knowledge of using HMDs in pilot training, and, more specifically, using HMDs in the training of manual aircraft control with motion cues. Next, research is proposed to help close these gaps, inform the development of qualification criteria and tolerances, and guide efforts to update regulations. The Vertical Motion Simulator (VMS) at NASA Ames Research Center, with its large motion capability, is currently undergoing significant upgrades including a state-of-the-art out-the-window visual system. In addition, an HMD capability will be introduced to use in conjunction with the conventional visual system. With its long history of setting standards in the simulation industry, the VMS is the ultimate tool to conduct research that could help accelerate the development of standards for the use of HMDs in FSTDs. The goal of the talk is ultimately to spark a discussion about the research needs and priorities to best serve the development of new qualification standards.
XR↗
Trades, Architecture, and Design of the Joint Augmented Reality Visual Informatics (Joint AR) Product
Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate and tight choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. Additionally, EVA operations, aside from the Apollo Lunar surface missions, have predominately focused on maintenance and construction tasks where success criteria are clearly measurable. However, future exploration missions expect to enable crew to carry out scientific objectives in increasingly Earth-independent ways. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. This paper highlights the project’s experience with a product-focused management style and use-case centered systems engineering approach to iteratively design, build, and test. The Joint AR product features were defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, graphics engine software and analog test beds. We outline the defining architectural design decisions, including safety criticality considerations, suit mounting interfaces, computer architectures, and partnership contracting mechanisms. The outcomes of these studies, architecture decisions, and management requirements result in a recommended design which is the Joint AR product. We discuss the evolution, development of these system components, and what work remains. We hope to share a unified understanding of various design decisions and how they impact the future of crew members’ access to data during Lunar and Martian EVAs. This ongoing effort can enable a community-wide discovery process toward realizing necessary AR features and capabilities for future missions.
Augmented Reality↗
Trace Elemental Abundances in Calcium-Aluminum-Rich Inclusions in CV Chondrites
Introduction: Calcium-aluminum-rich inclusions (CAIs), are the first formed solids that define the age of the Solar System [1,2]. CAIs are thought to have condensed from nebular gas [3,4] within the first <1 Ma of Solar System formation [5,6]. CAIs have experienced numerous early Solar System processes including condensation, evaporation, melting, recrystallization, and aqueous alteration [e.g., 7]. The chemical, mineralogical, and textural diversity among CAIs results from a range of chemical and physical processes recorded during nebular and parent body epoch. This study aims to explore the mineralogical, textural, and chemical compositions of CAIs including the trace elemental abundances in CAI phases to determine the early Solar System processes recorded in them. Samples and Analytical Methods: We analyzed one CAI each from CV3 chondrites Northwest Africa (NWA) 5508 designated as ‘Saguaro’, and Northwest Africa (NWA) 12772 designated as ‘Hoopoe’. Back-scatter electron (BSE) images were collected using a Phenom XL scanning electron microscope (SEM) at the Lunar and Planetary Institute (LPI) and the JEOL JXA-8530F electron probe microanalyzer (EPMA) at Johnson Space Center (JSC)-NASA. Additionally, energy dispersive X-ray spectrometry (EDS) elemental maps of select areas for these samples were collected using a 15.0kV beam energy and a 40µA emission current. Using the EPMA, wavelength-dispersive X-ray spectroscopy (WDS) quantitative data were collected. In-situ trace element measurements for both CAIs were determined at JSC-NASA using a Photon Machines 193nm laser ablation system and a Thermo-Scientific Element-XR inductively coupled plasma mass spectrometer (ICP-MS). Analyses consisted of 30s ablations at 10Hz, spot sizes of 20-25µm, and a fluence of 6.0 J/cm2 for anorthite and melilite, and a 3.5 J/cm2 fluence for all other phases. NIST612 was used to correct for instrument drift, while BHVO-2g was used as a primary calibration standard. BCR-2g and in-house mineral standards were regularly measured as unknowns to ensure accuracy. Results: Saguaro is a coarse-grained CAI, ~11 x 6 mm in dimensions. Saguaro contains spinel, Al-rich pyroxene, anorthite, Mg-rich melilite, and minor perovskite in its interior and is therefore classified as a Type B CAI. Individual melilite grains shows normal compositional zoning with an Ak content ranging from ~24 to 54 with no apparent trend from the core to the edge of the CAI. The spinel appears euhedral and occurs both as clusters and as spinel palisades [8]. Two rim sequences surround most of the sample: the inner rim being a Wark-Lovering (WL) rim (~10-35 µm) containing pyroxene, spinel, and melilite (or anorthite), and the outer rim is a finer-grained, thicker (~100 µm), accretionary rim (Fig. 1). The mineral phases in Saguaro record an overall flat REE pattern with an average negative Eu anomaly in pyroxene, and an average positive Eu anomaly in anorthite and melilite respectively. Anorthite, melilite, and pyroxene have a minor depletion in Tm (Fig. 2). The Hoopoe CAI is a compact, coarse-grained ~6 × 4 mm in size. The major mineralogy includes hibonite, spinel, melilite, anorthite, and perovskite. Therefore, it is classified as a compact transitional type A and B. (?)zoning was observed in some hibonites. Individual melilite grains show both reverse and normal zoning, where the Ak content ranges from ~6- to 28. Melilite shows two distinct textures. One texture consisted of smooth melilite that appeared homogenous, while the second appeared to consist of many fine fractures. The spinel also often appears clustered. The WL-rim sequence surrounding Hoopoe is ~25 µm thick and composed of spinel, perovskite, hibonite, and melilite/anorthite. It is then partially surrounded by an outer accretionary rim (~75µm). Like before, refractory metal nuggets appeared concentrated near the WL rims. Other metal assemblages rich in Fe and Ni were also observed. All major mineral phases in Hoopoe display relatively flat REE patterns, except for varying Eu and Tm between phases (Fig. 2). There is a prominent negative Eu anomaly in perovskite and an average positive Eu anomaly in spinel, anorthite, and hibonite respectively (Fig. 2, 3). The mixed phases along the rim of the CAI also display a negative Eu anomaly, and all phases the CAI were depleted in Pb. Discussion: The CV3 CAIs analyzed in this study were classified based on their mineralogy and textures into Type A versus Type B CAIs [10]. Hibonite appears to be pseudomorphically replacing the spinel, (i.e., is hibonite in composition, but appears in the shape of spinel). Spinel palisades. The presence of spinel palisades present in Saguaro are consistent with the melting and recrystallization experienced by this CAI. Trace elemental analyses. Saguaro and Hoopoe display similar trace element patterns to each other, with both appearing generally flat, with anomalies in Eu, and Tm. Melilite and anorthite display positive Eu anomalies in both CAIs, in addition to the hibonite in Hoopoe (Fig. 2). The phases that are depleted in Eu are pyroxene and perovskite in both Saguaro and Hoopoe, respectively (Fig. 3). Given that Eu is volatile in reducing environments [11], this could possibly indicate reducing conditions at the time anorthite and melilite crystallized, with the gas they formed from containing Eu. As these CAIs continued to form, this gas as a result would become depleted in Eu. This also could be supported by the propensity of anorthite and melilite to take up Eu from its surroundings and incorporate it into their structure [12]. In addition, analyzing the assemblage of the phases in the Saguaro, melilite and anorthite (Eu enriched) often surround the pyroxene (Eu depleted) as they are crystallized. This intergrowth of phases and the proximity of the phases would support that the Eu is being incorporated into some phases, preventing it from incorporating into other. Trace elemental analyses of the CAI rims will be evaluated in more detail, as they are complicated by the transient signal being composed of a mixture of mineral phases. Broadly, however, the patterns in the rims of both CAIs are comparable to each other, and for Hoopoe, to the mixed phase patterns in the core (Fig. 3). Other studies have found that CAI rims can be depleted in Ce and Yb [13], however we did not observe these anomalies in the two CAIs discussed here. Given their similarity, the trace elemental analyses of the mixed interior (i.e. core) and rim phases could be interpreted as forming from similar, if not the same, reservoirs. The REE abundance between the rim and core of Hoopoe are also similar, indicating they may have formed from a gas of the same or similar composition. Acknowledgments: We thank the ASU Center for Meteorite Studies for loaning the samples used in this work and Tabb Prissel for his assistance with the analysis. Mouti Al-Hashimi thanks Sam Crossley and Cyrena Goodrich for their help with the LPI SEM training. This work was supported by the LPI Summer Intern Program in Planetary Science and the LPI Cooperative Agreement. References: [1] Connelly J.N. (2012) Science, 338, 651-655. [2] MacPherson G. J. (2014) Treatise on Geochem., 2, 139-179. [3] Grossman L. (1972) GCA, 36, 597-619. [4] Ebel, D.S. (2006) Meteorites and the Early Solar System II (D. S. Lauretta & H. Y. McSween, Eds.) 253-277. [5] MacPherson G. J. (2012) Earth Planet. Sci. Lett., 331-332, 43-54. [6] MacPherson G.J. (2017) GCA, 201, 65-82. [7] Krot A.N. (1995) Meteoritics & Planet. Sci., 30, 748-775. [8] Wark and Lovering (1982) GCA, 46, 2595-2607. [9] Palme H. and Jones A. (2003) Treatise on Geochemistry (H. D. Holland and K. K. Turekian Eds.), 1, 41-61. [10] Grossman L. (1980) Ann. Rev. Earth Planet. Sci., 8, 559-608. [11] Floss C. et al. (1996) GCA, 60, 1975-1997. [12] Mason B. and Martin P. M. (1974) Earth Planet. Sci. Lett., 22, 141-144. [13] Wark B. and Boynton W. V. (2001) Meteoritics & Planet. Sci., 36, 1135-1166.
X Mouti↗