Enhancing Training Through Extended Reality and Data Fusion
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
Bramley, Shane Michael [Sandia National Laboratori↗
SEARCH · Engineering Papers
Results for “Extended Reality”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)
This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Early Fault Detection in Nuclear Systems: A Digital Engineering Approach
Nuclear energy systems present unique challenges in terms of ensuring safety, reliability, and efficiency during their design and operation. Early fault detection is critical for mitigating risks and fostering system resilience. However, current methods often fall short at identifying faults during early stages, potentially leading to costly delays and safety risks. The present work proposes a comprehensive digital engineering approach that leverages digital twins, digital threads, model-based systems engineering, artificial intelligence, and immersive extended reality to support early fault detection in nuclear systems. Through a series of case studies, we highlight specific gaps in the fault detection mechanisms of traditional nuclear design and operation processes, then demonstrate a suite of solutions we are working to implement to address these shortcomings in similar projects. Our findings suggest that a digital engineering approach to design and operation can significantly improve fault detection, ultimately leading to reductions in risk.
42 - ENGINEERING↗
Mixed Reality Training and Workspace Integration
Mixed reality technology is being used across Idaho National Laboratory (INL) to enhance training and workforce development. Projects involving mixed reality such as lockout/tagout , the Industrial Control System Laboratory , and a Department of Defense microreactor demonstration have benefited from these innovative approaches. Several key concerns exist with integrating this new technology, including ease of use, ease of setup, and maintenance through the lifecycle. These aspects need to be properly addressed to ensure that this technology remains attractive and useful to operations teams as well as engineers and researchers at INL. Primarily, this requires buy-in from information technology management, designing software/hardware-agnostic tools, and reducing friction with technology integration. To be successful, regular operational use of this new and unfamiliar technology will require straightforward user interfaces, simple setup processes, and feature-rich experiences that reduce the time needed to benefit from the technology. INL is improving its toolset to allow for a streamlined deployment and use of mixed reality technologies that are directly available to researchers and engineers.
99 GENERAL AND MISCELLANEOUS↗
Calculations Document
Figure 1 shows a simplified model schematic of the Tetracage target design. In this figure the green lines represent the Tetracage yarns, which consist of two parallel yarns on the top and two parallel yarns on the bottom with the pairs in a cross hatched pattern. For simplicity, as we are only considering vertical forces, we will perform calculations without consideration for the two pairs of yarns being perpendicular to each other. Also worth noting is the model shows the yarns extending directly to the capsule then closely hugging it – in reality, the yarns behave as you would expect where they hug the capsule only as much as the geometry of their deflection allows, similarly to if you held a tennis ball with a pair of parallel strings anchored at opposing ends. The dashed black lines show the path the yarns take straight across from slot glue point to slot glue point before the target is closed and the capsule deforms them. The variable r corresponds to the capsule outer radius. The variable L corresponds to the hohlraum inner radius. The variable a corresponds to the yarn offset from the center of the diagnostic band. The variable d corresponds to the wire deflection vertically.
42 ENGINEERING↗
Applications of visualization technology in the structural sciences
The structural sciences are undergoing a transformation driven by advancements in visualization technologies that aid researchers in understanding and communicating experimental data from complex molecular systems. New applications of integrative structural biological and biophysical approaches add a wide variety of complementary information from a broad range of scientific disciplines. These approaches extend structural biophysical methodologies to enable research by the incorporation of a variety of data streams and utilization of tools like molecular graphics, virtual reality, and machine learning. To redefine how structural data—particularly from cryo-electron microscopy and x-ray crystallography—are fed forward for scientific exploration and communication, the advances in tools for data visualization and interpretation have been critical. By bringing molecular systems into an interactive three-dimensional space, these novel technologies enhance research workflows, facilitate structure-based drug design, and create engaging educational experiences. Taken together, these visualization innovations are essential tools for advancing the field by making concepts more accessible and compelling.
Eng, Edward T. [New York Structural Biology Center↗
Repowering: The Other Side of the Reliability Coin
Extreme weather, cracked backsheets, severe PID, poorly built modules, and installation flaws - all can compromise a solar plant's health and force repowering long before end of life. With more than 70% of U.S. PV capacity less than seven years old, the fleet is young, but its rapid expansion has introduced new materials and system designs that are still being tested under real-world conditions. As a result, reliability - not economics - is what most often drives repowering decisions. Repowering is frequently assumed to be an economically motivated choice, but our work shows that reliability concerns are the real trigger. Drawing from industry interviews, case studies, and modeling, we highlight the physical, electrical, and policy barriers owners face when deciding whether to repair, repower, or decommission. At the same time, repowering can create opportunities: renewed interconnection periods, improved energy yields, and strategic upgrades to extend system value. We present a quantitative framework using NLR's System Advisor Model (SAM) and PV in Circular Economy (PV ICE) tool to evaluate trade-offs across financial, material, and energy impacts. These findings provide practical guidance for navigating the realities of repowering today and underscore the critical role of reliability in shaping the future performance and sustainability of the PV fleet.
14 SOLAR ENERGY↗
Virtual Inspection of Advanced Manufacturing via Process-Scale Digital Twins (Abbreviated Report)
Inspection and certification comprise the most significant bottlenecks in advanced manufacturing for NNSA applications, often requiring far more time and resources than the fabrication of the parts themselves. Traditional methods, such as manual review and X-ray computed tomography, are not only slow and costly, but also struggle to provide a clear connection between manufacturing instructions and the final performance of critical components. This gap limits both the agility and assurance needed to support the modernization and safety of the United States nuclear stockpile. In response, our Strategic Initiative established a digital twin framework that integrates realtime process monitoring, automated data analysis, and immersive virtual reality collaboration into a unified inspection pipeline. By leveraging data from sensors, machine instructions, and imaging, we created high-fidelity virtual models of manufactured parts that could be rapidly analyzed and certified. This approach was first demonstrated with Direct Ink Write, and then extended to other manufacturing settings, including conventional (or “subtractive”) manufacturing and to predict the end of life performance of parts per the aging and lifetimes programs. The result is a transformational capability: inspection times have been reduced by a factor of 120,000 without loss of accuracy and while simultaneously improving traceability and confidence in part quality. This framework not only streamlines certification for critical applications, but also positions the national security enterprise to respond more flexibly to emerging challenges, supporting agile manufacturing and digital engineering practices across a broad range of mission-relevant domains.
42 ENGINEERING↗
Higher Vortexability: Zero-Field Realization of Higher Landau Levels
The rise of moiré materials has led to experimental realizations of integer and FCIs in small or vanishing magnetic fields. At the same time, a set of minimal conditions sufficient to guarantee an Abelian fractional state in a flat band were identified, namely “ideal" or “vortexable" quantum geometry. Such vortexable bands share essential features with the LLL, while excluding the need for more fine-tuned aspects such as flat Berry curvature. A natural and important generalization is to ask if such conditions can be extended to capture the quantum geometry of higher Landau levels, particularly the first (1LL), where non-Abelian states at ν = 1/2, 2/5 are known to be competitive. The possibility of realizing these states at zero magnetic field, and perhaps even more exotic ones, could become a reality if we could identify the essential structure of the 1LL in Chern bands. In this work, we introduce a precise definition of 1LL quantum geometry, along with a figure of merit that measures how closely a given band approaches the 1LL. Furthermore, periodically strained Bernal graphene is shown to realize such a 1LL structure even in zero magnetic field.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
datacenterCoolingModel
ExaDigiT is a framework for developing comprehensive digital twins of liquid-cooled supercomputers, which has three main modules: (1) a python-based Resource Allocator and Power Simulator (RAPS), (2) a Modelica-based Thermo-Fluidic cooling model, and (3) a C++-based augmented reality model built on Unreal Engine 5. The Modelica-based cooling model is primarily built-on the open-source Transient Simulation Framework of Reconfigurable Models (TRANSFORM) library and the open-source autocsm library. The library follows the templating architecture developed in the TRANSFORM and the autocsm libraries. This tool can be easily extended to model other Frontier-like liquid cooled supercomputers.
Kumar, Vineet [Oak Ridge National Laboratory (ORNL↗