Extended Reality Visualization at INL
Presentation detailing the use of extended reality at INL.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “extended reality”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Integrating extended reality with inspection systems
An extended reality (“XR”) inspection system for inspecting a target is provided. The XR inspection system includes an inspection system and an XR device. The inspection system includes an inspection main unit and an inspection probe. The inspection main unit collects inspection data from the inspection probe, receives commands input by an inspector using the XR device, performs functions associated with the commands, and sends display data to the XR device. The XR device provides an augmented reality display and sensors. The XR device displays display data received from the inspection main unit, receives commands via the sensors from the inspector, and sends the commands to the inspection main unit.
Keene, Lionel↗
Enhancing Training Through Extended Reality and Data Fusion
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
Bramley, Shane Michael [Sandia National Laboratori↗
INL Digital Engineering: Model-Based Design, Digital Threads, Digital Twins, Artificial Intelligence, and Extended Reality for Complex Energy Systems
This presentation showcases digital transformation efforts carried by the Idaho National Laboratory (INL) Digital Innovation Center of Excellence (DICE). Digital Engineering technologies are described, including Model-Based Systems Engineering, Digital Thread, Digital Twins, Artificial Intelligence, and Extended Reality. Selected projects across the laboratory that have used or are currently using a digital engineering design approach are presented.
08 HYDROGEN↗
Deploying Extended Reality (XR) for Digital Operations and Maintenance (O&M) at the Mechanisms Engineering Test Loop (METL)
This report documents the preliminary efforts to digitize operation and maintenance (O&M) activities for the Mechanisms Engineering Test Loop (METL). METL became operational in September 2018 with the mission to provide an ecosystem for Advanced Reactor Development (ARD). METLs flagship facility’s primary purpose is conducting small to intermediate scale tests for Sodium Fast Reactors (SFR). Its resemblance to commercial SFR’s intermediate heat transport system, prototypic operating conditions, and industrial construction practices/materials provides the overarching benefit of establishing a proving ground for emerging operations and maintenance (O&M) activities such as incorporating Extended Reality (XR) applications throughout the program lifecycle.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
The Role of Immersion for Improving Extended Reality Analysis of Personalized Flow Simulations
Not provided.
Cardiovascular System & Cardiology↗
The Future of Visualization Technology Vis in Practice
Two decades ago, we witnessed an inflection point as graphics programming became commoditized. A comparable inflection point may be on the horizon, this time driven by the commoditization of immersive display technology with Augmented Reality (AR), Virtual Reality (VR), and Extended Reality (XR) technologies poised to redefine our interaction with data, environments, and collaboration. To drive the technology and its application, we should consider the lessons learned from successful large-scale immersive installations. Where these installations have thrived is by enhancing traditional workflows rather than entirely replacing them, supporting improved judgments of complex spaces, direct interaction in 3D, and embedding high-dimensional data.
AR/VR↗
Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)
This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Interactive Quantum Chemistry Enabled by Machine Learning, Graphical Processing Units, and Cloud Computing
Modern quantum chemistry algorithms are increasingly able to accurately predict molecular properties that are useful for chemists in research and education. Despite this progress, performing such calculations is currently unattainable to the wider chemistry community, as they often require domain expertise, computer programming skills, and powerful computer hardware. In this review, we outline methods to eliminate these barriers using cutting-edge technologies. We discuss the ingredients needed to create accessible platforms that can compute quantum chemistry properties in real time, including graphical processing units–accelerated quantum chemistry in the cloud, artificial intelligence–driven natural molecule input methods, and extended reality visualization. We end by highlighting a series of exciting applications that assemble these components to create uniquely interactive platforms for computing and visualizing spectra, 3D structures, molecular orbitals, and many other chemical properties.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Early Fault Detection in Nuclear Systems: A Digital Engineering Approach
Nuclear energy systems present unique challenges in terms of ensuring safety, reliability, and efficiency during their design and operation. Early fault detection is critical for mitigating risks and fostering system resilience. However, current methods often fall short at identifying faults during early stages, potentially leading to costly delays and safety risks. The present work proposes a comprehensive digital engineering approach that leverages digital twins, digital threads, model-based systems engineering, artificial intelligence, and immersive extended reality to support early fault detection in nuclear systems. Through a series of case studies, we highlight specific gaps in the fault detection mechanisms of traditional nuclear design and operation processes, then demonstrate a suite of solutions we are working to implement to address these shortcomings in similar projects. Our findings suggest that a digital engineering approach to design and operation can significantly improve fault detection, ultimately leading to reductions in risk.
42 - ENGINEERING↗
Toward a Smart Metaverse City: Immersive Realism and 3D Visualization of Digital Twin Cities
Metaverse and its related extended reality technologies can enable immersive, realistic, and participatory visualization of 3D data, and their use and the potential within a smart city can be effective for supporting urban research and urban operations management. This book chapter describes a vision for prototyping a “Smart Metaverse City” to combine the unique advantage of the Metaverse technology with the two-way connectivity of a digital twin city application. This synergy aims to create a virtual environment for immersive geovisualization to help researchers and the public understand the complex urban system through science-based and data-driven approaches. This book chapter selectively reviews past technological and paradigm advancements for collecting, analyzing, and visualizing 3D urban big data. Then we present a prototyping Geographic Information System (GIS) framework, together with some relevant data sources and open-source web technologies, to help researchers create a smart Metaverse city. We demonstrate our vision and discuss its application opportunities through a real-world example, a digital twin city developed at the Oak Ridge National Laboratory, to facilitate participatory, smart, and sustainable campus management.
Xu, Haowen↗
Mixed Reality Training and Workspace Integration
Mixed reality technology is being used across Idaho National Laboratory (INL) to enhance training and workforce development. Projects involving mixed reality such as lockout/tagout , the Industrial Control System Laboratory , and a Department of Defense microreactor demonstration have benefited from these innovative approaches. Several key concerns exist with integrating this new technology, including ease of use, ease of setup, and maintenance through the lifecycle. These aspects need to be properly addressed to ensure that this technology remains attractive and useful to operations teams as well as engineers and researchers at INL. Primarily, this requires buy-in from information technology management, designing software/hardware-agnostic tools, and reducing friction with technology integration. To be successful, regular operational use of this new and unfamiliar technology will require straightforward user interfaces, simple setup processes, and feature-rich experiences that reduce the time needed to benefit from the technology. INL is improving its toolset to allow for a streamlined deployment and use of mixed reality technologies that are directly available to researchers and engineers.
99 GENERAL AND MISCELLANEOUS↗
3D Reality Energy Modeling Software
The team will combine Bentley Systems’ ContextCapture and extend Oak Ridge National Laboratory’s building energy modeling capabilities in order to create digital twins of buildings that allow simulation-informed improvement for energy efficiency and demand response in the design and operation of the built environment. Bentley Systems’ ContextCapture software processes data from 3D laser scanning and photographs (through photogrammetry) to create a photorealistic, 3D mesh with a scale of individual objects to building to city-sized. This capability easily provides city-level visualization models and platforms where sustainable design alternatives are readily evaluated. Oak Ridge National Laboratory (ORNL) serves the U.S. Dept. of Energy (DOE) as one of three core laboratories developing building energy modeling tools EnergyPlus and OpenStudio. ORNL’s AutoBEM software (bit.ly/AutoBEM) can process imagery (satellite, aerial, and street level), LiDAR, cartographic layers, tax assessor’s data, and other data sources to extract building footprints, height, window-to-wall ratio, building type, vintage, and other building properties. AutoBEM has created 178,368 building energy models that were empirically validated with 15-minute whole-building electrical data from a utility.
97 MATHEMATICS AND COMPUTING↗
Calculations Document
Figure 1 shows a simplified model schematic of the Tetracage target design. In this figure the green lines represent the Tetracage yarns, which consist of two parallel yarns on the top and two parallel yarns on the bottom with the pairs in a cross hatched pattern. For simplicity, as we are only considering vertical forces, we will perform calculations without consideration for the two pairs of yarns being perpendicular to each other. Also worth noting is the model shows the yarns extending directly to the capsule then closely hugging it – in reality, the yarns behave as you would expect where they hug the capsule only as much as the geometry of their deflection allows, similarly to if you held a tennis ball with a pair of parallel strings anchored at opposing ends. The dashed black lines show the path the yarns take straight across from slot glue point to slot glue point before the target is closed and the capsule deforms them. The variable r corresponds to the capsule outer radius. The variable L corresponds to the hohlraum inner radius. The variable a corresponds to the yarn offset from the center of the diagnostic band. The variable d corresponds to the wire deflection vertically.
42 ENGINEERING↗
Applications of visualization technology in the structural sciences
The structural sciences are undergoing a transformation driven by advancements in visualization technologies that aid researchers in understanding and communicating experimental data from complex molecular systems. New applications of integrative structural biological and biophysical approaches add a wide variety of complementary information from a broad range of scientific disciplines. These approaches extend structural biophysical methodologies to enable research by the incorporation of a variety of data streams and utilization of tools like molecular graphics, virtual reality, and machine learning. To redefine how structural data—particularly from cryo-electron microscopy and x-ray crystallography—are fed forward for scientific exploration and communication, the advances in tools for data visualization and interpretation have been critical. By bringing molecular systems into an interactive three-dimensional space, these novel technologies enhance research workflows, facilitate structure-based drug design, and create engaging educational experiences. Taken together, these visualization innovations are essential tools for advancing the field by making concepts more accessible and compelling.
Eng, Edward T. [New York Structural Biology Center↗
Repowering: The Other Side of the Reliability Coin
Extreme weather, cracked backsheets, severe PID, poorly built modules, and installation flaws - all can compromise a solar plant's health and force repowering long before end of life. With more than 70% of U.S. PV capacity less than seven years old, the fleet is young, but its rapid expansion has introduced new materials and system designs that are still being tested under real-world conditions. As a result, reliability - not economics - is what most often drives repowering decisions. Repowering is frequently assumed to be an economically motivated choice, but our work shows that reliability concerns are the real trigger. Drawing from industry interviews, case studies, and modeling, we highlight the physical, electrical, and policy barriers owners face when deciding whether to repair, repower, or decommission. At the same time, repowering can create opportunities: renewed interconnection periods, improved energy yields, and strategic upgrades to extend system value. We present a quantitative framework using NLR's System Advisor Model (SAM) and PV in Circular Economy (PV ICE) tool to evaluate trade-offs across financial, material, and energy impacts. These findings provide practical guidance for navigating the realities of repowering today and underscore the critical role of reliability in shaping the future performance and sustainability of the PV fleet.
14 SOLAR ENERGY↗
Virtual Inspection of Advanced Manufacturing via Process-Scale Digital Twins (Abbreviated Report)
Inspection and certification comprise the most significant bottlenecks in advanced manufacturing for NNSA applications, often requiring far more time and resources than the fabrication of the parts themselves. Traditional methods, such as manual review and X-ray computed tomography, are not only slow and costly, but also struggle to provide a clear connection between manufacturing instructions and the final performance of critical components. This gap limits both the agility and assurance needed to support the modernization and safety of the United States nuclear stockpile. In response, our Strategic Initiative established a digital twin framework that integrates realtime process monitoring, automated data analysis, and immersive virtual reality collaboration into a unified inspection pipeline. By leveraging data from sensors, machine instructions, and imaging, we created high-fidelity virtual models of manufactured parts that could be rapidly analyzed and certified. This approach was first demonstrated with Direct Ink Write, and then extended to other manufacturing settings, including conventional (or “subtractive”) manufacturing and to predict the end of life performance of parts per the aging and lifetimes programs. The result is a transformational capability: inspection times have been reduced by a factor of 120,000 without loss of accuracy and while simultaneously improving traceability and confidence in part quality. This framework not only streamlines certification for critical applications, but also positions the national security enterprise to respond more flexibly to emerging challenges, supporting agile manufacturing and digital engineering practices across a broad range of mission-relevant domains.
42 ENGINEERING↗
Higher Vortexability: Zero-Field Realization of Higher Landau Levels
The rise of moiré materials has led to experimental realizations of integer and FCIs in small or vanishing magnetic fields. At the same time, a set of minimal conditions sufficient to guarantee an Abelian fractional state in a flat band were identified, namely “ideal" or “vortexable" quantum geometry. Such vortexable bands share essential features with the LLL, while excluding the need for more fine-tuned aspects such as flat Berry curvature. A natural and important generalization is to ask if such conditions can be extended to capture the quantum geometry of higher Landau levels, particularly the first (1LL), where non-Abelian states at ν = 1/2, 2/5 are known to be competitive. The possibility of realizing these states at zero magnetic field, and perhaps even more exotic ones, could become a reality if we could identify the essential structure of the 1LL in Chern bands. In this work, we introduce a precise definition of 1LL quantum geometry, along with a figure of merit that measures how closely a given band approaches the 1LL. Furthermore, periodically strained Bernal graphene is shown to realize such a 1LL structure even in zero magnetic field.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗