Engineering PapersSearch

SEARCH · Engineering Papers

Results for “immersive visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Immersive Analytics in Critical Spatial Domains: From Materials to Energy Systems

Immersive analytics (IA) leverages virtual reality, augmented reality, and mixed reality to transform how users interact with complex datasets across domains such as science, industry, and education. These immersive technologies offer spatial and multimodal environments that foster intuitive exploration, but they also introduce challenges related to cognitive load, interface design, and system performance. Here, this article presents a comprehensive review of visualization techniques, interaction models, and multimodal inputs utilized in IA. Drawing on case studies in scientific visualization, industrial training, and educational communication, we examine both the potential and limitations of current systems. Finally, we propose future research directions, focusing on real‐time collaboration, adaptive user interfaces, and scalable data exploration strategies to advance the field.

99 - GENERAL AND MISCELLANEOUS

3D Stereo Immersive Environment Utilizing Mobile Devices / Peripherals

This project expands upon some of the FY23 IRAD funded "Full Lunar Surface Simulation Platform" (FLS-SP) derived technologies. The results have demonstrated a low-cost, compact, immersive technology that supports training, interaction, mission planning, and other man-in-loop activities in simulated environments called “3D Stereo Immersion Environment Utilizing Mobile Devices” (3D SIEUMD). These activities will become crucial for safety and mission, planning, and assurance in the Artemis program, as well as future commercial crew programs. The FLS-SP enabled the visualization of simulated lunar surface operations for rovers, landers, habitation, and EVA. The 3D SIEUMD technology allows for NASA S&MA experts, tasked with defining safety protocols and procedures, to interact in an immersive environment without expensive immersion gear. Reduction of the overall safety risk by immersing safety concepts into the design and engineering phase for very small cost is accomplished even before hardware is deployed to the lunar surface.

Scott Johnson

Exploring the Use of Large Immersive Display Systems in the Nuclear Industry

Large immersive display systems play a critical role in the nuclear industry by enabling advanced training, design reviews, scientific visualization, and safety simulations. These systems, such as CAVE and powerwalls, allow engineers and operators to interact with virtual nuclear environments in real-time, providing a deeper understanding of complex systems. Their ability to simulate real-world scenarios for testing and optimization in a safe, controlled environment ensures that operators and engineers can refine process, enhance safety protocols, and troubleshoot complex challenges. This article outlines key lessons learned from deploying these systems, practical insights into their applications, and considerations for future improvements, aiming to guide their broader adoption and effective use in the nuclear industry.

99 - GENERAL AND MISCELLANEOUS

Research on Intelligent Synthesis Environments

Four research activities related to Intelligent Synthesis Environment (ISE) have been performed under this grant. The four activities are: 1) non-deterministic approaches that incorporate technologies such as intelligent software agents, visual simulations and other ISE technologies; 2) virtual labs that leverage modeling, simulation and information technologies to create an immersive, highly interactive virtual environment tailored to the needs of researchers and learners; 3) advanced learning modules that incorporate advanced instructional, user interface and intelligent agent technologies; and 4) assessment and continuous improvement of engineering team effectiveness in distributed collaborative environments.

Noor, Ahmed K.

Spaceflight Sensorimotor Analogs: Simulating Acute and Adaptive Effects

Adaptive changes in sensorimotor function during spaceflight are reflected by spatial disorientation, motion sickness, gaze destabilization and decrements in balance, locomotion and eye-hand coordination that occur during and following transitions between different gravitational states. The purpose of this study was to conduct a meta-synthesis of data from spaceflight analogs to evaluate their effectiveness in simulating adaptive changes in sensorimotor function. METHODS. The analogs under review were categorized as either acute analogs used to simulate performance decrements accompanied with transient changes, or adaptive analogs used to drive sensorimotor learning to altered sensory feedback. The effectiveness of each analog was evaluated in terms of mechanisms of action, magnitude and time course of observed deficits compared to spaceflight data, and the effects of amplitude and exposure duration. RESULTS. Parabolic flight has been used extensively to examine effects of acute variation in gravitational loads, ranging from hypergravity to microgravity. More recently, galvanic vestibular stimulation has been used to elicit acute postural, locomotor and gaze dysfunction by disrupting vestibular afferents. Patient populations, e.g., with bilateral vestibular loss or cerebellar dysfunction, have been proposed to model acute sensorimotor dysfunction. Early research sponsored by NASA involved living onboard rotating rooms, which appeared to approximate the time course of adaptation and post-exposure recovery observed in astronauts following spaceflight. Exposure to different bed-rest paradigms (6 deg head down, dry immersion) result in similar motor deficits to that observed following spaceflight. Shorter adaptive analogs have incorporated virtual reality environments, visual distortion paradigms, exposure to conflicting tilt-translation cues, and exposure to 3Gx centrifugation. As with spaceflight, there is considerable variability in responses to most of the analogs reviewed. DISCUSSION. A true ground-based flight analog for sensorimotor function is not feasible. A combination of flight analogs; however, can be used to selectively mimic different aspects of the spaceflight-induced sensorimotor performance decrements.

Taylor, Laura C.

Exploring the Intersection of AI and Visualization in the Nuclear Industry

This presentation explores the impact of AI and visualization in advancing the nuclear industry by improving safety, operational efficiency, and decision-making processes. It highlights key applications such as real-time monitoring, predictive maintenance, and immersive training, while addressing challenges like data quality, regulatory hurdles, and the need for explainable AI. Additionally, the presentation outlines future directions, emphasizing the potential of AI-driven reactor design, advanced simulation tools, and ethical considerations to drive innovation and sustainability in nuclear operations.

99 GENERAL AND MISCELLANEOUS

Exploring Innovative Methods for Earth Science Communication Through NASA’s Earth Information Center

Environmental challenges stemming from unprecedented changes in our planet have increased the need to communicate our understanding of Earth as a connected system. In June 2023, NASA unveiled the Earth Information Center (EIC), part of NASA’s Earth Action Strategy aimed at amplifying NASA’s Earth science impact by engaging decision-makers beyond the scientific community. Existing in both physical and virtual space, the EIC provides critical information on how the planet is changing and affecting livelihoods across the globe. For over fifty years, NASA has utilized the unique vantage point space offers to monitor Earth in collaboration with Federal partners. Through an expanding fleet of Earth observing satellites and sensors, NASA informs local to global decision making within nine thematic areas: agriculture, biodiversity, disasters, greenhouse gases, health and air quality, sea level rise and coastal impacts, sustainable energy, water resources, and wildfires. Visitors to the inaugural location of the EIC at NASA Headquarters in Washington D.C., can interact with Earth observation data and models through innovative exhibits and storytelling. Designed by an interdisciplinary team, the EIC is designed for multiple modality learning to reach a wide base of end-users. Data driven visualizations, near real-time information, and curated stories highlight the applications of Earth observations to address environmental challenges. Complementary exhibits and immersive storytelling allow visitors to physically step inside environmental data and connect with information on an emotional level. Taken together, the collective EIC provides scientists and non-scientists alike with the ability to see our home planet as NASA sees it, as a system of systems, while delivering easily accessible information to those who need it most.

Earth Information Center

NASA Virtual Glovebox: An Immersive Virtual Desktop Environment for Training Astronauts in Life Science Experiments

The International Space Station will soon provide an unparalleled research facility for studying the near- and longer-term effects of microgravity on living systems. Using the Space Station Glovebox Facility - a compact, fully contained reach-in environment - astronauts will conduct technically challenging life sciences experiments. Virtual environment technologies are being developed at NASA Ames Research Center to help realize the scientific potential of this unique resource by facilitating the experimental hardware and protocol designs and by assisting the astronauts in training. The Virtual GloveboX (VGX) integrates high-fidelity graphics, force-feedback devices and real- time computer simulation engines to achieve an immersive training environment. Here, we describe the prototype VGX system, the distributed processing architecture used in the simulation environment, and modifications to the visualization pipeline required to accommodate the display configuration.

Twombly, I. Alexander

Teleoperation and Visualization Interfaces for Remote Intervention in Space

Approaches to robotic manufacturing, assembly, and servicing of in-space assets range from autonomous operation to direct teleoperation, with many forms of semi-autonomous teleoperation in between. Because most approaches require one or more human operators at some level, it is important to explore the control and visualization interfaces available to those operators, taking into account the challenges due to significant telemetry time delay. We consider one motivating application of remote teleoperation, which is ground-based control of a robot on-orbit for satellite servicing. This paper presents a model-based architecture that: 1) improves visualization and situation awareness, 2) enables more effective human/robot interaction and control, and 3) detects task failures based on anomalous sensor feedback. We illustrate elements of the architecture by drawing on 10 years of our research in this area. The paper further reports the results of several multi-user experiments to evaluate the model-based architecture, on ground-based test platforms, for satellite servicing tasks subject to round-trip communication latencies of several seconds. The most significant performance gains were obtained by enhancing the operators’ situation awareness via improved visualization and by enabling them to precisely specify intended motion. In contrast, changes to the control interface, including model-mediated control or an immersive 3D environment, often reduced the reported task load but did not significantly improve task performance. Considering the challenges of fully autonomous intervention, we expect that some form of teleoperation will continue to be necessary for robotic in-situ servicing, assembly, and manufacturing tasks for the foreseeable future. We propose that effective teleoperation can be enabled by modeling the remote environment, providing operators with a fused view of the real environment and virtual model, and incorporating interfaces and control strategies that enable interactive planning, precise operation, and prompt detection of errors.

space robotics

Long term storage test of titanium material with liquid fluorine propellant

The compatibility of 6AL-4V Ti with propellant grade GF2 and LF2 at 77 K for up to 3 years was investigated. Titanium double coupons, annealed or heat treated, with 16 or 64 RMS finishes, were immersed in F2 in individual Pyrex capsules and stored under LN2 for 29 and 39 months. Pre and post immersion tests were performed on the propellant and coupons. Chemical analysis of the propellant did not reveal any significant changes due to titanium corrosion. Gravimetric, visual, microscopic, and metallurgical examination with pitting analysis did not reveal gross corrosion of the titanium although pitting appears to be greater after 39 months exposure. The increase in pit size and number raises the possibility of unpredictable crack propagation instability. Fracture toughness tests are necessary to define this possibility.

Denson, J. R.

The Emergence of Agent-Based Technology as an Architectural Component of Serious Games

The evolution of games as an alternative to traditional simulations in the military context has been gathering momentum over the past five years, even though the exploration of their use in the serious sense has been ongoing since the mid-nineties. Much of the focus has been on the aesthetics of the visuals provided by the core game engine as well as the artistry provided by talented development teams to produce not only breathtaking artwork, but highly immersive game play. Consideration of game technology is now so much a part of the modeling and simulation landscape that it is becoming difficult to distinguish traditional simulation solutions from game-based approaches. But games have yet to provide the much needed interactive free play that has been the domain of semi-autonomous forces (SAF). The component-based middleware architecture that game engines provide promises a great deal in terms of options for the integration of agent solutions to support the development of non-player characters that engage the human player without the deterministic nature of scripted behaviors. However, there are a number of hard-learned lessons on the modeling and simulation side of the equation that game developers have yet to learn, such as: correlation of heterogeneous systems, scalability of both terrain and numbers of non-player entities, and the bi-directional nature of simulation to game interaction provided by Distributed Interactive Simulation (DIS) and High Level Architecture (HLA).

Phillips, Mark

Using XR for Improving Scientific Discovery With Numerical Weather Models

Our work explores the use of extended reality (XR) to im- prove scientific discovery with numerical weather/climate models that inform Earth science digital twins, specifically the NASA Goddard Earth Observing System (GEOS) global atmospheric model. The overall project is named the Vi- sualization And Lagrangian dynamics Immersive eXtended Reality Toolkit (VALIXR), which has two main areas of focus: (1) enhancing the understanding of and interaction with model output data through advanced visualizations in the XR environment, and (2) the integration of Lagrangian dynamics into the GEOS model, which allows a natural, feature-specific analysis of Earth science phenomena as op- posed to traditional, fixed-point Eulerian dynamics. Here, we report initial work on these focus areas.

Thomas Grubb

Using RSVP for analyzing state and previous activities for the Mars Exploration Rovers

Current developments in immersive environments for mission planning include several tools which make up a system for performing and rehearsing missions. This system, known as the Rover Sequencing and Visualization Program (RSVP), includes tools for planning long range sorties for highly autonomous rovers, tools for planning operations with robotic arms, and advanced tools for visualizing telemetry from remote spacecraft and landers. One of the keys to successful planning of rover activities is knowing what the rover has accomplished to date and understanding the current rover state. RSVP builds on the lessons learned and the heritage of the Mars Pathfinder mission This paper will discuss the tools and methodologies present in the RSVP suite for examining rover state, reviewing previous activities, visually comparing telemetered results to rehearsed results, and reviewing science and engineering imagery. In addition we will present how this tool suite was used on the Mars Exploration Rovers (MER) project to explore the surface of Mars.

Mars Exploration Rover (MER)

Mitigation of Silver Ion Loss from Solution by Polymer Coating of Metal Surfaces, Part IV

“Spacecraft potable water systems require a biocidal agent that effectively provides both immediate and residual disinfection over long periods of time. Ionic silver (Ag+) is a leading candidate for this application, but suffers from rapid concentration loss due to interactions with the metallic storage containers and tubing. In order to maintain biocidal efficacy in systems with long periods of dormancy and to reduce the required rate of Ag+ injection, it is necessary to develop alternative materials and coatings for certified metal alloys that significantly reduce the Ag+ loss.” In previous reports, we have described our investigations addressing Ag+ loss mitigation and adhesion performance of parylene barrier coatings on coupons of several metal alloys and 316L tubing under static immersion. In such conditions, parylene-C and AF4 coatings have shown excellent Ag+ loss mitigation performance, and mixed long-term adhesion performance, depending on parylene species and substrate surface chemistry/structure. In Part IV of this series, we begin to address the performance of parylene-C barrier coatings under more challenging and realistic conditions, in order to evaluate potential suitability in flight systems. Using two testbeds, we characterized coating performance under dynamic mechanical operation. In the Flow/Pressure Testbed System, Ag+ solution is pumped through internally coated 316L tubing, with optional pressure cycling. In the Bellows Tank Testbed System, an internally coated edge-welded 316L bellows containing Ag+ solution is cyclically extended and compressed, analogous to the operation of bellows tanks used for potable water storage and delivery on the International Space Station. Periodic determinations of Ag+ loss with testbed cycling/time and visual observation of the parylene-C coatings were conducted. In addition, we characterized parylene-C coating resilience and Ag+ loss with 316L tubing and multiple fitting types under long-term immersion and repeated fitting dis/reassembly.

Lance Dean Delzeit

Three-Dimensional User Interfaces for Immersive Virtual Reality

The focus of this grant was to experiment with novel user interfaces for immersive Virtual Reality (VR) systems, and thus to advance the state of the art of user interface technology for this domain. Our primary test application was a scientific visualization application for viewing Computational Fluid Dynamics (CFD) datasets. This technology has been transferred to NASA via periodic status reports and papers relating to this grant that have been published in conference proceedings. This final report summarizes the research completed over the past year, and extends last year's final report of the first three years of the grant.

vanDam, Andries

High-Temperature Smart Structures for Engine Noise Reduction and Performance Enhancement

One of key NASA goals is to develop and integrate noise reduction technology to enable unrestricted air transportation service to all communities. One of the technical priorities of this activity has been to account for and reduce noise via propulsion/airframe interactions, identifying advanced concepts to be integrated with the airframe to mitigate these noise-producing mechanisms. An adaptive geometry chevron using embedded smart structures technology offers the possibility of maximizing engine performance while retaining and possibly enhancing the favorable noise characteristics of current designs. New high-temperature shape memory alloy (HTSMA) materials technology enables the devices to operate in both low-temperature (fan) and high-temperature (core) exhaust flows. Chevron-equipped engines have demonstrated reduced noise in testing and operational use. It is desirable to have the noise benefits of chevrons in takeoff/landing conditions, but have them deployed into a minimum drag position for cruise flight. The central feature of the innovation was building on rapidly maturing HTSMA technology to implement a next-generation aircraft noise mitigation system centered on adaptive chevron flow control surfaces. In general, SMA-actuated devices have the potential to enhance the demonstrated noise reduction effectiveness of chevron systems while eliminating the associated performance penalty. The use of structurally integrated smart devices will minimize the mechanical and subsystem complexity of this implementation. The central innovations of the effort entail the modification of prior chevron designs to include a small cut that relaxes structural stiffness without compromising the desired flow characteristics over the surface; the reorientation of SMA actuation devices to apply forces to deflect the chevron tip, exploiting this relaxed stiffness; and the use of high-temperature SMA (HTSMA) materials to enable operation in the demanding core chevron environment. The overall conclusion of these design studies was that the cut chevron concept is a critical enabling step in bringing the variable geometry core chevron within reach. The presence of the cut may be aerodynamically undesirable in some respects, but it is present only when the chevron is not immersed in the core jet exhaust. When deployed, the gap closes as the chevron tip enters the high-speed, high-temperature core stream. Aeroacoustic testing and flow visualization support the contention that this cut is inconsequential to chevron performance.

Quackenbush, Todd R.

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE)

NASA is planning to return to the Moon in the mid-2020s as a stepping stone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support. The software used in APACHE was created by the JSC Engineering Directorate, in partnership with Buendea, powered by a custom Unreal Engine 5 (UE5.3, Epic Games) project. APACHE currently utilizes the HTC Vive Pro Eye in a wireless configuration for VR simulations. There are two virtual environments that subjects can explore within APACHE, a Lunar and Martian surface. The virtual Lunar surface was created from LIDAR data of the Lunar South Pole to create roughly 16 sq km of explorable terrain. The virtual Martian surface contains roughly 400 sq km of explorable terrain derived from Mars Reconnaissance Orbiter LIDAR data of the Jezero Crater. The immersion and related cognitive burdens of conducting a planetary EVA is simulated through a series of EVA-relevant tasks performed in the VR environment, using these high-fidelity visual representations. Additionally, APACHE includes biosensor driven informatics, such as real-time heart rate monitoring and/or derived values from model simulations, for active monitoring by the EV crew and added cognitive demand. A “Wizard of Oz” control panel enables test operators to activate contingency events such as simulated spacesuit malfunctions, loss of communications, and/or limited visibility. Embedded performance measures such as accuracy, completeness, and execution time have been developed for various exploration tasks to objectively quantify crew performance during an EVA and compare impacts to performance when different environmental stressors, both physical and cognitive, are added to or removed from the simulation. Additionally, validated cognitive and operational performance measures such as the Digit Symbol Substitution Task have been recreated and embedded in VR for direct and relatively unobtrusive measurement of motor perception. The APACHE environment currently supports multiple research studies at NASA. Examples include the CHAPEA project, a series of simulated year-long missions on Mars by a 4-person crew; and the CO2 Contingency Walk Back Study, an investigation of elevated CO2 exposure on crew performance during a contingency EVA scenario. APACHE also provides a test environment to support the development of the Crew State and Risk Model, which is a collection of individualized, mathematical models of crew physical and cognitive state; and the Personalized EVA Informatics and Decision Support system, an operational tool for flight controllers, and eventually a self-reliant Martian crew, to make biomedically-informed decisions in real-time to optimize the EVA planning and execution with respect to crew health and performance. Some technical challenges associated with developing the APACHE environment, as well as current limitations, include VR limitless natural walking with a hybrid spacesuit simulator, optimizing performance for wireless PC VR streaming while maintaining a high degree of visual fidelity, and the integration of various physiological (metabolic masks) and psychometric (eye tracking) sensors with the VR headset.

Human Performance