Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “virtual training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

GeneLab for High Schools – Bioinformatic Training For Students And Educators

Modern biological sciences are increasingly based on high-throughput molecular techniques, including genomics, transcriptomics, and proteomics. NASA’s GeneLab program has collected extensive data from ‘omics’ studies, curated them into an accessible platform and provided data analysis/visualization tools to facilitate the generation of new hypotheses and research directions. GeneLab for High Schools (GL4HS), launched in 2017, has endeavored to utilize this database and provide tools for students to understand and analyze omics datasets whilst also learning about spaceflight research. The GL4HS program ran in person at Ames from 2017-2019 and has run virtually since 2020. Each year fifteen high school students are trained to analyze and interpret GeneLab transcriptomic data. Additionally, in the last several years we have expanded our “teacher training program” to include 10 teachers total in an effort to enable this program to be utilized in classrooms across the USA. Teachers also join the NASA GeneLab Education Working Group (EWG) enabling support as they implement custom GL4HS modules into their classrooms. The GL4HS program consists of three main components – (1) core learning modules, (2) networking and teamwork, and (3) an independent learning project. Students are also taught critical networking and science communication skills facilitating their ability to ‘sell their science’ in innovative and creative ways. This program has enabled students to learn about biology in space and to have a glimpse into the world of research for the first time. Many of the students in this program shared that the course was transformative to their perception about biological sciences and how it linked to other areas of STEM. The ultimate and long-term goal of GL4HS is to expand the program to multiple locations thereby facilitating the reach of NASA Space Biology beyond NASA-centric regions.

GeneLab↗

Alfalfa Virtual Building Service: Software Engineering Best Practices Applied to Runtime Interaction with Building Energy Models

Buildings are active participants in increasingly complex energy systems. Building Energy Modeling (BEM) has a key role to play in planning and de-risking an equitable energy transition, with BEM-backed "virtual buildings" critical path for diverse applications that include workforce training tools, Hardware-in-the-Loop (HIL) experimentation to study equipment performance under a range of conditions, Control-Hardware-in-the-Loop (CHIL) experimentation to de-risk commercial control implementations at equipment through grid orchestration levels, and integration of dynamic load profiles into grid modeling tools for energy system experimentation at the urban scale. Modeling requirements vary across these applications, but many software engineering tasks do not. The Alfalfa Virtual Building Service (AVBS, see https://github.com/NREL/alfalfa/wiki) is an open-source web service that solves these common tasks robustly in one place, providing a foundational platform for power users to bootstrap their own applications. AVBS abstracts the specifics of runtime interaction with OpenStudio, Modelica, and Spawn of EnergyPlus models behind a unified REST API. Additionally, AVBS provides resources for cloud deployment and scaling to 100s of parallel simulations, a growing library of modular Operational Technology (OT) integrations for emulation of real-world interfaces, and scripts to automate the population of communities of virtual buildings from URBANopt, ResStock and ComStock.

building automation↗

Virtual Guidance Ultrasound: A Tool to Obtain Diagnostic Ultrasound for Remote Environments

Astronauts currently acquire ultrasound images on the International Space Station with the assistance of real-time remote guidance from an ultrasound expert in Mission Control. Remote guidance will not be feasible when significant communication delays exist during exploration missions beyond low-Earth orbit. For example, there may be as much as a 20- minute delay in communications between the Earth and Mars. Virtual-guidance, a pre-recorded audio-visual tutorial viewed in real-time, is a viable modality for minimally trained scanners to obtain diagnostically-adequate images of clinically relevant anatomical structures in an autonomous manner. METHODS: Inexperienced ultrasound operators were recruited to perform carotid artery (n = 10) and ophthalmic (n = 9) ultrasound examinations using virtual guidance as their only instructional tool. In the carotid group, each each untrained operator acquired two-dimensional, pulsed, and color Doppler of the carotid artery. In the ophthalmic group, operators acquired representative images of the anterior chamber of the eye, retina, optic nerve, and nerve sheath. Ultrasound image quality was evaluated by independent imaging experts. RESULTS: Eight of the 10 carotid studies were judged to be diagnostically adequate. With one exception the quality of all the ophthalmic images were adequate to excellent. CONCLUSION: Diagnostically-adequate carotid and ophthalmic ultrasound examinations can be obtained by untrained operators with instruction only from an audio/video tutorial viewed in real time while scanning. This form of quick-response-guidance, can be developed for other ultrasound examinations, represents an opportunity to acquire important medical and scientific information for NASA flight surgeons and researchers when trained medical personnel are not present. Further, virtual guidance will allow untrained personnel to autonomously obtain important medical information in remote locations on Earth where communication is difficult or absent.

Caine,Timothy L.↗

Onboarding in a Virtual Environment

A need for a standardized Division 10000 onboarding program for virtual hires was identified by management to formalize the way employees and interns are onboarded and trained into Division 10000. This white paper provides effective short and long-term suggestions in the efforts of improving virtual onboarding. Data suggests that remote work is going to become the forefront of many industry practices, which indicates the need of a standardized virtual onboarding practices. With our research, gap assessments, benchmarking, and conducting interviews both internally and externally, we found that clarity, culture, and connection proved to be the strongest solutions in order to maintain Sandia’s competitive edge and sustain workers both remote and in-person.

99 GENERAL AND MISCELLANEOUS↗

Advanced training systems for the next decade and beyond

Autonomous training systems grouped under the term intelligent computer-aided training (ICAT) are described with references to their intelligent technologies. An ICAT system was developed for the deployment of the payload-assist module satellites from the Space Shuttle, fault detection in vacuum-vent lines on Spacelab, main-propulsion pneumatics, and for instrument pointing systems. The basic ICAT architecture is delineated with descriptions of elements such as the user interface, domain expert, traning-session manager, trainee model, and training-scenario generator. The ICAT systems employ advanced technologies including knowledge acquisition, virtual environments, and fuzzy logic. The general architecture of the ICAT systems is shown to be fully developed and applicable to the construction of seven different tasks, and the ICAT systems are concluded to enhance the training of aerospace personnel.

Loftin, R. B.↗

Implementation of Headtracking and 3D Stereo with Unity and VRPN for Computer Simulations

This paper explores low-cost hardware and software methods to provide depth cues traditionally absent in monocular displays. The use of a VRPN server in conjunction with a Microsoft Kinect and/or Nintendo Wiimote to provide head tracking information to a Unity application, and NVIDIA 3D Vision for retinal disparity support, is discussed. Methods are suggested to implement this technology with NASA's EDGE simulation graphics package, along with potential caveats. Finally, future applications of this technology to astronaut crew training, particularly when combined with an omnidirectional treadmill for virtual locomotion and NASA's ARGOS system for reduced gravity simulation, are discussed.

Noyes, Matthew A.↗

Sim2Real Autonomous Robotic Exploration [Poster]

Autonomous robots offer promising solutions for exploration in environments that are inaccessible or hazardous to humans. Despite this, physical training of such robots is often constrained by safety risks, high cost or limited accessibility. This project presents an end-to-end simulation to reality pipeline leveraging Nvidia Isaac Sim and Boston Dynamics' Spot to enable autonomous navigation in indoor environments. A reinforcement learning policy is first trained using Nvidia Isaac Lab to establish Spot's locomotion pattern. Virtual LiDAR sensors are then integrated to perform SLAM-based navigation using simulated odometry. Finally, the simulated navigation scheme is transferred to a physical Spot robot to inspect and record images of a real-world room by repeating the learnt trajectory. The proposed framework highlights the potential of scalable training in simulation and reliable deployment in physical environments. Future directions include dynamic trajectory generation in unseen and challenging environments and integration of environmental sensing like temperature, radiation or humidity via sensor and material simulation.

97 - MATHEMATICS AND COMPUTING↗

Creation Synthetic Data to Train a Digital Twin to Predict Reactor Operations

Understanding techniques to strengthen the nuclear safeguards regime is crucial in preventing nuclear proliferation due to recent advancements in the nuclear energy industry such as Generation IV reactors and microreactors. Prior to the construction of a nuclear power plant, it is necessary to understand the proliferation potential of the plant's reactor. Digital twins serve as a unique solution to recognizing reactor behavior indicative of nuclear proliferation. A digital twin is defined as a virtual model that works in unison to represent a physical asset, with a transference of data between the virtual and physical assets [1]. This work serves as validation for training a digital twin on synthetic data fabricated via means of Serpent reactor physics and point kinetics equations simulations. In this case this work is based on parameters of Idaho State University's AGN-201 reactor. The synthetic data can then be utilized to train machine learning models in the future to further investigate the utility of these methods. The accuracy of the predicted data is measured against real operational data to verify the reliability of the synthetic data creation methods and decide whether these methods should be used in the future to inform inspectors of a reactor's proliferation potential.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Design and Evaluation of a Cross-Cultural Training System

Cross-cultural competency, and the underlying communication and affective skills required to develop such expertise, is becoming increasingly important for a wide variety of domains. To address this need, we developed a blended learning platform which combines virtual role-play with tutorials, assessment and feedback. A Middle-Eastern Curriculum (MEC) exemplar for cross-cultural training U.S. military personnel was developed to guide the refinement of an existing game-based training platform. To complement this curriculum, we developed scenario authoring tools to enable end-users to define training objectives, link performance measures and feedback/remediation to these objectives, and deploy experiential scenarios within a game-based virtual environment (VE). Lessons learned from the design and development of this exemplar cross-cultural competency curriculum, as well as formative evaluation results, are discussed. Initial findings suggest that the underlying training technology promotes deep levels of semantic processing of the key information of relevant cultural and communication skills.

Santarelli, Thomas↗

Countermeasures to Enhance Sensorimotor Adaptability

During exploration-class missions, sensorimotor disturbances may lead to disruption in the ability to ambulate and perform functional tasks during the initial introduction to a novel gravitational environment following a landing on a planetary surface. The goal of our current project is to develop a sensorimotor adaptability (SA) training program to facilitate rapid adaptation to novel gravitational environments. We have developed a unique training system comprised of a treadmill placed on a motion-base facing a virtual visual scene that provides an unstable walking surface combined with incongruent visual flow designed to enhance sensorimotor adaptability. We have conducted a series of studies that have shown: Training using a combination of modified visual flow and support surface motion during treadmill walking enhances locomotor adaptability to a novel sensorimotor environment. Trained individuals become more proficient at performing multiple competing tasks while walking during adaptation to novel discordant sensorimotor conditions. Trained subjects can retain their increased level of adaptability over a six months period. SA training is effective in producing increased adaptability in a more complex over-ground ambulatory task on an obstacle course. This confirms that for a complex task like walking, treadmill training contains enough of the critical features of overground walking to be an effective training modality. The structure of individual training sessions can be optimized to promote fast/strategic motor learning. Training sessions that each contain short-duration exposures to multiple perturbation stimuli allows subjects to acquire a greater ability to rapidly reorganize appropriate response strategies when encountering a novel sensory environment. Individual sensory biases (i.e. increased visual dependency) can predict adaptive responses to novel sensory environments suggesting that customized training prescriptions can be developed to enhance adaptability. These results indicate that SA training techniques can be added to existing treadmill exercise equipment and procedures to produce a single integrated countermeasure system to improve performance of astro/cosmonauts during prolonged exploratory space missions.

Bloomberg, J. J.↗

Training Enhances Both Locomotor and Cognitive Adaptability to a Novel Sensory Environment

During adaptation to novel gravitational environments, sensorimotor disturbances have the potential to disrupt the ability of astronauts to perform required mission tasks. The goal of this project is to develop a sensorimotor adaptability (SA) training program to facilitate rapid adaptation. We have developed a unique training system comprised of a treadmill placed on a motion-base facing a virtual visual scene that provides an unstable walking surface combined with incongruent visual flow designed to enhance sensorimotor adaptability. The goal of our present study was to determine if SA training improved both the locomotor and cognitive responses to a novel sensory environment and to quantify the extent to which training would be retained. Methods: Twenty subjects (10 training, 10 control) completed three, 30-minute training sessions during which they walked on the treadmill while receiving discordant support surface and visual input. Control subjects walked on the treadmill but did not receive any support surface or visual alterations. To determine the efficacy of training all subjects performed the Transfer Test upon completion of training. For this test, subjects were exposed to novel visual flow and support surface movement, not previously experienced during training. The Transfer Test was performed 20 minutes, 1 week, 1, 3 and 6 months after the final training session. Stride frequency, auditory reaction time, and heart rate data were collected as measures of postural stability, cognitive effort and anxiety, respectively. Results: Using mixed effects regression methods we determined that subjects who received SA training showed less alterations in stride frequency, auditory reaction time and heart rate compared to controls. Conclusion: Subjects who received SA training improved performance across a number of modalities including enhanced locomotor function, increased multi-tasking capability and reduced anxiety during adaptation to novel discordant sensory information. Trained subjects maintained their level of performance over six months.

Bloomberg, J. J.↗

The development, assessment and validation of virtual reality for human anatomy instruction

This research project seeks to meet the objective of science training by developing, assessing, validating and utilizing VR as a human anatomy training medium. Current anatomy instruction is primarily in the form of lectures and usage of textbooks. In ideal situations, anatomic models, computer-based instruction, and cadaver dissection are utilized to augment traditional methods of instruction. At many institutions, lack of financial resources limits anatomy instruction to textbooks and lectures. However, human anatomy is three-dimensional, unlike the one-dimensional depiction found in textbooks and the two-dimensional depiction found on the computer. Virtual reality allows one to step through the computer screen into a 3-D artificial world. The primary objective of this project is to produce a virtual reality application of the abdominopelvic region of a human cadaver that can be taken back to the classroom. The hypothesis is that an immersive learning environment affords quicker anatomic recognition and orientation and a greater level of retention in human anatomy instruction. The goal is to augment not replace traditional modes of instruction.

Marshall, Karen Benn↗

Enhancing molecular design efficiency: Uniting language models and generative networks with genetic algorithms

This study examines the effectiveness of generative models in drug discovery, material science, and polymer science, aiming to overcome constraints associated with traditional inverse design methods relying on heuristic rules. Generative models generate synthetic data resembling real data, enabling deep learning model training without extensive labeled datasets. They prove valuable in creating virtual libraries of molecules for material science and facilitating drug discovery by generating molecules with specific properties. While generative adversarial networks (GANs) are explored for these purposes, mode collapse restricts their efficacy, limiting novel structure variability. To address this, we introduce a masked language model (LM) inspired by natural language processing. Although LMs alone can have inherent limitations, we propose a hybrid architecture combining LMs and GANs to efficiently generate new molecules, demonstrating superior performance over standalone masked LMs, particularly for smaller population sizes. This hybrid LM-GAN architecture enhances efficiency in optimizing properties and generating novel samples.

97 MATHEMATICS AND COMPUTING↗

STS-109 Crew Training

Footage shows the crew of STS-109 (Commander Scott Altman, Pilot Duane Carey, Payload Commander John Grunsfeld, and Mission Specialists Nancy Currie, James Newman, Richard Linnehan, and Michael Massimino) during various parts of their training. Scenes show the crew's photo session, Post Landing Egress practice, training in Dome Simulator, Extravehicular Activity Training in the Neutral Buoyancy Laboratory (NBL), and using the Virtual Reality Laboratory Robotic Arm. The crew is also seen tasting food as they choose their menus for on-orbit meals.

Source record↗

5G integrated edge computing platform for efficient component monitoring in coal-fired power plants

This project developed a cutting-edge 5G-integrated edge computing framework to enhance operational efficiency and reliability in coal-fired power plants through real-time component monitoring and anomaly detection. The initiative focused on leveraging distributed machine learning, federated learning, and 5G-based dynamic network slicing to support scalable, fault-tolerant monitoring environments to meet the operational requirements in industrial control systems. With a Distributed Edge Computing Service (DECS) orchestration, this project enabled federated learning at edge for condition monitoring and introduced adaptive client selection strategies to minimize communication overhead. Scalable distributed training was achieved using the Horovod framework, thus enhancing performance across edge nodes. In the realm of 5G networking, the project designed and deployed reconfigurable, QoS-aware network slicing tailored for operational technology (OT) environments, integrating software-defined networks to bolster cyber-resilience and enabling dynamic slicing for federated learning workloads. A significant milestone was the development of a virtualized ICS environment with 5G core integration—which allowed elastic and fault tolerant distributed training on real-world datasets such as NASA Bearings, Hydraulic Systems, and TEP. To broaden the impact of the project, a TRL-3 virtualized ICS testbed for research and education was designed. This project engaged several graduate and undergraduate students to conduct research on the cutting-edge technology, and it resulted in one PhD dissertation, one MS thesis, and over 14 peer-reviewed publications. With the support of this project students also participated in national cybersecurity competitions to improve their professional development skills.

20 FOSSIL-FUELED POWER PLANTS↗

Digital Twin Technology for Safety, Security, and Training in Spent Nuclear Fuel Handling

The increasing complexity of spent nuclear fuel handling requires significant resources to ensure safety, security, and personnel training. As nuclear facilities have continued to advance in scale and technology, the integration of digital tools has become indispensable. Among these tools, digital twins, which are virtual models of physical systems, are emerging as invaluable tools for enhancing safety protocols, security measures, and training in the nuclear sector. These models were conceptualized in the Industry 4.0 revolution. Digital twins can process data from physical systems in real time (by using sensors), include multiple code packages to enable simulations of different physics applications, and even implement artificial intelligence or machine learning techniques for advanced data processing. Despite the advantages that digital twins provide, challenges still exist regarding their widespread implementation. For instance, data used by a digital twin must be accurate to ensure that the digital twin is accurately tuned. Furthermore, if insecure digital twins are targeted by hackers, then they can pose serious risks to the security and safety of nuclear facilities.

Digital twins↗

Virtual Ultrasound Guidance for Inexperienced Operators

Medical ultrasound or echocardiographic studies are highly operator-dependent and generally require lengthy training and internship to perfect. To obtain quality echocardiographic images in remote environments, such as on-orbit, remote guidance of studies has been employed. This technique involves minimal training for the user, coupled with remote guidance from an expert. When real-time communication or expert guidance is not available, a more autonomous system of guiding an inexperienced operator through an ultrasound study is needed. One example would be missions beyond low Earth orbit in which the time delay inherent with communication will make remote guidance impractical. The Virtual Ultrasound Guidance system is a combination of hardware and software. The hardware portion includes, but is not limited to, video glasses that allow hands-free, full-screen viewing. The glasses also allow the operator a substantial field of view below the glasses to view and operate the ultrasound system. The software is a comprehensive video program designed to guide an inexperienced operator through a detailed ultrasound or echocardiographic study without extensive training or guidance from the ground. The program contains a detailed description using video and audio to demonstrate equipment controls, ergonomics of scanning, study protocol, and scanning guidance, including recovery from sub-optimal images. The components used in the initial validation of the system include an Apple iPod Classic third-generation as the video source, and Myvue video glasses. Initially, the program prompts the operator to power-up the ultrasound and position the patient. The operator would put on the video glasses and attach them to the video source. After turning on both devices and the ultrasound system, the audio-video guidance would then instruct on patient positioning and scanning techniques. A detailed scanning protocol follows with descriptions and reference video of each view along with advice on technique. The program also instructs the operator regarding the types of images to store and how to overcome pitfalls in scanning. Images can be forwarded to the ground or other site when convenient. Following study completion, the video glasses, video source, and ultrasound system are powered down and stored. Virtually any equipment that can play back video can be used to play back the program. This includes a DVD player, personal computer, and some MP3 players.

Caine, Timothy↗

Adaptive Effects on Locomotion Performance Following Exposure to a Rotating Virtual Environment

During long-duration spaceflight, astronauts experience alterations in vestibular and somatosensory cues that result in adaptive disturbances in balance and coordination upon return to Earth. These changes can pose a risk to crew safety and to mission objectives if nominal or emergency vehicle egress is required immediately following long-duration spaceflight. At present, no operational countermeasure is available to mitigate the adaptive sensorimotor component underlying the locomotor disturbances that occur after spaceflight. Therefore, the goal of this study is to develop an inflight training regimen that facilitates recovery of locomotor function after long-duration spaceflight. The countermeasure we are proposing is based on the concept of adaptive generalization. During this type of training the subject gains experience producing the appropriate adaptive motor behavior under a variety of sensory conditions and response constraints. As a result of this training a subject learns to solve a class of motor problems, rather than a specific motor solution to one problem, i.e., the subject learns response generalizability or the ability to "learn to learn." under a variety of environmental constraints. We are developing an inflight countermeasure built around treadmill exercise activities. By manipulating the sensory conditions of exercise by varying visual flow patterns, body load and speed we will systematically and repeatedly promote adaptive change in locomotor behavior. It has been shown that variable practice training increases adaptability to novel visuo-motor situations. While walking over ground in a stereoscopic virtual environment that oscillated in roll, subjects have shown compensatory torso rotation in the direction of scene rotation that resulted in positional variation away from a desired linear path. Thus, postural sway and locomotor stability in 1-g can be modulated by visual flow patterns and used during inflight treadmill training to promote adaptive generalization. The purpose of this study was to determine if adaptive modification in locomotor performance could be achieved by viewing simulated self-motion in a passive-immersive virtual ' environment over a prolonged period during treadmill locomotion.

Mulavara, A. P.↗