SEARCH · Engineering Papers

Results for “teleoperations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

11 records

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Teleoperation of Construction Robots Using Human Interaction: Case Study Examples: Preprint

The integration of advanced teleoperation methods in construction robotics has the potential to enhance productivity and safety in demanding environments. Among different methods, hand gestures have emerged as an intuitive approach, enabling seamless communication between human operators and robotic systems. This study demonstrates the use of hand gestures for controlling a model robotic excavator and a virtual robotic arm in construction applications. Two case study examples are presented. In the first case study, a series of hand gestures are performed to control a model robotic excavator's bucket and arm movements. The second case study focuses on using hand gestures to control a virtual robotic arm to perform a material handling task in a simulated environment. In both cases, the performed hand gestures are all successfully captured and interpreted by the gesture-based teleoperation method to conduct the corresponding tasks, which demonstrates the application of the gesture-based control method for various types of construction robots. Also, the limitations of the gesture-based teleoperation method (e.g., recognition delay, sensitivity to motion outliers) are discussed. Future work will focus on developing a digital twin system to support gesture-based teleoperation for a wider range of construction robots.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Performance Evaluation of Augmented Teleoperation of Contact Manipulation Tasks

At Argonne National Laboratory, an enhanced telerobotic concept has been suggested by providing augmented virtual fixtures for precise and dexterous manipulation. The proposed technology incorporated a human-robot interface that can assist personnel on the processes of Deactivation and Decommissioning in sites of high radiation. It has been implemented on a dual-arm robot system, known as Baxter, by integrating the Robotic Operating System (ROS) with 3D sensors and visual-haptic operator interface. However, what remained before its practical utilization is the capability for precisely placing the virtual fixtures. To this end, the objectives involved camera calibration, which required hardware fabrication and setup, as well as modification and implementation of ROS. The goal of this Research and Development is to develop an augmented-reality- based operator interface for human-inclusive, intelligent, and autonomous robotic system for the Deactivation and Decommissioning (D and D) of radioactive sites. The objectives are to develop: Collaborative Robot; Multi-modal Mixed-Reality Human-Robot Interface; Intelligent and Autonomous Behaviors. In order to achieve this, Baxter's Head-Kinect camera and Left-Hand camera need to be calibrated to overlap the real environment with the simulated environment. Camera calibration, which is crucial for precisely placing the virtual fixtures, was successful after running the simulations. The real and simulated environments overlapped, permitting the utilization of augmented teleoperation and the dexterous manipulation of Baxter for D and D applications in nuclear sites. Future steps: Performance evaluation of augmented teleoperation of contact manipulation tasks: Multiple-Camera 3D Reconstruction and Automation. Oculus Interface: Augmented reality and machine learning for enhanced telerobotic operation (Augmented Tele-autonomy): Machine-learning techniques for complex and flexible autonomous robotic behaviors. Interactive remote operation of robotic systems. Mesh cutting with simulation and real robot.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

A Passivity-Shortage Based Control Design for Teleoperation With Time-Varying Delays

This letter investigates the effect of time-varying delays in bilateral teleoperation, with respect to stability and performance, using the properties of passivity-shortage. Until recently, the desired stability and performance characteristics were achieved using the concept of passivity. However, passivity is limited to systems of relative degree zero or one, while passivity-shortage includes systems of higher relative degrees and possibly of non-minimum phase. Passivity-shortage also arises naturally when data transmission is subject to delays, either constant or time-varying. In this letter, the properties of passivity-shortage are employed to design a simple negative feedback controller. We show that the proposed method provides a faster responding solution and improved performance compared to the existing approaches. The performance improvements include improved steady-state error convergence, and robustness against environmental disturbances, even in the presence of varying delays.

42 ENGINEERING↗

DOE OSTI2020

Real-time 3D unstructured environment reconstruction utilizing VR and Kinect-based immersive teleoperation for agricultural field robots

Not Available

Chen, Yi↗

DOE OSTI2026

A Modular Accelerator Robotics Framework for AD Robotics

Accelerator tunnels, such as the ones at Fermilab, remain highly radioactive after beam shutoff due to induced radiation from the beam. This residual radiation creates a hazardous environment for manual inspection and repair of beamline components. To minimize worker radiation dose and reduce beam downtime, the AD Robotics Initiative previously built a fleet of low-cost custom mobile robots. However, the custom Python sockets server-client architecture lacked standardization, causing development delays and complicating the integration of new sensors and actuators. Here, we developed a modular system using ROS2 and Docker to standardize the teleoperation and control interfaces. This system was validated by implementing a teleoperation controller with real-time, low-latency, and high-definition video feedback. The aim of this framework is for a new feature or even a robot to be integrated into the system simply by documenting the hardware configuration. Current integration of LiDAR, Odometry, and Depth Cameras provides the foundation for Simultaneous Localization and Mapping (SLAM) tasks. Finally, future work involves integration into the accelerator control system and the attachment of a 6 degree-of-freedom robotic arm for telemanipulation.

Rayyan Khan, M. [Fermilab; Rensselaer Poly.; Unlis↗

DOE OSTI2026

Modular Accelerator Robotics Framework Implementation For Accelerator Inspection

Rayyan Khana, M. [Unlisted, US, IL] (ORCID:0009000↗

DOE OSTI2026

Toward Fully Soft and Multifunctional Shape Sensing via Optical Waveguide Arrays

For soft bodies, surface deformation and pressure provide proprioceptive and exteroceptive information, including body configuration, body compliance, and external forces. We develop a sheet sensor with a fully soft sensing surface that provides surface shape reconstruction using optical waveguide arrays. The waveguides are fabricated to achieve a tunable linear response to bi‐directional bending curvature, and the waveguide arrays are configured to differentiate between ambiguous shapes. We characterize the waveguide performance, relating curvature sensitivity to the core's surface roughness. Synergy of waveguide responses reduces the number of sensing elements required and achieves damage resilience. Using waveguide sensitivity to pressure, we also demonstrate feasibility for exteroception. We demonstrate the multifunctional sensing capability by wrapping the sheet around an upper arm, showcasing joint motion and external force sensing. Integrated into or applied onto surfaces of robotic or living systems, this design can be implemented in applications such as virtual reality, teleoperation, physical therapy, and soft robotics.

Yu, Qifan [Department of Mechanical Engineering Ma↗

DOE OSTI2021

Remote Target Engagement System (RTES) Generation 4 ("Gen 4")

RTES is designed to provide teleoperation of remote weapon platform capability at defensive physical protection locations requiring active lethal capabilities for final access denial. Multiple operator consoles allow for coordinated engagement of many weapon platforms by one or more operator consoles. This results in faster response times, increased effectiveness, and increased survivability from removing response force from harm's way increasing survivability. This software is developed against DoD requirements and has been safety and functionally reviewed and approved for operational use. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1935 O

Klingler, KristopherR.↗

DOE OSTI2023

Exploiting Task Tolerances in Mimicry-based Telemanipulation

We explore task tolerances, i.e., allowable position or rotation inaccuracy, as an important resource to facilitate smooth and effective telemanipulation. Task tolerances provide a robot flexibility to generate smooth and feasible motions; however, in teleoperation, this flexibility may make the user’s control less direct. In this work, we implemented a telema nipulation system that allows a robot to autonomously adjust its configuration within task tolerances. We conducted a user study comparing a telemanipulation paradigm that exploits task tolerances (functional mimicry) to a paradigm that requires the robot to exactly mimic its human operator (exact mimicry), and assess how the choice in paradigm shapes user experience and task performance. Our results show that autonomous adjustments within task tolerances can lead to performance improvements without sacrificing perceived control of the robot. Additionally, we find that users perceive the robot to be more under control, predictable, fluent, and trustworthy in functional mimicry than in exact mimicry.

42 ENGINEERING↗

DOE OSTI2025

Testing, Calibration, and UxS Integration of the Kromek GR1 Plus CZT Gamma Spectrometer

Collecting radiation measurements can be a hazardous task, especially in the presence of highly active sources. Various scenarios necessitate source search, classification, and quantification, often with limited or no a priori information. Activities such as disaster mitigation, emergency response, environmental monitoring, and site remediation may involve dangerous radioactive sources. In these situations, there is a pressing need for remote monitoring capabilities that protect human operators from potential harm and enhance adherence to the principle of “As Low as Reasonably Achievable” (ALARA) for radiation doses. The first step toward achieving remote radiation measurement capabilities is the remote operation of a radiation sensor. Once this milestone is reached, the next challenge is to integrate this remote sensing capability into suitable actuation agents, collectively referred to as uncrewed systems (UxS). These systems include familiar platforms such as robotic quadrupeds, aerial multirotor vehicles, and ground vehicles, any of which may be teleoperated, act autonomously, or utilize a combination of both. A critical factor in achieving remote radiation sensing is the availability of data from the appropriate sensor. Many commercially available radiation sensors have closed-source documentation for their communication protocols. Typical end-user products are often self-contained, handheld devices designed for manual measurement scenarios. While there are commercial off-the-shelf (COTS) integrations of radiation sensors with UxS available for purchase, these solutions are typically tailored for specific use cases and may not meet the requirements of different applications. This paper discusses efforts to remotely acquire radiation measurements from a small form-factor CZT gamma spectrometer. Sandia National Laboratories has successfully demonstrated the initial capability to integrate low size, weight, and power (SWaP) gamma spectroscopy into various UxS, alongside co-located GPS data logging and sensor calibration and qualification. With remote gamma spectroscopy achieved, the stage is set for UxS integration of this capability.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2026

Intern Poster Session 08/13: Autonomous Nuclear Robotics: Applications in nuclear waste inspection and hot cell experiments

The nuclear industry is experiencing renewed interest in autonomous robotics, yet most deployed systems remain teleoperated with limited autonomy. This work presents two contributions toward fully autonomous nuclear robotic systems: autonomous waste inspection at the Hanford Site and an autonomous hot cell laboratory framework. Inspections of Hanford's underground waste storage tanks are performed manually at significant cost and personnel exposure. We developed a reinforcement-learning (RL) training pipeline for a custom-built inspection arm. In parallel, we are designing an autonomous laboratory framework for post-irradiation examination in hot cells at the Specimen Preparation Laboratory (SPL) that integrates computer vision, task and motion planning, hardware execution, and operator-in-the-loop control. These systems demonstrate a path toward safer, more efficient nuclear operations by reducing human exposure while maintaining rigorous human oversight at critical decision points.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗