A Preliminary Cyber-Physical Security Assessment of the Robot Operating System (ROS)
Abstract Not Provided
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract Not Provided
For nuclear facility decommissioning and waste cleanup, it is necessary to deploy simple and robust robots in remote sites performing precise and dexterous manipulation under teleoperation. To meet the challenge, this paper presents a new remote operation method based on augmented reality for intuitive and efficient teleoperation. The enhanced teleoperation system incorporates three technology components - 3D sensing and reconstruction, augmented reality, and teleoperation. The 3D reconstruction technology utilizes 3D cameras and constructs a 3D geometric model of the environment. Compared to the state-of-the- art technology, the presented 3D reconstruction has greater spatial precision and dynamic object tracking capability, which enhances the precision of manipulation tasks in a dynamic environment. The augmented reality technology entails generation of virtual surfaces of various geometries and dynamic characteristics, as well as consistent perceptual overlay in camera, robot and operator hand control spaces. Teleoperation is demonstrated with a dual-arm robot system operated under Robot Operating System (ROS). (authors)
This paper describes the autonomous robotic systems developed in the TORONE project (Total Characterisation by Remote Observation of Nuclear Environments) for combined characterisation by remote techniques in nuclear environments. There are four main components to the system. Firstly, robot operation which uses a Robot Operating System (ROS) allowing ease of communication between hardware and software alongside robot vision systems such as Lidar and/or photogrammetry. Secondly, radiation detection instrumentation for gamma and neutron sources which is also collimated for spatial resolution. Thirdly, photonic characterisation instrumentation for remote material identification by means of Raman spectroscopy and Laser induced breakdown spectroscopy (LIBS). Finally, a data management system is described which contains the TORONE characterisation data with the ability to overlay material characterisation information onto 3D maps of the nuclear environment. Preliminary results are described alongside discussion of some of the synergies of the combined approach. There are many applications of such an autonomous system in nuclear decommissioning, waste management and asset management. (authors)
At Argonne National Laboratory, an enhanced telerobotic concept has been suggested by providing augmented virtual fixtures for precise and dexterous manipulation. The proposed technology incorporated a human-robot interface that can assist personnel on the processes of Deactivation and Decommissioning in sites of high radiation. It has been implemented on a dual-arm robot system, known as Baxter, by integrating the Robotic Operating System (ROS) with 3D sensors and visual-haptic operator interface. However, what remained before its practical utilization is the capability for precisely placing the virtual fixtures. To this end, the objectives involved camera calibration, which required hardware fabrication and setup, as well as modification and implementation of ROS. The goal of this Research and Development is to develop an augmented-reality- based operator interface for human-inclusive, intelligent, and autonomous robotic system for the Deactivation and Decommissioning (D and D) of radioactive sites. The objectives are to develop: Collaborative Robot; Multi-modal Mixed-Reality Human-Robot Interface; Intelligent and Autonomous Behaviors. In order to achieve this, Baxter's Head-Kinect camera and Left-Hand camera need to be calibrated to overlap the real environment with the simulated environment. Camera calibration, which is crucial for precisely placing the virtual fixtures, was successful after running the simulations. The real and simulated environments overlapped, permitting the utilization of augmented teleoperation and the dexterous manipulation of Baxter for D and D applications in nuclear sites. Future steps: Performance evaluation of augmented teleoperation of contact manipulation tasks: Multiple-Camera 3D Reconstruction and Automation. Oculus Interface: Augmented reality and machine learning for enhanced telerobotic operation (Augmented Tele-autonomy): Machine-learning techniques for complex and flexible autonomous robotic behaviors. Interactive remote operation of robotic systems. Mesh cutting with simulation and real robot.
Hazardous nuclear and industrial facilities are rarely designed for robots. Work in these domains demand precise manipulation and robust mobility in cluttered, constrained spaces where off-the-shelf platforms struggle and “one-size-fits-all” machines become costly and complex. Idaho National Laboratory (INL) is developing an autonomous, multi-robot inspection system that coordinates task-specific platforms rather than relying on a single omni-tool robot. An electric truck serves as a power and compute hub for a custom manipulator co-developed with Florida International University (FIU), a commercial mini crawler, a pan–tilt–zoom camera, and a Nexxis Argus LiDAR mapping system. Working in concert, these robots generate spatial, radiation, and temperature maps of the pit environments at the Hanford Waste Tank Farms. These systems will capture visual records and environmental telemetry to allow for analysis post inspection. The system architecture uses Robot Operating System 2 (ROS 2) for publish/subscribe integration, NVIDIA Isaac Sim and Unity for simulation and visualization, and algorithms such as NVBlox to fuse data into unified 3D overlays. This robot-agnostic approach reduces operator burden by enabling autonomy across heterogeneous platforms and lets each robot be used where it is strongest. Having autonomous functions means operators don’t have to fully control multiple different components. The ease of use could allow for more widespread adoption of advanced robotics at waste management sites that see continued use. By coordinating simpler, purpose-built mechanisms, the approach lowers design and manufacturing complexity, reduces capital risk in contaminated settings, and improves controllability for complex inspection and manipulation tasks. We present the architecture, early results, and lessons learned from building and deploying this coordinated multi-robot system, with the goal of accelerating safe, cost-effective adoption of advanced robotics at waste-management sites.
In order to establish a common software framework for its robotic systems, the United States Department of Energy - Environmental Management (DOE-EM) is considering the possibility of extending the Robot Operating System (ROS) open source robotics software to address the varied, complex challenges facing DOE-EM. The effort, preliminarily called ROS-DOE, would enhance the reliability, robustness, security, and user friendliness of ROS to meet the requirements of the nuclear waste remediation mission, and those of DOE as a whole. As envisioned, the ROS DOE program would also support rapid progress to mature cross-cutting capabilities including supervised autonomy, inter-operability with off-the-shelf industrial equipment, and physics-based robot simulation (i.e., Gazebo). This paper provides background context about the current state of ROS software and its supporting community, surveys DOE-EM needs and requirements for robotic solutions, and analyzes the gaps between the current state of ROS and those needed for DOE-EM robotics. It then identifies new capabilities that are recommended for ROS-DOE and outlines software development practices that could be leveraged to blend the best of the open-source world with high-reliability software development practices. (authors)
Disclosed here is a user interface for a robotic hand. The user interface anchors a user's palm in a relatively stationary position and determines various angles of interest necessary for a user's finger to achieve a specific fingertip location. The user interface additionally conducts a calibration procedure to determine the user's applicable physiological dimensions. The user interface uses the applicable physiological dimensions and the specific fingertip location, and treats the user's finger as a two link three degree-of-freedom serial linkage in order to determine the angles of interest. The user interface communicates the angles of interest to a gripping-type end effector which closely mimics the range of motion and proportions of a human hand. The user interface requires minimal contact with the operator and provides distinct advantages in terms of available dexterity, work space flexibility, and adaptability to different users.
Incorporating multiple robotic manipulators into large-scale manufacturing systems enhances production efficiency and expands manufacturing capabilities beyond those of single-robot systems. Workpiece positioners in robotic manufacturing have demonstrated significant benefits for process optimization, but coordination strategies for multi-robot systems with shared positioners have received limited attention. This work presents a task-space coordinated trajectory-tracking control framework for multi-robot manufacturing systems, in which robots coordinate their motions within a shared, dynamic workpiece positioning frame. A workpiece positioner actively adjusts the pose of the manufactured component to enable greater operational concurrency and improve overall production efficiency. The proposed motion-coordination scheme employs a distributed and scalable architecture, supporting coordination across heterogeneous multi-robot systems. Two optimization methodologies are introduced to manage kinematic redundancies and maintain continuous, near-optimal operation throughout the manufacturing process. The first strategy exploits a task-space dimensionality reduction to achieve locally optimal configurations by leveraging symmetry-axis rotations of the tool. The second strategy utilizes the workpiece positioner to drive the coordinated robots toward stable and kinematically favorable configurations. For both optimization strategies, multiple objectives are defined to improve key performance metrics, including manipulability, configuration consistency, proximity to mechanical limits, and motion efficiency. Addressing a key limitation of existing coordination approaches, the framework is designed around online setpoint modification, allowing coordinated robots to respond effectively to in-situ process feedback. The proposed control framework is validated using the Robot Operating System (ROS) middleware on a combination of physical and simulated multi-robot system hardware.
Integration of robots into scientific user facilities, such as the National Synchrotron Light Source II, improves their efficiency and capacity. Many such facilities use the opensource Bluesky project for experimental control and orchestration. However, there remains an open challenge in deploying robotic solutions at these facilities that are reconfigurable, extensible, and compatible with pre-existing software infrastructure. Herein, we introduce a framework that uses the Robotic Operating System 2 (ROS2) and Bluesky to provide extensible robotic applications, while working under the operational constraints of a large-scale user facility. We demonstrated this framework by integrating a robotic arm to pick and place a sample holder at a beamline, recording a 90% repeatability rate. This provides the groundwork for further new robotics applications at large-scale scientific user facilities that depend on Bluesky.
This project involves making measurements of contaminated areas using portable radiation detectors and small robots. Tasks involve operating detectors and small robots, combining data acquisition for the two systems, and automating the systems. The end result is a radiation map of contamination areas. Localization of radioactive sources and mapping of contamination distribution is essential when responding to emergencies, or when dealing with cleanup efforts. Radiation maps are used for situational awareness and for establishing a safe perimeter. However, it may be hazardous or impossible for humans to safely enter the site and survey the area. Informative Path Planning (IPP) is used to design a path for a robotic sensor platform to gather the most information about the radiation distribution while operating under the set of constraints given by the dynamics of the robot and other requirements such as minimizing the overall mission time. The key challenge for IPP is the tight coupling in multiple layers of decisions: Selection of locations to visit; Allocation of sensors to those locations; Processing of information gathered. Given a robot equipped with a basic gamma detector and Lidar sensor, how can we efficiently explore an unknown environment in such a way that we can satisfy the robot's constraints while simultaneously maximizing the accuracy of the map and minimizing the total runtime? This work presents a systematic procedure for IPP and environmental mapping that: Selects the best locations at which to sample; Finds the best path for robots; Estimates the measurement value at unknown locations using a Gaussian Process regression framework. Given a set of points where radiation measurements were taken, we are utilizing a Gaussian Process Regression with a Matern kernel to reconstruct the shape of the underlying ground truth. Mapping is done via the Robot Operating System's OpenSlam Gmapping package, which creates a 2D occupancy grid map. Simulated trials were run with a radiation source placed at random locations, and allowing the robot to select and move towards 20 samples at separate locations, as well as sampling along the path while moving. The simulated sensor model assumed an efficiency of 0.3, collection time of 1 second. Various weighting schemes were tested and compared. Quantitative evaluations often favored exploitation-heavy weighting schemes where μ was emphasized, with the Root Mean Squared Error (RMSE) quickly tending towards 2, whereas qualitative comparisons would favor exploration-biased schemes with greater weight on σ. The difference comes from operators often favoring knowing the general location of a source, rather than the exact properties of a source. Weighting of the path-length π often reduced the quality of the regression as less exploration occurred, however this may be deemed a worthwhile trade-off under certain circumstances, such as with sensitive robots. Successfully developed a methodology for informative path-planning for a robot to efficiently gather information and create a map of radiation. In the future, we would like to focus on: Hardware trials with integration of the robot platform and the IPP software; More refined sensor and environmental modeling; Multiple robot platforms.
This report details the development and evaluation of a Mid-Infrared (Mid-IR) Unmanned Aerial Vehicle (UAV)-based sensing platform integrated with deep learning algorithms for the identification and quantification of gaseous emissions in gas flares. The project, spearheaded by Omega Optics, Inc., aimed to address environmental monitoring challenges by leveraging advanced photonic technologies and autonomous UAV operations. The research focused on designing, optimizing, and fabricating photonic crystal waveguides and grating couplers to enhance the sensitivity and accuracy of gas detection. A comprehensive drone-based system was developed, featuring a miniaturized sensor, GPS module, and microcontroller communication network for real-time gas concentration monitoring. The system's adaptive sampling algorithm, implemented using the Robot Operating System (ROS), enables autonomous detection and localization of gas emission sources. Preliminary results demonstrate the platform's capability to detect and monitor gas emissions with high precision, cost-effectiveness, and scalability. Future work will expand upon this foundation by introducing 3D wind model-based learning for dynamic environmental conditions and further enhancing the user interface and data processing algorithms to support broader environmental monitoring applications. Overall, this project represents a significant step forward in UAV-based environmental sensing technologies, offering robust solutions for detecting and mitigating the impacts of gaseous emissions on public health and safety.
When characterizing facilities, advanced autonomous systems are safe, efficient, and cost-effective tools, which can safely deploy state-of-the-art instrumentation without exposing workers to radiation risks. One main focus of the research is the visual mapping of the environment.This paper presents a framework for the mapping aspect that utilizes lidar and SLAM technologies coupled with a monocular camera to create a point cloud of the environment. Upon completion, the present research work aims to provide an autonomous mobile robot the capability to localize itself and aid the user with visualizing the radiation data. Challenges: C++ node needs to properly synchronize image and point cloud data. 3D lidar has resolution of ± 3 cm. Proper camera calibration needed. Transforms need to be precise for proper alignment of image and point-cloud. Results: Voxelated point clouds. Accurate colors from calibrated cameras including details smaller than lidar resolution. Developed Robotics Operating System (ROS) package for ease of transfer to other robot platforms.
The radkit software suite (python) consists of three primary libraries: stark, trajan, and curie. The trajan library provides the tools to analyze and manipulate data from lidar and inertial measurement unit (IMU) devices as well as trajectories from algorithms such as simultaneous localization and mapping (SLAM). These components allow reading and writing standard data formats, performing rigid affine transformations, discretizing three-dimensional space, and visualizing data products. The curie library comprises a standard set of object-oriented tools for radiation data and analysis in the following modules: (1) listmode and binmode data classes with methods for manipulation, plotting, slicing and file IO; (2) radiological/nuclear source detection/identification analysis results; (3) source encounters of correlated analyses and (4) energy-dependent angular detector response functions. The stark package provides low-level tools that are leveraged by both curie and trajan. The tools are flexible for offline analysis as well as performant for real-time integrations. The radkit libraries have associated Robot Operating System packages for use in real-time and robotic systems.
Robot Operating System (ROS) has received widespread utilization with the development of robotics, self-driving, etc., recently. Meanwhile, the other technology blockchain is frequently applied to various fields with its trustworthy characteristics and immutability in data storage. However, ROS has no ability to interact with the blockchain, which hinders research in related fields. Therefore, we wonder if we can develop a convenient tool to bridge ROS and blockchain. Inspired by this, we propose ROS-Ethereum. It bridges ROS and Ethereum, a widely used blockchain platform. ROS-Ethereum is based on the User Datagram Protocol (UDP) communication mechanism and the SM algorithm family along with Ethereum technology. Simply put, ROS-Ethereum allows users to invoke the contract when interacting with the blockchain, which makes this process easier and safer. We conduct experiments in real robots to verify the effectiveness of ROS-Ethereum and evaluate it from the following metrics: (1) the encryption efficiency and stability of the algorithm and (2) ROS-Ethereum transaction response time and packet loss rate.
ROSSTEP is a system for sequentially running roslaunch, rosnode, and bash scripts automatically, for use in Robot Operating System (ROS) applications. The system consists of YAML files which define actions and conditions. A python file parses the code and runs actions sequentially using the sys and subprocess python modules. Between actions, it uses various ROS-based code to check conditions required to proceed, and only moves on to the next action when all the necessary conditions have been met. Included is rosstep-creator, a QT application designed to create the YAML files required for ROSSTEP. It has a nearly one-to-one mapping from interface elements to YAML output, and serves as a convenient GUI for working with the ROSSTEP system.
ROSSTEP is a system for sequentially running roslaunch, rosnode, and bash scripts automatically, for use in Robot Operating System (ROS) applications. The system consists of YAML files which define actions and conditions. A python file parses the code and runs actions sequentially using the sys and subprocess python modules. Between actions, it uses various ROS-based code to check conditions required to proceed, and only moves on to the next action when all the necessary conditions have been met. Included is rosstep-creator, a QT application designed to create the YAML files required for ROSSTEP. It has a nearly one-to-one mapping from interface elements to YAML output, and serves as a convenient GUI for working with the ROSSTEP system.
Structural members come across with various internal defects that cannot be evaluated visually. Instead, hand-held nondestructive sensors are used to detect such defects. In many situations, the hand-held NDT is not possible in high-risk structures because of limited access or safety issues. Therefore, Robotic NDT plays major role in assessing such structures. Robot Operating Systems (ROS) is a powerful open source tool, which is used to program and control robots and other devices enabling one to use sensors, devices and new functionalities such as autonomous navigation, visual perception. For the research presented, ROS is used to program the Sawyer robot arm manufactured by Rethink Robotics. The control system for the robot ensures the ability to adapt to different weights of integrated measuring devices and measured force applied against the wall with a wheeled measuring device while making a remote sweep. Twelve reinforced concrete (RC) beams built with characterized defects are evaluated with the robotic arm integrated with the measuring devices. The RC beams are characterized by voids, corrosion and debonding problems of rebars. The Impact Echo and Ground Penetrating Radar (GPR) devices attached to the robot arm are used to measure the material properties of the concrete beams. The robot arm ensures consistency and uniformity of measurement even in obscure locations. Infrared cameras are used to obtain 3D images of the surfaces of the concrete structures. Roughness is analyzed using computer vision techniques prior to the use of other sensors that are in touch with the surfaces. The computer vision is also used to handle the images collected from GPR sensor. Hand-held NDE is also performed to verify the results obtained by robotic examination. (authors)
The Department of Energy (DOE) nuclear complex includes many hazardous and challenging environments that must be inspected remotely and routinely for structural integrity evaluation and long-term planning purposes. The H-Canyon Air Exhaust (HCAEX) Tunnel biannual inspection is an example of such an environment. Presently inspections are performed by teleoperated robotic crawlers provide low resolution video feedback to the structural engineers. Advanced sensors such as Lidar and panospheric hi-res cameras have the potential to provide additional valuable data in future inspections. UT-Austin Lidar work in support of an H-Canyon deployment began with the DOE EM sponsored H-Canyon Integrated Research Project. The R and DE Robotic Sensor intern team includes two of the UT-Austin Masters students working on Lidar development to facilitate the pulling of university developed solutions to the field. The goal of this project is to develop a suite of sensors that could be used to gather advanced data in future HCAEX tunnel inspections. Of particular interest is the ability to map the tunnel walls at an accuracy that will allow for the comparison of two scans performed at different time periods to estimate the concrete erosion rate. Additionally, the development of the 3D point cloud in the GPS denied environment is the first step in being able to collect and overlay other 3D data such as radiation mapping. Project specific goals include: - Design and develop 3D mapping sensor suite. Merge Lidar point cloud with high res camera images Incorporate Inertial Measurement Unit (IMU) to assist with positioning. - Develop sensor software and user GUI Sensor data collection and integration software User GUI for reach back system. - Test solution on crawler in tunnel test bed Use crawler base similar to H-Canyon planned crawler Design and build test bed simulating tunnel conditions. To facilitate rapid sensor integration, software coding and user GUI development, the Robot Operating System (ROS) was employed as the development platform. ROS is a set of open source software libraries and tools that assist with the building of robot applications. ROS includes drivers for many sensors, state-of-the-art algorithms, and powerful developer tools. Sensors selected for the summer intern solution included assessment as to whether they possessed ROS drivers and associated sample code. Additionally, the ROS 3D Robot Visualizer (rviz) tool has been employed.