SEARCH · Engineering Papers
Results for “Robot sensing systems”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Robotics for HVAC applications: A critical review and future perspectives
Recent advances in artificial intelligence (AI), enhanced computational capabilities, and innovations in sensors and hardware have driven the increasing development and application of robots in heating, ventilation, and air conditioning (HVAC) systems. We selected and reviewed 101 studies published between 2005 and 2025, sourced from IEEE Xplore, Scopus, Web of Science, and the ACM Digital Library. To analyze these works, we developed a five-dimensional analytical framework (morphology, sensing, navigation, task execution, and system integration), inspired by the Springer Handbook of Robotics and tailored specifically for robotic applications in HVAC. Based on the reviewed studies, six distinct tasks spanning the entire HVAC lifecycle have been identified. Among the six tasks, inspection and maintenance dominate (59 %), followed by indoor monitoring and auditing (21 %), whereas leakage detection, comfort support, and installation/retrofit remain less explored. To address the identified gaps, this review proposes future research directions including investigating robot-aware HVAC design principles, developing multimodal HVAC sensing and data fusion techniques, enhancing robot training and hardware capabilities, and expanding robotic applications beyond Maintenance and Operations (M&O). The findings from this review inform future robotics research for HVAC applications and ultimately enhance system affordability, energy efficiency, resilience or reliability, and occupant environmental comfort. Moreover, it seeks to inspire researchers to explore the intersections of robotics, computer science, building science, and HVAC engineering fostering advancements in this multidisciplinary field.
Secure THz Communication in 6G: A Two-Stage DRL Approach for IRS-Assisted NOMA
Not Available
Toward Fully Soft and Multifunctional Shape Sensing via Optical Waveguide Arrays
For soft bodies, surface deformation and pressure provide proprioceptive and exteroceptive information, including body configuration, body compliance, and external forces. We develop a sheet sensor with a fully soft sensing surface that provides surface shape reconstruction using optical waveguide arrays. The waveguides are fabricated to achieve a tunable linear response to bi‐directional bending curvature, and the waveguide arrays are configured to differentiate between ambiguous shapes. We characterize the waveguide performance, relating curvature sensitivity to the core's surface roughness. Synergy of waveguide responses reduces the number of sensing elements required and achieves damage resilience. Using waveguide sensitivity to pressure, we also demonstrate feasibility for exteroception. We demonstrate the multifunctional sensing capability by wrapping the sheet around an upper arm, showcasing joint motion and external force sensing. Integrated into or applied onto surfaces of robotic or living systems, this design can be implemented in applications such as virtual reality, teleoperation, physical therapy, and soft robotics.
Harnessing ionic complexity: A modeling approach for hierarchical ionic circuit design
Since the 1950s, soft ionic devices have evolved from individual components to an expanding library of sensors, actuators, signal transmitters, and processors. However, integrating these components into complex, multifunctional systems remains challenging due to the nonintuitive and nonlinear interactions between ionic elements. In this work, we address these fundamental challenges by developing a lumped element model that enables interrogation of the physics that governs ionic circuits, as well as rapid design and optimization. Our model captures features specific to ionic charge carriers, while preserving the hierarchical design flexibility and computational efficiency of traditional circuit modeling. We demonstrate that our model can not only fit individual device behavior but also accurately predict the behavior of larger circuits formed by combining those devices. Additionally, we show how our tool utilizes the intrinsic nonlinearities of ionic systems to enable extended functionality, revealing how factors such as ion enrichment, ion leakage, and polymer charge density influence performance. Lastly, we present a fully ionic power supply, sensor, control system, and actuator for a soft robot that adapts its motion in response to environmental salt, illustrating the tool’s potential to accelerate advancements in chemical sensing, biointerfacing, biomimetic systems, and adaptive materials.
Testing, Calibration, and UxS Integration of the Kromek GR1 Plus CZT Gamma Spectrometer
Collecting radiation measurements can be a hazardous task, especially in the presence of highly active sources. Various scenarios necessitate source search, classification, and quantification, often with limited or no a priori information. Activities such as disaster mitigation, emergency response, environmental monitoring, and site remediation may involve dangerous radioactive sources. In these situations, there is a pressing need for remote monitoring capabilities that protect human operators from potential harm and enhance adherence to the principle of “As Low as Reasonably Achievable” (ALARA) for radiation doses. The first step toward achieving remote radiation measurement capabilities is the remote operation of a radiation sensor. Once this milestone is reached, the next challenge is to integrate this remote sensing capability into suitable actuation agents, collectively referred to as uncrewed systems (UxS). These systems include familiar platforms such as robotic quadrupeds, aerial multirotor vehicles, and ground vehicles, any of which may be teleoperated, act autonomously, or utilize a combination of both. A critical factor in achieving remote radiation sensing is the availability of data from the appropriate sensor. Many commercially available radiation sensors have closed-source documentation for their communication protocols. Typical end-user products are often self-contained, handheld devices designed for manual measurement scenarios. While there are commercial off-the-shelf (COTS) integrations of radiation sensors with UxS available for purchase, these solutions are typically tailored for specific use cases and may not meet the requirements of different applications. This paper discusses efforts to remotely acquire radiation measurements from a small form-factor CZT gamma spectrometer. Sandia National Laboratories has successfully demonstrated the initial capability to integrate low size, weight, and power (SWaP) gamma spectroscopy into various UxS, alongside co-located GPS data logging and sensor calibration and qualification. With remote gamma spectroscopy achieved, the stage is set for UxS integration of this capability.
Embedded Fluidic Sensing and Control with Soft Open‐Cell Foams
Abstract The synthesis of soft matter intelligence with circuit‐driven logic has enabled a new class of robots that perform complex tasks or conform to specialized form factors in unique ways that cannot be realized through conventional designs. Translating this hybrid approach to fluidic systems, the present work addresses the need for sheet‐based circuit materials by leveraging the innate porosity of foam—a soft material—to develop pneumatic components that support digital logic, mixed‐signal control, and analog force sensing in wearables and soft robots. Analytical tools and experimental techniques developed in this work serve to elucidate compressible gas flow through porous sheets, and to inform the design of centimeter‐sized foam resistors with fluidic resistances on the order of 10 9 Pa s m −3 . When embedded inside soft robots and wearables, these resistors facilitate diverse functionalities spanning both sensing and control domains, including digital logic using textile logic gates, digital‐to‐analog signal conversion using ladder networks, and analog sensing of forces up to 40 N via compression‐induced changes in resistance. By combining features of both circuit‐based and materials‐based approaches, foam‐enabled fluidic circuits serve as a useful paradigm for future hybrid robotic architectures that fully embody the sensing and computing capabilities of soft fluidic materials.
The Second Skin: A Wearable Sensor Suite that Enables Real-Time Human Biomechanics Tracking Through Deep Learning
Objective: Real-time determination of human kinematics and kinetics could advance biomechanics research and enable valuable applications of biofeedback and generalizable exoskeleton control. Here, this work aims to investigate a taskindependent, user-independent method for obtaining precise realtime joint state estimation across lower-body joints during a wide variety of tasks. Methods: We developed a generalizable sensing approach using a suit comprised of inertial measurement units (IMUs) and pressure insoles. With the suit, we collected a dataset of 33 tasks commonly performed during construction and hazardous waste cleanup (N = 10). We then trained deep learning user-independent, task-agnostic models to estimate joint lowerbody kinematics and dynamics using only worn sensor data. We likewise computed joint kinematics and dynamics analytically from sensor data to serve as a comparison tool for model results. Results: Our models achieved overall angle estimation root-meansquared-errors (RMSE) of 6.56±.92°, 8.60±1.01°, 7.58±.89°, and 6.00±.73° compared to 13.9±.1.3°, 15.31±1.0°, 10.76±.70°, and 7.56±.48° via analytical methods at the lower back, hip, knee, and ankle, respectively. Likewise, our models achieved overall normalized moment estimation RMSEs of .207±.069 Nm/kg, .242±.044 Nm/kg, .202±.038 Nm/kg, and .193±.034 Nm/kg compared to .306±.036 Nm/kg, .407±.021 Nm/kg, 1.18 ±.022 Nm/kg, and 1.73±.071 Nm/kg via analytical methods at the lower back, hip, knee, and ankle, respectively. Conclusion: These results are comparable to other state-of-the-art wearable sensing systems, establishing deep learning as a viable sensing approach that generalizes to new users and tasks. Significance: This work shows promise for enabling accurate real-world biomechanical data collection and enhancement of biofeedback systems and wearable robot control.
Mid-IR UAV-based sensing platform with deep learning to Identify and Quantify Gaseous Emission in Gas Flares
This report details the development and evaluation of a Mid-Infrared (Mid-IR) Unmanned Aerial Vehicle (UAV)-based sensing platform integrated with deep learning algorithms for the identification and quantification of gaseous emissions in gas flares. The project, spearheaded by Omega Optics, Inc., aimed to address environmental monitoring challenges by leveraging advanced photonic technologies and autonomous UAV operations. The research focused on designing, optimizing, and fabricating photonic crystal waveguides and grating couplers to enhance the sensitivity and accuracy of gas detection. A comprehensive drone-based system was developed, featuring a miniaturized sensor, GPS module, and microcontroller communication network for real-time gas concentration monitoring. The system's adaptive sampling algorithm, implemented using the Robot Operating System (ROS), enables autonomous detection and localization of gas emission sources. Preliminary results demonstrate the platform's capability to detect and monitor gas emissions with high precision, cost-effectiveness, and scalability. Future work will expand upon this foundation by introducing 3D wind model-based learning for dynamic environmental conditions and further enhancing the user interface and data processing algorithms to support broader environmental monitoring applications. Overall, this project represents a significant step forward in UAV-based environmental sensing technologies, offering robust solutions for detecting and mitigating the impacts of gaseous emissions on public health and safety.
Lab-Scale Cable-Driven Parallel Robot Prototype for Automated Prefabricated Component Manipulation
This paper presents the design and evaluation of a lab-scale cable-driven parallel robot (CDPR) developed as a flexible platform for automated installation of prefabricated components onto exterior building envelopes. Traditional manual installation methods for prefabricated components, which depend on scaffolding, cranes, cherry pickers, and verbal coordination, are not only labor-intensive and error-prone but also face significant limitations in dense urban environments due to site access constraints. To address these challenges, we developed a lab-scale CDPR platform capable of autonomously transporting building envelope components from a designated pickup zone to their target installation location, minimizing the need for human intervention. This study describes the system’s mechanical design, actuation architecture, real-time feedback system, and control strategy of the CDPR, and evaluates its performance in a laboratory environment. The robot’s actuation system uses torque control for end-effector manipulation. The robot’s real-time pose feedback comes from a construction-grade total station and a wireless inertial measurement unit (IMU), which together support precise end-effector control. Experimental results demonstrate the successful integration of the hardware, sensing, state estimation, and control subsystems. Preliminary tests showed that our lab-scale prototype can position the end effector with an error of less than 3 mm, which is a level of precision not previously achieved by existing CDPRs in construction applications. The key findings are twofold: (1) torque-only control is necessary but not sufficient for minimizing final pose error, and (2) incorporating real-time pose feedback can achieve the desired placement accuracy.
CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees
This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.
Using Fiducial Markers for Pose Estimation of an OSWEC in a Wave Tank: Preprint
In this study, we consider a novel method of sensing the motion of a wave energy converter during testing in a wave flume under the influence of incoming waves. The wave energy converter considered in our research is an oscillating surge wave energy converter, which is a hinged paddle that responds to incoming waves. Motion sensing is normally done with inertial sensors, which can hinder the motion due to suspended cables that carry power and transmit signals. Our proposed method is contactless and can be implemented economically. A camera is used to record different marker patterns affixed to the moving paddle and the motion deduced by pose estimation algorithms. Fiducial markers are commonly used for robot localization and in augmented reality. There are many types of fiducial markers, including ArUco-type markers which are accurate, fast and robust. The system consists of markers attached to the paddle element and recorded using a machine vision camera. A pose estimation algorithm is then applied to the detected markers to estimate the tilt of the paddle. In this work, we examine the challenges of image acquisition and calibration for underwater targets, compare the motion obtained by this new system with a calibrated tilt sensor and identify areas where the new system may be superior.
Ion‐Specific Interactions Engender Dynamic and Tailorable Properties in Biomimetic Cationic Polyelectrolytes
Abstract Biomaterials such as spider silk and mussel byssi are fabricated by the dynamic manipulation of intra‐ and intermolecular biopolymer interactions. Organisms modulate solution parameters, such as pH and ion co‐solute concentration, to effect these processes. These biofabrication schemes provide a conceptual framework to develop new dynamic and responsive abiotic soft material systems. Towards these ends, the chemical diversity of readily available ionic compounds offers a broad palette to manipulate the physicochemical properties of polyelectrolytes via ion‐specific interactions. In this study, we show for the first time that the ion‐specific interactions of biomimetic polyelectrolytes engenders a variety of phase separation behaviors, creating dynamic thermal‐ and ion‐responsive soft matter that exhibits a spectrum of physical properties, spanning viscous fluids to viscoelastic and viscoplastic solids. These ion‐dependent characteristics are further rendered general by the merger of lysine and phenylalanine into a single, amphiphilic vinyl monomer. The unprecedented breadth, precision, and dynamicity in the reported ion‐dependent phase behaviors thus introduce a broad array of opportunities for the future development of responsive soft matter; properties that are poised to drive developments in critical areas such as chemical sensing, soft robotics, and additive manufacturing.
Autonomous Coupler Alignment Using Position-Based Visual Servoing in a ROS 2 Framework
As robotic arms are becoming increasingly common alongside humans as collaborative robots, their high precision in motion enables tasks to be performed at significantly higher speeds with reduced disruption in the environment. The Fermi National Accelerator Laboratory is exploring this application by incorporating a UR16e from Universal Robots in a cleanroom setting during assembly of couplers to superconducting radio frequency cavities as part of the PIP-II project. The goal of the robotic assembly process is to precisely position the UR16e robot so that the coupler flange, mounted on the robot’s end-effector, is accurately aligned with and pressed against the cavity flange, requiring only final fastening by a lab technician. This thesis builds upon an initial system in which the robotic process was limited to the alignment phase using position-based visual servoing with an eye-in-hand camera to only align the coupler to the cavity with an offset distance. The objective of this thesis is to further advance autonomous robotic assembly by extending the process. To this end, the entire software framework was reconstructed, as the previous development environment posed significant challenges in modifying the software and adapting to hardware changes. The main contributions of this thesis are as follows: (i) a modular and scalable software framework based on ROS~2 was developed to facilitate performance expansion and interchangeability of software and hardware components; (ii) the desired alignment position for position-based visual servoing was parameterized to enable flexible configuration; and (iii) a methodology was developed to close the offset distance between the coupler and cavity utilizing the internal force-torque sensing capability of the UR16e, as visual feedback is not available during the offset-closing phase. The proposed autonomous robotic assembly reduces assembly time and technician involvement, thereby minimizing the risk of airborne particulate contamination, which is essential in the cleanroom setting. Moreover, the ROS~2-based framework provides a foundation for further expansion and continued advancement of robotic automation in Fermilab.
Surface Energy Modulated Self‐Assembly of Percolative Gallium Nanodroplet Films for Stretchable Electronics
Advancements in soft robotics and wearable technologies have led to an increased need for flexible and stretchable electronic systems. Liquid metals like Gallium (Ga) and its alloys offer high potential in the field of stretchable electronics and photonics due to their inherent high conductivity and malleability. However, their high surface tension and native oxide formation hinder uniform wetting and continuous film formation to get conducting films. Here, we report a fabrication strategy to realize electrically conductive Ga thin films with effective thicknesses around 100 nm on polymeric and elastomeric substrates. By enhancing the surface energy of the elastomer, we create uniform Ga nanodroplets capable of sustaining stretchability up to 200% strain. Our devices exhibit electronic conduction primarily through tunneling and display strain tunable piezoresistive characteristics, which are explained using Kirchhoff's resistive network and Simmon's analytical tunneling current model. To showcase the device's capability in fields of stretchable electronics, we demonstrate several functional prototypes, including flexible devices integrated with Light Emitting Diodes (LEDs), curvature and pressure sensors, and soft robotic grippers capable of sensing object curvature. The demonstrated devices highlight the potential of this approach for scalable integration of stretchable electronics in soft robotic and wearable platforms.
Autonomous phototaxis of hydrogel swimmers
The design of synthetic soft matter capable of emulating the complex behaviors of living organisms, such as sensing and adapting to their environment, remains an important challenge in developing biomimetic materials. Functionalized hydrogels are ideal candidates for such materials since they are highly responsive to their environment and can be operated in water. In this work, we investigate a hybrid bonding hydrogel composed of peptide amphiphile supramolecular nanofibers covalently attached to a photoresponsive network, in which high-aspect-ratio ferromagnetic nanowires are aligned along the length of the sample, designed to swim under oscillating magnetic fields. This hybrid hydrogel swimmer can autonomously swim toward a light source by utilizing photoinduced interactions between supramolecular and covalent networks reminiscent of phototactic swimming in living systems. Using a combination of experimental techniques and a continuum model incorporating photochemistry, magnetoelasticity, and hydrodynamics, we explain the swimming mechanism and predict phototactic behavior. Our work highlights the potential role of hybrid bonding polymers, which leverage the interplay between supramolecular assemblies and covalent networks. We demonstrate how these polymers can be tailored to react dynamically to their environment, paving the way for developing intelligent and autonomous robotic systems.
Dynamic Interfacial Design in Adaptive Hybrid Materials Enables Reversible and Tunable Mechano-Optic Smart Responses
Next-generation polymeric materials are shifting toward adaptive and interactive behaviors of living systems; however, designing materials that can reversibly modulate optical properties under mechanical deformation while maintaining mechanical robustness remains a key challenge. Here, we report a mechanically robust vitrimer-based adaptive hybrid material (AHM) that exhibits a stretch-induced reversible transparency-to-opacity transition, enabled by the integration of dynamic interactions at the polymer–silica nanoparticle interface and controlled nanoparticle self-assembly. The AHM combines boronic ester–functionalized polystyrene-b-poly(ethylene-co-butylene)-b-polystyrene (S-Bpin) with diol-functionalized silica nanoparticles (diol-SiNPs) to form a hybrid network hosting both dynamic boronic ester and hydrogen-bonding interactions. These reversible linkages facilitate controlled nanoparticle self-assembly and enable strain-induced nanoparticle alignment/aggregation. Upon stretching, SiNP-rich domains align and aggregate within the polymer matrix, while local modulus mismatch between stiff aggregated SiNP/borylated-styrene-rich regions and the softer elastomeric midblock induces surface microwrinkle formation. These internal aggregates and surface wrinkles cooperatively enhance light scattering, producing the opaque state under strain. Furthermore, the tailored AHM exhibits high toughness, thermomechanical stability, reprocessability, and programmable shape-memory behavior. This work presents a dynamic interfacial design strategy for mechanically robust, optically reconfigurable, and reusable soft materials for adaptive optics, smart windows, sensing, soft robotics, and circular smart-material platforms.