SEARCH · Engineering Papers

Results for “cooperative perception”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Bringing Different Views Together: A Hybrid Cooperative Perception Framework for Connected Autonomous Vehicles

Cooperative perception will be essential for connected autonomous vehicles to enhance object recognition and optimize path planning by sending data information about the surrounding environment. However, an inherent challenge in existing systems is the high bandwidth cost of transmitting information in real-time, which restricts cooperative perception’s practicality. Here, this work presents a hybrid cooperative perception fusion framework aimed at mitigating this issue by optimizing data transmission according to available bandwidth or through data reduction techniques. Our methods ensure that vehicles can rapidly transmit high-confidence data without overwhelming the network. Experimental results indicate that our methodology substantially diminishes data transmission sizes while maintaining object detection accuracy. For cooperative perception in autonomous vehicle systems, our approach provides a scalable and effective way to get past the bandwidth barrier.

Carrillo, Dominic [Univ. of North Texas, Denton, T↗

DOE OSTI2024

Infrastructure-Based Cooperative Perception at a Traffic Intersection: Overview and Challenges: Preprint

Recent advancement in autonomous driving vehicles and V2X communication has attracted increasing attention towards Intelligent Transportation Systems to build a safe and reliable traffic intersection. However, most of the systems are still at the initial stages and require significant progress to become a reality. This paper presents an overview of NREL Infrastructure Perception and Control (IPC) framework which is an open-source track-data fusion engine which takes input from infrastructure-based perception sensors and cooperatively shared messages from Connected Autonomous Vehicles (CAVs) and Connected Vehicle (CVs) and the challenges associated with deploying such cooperative perception framework at a four-way traffic intersection in the city of Colorado Springs, CO, USA. The sensor data is collected by deploying two radars and two LiDAR sensors on the IPC mobile lab and two radars on diagonally opposite traffic poles at the proposed intersection. The sensor output results imply the need for rapid sensor calibration to bring the collective perception to a common coordinate frame, the importance of time synchronization between the sensors in order to capture accurate spatial and temporal alignment of the objects, and the need for a health monitoring system with fail safe closed-loop detection model for real-time deployment.

camera↗

DOE OSTI2025

Infrastructure-Based Cooperative Perception at a Traffic Intersection: Overview and Challenges

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. About one-quarter of traffic fatalities and about one-half of all traffic injuries in the United States happen at traffic intersections . Effective management of these intersections is important to ensure safety and efficiency of all users - vehicles, pedestrians, cyclists, and vulnerable road users (VRUs). With advancements in sensor perception technologies such as radar, light detection and ranging (lidar), and cameras, traffic intersections are developing into dynamic and data-rich environments. By using these data to create a real-time digital twin, we can enable real-time data-driven decision making and a range of applications such as sharing perception information to connected vehicles (CVs) and connected autonomous vehicles (CAVs), safety affirmative signaling, and curb optimizing to improve efficiency and enhance safety.This paper presents an overview of the concept and examines the challenges involved in implementing an infrastructure-based cooperative perception engine at a traffic intersection. In addition to outlining the physical components, this study also addresses important challenges involved in a multi-sensor system. We present results from deploying the National Renewable Energy Laboratory's (NREL's) Infrastructure Perception and Control (IPC) mobile trailer at a traffic intersection in the city of Colorado Springs, Colorado, USA that employed multiple radars and lidars to capture the data. This study provides necessary practical learning for the Cooperative Driving Automation (CDA) and traffic engineering communities for next-generation infrastructure-based cooperative perception that promises improvements in signal control for optimized traffic flow, among other applications, and documents findings for ongoing research and development efforts in other areas.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

DOE OSTI2025

The Sensor Dilemma in Intelligent Transportation Systems: Evaluating Radar, Lidar and Camera: Preprint

Intelligent transportation systems (ITS) are at the forefront in advancing the way we interact with and perceive the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as radar, lidar, and video imaging, which are the most popular modalities for ITS. Real-time perception data from these sensors allow intelligent infrastructure-side decision-making to improve the energy, efficiency, and safety at traffic intersections. As traffic departments across the United States transition from traditional loop detectors and emulators and embrace newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception that is reliable, inexpensive, and easy to set up and that has robust performance in varying weather conditions. However, choosing a sensor that checks all these boxes is not straightforward, as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long-range vehicles and weather resistance but lacks high resolution. Lidar is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines radar, lidar, and camera sensor capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like radar, lidar, and cameras offers the most robust solution for enhancing the safety and efficiency of ITS. Through this evaluation, we hope to draw attention to the necessity of the National Renewable Energy Laboratory's infrastructure perception and control framework, which presents a multisensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2025

The Sensor Dilemma in Intelligent Transportation Systems

Intelligent Transportation Systems (ITS) are at the forefront in advancing the way we interact and perceive with the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as Radar, LiDAR and Video Imaging which are the most popular modalities for ITS. Real-time perception data from these sensors allows intelligent infrastructure side decision making to improve the energy, efficiency and safety at traffic intersections. As traffic departments across the United States are transitioning from traditional loop detectors / emulators and embracing newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception which is reliable, inexpensive, easy to setup and has robust performance in varying weather conditions. However, choosing a sensor which checks all boxes is not straightforward as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long range vehicles and weather resistance but lacks high resolution. LiDAR is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines Radar, LiDAR and camera sensors capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. Through this evaluation, we hope to draw attention to the necessity of National Renewable Energy Laboratory's (NREL) Infrastructure Perception and Control (IPC) framework which presents a multi-sensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like Radar, LiDAR and cameras, offers the most robust solution for enhancing the safety and efficiency in intelligent transportation systems.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2025

Descriptor: Infrastructure Perception and Control: Multi-Sensor Object Tracking Dataset (IPC-MSOT)

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. Traffic accidents often occur at traffic intersections, including a large proportion of traffic fatalities and about one-half of all traffic injuries in the United States. Object detection data were collected in 2024 across three intersections in Colorado Springs, CO, USA, over the course of multiple days and various times to induce a heterogeneous mix of traffic conditions and behaviors. The purpose of the data collection exercises was to learn various attributes about infrastructure sensors and to build a repository of high-resolution, object-level data that can be used for research and development (e.g., to develop multisensor data fusion algorithms). The Infrastructure Perception and Control:Multi-Sensor Object tracking (IPC-MSOT) dataset was collected as part of the U.S. Department of Transportation's Strengthening Mobility and Revolutionizing Transportation (SMART) project, where the city of Colorado Springs, Colorado, and the National Renewable Energy Laboratory collaborated to collect object-level trajectory data from road users using multiple types of infrastructure sensors deployed at different intersections. This dataset allows for testing of late-stage sensor fusion algorithms and their ability to ingest multimodal sensor data, and it can be utilized by traffic engineers to design and evaluate trajectory-based signal control strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS1992

Cooperative intelligent robotics in space III; Proceedings of the Meeting, Boston, MA, Nov. 16-18, 1992

The present volume on cooperative intelligent robotics in space discusses sensing and perception, Space Station Freedom robotics, cooperative human/intelligent robot teams, and intelligent space robotics. Attention is given to space robotics reasoning and control, ground-based space applications, intelligent space robotics architectures, free-flying orbital space robotics, and cooperative intelligent robotics in space exploration. Topics addressed include proportional proximity sensing for telerobots using coherent lasar radar, ground operation of the mobile servicing system on Space Station Freedom, teleprogramming a cooperative space robotic workcell for space stations, and knowledge-based task planning for the special-purpose dextrous manipulator. Also discussed are dimensions of complexity in learning from interactive instruction, an overview of the dynamic predictive architecture for robotic assistants, recent developments at the Goddard engineering testbed, and parallel fault-tolerant robot control.

Erickson, Jon D.↗

NASA NTRS1990

Robotics technology discipline

Viewgraphs on robotics technology discipline for Space Station Freedom are presented. Topics covered include: mechanisms; sensors; systems engineering processes for integrated robotics; man/machine cooperative control; 3D-real-time machine perception; multiple arm redundancy control; manipulator control from a movable base; multi-agent reasoning; and surfacing evolution technologies.

Montemerlo, Melvin D.↗

NASA NTRS1993

Comparative measurement of visual stability in Earth and cosmic space (L-4)

The frequency and the intensity of space motion sickness was reviewed and investigated. Unusual induced-gravity situations, such as rotation, linear acceleration, parallel swinging etc. were investigated as well. Visually-induced motion sensation or distorted perception were evaluated with respect to visual stability by many investigators. These studies are all concerned with the effect of gravity and the induction of motion sickness through human visual perception. Direct investigation under the microgravity situation, such as parabolic flight, Skylab, and Spacelab, was carried out. These studies focused on how human visual stability is established through various sensory afferents in specific gravity conditions. Results from these investigations indicate that sensory mismatch probably plays an important role in space motion sickness. The interaction of visual, vestibular, and somatosensory perception is smoothly coordinated under normal gravitational conditions on the Earth in our daily life. When the cooperation is destroyed or a mismatch occurs among them, motion sickness may develop not only on the Earth but also in microgravity. The latter case may be the cause of space motion sickness or space adaption syndrome. How human beings obtain visual stability even with posture changes on the ground was investigated. Visual stability can be categorized as static or dynamic. Static visual stability is concerned with orientation and dynamic stability is concerned with object motion perception. The perception of visual stability is modified by many other sensations, such as somatosensory, vestibular, and muscle tension. We will mainly focus on modifications by vestibular inputs to visual perception produced by eye movements in microgravity. The Vestibular-Oscular Reflex (VOR) is a well-known characteristic which results from the relationship between eye mobility and vestibular afferent inputs. Eye movements also modify dynamic visual perception, such as perceived object motion velocity. The VOR is constantly simulated under 1-g conditions on Earth. In fact, human beings have been habituated and 'programmed' for orientation (visual stability) in their everyday, 1-g environment. When humans are exposed to a different gravity situation, this programmed behavior must change; that is, it is reprogrammed. This is called habituation or familiarization. We hope to examine how object motion perception is perturbed and subsequently adapted in the microgravity environment. This experiment is focused on the cooperation of visual, vestibular, and somatosensory perception coordination and how it is changed or reduced in space compared to 1-g environment. We will obtain information on the coordination between eye movement and neck muscle activity by using EOG and EMG. We will also collect data from Payload Specialists using a self-diagnostic questionnaire concerned with perceptual abnormality. When each sensory input function and its integration in the higher nervous system are well-characterized, then more effective techniques to control SAS may be developed.

Koga, Kazugo↗

NASA NTRSDate not supplied

Design of Space Systems to Enable In-space Assembly and Servicing

For several decades, NASA has employed in-space systems to enhance the performance and extend the useful life of operational orbital assets. In at least one case, an operational mission was not only enhanced, but enabled – the International Space Station was made possible by crewed and robotic in-space assembly, and continues to support installation and operation of new science and technology payloads. In several cases (Hubble Space Telescope, Intelsat 401, Westar and Palapa), major operational assets were rescued or repaired soon after launch when otherwise mission-ending anomalies occurred or were detected. In addition to the original rescue, Hubble was upgraded four times, enabling high-demand, world class science over four decades. More recently, two Northrop Grumman Mission Extension Vehicles have captured two Intelsat spacecraft near the end of their life and fuel capacity, to take over maneuvering duties. In spite of these recent operational achievements, and with the exception of large human exploration vehicles and large space telescopes, space architects rarely consider in-orbit servicing and assembly capabilities in their future planning. Technologies such as multi-launch mission architectures (and rendezvous and proximity operations systems), docking systems, external robotics, advanced tools, modular systems and structures, and fluid transfer systems are available today to support these missions. In-space manufacturing will soon be operational to enable resilient missions that recover from on-orbit failures, and expand the utilization of space. We envision a future that includes these capabilities, and discuss the cultural, engineering, and technological challenges to achieving this vision. We discuss the vision, the proverbial chicken and the egg (which came first, the serviceable spacecraft or the servicer?), the cost, risk, and perceptions thereof of in-space operations, a “spectrum” of cooperative servicing design considerations, and the current status of the space industry’s slow but steady march to widespread operational use of on-orbit servicing, assembly, and manufacturing.

Bo Naasz↗

NASA NTRS1994

Extended cooperative control synthesis

This paper reports on research for extending the Cooperative Control Synthesis methodology to include a more accurate modeling of the pilot's controller dynamics. Cooperative Control Synthesis (CCS) is a methodology that addresses the problem of how to design control laws for piloted, high-order, multivariate systems and/or non-conventional dynamic configurations in the absence of flying qualities specifications. This is accomplished by emphasizing the parallel structure inherent in any pilot-controlled, augmented vehicle. The original CCS methodology is extended to include the Modified Optimal Control Model (MOCM), which is based upon the optimal control model of the human operator developed by Kleinman, Baron, and Levison in 1970. This model provides a modeling of the pilot's compensation dynamics that is more accurate than the simplified pilot dynamic representation currently in the CCS methodology. Inclusion of the MOCM into the CCS also enables the modeling of pilot-observation perception thresholds and pilot-observation attention allocation affects. This Extended Cooperative Control Synthesis (ECCS) allows for the direct calculation of pilot and system open- and closed-loop transfer functions in pole/zero form and is readily implemented in current software capable of analysis and design for dynamic systems. Example results based upon synthesizing an augmentation control law for an acceleration command system in a compensatory tracking task using the ECCS are compared with a similar synthesis performed by using the original CCS methodology. The ECCS is shown to provide augmentation control laws that yield more favorable, predicted closed-loop flying qualities and tracking performance than those synthesized using the original CCS methodology.

Davidson, John B.↗

NASA NTRS2020

Assemblers: A Modular, Reconfigurable Manipulator for Autonomous in-Space Assembly

This paper presents a modular, reconfigurable robotic manipulator for autonomous in-space assembly. On-orbit and planetary surface assembly is a challenging domain that encompasses various technological thrusts to support human exploration, science, and technology demonstration missions. The system architecture presented here addresses the need for robotic assembly of structures in locations that prohibit constant human oversight and/or teleoperation. This system is capable of scheduling, reconfiguring itself, and executing structural assembly tasks with the ability to assess construction and correct errors during the assembly as needed. An example concept of operations is presented. Details of the mechanical and electrical design of the robotic modules as well as the dynamic modeling approach, control algorithms, and sensing and perception systems are also provided.

robotics↗

DOE OSTI2024

Safe Operations at Roadway Junctions: Intelligent Roadway Infrastructure as Functional Interlocking

Automated vehicle (AV) technology is quickly maturing, and the corresponding infrastructure systems that evaluate traffic and communicate to vehicles requires sophisticated sensing and perception technologies, referred to as intelligent roadway infrastructure (IRI), to complement emerging AV capabilities. IRI provides signals to vehicles, indicating right-of-way for vehicles and communicating to approaching AVs that no other vehicle is failing to yield. This capability, denoted as safety-affirmative signaling, provides a green light or a green arrow as appropriate and affirms through communication links to connected vehicles when it is safe to proceed. About 36% of collisions occur at intersections, with most occurring upon left turns (22.2%) or crossing over (12.6%), and only a small percentage (1.2%) while turning right at an intersection. Of all intersection crashes about half (52.5%) of those vehicles were traveling through a signalized intersection 2. Safety-affirmative signaling would guarantee safety of AV fleet vehicles, by providing the interlocking principle, a term from automated train control that only allows progression through a railway intersection after affirming no opportunity for a crash exists. IRI through safety-affirmative signaling would bring performance and safety to complex roadway intersections where AV transit fleet service is most needed, as well as safety benefits to traditional, non-automated vehicles and vulnerable road users. The implementation of IRI has functional, programmatic, and technical challenges. Research work performed at the National Renewable Energy Laboratory (NREL) in an integrative approach encapsulating these themes, and termed infrastructure perception and control (IPC) is motivated by improved performance (travel time), improved safety (reduced collisions), and improved energy efficiency (less fuel burned and minimized production of greenhouse gases). IPC is intended not only for roadway and intersection applications but also in extension to inform complementary buildings and grid systems to enable better co-management, as vehicles and their charging needs become increasingly integrated into the built environment. The NREL IPC project presents an open-source framework, architecture, and supporting technology to implement IRI, addressing critical issues such as fusion of data, reliability, standardization of data interfaces, and confidence of detection. The framework is informed by previous experience in U.S. Department of Defense research technology, specifically in the use of radar to detect, identify, and track aerial threats. These principles combined with multi-sensor fusion provides for a complete digital twin with known and measurable confidence and accuracy from which safety-affirmative signaling can be developed and deployed.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

NASA NTRS2002

The Summer Robotic Autonomy Course

We offered a first Robotic Autonomy course this summer, located at NASA/Ames' new NASA Research Park, for approximately 30 high school students. In this 7-week course, students worked in ten teams to build then program advanced autonomous robots capable of visual processing and high-speed wireless communication. The course made use of challenge-based curricula, culminating each week with a Wednesday Challenge Day and a Friday Exhibition and Contest Day. Robotic Autonomy provided a comprehensive grounding in elementary robotics, including basic electronics, electronics evaluation, microprocessor programming, real-time control, and robot mechanics and kinematics. Our course then continued the educational process by introducing higher-level perception, action and autonomy topics, including teleoperation, visual servoing, intelligent scheduling and planning and cooperative problem-solving. We were able to deliver such a comprehensive, high-level education in robotic autonomy for two reasons. First, the content resulted from close collaboration between the CMU Robotics Institute and researchers in the Information Sciences and Technology Directorate and various education program/project managers at NASA/Ames. This collaboration produced not only educational content, but will also be focal to the conduct of formative and summative evaluations of the course for further refinement. Second, CMU rapid prototyping skills as well as the PI's low-overhead perception and locomotion research projects enabled design and delivery of affordable robot kits with unprecedented sensory- locomotory capability. Each Trikebot robot was capable of both indoor locomotion and high-speed outdoor motion and was equipped with a high-speed vision system coupled to a low-cost pan/tilt head. As planned, follow the completion of Robotic Autonomy, each student took home an autonomous, competent robot. This robot is the student's to keep, as she explores robotics with an extremely capable tool in the midst of a new community for roboticists. CMU provided undergraduate course credit for this official course, 16-162U, for 13 students, with all other students receiving course credit from National Hispanic University.

Nourbakhsh, Illah R.↗

NASA NTRS2001

The Conference Proceedings of the 2001 Air Transport Research Society (ATRS) of the WCTR Society

The ATRS held its 5th Annual conference at the City University of Hong Kong Campus in July 2001. The conference was a success with nearly 140 participants including 70 presenters. Titles that comprise Volume 2 include: Intelligent Airport Gate Assignment System; A Study on the Effects of the Personality Compatibility to the Job Performance; ITS/CVO Application for Air cargo Transportation in Korea; An Airport as a Logistics and Economic Hub: The Case of Incheon International Airport; The Impact Of Aviation Safety over the Consumer's Behavior; The Integration of China and Taiwan Air Networks for Direct Air Cargo Services; Quality perception and carrier choice in Civil Aviation; Future Trends in Business Travel Decision Making; Cooperation Among German Airports in Europe; Inbound and Outbound Air Passenger Traffic Forecasting between the United States and Selected Asian countries; An Evaluation of Alternative Facilities for Airport Redevelopment using Fuzzy Linguistic Approach; Economic Analysis of Airline Alliances; The Aviation Cooperation between the two Koreas Preparing for the Reunification of the Peninsula; and A Study on the Air Transport Cooperation in Northeast Asia between China, Japan and Korea.

Lee, Yeong-Heok↗

NASA NTRS1984

Marketing the use of the space environment for the processing of biological and pharmaceutical materials

The perceptions of U.S. biotechnology and pharmaceutical companies concerning the potential use of the space environment for the processing of biological substances was examined. Physical phenomena that may be important in space-base processing of biological materials are identified and discussed in the context of past and current experiment programs. The capabilities of NASA to support future research and development, and to engage in cooperative risk sharing programs with industry are discussed. Meetings were held with several biotechnology and pharmaceutical companies to provide data for an analysis of the attitudes and perceptions of these industries toward the use of the space environment. Recommendations are made for actions that might be taken by NASA to facilitate the marketing of the use of the space environment, and in particular the Space Shuttle, to the biotechnology and pharmaceutical industries.

Source record↗

NASA NTRS1992

A new neural net approach to robot 3D perception and visuo-motor coordination

A novel neural network approach to robot hand-eye coordination is presented. The approach provides a true sense of visual error servoing, redundant arm configuration control for collision avoidance, and invariant visuo-motor learning under gazing control. A 3-D perception network is introduced to represent the robot internal 3-D metric space in which visual error servoing and arm configuration control are performed. The arm kinematic network performs the bidirectional association between 3-D space arm configurations and joint angles, and enforces the legitimate arm configurations. The arm kinematic net is structured by a radial-based competitive and cooperative network with hierarchical self-organizing learning. The main goal of the present work is to demonstrate that the neural net representation of the robot 3-D perception net serves as an important intermediate functional block connecting robot eyes and arms.

Lee, Sukhan↗

NASA NTRS1984

On the measurement of pilot perceptual workload - A comparison of assessment techniques addressing sensitivity and intrusion issues

A flight simulator-based study was conducted to examine fourteen distinct mental workload estimation measures, including opinion, secondary task, physiological, and primary task measures. Both the relative sensitivity of the measures to changes in mental workload and the differential intrusion of the changes on primary task performance were assessed. The flight task was varied in difficulty by manipulation of the presentation rate and complexity of a hazard-perception task that required each of 48 licensed pilots to rely heavily on their perceptual abilities. Three rating scales (Modified Cooper-Harper, Multi-descriptor, and Workload-Compensation-Interference/Technical Effectiveness), two secondary task measures (time estimation and tapping regularity), one physiological measure (respiration frequency), and one primary task measure (danger-condition response time) were reliable indicants of workload changes. Recommendations for applying the workload measures are presented.

Casali, J. G.↗