Engineering Papers⌕ Search

Engineering topics

Benjamin N Kelley

Publications and source records attributed to Benjamin N Kelley.

14 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight frameworks is paramount for establishing an effective architecture for autonomous systems. Hardware test flights are time-consuming and cost prohibitive during early system design and development. Simulation environments can be useful tools to accelerate algorithm development and testing. However, transitions from simulation to flight (sim-to-flight) can be challenging, unless systems are designed with this transition in mind and with the necessary capabilities built into the architecture and framework. One of the objectives of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. ATTRACTOR’s objective was to construct computational concepts of trustworthiness and justifiable trust in multi-agent autonomous teams, to inform future certification of safety-critical and time-critical autonomous systems in aviation. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation (ModSim) environment for test and evaluation of autonomous systems. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single-and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. The Autonomous Entity Operational Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications, enabling sim-to-flight with minimal configuration changes. Using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗
NASA NTRSDate not supplied

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗
NASA NTRSDate not supplied

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗
NASA NTRSDate not supplied

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions.This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

synthetic data↗
NASA NTRSDate not supplied

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗
NASA NTRSDate not supplied

Supervised Autonomous Assembly to Create and Evolve Persistent Assets

Supervised autonomous assembly (SAA) will create a paradigm shift in the planning and design of future persistent assets (PAs), both in near zero-g environments and on planetary surfaces. SAA refers to an autonomy approach that has the benefits of autonomous assembly as well as the benefits provided by a supervisor (operator) who is available to resolve unexpected situations. SAA provides both increased design freedom as well as reduced programmatic risk. SAA enables evolution of future PAs over decades as in-space operations transition from single purpose missions to creation of PAs, such as laboratories and experimental stations which more closely resembling terrestrial laboratories that can easily adapt and evolve to new missions leveraging repeated visits to the PA. The ability to evolve enables PAs to rapidly respond to changing objectives resulting from new questions as our understanding improves. A recently initiated National Aeronautics and Space Administration (NASA) project in the Space Technology Mission Directorate (STMD) Game Changing Development (GCD) Program called the Precision Assembled Space Structure (PASS), leverages the advantages of SAA to develop technologies that enable efficient creation and evolution of hexagonal topologies; both planar (example: fuel depots) and curved (examples: telescopes and shelters). PASS will be used to provide context for the philosophy and concepts discussed as well as the decision and selections made. PASS objectives are: a) Develop confidence in SAA and on-orbit servicing, assembly and manufacturing (OSAM) technologies by executing a test campaign that uses a path-to-flight autonomous precision assembly process directly applicable to future space telescopes. b) Test autonomous technologies including automated path planning and error recovery, to emphasize a robust approach that relies on generic robots and special purpose tools. c) Validate critical component models using a digital twin that includes the assembled primary mirror support structure and assembly process. A digital twin is a high-fidelity simulation of the asset capable of predicting the on-orbit performance. The paper concludes after identifying the critical need for a modest assembly flight experiment to validate and develop confidence in the SAA paradigm, thus accelerating adoption of the benefits described. SAA is a game changing paradigm that enhances the ability of an organization to infuse new technology through rapid evolution of PAs while leveraging OSAM technologies.

Structural Modeling↗
NASA NTRSDate not supplied

Designing a Distributed Web-based Simulation Environment for Enabling Autonomous Systems Research

In the continued pursuit of creating a future with robust Urban Air Mobility (UAM) operations defined as safe and efficient air traffic operations in metropolitan environments for both piloted and autonomous systems, development of the concepts, technologies, and procedures to establish this UAM ecosystem remains an active area of research. In particular, as autonomous systems continue to grow in both complexity and use throughout UAM concepts the need for simulation environments to both test individual components and systems and to study the complex interactions between them is paramount. In this paper we address design considerations, technologies, and challenges of adapting native simulation environment application concepts to an interactive and distributed web-based framework. The proposed web-based design allows for easier and wider access for developing, testing, integrating, and studying emergent behaviors of complex autonomous systems interaction. We demonstrate the utility of the proposed approach by showing multi-agent interaction and emergent behavior in two scenarios: (1) autonomous urban air mobility vehicles flying in a convoy and (2) interaction of a convoy with a search and rescue operation.

Benjamin N Kelley↗
NASA NTRSDate not supplied

Towards Persistent Space Observations through Autonomous Multi-Agent Formations

Sensing platforms must advance in scale and sophistication in order to support increasingly ambitious missions across Earth and space science; intelligence, surveillance, and reconnaissance (ISR); and planetary exploration. Distributed, persistent observation platforms have the potential to play a pivotal role in next generation missions through improved area coverage, enhanced situational awareness, and faster identification of trends and changes. The Multi-Agent Clusters for Persistent Observations from Space (MACPOS) project at NASA Langley Research Center is developing key technologies for the autonomous, heterogeneous formations that will comprise such platforms. Research thrusts include dynamic formation negotiation for self-assembling clusters of agents, distributed motion planning, and coordinated trajectory execution. Adaptive leader-follower formation negotiation allows agents to cluster and break off as necessary to adapt to both nominal and new mission objectives. Coordinated motion planning and execution maintain the formation while ensuring safe separation distances among agents and obstacles in the environment. These capabilities align MACPOS with NASA’s initiative for space and surface in-situ assembly through fundamental technology development for autonomous multi-agent systems. This paper presents an overview and early progress for the MACPOS project. We describe the system architecture for both individual agents and the overall fleet. Design considerations are given for the planning, control, and metrology subsystems. Finally, we discuss planned project milestones and the expected course of development.

Matthew P Vaughan↗
NASA NTRSDate not supplied

Designing a Software Architecture for the Precision Assembly of Space Structures

As NASA’s space exploration and science missions expand in complexity, longevity, anddistance beyond earth’s orbit, Orbital Servicing, Assembly and Manufacturing (OSAM)technologies and concepts have become a critical area of ongoing research and innovation.Artemis’ Moon-to-Mars goals of building sustainable elements on and around the Moon andMars that allow our robots and astronauts to explore and conduct more scientific researchwill demand in situ resource utilization, construction, and maintenance to succeed. In-spaceAssembly (ISA), as a sub-component of OSAM, focuses on the on-orbit building or fabricationof mission infrastructure and payloads. One such ISA application is highlighted by the recentNASA In-Space Assembled Telescope (iSAT) study, which stated that the next generation ofspace observatories will exceed the fairing size of existing or even planned launch vehicles andISA has emerged as a viable approach for observatory assembly. Research efforts at NASALangley Research Center have led to the design of a novel TriTruss structural concept for themodular construction of large complex persistent platforms. The TriTruss design and otherdeveloping OSAM technologies enable larger and persistent space missions that would notbe possible with single-launch-sized structures. For example, 20 meter or larger telescopesor orbital platform applications. However, the increased complexity will require autonomousoperations for the construction and maintenance of long-term infrastructure to achieve missionsuccess. NASA’s Precision Assembly of Space Structures (PASS) project is focused on thestructural and autonomy capabilities required to construct an iSAT in deep space. PASSresearch efforts will develop and validate critical technologies needed for effective efficienton-orbit assembly that can be confidently adopted for future systems. PASS will utilize theTriTruss modules to demonstrate the autonomous modular assembly of a 20m-class iSAT mirrorbackbone structure including simulated mirrors and wiring harness. In this paper, we addressthe software and hardware design considerations, technologies, and challenges of designing arobust robotics framework for assembling modular space structures in support of In SpaceAssembly missions in general as well as for PASS specifically.

Benjamin N Kelley↗
NASA NTRSDate not supplied

Design of Safe Separation Bounds for Temporally Deconflicted Trajectories Under Bounded Uncertainties

This paper explores the derivation of safe separation bounds for a heterogeneous group of~$n$ Uncrewed Aerial Systems (UAS) that are assigned temporally deconflicted trajectories. Compared to spatially deconflicted trajectories, temporal deconfliction can lead to higher traffic capacities and a more efficient use of the available airspace. One challenge with this type of deconfliction is that collisions can occur if some cooperating UAS are behind or ahead of schedule. To overcome this risk, this paper derives a lower bound on the safety distance between two heterogeneous UAS in the presence of bounded uncertainties. This safety distance can be leveraged to inform trajectory generation algorithms. The proposed bound establishes a rigorous safety margin when the fleet deviates from the planned trajectories, both temporally and spatially. For its derivation the paper assumes the UAS implement a distributed coordination algorithm that allows the fleet to maintain their schedules synchronized within a bounded temporal error, and a path-following algorithm that lets the vehicles track a target that moves along the planned trajectory with a bounded spatial error.

autonomy↗
NASA NTRSDate not supplied

Multi-Agent Search and Rescue Applied to a Swarm of Ground Vehicles

This paper presents an algorithm for efficient search and rescue using a multi-agent system of vehicles. The algorithm uses an artificial potential field combined with a time-varying reward function for visiting various points within the search area. The reward function is used as a weight for the attractiveness of these points in the potential field. The reward value increases while the point is not being observed, and decreases while the point is observed. Collision avoidance terms are used to repel vehicles from each other, which has the additional effect of reducing duplication of searching efforts. Gradient descent of the potential field results in persistent surveillance of the search area. The algorithm generates position commands in real-time based on communication with the other vehicles. This framework allows vehicles to react in a dynamic environment, which is a significant advantage to simply following a-priori defined trajectories. The algorithm is applied to a swarm of ground robots, and experimental data is presented showing that the swarm effectively searches the entire area and self-allocates search regions to individual vehicles.

multi-agent↗