Engineering Papers⌕ Search

Engineering topics

B Danette Allen

Publications and source records attributed to B Danette Allen.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Detection and Tracking of Aircraft in the Far-Field from Small Unmanned Aerial Systems

Onboard far-field aircraft detection is needed for safe non-cooperative traffic mitigation in autonomous small Unmanned Aerial System (sUAS) operations. Machine vision systems, based on standard optics and visible light detectors, possess the ideal size, weight, and power (SWaP) requirements for sUAS. This work presents the design and analysis of a novel aircraft detection and tracking pipeline based on optical sensing alone. Key contributions of the work include a refined range inequality model based on sensing and detection with FAA well-clear separation assurance distances between aircraft in mind, a detector fusion method to maximize the benefit of two image detectors, and a comparative analysis of Linear Kalman-filtering and Extended Kalman-filtering to seek optimal tracking performance. The pipeline is evaluated offline against multiple intruder platforms, using two types of flight encounters: multirotor sUAS vs. fixed-wing sUAS and multirotor sUAS vs. general aviation(GA)plane. Analysis is restricted to the rate-limiting head-on and departing collision volume cases vertically separated for safety. Results indicate that it is feasible to use the proposed optical spatial-temporal tracking algorithm to provide adequate alerting time to prevent penetration of well-clear separation volumes for both sUAS and GA aircraft.

Unmanned Aerial System↗
NASA NTRS2021

ATTRACTOR: Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability

Autonomous systems (AS) are crucial to realizing the vision of new, complex transportation modes, such as advanced air mobility (AAM) and urban air mobility (UAM). A chief barrier to induction of AS into aviation is insufficient understanding of AS reliability in time-critical and safety-critical environments—an obstacle to certification. ATTRACTOR is aimed at building a basis for certification of classes of autonomous cyber-physical-human systems (CPHS) via establishing metrics and models of trustworthiness and trust in multi-agent team interactions, analyzable trajectories, explainability of computational algorithms (explainable artificial intelligence, or XAI), and persistent modeling and simulation, in the context of missions planning and operation. By “building a basis for certification,” we mean acquiring an understanding of when a system is trustworthy and developing computable means to estimate trustworthiness and trust in order to eventually inform functional requirements that contribute to certification. The outcomes are applicable not just to aviation but to all domains that rely on autonomous systems.

Autonomy↗
NASA NTRS2021

Inertial Transfer Concept for Autonomous In-Space Assembly

Rocket payload and fairing size have placed strict mass and volume limitations on single launch in-space structures. These limitations are what motivates In-Space Assembly (ISA) and where Inertial Transfer has potential to improve or augment ISA capabilities by utilizing a multiagent autonomous system to transport untethered payloads. The Inertial Transfer concept is presented including autonomy capabilities, potential risks, and three system configurations. These configurations are based on the autonomous system’s available sensor coverage that tracks the payload’s state. Participating agents have well-defined roles, expectations, and assumptions in their physical organization and coordination of actions depending the mode of operation. The sensor information available to participating agents is considered as it affects the uncertainty in the estimated state and the actions required to capture the payload.

Multi-Agent↗
NASA NTRS2021

Inertial Transfer Concept for Autonomous In-Space Assembly

Rocket payload and fairing size have placed strict mass and volume limitations on single launch in-space structures. These limitations are what motivates In-Space Assembly (ISA)and where Inertial Transfer has potential to improve or augment ISA capabilities by utilizing an efficient multi-agent autonomous system to transport untethered payloads. Adoption of an inertial transfer approach significantly reduces system complexity, energy and time needed for assembly compared to conventional ISA capabilities, increasing the likelihood of early adoption for assembly. The Inertial Transfer concept is presented including autonomy capabilities, potential risks, and three system configurations. These configurations are based on the autonomous system’s available sensor coverage that tracks the payload’s state. Participating agents have well-defined roles, expectations, and assumptions in their physical organization and coordination of actions depending the mode of operation. The sensor information available to participating agents is considered as it affects the uncertainty in the estimated state and theactions required to capture the payload.

Multi-Agent↗
NASA NTRS2020

State of the Profession Considerations: NASA Langley Research Center Capabilities / Technologies for Autonomous In-Space Assembly and Modular Persistent Assets

Successfully implementing OSAM into next generation revolutionary observatories requires integrating expertise and technologies in modular space structures, assembly operations, autonomy, and modeling/simulation. LaRC OSAM technologies/capabilities have been presented to inform the Planetary Science and Astrobiology Decadal Survey community of the robust and mature existing capability to support an OSAM based architecture for their next observatory. LaRC Structures and Assembly capabilities enable; a modular telescope architecture, high-performance structural modules, and robotic assembly techniques. LaRC Autonomy capabilities ensure that the robotic assembly will be accomplished in a safe and robust manner and only require humans in a supervisory role. The LaRC toolbox of Modeling and Simulation capabilities that is calibrated using module-level ground testing, will ensure that the performance of the fully assembled observatory, a very large zero-g system that will never be assembled/tested in a gravity environment, meets all performance requirements when it enters into service. Integrating all three LaRC capabilities and including embedded metrology, will enable servicing, repair, instrument upgrades (and/or replacement) while ensuring a very long lifetime for the observatory and providing a return-on-investment that is substantially greater than the initial cost. Further confidence will be achieved as OSAM technologies are validated in a new LaRC OSAM laboratory that allows large-scale collaborative testing of modular hardware, simulation software and algorithms, and autonomous agents.

Large space structures↗
NASA NTRS2018

Persistent Assets in Zero-G and on Planetary Surfaces: Enabled by Modular Technology and Robotic Operations

Space operations are on the cusp of a revolutionary new operational paradigm that leverages modular systems and recurring robotic visits to “Persistent Assets” enabling asset maintenance, repair, and enhancement. A “Persistent Asset” is defined here as any zero-g or planetary surface system that benefits from in-space assembly (ISA) or multiple visits for servicing, repairs, and upgrades. This term is an extension of the term “Persistent Platform” used by Ms. Pam Melroy at the Defense Advanced Research Projects Agency to describe the vision of the Agency for a geosynchronous Earth orbiting platform. In this paper, the term “Persistent Asset” is introduced to encompass not only zero-g systems; such as telecommunication platforms, Earth observing science platform, Department of Defense platforms, and scientific telescope systems, but also planetary surface systems that support missions such as human outposts, science stations, and in-situ resource utilization systems. In contrast to the current state of the art, where space systems are typically launched as a single unit and operated without any further physical intervention after launch; future systems will be maintained, enhanced and reconfigured in-situ as new technology becomes available or mission needs change. Visits to the persistent asset can be regularly scheduled or dictated by funding constraints enabling a pay-as-you-go approach, which is largely independent of time-constraints and able to exploit launches of opportunity. In this paper, historical in-space assembly activities which relied heavily on astronaut extra-vehicular activity will be reviewed as well as early robotic assembly activities. These approaches will be contrasted with emerging modular approaches supporting realization of a new Persistent Asset operational paradigm. The paper will define attributes of the Persistent Asset paradigm and illustrate advantages by applying the paradigm to two relevant applications: 1) a large space telescope backing structure and 2) the backbone structure for a solar electric transport vehicle. Finally, recently developed unique Persistent Asset elements (modules, and interface approaches) will be described.

William R Doggett↗
NASA NTRS2018

Trusted Communication: Utilizing Speech Communication to Enhance Human-Machine Teaming Success

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such an integration requires humans to work closely with autonomous systems, forming teams. Our hypothesis is that a team composed of both humans and autonomous systems will operate better than either entity alone. We have existing procedures for certifying pilots to operate in the national airspace and are currently working on methods for validating the function of autonomous systems, however we have no method in place for assessing the interaction of these two disparate systems. Communication is one avenue. This paper will examine the use of language as a metric for ascertaining human-machine teaming effectiveness. A proof-of-concept of the application of two communication-based analysis techniques, Linguistic Inquiry and Word Count (LIWC) and Latent Semantic Analysis (LSA), for the prediction of success in human/chatbot teaming was conducted. By running these analyses over data from the 2014 and 2015 Loebner Prize competitions of human/chatbot teaming, numerical scores were obtained that can be associated with scores provided by human judges during the competition. Correlating their LIWC and LSA data with the scores provided by the judges, and using linear regression over this correlation, formulae were obtained that predict the score of human/chatbot interaction. These formulae were tested over the 2013 Loebner Prize transcripts, determining that, though there was strong correlation between predicted and actual scores, the predictive success of this method was not strong. However, with specialized topic spaces and lexica, as well as larger data sets, the predictive power of these metrics will improve. Given the importance of providing metrics for human-machine system team success and given the promise shown by the communication-basedLIWCand LSAmethods, continuing research in this area is necessary. After examining the potential for using communication and spoken language as a metric for the success of human/autonomous system teaming, this paper then examines aspects inherent to communication systems that may contribute to unreliability and reduced trust. Modern natural language processing tools rely on deep learning algorithms to create language rules that produce accurate results, but these rules are uninterpretable. The resulting blackbox system lacks transparency necessary for full validation and complete trust. Additionally, speech-based interfaces pose other difficulties to developing coordinated teamwork between humans and autonomous systems. Human communication is infrequently limited to speech only, instead usually relying on a combination of verbal, gestural, and general body language communication. Reducing an analysis of team effectiveness to a study of spoken language alone is problematic as it leaves these other equally important forms of communication out. This paper will examine these problems and the general deficiencies in speech-based metrics for human-machine teaming.

E L Meszaros↗
NASA NTRSDate not supplied

Analyzing Natural Language Context in Human-Machine Teaming using Supervised Machine Learning

Building a foundation for trustworthiness and trust verification in multi-asset teaming is the research challenge of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR). The Design Reference Mission (DRM) for ATTRACTOR is a search and rescue mission objective governed by a multi-member team consisting of human and machine operators. A crucial component to the effort is the communication between humans and autonomous agents throughout both planning and execution stages of the mission. Intuitive communication methods and modalities are posited as critical enablers for certifying trust and trustworthiness. This paper reports on the data collection and analysis conducted in support of the Human Informed Natural-language GANs Evaluation (HINGE)project to attain explainable and trusted communication between human-machine assets. Two identically curated image description datasets were acquired for HINGE, both consisting of two unique input modalities (typed vs. verbal) and retrieved in two distinct contexts (general vs. specific). The gathered datasets were assessed and compared using Parts-of-Speech (POS)features, sentence similarity metrics, and linguistic analysis. Then, the datasets were modeled and tested separately and in combination with one another using machine learning algorithms. The comparison and testing results reveal a superior dataset, by which a preferred context and input is understood, for generating image representations of missing persons using a Generative Adversarial Network (GAN).

Bryan A Barrows↗
NASA NTRSDate not supplied

Inertial Transfer: Concept and Multi-Agent Approach

Research and development of cost saving technologies is vital to the success of NASA’s strategic goal to extend human presence deeper into space and to the moon for sustainable long-term exploration and utilization. Reduction of mass has long been a method of reducing space mission costs. In this submission, Inertial Transfer, a new approach to mass transfer in space, is presented. A Multi-Agent System solution to the problem space is discussed. A scaled base-line simulator is constructed and demonstrated which will enable the development of AI capabilities necessary to perform Inertial Transfer. Finally, future work and key challenges are discussed.

Multi-Agent↗
NASA NTRSDate not supplied

OSAM Autonomy

Workshop Description: NASA hosts an annual technology transfer workshop to facilitate the transfer of OSAM technologies to U.S. industry. Due to precautions surrounding COVID-19, the fifth OSAM Technology Transfer Workshop will be held virtually on September 22-23. Workshop attendees will enjoy access to an updated technology catalog, information about the latest developments from NASA subject matter experts, and a tour of NASA facilities.

OSAM↗
NASA NTRSDate not supplied

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.

Lisa R Le Vie↗
NASA NTRSDate not supplied

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions.This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

synthetic data↗
NASA NTRSDate not supplied

ATTRACTOR: Toward Trustworthy and Trusted Autonomous Systems

The question of what it means and what it takes for an autonomous system to consider another autonomous system justifiably trustworthy must be addressed by all who seek to integrate intelligent machine agents into real-world operations. A satisfactory answer to this question is an essential component in accepting autonomous machine decision-making in safety-critical and time-critical environments, such as aviation. Historically, simulation platforms for test and evaluation of complex systems have proven to be effective in assessing performance and contributing to decisions on the fitness of systems to operate in current general and commercial aviation airspace. Moreover, simulations have informed the definition of safety-critical constraints. However, as machine systems progressively take on responsibilities for decision-making traditionally supplied by humans, simulations require enhancement. Mixed reality simulation that integrates real-world platforms and data or high-fidelity simulation data in a sim-to-flight paradigm provides insight into agent interaction and the rationale behind autonomous agent decision-making as well as the capacity for seamless integrated implementation, testing, and operation of systems. Strong simulation capabilities are especially important in the presence of algorithms that hold great promise in decision-making yet increase the uncertainty in the system. Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) is a subproject of NASA’s Convergent Aeronautics Solutions (CAS) Project. ATTRACTOR’s objective is to build a basis for understanding trust and trustworthiness in multi-agent autonomous teams, and thus to inform future certification of safety-critical and time-critical autonomous systems in aviation. Because the concepts of trust and trustworthiness must be addressed in a context, ATTRACTOR has chosen Search and Rescue (SAR) in dynamic and unstructured environments, with emphasis on search, as its design reference mission (DRM). During dynamic planning and execution of trajectory-based operations, autonomous agents determine their trajectories given an assigned mission or missions and call for assistance from an appropriate teammate when needed. This experience along with the attendant human-machine and machine-machine interactions, serve as a platform for developing approaches to identifying and measuring trustworthiness and increasing trust. In this paper, we give an overview of some of ATTRACTOR’s research and development activities, findings, and ongoing work.

ATTRACTOR↗