SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This paper summarizes a series of experimental results in the evaluation and demonstration of planetary rover autonomy, with a particular emphasis on rover system technology capabilities under development for a 2005 Mars sample return mission and its precursor missions.
On the International Space Station today, the crew has the near real-time support of a large group of system experts on the ground when dealing with problems on-board. For exploration beyond Low Earth Orbit, however, intermittent and delayed communication with ground will force small crews to take the lead in responding to vehicle anomalies. Enabling a flight crew of roughly four astronauts to perform the job that has traditionally been done by a ground crew of over 80 experts will require a fundamental rethinking of human-systems integration. Through observations of anomaly resolution processes, interviews with system experts and astronauts, and analyses of problem-solving models, we have identified the capabilities that are not currently available on-board but will be needed to enable safe exploration further away from Earth. These include increased data access, just-in-time training tools and technologies, and troubleshooting decision support. Important questions remain on how these technologies can be designed and implemented for increased crew autonomy. We present this critical challenge for deep space exploration to the human-computer interaction research community to reflect on the areas identified by our needs analysis and contemplate how they might be manifested as solutions.
This Cognitive Task Analysis (CTA) study was designed to understand the capability of the m:N Tactical Operator (TO) interfaces developed by the Human-Autonomy Teaming Laboratory at NASA Ames to support operators responsible for simplified pilot operations of 100 independently operated small UAS (sUAS) in a constrained geographic area. The m:N sUAS TO interface includes a central Tactical Situation Display (TSD) digital map with moving icons reflecting the sUAS location and planned flight route. The interface also has two side panels. The left panel includes a tabular list of UAS assets and mission tasking, a list of recently viewed assets, and a list of events and alerts. The right panel includes a tabular list of UAS assets and their associated telemetry, text-based chat communication window, and a tabbed checklist window. This CTA was adapted from the incident-based applied cognitive task analysis (Militello & Hutton, 1998) and included demographics questions, scenario-based simulations, a task diagram and knowledge audit methods. In addition to examining the support provided by this m:N sUAS TO interface, this CTA study, conducted with aviation subject matter experts in analogous roles to the future tactical operator, was designed to illuminate and project likely cognitive requirements of the tactical operator. Interviewees participated in two scenario-based simulations using the m:N sUAS TO interfaces. In the first simulation, the interviewees supervised 12 sUAS operating in downtown San Diego, California transiting to and from a central sUAS Hive, restaurant locations, and customer drop off locations. Interviewees were asked to react to a UAS Volume Reservation (UVR) event with a two-phase impact on food delivery operations. In the second scenario, the interviewees supervised 100 sUAS operating in the same airspace and with the same mission. Interviewees used the interfaces to recognize and react to two sUAS air vehicle problems. After each scenario, we asked the interviewees a semi-structured list of questions to elicit their reflections about using the interfaces. Interviewees were confident in their ability to respond to two off-nominal situations in each simulation. Interviewees felt that, given high levels of automation on the sUAS, they would be able to manage the events without requiring additional support or handing off the sUAS to a colleague or supervisor in both the n=12 or n=100 sUAS settings. In the n=12 sUAS condition, interviewees used the center map to understand the asset location and progress along with mission tasking. An additional display window, Asset Telemetry, helped interviewees understand battery state and sUAS altitude. When the number of sUAS increased, interviewees altered their behavior. Rather than maintaining awareness of individual assets, interviewees appeared to become more reactive, managing exceptions. Interviewees reported that they spent less time looking at the nominal aircraft, and focused their attention primarily on the off-nominal aircraft. In addition, in the second simulation with n=100 sUAS, interviewees reported that they relied more on the side panels (Mission Timeline and Asset Telemetry) to gather information.
In future exploration missions beyond low earth-orbit, crew will have to execute complex operations and respond to off-nominal events, without real-time support from Mission Control. It is anticipated that increased reliance on automated systems, including human-centric vehicle and information architecture, will need to be designed to support the crew; increased risk to performance, health, and safety may occur if these are not implemented appropriately. The Human Factors and Behavioral Performance Element (HFBP) in the NASA Human Research Program supports research to characterize and mitigate such human health and performance risks, including the Risk of Adverse Outcome Due to Inadequate Human Systems Integration Architecture (HSIA). The HSIA risk addresses the integration of onboard capability and the crew roles and responsibilities necessary to enable the crew to respond effectively and efficiently in the increasingly autonomous mission operations environment. In 2017, HFBP released the “Human Capabilities Assessments for Autonomous Missions” (HCAAM) research topic to address HSIA related questions. HCAAM is a major NASA research effort that has assembled a multidisciplinary team from seven institutions to work closely with design and engineering efforts on research towards developing and refining human performance standards, guidelines and automation tools. The scientific focus is on quantitative assessment of human capabilities relevant to future deep-space missions during which earth/spacecraft communication is so delayed and intermittent that the crew must be able to function autonomously. The integrated strategy of the HCAAM project characterizes human capabilities and limitations related to potential performance decrements during long duration exploration mission spaceflight as relevant to both routine and complex task performance; defines system characteristics that reduce the likelihood or impact of potential decrements in human performance capabilities; performs integrated assessment of intelligent system responses within the context of an operational environment with relevant NASA tools, systems, and data structures in order to determine positive or negative interactions and validate recommended approaches; and proposes specific updates to existing standards and guidelines for inclusion in NASA handbooks for the design of future spacecraft intelligent systems that provide crew performance assessment/feedback, and to also serve as decision-support aids for the onboard crew (i.e., NASA-STD-3001, and NASA/SP-Human Integration Design Handbook (HIDH)). The scientific research vectors being addressed by the seven HCAAM teams include: - crew task performance (accuracy, efficiency) (crew + automation) - crew performance (accuracy, efficiency) - crew Situation Awareness - procedure design and multi-modal enhancement - concurrent tasking (mixed manual + some level of autonomy) - task handover - crew self-planning and time-lining - task design - trust in automation, real-time calibration - human multi-sensory feedback and guidance - human trust in on-board software-based intelligent assistants - virtual assistants The presentation will highlight plans and progress made in each of these research areas as well as the methods by which surrogate astronaut crews in the NASA JSC HERA spaceflight analog facility will function as human test subjects for all of the HCAAM research projects.
Trajectory planning is a particularly challenging task for autonomous vehicles when the uncertainties in their operating environment cannot be characterized statistically. In this paper, we propose a receding horizon control strategy with novel trajectory planning policies that enable dynamic updating of the planned trajectories of autonomous vehicles operating in environments where potential conflicts are, from a statistical perspective, either partially known or completely unknown. The proposed policies utilize two metrics: (1) the number of feasible trajectories; and (2) the robustness of the feasible trajectories. We measure the effectiveness of the suggested policies in terms of mission survivability, which is defined as the probability that the primary mission is accomplished or, if that is not possible, the vehicle lands safely at an alternative site. We show that a linear combination of both metrics is an effective objective function when there is a mix of partially known and unknown uncertainties. When the operating environment is dominated by unknown disturbances, maximizing the number of feasible trajectories results in the highest mission survivability. These findings have significant implications for achieving safe aviation. autonomy.
Urban Air Mobility (UAM) is an emerging aviation sector and is playing an integral part in the on-demand mobility revolution. UAM is powered by the convergence of advances in distributed electrical propulsion (DEP) and vehicle autonomy. The complexity of operations in the urban environment and the unconventional vehicle configurations designed to take advantage of new propulsion technologies, result in numerous challenges that benefit from a control-centric approach. In this talk we outline some of these challenges and present our current approach to addressing them. For example, in order to achieve full market potential and access to UAM, vehicle autonomous flight is required. A key barrier to autonomous flight in a large multi-agent system is dealing with off-nominal situations and contingencies in a safe and predictable manner. We present our approach to intelligent contingency management, and share recent results and open problems. Additionally, we discuss another major barrier to ubiquitous UAM – the noise signature produced by vehicles with multiple rotors. We present our approach to minimizing such noise within the framework of the acoustically-aware vehicle.
Trajectory planning is a particularly challenging task for autonomous vehicles when there are moderate to extreme uncertainties in their operating environment, i.e., where the trajectories of hazards are partially known to completely unknown. In this paper, we propose a receding horizon control strategy with novel trajectory planning policies that enable dynamic updating of the planned trajectories of autonomous vehicles. The proposed policies utilize two metrics: (1) the number of feasible trajectories; and (2) the robustness of the feasible trajectories. We measure the effectiveness of the suggested policies in terms of mission survivability, which is defined as the probability that the primary mission is accomplished or, if that is not possible, the vehicle lands safely at an alternative site. We show that a linear combination of both metrics is an effective objective function when there is a mix of partially known and unknown uncertainties. When the operating environment is dominated by unknown disturbances, maximizing the number of feasible trajectories results in the highest mission survivability. These findings have significant implications for achieving safe aviation autonomy.
NASA’s Artemis program will send astronauts to the lunar surface for extended mission durations throughout the 2030s, with a focus on sustainability and extensibility for Mars exploration, as described in NASA’s “Artemis Plan”. However, NASA must place more emphasis on protecting both the crew and the exploration surface systems if they hope to achieve long-duration sustainability on the lunar surface. It is now reasonably achievable with excavation, construction, and autonomy technologies to achieve a significant level of protection that architectures have been unable to achieve to date. The Lunar Safe Haven (LSH) was proposed to protect astronauts, electronics, and other surface exploration systems from the hazards of the lunar environment, including radiation, micrometeoroid strikes, lunar dust, thermal vacuum, etc. During the study, Level Zero Requirements were developed for the LSH, and a decision analysis framework was baselined to evaluate concepts. The LSH Study also performed a comprehensive trade study, during which it identified numerous alternatives for establishing and maintaining a safe haven shelter on the lunar surface. This paper reviews the products developed during the study and presents the final recommendations.
The sustainable missions beyond Low Earth Orbit (LEO) envisioned for NASA’s Artemis program will require autonomous capabilities. Moreover, Artemis mission crews will need a means to efficiently interact with a spacecraft’s autonomous systems. This interaction can be facilitated by voice and speech communications because voice-based controls enable users to interact hands- and eyes-free, allowing the user to better focus on critical tasks. The goal of our project was to explore the knowledge and technology needed to successfully design effective Voice User Interfaces (VUIs) for autonomous systems utilizing Human Centered Design (HCD) principles. The focus of the human factors’ aspect of engineering, pays close attention to psychological and physiological principles in the development of autonomous crew operation systems. A main objective was to understand how a crew member, through voice interaction, could efficiently and intuitively communicate with a notional autonomous vehicle system manager. This project was a part of the NASA Moon to Mars eXploration Systems and Habitation (M2M X-Hab) 2020 Academic Innovation Challenge. The work from the BLiSS Team, at the University of Michigan, resulted in the design of a system persona, Diego, to which an astronaut may quickly build trust with autonomous systems, to alleviate known stressors on mental health expected during long duration space missions. Optimal software to facilitate integration of the system persona into a reference Lunar orbiting Gateway station was defined. Additionally, a Speech to Text (STT) system and a Graphical User Interface (GUI) that could be implemented in future missions was developed on an Internet of Things (IOT) platform. The Voice User Interface (VUI) design for the M2M X-Hab 2020 project leveraged previous technology developed by the BLiSS team to incorporate a voice-based interface into NASA’s Platform for Autonomous Systems (NPAS) software. This required technologies to convert voice to text, conduct semantic interpretations, and convert responses from the autonomous system to text and to speech; additionally, the spacecraft background noise environment was assessed, a noise mitigation technique was developed, and a relatable personality for the autonomous system was developed in order to facilitate human-like conversations. The success of our effort was largely due to the diversity of the team that included expertise in Space Systems Engineering, Human Computer Interaction, Aerospace Engineering, Computer Science, Biomedical Engineering, and Applied Physics. The diverse perspectives fostered elaborate discussions, resulting in the conception of three main subsystems: (1) User-System, (2) NPAS-System, and (3) Environment-System. The VUI was unique and had to be efficient and intuitive. For this project, 5 subteams were formed, each with a separate objective, Voice Design team, Background Noise Mitigation team, Software Integration team and Graphical User Interface team. The BLiSS team crafted a personality for the VUI to enable human-like conversation and drive user adoption and trust. User surveys were completed and used to help determine the required VUI system personality traits by capturing perspectives and expectations of prospective “Artemis Generation Astronauts”. To further simulate human-like conversations, the system had to be able to quickly interpret user speech and be able to integrate with NASA’s NPAS platform for quick and reliable information transfer. The outcomes of our research were: (1) a working prototype user interface, that is compatible with NASA’s NPAS platform; (2) software that demonstrates the ability of the VUI system to interpret user requests and respond appropriately; (3) the capability to implement fully expanded conversations between user and system using intuitive communication in four request categories; and (4) software and hardware recommendations that optimize the system’s ability to operate in a noisy environment. Our research has laid the foundation for the development of VUI’s for autonomy, and provides a baseline for future VUI developments.
The idea of a “digital twin” was born at NASA in the 1960s as a “living model” of the Apollo mission. In response to Apollo 13’s oxygen tank explosion and subsequent damage to the main engine, NASA employed multiple simulators to evaluate the failure and extended a physical model of the vehicle to include digital components. This “digital twin” was the first of its kind, allowing for a continuous ingestion of data to model the events leading to up to the accident for forensic analysis and exploration of next steps. Fast forward half a century and NASA, along with others in the aerospace community, continues to develop and utilize high-fidelity digital models of physical systems and components as well as the extreme environments in which they operate. NASA aims to travel further and stay longer in space as we realize the Artemis program, taking us from the moon to Mars by establishing a sustainable presence on the Moon to prepare for missions to Mars. We will no longer be able to rely on constant connectivity with an asset nor be in-the-loop for on-demand human intervention in the event of an anomaly. Further, the importance of digital twins is increasing as we seek alternatives for certification of structures so large that they cannot be fully evaluated in existing test facilities and autonomous systems that are not deterministic. The idea of a digital twin is not a new one. What is new is the scale, ordinality, and non-deterministic nature of the models that are critical to achieving NASA’s goals. Their number and autonomy from each other as well as the reference system is suggestive of a changing ecosystem, returning us the idea of a living model.
An Earth-independent permanent extraterrestrial habitat system must function as intended under continuous disruptive conditions, and with significantly limited Earth support and extended uncrewed periods. Designing for the demands that extreme environments such as wild temperature fluctuations, galactic cosmic rays, destructive dust, meteoroid impacts (direct or indirect), vibrations, and solar particle events, will place on long-term deep space habitats represents one of the greatest challenges in this endeavor. This context necessitates that we establish the know-how and technologies to build habitat systems that are resilient. Resilience is not simply robustness or redundancy: it is a system property that accounts for both anticipated and unanticipated disruptions via the design choices and maintenance processes, and adapts to them in operation. We currently lack the frameworks and technologies needed to achieve a high level of resilience in a habitat system. The Resilient Extra Terrestrial Habitats Institute (RETHi) has the mission of leveraging existing novel technologies to provide situational awareness and autonomy to enable the design of habitats that are able to adapt, absorb and rapidly recover from expected and unexpected disruptions. We are establishing both fully virtual and coupled physical-virtual simulation capabilities that will enable us to explore a wide range of potential deep space Smart Hab configurations and operating modes.
Measurement of multiple biologic and non-biologic signals can be exploited for the task of monitoring the physiological status of individuals - either as patients during and following illness or injury or as those engaged in operational activities. Assessing physiological status is accomplished by measuring vital signs and wellness measures that support clinical decision-making for physical optimization, illness/injury prevention and treatment, recovery progression, and general delivery of care, or monitoring an operator's moment-to-moment personal "readiness" state. Physiological measures are beneficial for monitoring the medical state of vehicle operators, for example, through the detection of incapacitation in the realm of transportation safety. Measuring physiological signals or control inputs can also be beneficial for monitoring operator state to optimize human-autonomy-teaming performance for safety and efficiency. Similarly, monitoring a health care provider during the performance of medical procedures could provide valuable feedback on optimizing human-robot interactions and human teaming with autonomous systems. In this sense, the provider can be seen as a "Medical Operator" in the same way other "operators" drive, aviate, or control vehicles by performing manual, attention-demanding tasks during safety-critical activities.
Automation often relies on the human to "jump" into the loop and solve problems when the automation can’t due to conditions outside of which it was designed for or automaton failure. This talk proposes a methodology (Human Autonomy Assistant) to address that situation. Examples are provided from a wild fire context.
The National Aeronautics and Space Administration is supporting research to develop a prototype remote vehicle operations center at Langley Research Center to explore current and future advanced air mobility operations using small unmanned aerial systems vehicles as surrogates for future, larger-scale passenger carrying vehicles. Data collected within the Remote Operations for Autonomous Missions (ROAM) Unmanned Aerial Systems (UAS) Operations Center will be used to explore different roles and responsibilities of remote operators managing multiple autonomous vehicles, with the goal of exploring human-autonomy teaming concepts that enable m:N operations (i.e., m operators managing N vehicles). ROAM has developed into a world-class research, development, and technology (RD&T) environment that can support both the collection of human factors data and the command and control of remote vehicles in beyond visual line of sight conditions. Presented in this paper is an overview of ROAM, with a focus on the design components that support human factors data collection and a review of initial usability results of the facility.
Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.
The aviation literature gives relatively little guidance to practitioners about the specifics of architecting systems for safety, particularly the impact of architecture on allocating safety requirements, or the relative ease of system assurance resulting from system or subsystem level architectural choices. As an exemplar, this paper considers common architectural patterns used within traditional aviation systems and explores their safety and safety assurance implications when applied in the context of integrating artificial intelligence (AI) and machine learning (ML) based functionality. Considering safety as an architectural property, we discuss both the allocation of safety requirements and the architectural trade-offs involved early in the design lifecycle. This approach could be extended to other assured properties, similar to safety, such as security. We conclude with a discussion of the safety considerations that emerge in the context of candidate architectural patterns that have been proposed in the recent literature for enabling autonomy capabilities by integrating AI and ML. A recommendation is made for the generation of a property-driven architectural pattern catalogue.
The National Aeronautics and Space Administration is supporting research to develop a prototype remote vehicle operations center at Langley Research Center to explore current and future advanced air mobility operations using small unmanned aerial systems vehicles as surrogates for future, larger-scale passenger carrying vehicles. Data collected within the Remote Operations for Autonomous Missions (ROAM) Unmanned Aerial Systems (UAS) Operations Center will be used to explore different roles and responsibilities of remote operators managing multiple autonomous vehicles, with the goal of exploring human-autonomy teaming concepts that enable m:N operations (i.e., m operators managing N vehicles). ROAM has developed into a world-class research, development, and technology (RD&T) environment that can support both the collection of human factors data and the command and control of remote vehicles in beyond visual line of sight conditions. Presented in this paper is an overview of ROAM, with a focus on the design components that support human factors data collection and a review of initial usability results of the facility.
Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.