SEARCH · Engineering Papers

Results for “Decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Assessing the Needs of NASA's Near Real-Time Earth Observation Products

"The 2017-2027 Decadal Survey for Earth Science and Applications from Space stated that NASA's Earth Science with planned implementation of applications provides sustained earth observations for societal benefits [1]. The Decadal Survey indicated that data latency is invaluable for time-sensitive applications including disaster risk reduction, wildland fire carbon emissions quantification, real-time measurements of the state of the hydrologic systems and many more. Data latency refers to the time between earth observation and data products available to users. During the past 13 years, NASA's Land, Atmosphere Near Real-Time Capability for Earth Observing Systems (LANCE) continues to provide free access to earth observation products that are made available much quicker than routine processing allows. The latency of most LANCE data products is Near Real-time (NRT) which is defined as less than three hours from satellite observations [2]. LANCE is managed by the Earth Science Data and Information System (ESDIS) Project at NASA Goddard Space Flight Center [3], and a User Working Group (UWG) is responsible for providing guidance to LANCE. LANCE data are used by direct users and brokers who add value to the data [4]. NASA Earth Applied Sciences Program (ASP) is one of the primary users of LANCE, which collaborates with partner organizations and provides support to scientists to solve problems in applications of earth observations. ASP promotes the use of LANCE NRT data products to demonstrate applications in decision making, facilitates end-user feedback to the science team to improve data products, and provides information on future demands for research. LANCE supports applications that need a rapid response including detecting wildland fires and volcanic eruptions, tracking smoke, ash and dust plumes, monitoring air quality and tracking extreme weather events such as hurricanes, landslides, and floods. To gather feedback regarding the availability, accessibility and actionability of NASA's NRT data products for societal benefit, three surveys and a few discussions with experts involved in the topic within ASP were conducted from the perspective of users. Feedback has been collected from users who are interested in using low latency NASA data within application communities of agriculture, disasters, water resources, health and air quality, ecological conservation, wildland fires and capacity building. Analysis-ready NRT data products in a variety of formats have been mentioned many times in the collected feedback, especially for applied users with little to no experience using research-grade earth observation products. Users prefer to have products that can be easily integrated into their existing workflows and take their analysis to the data. HDF5 is a commonly used data format for research, but typically requires some conversion to a more friendly format for applications and regular use in decision-making. Users prefer the GeoTIFF data format that can be directly ingested into a GIS mapping software and platform for data analysis and visualization. For example, LANCE’s fire, flood, SO2 and Black Marble Nighttime Blue/Yellow Composite data products have been integrated into NASA Disasters Mapping Portal, which is an GIS-based open data portal, for users in the disaster management community. There are 291 LANCE NRT layers available through GIBS and Worldview, where users can download a snapshot in GeoTIFF format. Operational users expect data to be processed as close to the user as possible. The collected feedback indicates that LANCE fire products within 3 hours latency would meet the needs of the wildland fire community. The ideal latency for volcanic application is 10-15 minutes. Users in Volcanic Ash Advisory Centers (VAAC) reported that the first forecast volcanic product should be issued within 75 minutes from the volcano eruption [5]. Overall, for disaster applications, data latency within 3 hours is useful while latency greater than 12 hours is not timely enough for operational use. Capacity building and training are critical for users to be able to access, interpret and use data products and tools for their decision making, especially for applied users with limited experience using earth observation products. LANCE data products have been used in a number of capacity building projects domestically and internationally [6]. As LANCE continues to bring new products into the system, users request training to utilize LANCE new and upcoming data products and capabilities in their applications. Due to the limitation of bandwidth and downstream flow paths, users in some developing countries need tools to select and download data for a specific area of interest instead of bulk downloads. The collected feedback also shows the lack of available SAR satellite low latency data products. The advantages of SAR to monitor conditions and changes on the ground through darkness, clouds, volcanic ash, and other atmospheric conditions, are appealing to low latency users. For example, terabytes of low latency but cloudy optical images are not helpful in rapidly identifying the extent of flood or fire impacts. LANCE could be complemented with low latency measurements via the upcoming NASA-ISRO Synthetic Aperture Radar (NISAR) mission [7]. Requests for higher spatial resolution products are expressed. A user from the wildland fire management community reported that products with 30-m spatial resolution could be used to detect small fires. The 30-m Landsat OLI fire data is now part of NASA’s Fire Information for Resource Management System (FIRMS) US/Canada [8]. Within the open and free NASA resources, LANCE disseminates NRT data products in a manner that allows them to be accessible and understandable to both scientific and applied users. In many application areas, latency plays an important or even decisive role where low latency earth observations help people to observe areas of interest, detect and track changes in the environment and make timely decisions. NASA’s Earth Applied Sciences Program promotes the use of LANCE NRT products and builds a bridge between application users and research teams. The collected feedback indicates data latency within 3 hours is useful for most of the applications, and shows the needs of user-friendly, analysis-ready products, and requests training on LANCE’s new and upcoming data products. User feedback has been provided to LANCE UWG for guidance and recommendations, and for translating findings into something actionable.

Tian Yao↗

NASA NTRS2006

Plan Execution Interchange Language (PLEXIL)

Plan execution is a cornerstone of spacecraft operations, irrespective of whether the plans to be executed are generated on board the spacecraft or on the ground. Plan execution frameworks vary greatly, due to both different capabilities of the execution systems, and relations to associated decision-making frameworks. The latter dependency has made the reuse of execution and planning frameworks more difficult, and has all but precluded information sharing between different execution and decision-making systems. As a step in the direction of addressing some of these issues, a general plan execution language, called the Plan Execution Interchange Language (PLEXIL), is being developed. PLEXIL is capable of expressing concepts used by many high-level automated planners and hence provides an interface to multiple planners. PLEXIL includes a domain description that specifies command types, expansions, constraints, etc., as well as feedback to the higher-level decision-making capabilities. This document describes the grammar and semantics of PLEXIL. It includes a graphical depiction of this grammar and illustrative rover scenarios. It also outlines ongoing work on implementing a universal execution system, based on PLEXIL, using state-of-the-art rover functional interfaces and planners as test cases.

Estlin, Tara↗

NASA NTRS1998

Automation: Decision Aid or Decision Maker?

This study clarified that automation bias is something unique to automated decision making contexts, and is not the result of a general tendency toward complacency. By comparing performance on exactly the same events on the same tasks with and without an automated decision aid, we were able to determine that at least the omission error part of automation bias is due to the unique context created by having an automated decision aid, and is not a phenomena that would occur even if people were not in an automated context. However, this study also revealed that having an automated decision aid did lead to modestly improved performance across all non-error events. Participants in the non- automated condition responded with 83.68% accuracy, whereas participants in the automated condition responded with 88.67% accuracy, across all events. Automated decision aids clearly led to better overall performance when they were accurate. People performed almost exactly at the level of reliability as the automation (which across events was 88% reliable). However, also clear, is that the presence of less than 100% accurate automated decision aids creates a context in which new kinds of errors in decision making can occur. Participants in the non-automated condition responded with 97% accuracy on the six "error" events, whereas participants in the automated condition had only a 65% accuracy rate when confronted with those same six events. In short, the presence of an AMA can lead to vigilance decrements that can lead to errors in decision making.

Skitka, Linda J.↗

NASA NTRS1991

Fuzzy set methods for object recognition in space applications

Progress on the following tasks is reported: (1) fuzzy set-based decision making methodologies; (2) feature calculation; (3) clustering for curve and surface fitting; and (4) acquisition of images. The general structure for networks based on fuzzy set connectives which are being used for information fusion and decision making in space applications is described. The structure and training techniques for such networks consisting of generalized means and gamma-operators are described. The use of other hybrid operators in multicriteria decision making is currently being examined. Numerous classical features on image regions such as gray level statistics, edge and curve primitives, texture measures from cooccurrance matrix, and size and shape parameters were implemented. Several fractal geometric features which may have a considerable impact on characterizing cluttered background, such as clouds, dense star patterns, or some planetary surfaces, were used. A new approach to a fuzzy C-shell algorithm is addressed. NASA personnel are in the process of acquiring suitable simulation data and hopefully videotaped actual shuttle imagery. Photographs have been digitized to use in the algorithms. Also, a model of the shuttle was assembled and a mechanism to orient this model in 3-D to digitize for experiments on pose estimation is being constructed.

Keller, James M.↗

NASA NTRS2011

Product Lifecycle Management and the Quest for Sustainable Space Exploration Solutions

Product Lifecycle Management (PLM) is an outcome of lean thinking to eliminate waste and increase productivity. PLM is inextricably tied to the systems engineering business philosophy, coupled with a methodology by which personnel, processes and practices, and information technology combine to form an architecture platform for product design, development, manufacturing, operations, and decommissioning. In this model, which is being implemented by the Marshall Space Flight Center (MSFC) Engineering Directorate, total lifecycle costs are important variables for critical decision-making. With the ultimate goal to deliver quality products that meet or exceed requirements on time and within budget, PLM is a powerful concept to shape everything from engineering trade studies and testing goals, to integrated vehicle operations and retirement scenarios. This briefing will demonstrate how the MSFC Engineering Directorate is implementing PLM as part of an overall strategy to deliver safe, reliable, and affordable space exploration solutions and how that strategy aligns with the Agency and Center systems engineering policies and processes. Sustainable space exploration solutions demand that all lifecycle phases be optimized, and engineering the next generation space transportation system requires a paradigm shift such that digital tools and knowledge management, which are central elements of PLM, are used consistently to maximum effect. Adopting PLM, which has been used by the aerospace and automotive industry for many years, for spacecraft applications provides a foundation for strong, disciplined systems engineering and accountable return on investment. PLM enables better solutions using fewer resources by making lifecycle considerations in an integrative decision-making process.

Caruso, Pamela W.↗

NASA NTRS2016

Developing a Crop Mask for Agricultural Assessments in Kenya

Kenya relies on agricultural production for supporting local consumption and other processing value chains. The role of agriculture in supporting Kenya's economy is critical, with its contribution to the Gross Domestic product (GDP) estimated at over 277,000 Million in 2016. With changing climate in a rain-fed dependent agricultural production system, cropping zones are shifting and proper decision making will require updated data for proper delineation of cropping areas and extent; especially in agriculture and food security assessments. Where up-to-date data is not available it is important that it is generated and passed over to relevant stakeholders to inform their decision making processes. It is important that government agencies, non-governmental agencies and other agricultural stakeholders access updated tools and information to assist in their assessments. To support agricultural decision making, SERVIR E&SA will develop an updated agricultural crop mask. Due to intercropping especially in small holder farming, the mask will cover all crops to provide an overall map of cropped areas.

environment↗

NASA NTRS2005

Range Systems Simulation for the NASA Shuttle: Emphasis on Disaster and Prevention Management During Lift-Off

This article describes a decision-making system composed of a number of safety and environmental models for the launch phase of a NASA Space Shuttle mission. The components of this distributed simulation environment represent the different systems that must collaborate to establish the Expectation of Casualties (E(sub c)) caused by a failed Space Shuttle launch and subsequent explosion (accidental or instructed) of the spacecraft shortly after liftoff. This decision-making tool employs Space Shuttle reliability models, trajectory models, a blast model, weather dissemination systems, population models, amount and type of toxicants, gas dispersion models, human response functions to toxicants, and a geographical information system. Since one of the important features of this proposed simulation environment is to measure blast, toxic, and debris effects, the clear benefits is that it can help safety managers not only estimate the population at risk, but also to help plan evacuations, make sheltering decisions, establish the resources required to provide aid and comfort, and mitigate damages in case of a disaster.

Rabelo, Lisa↗

NASA NTRS1989

The role of flight planning in aircrew decision performance

The role of flight planning in increasing the safety and decision-making performance of the air transport crews was investigated in a study that involved 48 rated airline crewmembers on a B720 simulator with a model-board-based visual scene and motion cues with three degrees of freedom. The safety performance of the crews was evaluated using videotaped replays of the flight. Based on these evaluations, the crews could be divided into high- and low-safety groups. It was found that, while collecting information before flights, the high-safety crews were more concerned with information about alternative airports, especially the fuel required to get there, and were characterized by making rapid and appropriate decisions during the emergency part of the flight scenario, allowing these crews to make an early diversion to other airports. These results suggest that contingency planning that takes into account alternative courses of action enhances rapid and accurate decision-making under time pressure.

Pepitone, Dave↗

NASA NTRS2003

Influence of Icing Information on Pilot Strategies for Operating in Icing Conditions

The influence of potential remoteice-deteetion system features on pilot decision making was investigated through a Web-based experiment. Display features including a graphical plan view depiction of icing severity, vertical view depiction, single and multiple icing Severity levels as well as sensor range were varied in a part-task simulation experiment. Using information from each display, pilots were presented with a set of four flight scenarios and probed on their routing decisions and comfort level with those decisions. The experiment also included a subjective display preference evaluation. Results show that all of the displays improved pilot decision making over existing text-based icing information. The three-dimensional displays that included vertical depiction of icing conditions were found to support improved decision making. Range was not found to be a strong factor in the experiment; however, the minimum range tested was 25 n miles, which may be in excess of current technical capabilities. The depiction of the severity of icing conditions was not found to be as important as accurate information on the location of icing conditions.

Vigeant-Langlois, Laurence↗

NASA NTRS1994

Teams and teamwork at NASA Langley Research Center

The recent reorganization and shift to managing total quality at the NASA Langley Research Center (LaRC) has placed an increasing emphasis on teams and teamwork in accomplishing day-to-day work activities and long-term projects. The purpose of this research was to review the nature of teams and teamwork at LaRC. Models of team performance and teamwork guided the gathering of information. Current and former team members served as participants; their collective experience reflected membership in over 200 teams at LaRC. The participants responded to a survey of open-ended questions which assessed various aspects of teams and teamwork. The participants also met in a workshop to clarify and elaborate on their responses. The work accomplished by the teams ranged from high-level managerial decision making (e.g., developing plans for LaRC reorganization) to creating scientific proposals (e.g., describing spaceflight projects to be designed, sold, and built). Teams typically had nine members who remained together for six months. Member turnover was around 20 percent; this turnover was attributed to heavy loads of other work assignments and little formal recognition and reward for team membership. Team members usually shared a common and valued goal, but there was not a clear standard (except delivery of a document) for knowing when the goal was achieved. However, members viewed their teams as successful. A major factor in team success was the setting of explicit a priori rules for communication. Task interdependencies between members were not complex (e.g., sharing of meeting notes and ideas about issues), except between members of scientific teams (i.e., reliance on the expertise of others). Thus, coordination of activities usually involved scheduling and attendance of team meetings. The team leader was designated by the team's sponsor. This leader usually shared power and responsibilities with other members, such that team members established their own operating procedures for decision making. Sponsors followed a hands-off policy during team operations, but they approved and reviewed team products. Most teams, particularly high-level decision-making teams, had little or no authority to carry out their decisions. Team members had few interpersonal conflicts. They monitored each other respectfully about meeting deadlines. Feedback and backup behaviors were seen as desirable aspects of teamwork, wanted by the members, and done appropriately.

Dickinson, Terry L.↗

NASA NTRS2001

Cognitive Task Analysis of Business Jet Pilots' Weather Flying Behaviors: Preliminary Results

This report presents preliminary findings from a cognitive task analysis (CTA) of business aviation piloting. Results describe challenging weather-related aviation decisions and the information and cues used to support these decisions. Further, these results demonstrate the role of expertise in business aviation decision-making in weather flying, and how weather information is acquired and assessed for reliability. The challenging weather scenarios and novice errors identified in the results provide the basis for experimental scenarios and dependent measures to be used in future flight simulation evaluations of candidate aviation weather information systems. Finally, we analyzed these preliminary results to recommend design and training interventions to improve business aviation decision-making with weather information. The primary objective of this report is to present these preliminary findings and to document the extended CTA methodology used to elicit and represent expert business aviator decision-making with weather information. These preliminary findings will be augmented with results from additional subjects using this methodology. A summary of the complete results, absent the detailed treatment of methodology provided in this report, will be documented in a separate publication.

Latorella, Kara↗

NASA NTRS1999

Developing an Advanced Environment for Collaborative Computing

Knowledge management in general tries to organize and make available important know-how, whenever and where ever is needed. Today, organizations rely on decision-makers to produce "mission critical" decisions that am based on inputs from multiple domains. The ideal decision-maker has a profound understanding of specific domains that influence the decision-making process coupled with the experience that allows them to act quickly and decisively on the information. In addition, learning companies benefit by not repeating costly mistakes, and by reducing time-to-market in Research & Development projects. Group-decision making tools can help companies make better decisions by capturing the knowledge from groups of experts. Furthermore, companies that capture their customers preferences can improve their customer service, which translates to larger profits. Therefore collaborative computing provides a common communication space, improves sharing of knowledge, provides a mechanism for real-time feedback on the tasks being performed, helps to optimize processes, and results in a centralized knowledge warehouse. This paper presents the research directions. of a project which seeks to augment an advanced collaborative web-based environment called Postdoc, with workflow capabilities. Postdoc is a "government-off-the-shelf" document management software developed at NASA-Ames Research Center (ARC).

Becerra-Fernandez, Irma↗

NASA NTRSDate not supplied

Summary of Technical Interchange Meetings (TIMs) Designed to Enable Earth Independent Medical Operations (EIMO)

The Exploration Medical Capability Element (ExMC) in NASA’s Human Research Program hosted a series of TIMs in 2023-2024 designed to stimulate discussion around specific topics with the goal of enabling EIMO. In context of the thematic constituent elements of EIMO, namely pre-mission planning, acute/emergent/prolonged medical decision making, supply/resource management and task load management, subject matter experts from industry, academia and government (NASA and other Agencies) provided valuable and actionable guidance and recommendations. Earth-based medical experts will remain indispensable for pre-mission planning, however, management of acute/emergent medical contingencies will require a gradual transition of medical care and decision making from terrestrial to space-based assets to enable support of astronaut health and performance and reduce overall mission risk. Key to achieving these enhancements is providing an integrated data system platform capable of utilizing multiple data streams in concert with a variety of on-board databases and passive monitoring of video and wearable sensors to enable a multi-modal, agentic AI-based clinical decision support system (CDSS) to support crew medical officer (CMO) medical decision-making. The EIMO series of TIMs (I-V) have proven to be instructive and portend a significant paradigm shift will be necessary to maintain crew health and performance on exploration class missions. Importantly, since the expected paradigm shift will be significantly different from the methods of operation that have been employed for the majority of missions from the inception of human spaceflight to date, any proposed methods must be deployed in the setting of ongoing operations early and be “tested, reviewed and practiced” while reliable back-up is available to facilitate an Enterprise-wide level of comfort and acceptance. Serious constraints on data transmission coupled with a large and expanding universe of on-board medical informatics data streams will necessitate implementation of a CDSS to supplant the current reliance on support provided by ground-based SMEs. Establishment of trust in the system by CMO/crew and the ground-based medical support team will be essential. Co-development of a CDSS with industry partners will assure that state of the art tools can be employed, and industry efficiencies can be leveraged. Training regimens, materials and tools must evolve to be responsive (just-in-time training) and facilitate autonomous execution of procedures. Proficiency metrics should be established and be based on validated competencies or milestones as opposed to a prescribed number of training hours. Training should be prioritized for broad, translatable skills that have universal application across a variety of medical conditions. Repetition was deemed to be the key to achieving proficiency and emphasis should lie in procedural training which is known to extinguish more rapidly than diagnostic skills. Advanced tools, e.g., extended reality, can provide more realistic and effective training. Use of advanced probabilistic risk assessment tools will be essential to optimize the medical system capability while carefully balancing risk relative to mass/power/volume limitations. Importance of factoring use-life of medical supplies and maintaining awareness of redundancy and opportunity to re-purpose under off nominal situations was emphasized. Consideration of adopting optimized performance standards vs. “good-enough” performance thresholds is warranted. The use of legacy systems as opposed to creating new systems may be preferable. Managing task load and associated cognitive load will be essential to maintain operational safety and behavioral health. ExMC aspires to create a shared EIMO paradigm and strategic vision for advancing medical system design through novel technologies, training, protocols, and support capabilities, built upon the spirit of successful strategies and innovations over the past six decades of space medicine operations.

Jay Lemery↗

NASA NTRS2011

Applications of the International Space Station Probabilistic Risk Assessment Model

Recently the International Space Station (ISS) has incorporated more Probabilistic Risk Assessments (PRAs) in the decision making process for significant issues. Future PRAs will have major impact to ISS and future spacecraft development and operations. These PRAs will have their foundation in the current complete ISS PRA model and the current PRA trade studies that are being analyzed as requested by ISS Program stakeholders. ISS PRAs have recently helped in the decision making process for determining reliability requirements for future NASA spacecraft and commercial spacecraft, making crew rescue decisions, as well as making operational requirements for ISS orbital orientation, planning Extravehicular activities (EVAs) and robotic operations. This paper will describe some applications of the ISS PRA model and how they impacted the final decision. This paper will discuss future analysis topics such as life extension, requirements of new commercial vehicles visiting ISS.

Grant, Warren↗

NASA NTRS2022

Increasing the Uptake of Ecological Model Results in Policy Decisions to Improve Biodiversity Outcomes

Models help decision-makers anticipate the consequences of policies for ecosystems and people; for instance, improving our ability to represent interactions between human activities and ecological systems is essential to identify pathways to meet the 2030 Sustainable Development Goals. However, use of modeling outputs in decision-making remains uncommon. We share insights from a multidisciplinary National Socio-Environmental Synthesis Center working group on technical, communication, and process-related factors that facilitate or hamper uptake of model results. We emphasize that it is not simply technical model improvements, but active and iterative stakeholder involvement that can lead to more impactful outcomes. In particular, trust- and relationship-building with decision-makers are key for knowledge-based decision making. In this respect, nurturing knowledge exchange on the interpersonal (e.g., through participatory processes), and institutional level (e.g., through science-policy interfaces across scales), represent promising approaches. To this end, we offer a generalized approach for linking modeling and decision-making.

Biodiversity-ecosystem function relationships↗

NASA NTRS2004

Intelligent Medical Systems for Aerospace Emergency Medical Services

The purpose of this project is to develop a portable, hands free device for emergency medical decision support to be used in remote or confined settings by non-physician providers. Phase I of the project will entail the development of a voice-activated device that will utilize an intelligent algorithm to provide guidance in establishing an airway in an emergency situation. The interactive, hands free software will process requests for assistance based on verbal prompts and algorithmic decision-making. The device will allow the CMO to attend to the patient while receiving verbal instruction. The software will also feature graphic representations where it is felt helpful in aiding in procedures. We will also develop a training program to orient users to the algorithmic approach, the use of the hardware and specific procedural considerations. We will validate the efficacy of this mode of technology application by testing in the Johns Hopkins Department of Emergency Medicine. Phase I of the project will focus on the validation of the proposed algorithm, testing and validation of the decision making tool and modifications of medical equipment. In Phase 11, we will produce the first generation software for hands-free, interactive medical decision making for use in acute care environments.

Epler, John↗

NASA NTRS1999

Climate Change and a Global City: An Assessment of the Metropolitan East Coast Region

The objective of the research is to derive an assessment of the potential climate change impacts on a global city - in this case the 31 county region that comprises the New York City metropolitan area. This study comprises one of the regional components that contribute to the ongoing U.S. National Assessment: The Potential Consequences of Climate Variability and Change and is an application of state-of-the-art climate change science to a set of linked sectoral assessment analyses for the Metro East Coast (MEC) region. We illustrate how three interacting elements of global cities react and respond to climate variability and change with a broad conceptual model. These elements include: people (e.g., socio- demographic conditions), place (e.g., physical systems), and pulse (e.g., decision-making and economic activities). The model assumes that a comprehensive assessment of potential climate change can be derived from examining the impacts within each of these elements and at their intersections. Thus, the assessment attempts to determine the within-element and the inter-element effects. Five interacting sector studies representing the three intersecting elements are evaluated. They include the Coastal Zone, Infrastructure, Water Supply, Public Health, and Institutional Decision-making. Each study assesses potential climate change impacts on the sector and on the intersecting elements, through the analysis of the following parts: 1. Current conditions of sector in the region; 2. Lessons and evidence derived from past climate variability; 3. Scenario predictions affecting sector; potential impacts of scenario predictions; 4. Knowledge/information gaps and critical issues including identification of additional research questions, effectiveness of modeling efforts, equity of impacts, potential non-local interactions, and policy recommendations; and 5. Identification of coping strategies - i.e., resilience building, mitigation strategies, new technologies, education that affects decision-making, and better preparedness for contingencies.

Rosenzweig, Cynthia↗

NASA NTRS2022

Reliability-Aware Requirements Development for Autonomy Software

Autonomy is the ability of a system to make decisions and take actions in the presence of uncertainty. Validating autonomy, therefore, is a matter of validating that the system makes intelligent decisions even when there might be discrepancies between the observed and the expected state of the world as well as when the possible outcome of each of the possible courses of action is uncertain. During the requirements engineering phase, the functions, including those that are required to be autonomous and their expected behavior are specified. However, in the case of autonomous software system, it is challenging to specify all possible scenarios that the software may encounter. Additionally, since autonomous behaviors cannot always be fully predetermined, it is difficult to reason about their completeness and correctness. While these challenges are also faced with non-autonomous system, they are more prevalent for autonomous system due to their complexity and emergent behavior. Our efforts have been three-fold. On one hand, we have developed a goal-based method for requirements decomposition. We have embedded this approach into a higher-level systems engineering framework and then developed methods for decision and reliability analysis within this framework. And finally, we use simulation analysis to validate the more theoretical methods and provide a feedback mechanism. The decision analysis approach (DA) helps in identifying and mitigating the run-time risks, by bringing to the forefront the uncertainties, decisions, interactions, and other factors that may cause autonomous software to make erroneous decisions. The DA framework is used to quantify, for each decision that the software can make, failure risk due to uncertainties. The information about the key decisions and circumstances that can cause autonomous system to make incorrect decisions are used to generate test scenarios to be run in a simulator to ensure that the system can handle error-prone circumstances. The results or outcomes from decisions, based on the simulated scenarios, can then be leveraged to further gain insight of the assured system. We combine a goal-based approach with simulation analysis to facilitate requirements development for autonomous systems and further provide a method for run-time systems level reliability considerations during the autonomous software development process. The DA and the reliability analysis methods provide a formalism for the consideration of uncertainty in the run time decision-making process for autonomous software. This formalism considers the uncertainty involved in the outcome of different courses of action, in terms of performance and cost, as well as a method to consider the system level reliability implications. System level reliability considerations for autonomous software decision making contribute to the satisfaction of the system level goals over the lifecycle of a given mission. We demonstrate our approach using a hypothetical rover path planning example. The requirements for our rover simulator are based on existing literature about Mars rovers and lessons learned from real world observations at JPL. The specifics of the autonomy design for the Mars rovers, that have not been previously cleared for external release, are not used for our demonstrations.

Lindvall, Mikael↗