Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Radionuclide Risk Coefficient Uncertainty Distributions for Use in Performance Assessments - 19156

Traditionally, radiation dose has been used as the regulatory criterion for decision making in performance assessments (PAs), despite the concept of cancer risk arguably being a more easily understood endpoint than dose for the public, and a preferable metric for decision analysis. However, the United States Environmental Protection Agency (EPA) has developed risk parameters for use in risk assessments and PAs in the form of radionuclide-specific risk coefficients, or RCs, which are published in various Federal Guidance Reports (FGRs). RCs are employed as scalars to convert environmental radionuclide exposure (via ingestion, inhalation, and external exposure) estimates to incremental lifetime cancer risk (ILCR). ILCR is the additional cancer risk averaged over a lifetime, over-and-above all-cause cancer risk, associated with carcinogen exposure. Uncertainties associated with RCs are discussed in FGR 13 and in a joint report published by EPA and Oak Ridge National Laboratory, but statistical distributions for the RCs were not directly developed. The uncertainty assessments in the EPA/ONRL report were based on dosimetric modeling and elicitation of nine experts. From these sources, five uncertainty categories were defined based on ratios of the 5. and 95. quantiles of uncertainty. Thus, the representations of uncertainty defined by EPA/ORNL are not distributions in a traditional sense. Furthermore, the authors only addressed uncertainty in RCs for inhalation and ingestion pathways. We develop a methodology for assigning statistical distributions to EPA's published mortality RC values (i.e. to estimate the probability of dying from radiation-induced cancers) for the inhalation (slow, medium, and fast absorption types), ingestion (water, food, and soil), and external exposure pathways associated with all cancer types. We employed the same dosimetric concepts and assumptions as EPA/ORNL, including cancer risk (dose-response) distributional information from a previous expert elicitation, which was also employed by EPA/ORNL in their work. We assumed that uncertainty in RCs can be described by lognormal distributions based on the modeling conducted previously by EPA/ORNL, and that point estimates tabulated in FGR 13 represent median values of the distributions. We also extended EPA/ORNL's uncertainty ratios to statistical distributions for external exposure RCs. The results are a set of radionuclide-specific distributions that are applicable in PAs that focus on cancer mortality. These distributions are currently and will subsequently be employed in PAs at various sites, in addition to the required regulatory dose limits. Quantification of ILCRs and associated uncertainty in PAs will provide regulators and the public with additional information for good decision making. Future directions include further refinement of the distributions and development of statistical distributions for morbidity RCs, which are used to estimate the probability of developing, but not necessarily dying as a result of, radiation-induced cancer. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Stakeholders’ perceptions towards non-native acacias and implications for their management in Portugal

Abstract Humans act as drivers for the introduction of non-native trees. Some non-native species may become invasive and cause undesirable impacts, thereby motivating targeted decision-making and management actions. Australian acacias (or wattles; genus Acacia subgenus Phyllodineae) have been introduced worldwide, offering both opportunities and risks for local communities. Understanding how stakeholders perceive invasive acacias is paramount to assist effective decision-making. We assessed stakeholders’ perceptions about these non-native acacias, their invasion process, social-ecological impacts and management. We conducted a questionnaire-based survey with experienced managers and decision-makers in Northern Portugal, where acacia invasions are widespread. We found that most stakeholders are not able to recognize non-native species, failing to identify the introduction period, drivers of dispersion and appropriate management methods of Australian acacias. We could also identify different stakeholder perceptions on the benefits and negative impacts provided by these species. We call for the implementation of technical training and information outreach strategies to address stakeholders’ lack of knowledge (and experience) on the recognition and identification of non-native trees, as well as on their introduction and invasion history, drivers of dispersion, costs and benefits, and effective management actions. Stakeholders’ engagement should be promoted in the design and implementation of biosecurity efforts to control (and/or adapt to) invasive acacias at relevant scales of invasion management.

Vaz, Ana Sofia↗

Integrated Modeling and Simulation Verification, Validation, and Accreditation Strategy for Exploration Systems Mission Directorate

Models and simulations (M&S) are critical resources in the exploration of space. They support program management, systems engineering, integration, analysis, test, and operations and provide critical information and data supporting key analyses and decisions (technical, cost and schedule). Consequently, there is a clear need to establish a solid understanding of M&S strengths and weaknesses, and the bounds within which they can credibly support decision-making. Their usage requires the implementation of a rigorous approach to verification, validation and accreditation (W&A) and establishment of formal process and practices associated with their application. To ensure decision-making is suitably supported by information (data, models, test beds) from activities (studies, exercises) from M&S applications that are understood and characterized, ESMD is establishing formal, tailored W&A processes and practices. In addition, to ensure the successful application of M&S within ESMD, a formal process for the certification of analysts that use M&S is being implemented. This presentation will highlight NASA's Exploration Systems Mission Directorate (ESMD) management approach for M&S W&A to ensure decision-makers receive timely information on the model's fidelity, credibility, and quality.

Hale, Joseph P.↗

Communicating about bioenergy sustainability

Defining and measuring sustainability of bioenergy systems are difficult because the systems are complex, the science is in early stages of development, and there is a need to generalize what are inherently context-specific enterprises. These challenges, and the fact that decisions are being made now, create a need for improved communications among scientists as well as between scientists and decision makers. In order for scientists to provide information that is useful to decision makers, they need to come to an agreement on how to measure and report potential risks and benefits of diverse energy alternatives, including problems and opportunities in various bioenergy production pathways. Scientists also need to develop approaches that contribute information relevant to policy and decision making. The need for clear communication is especially important at this time when there is a plethora of scientific papers and reports, and it is difficult for the public or decision makers to assess the merits of each analysis. We propose three communication guidelines for scientists whose work can contribute to decision making: (1) relationships between the question and the analytical approach should be clearly defined and make common sense; (2) the information should be presented in a manner that nonscientists can understand; and (3) the implications of methods, assumptions and limitations should be clear. The scientists job is to analyze information in order to build a better understanding of environmental, cultural and socioeconomic aspects of the sustainability of energy alternatives. The scientific process requires transparency, debate, review, and collaboration across disciplines and time. This paper serves as an introduction to the papers in the special issue on Sustainability of Bioenergy Systems: Cradle to Grave because scientific communication is essential to developing more sustainable energy systems. Together these four papers provide a framework under which the effects of bioenergy can be assessed and compared to other energy alternatives in order to foster sustainability.

Benefits↗

Natural Resource Information System. Volume 1: Overall description

A prototype computer-based Natural Resource Information System was designed which could store, process, and display data of maximum usefulness to land management decision making. The system includes graphic input and display, the use of remote sensing as a data source, and it is useful at multiple management levels. A survey established current decision making processes and functions, information requirements, and data collection and processing procedures. The applications of remote sensing data and processing requirements were established. Processing software was constructed and a data base established using high-altitude imagery and map coverage of selected areas of SE Arizona. Finally a demonstration of system processing functions was conducted utilizing material from the data base.

Source record↗

SafeMAP: Safe Multi-Agent Planning Framework Based on Dynamic Probabilistic Risk Assessment

This paper proposes a risk-aware framework for Safe Multi-Agent Planning (SafeMAP) that unifies disparate models for multi-agent systems in a Markovian process that allows for simultaneous system health monitoring, decision making under uncertainty, and multi-agent system collaboration. As operations beyond low earth orbit mature, there is an increased need for autonomous cyber-physical systems with onboard decision making capabilities. Multi-agent cyber-physical systems in particular offer the potential of increased efficiency, resiliency, and mission capabilities for future applications such as multi-rover terrain operations, distributed satellite operations, and management of smart lunar habitats. SafeMAP utilizes physics-based models of each agent and the relevant components, probability models of the environment and component operational states, and reward models for mission-specific objectives such as scientific task completion or resource consumption. The output of SafeMAP is a set of mission plans that satisfy the mission objective under specified risk/reward constraints. A readable interpretation of each of these generated mission plans is provided as an additional output. SafeMAP has been demonstrated on a simulated case study involving a four-rover system performing surface mapping operations and science tasks. Results of this paper demonstrate SafeMAP’s ability to generate explainable mission plans that satisfy the mission objective while minimizing risk under nominal and off-nominal conditions.

Mohammad Hejase↗

SafeMAP: Safe Multi-Agent Planning framework based on Dynamic Probabilistic Risk Assessment

This paper proposes a risk-aware framework for Safe Multi-Agent Planning (SafeMAP) that unifies disparate models for multi-agent systems in a Markovian process that allows for simultaneous system health monitoring, decision making under uncertainty, and multi-agent system collaboration. As operations beyond low earth orbit mature, there is an increased need for autonomous cyber-physical systems with onboard decision making capabilities. Multi-agent cyber-physical systems in particular offer the potential of increased efficiency, resiliency, and mission capabilities for future applications such as multi-rover terrain operations, distributed satellite operations, and management of smart lunar habitats. SafeMAP utilizes physics-based models of each agent and the relevant components, probability models of the environment and component operational states, and reward models for mission-specific objectives such as scientific task completion or resource consumption. The output of SafeMAP is a set of mission plans that satisfy the mission objective under specified risk/reward constraints. A readable interpretation of each of these generated mission plans is provided as an additional output. SafeMAP has been demonstrated on a simulated case study involving a four-rover system performing surface mapping operations and science tasks. Results of this paper demonstrate SafeMAP’s ability to generate explainable mission plans that satisfy the mission objective while minimizing risk under nominal and off-nominal conditions.

Mohammad Hejase↗

The role of information structures in game-theoretic multi-agent learning

Multi-agent learning (MAL) studies how agents learn to behave optimally and adaptively from their experience when interacting with other agents in dynamic environments. The outcome of a MAL process is jointly determined by all agents’ decision-making. Hence, each agent needs to think strategically about others’ sequential moves, when planning future actions. The strategic interactions among agents makes MAL go beyond the direct extension of single-agent learning to multiple agents. With the strategic thinking, each agent aims to build a subjective model of others decision-making using its observations. Such modeling is directly influenced by agents’ perception during the learning process, which is called the information structure of the agent’s learning. As it determines the input to MAL processes, information structures play a significant role in the learning mechanisms of the agents. This review creates a taxonomy of MAL and establishes a unified and systematic way to understand MAL from the perspective of information structures. Here we define three fundamental components of MAL: the information structure (i.e., what the agent can observe), the belief generation (i.e., how the agent forms a belief about others based on the observations), as well as the policy generation (i.e., how the agent generates its policy based on its belief). In addition, this taxonomy enables the classification of a wide range of state-of-the-art algorithms into four categories based on the belief-generation mechanisms of the opponents, including stationary, conjectured, calibrated, and sophisticated opponents. We introduce Value of Information (VoI) as a metric to quantify the impact of different information structures on MAL. Finally, we discuss the strengths and limitations of algorithms from different categories and point to promising avenues of future research.

97 MATHEMATICS AND COMPUTING↗

Advanced Seismic Probabilistic Risk Assessment Demonstration Project Plan

Idaho National Laboratories (INL) has an ongoing research and development (R&D) project to remove excess conservatism from seismic probabilistic risk assessments (SPRA) calculations. These risk calculations should focus on providing best estimate results, and associated insights, for evaluation and decision-making. This report presents a plan for improving our current traditional SPRA process using a seismic event recorded at a nuclear power plant site, with known outcomes, to improve the decision making process. SPRAs are intended to provide best estimates of the various combinations of structural and equipment failures that can lead to a seismic induced core damage event. However, in general this approach has been conservative, and potentially masks other important events (for instance, it was not the seismic motions that caused the Fukushima core melt events, but the tsunami ingress into the facility).

58 GEOSCIENCES↗

Potential State Regulatory Pathways to Facilitate Low-Carbon Fuels

States and the federal government are increasingly engaged in the challenges around decarbonizing the electric grid. In particular, regulators, consumers, stakeholders, and utilities recognize the need to carefully consider the role natural gas will play in a decarbonized future. A variety of technology and policy options to reduce greenhouse gas emissions associated with natural gas use are available, including energy efficiency programs, demand reduction tools, strategic electrification, and strategies to reduce emissions from natural gas production, transportation, and consumption. Low-carbon fuels – mainly renewable natural gas (RNG) and clean hydrogen – are being considered an important component of decarbonization goals. RNG and hydrogen may be able to meaningfully reduce emissions from processes independent of geologic natural gas, displacing emissions of methane, a powerful greenhouse gas. Although RNG and hydrogen are not cost-competitive today with geologic natural gas and are smaller in scale and potential than other decarbonization options, they can be explored as potential critical tools to decarbonize sectors that are difficult to electrify or shift off of natural gas entirely, such as air travel, industrial processes, maritime transport, long-distance trucking, space heating on cold days, and railroads (Nadel, 2022). The role of this report is to provide informational context for state utility regulators to understand the impacts of and challenges associated with broader integration of low-carbon fuels, followed by examples of state regulatory actions taken to date to facilitate the development of low-carbon fuels. Setting clear guidance to calculate the environmental benefits of low-carbon fuels and continuing federal and state investments in research and development to reduce costs relative to fossil fuels will be important steps to take to signal the desire to grow the market for these fuels. State public utility commissions may play a key role in setting regulatory frameworks for low-carbon fuels and ensuring that ratepayer funds, if utilized, are done so to further the public interest. This report is intended to summarize decisions that states have made to date on low-carbon fuels. In the spirit of understanding the current market and sharing information, this report provides success stories, and lessons learned across states as regulators implement varying strategies to achieve decarbonization objectives while maintaining their focus on affordability, safety, and reliability of the energy system. The report begins with an introduction of the role of natural gas in the U.S. economy (Section I) and background information on natural gas use, decarbonization, and low-carbon fuels (Section II). Next, the report describes the current market by discussing the scale of current production, emissions intensity, resource potential, and costs of low-carbon fuels compared to geologic natural gas (Section III). Following these sections, the report describes four strategies states have employed to facilitate low-carbon fuels: opening exploratory dockets, approving voluntary tariffs for customers, approving interconnection tariffs for producers, and considering portfolio-wide procurement targets (Section IV). This section lists states that have taken actions in each category, citing utility filings, commission decisions, stakeholder comments, and other relevant sources. Finally, the report concludes with suggested questions regulators may wish to consider regarding low-carbon fuels, in the interest of preparing to make decisions in the future (Section V). These questions include: Are there existing regulatory or technical barriers to voluntary purchases of low-carbon fuels? Can customers work with utilities to procure low-carbon fuels; are producers able to interconnect projects without significant barriers to entry? Should the infrastructure and/or commodity costs of low-carbon fuels be socialized among all ratepayers, or borne solely by the large commercial and industrial (C&I) customers currently driving the market? Should regulated natural gas and/or electric utilities own and operate low-carbon fuel production? How should regulators consider the unique decarbonization potential of low-carbon fuels, particularly for hard-to-abate sectors, in decision-making? Is additional direction or clarity from state policymakers needed? What no-regrets approaches can help facilitate both near-term RNG development and long-term development of hydrogen and other zero-carbon fuels? We collectively wish to express our gratitude to the U.S. Department of Energy, Office of Fossil Energy and Carbon Management, for supporting this report and other technical assistance resources for state regulators on natural gas topics. State regulators operate under a variety of policy environments, and states have vastly different types of energy resources, infrastructure, and customers. While there is no optimal regulatory, policy, or technological solution that will be successful in every state, state regulators can benefit by exchanging lessons learned with their peers across the country. We look forward to continued engagement with our fellow commissioners, commission staff, NARUC, the U.S. Department of Energy, and other stakeholders to develop sound regulation in the public interest.

03 NATURAL GAS↗

SAMICS Validation. SAMICS Support Study, Phase 3

SAMICS provides a consistent basis for estimating array costs and compares production technology costs. A review and a validation of the SAMICS model are reported. The review had the following purposes: (1) to test the computational validity of the computer model by comparison with preliminary hand calculations based on conventional cost estimating techniques; (2) to review and improve the accuracy of the cost relationships being used by the model: and (3) to provide an independent verification to users of the model's value in decision making for allocation of research and developement funds and for investment in manufacturing capacity. It is concluded that the SAMICS model is a flexible, accurate, and useful tool for managerial decision making.

Source record↗

The Effect of Shared Information on Pilot/Controller And Controller/Controller Interactions

In order to respond to the increasing demand on limited airspace system resources, a number of applications of information technology have been proposed, or are under investigation, to improve the efficiency, capacity and reliability of ATM (Asynchronous Transfer Mode) operations. Much of the attention in advanced ATM technology has focused on advanced automation systems or decision aiding systems to improve the performance of individual Pilots or Controllers. However, the most significant overall potential for information technology appears to he in increasing the shared information between human agents such as Pilots, Controllers or between interacting Controllers or traffic flow managers. Examples of proposed shared information systems in the US include; Controller Pilot Databank Communication (CPDLC), Traffic Management Advisor (TMA); Automatic Dependent Surveillance (ADS); Collaborative Decision Making (CDM) and NAS Level Common Information Exchange. Air Traffic Management is fundamentally a human centered process consisting of the negotiation, execution and monitoring of contracts between human agents for the allocation of limited airspace, runway and airport surface resources. The decision processes within ATM tend to be Semistructured. Many of the routine elements in ATM decision making on the part of the Controllers or Pilots are well Structured and can be represented by well defined rules or procedures. However in disrupted conditions, the ATM decision processes are often Unstructured and cannot be reduced to a set of discrete rules. As a consequence, the ability to automate ATM processes will be limited and ATM will continue to be a human centric process where the responsibility and the authority for the negotiation will continue to rest with human Controllers and Pilots. The use of information technology to support the human decision process will therefore be an important aspect of ATM modernization. The premise of many of the proposed shared information systems is that the performance of ATM operations will improve with an increase in Shared Situation Awareness between agents (Pilots, Controller, Dispatchers). This will allow better informed control decisions and an improved ability to negotiate between agents. A common information basis may reduce communication load and may increase the level of collaboration in the decision process. In general, information sharing is expected to have advantages for all agents within the system. However there are important questions which remain to be,addressed. For example: What shared information is most important for developing effective Shared Situation Awareness? Are there issues of information saturation? Does information parity create ambiguity in control authority? Will information sharing induce undesirable or unstable gaming behavior between agents? This paper will explore the effect of current and proposed information sharing between different ATM agents. The paper will primarily concentrate on bilateral tactical interactions between specific agents (Pilot/Controller; Controller/Controller; Pilot/Dispatcher; Controller/Dispatcher) however it will also briefly discuss multilateral interaction and more strategic interactions.

Hansman, R. John↗

Operation Optimization Using Reinforcement Learning with Integrated Artificial Reasoning Framework

In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.

Kim, Junyung↗

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing heterogeneity in vehicle capabilities and density, increased levels of automation are likely necessary to achieve operational safety and efficiency goals. This paper focuses on one example where increased automation has been suggested. Autonomous operations will need contingency management systems that can monitor evolving risk across a span of interrelated (or interdependent) hazards and, if necessary, execute appropriate control interventions via supervised or automated decision making. Accommodating this complex environment may require automated functions (autonomy) that apply artificial intelligence (AI) techniques that can adapt and respond to a quickly changing environment. This paper explores the use of Deep Reinforcement Learning (DRL) which has shown promising performance in complex and high-dimensional environments where the objective can be constructed as a sequential decision-making problem. An extension of a prior formulation of the contingency management problem as a Markov Decision Process (MDP) is presented and uses a DRL framework to train agents that mitigate hazards present in the simulation environment. A comparison of these learning-based agents and classical techniques is presented in terms of their performance, verification difficulties, and development process.

machine learningautonomous systems; flight simulat↗

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing heterogeneity in vehicle capabilities and density, increased levels of automation are likely necessary to achieve operational safety and efficiency goals. This paper focuses on one example where increased automation has been suggested. Autonomous operations will need contingency management systems that can monitor evolving risk across a span of interrelated (or interdependent) hazards and, if necessary, execute appropriate control interventions via supervised or automated decision making. Accommodating this complex environment may require automated functions (autonomy) that apply artificial intelligence (AI) techniques that can adapt and respond to a quickly changing environment. This paper explores the use of Deep Reinforcement Learning (DRL) which has shown promising performance in complex and high-dimensional environments where the objective can be constructed as a sequential decision-making problem. An extension of a prior formulation of the contingency management problem as a Markov Decision Process (MDP) is presented and uses a DRL framework to train agents that mitigate hazards present in the simulation environment. A comparison of these learning-based agents and classical techniques is presented in terms of their performance, verification difficulties, and development process.

machine learning↗

DEVELOP: Building Capacity in Early Career Individuals to Apply NASA Earth Observations in Health and Air Quality

The NASA DEVELOP National Program builds capacity to use and apply NASA Earth observations to address environmental concerns around the globe. The DEVELOP model builds capacity in both participants (students, recent graduates, and early and transitioning career professionals), who conduct the projects, and partners (decision and policy makers), who are recipients of project methodologies and results. While projects focus on a spectrum of thematic topics, health and air quality related topics made up more than a quarter of DEVELOP’s FY2023 project portfolio. These projects worked in collaboration with over 30 partner organizations throughout the US and internationally to explore how Earth observations could support decision making in areas such as health and air quality, wildland fires, climate, urban development, and transportation and infrastructure. This presentation provides an overview of the DEVELOP model of building capacity to use Earth observation data, environmental decision-making needs identified in health and air quality relevant projects, DEVELOP project case studies, commonly utilized data sources, and lessons learned. Key takeaways include best practices for project development and execution, how to balance learning with delivering impactful results for partners, and water resource relevant decisions guided by project end products.

Remote sensing↗

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗