Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

The significance of structural power in Strategic Environmental Assessment

This article presents a study of how power dynamics enables and constrains the influence of actors upon decision-making and Strategic Environmental Assessment (SEA). Based on structuration theory, a model for studying power dynamics in strategic decision-making processes is developed. The model is used to map and analyse key decision arenas in the decision process of aluminium production in Greenland. The analysis shows that communication lines are an important resource through which actors exercise power and influence decision-making on the location of the aluminium production. The SEA process involved not only reproduction of formal communication and decision competence but also production of alternative informal communication structures in which the SEA had capability to influence. It is concluded, that actors influence strategic decision making, and attention needs to be on not only the formal interactions between SEA process and strategic decision-making process but also on informal interaction and communication between actors as the informal structures, which can be crucial to the outcome of the decision-making process. This article is meant as a supplement to the understanding of power dynamics influence in IA processes and as a contribution to the IA research field with a method to analyse power dynamics in strategic decision-making processes. The article also brings reflections of strengths and weaknesses of using the structuration theory as an approach to power analysis. - Highlights: Black-Right-Pointing-Pointer Informal interaction influenced process despite the presence of formalised rules. Black-Right-Pointing-Pointer Interdependence of actors influenced SEA effectiveness. Black-Right-Pointing-Pointer SEA practitioners successfully exercised power to influence decision-making. Black-Right-Pointing-Pointer Power dynamics are properties of actors' interactions in decision-making. Black-Right-Pointing-Pointer Power structures can be enabling and not solely limiting.

54 ENVIRONMENTAL SCIENCES↗

Development of a Severe Accident Analysis Engine Using Approximate Reasoning

In hypothetical severe accident scenarios, nuclear power plant safety is challenged by core degradation and release of fission products. To aid the plant operator and technical support center staff, research has been performed to develop understanding of severe accident phenomenology, assessing their risk and devise measures to mitigate accident consequences (Sehgal, 2011). Nuclear power plant accidents involve highly complex physical and chemical interactions, a large number of safety related systems, and emergency operating procedures (EOP) and severe accident management guidelines (SAMG). Large number of factors with uncertainty and stress can overwhelm the operators. The overall objective of the present research is to develop a methodology and tools that an operator can use to predict severe accident progression and make effective decisions to arrest and manage the accident under large uncertainties. Towards this goal, this study examines a novel approach that brings to bear a combined use of techniques in artificial intelligence (Russel and Norvig, 2010), including Bayesian Network (BN), Answer Set Programming (ASP) and Fuzzy Inference (FI) to achieve faster-than-real-time, yet sufficiently accurate analysis of severe accident progression. Bayesian network (BN) is a type of probabilistic graphical models that can be used to represent knowledge and conditional dependencies about an uncertain realm. It is useful for capturing the causal relationships in a complex system. It also allows prediction via Bayesian inference (Kelly and Smith, 2012). It is composed of nodes and edges, which express random variables and probabilistic relationships between the nodes, respectively. This relationship, given by conditional probability is calculated using stochastic methods. The BN is used in several systems for analysis and management of accident risk; e.g. (Knochenhauer and Frid, 2010). In those systems, the nodes or so-called 'effective factors' are presumably known within the network by system descriptions in SAMGs. There are two steps to configure the BN, namely (i) identifying compositions within the network and (ii) defining conditional dependency between nodes. The first step is performed following the spirit of ASP (Baral, 2003) using Prolog (Wielemaker, 2005). Knowledge representation is used to build databases required for processing by ASP. Knowledge representation is defined as the expression of knowledge in a way that is understandable to both human and computers. Originally knowledge indicates data, information and facts. To focus, knowledge should be formed to achieve a goal. In a severe accident, key physics and safety related components status are defined according to a failure mode. The conditional dependencies between nodes are generated by approximate reasoning using Fuzzy inference (Zadeh, 1995). Fuzzy logic is a multiple-valued logic to treat ambiguous features such as linguistic description. It indicates possibility, which is distinguished from probability. Fuzzy set consists of linguistic variables according to the fixed rule. In other words, even uncertain states could be expressed as not binary logic, but as many-value logic by rule-based technology. Fuzzy control system is comprised of Fuzzy inference engine that is performed based on the 'If-Then Rule'. The 'If-Then Rule' is of the following form. If Y1 is B11 and Y2 is B12 then Z is C1. If Y1 is B21 and Y2 is B22 then Z is C2. Y1 and Y2 are inputs, which indicate conditional variables. Z indicates decision-making and both B and C are linguistic variables. With this rule-based technique, the approximate reasoning can be realized by Fuzzy inference. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Lessons learned from the Siting Process of an Interim Storage Facility in Spain - 12024

On 29 December 2009, the Spanish government launched a site selection process to host a centralised interim storage facility for spent fuel and high-level radioactive waste. It was an unprecedented call for voluntarism among Spanish municipalities to site a controversial facility. Two nuclear municipalities, amongst a total of thirteen municipalities from five different regions, presented their candidatures to host the facility in their territories. For two years the government did not make a decision. Only in November 30, 2011, the new government elected on 20 November 2011 officially selected a non-nuclear municipality, Villar de Canas, for hosting this facility. This paper focuses on analysing the factors facilitating and hindering the siting of controversial facilities, in particular the interim storage facility in Spain. It demonstrates that involving all stakeholders in the decision-making process should not be underestimated. In the case of Spain, all regional governments where there were candidate municipalities willing to host the centralised interim storage facility, publicly opposed to the siting of the facility. (author)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Making a Water Data System Responsive to Information Needs of Decision Makers

Evidence-based environmental management requires data that are sufficient, accessible, useful and used. A mismatch between data, data systems, and data needs for decision making can result in inefficient and inequitable capital investments, resource allocations, environmental protection, hazard mitigation, and quality of life. In this paper, we examine the relationship between data and decision making in environmental management, with a focus on water management. We focus on the concept of decision-driven data systems —data systems that incorporate an assessment of decision-makers' data needs into their design. The aim of the research was to examine the process of translating data into effective decision making by engaging stakeholders in the development of a water data system. Using California's legislative mandate for state agencies to integrate existing water and other environmental data as a case study, we developed and applied a participatory approach to inform data-system design and identify unmet data needs. Using workshops and focused stakeholder meetings, we developed 20 diverse use cases to assess data sources, availability, characteristics, gaps, and other attributes of data used for representative decisions. Federal and state agencies made up about 90% of the data sources, and could readily adapt to a federated data system, our recommended model for the state. The remaining 10% of more-specialized data, central to important decisions across multiple use cases, would require additional investment or incentives to achieve data consistency, interoperability, and compatibility with a federated system. Based on this assessment, we propose a typology of different types of data limitations and gaps described by stakeholders. We also propose technical, governance, and stakeholder engagement evaluation criteria to guide planning and building environmental data systems. Data-system governance involving both producers and users of data was seen as essential to achieving workable standards, stable funding, convenient data availability, resilience to institutional change, and long-term buy-in by stakeholders. Our work provides a replicable lesson for using decision-maker and stakeholder engagement to shape the design of an environmental data system, and inform a technical design that addresses both user and producer needs.

Cantor, Alida↗

Multi-criteria evaluation in strategic environmental assessment for waste management plan, a case study: The city of Belgrade

Highlights: • The paper deals with the specific method of multi-criteria evaluation applied in drafting the SEA for the Belgrade WMP. • MCE of the planning solutions, assessed according to 37 objectives of the SEA and four sets of criteria, was presented in the matrix form. • The results are presented in the form of graphs so as to be easily comprehensible to all the participants in the decision-making process. • The results represent concrete contribution proven in practice. - Abstract: Strategic Environmental Assessment (SEA) is one of the key instruments for implementing sustainable development strategies in planning in general; in addition to being used in sectoral planning, it can also be used in other areas such as waste management planning. SEA in waste management planning has become a tool for considering the benefits and consequences of the proposed changes in space, also taking into account the capacity of space to sustain the implementation of the planned activities. In order to envisage both the positive and negative implications of a waste management plan for the elements of sustainable development, an adequate methodological approach to evaluating the potential impacts must be adopted and the evaluation results presented in a simple and clear way, so as to allow planners to make relevant decisions as a precondition for the sustainability of the activities planned in the waste management sector. This paper examines the multi-criteria evaluation method for carrying out an SEA for the Waste Management Plan for the city of Belgrade (BWMP). The method was applied to the evaluation of the impacts of the activities planned in the waste management sector on the basis of the environmental and socioeconomic indicators of sustainability, taking into consideration the intensity, spatial extent, probability and frequency of impact, by means of a specific planning approach and simple and clear presentation of the obtained results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Blockchain for Fault-Tolerant Grid Operations Version 2.0

This report explores the potential of distributed ledger technology (DLT) as a transformative tool to enhance fault-tolerant operations in electrical distribution systems. Leveraging DLT's core attributes, including an immutable decentralized ledger, distributed consensus mechanisms, and state replication capabilities, this study focuses on three critical use cases. A central aspect of this research centers on the utilization of a consensus-driven ledger, providing actors within the system, such as distributed resources, with access to a reliable data repository. This empowers these actors to collaborate effectively and make informed decisions, all securely recorded on the blockchain. The first use case concentrates on data configuration, utilizing mathematical criteria---particularly, the chi-squared test for gross error detection---to identify trustworthy sensors for advanced decision-making. Building upon this foundation of trust, the second use case, topology identification, accurately determines circuit breaker states, unveiling the distribution network's topology. Ultimately, the third use case leverages this trust to execute switching actions, reconfiguring feeders and restoring power to disconnected customers after fault events. The concept of trust serves as a cornerstone in this approach, marking a departure from traditional fault location, isolation, and service restoration (FLISR) methods. Additionally, the blockchain-based architecture introduces decentralization, empowering disconnected areas to make autonomous decisions, even when communication with a central control center is disrupted. The primary contributions of this report are twofold: (1) a novel approach for evaluating distribution system voltage areas while preserving data ownership and (2) the implementation of interactions between distribution network areas using the actor model. Unlike the previous sequential approach for evaluating the area connection voltages, which required a radial network topology, this study's area model reduction enables a more versatile approach. The area model reduction addresses issues of prolonged data waiting times and multiple points of failure within the previous approach. Notably, the presented evaluation for the reduced network model area connection reveals a significant increase in the differences in voltage magnitudes. Simulation and evaluation of area agents across four distinct cases elucidate the area-level interaction behavior during a fault event. Simulations demonstrate that the proposed distributed FLISR (DFLISR) approach can successfully restore service to an affected area. Varying message delays and message loss probabilities in each simulation case underscore their impacts on restoration times, ranging from 3 min and 32 s to 6 min and 19 s. In contrast, power is not restored in an area in one of our simulation cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A window on urban sustainability

Sustainable urban development requires the integration of environmental interests in urban planning. Although various methods of environmental assessment have been developed, plan outcomes are often disappointing due to the complex nature of decision-making in urban planning, which takes place in multiple arenas within multiple policy networks involving diverse stakeholders. We argue that the concept of ‘decision windows’ can structure this seemingly chaotic chain of interrelated decisions. First, explicitly considering the dynamics of the decision-making process, we further conceptualized decision windows as moments in an intricate web of substantively connected deliberative processes where issues are reframed within a decision-making arena, and interests may be linked within and across arenas. Adopting this perspective in two case studies, we then explored how decision windows arise, which factors determine their effectiveness and how their occurrence can be influenced so as to arrive at more sustainable solutions. We conclude that the integration of environmental interests in urban planning is highly dependent on the ability of the professionals involved to recognize and manipulate decision windows. Finally, we explore how decision windows may be opened. -- Highlights: • Decision-making about sustainable urban development occurs in networks. • The concept of ‘decision windows’ was further elaborated. • Decision windows help understand how environmental interests enter decision-making. • Decision windows can, to some extent, be influenced.

54 ENVIRONMENTAL SCIENCES↗

Robotic Planning under Uncertainty in Spatiotemporal Environments in Expeditionary Science

In the expeditionary sciences, spatiotemporally varying environments -- hydrothermal plumes, algal blooms, lava flows, or animal migrations -- are ubiquitous. Mobile robots are uniquely well-suited to study these dynamic, mesoscale natural environments. We formalize expeditionary science as a sequential decision-making problem, modeled using the language of partially-observable Markov decision processes (POMDPs). Solving the expeditionary science POMDP under real-world constraints requires efficient probabilistic modeling and decision-making in problems with complex dynamics and observational models. Previous work in informative path planning, adaptive sampling, and experimental design have shown compelling results, largely in static environments, using data-driven models and information-based rewards. However, these methodologies do not trivially extend to expeditionary science in spatiotemporal environments: they generally do not make use of scientific knowledge such as equations of state dynamics, they focus on information gathering as opposed to scientific task execution, and they make use of decision-making approaches that scale poorly to large, continuous problems with long planning horizons and real-time operational constraints. In this work, we discuss these and other challenges related to probabilistic modeling and decision-making in expeditionary science, and present some of our preliminary work that addresses these gaps. We ground our results in a real expeditionary science deployment of an autonomous underwater vehicle (AUV) in the deep ocean for hydrothermal vent discovery and characterization. Our concluding thoughts highlight remaining work to be done, and the challenges that merit consideration by the reinforcement learning and decision-making community.

Preston, Victoria↗

Integrating Land Cover Modeling and Adaptive Management to Conserve Endangered Species and Reduce Catastrophic Fire Risk

Land cover modeling is used to inform land management, but most often via a two-step process where science informs how management alternatives can influence resources and then decision makers can use this to make decisions. A more efficient process is to directly integrate science and decision making, where science allows us to learn to better accomplish management objectives and is developed to address specific decisions. Co-development of management and science is especially productive when decisions are complicated by multiple objectives and impeded by uncertainty. Multiple objectives can be met by specification of tradeoffs, and relevant uncertainty can be addressed through targeted science (i.e., models and monitoring). We describe how to integrate habitat and fuels monitoring with decision making focused on dual objectives of managing for endangered species and minimizing catastrophic fire risk. Under certain conditions, both objectives might be achieved by a similar management policy, but habitat trajectories suggest tradeoffs. Knowledge about system responses to actions can be informed by applying competing management actions to different land units in the same system state and by ideas about fire behavior. Monitoring and management integration is important to optimize state-specific management decisions and increase knowledge about system responses. We believe this approach has broad utility for and cover modeling programs intended to inform decision making.

adaptive management↗

Demystifying Cyberattacks: Potential for Securing Energy Systems With Explainable AI : Preprint

Modernization of energy systems has led to in- creased interactions among multiple critical infrastructures and diverse stakeholders making the challenge of operational decision making more complex and at times beyond cognitive capabilities of human operators. The state-of-the-art machine learning and deep learning approaches show promise of supporting users with complex decision-making challenges, such as those occurring in our rapidly transforming cyber-physical energy systems. However, successful adoption of data-driven decision support technology for critical infrastructure will be dependent on the ability of these technologies to be trustworthy and contextually interpretable. In this paper, we investigate the feasibility of implementing XAI for interpretable detection of cyberattacks in the energy system. Leveraging a proof-of-concept simulation use case of detection of a data falsification attack on a photovoltaic system using XGBoost algorithm, we demonstrate how Local Interpretable Model-Agnostic Explanations (LIME), a flavor XAI approach, can help provide contextual and actionable interpretation of cyberattack detection.

artificial intelligence↗

Runway Configuration Management with Offline Reinforcement Learning

Runway configuration management (RCM) is a challenging task, and it affects the efficiency of the National Airspace System (NAS) and airport surface operations significantly. Each airport, depending on the geometry, capacity, local climate patterns, etc. has multiple configurations for the runway usage for arriving and departing flights. Many factors such as the incoming/outgoing traffic load, wind direction and speed, convective weather, cloud ceiling and other environmental factors might affect the choice of a runway configuration at any point in time. However, other factors such as safety measures and regulations, noise abatement, capacity of each configuration, and preference of the air traffic controllers (ATCs) can also play a significant role in selecting the configuration. A sub-optimal selection of the runway configuration, or delay in making configuration changes might result in significant increase in taxi times for aircraft on the surface of the airport, fuel and energy use of the aircraft, and maintenance costs. It can also lead to safety concerns, such as an aircraft performing one or more go-arounds before being able to land. All these factors make RCM an extremely important and challenging decision-making process for the ATCs. The current state of practice sets the runway configuration by the ATCs based on relevant information available at the time including weather, traffic, noise abatement, safety bounds, etc. This makes the decision-making process subjective based on the accuracy of the available information and the bias in human decision making. Unfortunately, this approach yields poor results (e.g., significant delays) if the predicted outcomes are uncertain and their relative impact is not well understood. This is especially evident when the uncertainty increases the size of possible predicted outcomes (combinatorial explosion in possible scenarios) that cannot be handled by human reasoning. On the other hand, an automated approach based on machine intelligence can make use of historical data and search through all (or significant amount of) possible scenarios under uncertainty and make well-informed decisions.

Milad Memarzadeh↗

Error-associated behaviors and error rates for robotic geology

This study explores human error as a function of the decision-making process. One of many models for human decision-making is Rasmussen's decision ladder [9]. The decision ladder identifies the multiple tasks and states of knowledge involved in decision-making. The tasks and states of knowledge can be classified by the level of cognitive effort required to make the decision, leading to the skill, rule, and knowledge taxonomy (Rasmussen, 1987). Skill based decisions require the least cognitive effort and knowledge based decisions require the greatest cognitive effort. Errors can occur at any of the cognitive levels.

error rates↗

Method for optimizing resource allocation in a government organization

The managers in Federal agencies are challenged to control the extensive activities in government and still provide high-quality products and services to the American taxpayers. Considering today's complex social and economic environment and the $3.8 billion daily cost of operating the Federal Government, it is evident that there is a need to develop decision-making tools for accurate resource allocation and total quality management. The goal of this thesis is to provide a methodical process that will aid managers in Federal Government to make budgetary decisions based on the cost of services, the agency's objectives, and the customers' perception of the agency's product. A general resource allocation procedure was developed in this study that can be applied to any government organization. A government organization, hereafter the 'organization,' is assumed to be a multidivision enterprise. This procedure was applied to a small organization for the proof of the concept. This organization is the Technical Services Directorate (TSD) at the NASA Lewis Research Center in Cleveland, Ohio. As part of the procedure, a nonlinear programming model was developed to account for the resources of the organization, the outputs produced by the organization, the decision-maker's views, and the customers' satisfaction with the organization. The information on the resources of the organization was acquired from current budget levels of the organization and the human resources assigned to the divisions. The outputs of the organization were defined and measured by identifying metrics that assess the outputs, the most challenging task in this study. The decision-maker's views are represented in the model as weights assigned to the various outputs and were quantified by using the analytic hierarchy process. The customer's opinions regarding the outputs of the organization were collected through questionnaires that were designed for each division individually. Following the philosophy of total quality management, information on customers' satisfaction is presented in the model as the quality of output. The model is a nonlinear one whose objective is to maximize customers' satisfaction such that the total cost of operation does not exceed the organization's budget. This model represents a structured approach or policy mechanism, at the agency level, to make capital investment decisions based on the priorities of the agency and the quality of outputs. This procedure applied to TSD resulted in a resources allocation scheme that was reasonable and acceptable to the decision-makers and, as expected, dependent on the assumptions and accuracy of the data used in the model.

Afarin, James↗

Surrogate Modeling for Capacity Planning of Charging Station Equipped with PV and Hydropneumatic Energy Storage

Due to the promising potential for environmental sustainability, there has been a significant increase of electric vehicles (EVs) and plug-in hybrid electric vehicles (PHEV) in the market. To support this increasing demand for EVs and PHEVs, challenges related to capacity planning and investment costs of public charging infrastructure must be addressed. Hence, in this paper, a capacity planning problem for EV charging stations is developed and aims to balance current capital investment costs and future operational revenue. The charging station considered in this work is assumed to be equipped with solar photovoltaic panel (PV) and an energy storage system which could be electric battery or the recently invented hydro-pneumatic energy storage (GLIDES, Ground-Level Integrated Diverse Energy Storage) system. A co-optimization model that minimizes investment and operation cost is established to determine the global optimal solution while combining the capacity and operational decision making. The operational decision making considers EV mobility which is modeled as an Erlang-loss system. Meanwhile, stochastic programming is adopted to capture uncertainties from solar radiation and charging demand of the EV fleet. To provide a more general and computationally efficient model, main configuration parameters are sampled in the design space and then fixed in solving the co-optimization model. The model can be used to provide insights for charging station placement in different practical situations. The sampled parameters include: the total number of EV charging slots, the PV area, the maximum capacity of the energy storage system, and daily mean EV arrival number in the Erlang-loss system. Based on the sampled parameter combinations and its responses, black-box mappings are then constructed using surrogate models (RBF, Kriging etc). The effectiveness of proposed surrogate modeling approach is demonstrated in the numerical experiments.

Chen, Yang↗

Alternative Perspectives on Risk

The goal of the commercial air transport system is to provide air transportation to the flying public at an acceptable cost with minimal risk. in an ideal situation these three goals would support each other. In fact, it is sometimes the case that the goals conflict: getting passengers to their destinations on time may conflict with fixing a minor mechanical malfunction that may or may not impact safety; flying a route that will avoid turbulence, thereby providing passengers with a more comfortable ride, may consume more fuel; managing traffic density may mean aircraft are delayed or must use an approach that will result in a long taxi to their gates, costing time and fuel. Various players in the system--pilots, dispatchers, controllers, as well as managers in the airline carriers and traffic management system--make decisions every day that involve trade-offs of benefits and costs. The prospect of revisions in the air traffic management system, with shifts in responsibilities from controllers to users, including airline operations center personnel and pilots, means that individuals may be performing either new jobs or old jobs under new guidance. It will be essential to know how the various players (a) perceive the risks and benefits associated with the decisions they will make under the old and new control structures, and (b) how much risk they are willing to accept in making decisions. Risk is here defined as the probability and magnitude of negative events (after Slovic, 1987). Of primary interest are risks associated with traffic, weather, and operational factors such as schedule, fuel consumption, and passenger service. Previous research has documented differences between groups in perceptions of risks associated with both everyday and aviation related situations. Risk perception varies as a function of familiarity with the situation, degree to which one is potentially affected by the risk, the level of control one has over the situation, and one's level of experience and responsibility in the situation. In our presentation we will consider several factors that may influence differences in risk perception, risk tolerance and risk management among the three major categories of participants in the aviation system (pilots, dispatchers, and controllers). Primary factors that may affect risk attitudes (the collective term we will use for the three components of risk) include: expertise or job-specific knowledge or training, personal involvement or vulnerability to consequences, goals, time horizon (imminence of consequences), span of control and type of control, and information or technology support. These will be considered in the context of five different types of risk (physical threat, economic, social, legal, and ethical). A study designed to study differences between pilots and controllers in their perceptions and responses to traffic risks under the present and a user-preferred control situation will be described. Future studies involving dispatchers' risk perceptions regarding various types of risk will be discussed.

Davison, Jeannie↗

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

Developing a Process for Collaboration-Based Siting of a Federal Consolidated Interim Storage Facility in the United States: Learning from Communities Living with Legacy Waste

In June of 2023, the U.S. Department of Energy (DOE), Office of Nuclear Energy (NE) announced the selection of its Collaboration-Based Siting (CBS) Consortia, a group of 12 awardees, including the Consortium for Risk Evaluation with Stakeholder Participation (CRESP) (led by Vanderbilt University) to assist DOE-NE with the development of its process for siting a federal consolidated interim storage facility (FCISF) for spent nuclear fuel (SNF) storage. At this time, DOE NE is not soliciting interested host communities, rather the CBS Consortia are tasked with in-depth engagement, mutual learning, and capacity building to provide DOE NE with feedback on the CBS process. CRESP’s objective is to engage communities in two regions (the Pacific Northwest and the Southeast) with sites currently storing defense- and research-related SNF to foster learning concerning the best and worst practices in community participation in risk-informed decision making. This includes learning from existing structures for public input in radioactive waste management decision making [e.g. citizen advisory boards (CABs)] and other local parties about how to build and sustain trust among the parties. CRESP has been working to engage stakeholders and Tribes surrounding two DOE sites historically differing in receptiveness to engaging with DOE and trusting in DOE to accomplish its missions. CRESP’s approach to date has consisted of (1) engaging voluntarily members and former members of the DOE Office of Environmental Management’s CABs to develop a mutual understanding of their perspectives, values, and experiences related to risk and participatory decision making; (2) engaging members of those communities that would likely be part of any radioactive waste management discussions and who may provide valuable feedback for the development of the CBS process; and in the longer term, (3) engaging communities to foster knowledge sharing on understanding and definitions of risk and how risk is factored into community decision making. Our emphasis is to identify opportunities for improving risk communication frameworks, strategies, and decision making. The selection of a future FCISF site is likely to result in the creation of a structure similar to a CAB composed of members of the local community. We anticipate that these insights can help DOE NE learn from existing participatory risk communication structures in place at sites storing defenseor research-related SNF to understand best practices for fostering enduring and participatory relationships with future CABs. Within this paper, we (1) describe CRESP’s overall approach to assisting DOE NE with maturing the CBS process; (2) present a summary of preliminary phase 1 project results, including the development of a body of knowledge (describing available resources to support community engagement, risk communica tion, and participatory decision making) and community ecosystem information (leveraging demographic, social, economic, and environmental attribute mapping and advanced sentiment analysis of social media data); and (3) based on these results, provide observations for future research opportunities to support the development of CBS processes for radioactive waste management facilities, generally.

collaboration-based siting↗

A Comparison of GoldSim, RESRAD-Onsite, and NORMALYSA Modeling Tools at Radioactive Waste Sites - 19480

Radioactive waste disposal and associated decision making is a challenging problem around the world. A strong performance assessment model plays a crucial role in making good management and remediation decisions and in optimizing the performance of a site. The International Atomic Energy Agency (IAEA) MODARIA II Working Group 1 (WG1) is comparing the performance of various modeling platforms used at Naturally Occurring Radioactive Material (NORM) and legacy waste sites to support risk-informed decision making. Neptune and Company, Inc. (Neptune) has developed probabilistic performance assessment models using the GoldSim system modeling software at a variety of radioactive waste sites. This paper presents a comparison between GoldSim and two other tools used to evaluate radiation exposure and their associated risks: the NORM And Legacy Site Assessment (NORMALYSA) tool used to assess risk at the Zapadnoe mill tailings site, and the residual radioactivity (RESRAD-Onsite) computer program used to calculate Authorized Limits at the Los Alamos National Laboratory (LANL). The International Atomic Energy Agency (IAEA) supported development of NORMALYSA based off of Ecolego 6.0, in which the user connects several universal modules, representing various environmental transport and exposure pathways, and enters in site-specific data. Further work with NORMALYSA has continued under the MODARIA II WG 1. A radionuclide transport and dose calculation model of the Zapadnoe uranium mill tailings site at the Pridneprovsky Chemical Plant in the Ukraine has been configured by MODARIA II WG1 to test the capabilities of NORMALYSA. Under this test case, contaminant transport and effective dose calculations were performed for two exposure scenarios. The onsite worker is exposed via external ground irradiation and radon and radioactive dust inhalation. The offsite resident defines a residence established 300 years after institutional control has ended, 800 meters downstream from the site with exposure pathways including: ingestion of garden vegetables irrigated by contaminated ground water, ingestion of fish from the Konoplyanka River and agricultural activities in the contaminated garden. GoldSim modeling software is a dynamic probabilistic modeling platform that evaluates uncertainty in a robust and transparent manner. Although GoldSim provides contaminant and radionuclide transport modules to facilitate integrated modeling of radionuclide migration in the environment, these features are not embedded in an existing modeling framework, except as created by the user. Neptune developed a GoldSim model for the two exposure scenarios of the Zapadnoe test case. Neptune's Generic PA Model was used as a starting point for the Zapadnoe site. Input parameters for the GoldSim model include site-specific parameters from the MODARIA Working Group as well as parameters from the Generic PA Model and other PA models created by Neptune. For the other comparison, Version 7.0 of RESRAD-Onsite, developed by Argonne National Laboratory for the U.S. Department of Energy (DOE), was used to calculate Authorized Limits for LANL. Authorized Limits are concentrations of radionuclides in soil that support the evaluation process to clear land for release under different uses. The RESRAD-Onsite computer code was used to calculate Authorized Limits because this program was specifically designed to derive radionuclide soil guidelines corresponding to a specific dose criterion. The scope of the RESRAD dose or risk evaluation is constrained to the transport and exposure pathways that have been included in the computer code. To assist in illustrating the capability of GoldSim modeling software, a GoldSim model was created to replicate the calculation of LANL's Authorized Limits for soil. The main exposure pathways in this model are inhalation of dust and gas, plant ingestion, soil ingestion, and external ground irradiation. All of the processes and outputs of RESRAD-Onsite and NORMALYSA can be created in a GoldSim model, but the value of GoldSim lies in its flexibility for application to any of a wide variety of environmental modeling problems. GoldSim allows development of site-specific inventory, transport mechanisms and risk assessment scenarios. If all potentially complete release, transport, and exposure pathways are addressed in an existing dose and risk assessment computer code, and if the code's capabilities fulfill the project modeling objectives, then expending resources to create a GoldSim model may not be necessary. Site optimization and good decision making about site management are often best when supported with the flexibility of GoldSim as a modeling tool. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗