Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Transportation Hub Infrastructure Expansion: Decision Support Under Uncertainty

The Athena project (www.athena-mobility.org) has worked to investigate the relationship between the Dallas-Fort Worth Airport (DFW) and the greater Dallas area in order to better understand and therefore better inform future decision-making regarding the critical infrastructure that influence mobility between the airport and the city. Through this work, infrastructure related to curbside pickup and drop-off, parking, public transit, and the road network congestion were identified as critical to the operation of the DFW transportation hub. The infrastructure analysis and expansion aspect of the Athena project is focused on the restructuring of the CTA curb as a hierarchical curb and the building or repurposing of parking infrastructure as the interplay between these two areas. Many sources of uncertainty exist that may impact future airport and transportation hub operations, such as passenger volume growth, population demographic changes over time, electric vehicle (EV) adoption rates, and autonomous vehicle (AV) adoption rates. Due to these sources of uncertainty, we have selected for our research a modeling framework that can capture various types of uncertainty and hedge against those uncertainties in the optimization process. We analyze road network and curb congestion, the rise of transportation networking companies, trends in parking usage, existing policies around this infrastructure, airport revenue streams, and other contributing factors to enable infrastructure decision making with less uncertainty. To accomplish this wholistic analysis, we have developed a novel multi-stage, multi-period stochastic optimization model which considers the airport's decisions from 2025-2045 under different possible future macro trajectories and day-to-day variations in operational conditions captured as "annual representation of operations" scenarios with respective probabilities. This model has also been designed to leverage the outputs of various efforts under the Athena project to create a combined decision framework for infrastructure decisions. These various efforts include the route optimization model, the ASPIRES simulation, the mode choice model, and the SUMO traffic simulation. Our computational experiments of this system at scale have resulted in a working version of our infrastructure model which enables the explicit representation and consideration of various sources of uncertainty in the decision process to enable robust, flexible decision-making. This model has been effectively run on NREL's HPC system, Eagle, with large numbers of stochastic scenarios and shows promise as a scalable tool for robust consideration of uncertainties in airport planning. We have tested our model using 30,240 operational circumstances in total, resulting in a problem with more 200 million variables. This model was solved in several different configurations, and a workflow to simulate the performance of the infrastructure model results was developed and deployed. In general, our results indicate that a combination of remote parking, remote curb infrastructure, and dynamic pricing can generate revenue, reduce emissions, accommodate emerging technologies such as AVs and EVs, and manage airport passenger growth over time. We note the success of the proposed strategy depends on the data collection and forecasting abilities of DFW. We have also seen that the AV adoption by TNCs might necessitate larger amounts of remote curb. The results of this work inform strategies for airport infrastructure decision making, as well as demonstrate the value of an adaptable model, but also indicate that there are avenues remaining where further research would be of value.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Next Generation Melter Optioneering Study (Interim Report)

The next generation melter (NOM) development program includes a down selection process to aid in determining the recommended vitrification technology to implement into the WTP at the first melter change-out which is scheduled for 2025. This optioneering study presents a structured value engineering process to establish and assess evaluation criteria that will be incorporated into the down selection process. This process establishes an evaluation framework that will be used progressively throughout the NGM program, and as such this interim report will be updated on a regular basis. The workshop objectives were achieved. In particular: (1) Consensus was reached with stakeholders and technology providers represented at the workshop regarding the need for a decision making process and the application of the D{sub 2}0 process to NGM option evaluation. (2) A framework was established for applying the decision making process to technology development and evaluation between 2010 and 2013. (3) The criteria for the initial evaluation in 2011 were refined and agreed with stakeholders and technology providers. (4) The technology providers have the guidance required to produce data/information to support the next phase of the evaluation process. In some cases it may be necessary to reflect the data/information requirements and overall approach to the evaluation of technology options against specific criteria within updated Statements of Work for 2010-2011. Access to the WTP engineering data has been identified as being very important for option development and evaluation due to the interface issues for the NGM and surrounding plant. WRPS efforts are ongoing to establish precisely data that is required and how to resolve this Issue. It is intended to apply a similarly structured decision making process to the development and evaluation of LAW NGM options.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Teaching Freight Mode Choice Models New Tricks Using Interpretable Machine Learning Methods

Understanding and forecasting the intricate freight mode choice behavior under various industry, policy, and technology contexts is essential in freight planning and policymaking. Numerous models have been developed in prior studies to provide insights into freight mode selection, the majority of which use discrete choice models such as multinomial logit (MNL) models. However, logit models often rely on linear specifications of independent variables, despite potential nonlinear relationships in the data. Moreover, there often lacks a heuristic and efficient approach to identify such complex relationships to define the logit model specifications. To fill this gap, we developed an MNL model for freight mode choice using the insights from state-of-the- art machine learning (ML) models. ML models can capture the nonlinear nature of the complex decision-making process, and recent advances in 'explainable AI' have greatly improved their interpretability. The interpretable ML methods help enhance the performance of MNL models and advance knowledge of freight mode choice. Specifically, the influential factors and their relationship with individual modes are identified using SHapley Additive exPlanations (SHAP) to improve the MNL's performance. The workflow is demonstrated in a case study of Austin, Texas, and the SHAP results reveal multiple nonlinear relationships predicted by ML models. Incorporating those relationships into MNL model specifications improves the interpretability and accuracy of the MNL model compared to a conventional MNL model. Findings from this study can be used to guide freight planning and inform policymakers and practitioners on how key factors affect freight decision-making.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

Bottom-up responses to environmental and social impact assessments: A case study from Guatemala

In this article we take a closer look at resistance to the practice of Environmental Impact Assessment (EIA) in mining and energy projects in Guatemala. Collectivities resisting mining and hydropower projects in Guatemala are increasingly using the evaluations of EIAs conducted by international independent professionals. Reaching out to international experts is facilitated by local communities' engagements in transnational networks bringing together activists, NGOs, scientists, journalists and others. We argue that resistance movements resort to international professionals to challenge the limits imposed on them by the national legislation and institutional arrangements as well as by the way in which EIAs are performed in the country. Further, the engagements in networks that facilitate access to knowledge contribute to strengthen the legitimacy of communities' claims. Challenges to and complaints about EIAs are ways in which affected communities try to reclaim their right to participate in decision-making related to their local environment and the development of their communities. Both complaints about EIAs and the use of transnational networks to attain better participation in decision making processes at local levels, illustrated in this study for Guatemala, are common responses to the advancement of extractive industries and hydropower development across Latin America. The widespread of initiatives to challenge EIAs involving international experts in the region show that EIAs have become a sort of a transnational battleground. - Highlights: • Communities’ opposition to extractive projects is rooted in lack of participation in decision-making, including EIAs • Experts’ evaluations of approved EIAs confirm communities’ claims of poor practices in the public sector • Research presented here shows that local communities linked to transnational networks are able to scale up their demands.

54 ENVIRONMENTAL SCIENCES↗

Public participation and environmental impact assessment: Purposes, implications, and lessons for public policy making

In recent years the need to enhance public participation in Environmental Impact Assessment (EIA), and the efficacy of alternative mechanisms in achieving this goal, have been central themes in the EIA literature. The benefits of public participation are often taken for granted, and partly for this reason the underlying rationale for greater public participation is sometimes poorly articulated, making it more difficult to determine how to pursue it effectively. The reasons for seeking public participation are also highly diverse and not always mutually consistent. There has been limited analysis of the implications of different forms and degrees of public participation for public decision making based on EIA, and little discussion of how experience with public participation in EIA relates to debates about participation in policy making generally. This paper distinguishes various purposes for public participation in EIA, and discusses their implications for decision making. It then draws on some general models of public participation in policy making to consider how approaches to participation in EIA can be interpreted and valued, and asks what EIA experience reveals about the utility of these models. It argues that the models pay insufficient attention to the interaction that can occur between different forms of public participation; and to the fact that public participation raises issues regarding control over decision making that are not subject to resolution, but must be managed through ongoing processes of negotiation.

54 ENVIRONMENTAL SCIENCES↗

Cross-Cutting Risk Framework: Mining Data for Common Risks Across the Portfolio

The National Aeronautics and Space Administration (NASA) defines risk management as an integrated framework, combining risk-informed decision making and continuous risk management to foster forward-thinking and decision making from an integrated risk perspective. Therefore, decision makers must have access to risks outside of their own project to gain the knowledge that provides the integrated risk perspective. Through the Goddard Space Flight Center (GSFC) Flight Projects Directorate (FPD) Business Change Initiative (BCI), risks were integrated into one repository to facilitate access to risk data between projects. With the centralized repository, communications between the FPD, project managers, and risk managers improved and GSFC created the cross-cutting risk framework (CCRF) team. The creation of the consolidated risk repository, in parallel with the initiation of monthly FPD risk managers and risk governance board meetings, are now providing a complete risk management picture spanning the entire directorate. This paper will describe the challenges, methodologies, tools, and techniques used to develop the CCRF, and the lessons learned as the team collectively worked to identify risks that FPD programs projects had in common, both past and present.

risk-informed decision making↗

Managing Complex Airplane System Failures Through a Structured Assessment of Airplane Capabilities

This report describes an analysis of current transport aircraft system-management displays and the initial development of a set of display concepts for providing information about aircraft system status. The new display concepts are motivated by a shift away from the current approach to aircraft system alerting that reports the status of physical components, and towards displaying the implications for mission capability. Specifically, the proposed display concepts describe transport airplane component failures in terms of operational consequences of aircraft system degradations. The research activity described in this report is an effort to examine the utility of different representations of complex systems and operating environments to support real-time decision making during off-nominal situations. A specific focus is to develop display concepts that provide more highly integrated information to allow pilots to more easily reason about the operational consequences of the off-nominal situations. The work can also serve as a foundational element to autonomy-supported decision making since we are developing ideas for integrating information from the airplane and the operational environment to support decision making.

operational decision making↗

I Asked 30,000 People in the Nuclear Industry About Safety Culture; This is What I Learned - 19204

Organizations in the nuclear industry place a high value on maintaining the safety of the workforce and community. Some of these organizations do a better job than others when it comes to developing and sustaining a healthy safety culture. We spent six years studying nuclear organizations to better understand the factors that influence safety culture. We used mixed methods to evaluate perceptions of safety culture in these organizations including administering a valid and reliable safety culture survey, conducting one-on-one interviews with managers, and facilitating focus groups with members of the workforce. We analyzed the quantitative and qualitative data collected from more than 30,000 workers in U.S. based organizations. All of the organizations had a nuclear component to their operations. They operated nuclear reactors, processed nuclear materials, decontaminated and decommissioned buildings with radiological contamination, cleaned-up hazardous/mixed waste, and conducted basic science research and development. We talked to craft workers, technicians, engineers, scientific professionals, support personnel, production workers, supervisors and managers. We conducted extensive statistical analysis and learned that, with rare exception, there is a gap between the perceptions of managers and the workforce that they manage. Managers almost always have a more positive perception of safety culture than the people that are actually performing the work. It is not a question of whether there will be a gap; it is simply a matter of the magnitude of the gap. We also learned through exploratory factor analysis that there is one dominant factor that accounted for almost all (75%) of the variance in the perceptions of safety culture. It was the behavior of the leaders, the decisions they made, and the systems they implemented that most influenced the workforce's perception of safety culture. Personal accountability for safety accounted for 14% of the variance, communication and reporting accounted for another 6%. Everything else accounted for the remaining 5%. Management systems, decision making and behavior is the dominant factor and managers almost always have a more positive perception than the people that work for them. People that work in organizations where management exhibits positive decision-making and safety-related behaviors tend to have more positive perceptions of safety culture. Based upon these results, we developed a theory that there were a few important factors on which management could focus on if they sought to influence the safety culture in their organization. Our experience and research suggests that management often fails to recognize five root causes of employee discontent. Employees seek: - To be recognized as an individual; - To be respected; - A sense of stability; - Fairness; - To make a difference. Understanding the perceptions of the workforce is critical because perceptions influence attitudes, which contribute to behaviors that determine individual performance. An organisation's performance is simply the sum of the performance of all of the members of that organization. To change an organisation's safety culture, interventions should target management behavior and decision making for the greatest return on investment. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Earth-Independent Medical Operations (EIMO) Concept of Operations

Compared to the current paradigm for crew health in low-Earth orbit and Lunar missions that rely on constant communication with Mission Control, there is an anticipated shift in medical operations for deep-space exploration missions. This shift stems from mission constraints imposed by the considerable distance from Earth, which include resource limitations due to a lack of resupply, mass, power, volume, and data limitations, challenges imposed by communication latency and the inability to evacuate in case of emergencies. To transition towards a more self-reliant medical approach, a comprehensive strategy is essential to progressively enable crew autonomy and mitigate mission success risks in the challenging environment of space. This transformative shift is collectively referred to as "Earth-Independent Medical Operations" (EIMO), signifying the gradual transfer of medical care and decision-making from terrestrial resources to space-based assets. This transition is aimed at bolstering astronaut health and performance while simultaneously reducing the overall risks associated with space missions. The constraints related to EIMO necessitate an integrated development of medical systems, featuring interoperability with mission planning, vehicle design, spacesuit design, and data architecture. This integration is vital in establishing a robust medical infrastructure that not only supports the well-being of astronauts but also ensures the success of the mission as a whole. The Human Research Program (HRP) Exploration Medical Capability (ExMC) Element has developed a model-based Concept of Operations (ConOps) outlining an initial vision for EIMO. Within this ConOps, a comprehensive view is presented, encompassing stakeholder needs, system objectives, and system goals associated with EIMO. Additionally, it provides illustrative examples of the various activities (scenarios) for which the system will be employed during missions. The selection of these activities has been meticulous, aiming to encompass a wide spectrum of medical conditions, including those falling under different risk categories, such as low-likelihood-low-consequence, low-likelihood-high-consequence, and high-likelihood-low-consequence. The selection of these activities (scenarios) effectively encompasses the wide range of medical events situated within an assumed probability-consequence bell curve. In each scenario, at least one of the five main EIMO components identified is captured. Those EIMO components are: Pre-mission Planning, Acute and Emergent Management Decision Making, Prolonged Medical Management Decision Making, Supplies and Resource Management, and Task Load Management. The ConOps was developed by a multidisciplinary team consisting of systems engineers, scientists, and clinicians across NASA and aims to serve as an initial recommendation to gradually and safely enabling crew autonomy for Mars missions and beyond.

Earth Independent Medical Operations↗

Earth-Independent Medical Operations (EIMO) Concept of Operations (ConOps)

Compared to the current paradigm for crew health in low-Earth orbit and Lunar missions that rely on constant communication with Mission Control, there is an anticipated shift in medical operations for deep-space exploration missions. This shift stems from mission constraints imposed by the considerable distance from Earth, which include resource limitations due to a lack of resupply, mass, power, volume, and data limitations, challenges imposed by communication latency and the inability to evacuate in case of emergencies. To transition towards a more self-reliant medical approach, a comprehensive strategy is essential to progressively enable crew autonomy and mitigate mission success risks in the challenging environment of space. This transformative shift is collectively referred to as "Earth-Independent Medical Operations" (EIMO), signifying the gradual transfer of medical care and decision-making from terrestrial resources to space-based assets. This transition is aimed at bolstering astronaut health and performance while simultaneously reducing the overall risks associated with space missions. The constraints related to EIMO necessitate an integrated development of medical systems, featuring interoperability with mission planning, vehicle design, spacesuit design, and data architecture. This integration is vital in establishing a robust medical infrastructure that not only supports the well-being of astronauts but also ensures the success of the mission as a whole. The Human Research Program (HRP) Exploration Medical Capability (ExMC) Element has developed a model-based Concept of Operations (ConOps) outlining an initial vision for EIMO. Within this ConOps, a comprehensive view is presented, encompassing stakeholder needs, system objectives, and system goals associated with EIMO. Additionally, it provides illustrative examples of the various activities (scenarios) for which the system will be employed during missions. The selection of these activities has been meticulous, aiming to encompass a wide spectrum of medical conditions, including those falling under different risk categories, such as low-likelihood-low-consequence, low-likelihood-high-consequence, and high-likelihood-low-consequence. The selection of these activities (scenarios) effectively encompasses the wide range of medical events situated within an assumed probability-consequence bell curve. In each scenario, at least one of the five main EIMO components identified is captured. Those EIMO components are: Pre-mission Planning, Acute and Emergent Management Decision Making, Prolonged Medical Management Decision Making, Supplies and Resource Management, and Task Load Management. The ConOps was developed by a multidisciplinary team consisting of systems engineers, scientists, and clinicians across NASA and aims to serve as an initial recommendation to gradually and safely enabling crew autonomy for Mars missions and beyond.

Earth Independent Medical Operations↗

Advanced Computational Framework for Environmental Management ZEM, Version 1.x

Typically environmental management problems require analysis of large and complex data sets originating from concurrent data streams with different data collection frequencies and pedigree. These big data sets require on-the-fly integration into a series of models with different complexity for various types of model analyses where the data are applied as soft and hard model constraints. This is needed to provide fast iterative model analyses based on the latest available data to guide decision-making. Furthermore, the data and model are associated with uncertainties. The uncertainties are probabilistic (e.g. measurement errors) and non-probabilistic (unknowns, e.g. alternative conceptual models characterizing site conditions). To address all of these issues, we have developed an integrated framework for real-time data and model analyses for environmental decision-making called ZEM. The framework allows for seamless and on-the-fly integration of data and modeling results for robust and scientifically-defensible decision-making applying advanced decision analyses tools such as Bayesian- Information-Gap Decision Theory (BIG-DT). The framework also includes advanced methods for optimization that are capable of dealing with a large number of unknown model parameters, and surrogate (reduced order) modeling capabilities based on support vector regression techniques. The framework is coded in Julia, a state-of-the-art high-performance programing language (http://julialang.org). The ZEM framework is open-source and can be applied to any environmental management site. The framework will be open-source and released under GPL V3 license.

Vesselinov, VelimirV.↗

Implementing an Applied Science Program

The work implied in the NASA Applied Science Program requires a delicate balancing act for the those doing it. At the implementation level there are multiple tensions intrinsic to the program. For example each application of an existing product to a decision support process requires deep knowledge about the data and deep knowledge about the decision making process. It is highly probable no one person has this range of knowledge. Otherwise the decision making process would already be using the data. Therefore, a team is required. But building a team usually requires time, especially across agencies. Yet the program mandates efforts of relatively short duration. Further, those who know the data are scientists, which makes them essential to the program. But scientists are evaluated on their publication record. Anything which diverts a scientist from the research for his next publication is an anathema to him and potential death to their career. Trying to get another agency to use NASA data does not strike most scientists as material inherently suitable for publication. Also, NASA wishes to rapidly implement often substantial changes to another agency's process. For many reasons, such as budget and program constraints, speed is important. But the owner of a decision making process is tightly constrained, usually by law, regulation, organization and custom. Changes when made are slow, cautious, even hesitant, and always done according a process specific to the situation. To manage this work MSFC must balance these and other tensions. Some things we have relatively little control over, such as budget. These we try to handle by structural techniques. For example by insisting all of our people work on multiple projects simultaneously we inherently have diversification of funding for all of our people. In many cases we explicitly use some elements of tension to be productive. For example the need for the scientists to constantly publish is motivation to keep tasks short and to the immediate point. As another example, the DSS agency and it personnel are treated as integral to the effort at every step. Thus, their ways of doing things, their problems and their assets become part of the solution. MSFC also manages the Applied Science work' within a strategic framework.' First, the scientists are necessarily at the core of all of this work as well as all of the work within the larger' organization. We therefore strive to keep a roughly 50-50 balance between the work done on tasks funded directly by the research side of NASA's Science Mission Directorate and funding from the applied side. Done at both the organization level and the level of the individual, this keeps the scientist both happy and productive over the long term. We also try diligently to remove as much burden from the scientist as practical by employing people such as the authors and others to do tasks not requiring; scientific knowledge. We also have designed our effort to take full use of external partners. We actively seek and support, including fund, people from multiple organizations to join us as committed collaborators. In this we use today's money and today's problem to help us diversify and strengthen for tomorrow. MSFC also considers the Applied Science work holistically. Each element is viewed as a step in a larger process. At a management level we can chose to emphasize or encourage certain areas which service long term goals. Thus, if we think work in a particular area should be developed, we can start with the smaller, less costly elements and grow.

Rickman, Doug↗

A multi-criteria decision analysis assessment of waste paper management options

Highlights: ► Isolated communities have particular problems in terms of waste management. ► An MCDA tool allowed a group of non-experts to evaluate waste management options. ► The group preferred local waste management solutions to export to the mainland. ► Gasification of paper was the preferred option followed by recycling. ► The group concluded that they could be involved in the decision making process. - Abstract: The use of Multi-criteria Decision Analysis (MCDA) was investigated in an exercise using a panel of local residents and stakeholders to assess the options for managing waste paper on the Isle of Wight. Seven recycling, recovery and disposal options were considered by the panel who evaluated each option against seven environmental, financial and social criteria. The panel preferred options where the waste was managed on the island with gasification and recycling achieving the highest scores. Exporting the waste to the English mainland for incineration or landfill proved to be the least preferred options. This research has demonstrated that MCDA is an effective way of involving community groups in waste management decision making.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Interorganizational transfer of technology - A study of adoption of NASA innovations

The paper describes a study on the effects of top management support, various techno-economic factors, organizational climate, and decision-making modes on the adoption of NASA innovations. Field research consisted of interviews and questionnaires directed to sixty-five organizations. Forty-five test cases where different decisions for adoption of ideas for new products or processes were made on NASA Tech Briefs were studied in relation to the effects of various factors on the degree of success of adoption, including: (1) the degree of general connection of the technology to the firm's existing operation, (2) the specificity of the relationship between the technology and some existing and recognized problem, (3) the degree of urgency of the problem to which the technology was related, (4) maturity of technology available to implement the technology, (5) availability of personnel and financial resources to implement the technology, (6) degree of top management interest, (7) the use of confrontation in joint-decision, (8) the use of smoothing in decision-making, and (9) the use of forcing in decision-making. It was found that top managements interest was important in the product cases only, and that the success of process innovations was dependent on the quality of information and the specificity of the relationship between the technology and some recognized existing problem.

Chakrabarti, A. K.↗

Value Based Decision Approach to Help Inform Waste Management Guidance for VLLW Following an RDD Detonation - 19510

The detonation of a radiological dispersal device in an urban environment or similar large-scale radiological event has the potential to spread radioactive contamination over a large area. The resulting effort to clean up and dispose of this waste will involve input and coordination from a wide variety of stakeholder groups, especially if the waste crosses municipal and state boundaries. Guidance designed to help effectively and safely deal with the wastes generated from incident cleanup will need to navigate the intersection of stakeholders at the local, regional, and national levels. At the same time, the sheer size of such a cleanup effort and the volumes of wastes generated will require innovative and potentially novel solutions compared to current Low-Level Radioactive Waste disposal practices. A structured decision-making approach incorporating value-focused thinking is one method that could be employed to help build stakeholder confidence in a given cleanup guidance strategy and documentation. This approach would help ensure that all stakeholder perspectives were accounted for in a given decision situation and to promote transparency in the decision-making process. This paper will discuss research into the role and development of a public stakeholder tool used to gather input from relevant stakeholders in order to help inform cleanup and disposal guidance of Very Low-Level Radioactive Waste following a radiological disaster. This tool is being designed to draw on aspects of value-focused decision making. Case studies from two prominent recent events will be discussed to illustrate some of the key issues that could benefit from such an approach to stakeholders. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Problem Complexity and LLM: H-M Team Reliability in Challenging Environments

In traditional human-machine operations, the functional decomposition of actions and responsibilities among various agents is assigned a priori. For instance, in current air traffic operations, although assisted by software, human pilots have the ultimate control of aircraft. Multiagent human-machine and machine-machine systems will face problems of varying and potentially unpredicted complexity in future challenging scenarios of planetary, en route, and orbital activities. Hence, it is important to enable dynamic transfer of decision-making to appropriate team members, human or machine, depending on which agent is best equipped to solve that specific problem on a time budget. In this paper, we consider aspects of problem-solving and its modeling that affect the outcomes of decision-making as a function of solution quality and the likelihood of solving the problem on a required time budget. We focus on Large Language Models (LLM) as potential machine teammates and conclude that practical, predictive modeling of their performance, at the current stage of their development, is infeasible. Simple examples help us illustrate that current LLM will require fundamental advancements to provide reliable support in team decision-making, especially in safety-critical and time-critical domains. The study is not meant to diminish the value of the remarkable capabilities of LLM, but rather to gain a better understanding of the technology’s appropriate use and the needed additions.

function allocation↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗