Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Role of PHM in Autonomous Decision-Making: Aerospace applications

There is an increased need for onboard decision-making capabilities in cyber-physical systems be it in energy, automotive, aviation, space, or other industries as they aim for increased efficiency, resiliency, and mission assurance capabilities. Emerging next-gen technologies such as multi-rover planetary missions, distributed satellites, unmanned ground and aerial vehicle operations and smart grid systems rely on in-time risk assessment and autonomous decision-making. One critical piece of the autonomy puzzle is reliable prediction of system behavior under time-varying and potentially uncertain environmental conditions. Further, if agent states change during operation such as initiation of faults or degradation, reliable diagnostic tools need to be investigated. In this tutorial, we will revise approaches that integrates existing physics-based and data-driven models of agents interacting with probability models of the environment and component operation state. Role of existing PHM methodologies as they feed into decision-making under uncertainty will be studied. Balancing critical trade-offs between high-fidelity prognostic models, prediction time-horizons and the computational requirements for in-time cost-effective decision-making will be discussed through the implementation of surrogate models. Finally, the audience will be introduced to a real-time application of in-time trajectory planning of an unmanned aerial system (UAS) based on its PHM assessments under uncertain and varying wind conditions.

decision-making↗
DOE OSTI2021

System risk quantification and decision making support using functional modeling and dynamic Bayesian network

Risk-informed decision-making requires a probabilistic assessment of the likelihood of success of control action, given the system status. This paper presents a systematic state transition modeling approach integrating dynamic probabilistic risk assessment with a decision-making process using a dynamic Bayesian network (DBN) coupled with functional modeling. A functional model designed with multilevel flow modeling (MFM) technique was used to build a system state structure inferred by energy, mass, and information flow so that one can verify the developed model with respect to system functionality. The MFM model represents the causal relationship among the nodes, which captures the structure of process parameters and control units. Each node may have multiple possible states, and the DBN structured by the MFM model represents the time-domain transitions among the defined states. Furthermore, the MFM-DBN integrated state transition modeling is a white-box approach that allows one to draw the system's risk profile by updating the system states and supports the decisions probabilistically with physical inference. An example of a simple heating system has been used to illustrate this process, including decision-making support based on quantitative risk profile. For demonstrating its applicability to a complex system operational decision making, a case study of station blackout accident scenario leading to the seal loss of coolant accident in a nuclear power plant is presented. The proposed approach effectively provided the risk profile along time for each option so that the operators can make the best decision, which minimizes the plant risk.

42 ENGINEERING↗
NASA NTRS2009

Probabilistic Risk Assessment for Decision Making During Spacecraft Operations

Decisions made during the operational phase of a space mission often have significant and immediate consequences. Without the explicit consideration of the risks involved and their representation in a solid model, it is very likely that these risks are not considered systematically in trade studies. Wrong decisions during the operational phase of a space mission can lead to immediate system failure whereas correct decisions can help recover the system even from faulty conditions. A problem of special interest is the determination of the system fault protection strategies upon the occurrence of faults within the system. Decisions regarding the fault protection strategy also heavily rely on a correct understanding of the state of the system and an integrated risk model that represents the various possible scenarios and their respective likelihoods. Probabilistic Risk Assessment (PRA) modeling is applicable to the full lifecycle of a space mission project, from concept development to preliminary design, detailed design, development and operations. The benefits and utilities of the model, however, depend on the phase of the mission for which it is used. This is because of the difference in the key strategic decisions that support each mission phase. The focus of this paper is on describing the particular methods used for PRA modeling during the operational phase of a spacecraft by gleaning insight from recently conducted case studies on two operational Mars orbiters. During operations, the key decisions relate to the commands sent to the spacecraft for any kind of diagnostics, anomaly resolution, trajectory changes, or planning. Often, faults and failures occur in the parts of the spacecraft but are contained or mitigated before they can cause serious damage. The failure behavior of the system during operations provides valuable data for updating and adjusting the related PRA models that are built primarily based on historical failure data. The PRA models, in turn, provide insight into the effect of various faults or failures on the risk and failure drivers of the system and the likelihood of possible end case scenarios, thereby facilitating the decision making process during operations. This paper describes the process of adjusting PRA models based on observed spacecraft data, on one hand, and utilizing the models for insight into the future system behavior on the other hand. While PRA models are typically used as a decision aid during the design phase of a space mission, we advocate adjusting them based on the observed behavior of the spacecraft and utilizing them for decision support during the operations phase.

dynamic fault trees↗
NASA NTRS1990

Acquisition and production of skilled behavior in dynamic decision-making tasks

Ongoing research investigating perceptual and contextual influences on skilled human performance in dynamic decision making environments is discussed. The research is motivated by two general classes of findings in recent decision making research. First, many studies suggest that the concrete context in which a task is presented has strong influences on the psychological processes used to perform the task and on subsequent performance. Second, studies of skilled behavior in a wide variety of task environments typically implicate the perceptual system as an important contributor to decision-making performance, either in its role as a mediator between the current decision context and stored knowledge, or as a mechanism capable of directly initiating activity through the development of a 'trained eye.' Both contextual and perceptual influences place limits on the ability of traditional utility-theoretic accounts of decision-making to guide display design, as variance in behavior due to contextual factors or the development of a perceptual skill is left unexplained. The author outlines a framework in which to view questions of perceptual and contextual influences on behavior and describe an experimental task and analysis technique which will be used to diagnose the possible role of perception in skilled decision making performance.

Kirlik, Alex↗
DOE OSTI2017

Modular evaluation method for subsurface activities (MEMSA). A novel approach for integrating social acceptance in a permit decision-making process for subsurface activities

We investigate how the decision support system ‘Modular Evaluation Method Subsurface Activities’ (MEMSA) can help facilitate an informed decision-making process for permit applications of subsurface activities. To this end, we analyze the extent the MEMSA approach allows for a dialogue between stakeholders in a transparent manner. We use the exploration permit for the underground gas storage facility at the Pieterburen salt dome (Netherlands) as a case study. The results suggest that the MEMSA approach is flexible enough to adjust to changing conditions. Furthermore, MEMSA provides a novel way for identifying structural problems and possible solutions in permit decision-making processes for subsurface activities, on the basis of the sensitivity analysis of intermediate rankings. We suggest that the planned size of an activity should already be specified in the exploration phase, because this would allow for a more efficient use of the subsurface as a whole. We conclude that the host community should be involved to a greater extent and in an early phase of the permit decision-making process, for example, already during the initial analysis of the project area of a subsurface activity. We suggest that strategic national policy goals are to be re-evaluated on a regular basis, in the form of a strategic vision for the subsurface, to account for timing discrepancies between the realization of activities and policy deadlines, because this discrepancy can have a large impact on the necessity and therefore acceptance of a subsurface activity.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Method and apparatus for constructing informative outcomes to guide multi-policy decision making

In Multi-Policy Decision-Making (MPDM), many computationally-expensive forward simulations are performed in order to predict the performance of a set of candidate policies. In risk-aware formulations of MPDM, only the worst outcomes affect the decision making process, and efficiently finding these influential outcomes becomes the core challenge. Recently, stochastic gradient optimization algorithms, using a heuristic function, were shown to be significantly superior to random sampling. In this disclosure, it was shown that accurate gradients can be computed-even through a complex forward simulation—using approaches similar to those in dep networks. The proposed approach finds influential outcomes more reliably, and is faster than earlier methods, allowing one to evaluate more policies while simultaneously eliminating the need to design an easily-differentiable heuristic function.

Olson, Edwin↗
DOE OSTI2021

Harnessing Condorcet Methods to Improve Decision-making Based on Ranked Data

Decision-makers must often choose between multiple alternatives based on their relative merits across a variety of criteria. These multiple-criteria decision-making (MCDM) problems must be approached in an objective, measurable, and transparent fashion to obtain well-supported outcomes. The challenge of using sets of ranked data to identify the optimal choice is not unlike the challenge of using ranked ballots to identify the winner of an election in a preference voting system. As such, the methods of rank aggregation used in elections can be applied to help resolve MCDM problems. Previous research into the design of elections and ballots has yielded many algorithms with well-understood properties. A subset of these, called Condorcet methods, reliably identify the “Condorcet winner,” if it exists, giving the result that would defeat any other in a pairwise comparison. That, in addition to several other desirable qualities, makes Condorcet methods like the Schulze method, Ranked Pairs, and Copeland’s method, effective and scalable means for tackling MCDM problems. These rank aggregation methods have been implemented in JavaScript functions for incorporation into a web-based MCDM decision tool. These algorithms can be applied in a wide variety of contexts (for example, determining the “best” environmental remediation method or selecting a subcontractor) to facilitate effective decision-making. The performance of the JavaScript Condorcet prototype tool was compared across the implemented algorithms and with both a non-Condorcet rank aggregation method as well as an implementation of the Simple Multi-Attribute Rating Technique (SMART) algorithm.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2018

Can You Verifi This? Studying Uncertainty and Decision-Making About Misinformation using Visual Analytics

We describe a novel study of decision-making processes around misinformation on social media. Using a custom-built visual analytic system, we presented users with news content from social media accounts from a variety of news outlets, including outlets engaged in distributing misinformation. We conducted controlled experiments to study decision-making regarding the veracity of these news outlets and tested the role of confirmation bias (the tendency to ignore contradicting information) and uncertainty of information on human decision-making processes. Our findings reveal that the presence of conflicting information, presented to users in the form of cues, impacts the ability to judge the veracity of news in systematic ways. We also find that instructing participants even to explicitly disconfirm given hypotheses does not significantly impact their decision-making regarding misinformation when compared to a control condition. Our findings have the potential to inform the design of visual analytics systems so that they may be used to mitigate the effects of cognitive biases and stymie the spread of misinformation on social media.

misinformation, decision making, social media, vis↗
DOE OSTI2021

Analytical Framework for Homeowner-Focused Computational Cost-Benefit Mitigation Decision Making

As a result of increasing windstorm losses in the United States over the past 50 years, a variety of residential wind hazard mitigation strategies have been recommended. Wind hazard mitigation undoubtedly reduces windstorm losses; however, little customized information is available to support the economic decision-making process for individual stakeholders, especially at the consumer level. Therefore, there is a need for decision support tools to calculate, evaluate, and present the economic benefits of mitigation over variable decision-making time horizons for unique building characteristics in specific geographical locations. This paper presents a cost-benefit computational decision-making recommendation framework that evaluates and presents the cost effectiveness of mitigation, customized based on location, years of interest, and building characteristics. The decision-making framework consists of two cores. The user-independent core and user-dependent core which consists of eight steps, divided into four subprocesses: (1) data acquisition, (2) data evaluation, (3) cost-benefit calculation, and (4) results comparison and decision making. To demonstrate the framework, a wood-framed single-family home in light suburban terrain in Golden Meadow, Louisiana, is used as a case study, considering retrofit mitigation with a $15,000 budget and a decision-making time horizon of 30 years. The case study provides six mitigation options, with cost ranging between approximately $2,000 and $15,000 and net benefit/cost ratios ranging from 2.4 to 13. Once fully implemented in a decision making information tool, the developed mitigation recommendation framework will provide valuable information that can be used by home designers, builders, owners, and other stakeholders to better understand the economic facets of wind hazard mitigation, providing critical information as part of the overall decision-making process.

Orooji, Fatemeh↗
NASA NTRS2017

Prospective Architectures for Onboard vs Cloud-Based Decision Making for Unmanned Aerial Systems

This paper investigates propsective architectures for decision-making in unmanned aerial systems. When these unmanned vehicles operate in urban environments, there are several sources of uncertainty that affect their behavior, and decision-making algorithms need to be robust to account for these different sources of uncertainty. It is important to account for several risk-factors that affect the flight of these unmanned systems, and facilitate decision-making by taking into consideration these various risk-factors. In addition, there are several technical challenges related to autonomous flight of unmanned aerial systems; these challenges include sensing, obstacle detection, path planning and navigation, trajectory generation and selection, etc. Many of these activities require significant computational power and in many situations, all of these activities need to be performed in real-time. In order to efficiently integrate these activities, it is important to develop a systematic architecture that can facilitate real-time decision-making. Four prospective architectures are discussed in this paper; on one end of the spectrum, the first architecture considers all activities/computations being performed onboard the vehicle whereas on the other end of the spectrum, the fourth and final architecture considers all activities/computations being performed in the cloud, using a new service known as Prognostics as a Service that is being developed at NASA Ames Research Center. The four different architectures are compared, their advantages and disadvantages are explained and conclusions are presented.

Software engineering↗
DOE OSTI2014

Effective dialogue: Enhanced public engagement as a legitimising tool for municipal waste management decision-making

Highlights: • A review of public engagement in waste management decision-making is undertaken. • Enhanced public engagement is explored as a means to legitimise waste decisions. • Analytical–deliberative processes are explored as a tool for effective dialogue. • Considerations for integrating public values with technical analysis are outlined. • Insights into the design of appropriate public engagement processes are provided. - Abstract: The complexity of municipal waste management decision-making has increased in recent years, accompanied by growing scrutiny from stakeholders, including local communities. This complexity reflects a socio-technical framing of the risks and social impacts associated with selecting technologies and sites for waste treatment and disposal facilities. Consequently there is growing pressure on local authorities for stakeholders (including communities) to be given an early opportunity to shape local waste policy in order to encourage swift planning, development and acceptance of the technologies needed to meet statutory targets to divert waste from landfill. This paper presents findings from a research project that explored the use of analytical–deliberative processes as a legitimising tool for waste management decision-making. Adopting a mixed methods approach, the study revealed that communicating the practical benefits of more inclusive forms of engagement is proving difficult even though planning and policy delays are hindering development and implementation of waste management infrastructure. Adopting analytical–deliberative processes at a more strategic level will require local authorities and practitioners to demonstrate how expert-citizen deliberations may foster progress in resolving controversial issues, through change in individuals, communities and institutions. The findings suggest that a significant shift in culture will be necessary for local authorities to realise the potential of more inclusive decision processes. This calls for political actors and civic society to collaborate in institutionalising public involvement in both strategic and local planning structures.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗
NASA NTRS1982

A model of human decision making in multiple process monitoring situations

Human decision making in multiple process monitoring situations is considered. It is proposed that human decision making in many multiple process monitoring situations can be modeled in terms of the human's detection of process related events and his allocation of attention among processes once he feels event have occurred. A mathematical model of human event detection and attention allocation performance in multiple process monitoring situations is developed. An assumption made in developing the model is that, in attempting to detect events, the human generates estimates of the probabilities that events have occurred. An elementary pattern recognition technique, discriminant analysis, is used to model the human's generation of these probability estimates. The performance of the model is compared to that of four subjects in a multiple process monitoring situation requiring allocation of attention among processes.

Greenstein, J. S.↗
NASA NTRS2003

Risk-based analysis and decision making in multi-disciplinary environments

A risk-based decision-making process conceived of and developed at JPL and NASA, has been used to help plan and guide novel technology applications for use on spacecraft. These applications exemplify key challenges inherent in multi-disciplinary design of novel technologies deployed in mission-critical settings. 1) Cross-disciplinary concerns are numerous (e.g., spacecraft involve navigation, propulsion, telecommunications). These concems are cross-coupled and interact in multiple ways (e.g., electromagnetic interference, heat transfer). 2) Time and budget pressures constrain development, operational resources constrain the resulting system (e.g., mass, volume, power). 3) Spacecraft are critical systems that must operate correctly the first time in only partially understood environments, with no chance for repair. 4) Past experience provides only a partial guide: New mission concepts are enhanced and enabled by new technologies, for which past experience is lacking. The decision-making process rests on quantitative assessments of the relationships between three classes of information - objectives (the things the system is to accomplish and constraints on its operation and development), risks (whose occurrence detracts from objectives), and mitigations (options for reducing the likelihood and or severity of risks). The process successfully guides experts to pool their knowledge, using custom-built software to support information gathering and decision-making.

technology↗
DOE OSTI2015

SU-E-J-155: Automatic Quantitative Decision Making Metric for 4DCT Image Quality

Purpose: To develop a quantitative decision making metric for automatically detecting irregular breathing using a large patient population that received phase-sorted 4DCT. Methods: This study employed two patient cohorts. Cohort#1 contained 256 patients who received a phasesorted 4DCT. Cohort#2 contained 86 patients who received three weekly phase-sorted 4DCT scans. A previously published technique used a single abdominal surrogate to calculate the ratio of extreme inhalation tidal volume to normal inhalation tidal volume, referred to as the κ metric. Since a single surrogate is standard for phase-sorted 4DCT in radiation oncology clinical practice, tidal volume was not quantified. Without tidal volume, the absolute κ metric could not be determined, so a relative κ (κrel) metric was defined based on the measured surrogate amplitude instead of tidal volume. Receiver operator characteristic (ROC) curves were used to quantitatively determine the optimal cutoff value (jk) and efficiency cutoff value (τk) of κrel to automatically identify irregular breathing that would reduce the image quality of phase-sorted 4DCT. Discriminatory accuracy (area under the ROC curve) of κrel was calculated by a trapezoidal numeric integration technique. Results: The discriminatory accuracy of ?rel was found to be 0.746. The key values of jk and tk were calculated to be 1.45 and 1.72 respectively. For values of ?rel such that jk≤κrel≤τk, the decision to reacquire the 4DCT would be at the discretion of the physician. This accounted for only 11.9% of the patients in this study. The magnitude of κrel held consistent over 3 weeks for 73% of the patients in cohort#3. Conclusion: The decision making metric, ?rel, was shown to be an accurate classifier of irregular breathing patients in a large patient population. This work provided an automatic quantitative decision making metric to quickly and accurately assess the extent to which irregular breathing is occurring during phase-sorted 4DCT.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1993

Modelling decision-making by pilots

Our scientific goal is to understand the process of human decision-making. Specifically, a model of human decision-making in piloting modern commercial aircraft which prescribes optimal behavior, and against which we can measure human sub-optimality is sought. This model should help us understand such diverse aspects of piloting as strategic decision-making, and the implicit decisions involved in attention allocation. Our engineering goal is to provide design specifications for (1) better computer-based decision-aids, and (2) better training programs for the human pilot (or human decision-maker, DM).

Patrick, Nicholas J. M.↗
DOE OSTI2015

Water Governance Process Assessment: Evaluating the Link between Decision Making Processes and Outcomes in the Columbia River Basin

Academics and practitioners agree that in water governance, the quality of a decision making process should influence the quality of the outcome and the degree to which it is accepted by interested parties. However, finding a feasible way to evaluate and then improve the quality of a decision making process has proven elusive. Systematically collecting evidence of a link between process and outcome is also challenging. In my dissertation, I developed a synthesis framework for evaluating and improving water governance decision making to address these two challenges. The synthesis framework, which I call the Water Governance Process Assessment (Water GPA), draws upon 22 existing frameworks rooted in resilience, adaptive governance, and good governance. From these frameworks, I identified and provided a way to evaluate four characteristics critical to good water governance decision making processes: 1) accountability, 2) inclusivity, and 3) information, and 4) context. I applied the Water GPA framework to the recent reviews of the Columbia River Treaty by the United States and Canada. I collected data for the case studies through semi-structured interviews and surveys of process participants from the federal agencies, Tribal and First Nations, state/provincial governments, local governments, stakeholder interests, and citizens. I coded and analyzed the interviews using the qualitative analysis software QSR NVivo and the characteristics identified in the Water GPA framework. I used the two case study applications to demonstrate how to use the framework. I identified what aspects of the four process categories served as barriers and building blocks for good water governance in each water governance process. I also gleaned lessons learned and recommendations including some for determining process leadership, ensuring meaningful engagement and inclusivity, addressing sovereignty issues, setting decision criteria, sharing decision authority, allocating resources in future processes in the US and BC portions of the Columbia River Basin and similar basins. In my case studies, I also investigated which characteristics of the water governance decision making process influenced the direct outcomes of those processes (the decisions) as well as other non-target outcomes (such as trust, co-produced science, new coalitions, etc.). All four characteristics outlined in the Water Governance Process Assessment (Water GPA), played some role in the development of the content and/or support of the two case study decision documents (US Regional Recommendation and BC Provincial Decision). Generally, when the characteristic of the process was done well, it improved the legitimacy and acceptance of the decision. At the same time performing poorly in one area did not necessarily torpedo the process or decision. In both case studies, it appears that the interplay between the process characteristics (that is where two or more characteristics converge) had a greater influence over the decision. Further work is needed to clearly identify what characteristics of a process are most influential in different situations. The Water GPA is one useful tool for this effort.

13 HYDRO ENERGY↗
NASA NTRS2010

Achieving a Risk-Informed Decision-Making Environment at NASA: The Emphasis of NASA's Risk Management Policy

This slide presentation reviews the evolution of risk management (RM) at NASA. The aim of the RM approach at NASA is to promote an approach that is heuristic, proactive, and coherent across all of NASA. Risk Informed Decision Making (RIDM) is a decision making process that uses a diverse set of performance measures along with other considerations within a deliberative process to inform decision making. RIDM is invoked for key decisions such as architecture and design decisions, make-buy decisions, and budget reallocation. The RIDM process and how it relates to the continuous Risk Management (CRM) process is reviewed.

Dezfuli, Homayoon↗