Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic Risk”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

RISMC Advanced Safety Analysis Project Plan – FY 2015 - FY 2019

In this report, a project plan is developed, focused on industry applications, using Risk-Informed Safety Margin Characterization (RISMC) tools and methods applied to realistic, relevant, and current interest issues to the operating nuclear fleet. RISMC focuses on modernization of nuclear power safety analysis (tools, methods and data); implementing state-of-the-art modeling techniques (which include, for example, enabling incorporation of more detailed physics as they become available); taking advantage of modern computing hardware; and combining probabilistic and mechanistic analyses to enable a risk informed safety analysis process. The modernized tools will maintain the current high level of safety in our nuclear power plant fleet, while providing an improved understanding of safety margins and the critical parameters that affect them. Thus, the set of tools will provide information to inform decisions on plant modifications, refurbishments, and surveillance programs, while improving economics. This set of tools will also benefit the design of new reactors, enhancing safety per unit cost of a nuclear plant. The proposed plan will focus on application of the RISMC toolkit, in particular, solving realistic problems of important current issues to the nuclear industry, in collaboration with plant owners and operators to demonstrate the usefulness of these tools in decision making.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Understanding the nature of nuclear power plant risk

This paper describes the evolution of understanding of severe accident consequences from the non-mechanistic assumptions of WASH-740 to WASH-1400, NUREG-1150, SOARCA and today in the interpretation of the consequences of the accident at Fukushima. As opposed to the general perception, the radiological human health consequences to members of the Japanese public from the Fukushima accident will be small despite meltdowns at three reactors and loss of containment integrity. In contrast, the radiation-related societal impacts present a substantial additional economic burden on top of the monumental task of economic recovery from the nonnuclear aspects of the earthquake and tsunami damage. The Fukushima accident provides additional evidence that we have mis-characterized the risk of nuclear power plant accidents to ourselves and to the public. The human health risks are extremely small even to people living next door to a nuclear power plant. The principal risk associated with a nuclear power plant accident involves societal impacts: relocation of people, loss of land use, loss of contaminated products, decontamination costs and the need for replacement power. Although two of the three probabilistic safety goals of the NRC address societal risk, the associated quantitative health objectives in reality only address individual human health risk. This paper describes the types of analysis that would address compliance with the societal goals. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scalable Risk Assessment of Rare Events in Power Systems With Uncertain Wind Generation and Loads

Risk assessment of rare events has become increasingly important in power system planning and operation with the increasing integration of renewable energy and the presence of system uncertainties. However, quantifying the risk posed by rare events via the traditional method, i.e., Monte Carlo sampling (MCS), incurs substantial computational expense stemming from the vast ensemble of power flow simulations. To accelerate the assessment, this paper proposes a Deep Neural Network (DNN)-kernelized vector-valued Gaussian Process (VVGP) approach with excellent computational efficiency while maintaining high accuracy. Consequently, serving as a surrogate model for the power flow solver, the DNN-kernelized VVGP enables significantly faster but accurate risk assessment compared to the power flow solver. The developed surrogate model evaluates low-order N - k events that contain more than 90% instances by adeptly capturing the topological features while the high-order N - k events are assessed via a power flow solver, thereby striking a balance between computational efficiency and uncertainty quantification accuracy. Moreover, the model incorporates a Support Vector Machine (SVM) classifier to resample concerning low-probability tail events to counteract the biases potentially introduced during the DNN-kernelized VVGP evaluations. Simulations conducted on the modified IEEE 24-bus, 118-bus, and European 1354-bus systems demonstrate that the proposed method maintains the accuracy benchmark set by MCS while significantly reducing computational demands in large-scale power systems as compared to other state-of-the-art methods.

17 WIND ENERGY↗

Modeling airborne pathogen transport and transmission risks of SARS-CoV-2

An integrated modeling approach has been developed to better understand the relative impacts of different expiratory and environmental factors on airborne pathogen transport and transmission, motivated by the recent COVID-19 pandemic. Computational fluid dynamics (CFD) modeling was used to simulate spatial-temporal aerosol concentrations and quantified risks of exposure as a function of separation distance, exposure duration, environmental conditions (e.g., airflow/ventilation), and face coverings. The CFD results were combined with infectivity models to determine probability of infection, which is a function of the spatial-temporal aerosol concentrations, viral load, infectivity rate, viral viability, lung-deposition probability, and inhalation rate. Uncertainty distributions were determined for these parameters from the literature. Probabilistic analyses were performed to determine cumulative distributions of infection probabilities and to determine the most important parameters impacting transmission. This modeling approach has relevance to both pathogen and pollutant dispersion from expelled aerosol plumes.

60 APPLIED LIFE SCIENCES↗

RAVEN Beta Release

This documents the release of the Risk Analysis Virtual Environment (RAVEN) code. A description of the RAVEN code is provided, and discussion of the release process for the M2LW-16IN0704045 milestone. The RAVEN code is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. RAVEN is capable of investigating the system response as well as the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused toward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. RAVEN has now increased in maturity enough for the Beta 1.0 release.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development and testing of improved statistical wind power forecasting methods.

Wind power forecasting (WPF) provides important inputs to power system operators and electricity market participants. It is therefore not surprising that WPF has attracted increasing interest within the electric power industry. In this report, we document our research on improving statistical WPF algorithms for point, uncertainty, and ramp forecasting. Below, we provide a brief introduction to the research presented in the following chapters. For a detailed overview of the state-of-the-art in wind power forecasting, we refer to [1]. Our related work on the application of WPF in operational decisions is documented in [2]. Point forecasts of wind power are highly dependent on the training criteria used in the statistical algorithms that are used to convert weather forecasts and observational data to a power forecast. In Chapter 2, we explore the application of information theoretic learning (ITL) as opposed to the classical minimum square error (MSE) criterion for point forecasting. In contrast to the MSE criterion, ITL criteria do not assume a Gaussian distribution of the forecasting errors. We investigate to what extent ITL criteria yield better results. In addition, we analyze time-adaptive training algorithms and how they enable WPF algorithms to cope with non-stationary data and, thus, to adapt to new situations without requiring additional offline training of the model. We test the new point forecasting algorithms on two wind farms located in the U.S. Midwest. Although there have been advancements in deterministic WPF, a single-valued forecast cannot provide information on the dispersion of observations around the predicted value. We argue that it is essential to generate, together with (or as an alternative to) point forecasts, a representation of the wind power uncertainty. Wind power uncertainty representation can take the form of probabilistic forecasts (e.g., probability density function, quantiles), risk indices (e.g., prediction risk index) or scenarios (with spatial and/or temporal dependence). Statistical approaches to uncertainty forecasting basically consist of estimating the uncertainty based on observed forecasting errors. Quantile regression (QR) is currently a commonly used approach in uncertainty forecasting. In Chapter 3, we propose new statistical approaches to the uncertainty estimation problem by employing kernel density forecast (KDF) methods. We use two estimators in both offline and time-adaptive modes, namely, the Nadaraya-Watson (NW) and Quantilecopula (QC) estimators. We conduct detailed tests of the new approaches using QR as a benchmark. One of the major issues in wind power generation are sudden and large changes of wind power output over a short period of time, namely ramping events. In Chapter 4, we perform a comparative study of existing definitions and methodologies for ramp forecasting. We also introduce a new probabilistic method for ramp event detection. The method starts with a stochastic algorithm that generates wind power scenarios, which are passed through a high-pass filter for ramp detection and estimation of the likelihood of ramp events to happen. The report is organized as follows: Chapter 2 presents the results of the application of ITL training criteria to deterministic WPF; Chapter 3 reports the study on probabilistic WPF, including new contributions to wind power uncertainty forecasting; Chapter 4 presents a new method to predict and visualize ramp events, comparing it with state-of-the-art methodologies; Chapter 5 briefly summarizes the main findings and contributions of this report.

17 WIND ENERGY↗

Probability of Failure and Risk Assessment of Propulsion Structural Components

Due to increasing need to account for the uncertainties in material properties, loading conditions, or geometries, a methodology was developed to determine structural reliability and the assess the risk associated with it. The methodology consists of a probabilistic structural analysis by a probabilistic finite element computer code Nonlinear Evaluation of Stochastic Structures Under Stress (NESSUS) and a generic probabilistic material properties model. The methodology is versatile and is equally applicable to high and cryogenic temperature structures. Results obtained demonstrate that the whole issue of structural reliability and risk can be formally evaluated using the methodology developed which is inclusive of uncertainties in material properties, structural parameters and loading conditions. The methodology is described in some detail with illustrative examples.

Shiao, Michael C.↗

Satellite Collision Modeling with Physics-Based Hydrocodes: Debris Generation Predictions of the Iridium-Cosmos Collision Event and Other Impact Events

Satellite collision debris poses risks to existing space assets and future space missions. Predictive models of debris generated from these hypervelocity collisions are critical for developing accurate space situational awareness tools and effective mitigation strategies. Hypervelocity collisions involve complex phenomenon that spans several time- and length-scales. We have developed a satellite collision debris modeling approach consisting of a Lagrangian hydrocode enriched with smooth particle hydrodynamics (SPH), advanced material failure models, detailed satellite mesh models, and massively parallel computers. These computational studies enable us to investigate the influence of satellite center-of-mass (CM) overlap and orientation, relative velocity, and material composition on the size, velocity, and material type distributions of collision debris. We have applied our debris modeling capability to the recent Iridium 33-Cosmos 2251 collision event. While the relative velocity was well understood in this event, the degree of satellite CM overlap and orientation was ill-defined. In our simulations, we varied the collision CM overlap and orientation of the satellites from nearly maximum overlap to partial overlap on the outermost extents of the satellites (i.e, solar panels and gravity boom). As expected, we found that with increased satellite overlap, the overall debris cloud mass and momentum (transfer) increases, the average debris size decreases, and the debris velocity increases. The largest predicted debris can also provide insight into which satellite components were further removed from the impact location. A significant fraction of the momentum transfer is imparted to the smallest debris (< 1-5mm, dependent on mesh resolution), especially in large CM overlap simulations. While the inclusion of the smallest debris is critical to enforcing mass and momentum conservation in hydrocode simulations, there seems to be relatively little interest in their disposition. Based on comparing our results to observations, it is unlikely that the Iridium 33-Cosmos 2251 collision event was a large mass-overlap collision. We also performed separate simulations studying the debris generated by the collision of 5 and 10 cm spherical projectiles on the Iridium 33 satellite at closing velocities of 5, 10, and 15 km/s. It is important to understand the vulnerability of satellites to small debris threats, given their pervasiveness in orbit. These studies can also be merged with probabilistic conjunction analysis to better understand the risk to space assets. In these computational studies, we found that momentum transfer, kinetic energy losses due to dissipative mechanisms (e.g., fracture), fragment number, and fragment velocity increases with increasing velocity for a fixed projectile size. For a fixed velocity, we found that the smaller projectile size more efficiently transfers momentum to the satellite. This latter point has an important implication: Eight (spaced) 5 cm debris objects can impart more momentum to the satellite, and likely cause more damage, than a single 10 cm debris object at the same velocity. Further studies are required to assess the satellite damage induced by 1-5 cm sized debris objects, as well as multiple debris objects, in this velocity range.

42 ENGINEERING↗

Study of Risk Assessment Programs at Federal Agencies and Commercial Industry Related to the Conduct or Regulation of High Hazard Operations

In the Department of Energy (DOE) Implementation Plan (IP) for Defense Nuclear Facilities Safety Board's Recommendation 2009-1, the DOE committed to studying the use of quantitative risk assessment methodologies at government agencies and industry. This study consisted of document reviews and interviews of senior management and risk assessment staff at six organizations. Data were collected and analyzed on risk assessment applications, risk assessment tools, and controls and infrastructure supporting the correct usage of risk assessment and risk management tools. The study found that the agencies were in different degrees of maturity in the use of risk assessment to support the analysis of high hazard operations and to support decisions related to these operations. Agencies did not share a simple, 'one size fits all' approach to tools, controls, and infrastructure needs. The agencies recognized that flexibility was warranted to allow use of risk assessment tools in a manner that is commensurate with the complexity of the application. The study also found that, even with the lack of some data, agencies application of the risk analysis structured approach could provide useful insights such as potential system vulnerabilities. This study, in combination with a companion study of risk assessment programs in the DOE Offices involved in high hazard operations, is being used to determine the nature and type of controls and infrastructure needed to support risk assessments at the DOE.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Integrated Risk-Informed Decision-Making for an ALMR PRISM

Decision-making is the process of identifying decision alternatives, assessing those alternatives based on predefined metrics, selecting an alternative (i.e., making a decision), and then implementing that alternative. The generation of decisions requires a structured, coherent process, or a decision-making process. The overall objective for this work is that the generalized framework is adopted into an autonomous decision-making framework and tailored to specific requirements for various applications. In this context, automation is the use of computing resources to make decisions and implement a structured decision-making process with limited or no human intervention. The overriding goal of automation is to replace or supplement human decision makers with reconfigurable decision-making modules that can perform a given set of tasks rationally, consistently, and reliably. Risk-informed decision-making requires a probabilistic assessment of the likelihood of success given the status of the plant/systems and component health, and a deterministic assessment between plant operating parameters and reactor protection parameters to prevent unnecessary trips and challenges to plant safety systems. The probabilistic portion of the decision-making engine of the supervisory control system is based on the control actions associated with an ALMR PRISM. Newly incorporated into the probabilistic models are the prognostic/diagnostic models developed by Pacific Northwest National Laboratory. These allow decisions to incorporate the health of components into the decision–making process. Once the control options are identified and ranked based on the likelihood of success, the supervisory control system transmits the options to the deterministic portion of the platform. The deterministic portion of the decision-making engine uses thermal-hydraulic modeling and components for an advanced liquid-metal reactor Power Reactor Inherently Safe Module. The deterministic multi-attribute decision-making framework uses various sensor data (e.g., reactor outlet temperature, steam generator drum level) and calculates its position within the challenge state, its trajectory, and its margin within the controllable domain using utility functions to evaluate current and projected plant state space for different control decisions. The metrics that are evaluated are based on reactor trip set points. The integration of the deterministic calculations using multi-physics analyses and probabilistic safety calculations allows for the examination and quantification of margin recovery strategies. This also provides validation of the control options identified from the probabilistic assessment. Thus, the thermalhydraulics analyses are used to validate the control options identified from the probabilistic assessment. Future work includes evaluating other possible metrics and computational efficiencies, and developing a user interface to mimic display panels at a modern nuclear power plant.

97 MATHEMATICS AND COMPUTING↗

Supervisory Control System for Multi-Modular Advanced Reactors

The proposed supervisory control system (SCS) may provide considerable benefits to advanced small modular reactors, including reduced plant staffing, optimized maintenance activities, greater plant availability, and higher operating efficiency. The SCS makes risk-informed decisions based on (1) a probabilistic assessment of the likelihood of success given the status of the plant/systems and component health, and (2) a deterministic assessment between plant operating parameters and reactor protection parameters to prevent unnecessary trips and challenges to plant safety system—one measure of SCS success. The probabilistic portion of the decision-making engine of the SCS is based on the control actions associated with an advanced liquid-metal reactor (ALMR) Power Reactor, Innovative, Small Module (PRISM). Within the SCS, the probabilistic assessment provides a ranking of viable control actions; however, certain instructions generated by the probabilistic model only include an abstract notion of action without specifications. For instance, one instruction may be to reduce power without specifying how much reduction is needed. The prognostic/diagnostic models incorporate the health of components into the decision-making process. Once the control options are identified and ranked based on the likelihood of success, the SCS transmits the options to the deterministic portion of the platform. The performance-based system models assess and rank each of the probabilistically identified control actions by taking into account the physical behavior (current and projected) of the system. The performance-based decision making module receives inputs from the probabilistic decision-making module and the ERM module to generate a single solution. Interfaces to these modules are defined later in the section. A utility theory algorithm factors into the decision making by estimating the distance from and approach to a trip setpoint for each control option. If the magnitude of a negative utility value increases rapidly as the system approaches the trip setpoint, that option is not likely to be the preferred option. This can lead to a re-ranking of the control options. The SCS then transmits a control signal(s) to a component or system and informs the operator of actions taken based on the action chosen. The SCS successfully coupled probabilistic and performance-based system models to arrive at optimal control decisions based on the actual status of the plant and components. The automatic, autonomous, and real-time performance requirements for a control system were met by the SCS. The value of coupling probabilistic and performance-based system models was demonstrated by the re-ranking of control options based on the use of a utility algorithm. The use of ERM monitors provides added value to the SCS as demonstrated by the re-ranking of control options based on a components degraded state.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Probabilistic Approach to Model Update

Finite element models are often developed for load validation, structural certification, response predictions, and to study alternate design concepts. In rare occasions, models developed with a nominal set of parameters agree with experimental data without the need to update parameter values. Today, model updating is generally heuristic and often performed by a skilled analyst with in-depth understanding of the model assumptions. Parameter uncertainties play a key role in understanding the model update problem and therefore probabilistic analysis tools, developed for reliability and risk analysis, may be used to incorporate uncertainty in the analysis. In this work, probability analysis (PA) tools are used to aid the parameter update task using experimental data and some basic knowledge of potential error sources. Discussed here is the first application of PA tools to update parameters of a finite element model for a composite wing structure. Static deflection data at six locations are used to update five parameters. It is shown that while prediction of individual response values may not be matched identically, the system response is significantly improved with moderate changes in parameter values.

Horta, Lucas G.↗

Assessing State Nuclear Weapons Proliferation: Using Bayesian Network Analysis of Social Factors

A Bayesian network (BN) model of social factors can support proliferation assessments by estimating the likelihood that a state will pursue a nuclear weapon. Social factors including political, economic, nuclear capability, security, and national identity and psychology factors may play as important a role in whether a State pursues nuclear weapons as more physical factors. This paper will show how using Bayesian reasoning on a generic case of a would-be proliferator State can be used to combine evidence that supports proliferation assessment. Theories and analysis by political scientists can be leveraged in a quantitative and transparent way to indicate proliferation risk. BN models facilitate diagnosis and inference in a probabilistic environment by using a network of nodes and acyclic directed arcs between the nodes whose connections, or absence of, indicate probabilistic relevance, or independence. We propose a BN model that would use information from both traditional safeguards and the strengthened safeguards associated with the Additional Protocol to indicate countries with a high risk of proliferating nuclear weapons. This model could be used in a variety of applications such a prioritization tool and as a component of state safeguards evaluations. This paper will discuss the benefits of BN reasoning, the development of Pacific Northwest National Laboratory’s (PNNL) BN state proliferation model and how it could be employed as an analytical tool.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Uncertainty analysis for unprotected accidents in sodium-cooled fast reactors.

Reactor safety analyses often utilize a deterministic approach where in addition to performing best estimate calculations, uncertainty is accommodated by performing calculations with pessimistic values for input parameters that are important to safety. Here, a stochastic approach is considered for explicitly including uncertainty in safety parameters by applying Monte Carlo sampling coupled with established deterministic reactor safety analysis tools. The Monte Carlo approach yields frequency distributions for reactor safety metrics (e.g., peak temperatures) that can be compared to performance limits, allowing for an improved determination of the safety margin and a clear determination of which safety parameters are most important to the transient response. Because the approach enables the estimation of probabilities for violating safety boundaries, it should be useful in a risk-based regulatory environment. It has the advantage of not requiring any substantial rewriting of existing safety analysis computer codes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Bayesian-Motivated Probabilistic Model of Hurricane-Induced Multimechanism Flood Hazards

Multimechanism floods (MMFs) are caused by the simultaneous occurrence of more than one flood mechanism such as storm surge, precipitation, tides, and waves. MMFs can lead to more severe or differing impacts than single-mechanism floods. As a result, comprehensive risk assessments require the ability to assess the multivariate probabilistic behaviors of hazards from MMFs. Here this study introduces a novel Bayesian-motivated approach for the probabilistic assessment of hurricane-induced hazards from the combination of the surge, precipitation, tides, and river antecedent flow. A Bayesian network (BN) is developed to capture the physical (conditional) relationship between variables and facilitate the generation of a hazard curve for river discharge that captures the contributions from multiple flood drivers. A case study located along the Delaware River is used to illustrate the proposed approach. Five computationally efficient representative predictive models are developed to estimate the conditional distributions required for the BN as a means of demonstrating the overall framework. The predictive models used in this study act as placeholders and can be replaced with more sophisticated and high-fidelity models depending on the desired accuracy level. While the predictive models are intended to be representative and illustrative, the model performance is evaluated using three historical storms that affected the area. Overall, the proposed framework is shown to be transparent, effective, and adaptable.

54 ENVIRONMENTAL SCIENCES↗

A methodology for evaluating the reliability and risk of structures under complex service environments

The theoretical basis and numerical implementation of NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), a computer code for probabilistic structural analysis of aerospace components, are described, with an emphasis on the use of NESSUS for reliability and risk assessment. Topics addressed include the structure of probabilistic models of fatigue-crack initiation, risk/cost evaluation, fatigue-fracture analysis, and fatigue-crack initiation. Numerical results from typical applications are presented in graphs and briefly characterized. The usefulness of NESSUS predictions for establishing inspection and retirement schedules and for component certification is indicated.

Shiao, Michael C.↗

Method of Distributions for Two‐Phase Flow in Heterogeneous Porous Media

Abstract Multiscale heterogeneity and insufficient characterization data for a specific subsurface formation of interest render predictions of multi‐phase fluid flow in geologic formations highly uncertain. Quantification of the uncertainty propagation from the geomodel to the fluid‐flow response is typically done within a probabilistic framework. This task is computationally demanding due to, for example, the slow convergence of Monte Carlo simulations (MCS), especially when computing the tails of a distribution that are necessary for risk assessment and decision‐making under uncertainty. The frozen streamlines method (FROST) accelerates probabilistic predictions of immiscible two‐phase fluid flow problems; however, FROST relies on MCS to compute the travel‐time distribution, which is then used to perform the transport (phase saturation) computations. To alleviate this computational bottleneck, we replace MCS with a deterministic equation for the cumulative distribution function (CDF) of travel time. The resulting CDF‐FROST approach yields the CDF of the saturation field without resorting to sampling‐based strategies. Our numerical experiments demonstrate the high accuracy of CDF‐FROST in computing the CDFs of both saturation and travel time. For the same accuracy, it is about 5 and 10 times faster than FROST and MCS, respectively.

Yang, Hyung Jun↗

Safety Risk Knowledge Elicitation in Support of Aeronautical R and D Portfolio Management: A Case Study

Aviation is a problem domain characterized by a high level of system complexity and uncertainty. Safety risk analysis in such a domain is especially challenging given the multitude of operations and diverse stakeholders. The Federal Aviation Administration (FAA) projects that by 2025 air traffic will increase by more than 50 percent with 1.1 billion passengers a year and more than 85,000 flights every 24 hours contributing to further delays and congestion in the sky (Circelli, 2011). This increased system complexity necessitates the application of structured safety risk analysis methods to understand and eliminate where possible, reduce, and/or mitigate risk factors. The use of expert judgments for probabilistic safety analysis in such a complex domain is necessary especially when evaluating the projected impact of future technologies, capabilities, and procedures for which current operational data may be scarce. Management of an R&D product portfolio in such a dynamic domain needs a systematic process to elicit these expert judgments, process modeling results, perform sensitivity analyses, and efficiently communicate the modeling results to decision makers. In this paper a case study focusing on the application of an R&D portfolio of aeronautical products intended to mitigate aircraft Loss of Control (LOC) accidents is presented. In particular, the knowledge elicitation process with three subject matter experts who contributed to the safety risk model is emphasized. The application and refinement of a verbal-numerical scale for conditional probability elicitation in a Bayesian Belief Network (BBN) is discussed. The preliminary findings from this initial step of a three-part elicitation are important to project management practitioners as they illustrate the vital contribution of systematic knowledge elicitation in complex domains.

Shih, Ann T.↗