Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Roadmap to Iodine and Mercury Abatement Materials Selection in Nuclear Waste Processing Off-Gas Streams

This work provides a guide for candidate mercury (Hg) and iodine-129 (129I) abatement material identification, screening, evaluation, technical gap identification, and bench-scale testing prioritization while also conceptualizing a materials deployment roadmap for implementation of new materials in the Hanford Waste Treatment and Immobilization Plant (WTP) Low-Activity Waste (LAW) Facility at Hanford in Richland, Washington, and elsewhere in the U.S. Department of Energy (DOE) complex for similar applications. The study was prompted by the need to replace the Kombisorb BAT-37 due to uncertainties in Hg and 129I capture performance and future availability for use in the WTP LAW Facility secondary off-gas system, specifically the Carbon Adsorber units. However, replacement of this material could also mitigate two other issues with Kombisorb BAT-37 (and its successor BAT II 37): (1) fire safety risk due to exothermic heat generated by adsorption reactions between the carbon material and Hg and (2) the risk of low retention of 129I in glass and subsequent downstream impacts on secondary liquid waste treatment at the Effluent Treatment Facility.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Safety-Related Instrumentation and Control Pilot Upgrade: Initial Scoping Phase Implementation and Lessons Learned

In May 2016, the U.S. Nuclear Regulatory Commission (NRC) staff provided a digital instrumentation and control (I&C) regulatory infrastructure integrated action plan to the NRC for approval. One of the objectives of that plan was to establish a clear regulatory structure with reduced regulatory uncertainty to enable the expanded safe use of digital I&C in commercial nuclear reactors while continuing to ensure safety and security. To achieve this end, the NRC, with collaboration from industry, developed a streamlined License Amendment Request Alternate Review (AR) process for safety-related (SR) digital I&C upgrades. In spite of this effort, the industry has remained reluctant to perform such I&C upgrades because of perceived regulatory and financial risks associated with being the first or an early adopter of the AR process for SR I&C upgrades. The U.S. Department of Energy Light Water Reactor Sustainability Program at the Idaho National Laboratory performed Initial Scoping Phase research to help break this impasse by supporting a SR I&C Pilot Upgrade, working with MPR Associates, ScottMadden Inc., and Exelon Generation. Exelon’s Limerick Generating Station (LGS) was selected as the target for this research. This paper summarizes the Initial Scoping Phase engineering and operations, licensing, and project management activities necessary to bound the scope, schedule, and estimated cost of the project sufficiently to enable utility management authorization of Conceptual Design Phase activities. These efforts and associated products are intended to provide a template to support larger industry efforts to perform similar upgrades as a foundation stone for a digital transformation that will improve plant safety, reliability, and operational performance while lowering plant total cost of ownership. As a result of the combined effort of Exelon Generation and research participants, Conceptual Design Phase activities for the subject upgrade at LGS were approved by Exelon. Further, the U.S. Department of Energy also awarded a $50 million cost share award to Exelon in order to pave the way for SR I&C modernization and associated control room upgrades across the U.S. nuclear fleet. Additional research reports are planned for the Conceptual Design Phase, Detailed Design Phase, and the Implementation Phase of the LGS project to document the process followed and promulgate lessons learned to industry.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Integrated global assessment of the natural forest carbon potential

Forests are a substantial terrestrial carbon sink, but anthropogenic changes in land use and climate have considerably reduced the scale of this system. Remote-sensing estimates to quantify carbon losses from global forests are characterized by considerable uncertainty and we lack a comprehensive ground-sourced evaluation to benchmark these estimates. Here we combine several ground-sourced and satellite-derived approaches to evaluate the scale of the global forest carbon potential outside agricultural and urban lands. Despite regional variation, the predictions demonstrated remarkable consistency at a global scale, with only a 12% difference between the ground-sourced and satellite-derived estimates. At present, global forest carbon storage is markedly under the natural potential, with a total deficit of 226 Gt (model range = 151–363 Gt) in areas with low human footprint. Most (61%, 139 Gt C) of this potential is in areas with existing forests, in which ecosystem protection can allow forests to recover to maturity. The remaining 39% (87 Gt C) of potential lies in regions in which forests have been removed or fragmented. Although forests cannot be a substitute for emissions reductions, our results support the idea that the conservation, restoration and sustainable management of diverse forests offer valuable contributions to meeting global climate and biodiversity targets.

54 ENVIRONMENTAL SCIENCES↗

Determining hexavalent chromium transport properties in alkaline nuclear waste using nuclear magnetic resonance spectroscopy

This study focuses on the transport properties of hexavalent chromium, specifically the chromate anion, to improve predictive models and environmental remediation strategies for Cr(VI) migration. Using 53 Cr Nuclear Magnetic Resonance (NMR) spectroscopy, the research quantifies chromate in multicomponent electrolytes replicating nuclear waste conditions at the Hanford Site in Washington State. The consistency of the 53 Cr NMR signal integral with chromate concentration, despite varying matrix compositions, establishes it as a reliable concentration indicator. The transport properties of chromate in an alkaline solution were assessed using relaxation-based measurements via saturation recovery and Carr-Purcell-Meiboom-Gill experiments, determining spin-lattice and spin-spin relaxation times. These measurements, combined with the Bloembergen-Purcell-Pound equation, helped estimate the rotational correlation time and the 53 Cr self-diffusion coefficient using Stokes-Einstein-Debye and Stokes-Einstein equations. Direct measurements were obtained through pulsed field gradient stimulated echo 53 Cr NMR spectroscopy. Monte Carlo simulations further estimated uncertainty propagation. The results enhance comprehension of chromate transport and highlight prospects for identifying transport properties of NMR-active nuclei, traditionally considered unreachable.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Monitoring with Trackers Based on Semi-Quantitative Models

In three years of NASA-sponsored research preceding this project, we successfully developed a technology for: (1) building qualitative and semi-quantitative models from libraries of model-fragments, (2) simulating these models to predict future behaviors with the guarantee that all possible behaviors are covered, (3) assimilating observations into behaviors, shrinking uncertainty so that incorrect models are eventually refuted and correct models make stronger predictions for the future. In our object-oriented framework, a tracker is an object which embodies the hypothesis that the available observation stream is consistent with a particular behavior of a particular model. The tracker maintains its own status (consistent, superceded, or refuted), and answers questions about its explanation for past observations and its predictions for the future. In the MIMIC approach to monitoring of continuous systems, a number of trackers are active in parallel, representing alternate hypotheses about the behavior of a system. This approach is motivated by the need to avoid 'system accidents' [Perrow, 1985] due to operator fixation on a single hypothesis, as for example at Three Mile Island. As we began to address these issues, we focused on three major research directions that we planned to pursue over a three-year project: (1) tractable qualitative simulation, (2) semiquantitative inference, and (3) tracking set management. Unfortunately, funding limitations made it impossible to continue past year one. Nonetheless, we made major progress in the first two of these areas. Progress in the third area as slower because the graduate student working on that aspect of the project decided to leave school and take a job in industry. I enclosed a set of abstract of selected papers on the work describe below. Several papers that draw on the research supported during this period appeared in print after the grant period ended.

Kuipers, Benjamin↗

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2024)

The Spent Fuel and Waste Science and Technology Campaign (SFWST) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two priorities for SFWST are design concept development and disposal system modeling. These priorities are directly addressed in the Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Reliability and resilience of environmental flows under uncertainty: reconsidering water year types and inconsistent flow requirements in California

Abstract Environmental water allocation in California is a complex legal process involving various government agencies and stakeholders. E-flow requirements can be based on annual runoff typologies called water year types (WYTs), which dictate water volume, timing, and duration. In this study, we examined hydropower licensing documents of the major water and power projects in the Central Sierra Nevada to catalog e-flow requirements by WYT. In this study case, we identify how WYT classification systems and categories vary across and within different basins. Additionally, we assessed the impacts of climate change on hydrology, the frequency of WYTs identified, and the reliability and resilience of e-flows using future projections (2031–2060) of 10 Global Circulation Models (GCMs). We then propose a potential adaptation strategy using a 30 year moving percentiles approach to recalculate WYTs. We identified eight WYT classifications systems were identified, and their WYT distributions statistically significantly changes across all GCMs, even though most GCMs indicate no statistically significant change in hydrology. Disparities in future impacts are observed among and within hydropower projects, with some river reaches showing negative impacts on reliability and resilience. The adaptation strategy can generally boost resilience and improve reliability, but simply updating existing WYT thresholds without flexible regulatory frameworks reconsidering WYTs and e-flows thresholds, may not yield substantial improvements. Challenges in managing e-flows in California within regulatory and hydroclimatic contexts are intricate due to the lack of standardized approaches, leading to inconsistencies and potential conflicts among stakeholders, that will likely be exacerbated by climate change. Thus, we emphasize that targeted, site-specific, and adaptive management strategies are crucial, besides the need for a harmonized and consistent approach to defining and applying WYT categories and methods and/or e-flow assessments.

Environmental Sciences & Ecology↗

Multi-application controls: Robust nonlinear multivariable aerospace controls applications

This viewgraph presentation describes the general methodology used to apply Honywell's Multi-Application Control (MACH) and the specific application to the F-18 High Angle-of-Attack Research Vehicle (HARV) including piloted simulation handling qualities evaluation. The general steps include insertion of modeling data for geometry and mass properties, aerodynamics, propulsion data and assumptions, requirements and specifications, e.g. definition of control variables, handling qualities, stability margins and statements for bandwidth, control power, priorities, position and rate limits. The specific steps include choice of independent variables for least squares fits to aerodynamic and propulsion data, modifications to the management of the controls with regard to integrator windup and actuation limiting and priorities, e.g. pitch priority over roll, and command limiting to prevent departures and/or undesirable inertial coupling or inability to recover to a stable trim condition. The HARV control problem is characterized by significant nonlinearities and multivariable interactions in the low speed, high angle-of-attack, high angular rate flight regime. Systematic approaches to the control of vehicle motions modeled with coupled nonlinear equations of motion have been developed. This paper will discuss the dynamic inversion approach which explicity accounts for nonlinearities in the control design. Multiple control effectors (including aerodynamic control surfaces and thrust vectoring control) and sensors are used to control the motions of the vehicles in several degrees-of-freedom. Several maneuvers will be used to illustrate performance of MACH in the high angle-of-attack flight regime. Analytical methods for assessing the robust performance of the multivariable control system in the presence of math modeling uncertainty, disturbances, and commands have reached a high level of maturity. The structured singular value (mu) frequency response methodology is presented as a method for analyzing robust performance and the mu-synthesis method will be presented as a method for synthesizing a robust control system. The paper concludes with the author's expectations regarding future applications of robust nonlinear multivariable controls.

Enns, Dale F.↗

Chemist: A Domain-Specific Language by Chemists for Chemists

Managing the complexity of quantum chemistry (QC) software is key to ensuring it remains accessible, maintainable, and reusable. Noticeably missing from the QC ecosystem are modules targeting bottleneck routines. Here we argue that this is likely due to the difficulty in defining interfaces for such modules. To that end, we introduce the open-source, publicly available Chemist library https://github.com/NWChemEx/Chemist. Chemist is a domain-specific language targeting the QC domain. Chemist has been developed focusing on performance and user-friendliness. Using Chemist, QC tasks are defined using familiar domain concepts such as molecules, wave functions, and operators. The domain objects are hierarchical to ensure a systematic encapsulation of information. Key features of Chemist include: extensibility, the ability to alias existing data, and the ability to succinctly define many common QC tasks. The usefulness of Chemist is demonstrated by discussing the interface of NWChemEx’s Fock build module and by showcasing a proof-of-concept self-consistent field algorithm containing uncertainty propagation.

Algorithms↗

Evaluation of Hypotheses for the Fate of Historical Discharges from Hanford Site BC Cribs and Trenches

A preliminary review of declassified reports and historical documents from the 1950s and 1960s indicated they may contain valuable information regarding potential impacts to groundwater from liquid waste discharged to the 216-BC Cribs and Trenches during the late 1950s. Transport of contaminants in the vadose zone beneath the BC Cribs area is simulated by a vadose zone model developed for the Composite Analysis (DOE/RL-2019-52, Composite Analysis for Low-Level Waste Disposal in the Hanford Site Central Plateau ). Results from this model indicate there has been no substantial breakthrough of contaminants (particularly technetium-99) to groundwater from the vadose zone up to the present day. However, there is uncertainty in the anisotropy and other model input parameters as well as acknowledged sparseness of sampling data for this area. In this study, historical documents and other information were reviewed to evaluate the possibility that contaminant breakthrough to groundwater occurred during or shortly after operation of the BC Cribs sites, and whether refinements of the vadose zone model parametrization should be considered.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

MatLib-1.1: Nuclear Material Properties Library: Developed under NQA-1-2017

The U.S. Nuclear Regulatory Commission (NRC) uses the computer code Fuel Analysis under Steady-state and Transients (FAST) to model steady-state and transient fuel behavior to support regulatory decisions. FAST relies on a material properties library (MatLib) that contains the thermal and mechanical properties of the nuclear materials and coolants of interest to support the US commercial nuclear industry. MatLib contains properties for a variety of nuclear fuels, cladding and other structural materials, gases, and coolants. In this document, material property correlations for the materials contained within MatLib are presented and discussed. When available, comparisons are made between the material property correlations and available data. Additionally, uncertainties are quantified on the material properties, which is then used by the NRC to support uncertainty quantification for best-estimate plus uncertainty safety evaluation reviews. This document describes MatLib-1.1, which was updated from MatLib-1.0 to include the addition of Lua functionality and code changes for integration with FAST. The results of MatLib did not change between MatLib-1.0 and MatLib-1.1; however, the source code changes warranted incrementing the minor numbering of the software version number. This document is one of a series of documents on FAST; the other documents detail the models used by FAST as well as its integral assessment to experiments and commercial data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2021)

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. GDSA Framework is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-21SN01030404) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2021) (M3SF-21SN010304042). It presents high level objectives and strategy for development of uncertainty and sensitivity analysis tools, demonstrates uncertainty quantification (UQ) and sensitivity analysis (SA) tools in GDSA Framework in FY21, and describes additional UQ/SA tools whose future implementation would enhance the UQ/SA capability of GDSA Framework. This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-21SN01030405), the GDSA Repository Systems Analysis work package (SF-21SN01030406), and the GDSA PFLOTRAN Development work package (SF-21SN01030407). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF 20SN010304032.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

GDSA Repository Systems Analysis Investigations in FY 2024

The Disposal Research and Development (R&D) Program of the US Department of Energy (DOE) office of Nuclear Energy (NE-8) Spent Fuel and Waste Science and Technology (SFWST) Campaign is to conduct R&D on disposal of spent nuclear fuel (SNF) and high-level waste (HLW). The goal of the Geologic Disposal Safety Assessment (GDSA) within this project is to develop a disposal system modeling and analysis capability that supports the integrated modeling of coupled processes controlling disposal system performance of deep geologic repositories, including uncertainty. This report describes specific activities in the Fiscal Year (FY) 2024 associated with the GDSA Repository Systems Analysis (RSA) work package. The overall objective of the GDSA RSA work package is to develop generic deep geologic repository concepts and repository system performance models in crystalline, argillite, salt, and unsaturated alluvium potential host-rock environments, and to simulate and analyze these generic repository concepts and models using GDSA Framework toolkit, and other tools as needed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Health Physics Research Reactor Criticality Accident Alarm System Benchmark Overview

From the countless critical experiments performed in the world during the past century, high-quality integral benchmarks experiments have been collected and gathered into the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook), managed by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Working Group. This information preservation and dissemination effort is crucial for reactor licensing as well as criticality and radiation transport modeling validation. This summary reports on the status of a tentative benchmark addition to the ICSBEP Handbook. The proposed benchmark arises from legacy operation data of the Oak Ridge National Laboratory (ORNL) Health Physics Research Reactor (HPRR). The HPRR was a small, unmoderated, unshielded fast burst reactor that was used for research in health physics and radiobiology as well as teaching and training. As part of a comprehensive investigation of the available HPRR operation data and characteristics, different possibilities for use of the valuable results were studied. A critical experiment benchmark evaluation was performed, analyzing data coming from sub-critical and critical operation of the HPRR during operator training, steady-state irradiation of samples and before critical bursts. The results of the evaluation do not satisfy for the ICSBEP standards as the benchmark relative standard uncertainty is of about 4% for k eff , and the relative difference between sample calculations and expected k eff results is of about 1.5%. Due to those unsatisfactory results, it was decided not to pursue critical experiments evaluation of the HPRR presently and to focus instead on shielding type data for the creation of a criticality accident alarm system (CAAS) and shielding category benchmark, which is currently very scarce in the ICSBEP handbook—especially concerning critical, pulsed assembly, or reactor operation data. Several dosimetry and shielding experiments from HPRR burst operation were evaluated, with different benchmark metrics as sulfur fluence, Element 57 dose, or neutron fluence at different distances and under different shield materials conditions. An evaluation focusing on the Element 57 neutron dose as a benchmark metric was submitted to the ICSBEP Technical Review Group (TRG) meeting in October 2021, and the inclusion of the evaluation in the ICSBEP Handbook was deferred. The main change proposed by the international experiment evaluation experts is to use the neutron fluence measured by Bonner spheres as a benchmark metric. This represents a quantity closer to that actually measured by the experimentalists of the HPRR compared to the Element 57 dose, which adds another step of data transformation, thus potentially adding uncertainty to the benchmark. The evaluation has been updated and will be submitted to the 2022 ICSBEP TRG meeting for inclusion in the 2023 edition of the ICSBEP Handbook. The evaluation is performed using the KENO and MAVRIC combination from the SCALE 6.2.4 code suite which was previously used in similar CAAS benchmarks to allow for the use of variance reduction techniques.

61 RADIATION PROTECTION AND DOSIMETRY↗

Computational Fluid Dynamics Simulation of Methane Slosh and Drain Experiments

NASA possesses a wealth of historical cryogenic experiments that provide valuable insights into the design, troubleshooting, and understanding involved in the complex fluid and thermodynamics of managing cryogenic propellants. One approach to leveraging these historical datasets is by simulating these experiments to validate the accuracy of simulation environments and constituent models. This study focused on simulating a selection of the K site test series for both static and sloshing pressurized liquid methane draining experiments conducted at NASA in the 1970’s, utilizing computational fluid dynamics. The simulations were performed in the ANSYS FLUENT environment using the Volume of Fluid (VOF) numerical approach. A k-omega turbulence model was used with interfacial turbulence damping, and accurately predicted the amount of pressurant needed to maintain the required tank pressure throughout the static drain. The static simulation predicted the temperature stratification in the ullage observed at the end of the drain. During the methane expulsion with sloshing test, many features were successfully captured using the k-omega turbulence model with interfacial turbulence damping included. The rate of phase change and liquid temperature was overpredicted compared to the experimental measurements. The overprediction may be attributed to uncertainties in the vessel geometry, methane pressurant temperature and composition, and methodological differences in how the sloshing frequency was adjusted during the expulsion.

Cryogenic Propellants↗

Industrial battery operation and utilization in the presence of electrical load uncertainty using Bayesian decision theory

Behind the meter battery storage is becoming increasing popular in all sectors, though enthusiasm has recently lagged in the industrial sector. Even though there may be many factors contributing to this including lack of innovation, prohibitive costs, and undesirable rate structures, a difficulty arises in accounting for uncertainty of electrical load in industrial facilities while still attempting to utilize battery storage as much as possible all while trying to achieve fiscal profitability. Here this study utilizes Gaussian process regression and Bayesian decision theory to organize load data and quantify electrical load uncertainty to properly and effectively discharge industrial battery storage. The study employs a simulation model to set battery load setpoints for the span of the utility billing period according to the degree of risk aversion. This combination of economic analysis according to utility billing period and utilization of degree of risk aversion to make decisions on the uncertainty of the data has not before been applied to battery storage. The method resulted in an annual average reduction of peak demand by 3.8 % at the lowest amount of savings and lowest risk aversion. The highest risk aversion resulted in an annual average reduction of peak demand of 7.5 %. The maximum reduction of peak load in any month was 13.8 % in the month of December with a relatively high risk aversion. With a the highest amount risk aversion tested, the model reduced demand ten of the twelve months of the year.

25 ENERGY STORAGE↗

A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings

Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of a proposed expert system development methodology: Two case studies

Two expert system development projects were studied to evaluate a proposed Expert Systems Development Methodology (ESDM). The ESDM was developed to provide guidance to managers and technical personnel and serve as a standard in the development of expert systems. It was agreed that the proposed ESDM must be evaluated before it could be adopted; therefore a study was planned for its evaluation. This detailed study is now underway. Before the study began, however, two ongoing projects were selected for a retrospective evaluation. They were the Ranging Equipment Diagnostic Expert System (REDEX) and the Backup Control Mode Analysis and Utility System (BCAUS). Both projects were approximately 1 year into development. Interviews of project personnel were conducted, and the resulting data was used to prepare the retrospective evaluation. Decision models of the two projects were constructed and used to evaluate the completeness and accuracy of key provisions of ESDM. A major conclusion reached from these case studies is that suitability and risk analysis should be required for all AI projects, large and small. Further, the objectives of each stage of development during a project should be selected to reduce the next largest area of risk or uncertainty on the project.

Gilstrap, Lewey↗