SEARCH · Engineering Papers

Results for “Risk Informed Decision Making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Updates to a Preliminary Probabilistic Performance Assessment Model for Radiological and Chemical Contamination at the West Valley Site, New York - 20420

The New York State Energy Research and Development Authority (NYSERDA) is the owner of the Western New York Nuclear Service Center (WNYNSC), a 1,351-ha site located approximately 48 km south of Buffalo, New York. In 1962, Nuclear Fuel Services, Inc. (NFS) entered into agreements with the Atomic Energy Commission and New York State to construct the first commercial reprocessing plant of nuclear fuel in the United States at the WNYNSC. NFS built and operated the spent fuel reprocessing plant and waste disposal facilities, processing 640 Mg (640 metric tons) of spent nuclear fuel from 1966 to 1972 under an Atomic Energy Commission license. Nuclear fuel reprocessing operations halted in 1972 and never restarted, leaving behind radioactive and chemical wastes. The U.S. Department of Energy (DOE) was required to complete certain waste management activities under the West Valley Demonstration Project (WVDP) Act of 1980 including decommissioning of WVDP facilities. As collaborating agencies, NYSERDA and the DOE are tasked with making decisions about decommissioning and risk reduction for the West Valley Site. Neptune and Company, Inc. (Neptune) was contracted to develop a probabilistic performance assessment (PPA) model to assist the agencies in their decision making process for decommissioning the WVDP and WNYNSC. One important tool that is needed in order to inform the decision-making process is a science-based model of the West Valley Site that evaluates potential future consequences for human health and the environment. This forms the core of the spatial domain of the West Valley PPA Model. The PPA Model, developed using the GoldSim system modeling software, is a tool intended to provide support for decision making that evaluates uncertainty, in a manner that is transparent, defensible, and robust. The PPA Model includes contaminant transport and health effects components, and is organized around geographically-grouped contaminated facilities. These include the waste disposal areas licensed by the U.S. Nuclear Regulatory Commission and the State of New York, a waste tank farm for storage of high level radioactive waste resulting from reprocessing operations, and several areas contaminated with radioactive and chemical constituents. The PPA Model evaluates contaminant transport from these sources to points of exposure across the site and into receiving surface waters and sediments. Hypothetical people and wildlife could be exposed to contamination at these locations, and the effects of these exposures are evaluated. Contaminant transport processes to be evaluated in the PPA Model include groundwater and surface water transport, contaminant translocation by plants and animals, diffusion, and erosion. The evaluation of exposures to people in this preliminary model is limited to a resident farmer scenario, and ecological assessment is performed at the level of a screening analysis. The results of these preliminary evaluations inform future model developments. PPA Model results are subjected to sensitivity analysis in order to determine those pathways and parameters that are most significant in influencing the results. This information allows analysts and decision makers to focus on those aspects of Site behavior and processes. With this information, the decision makers can drive informed, defensible decisions regarding decommissioning of the Site. This paper includes an update of the information presented at WM2019 [1]. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

A robust offering strategy for wind producers considering uncertainties of demand response and wind power

This paper proposes a risk-constrained decision-making approach for a wind power producer participating in the day-ahead market. In the developed model, a flexible demand response trading scheme between the wind power producer and different customers is employed. Through the proposed demand response mechanism, the wind power producer is able to trade demand response resource internally with different customers, and then trade energy externally with the market to increase the expected profit and the wind energy utilization. The uncertainties in the wind power and demand response are modeled by using the information gap decision theory approach from risk averse (robust) and risk-seeking (opportunistic) perspectives. The objective of the robust model is to maximize the robust level while satisfying the desired profit, whereas the opportunistic model aims to evaluate the possibility of achieving windfall profits with favorable uncertainties. The overall offering strategy problem is modeled as a bi-objective mixed integer nonlinear programming, which is linearized by proper techniques and solved efficiently by using the normal boundary intersection technique. In this work, simulation results show that utilizing demand response resource to mitigate wind power deviations can increase a wind power producer's profit and reduce potential risks. In addition, the results demonstrate that the proposed bi-objective optimization approach enables the wind power producer to select appropriate offering decisions with respect to uncertainties.

17 WIND ENERGY↗

DOE OSTI2020

Case Studies of the Economic Impacts of Power Interruptions and Damage to Electricity System Infrastructure from Extreme Events

The risks of long-duration, widespread interruptions (LDWIs) in electrical power are a concern of U.S. regulators, the electric power industry, and stakeholders. Those responsible for making decisions about increasingly costly investments to prevent such interruptions and to facilitate rapid recovery when they do occur need relevant information on which to base those decisions. Although a number of studies have examined the physical and engineering impacts of extreme weather and other precipitating events on the bulk power system, decision makers evaluating investments in preventive strategies need information on the costs of past power interruptions and the benefits of preventing them in the future. This paper contributes to addressing this need by offering six case studies that detail the economics, at the level of the utility service territory, of power interruptions caused by extreme weather and lasting from a few days to several weeks. These intermediate-duration interruptions have been, and will continue to be, the most common type of major electric power disruption. They are longer than the short-term disruptions addressed in utility reliability planning, but not as long or widespread geographically as the national-scale interruptions with durations of many weeks, months, or longer that have been examined in some recent studies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRSDate not supplied

Combining NASA Earth Observations and Commercial Smallsat Data to Inform Localized Decision Making

NASA's Earth Science Division's DEVELOP Program builds capacity in individuals and partner organizations to research the feasibility of using Earth observations for informed environmental decision making. Employing an internship-like model, DEVELOP conducts 10-week long feasibility studies that are focused on decision-making organizations' environmental concerns. These projects use the vantage point of space to address environmental issues across a broad set of themes, including agricultural monitoring, disaster risk and resilience planning, water resource and coastal management, wildfire cartography, health & air quality, and urban development. Following the establishment of NASA's Commercial Smallsat Data Acquisition (CSDA) Program, DEVELOP began adding commercial smallsat data into a subset of its feasibility projects. This presentation will highlight the program's use of CSDA data and its integration with NASA Earth observing fleet data, showcase example use cases, speak to challenges faced by the DEVELOP team in using CSDA data, and the broad array of thematic and topical applications created by DEVELOP teams.

Lisa Tanh↗

NASA NTRSDate not supplied

Sensorimotor Application of Proposed Methods to Combine the Effects of Multiple Countermeasures for PRisM

Risk associated with human systems is challenging to quantify but is critical for the mission planning and decision making required to enable future Lunar and Martian missions. To address this gap, the Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) project is developing an integrated computational model for CHP mission risk. Much like how MEDPRAT is designed to allow medical resource trades informed by medical risk, CHP-PRA will enable analogous trades in human system risks across multiple CHP functions and capabilities. Human performance is one component of the risk intended to be captured by CHP-PRA through the Performance Risk Model (PRisM). The sensorimotor risk area provides a good frame of reference for investigating the structure of a performance model because most tasks that astronauts are expected to perform require input from the sensory system and/or movement/motor control. Additionally, sensorimotor countermeasures are an area of particular concern for NASA’s Human Research Program because of the increased sensorimotor risk associated with surface operations in Lunar and Martian missions. Thus, a tool that can quickly compare risk reductions of potential countermeasures would be beneficial in guiding research and development of effective countermeasures. In this proof of concept, we present a systematic way to combine multiple performance data sets for humans subjected to different countermeasures such that we can predict the countermeasure(s) that optimize astronaut performance on relevant tasks. PRisM assumes that both the tests that are used to measure countermeasure effectiveness (input data) and the tasks we use to represent astronaut performance, can be broken down and represented as a function/vector of the human systems required to perform that test/task. Through mathematical combination, test data are used to predict performance on astronaut tasks that use similar systems. We propose that when combining countermeasures evaluated using the same test, that only one value should be used to represent their combined effectiveness. We start our analysis with the assumption that two countermeasures together will perform better than each countermeasure individually. Our initial implementation of this framework compares various space motion sickness countermeasures and the most up to date analysis will be demonstrated at the IWS.

Caroline R Austin↗

DOE OSTI2020

Panel Session 128: Best Practices in Project Communications

This panel focused on a sustainable, holistic and integrated approach to structure nuclear waste management, disposal and remediation decisions. This panel had participation from internal and external stakeholders and demonstrate use of tools and techniques to effectively communicate factors that inform decisions. The desired outcome was to effectively communicate how risk is evaluated at complex sites, highlight holistic site level approaches that are protective of human health and the environment, and incorporate policy and technical concerns related to achieving alternative end points. This discussion included existing decision-making tools in conjunction with case studies. Panelists with presentations: Removing the Cloak of Secrecy from Legacy Cleanup at Los Alamos National Laboratory (David Nickless); Best Practice In Project Communications (Alan Paulley); Stakeholder and Public Engagement (Mark Lesinski); Stakeholder Engaged Structured Decision Making (Kelly Black)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

System Health and Status Reporting is Used to Improve Infrastructure Systems at the Hanford Site - 20449

Reliable physical infrastructure systems are vital to completing the clean-up mission and the start-up and commissioning of new nuclear waste processing facilities at the Hanford Site. Key infrastructure systems at Hanford include water, sewer, and electrical utilities, roads, telecommunications/network systems, and fire systems. All of the infrastructure systems are non-nuclear, General Service systems that are being maintained under formal engineering configuration control and none are specifically credited in any documented safety analysis (DSA). Starting in calendar year 2017, the Hanford Site's infrastructure and services contractor started producing system health and status reports for a total of 15 critical infrastructure systems as means to get a better understanding of each system's health and how it could be improved to ensure better and more reliable service delivery. As the reporting, tracking, and use of the metrics has matured, the number of systems for which reports are being developed has been expanded to a total of 23. Each of the critical infrastructure systems are assigned primary and alternate design authorities that complete qualifications on each assigned system. The design authorities actively manage and maintain configuration control on each of their systems and track metrics associated with availability, maintenance (corrective and preventive), and configuration of the technical baseline. The metrics are based on the principles established in Chapter V of DOE O 420.1C, Facility Safety, [1] and have been tailored as appropriate to each of the key infrastructure systems. An overall assessment of system health is performed and documented on a routine basis (e.g., quarterly). Included in this documentation is a quantitative score for each of the metrics (i.e., availability, maintenance, configuration management) along with results of system walk-downs, description of any permanent design modifications, identification of new or emerging issues and vulnerabilities affecting the system, and an assessment by the design authority of actions necessary to improve the system health score. The overall status scores are calculated using a formula and based on a pre-determined grading scale, a color is assigned for simple presentation. The information gained from developing the reports is being used to (1) assist with making timely and better informed decisions through the use of solid technical bases that are increasing the overall reliability and capabilities of the Site's infrastructure systems as new expense and capital projects in the Reliability Projects Investment Portfolio (RPIP) are prioritized and executed; (2) feed the risk management program, and (3) integrate the technical content of Master Plans that describe the Site's needs for the system and the system's capabilities to meet those future needs. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

The modeling of risk perception in the use of structural health monitoring information for optimal maintenance decisions

This paper proposes an approach to select a maintenance strategy from a predefined set of choices considering the decision maker’s behavioral risk profile. It is assumed that the damage state is characterized by a continuous state parameter probabilistically inferred from observable sensor data. This work applies an engineering application of consequence-based decision-making incorporating the acceptable risk intensity of the decision-maker, i.e., the decision-maker’s (individual or an organization) valuation of the outcome of a decision, using a risk profile model. The utility of a decision-maker is subjective, and this paper considers the fact that different decision-makers mentally assign a different importance factor (the utility) to the seriousness or urgency to take necessary actions with the increasing intensity of structural damage. The approach herein incorporates a layer of human psychology on selecting appropriate maintenance strategies that not only depend on the posterior distribution of unmeasurable damage state but also consider the behavioral risk profile of the decision-maker. Further, the collective decision-making of an organization consisting of many individuals is also investigated. The approach is exemplified in a case study involving life cycle monitoring of a miter gate, part of a lock system enabling navigation of inland waterways.

42 ENGINEERING↗

DOE OSTI2024

Implementation and Operation of Power Flow Control Solutions for Transmission Systems

Power-flow controls (PFCs) technologies provide a suite of alternatives to more-efficiently direct the flow of power on the grid, improving flexibility and enabling the grid to be more responsive and resilient. PFCs can be used in many cases to mitigate overloads and consequently defer the installation of grid-expansion projects. They can also be suitable options in situations where new transmission lines cannot be built because of environmental constraints, land use, or other types of restrictions. Other uses include mitigation of loop or unintended flows, forcing of contractual or scheduled flows, reduction of congestion, and mitigation solutions during large maintenance or construction projects. While many studies have demonstrated the potential economic benefits of PFC for different types of applications, the implementation implications of using multiple PFCs for system operation and reliability have not been analyzed in detail. The lack of information and practical experience on these aspects hinders adoption of this technology. One use case would be that multiple PFCs are required to coordinate congestion management. In such cases, multiple PFCs are deployed in a meshed power system to control power flows across a wide area. The challenges are associated with PFC interaction—namely, the self and mutual power-flow sensitivity of each PFC, which must be accounted for in the calculation of the respective operating setpoints. This report analyzes implementation and operation that must be considered in evaluating transmission solutions using PFCs. The report first analyzes attributes with which PFC-based solutions should comply, based on the objective and characteristics of each particular use case. It then describes different approaches for coordinated control of multiple PFC devices for different applications, including options to avoid adverse interactions and reduce risks due to inappropriate coordination. Control and operation are illustrated through case studies performed on both generic and actual power system models. This report provides insights for transmission planners and operation engineers about the implementation of PFC-based transmission solutions; consequently, it will help them make informed decisions about the adoption of the technology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Uncertainty Analysis of Consequence Management Data Products

An interlaboratory effort has developed a probabilistic framework to characterize uncertainty in data products that are developed by the US Department of Energy Consequence Management Program in support of the Federal Radiological Monitoring and Assessment Center. The purpose of this paper is to provide an overview of the probability distributions of input variables and the statistical methods used to propagate and quantify the overall uncertainty of the derived response levels that are used as contours on data products due to the uncertainty in input parameters. Uncertainty analysis results are also presented for several study scenarios. This paper includes an example data product to illustrate the potential real-world implications of incorporating uncertainty analysis results into data products that inform protective action decisions. Data product contours that indicate areas where public protection actions may be warranted can be customized to an acceptable level of uncertainty. Finally, the investigators seek feedback from decision makers and the radiological emergency response community to determine how uncertainty information can be used to support the protective action decision-making process and how it can be presented on data products.

61 RADIATION PROTECTION AND DOSIMETRY↗

NASA NTRS2013

Understanding Crew Decision-Making in the Presence of Complexity: A Flight Simulation Experiment

Crew decision making and response have long been leading causal and contributing factors associated with aircraft accidents. Further, it is anticipated that future aircraft and operational environments will increase exposure to risks related to these factors if proactive steps are not taken to account for ever-increasing complexity. A flight simulation study was designed to collect data to help in understanding how complexity can, or may, be manifest. More specifically, an experimental apparatus was constructed that allowed for manipulation of information complexity and uncertainty, while also manipulating operational complexity and uncertainty. Through these manipulations, and the aid of experienced airline pilots, several issues have been discovered, related most prominently to the influence of information content, quality, and management. Flight crews were immersed in an environment that included new operational complexities suggested for the future air transportation system as well as new technological complexities (e.g. electronic flight bags, expanded data link services, synthetic and enhanced vision systems, and interval management automation). In addition, a set of off-nominal situations were emulated. These included, for example, adverse weather conditions, traffic deviations, equipment failures, poor data quality, communication errors, and unexpected clearances, or changes to flight plans. Each situation was based on one or more reference events from past accidents or incidents, or on a similar case that had been used in previous developmental tests or studies. Over the course of the study, 10 twopilot airline crews participated, completing over 230 flights. Each flight consisted of an approach beginning at 10,000 ft. Based on the recorded data and pilot and research observations, preliminary results are presented regarding decision-making issues in the presence of the operational and technological complexities encountered during the flights.

Young, Steven D.↗

DOE OSTI2025

Grid Architecture Mapping to Understand Transformation (GAMUT): Concept Definition

The electric power system is undergoing significant transformation driven by changes in the generation mix, increasing reliance on information and communication technologies, evolving customer expectations, and a dynamic cyber-physical environment. To address these challenges, substantial investments will be made over the next decade to create a flexible, affordable, secure, reliable, and resilient electric system. In response, the U.S. Department of Energy's Office of Electricity is developing knowledge management tools aimed at systematically documenting technology pilots and demonstration projects. This initiative seeks to improve understanding of operating contexts, planning steps, and integration requirements for innovative grid technologies. The Department of Energy project leverages Grid Architecture principles to collect and organize insights into the interdependencies, requirements, and capabilities of various grid solutions. By employing a systematic approach, the project aims to perform a feasibility study for the development of a software tool that will support stakeholders, including regulators, transmission and distribution system operators, distributed energy resources aggregators, and technology providers. By offering a systematic, software-based framework to document technologies, understand their benefits and impacts, and inform deployment strategies, the proposed Grid Architecture Mapping to Understand Transformation (GAMUT) Tool is intended to reduce costs, enhance decision-making, and facilitate scaling and effective deployment of new technologies. The feasibility study will evaluate the technical and financial viability of the GAMUT Tool, identifying stakeholder needs and assessing risks and mitigation strategies. Ultimately, the GAMUT team aims to develop an initial minimal viable product, followed by staged improvements, to aid in the modernization of the electric grid, contributing to a more sustainable and resilient energy future.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Big Data Analytics for Long-Term Meteorological Observations at Hanford Site

A growing number of physical objects with embedded sensors with typically high volume and frequently updated data sets has accentuated the need to develop methodologies to extract useful information from big data for supporting decision making. This study applies a suite of data analytics and core principles of data science to characterize near real-time meteorological data with a focus on extreme weather events. To highlight the applicability of this work and make it more accessible from a risk management perspective, a foundation for a software platform with an intuitive Graphical User Interface (GUI) was developed to access and analyze data from a decommissioned nuclear production complex operated by the U.S. Department of Energy (DOE, Richland, USA). Exploratory data analysis (EDA), involving classical non-parametric statistics, and machine learning (ML) techniques, were used to develop statistical summaries and learn characteristic features of key weather patterns and signatures. The new approach and GUI provide key insights into using big data and ML to assist site operation related to safety management strategies for extreme weather events. Specifically, this work offers a practical guide to analyzing long-term meteorological data and highlights the integration of ML and classical statistics to applied risk and decision science.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Vulnerabilities in Artificial Intelligence and Machine Learning Applications and Data

Artificial intelligence (AI) applications driven by machine learning (ML) are transformational technologies within the international nuclear security regime. Advancements realized by AI—faster and improved data insights, more efficient and automated processes, reductions in human error—enable nuclear security applications such as behavior analysis for insider threat mitigation, source tracking of stolen nuclear material, and facial recognition software for physical protection. In addition to the advantages, however, there are also inherent vulnerabilities and threats associated with its use and risk mitigations must be built into any AI/ML-enabled systems. This work provides a background on AI and ML and different data types used in the field, including open-source intelligence information (OSINT) that is discoverable by AI tools and application data that are used by AI tools for decision-making and automation. Current and potential AI applications and vulnerabilities related to their use within the nuclear security regime are also discussed.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

NASA NTRS1994

Situational Variables in Expert Pilot Decision Making

In traditional laboratory studies of decision making, the experimenter structures the problem, defines the goal and specifies available information. In contrast, when people make decisions in non-laboratory environments characterized as complex, dynamic and consequential, they must first identify the problem and determine what information and responses are relevant. The present research was designed to investigate which situational aspects are important to experienced pilots making aviation decisions. Twenty-eight professional pilots were asked to sort descriptions of 22 aircraft incidents into piles involving similar types of major decisions. Preliminary analyses suggest four underlying variables: time pressure, risk level, available resources, and certainty of goal attainment.

Fischer, Ute↗

DOE OSTI2023

Downscaling and bias-correction contribute considerable uncertainty to local climate projections in CMIP6

Abstract Efforts to diagnose the risks of a changing climate often rely on downscaled and bias-corrected climate information, making it important to understand the uncertainties and potential biases of this approach. Here, we perform a variance decomposition to partition uncertainty in global climate projections and quantify the relative importance of downscaling and bias-correction. We analyze simple climate metrics such as annual temperature and precipitation averages, as well as several indices of climate extremes. We find that downscaling and bias-correction often contribute substantial uncertainty to local decision-relevant climate outcomes, though our results are strongly heterogeneous across space, time, and climate metrics. Our results can provide guidance to impact modelers and decision-makers regarding the uncertainties associated with downscaling and bias-correction when performing local-scale analyses, as neglecting to account for these uncertainties may risk overconfidence relative to the full range of possible climate futures.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Impacts of PV Module Connector Failures on Cost and Performance of Utility Scale Photovoltaic Systems

The reliability, cost and performance of electrical connectors are a concern in all types of electrical systems, and demands on connectors used on photovoltaic (PV) systems include that connectors maintain electrical conductivity and physical strength, endure ultraviolet sunlight and high ambient temperature, and resist moisture and chemical intrusion over a very long (>25 year) performance period. Connector failures increase operation and maintenance (O&M) costs and reduce plant production, but connector failure can also cause safety and liability problems, which are of greater concern. This work results from a three-year collaboration between Sandia National Laboratories (SNL), the Electric Power Research Institute (EPRI), and the National Renewable Energy Laboratory (NREL) and funded by the U.S. Department of Energy (DOE) Solar Energy Technology Office (SETO) under Agreements #39035 and #38531 "Connector Reliability Across the US Solar Sector." a multi-pronged investigation of PV connector health across the US (see https://energy.sandia.gov/pvconnectors/). This report presents derivation of a Techno-Economic Analysis (TEA) that models failure modes and frequencies (how often failure occurs), estimates O&M costs and lost production associated with connector failures, and then calculates the effect that PV module connectors can have on Levelized Cost of Energy (LCOE). The model is informed with initial data from quantitative assessment of failure rates, root causes and mechanisms, in-situ diagnostics and data collection, lab-based forensics, and interviews with PV connector manufacturers and plant operators. SNL conducted site inspections at multiple utility-scale sites in different climates and subjected field samples of new, used, and degraded connectors to visual and electrical characterization. EPRI conducted metallurgical analysis of the pin and sleeve conductors to study failure-induced morphological and compositional changes. There is in general a shortage of statistically valid data, but data from PVROM database maintained by SNL was sufficient to ascertain failure rates and lost production as well as provide qualitative insight in its curated maintenance records. This report details the structure of the mathematical model but the sources of data to inform the model will continue to evolve. Analysis of a 100 MW PV plant is provided as an example of the use of the model, with results indicating that connectors are responsible for Annualized O&M Costs of $\$$71,933/year; Annualized Unit O&M Costs of $\$$0.72/kW/year; that a Reserve Account of $\$$187,220 should be available to fund repairs related to connectors; that connectors add $\$$1,494,004 to the Net Present Value of the O&M Costs (project life); and that O&M related to connectors adds about $\$$0.00088/kWh to the Levelized Cost of Energy. The impact of this model is to provide a tool to make the US solar sector more robust by quantifying and monetizing the reliability risks to utility-scale PV systems posed by poorly installed, mismatched and/or poorly designed and manufactured connectors. The TEA provides a model incorporating failure statistics, O&M cost data, and lost production into a single figure of merit, informing decisions and enabling practitioners to optimize cost and performance trade-offs. Stakeholders include connector manufacturers, system designers and equipment specifiers, standards bodies, installers and O&M providers, investors and insurance underwriters. This report supports continued growth of PV predicated on assurances that properly installed and maintained PV system connectors are safe and reliable. The project team is proposing future work including accelerated testing of connectors and expanding the approach taken here to other PV system components, such as TEA for rapid shut-down devices.

14 SOLAR ENERGY↗

NASA NTRS1997

Application of Domain Knowledge to Software Quality Assurance

This work focused on capturing, using, and evolving a qualitative decision support structure across the life cycle of a project. The particular application of this study was towards business process reengineering and the representation of the business process in a set of Business Rules (BR). In this work, we defined a decision model which captured the qualitative decision deliberation process. It represented arguments both for and against proposed alternatives to a problem. It was felt that the subjective nature of many critical business policy decisions required a qualitative modeling approach similar to that of Lee and Mylopoulos. While previous work was limited almost exclusively to the decision capture phase, which occurs early in the project life cycle, we investigated the use of such a model during the later stages as well. One of our significant developments was the use of the decision model during the operational phase of a project. By operational phase, we mean the phase in which the system or set of policies which were earlier decided are deployed and put into practice. By making the decision model available to operational decision makers, they would have access to the arguments pro and con for a variety of actions and can thus make a more informed decision which balances the often conflicting criteria by which the value of action is measured. We also developed the concept of a 'monitored decision' in which metrics of performance were identified during the decision making process and used to evaluate the quality of that decision. It is important to monitor those decision which seem at highest risk of not meeting their stated objectives. Operational decisions are also potentially high risk decisions. Finally, we investigated the use of performance metrics for monitored decisions and audit logs of operational decisions in order to feed an evolutionary phase of the the life cycle. During evolution, decisions are revisisted, assumptions verified or refuted, and possible reassessments resulting in new policy are made. In this regard we implemented a machine learning algorithm which automatically defined business rules based on expert assessment of the quality of operational decisions as recorded during deployment.

Wild, Christian W.↗