Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “expert elicitation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Development of Digital Twin Predictive Model for PWR Components: Updates on Multi Times Series Temperature Prediction Using Recurrent Neural Network, DMW Fatigue Tests, System Level Thermal-Mechanical-Stress Analysis

The long-term operation (LTO) of nuclear power plant (NPP) beyond their original design life of 40 years, can lead to more material damage associated with cyclic fatigue under thermal-mechanical loading cycles and associated long-term exposure of reactor material to the deleterious reactor-coolant environments. However, under this LTO condition the reactor components can still safely operate but may require more frequent Nondestructive Evaluation (NDE) of reactor components. Frequent NDE requirement may lead to frequent shutdown of the NPP. This in turn can lead to power outage and additional NDE-inspection-cost related economic loss. The economic loss can be minimized by reducing uncertainty in life estimation of safety-critical pressure boundary components and by implementing more digital approach such as by using upcoming digital-twin (DT) technology for predicting the structural states (e.g., time and location dependent inside/outside thickness temperature, stress, strain, plastic deformation, etc.) and associated fatigue life of a component in real time. Towards this goal Argonne National Laboratory (ANL) with the sponsorship of DOE Light Water Reactor Sustainability (LWRS) program is working on the development of a DT framework that can be used for real time environmental fatigue prediction of reactor components. The DT framework is based on limited experiment-data, Artificial-intelligence (AI) – Machine-Learning (ML) - Deep-Learning (DL) based techniques and Multiphysics-computational-mechanics such as finite element (FE) based modeling tools. Towards this overall goal, following are some of the major contributions made during the FY21: 1) Multiple 82/182 dissimilar metal weld (DMW) specimens (both solid-weld and joint-weld representing the actual reactor multi-metal nozzles) were fatigue tested. The resulting fatigue lives were compared to the NUREG-6909 based best-fit and design fatigue curves. Additionally, the results of 52/152 DMW fatigue specimens (which were recently tested at Republic of Korea under the sponsorship of International Nuclear Energy Research Initiative - INERI program) were compared to the NUREG-6909 based best-fit and design fatigue curves. From the comparison of 82/182 and 52/152 DMW test data with NUREG-6909 best-fit curve, most of the reported test data fall way away from the NUREG-6909 suggested best-fit or mean curve. The NUREG-6909 suggested best-fit curve is the best-fit curve of austenitic stainless steel and due to lack of enough data on Nickel-based welds, this is currently being used for predicting the life of Nickel-alloy-based welded components. However, the above observation may require higher scaling factor (e.g., ASME suggested factor of 20 on cycles rather than the current NUREG-6909 suggested factor of 12 on cycles) for scaling the austenitic-stainless-steel best-fit-curve for estimating the design or safe-life of a welded component. Accordingly, for example, if a DMW component experience a strain amplitude of 0.6% the PWR-water life of the component would be 52 cycles instead of 85 cycles. However, more DMW tests are required to further ascertain the above-mentioned observations. 2) A system level CAD and finite element model were developed which consists of reactor pressure vessel (RPV), part of steam generator (SG), part of pressurizer (PRZ), hot leg (HL), and surge line (SL). This is with detailed nozzle geometry and thermal-mechanical material properties of different metals to simulate realistic thermal-mechanical stress under connected system global thermal-mechanical boundary conditions. 3) Different system level heat transfer analyses were performed with estimation of relevant heat transfer coefficients. The resulting data were used in subsequent system level thermal-mechanical stress analysis and for generating spatial-temporal training and validation data for a system level digital-twin based temperature predictor. Transient heat transfer analyses were performed considering thermal boundary condition under design-basis (DB) loading and EDF (Électricité de France) data-based grid-load-following (EDF-GLF) loading cycles. 4) System level thermal-mechanical stress analysis was performed for identifying damage-prone hotspots and for future extension of the model for cyclic state prediction. From the system-level model simulation under DB loading cycle it is found that HL and the SL nozzle that connect to the HL can experience significant stress and strain and could be one of the weakest links in the overall reactor coolant system (RCS). 5) An AI/ML based DT model was developed for multi-time-series temperature prediction at any inside/outside thickness locations of PWR pressure boundary components. This is by using Recurrent-neural-network (RNN) and keras machine learning libraries. The RNN model was validated against two laboratory test-based data sets with one obtained through ANL’s in-air fatigue test system and other through PWR-water test loop. The experimentally validated DT model further validated against FE model results to predict thermal scarification related spatialtemporal temperatures at random locations of a component. The well validated DT model was then used for demonstrating spatial-temporal temperature prediction under 100+ years of reactor operation subjected to combined DB, EDF-GLF and randomized grid-load-following (RANDOMGLF) loading Cycles. The expert-elicitation DT model framework was developed assuming field/input/process measurements can be available from a few existing plant sensors and can readily be used by the NPP operators. The above temperature prediction model will feed to the next-step stress analysis model based on which the life of a component can be predicted in realtime, which is one of our future works.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Physics-Infused AI/ML Based Digital-Twin Framework for Flow-Induced-Vibration Damage Prediction in a Nuclear Reactor Heat Exchanger

This report summarizes some of the ongoing work related to the development of an expert-elicitation-digital-twin framework for real time damage state prediction in heat exchanger components of a nuclear reactor. The framework is targeted towards predicting damage associated with coupled low cycle fatigue (associated with regular heat-up, cool-down and power operation transients) and high cycle fatigue (associated with flow induced vibration transients). The overall framework will be based on a NoSQL based database, physics-infused-geometry-dependent virtual-sensor data, different AI/ML techniques-based data-driven-predictive-model applications (Apps) and real-time plant sensor measurements available through few existing sensors. Towards this overall goal, this report updates some of the ongoing work, such as on implementation of a NoSQL Database (such as MongoDB), FE based heat transfer analysis of a heat exchanger (e.g. of a PWR steam generator) for generating geometry-dependent virtual sensor data and evaluation of various AI/ML models such as based on multivariate linear regression, ensembled decision-tree based Random-Forest and Gradient-Boosting regression and high-dimensional-kernel-function-transformation based Support-Vector-Machine regression models. The AI/ML models were evaluated for predicting multi-time-series thermal states at thousands of 3D point-clouds

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reaction Evolution Flow Chart - The Critical Path to DDT [Slides]

Purpose (and limitations): The following flow-chart identifies and organizes a generalized, and simplified, sequence of necessary conditions for accidental ignition and reaction growth in a consolidated, polymer-bonded explosive (PBX) charge that has been insulted. A ‘yes’ answer to each question will lead down the critical path and produce violent, explosive reactions, up to and possibly including transition to detonation. Alternatively, any ‘no’ answer will serve as an off-ramp from the path resulting in less violent responses. It is important to note that this flow-chart is a high-level tool to flag potential operational vulnerabilities, but lacks the details needed to stand alone as a sole-source for risk determination. Each question represents a significant area of study and, therefore, the flow chart is intended to be supplemented by subject matter expert elicitations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Predictive Capability Maturity Model Demonstration for Cylindrical Cavity Coupling Using Gemma in the Next Generation Workflow

The predictive capability maturity model (PCMM) uses the expert elicitation process to generate credibility evidence for a particular analysis. To ensure Gemma has the capability to efficiently produce this credibility evidence, next generation workflows (NGW) are created for the solution verification, calibration/validation, and input uncertainty quantification portions of the PCMM assessment. These workflows are then used on the Higgins cylinder problem, which is representative of applications involving external-to-internal electromagnetic field coupling through a slot. The uncertainties calculated using these workflows are then used to calculate the validation comparison error and the validation uncertainty for the model following the American Society of Mechanical Engineers (ASME) verification and validation (V&V) 20 standard. These workflows will enable analysts to iterate each element of PCMM more efficiently than if completed without using a NGW workflow. An example of this iterative process is shown in Section 7.2.

42 ENGINEERING↗

Comparison of the Gaussian Wind Farm Model with Historical Data of Three Offshore Wind Farms

A recent expert elicitation showed that model validation remains one of the largest barriers for commercial wind farm control deployment. The Gaussian-shaped wake deficit model has grown in popularity in wind farm field experiments, yet its validation for larger farms and throughout annual operation remains limited. This article addresses this scientific gap, providing a model comparison of the Gaussian wind farm model with historical data of three offshore wind farms. The energy ratio is used to quantify the model’s accuracy. We assume a fixed turbulence intensity of $I_∞$ = 6% and a standard deviation on the inflow wind direction of $σ_{wd}$ = 3° in our Gaussian model. First, we demonstrate the non-uniqueness issue of $I_∞$ and $σ_{wd}$, which display a waterbed effect when considering the energy ratios. Second, we show excellent agreement between the Gaussian model and historical data for most wind directions in the Offshore Windpark Egmond aan Zee (OWEZ) and Westermost Rough wind farms (36 and 35 wind turbines, respectively) and wind turbines on the outer edges of the Anholt wind farm (110 turbines). Turbines centrally positioned in the Anholt wind farm show larger model discrepancies, likely due to deep-array effects that are not captured in the model. A second source of discrepancy is hypothesized to be inflow heterogeneity. In future work, the Gaussian wind farm model will be adapted to address those weaknesses.

17 WIND ENERGY↗

Grand challenges in the digitalisation of wind energy

The availability of large amounts of data is starting to impact how the wind energy community works. From turbine design to plant layout, construction, commissioning, and maintenance and operations, new processes and business models are springing up. This is the process of digitalisation, and it promises improved efficiency and greater insight, ultimately leading to increased energy capture and significant savings for wind plant operators, thus reducing the levelised cost of energy. Digitalisation is also impacting research, where it is both easing and speeding up collaboration, as well as making research results more accessible. This is the basis for innovations that can be taken up by end users. But digitalisation faces barriers. This paper uses a literature survey and the results from an expert elicitation to identify three common industry-wide barriers to the digitalisation of wind energy. Comparison with other networked industries and past and ongoing initiatives to foster digitalisation show that these barriers can only be overcome by wide-reaching strategic efforts, and so we see these as “grand challenges” in the digitalisation of wind energy. They are, first, creating FAIR data frameworks; secondly, connecting people and data to foster innovation; and finally, enabling collaboration and competition between organisations. The grand challenges in the digitalisation of wind energy thus include a mix of technical, cultural, and business aspects that will need collaboration between businesses, academia, and government to solve. Working to mitigate them is the beginning of a dynamic process that will position wind energy as an essential part of a global clean energy future.

17 WIND ENERGY↗

Direct-DC Power in Buildings: Identifying the Best Applications Today for Tomorrow’s Building Sector

Driven by the increased use of direct current (DC) sources (photovoltaics, battery storage) and DC end-use devices (electronics, solid-state lighting, efficient motors), DC power distribution in buildings and DC microgrids have been proposed as a way to achieve greater efficiency, cost savings, and resiliency in a transitioning building sector. Despite these important benefits, several market and technological barriers inhibit the development of DC distribution, and the market for DC in buildings is still largely in the demonstration phase. Therefore, to jumpstart this technology, a clear path forward must emerge at this early stage of deployment. The goal of this paper is to define specific end-use cases for which DC distribution in buildings is a value proposition today by defining clear efficiency and resiliency benefits while addressing barriers to implementation. The paper begins with a technology and market assessment of DC distribution equipment, end uses, and technology standards. That is followed by results from an expert elicitation of DC power and building end-use professionals (e.g., electrical designers, building operators, engineers) and reports on-site visits and lessons learned from successful (and less successful) field deployments of DC distribution projects in North America. We present specific adoption pathways at the community and building level that can be implemented today, and evaluate them using qualitative and quantitative metrics, such as technology and market readiness, energy savings, and resiliency.

building-level electrical distribution↗

Direct-DC Power in Buildings: Identifying the Best Applications Today for Tomorrow’s Building Sector

Driven by the increased use of direct current (DC) sources (photovoltaics, battery storage) and DC end-use devices (electronics, solid-state lighting, efficient motors), DC power distribution in buildings and DC microgrids have been proposed as a way to achieve greater efficiency, cost savings, and resiliency in a transitioning building sector.Despite these important benefits, several market and technological barriers inhibit the development of DC distribution, and the market for DC in buildings is still largely in the demonstration phase. Therefore, to jumpstart this technology, a clear path forward must emerge at this early stage of deployment. The goal of this paper is to define specific end-use cases for which DC distribution in buildings is a value proposition today by defining clear efficiency and resiliency benefits while addressing barriers to implementation.The paper begins with a technology and market assessment of DC distribution equipment, end uses, and technology standards. That is followed by results from an expert elicitation of DC power and building end-use professionals (e.g., electrical designers, building operators, engineers) and reports on-site visits and lessons learned from successful (and less successful) field deployments of DC distribution projects in North America. We present specific adoption pathways at the community and building level that can be implemented today, and evaluate them using qualitative and quantitative metrics, such as technology and market readiness, energy savings, and resiliency.

Vossos, Evangelos↗

Repowering and Retrofitting of Solar Inverters: A Field Case Study [Slides]

A handful of large-scale photovoltaic (PV) plants have undergone retrofitting and/or repowering of inverters for a variety of reasons, such as rapid product life-cycle innovations with lack of reverse compatibility, original equipment manufacturers (OEMs) exiting the inverter business, weather damage, more lucrative revenue opportunities driven by high contractual offtake price, and so on. Insights has been collected via expert elicitation and relevant staff involved in these retrofitting/repowering at the case study site. Selecting and installing inverters from a different OEM at the commercially operating PV plant provides a unique opportunity to thoroughly document inverter retrofitting/repowering. The case study describes compatibility of mechanical, electrical, communications, and other important aspects. The goal is to provide a public case study that improves the general knowledge of the solar industry about what is involved in repowering/retrofitting a PV plant and how others can best prepare.

14 SOLAR ENERGY↗

Enhancing PV Inverter Reliability Through Predictive Maintenance: Insights from Retrofitting of PV Inverters

Photovoltaic (PV) systems represent a cornerstone in the global shift toward sustainable energy generation, with inverters serving as the crucial link between solar panels and the grid. Despite their pivotal role, inverters are susceptible to failures, contributing significantly to maintenance events and operational disruptions in large-scale PV plants. This white paper investigates the importance and methodologies of predictive maintenance strategies that monitor the component-level pre-failure signatures on PV inverters. Through a comprehensive survey of literature and industry professionals, insights on preventive maintenance and retrofitting practices have been gathered. The expert elicitation helps shed light on common challenges and opportunities for improving PV system reliability, particularly inverter reliability. By addressing these challenges, the white paper aims to enhance the long-term viability and effectiveness of solar PV plants in the renewable energy landscape, contributing to the global transition toward environmentally friendly energy generation.

14 SOLAR ENERGY↗

A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes

When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.

97 MATHEMATICS AND COMPUTING↗

Expert perspectives on the wind plant of the future

Abstract Wind power technology has changed rapidly in recent years. Technology innovation, evolving power markets, and competing land and ocean uses continue to influence the design and operation of wind turbines and plants. Anticipating these trends and their impact on future facilities can inform commercial strategies and research priorities. Drawing from a recent survey of 140 of the world's foremost wind experts, we identify expectations of future wind plant design in 2035, both for onshore and offshore wind. Experts anticipate continued growth in turbine size, to 5.5 (onshore) and 17 MW (offshore), with plants located in increasingly less favorable wind and siting regimes. They expect plant sizes of 1,100 MW for fixed‐bottom and 600 MW for floating offshore wind. Experts forecast enhanced grid‐system value from wind through significant to widespread use of larger rotors, hybrid projects with batteries and hydrogen production, and more. To explain experts' perspectives on future plant design and operation, we identify five mechanisms: economies of unit, plant, and resource scale; grid‐system value economies; and production efficiencies. We characterize learning effects as a moderating influence on the strength of these mechanisms. In combination, experts predict that these design choices support levelized cost of energy reductions of 27% (onshore) and 17%–35% (floating and fixed‐bottom offshore) by 2035 compared to today, while enhancing wind energy's grid service offerings. Our findings provide a much‐needed benchmark for representing future wind technologies in power sector models and address a critical research gap by explaining the economics behind wind energy design choices.

17 WIND ENERGY↗

Identifying Adversarial Cyber-Activity in Operational Technology Environments Using Bayesian Networks

Critical infrastructure and other operational technology (OT) environments face increasing cybersecurity risks from adversarial behavior. This paper describes the development of a risk model using a Bayesian network to enhance the comprehension of observable cyber events caused by malicious activity in OT environments. The core of the Bayesian network is a process model that describes the stages of adversary behavior. The remainder of the model is based on the MITRE ATT&CK® for Industrial Control Systems (ICS) taxonomy, which includes tactics and techniques that may be used by the adversary. The observables provide evidence for adversary behavior through the intermediary technique and tactic nodes. One challenge in constructing this model is a lack of open-source data from cyber-attacks on OT systems. This paper discusses learning from limited data, the elicitation of expert opinion to construct the conditional probability tables when data is scarce, and the refinement of the most difficult conditional probabilities tables using several forms of sensitivity analyses. Finally, the Bayesian network is demonstrated using two historical case studies: the DarkSide ransomware attack on the Colonial Pipeline and the destructive cyberattack targeting the ThyssenKrupp blast furnace. Index Terms—Cybersecurity, industrial control systems, operational technology

97 - MATHEMATICS AND COMPUTING↗

Estimating the Contributions to Human Error Probability from the Convolution of the Distribution of Time Available and Time Required

As part of their duties, Human Reliability Analysis must often evaluate if crews in nuclear power plants (NPPs) can complete tasks associated with a human-failure event within time limits. For example, the time required in NPP scenarios is determined by systematic and structured walkthroughs, feasibility studies, recorded times from training exercises, and interviews with experienced operators and experts. Typically, a point estimate is derived for the estimate (mean, maximum, or 95th percentile of time required). Using point-estimate values can mask the risk associated with variability among crews, plant conditions and set-up, environmental conditions, and other impact factors under which these actions are executed. While point estimates for time required and time available have served the industry well, without considering the uncertainty they could lead to biased understanding about the risk. The Integrated Human Event Analysis System - General Methodology (IDHEAS-G) model (developed by the US Nuclear Regulatory Commission, NRC) for human error probability calculates human error probability by summing two probabilities: insufficient time and cognitive error. As such, the model takes a more holistic approach by considering the full distributions for time required and time available to calculate the human error probability because the time available to complete the task is insufficient. In this study, we expand on the work of the NRC and discuss methods for estimating these time considerations. For example, for the time required, the impact of Performance Influencing Factors (PIFs) on the distribution was divided into impacts that are aleatory in nature, such as crew-to-crew variability, and those that are epistemic (i.e., the PIFs). Starting with the factors that introduce aleatory uncertainty, a first-order distribution was developed from a large set of time required (i.e., NPP task completion times) data for the range of operator actions that occur in the NPP control room under simulated accident conditions. The first-order distribution can then be adjusted to account for epistemic uncertainty using research associated with the impact of applicable PIFs on the time required. We also develop guidance for analysts to address the probability distributions for the time available. The guidance we developed on how to estimate time required and time available distributions is based on the identification of pertinent research and data, data analyses, and expert knowledge elicitation.

human error probability, human performance, time e↗

Burning Embers: Towards more transparent and robust climate change risk assessments

The Intergovernmental Panel on Climate Change (IPCC) assessments provide policy-relevant insights about climate impacts, vulnerabilities, and adaptation through a process of peer-reviewed literature assessments underpinned by expert judgement. An iconic output from these assessments is the “burning embers” diagram. Burning embers were first used in the Third Assessment Report to visualize reasons for concern, which aggregate risks from various systems and sectors. In these diagrams, colour transitions show changes in the assessed level of risk to humans and ecosystems as a function of climate change indicated by increasing levels of global mean temperature. Here we review the approach to the construction of burning embers, its evolution across the various IPCC reports, and recent methodological advances in the elicitation process to reduce subjectivity in the expert judgement and improve the transparency of the assessment. We recommend the use of a standardized, transparent process of expert elicitation in the production of burning embers diagrams to enhance their quality, comparability, and credibility.

Zommers, Zinta↗

Molten Salt Reactor Fundamental Safety Function PIRT

The phenomenon identification and ranking table (PIRT) process was employed to evaluate the current capability to assess the ability of liquid-salt–fueled molten salt reactors to achieve their fundamental safety functions (FSFs). The PIRT process provides a structured mechanism to elicit and document expert opinions on the most important phenomena and the corresponding level of knowledge with regard to achieving the FSFs. The PIRT panel included reactor developers, accident progression evaluation tool developers, US Department of Energy (DOE) national laboratory technical staff, university researchers, and US Nuclear Regulatory Commission (NRC) staff. The information-gathering process concentrated on phenomena related to accidents in which the fuel salt—including any in the cover gas—has been released from the first barrier layer. This information-gathering process included identifying all potential accidents that could result in the release of a substantial amount of radionuclides that could breach or bypass the first barrier. The PIRT did not identify any previously unrecognized systemic vulnerabilities. However, the elicitation process identified several areas with low levels of knowledge and significant potential impact on accident progression. These areas either require additional research to improve the state of knowledge or additional design conservatism to accommodate the remaining unknowns.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Independent Review of the Proof-of-Concept Cyber100 Compass Cybersecurity Risk Tool

The U.S. Department of Energy (DOE) Office of Cybersecurity, Energy Security, and Emergency Response (CESER), and Office of Electricity (OE) commissioned the National Renewable Energy Laboratory (NREL) to develop a method and tool to enable electric utilities to understand and manage the risk of cybersecurity events that can lead to physical effects like blackouts. This tool, called Cyber100 Compass, uses cybersecurity data elicited from cybersecurity experts, then incorporates that data into a tool designed to be usable by cybersecurity non-experts who understand the system itself. The tool estimates dollar-valued risks for a current or postulated future electric power digital control configuration, in order to enable utility risk planners to prioritize among proposed cybersecurity risk mitigation options. With the development of the Cyber100 Compass tool for quantification of future cyber-physical security risks, NREL has taken an initial bold step in the direction of enabling and indeed encouraging electric utilities to address the potential for cybersecurity incidents to produce detrimental physical effects related to electric power delivery. As part of the Cyber100 Compass development process, DOE funded NREL to seek out an independent technical review of the risk methodology embodied in the tool. NREL requested this review from Sandia National Laboratories, and made available to Sandia a very late version of the project report, as well as NREL personnel to provide clarification and to respond to questions. This paper provides the result of the independent review activity.

97 MATHEMATICS AND COMPUTING↗

A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis

This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this framework is to rapidly collect and analyze a broad variety of human factors data in order to accelerate the development and evaluation loop for deploying machine learning applications. We describe our methodology and analysis, and we discuss insights gained from a pilot participant about the current usability state of an early technology readiness level (TRL) artificial neural network (ANN) recommender.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗