Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Verification of data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Cyberattack Detection and Mitigation on Central Volt‐VAr Using Circuit Law and Machine Learning

ABSTRACT In a distribution grid, voltage is maintained within a nominal range through a Volt‐VAr function that controls capacitor banks, reactive power of distributed energy resources (DER), and on‐load tap changers (OLTC). Availability of communications helps with the implementation of central Volt‐VAr control; however, it also opens the system to cyberattacks, causing voltage disturbances. Previous work has shown the adverse impacts of false data injection (FDI) on the central Volt‐VAr control; however, very few works have studied methods to detect and mitigate FDI on Volt‐VAr control. This paper addresses gaps in the detection and mitigation of FDI on the measurement packets of a central Volt‐VAr control. This work uses a two‐stage algorithm for cyberattack detection since the accuracy of a single‐stage machine learning (ML)–based detection method decreases while dealing with unseen data. The first stage is based on the verification of measurements against circuit laws, and the second stage utilizes a tree search algorithm and an ML method to detect the falsified data. This paper compares long short‐term memory (LSTM) and bidirectional LSTM (BiLSTM) as the employed ML algorithms. Finally, the mitigation algorithm replaces the falsified data with the estimated output of the ML algorithm. The effectiveness of the proposed method is tested for several cases using the IEEE 13‐bus test system in PSCAD software.

Beikbabaei, Milad [Bradley Department of Electrica↗

Summary of the 5th IAEA technical meeting on fusion data processing, validation and analysis (FDPVA)

The purpose of the 5th International Atomic Energy Agency technical meeting on fusion data processing, validation and analysis (FDPVA) (Ghent University, Ghent, Belgium, 12–15 June 2023) was to provide a platform during which a set of topics relevant to FDPVA were discussed with the view of meeting the needs of next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics data analysis and synthetic diagnostics reported at the meeting, including concept description of new devices; fusion databases; integrated data analysis; inverse problems; uncertainty propagation, verification and validation; probabilistic methods and machine learning. The relevant results underline trends observed in the current major fusion confinement devices.

fusion databases↗

Data-driven key performance indicators and datasets for building energy flexibility: A review and perspectives

Energy flexibility, through short-term demand-side management (DSM) and energy storage technologies, is now seen as a major key to balancing the fluctuating supply in different energy grids with the energy demand of buildings. This is especially important when considering the intermittent nature of ever-growing renewable energy production, as well as the increasing dynamics of electricity demand in buildings. This paper provides a holistic review of (1) data-driven energy flexibility key performance indicators (KPIs) for buildings in the operational phase and (2) open datasets that can be used for testing energy flexibility KPIs. The review identifies a total of 48 data-driven energy flexibility KPIs from 87 recent and relevant publications. These KPIs were categorized and analyzed according to their type, complexity, scope, key stakeholders, data requirement, baseline requirement, resolution, and popularity. Moreover, 330 building datasets were collected and evaluated. Of those, 16 were deemed adequate to feature building performing demand response or building-to-grid (B2G) services. The DSM strategy, building scope, grid type, control strategy, needed data features, and usability of these selected 16 datasets were analyzed. This review reveals future opportunities to address limitations in the existing literature: (1) developing new data-driven methodologies to specifically evaluate different energy flexibility strategies and B2G services of existing buildings; (2) developing baseline-free KPIs that could be calculated from easily accessible building sensors and meter data; (3) devoting non-engineering efforts to promote building energy flexibility, standardizing data-driven energy flexibility quantification and verification processes; and (4) curating and analyzing datasets with proper description for energy flexibility assessm.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Adversarial Binaries: AI-guided Instrumentation Methods for Malware Detection Evasion

Adversarial binaries are executable files that have been altered without loss of function by an AI agent in order to deceive malware detection systems. Progress in this emergent vein of research has been constrained by the complex and rigid structure of executable files. Although prior work has demonstrated that these binaries deceive a variety of malware classification models which rely on disparate feature sets, a consensus as to the best approach has not been reached, either in terms of the optimization algorithms or the instrumentation methods. Furthermore, although inconsistencies in the data sets, target classifiers, and functionality verification methods make head-to-head comparisons difficult, here we extract lessons learned and make recommendations for future research.

malware obfuscation↗

Detecting the undetected: Dealing with non-routine events using advanced M&V meter-based savings approaches

In a rapidly evolving energy industry, utilities are dealing with new challenges like integrating distributed energy resources and market saturation for advanced lighting retrofits. Demand-side management programs require new approaches to meet aggressive carbon reduction goals. Advanced measurement & verification (M&V) is an energy data analysis method using smart meter data in combination with analytics to quantify energy efficiency project savings. Advanced M&V shows great promise for supporting next generation commercial programs including retro commissioning, multi-measure retrofits, and behavior change programs. Advanced M&V captures real project impacts at the meter, but sometimes non-project events can also impact consumption (so-called “non-routine events” [NREs]). Accurately detecting and accounting for NREs is important for reducing uncertainty of savings estimates and helps manage investment risk for different stakeholders (e.g., utilities, building owners, ESCOs). Recent research has shown promise in establishing data-driven techniques to identify and adjust for NREs, but fundamental questions still remain, such as: how can you distinguish NREs from acceptable noise in energy consumption profiles? What is the frequency and magnitude of NREs? Can their detection and adjustment be automated and streamlined? This paper documents the state of the art in NRE quantification and analysis. The results of research to quantify the frequency, nature and direction of NREs, and methods and metrics for determining a trigger threshold for taking action on NREs are presented. The paper also documents the latest technical guidance on application of NRE detection and adjustment methods.

Fernandes, Samuel↗

Decovalex-2019 (Executive Summary)

The DECOVALEX Project is an on-going international research collaboration, established in 1992, to advance the understanding and modeling of coupled Thermal (T), Hydrological (H), Mechanical (M) and Chemical (C) processes in geological in geological systems. DECOVALEX was initially motivated by the recognition that prediction of these coupled effects is an essential part of the performance and safety assessment of geologic disposal systems for radioactive waste and spent nuclear fuel. Later it was realized that these processes also play a critical role in other subsurface engineering activities, such as subsurface CO 2 storage, enhanced geothermal systems, and unconventional oil and gas production through hydraulic fracturing. Research teams from many countries (e.g., Canada, China, Czech Republic, Finland, France, Germany, Japan, Republic of Korea, Spain, Sweden, Switzerland, Taiwan, United Kingdom, and the United States) various institutions have participated in the DECOVALEX Project over the years, providing a wide range of perspectives and solutions to these complex problems. These institutions represent radioactive waste management organizations, national research institutes, regulatory agencies, universities, as well as industry and consulting groups. The overall aim of DECOVALEX-2019 was to increase the understanding of various thermo-hydro-mechanical-chemical processes of importance for radionuclide release and transport from a repository to the biosphere and how they can be described and modelled using mathematical models. The scientific and technical objectives are: to increase the basic understanding of T-H-M-C coupled processes in fractured rocks (crystalline, sedimentary, argillaceous) and buffer materials; to investigate the predictive capabilities of different codes to field experiments and to perform verification of codes; to exchange experimental data, and improve the understanding of the constitutive behavior of crystalline and argillaceous rock masses and buffer materials; and to perform THMC calculations in a performance/safety assessment context.

58 GEOSCIENCES↗

SECARB Regional Project Assessment

The SECARB Cranfield Early Test Project was designed to safely demonstrate large-scale, long-term CO 2 injection and storage in a CO 2 -enhanced oil recovery (EOR) operation and associated saline reservoir. Storage during EOR operations has the potential to offset commercial costs, holding a significant promise for future large-scale deployment in the southeastern United States. Denbury Onshore LLC began CO 2 -EOR operations in July 2008 at the Cranfield oilfield located east of Natchez, Mississippi (Figure 1). The location offered an ideal setting to investigate storage monitoring at a commercial CO 2 -EOR operation. The field team, led by the Gulf Coast Carbon Center of the Bureau of Economic Geology at the University of Texas at Austin, deployed the largest suite of monitoring, verification, accounting (MVA) technologies to collect data to assess long-term CO 2 utilization and storage. The CO 2 injection interval is within the 3,000-meter-deep fluvial lower Tuscaloosa Formation, a large and regionally extensive saline reservoir, at a broad four-way structural closure that defines the Cranfield oilfield. Tests were conducted in the oil-producing area as well as in the non-oil-producing brine aquifer. The CO 2 used during EOR operation was transported via pipeline from the Jackson Dome, a natural source of CO 2 . The study focused on four integrated research areas: (1) the High-Volume Injection Test area (HiVIT); (2) the Detailed Area of Study (DAS); (3) the Geomechanical area; and (4) the near-surface observatory, also called the “P-site.” CO 2 injection occurred at the HiVIT and the DAS (Figure 2 and Figure 3). The DAS was located down-dip of the oil-water interface of the Cranfield oilfield. The well layout included one injection well and two down-dip observation wells. The team was the first of the regional partnerships to monitor more than 1 million metric tons of CO 2 . At the end of the project, the team monitored more than 11 million metric tons of CO 2 injected and 5 million metric tons of CO 2 stored. The Cranfield Project was the fifth project worldwide, and the first such project in the United States, to reach this CO 2 injection volume while being monitored to demonstrate storage effectiveness.

01 COAL, LIGNITE, AND PEAT↗

Moving Beyond Direct Load Control: A Maturity Model for Realizing the Promise of Demand Flexibility

This report discusses a new maturity model that regulators and utilities can use to guide and expand demand flexibility programs and enable the resources to provide more grid services. The model has six demand flexibility categories: planning and design; customer engagement; program operations; evaluation, measurement and verification; distributed energy resource orchestration; and data infrastructure. Within each category, capabilities are identified and described on a maturity scale that ranges from performing below expectations to improving on best practices.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Modeling of Vertical Motor-driven Pump for Simulation of a Fault Signature \\ for Condition Monitoring

As part of the ongoing effort to transition from preventive maintenance strategies to condition-based maintenance strategies in nuclear power plants, there is significant reliance on using machine learning techniques. To develop a robust machine learning model that can diagnose all the fault modes of a vertical motor-driven pump, data capturing the unique signature of each fault mode is required. In practice, it is difficult to collect or capture data that captures all the fault modes from a single plant site. So to address this situation, a computational model of a vertical motor-driven pump is developed using the multipurpose finite element software COMSOL Multiphysics. The developed model is used to generate simulated data under normal operation and is compared with the vibration data collected using vibration sensors. Once the simulation model is verified under normal operating condition, simulated data for the fault mode for which minimal or no evidence is available in historical plant process data is developed. This simulated data is used to develop fault signatures to achieve robust predictive models. This paper presents modeling details and verification of the model that can used to generate data for fault modes that are not available at a plant site for condition monitoring purpose.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Modeling of Vertical Motor-driven Pump for Simulation of a Fault Signature \\ for Condition Monitoring

As part of the ongoing effort to transition from preventive maintenance strategies to condition-based maintenance strategies in nuclear power plants, there is significant reliance on using machine learning techniques. To develop a robust machine learning model that can diagnose all the fault modes of a vertical motor-driven pump, data capturing the unique signature of each fault mode is required. In practice, it is difficult to collect or capture data that captures all the fault modes from a single plant site. So to address this situation, a computational model of a vertical motor-driven pump is developed using the multipurpose finite element software COMSOL Multiphysics. The developed model is used to generate simulated data under normal operation and is compared with the vibration data collected using vibration sensors. Once the simulation model is verified under normal operating condition, simulated data for the fault mode for which minimal or no evidence is available in historical plant process data is developed. This simulated data is used to develop fault signatures to achieve robust predictive models. This paper presents modeling details and verification of the model that can used to generate data for fault modes that are not available at a plant site for condition monitoring purpose.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Uncertainty Propagation from Experiment Measurements to Modeling Approaches: A Case for SMR Steam Entrainment Testing

To license new and advanced reactor designs, regulators must be convinced that their unique safety cases—relative to existing large scale reactors—have been adequately addressed by the designed reactor protection systems. In water cooled small modular reactors (SMRs), droplet entrainment in steam flow has significant implications on the progression of accident scenarios due to its compact design features, which requires representative test data applicable to SMR designs. Computer code, modeling and simulation (M&S) tools and models require adequate verification, assessment, and qualification. This includes M&S results validation against scaled empirical data within allowable uncertainty bands to gain regulatory approvals during the various stages of reactor system design, demonstration, and commercialization. However, measurement uncertainty within the empirical datasets and test data applicability ranges requires careful consideration of M&S inputs (i.e., boundary conditions, and initial conditions), and verification and validation efforts. This study focuses on uncertainty quantification in designing scaled test facilities for SMR applications with appropriate measurements and a standard data-reduction method to estimate thermal hydraulics characteristics parameters that incorporate physics phenomena of interest. In addition, this study supports the evaluation model development and assessment process using M&S that interfaces with advanced computing tools and digital twin capabilities. This will allow synchronization between experiment and modeling approaches for droplet entrainment testing and analysis, improving diagnostics, prognostics, and decision-making to accelerate regulatory approval.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Baseline Characterization Database Verification Report ? NBG-17 Billet V104

The purpose of this report is to present data collected in the Baseline Graphite Characterization Program, which is directly tasked with supporting the Idaho National Laboratory’s (INL’s) research and development efforts on the Advanced Reactor Technologies (ART) Program. This program populates a comprehensive database that reflects the baseline properties of nuclear-grade graphite regarding individual grade, billet, and position within individual billets. The physical- and mechanical-property information being collected will be transferred to the Nuclear Data Management and Analysis System (NDMAS), and that database will help populate the handbook of property data available to member nations of the Generation-IV International Forum. Transfer of these data from the applicable technical lead to the dissemination databases available to other end users requires a full review of the test procedures and data-collection efforts through an analysis of the multiple summary spreadsheets and values being collected. This report represents the analysis for NBG-17 Billet V104 and facilitates release of associated data to the NDMAS custodians. Millions of raw data points have been collected during testing and quantification analyses for these billets. The summary scalar property values and supplementary traceability data are collected into comprehensive spreadsheets. Data sets are composed of single billets of graphite for any given grade, organized by mechanical test-specimen type, and further subdivided into individual spreadsheet tabs according to the specific test or evaluation being performed. A direct analysis of properties was not conducted, and this report does not provide information on the validity or performance characteristics of the graphite itself. Rather, this report is intended as a verification of the completeness of actual data collected in accordance with PLN-3467, “Baseline Graphite Characterization Plan: Electromechanical Testing,” [1] and PLN-3348 “Graphite Mechanical Testing” [2] and their representation of the measurement and test results with sole regard to the graphite billets under evaluation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

Uranium Mononitride (UN) Handbook

Uranium Mononitride (UN) is being reexamined as a high temperature advanced nuclear fuel in many reactor applications due to its high thermal conductivity, high melting point, and high fissionable uranium density, among other desirable properties. A thorough review of the experimental data for the material and irradiation properties has been collected and is presented in this handbook. As an outcome of this review, in many cases, it is apparent that additional experimental verification must be conducted to verify the available data and to verify the suggested empirical correlations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Regressing Nuclear Reactor Power Level Using Low-Cost Sensor Network Data

Multisensor networks deployed at nuclear facilities can be leveraged to collect data used as inputs to machine learning models predicting nuclear safeguard relevant information. This work demonstrates an application of this idea by regressing nuclear reactor power levels, a key indicator for nuclear safeguard verification, at the McClellan Nuclear Research Center using data collected by five Merlyn multisensor platforms with LASSO and LSTM models. This work also demonstrates the use of Leave One Node Out to measure the importance of each multisensor for this regression problem providing insight into model explainability and allowing inferential hypotheses about the nuclear facility to be made. This work can be used as a starting point for future development of methods for regression on reactor power levels at nuclear facilities using multisensor network data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Preliminary verification of the MCNP perturbation and fixed-source tally sensitivity tools

Integral benchmark experiments are vital in the adjustment and validation of the nuclear data that govern predictive simulations across the nuclear community. The nuclear data sensitivity capabilities of the Monte Carlo N-Particle (MCNP ®) transport code are currently limited; however, expanding sensitivity capabilities will allow benchmark experiments to be designed to resolve compensating errors and adjust nuclear data where previously prohibitively difficult. This paper provides details of a preliminary verification for the use of (i.) the recently revised perturbation and (ii.) developmental fixed-source sensitivity tools within MCNP to calculate sensitivities of tallied responses (such as current integrated over a surface, F1, and flux averaged over a cell, F4) to nuclear data in fixed-source simulations. Energy-binned and energy-integrated sensitivities calculated with these tools are compared against sensitivities calculated using a central-difference approximation. Here, the verification is completed for four configurations of a benchmarked system using a 4.5-kg plutonium sphere surrounded by varying amounts of copper and/or polyethylene. The results show that sensitivities calculated with the perturbation and fixed-source sensitivity tools agree with the central-difference-based approach.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Real-time neutron multiplicity and source localization for criticality safety during fuel debris removal

Advancing neutron detection and analysis techniques for complex radiation environments is an ongoing focus in nuclear instrumentation and monitoring. This proposal presents research and development of a generalized real-time neutron monitoring and analysis system, applicable to any detector capable of producing time-tagged neutron count data. While the work is demonstrated using the Neutron Multiplication Analysis Detector (NoMAD), a modular 15-tube helium-3 (He-3) array, due to its availability, spatial resolution, and flexible deployment, the methods developed are extensible to other systems, including organic scintillators and fast digital detectors. This research investigates two complementary analytical techniques for real-time characterization of neutron emitting sources: neutron multiplicity estimation based on the Hage-Cifarelli formalism and spatial localization using supervised machine learning applied to spatial count rate patterns. These methods are designed to operate under dynamic, evolving conditions such as fuel debris retrieval or reactor startup, where neutron-emitting material geometries may be partially unknown or changing over time. By integrating statistical neutron emission data with spatial localization, this research aims to develop and evaluate methods for real time neutron monitoring, source characterization, and material verification. Key contributions include implementation of a low-latency data pipeline for continuous neutron multiplicity analysis, development and validation of machine learning models for spatial inference, and experimental evaluation of system performance under variable measurement conditions. The outcomes are intended to support applications in nuclear safeguards, verification, emergency response, and reactor startup.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗