Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reliability assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Hybrid Analytics Solution to Improve Coal Power Plant Operations

This project focused on developing advanced methods for thermal performance monitoring of a coal-fueled power plant. The specific goal was to develop and demonstrate a new thermal performance monitoring approach using a hybrid model that integrates a physics-based heat balance model with a machine learning-based pattern recognition model. The hybrid model enables increased accuracy and scope of the thermal analysis and an improved ability to monitor and detect changes in plant operation. This new approach takes full advantage of the individual model capabilities and creates an important new set of capabilities not previously possible using the two types of models separately. Using the heat balance model, a rich set of derived parameters (virtual sensors) are calculated from the measured plant operating data at each time point. The combined measured and derived data values are used by machine learning algorithms to create pattern recognition models over the range of normal unit operation. To create the monitoring models, historical data from normal operation of the plant is first processed by the heat balance model to compute the derived parameter data. The result is a greatly expanded set of normal operating data that can be used as input to create the pattern recognition model. Once the models are calibrated for normal operation, the hybrid model is suitable for use in continuous online monitoring. During online monitoring, new plant operating data is processed first by the heat balance model and then by the pattern recognition model. Results from the pattern recognition model quantify the deviation of each measured or derived parameter from its expected value in normal operation. The hybrid models can detect abnormal changes in plant operating data with very high accuracy and sensitivity. When abnormal behavior is detected, alerts are generated automatically for evaluation by the plant monitoring staff. The new hybrid solution product was developed and verified in the performance of the project. The hybrid solution was tested first in a simulation environment that mimicked the plant data systems and infrastructure used by U.S. power generating plants and utilities. The hybrid solution was then deployed for real-time, online monitoring of an operating coal-fueled power plant at a field test site. Field testing demonstrated that all hybrid solution development objectives were accomplished. The project work was based on combining the capabilities of two existing software products to create the new hybrid solution product. One of these was the existing MapEx® heat balance product and the other was the existing SureSense® advanced pattern recognition product. Each of these separate products was assessed to be at a Technology Readiness Level (TRL) of 9 at the start of the effort. The hybrid solution product was assessed to be at a TRL of 2 at the start of the project based on early feasibility work by the project team. At completion of the field testing performed in the project, the hybrid solution product was assessed to be at a TRL of 7. The project team expects that the hybrid solution product will be deployed commercially and will achieve a TRL of 9 within one year after completion of the project.

01 COAL, LIGNITE, AND PEAT↗

A reliable workflow for improving nanoscale X-ray fluorescence tomographic analysis on nanoparticle-treated HeLa cells

Abstract Scanning X-ray fluorescence (XRF) tomography provides powerful characterization capabilities in evaluating elemental distribution and differentiating their inter- and intra-cellular interactions in a three-dimensional (3D) space. Scanning XRF tomography encounters practical challenges from the sample itself, where the range of rotation angles is limited by geometric constraints, involving sample substrates or nearby features either blocking or converging into the field of view. This study aims to develop a reliable and efficient workflow that can (1) expand the experimental window for nanoscale tomographic analysis of local areas of interest within a laterally extended specimen, and (2) bridge 3D analysis at micrometer and nanoscales on the same specimen. We demonstrate the workflow using a specimen of HeLa cells exposed to iron oxide core and titanium dioxide shell (Fe3O4/TiO2) nanocomposites. The workflow utilizes iterative and multiscale XRF data collection with intermediate sample processing by focused ion beam (FIB) sample preparation between measurements at different length scales. Initial assessment combined with precise sample manipulation via FIB allows direct removal of sample regions that are obstacles to both incident X-ray beam and outgoing XRF signals, which considerably improves the subsequent nanoscale tomography analysis. This multiscale analysis workflow has advanced bio-nanotechnology studies by providing deep insights into the interaction between nanocomposites and single cells at a subcellular level as well as statistical assessments from measuring a population of cells.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Controller Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System with Multiple Grid-Forming Inverters

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). The CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗

Synthetic Ancillary Service Generator (SynAS) v1

The balance of demand and supply in the electric power grid is a crucial element to grid reliability. While balancing is typically provided by conventional power plants, with spinning generators, distributed energy resources (DER) and especially electric vehicles (EVs) pose a great potential to provide such service. This project conducted a field demonstration at the Los Angeles Air Force Base (LA-AFB) where a fleet of mixed-use bi-directional EVs were actively participating in the California Independent System Operator (CAISO) market for frequency regulation. While participation in regulation markets is promising, a major drawback in designing control systems and assessing potential revenue is the lack of example frequency regulation signals. This project introduces an open-source dataset for 143 days of four-second regulation data, and the SynAS Python module to synthetically generate frequency regulation signals of arbitrary length.

Black, DouglasR↗

Analysis of Respirator Cartridge Performance Testing on the 702-AZ Primary Exhauster for the Hanford AY/AZ Tank Farms during a Waste-Disturbing Event

Washington River Protection Solutions (WRPS) conducted tests using two types of chemical cartridges for use in air-purifying respirators (APR) to determine the period of time that the cartridges would provide adequate performance1 for APRs used to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPC) from vapors exiting the 702-AZ Primary Exhauster for the Hanford AY-AZ tank farms. Unlike prior cartridge testing on the 702-AZ Primary Exhauster, the recent tests were performed during a waste-disturbing event. The Occupational Safety and Health Administration (OSHA) identifies cartridge testing as a valid approach for establishing a cartridge change schedules. Testing is commonly applied in situations where mixtures of COPCs exist, and where other approaches, such as manufacturer recommendations and modeling, are less reliable. The tests were designed and conducted to assure measurement and/or control of the key variables OSHA identified as important to estimate the cartridge service life, including temperature, humidity, COPC concentration, breathing rate, and cartridge adsorption capacity. Testing was conducted from February 10–11, 2017, on a slipstream from the 702-AZ exhauster fed to a respirator cartridge test stand developed by WRPS in collaboration with HiLine Engineering (Richland, Washington). Multipurpose respirator cartridges, SCOTT 7422-SD1 and SCOTT 7422-SC1 (SCOTT Safety, Monroe, North Carolina), were assessed on separate days. Sample media (sorbent tubes) and canisters (e.g., Summa) sampling were used to collect samples of the vapor stream entering and exiting the respirator cartridge and were subsequently analyzed for COPC concentrations. Pacific Northwest National Laboratory was tasked with conducting an independent analysis of the analytical results and making recommendations based on the results for respiratory cartridge performance and service life.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Controller Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System with Multiple Grid-Forming Inverters: Preprint

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). The CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗

Controller-Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System With Multiple Grid-Forming Inverters

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). This CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗

D$e^+e^-$ffusion: Capturing the Beam-Beam Physics of $e^+e^-$ Collisions with Diffusion Models

Beam-induced backgrounds at high-luminosity $e^+e^-$ colliders, such as the FCC-ee, are dominated by incoherent pair creation (IPC), and require computationally expensive simulations with dedicated Monte Carlo (MC) event generators. Reliable detector and machine-detector interface studies necessitate event samples that are several orders of magnitude larger than what is practically attainable with existing MC. To alleviate this bottleneck, we present D$e^+e^-$ffusion, a denoising diffusion probabilistic model that operates as a permutation-equivariant, set-valued surrogate for fast IPC simulation. Trained on a small GuineaPig++ sample, D$e^+e^-$ffusion faithfully reproduces the marginal and joint kinematic, angular, and positional distributions of all three IPC production processes. In addition, we assess the fidelity at the detector level by propagating both Geant4 and D$e^+e^-$ffusion events through a Geant4 simulation of the CLD vertex detector and by training a transformer-based two-sample classifier; the classifier achieves an area under the ROC curve of $0.553 \pm 0.016$. The trained model generates events nearly four orders of magnitude faster than Geant4, paving the way for a fast-simulation surrogate for FCC-ee design studies.

Chahine, Antonio [Imperial Coll., London]↗

Critical assessment of the recent report on the gigaparsec-scale correlation of the orientations of large quasar groups

ABSTRACT Recently, it was reported that large quasar groups (LQGs) identified from the Sloan Digital Sky Survey (SDSS) data release seven catalogue are not randomly oriented but preferentially aligned or orthogonal over scales 1–2 Gpc. To confirm this claim, I reproduced the same LQG sample and performed Sobolev tests of uniformity on the LQG orientation axes in the redshift space. Contrary to the original report based on the bimodal distribution of the LQG position angles in the sky, I found no departure from uniformity in the distribution of the LQG orientation axes. I also examined whether the LQGs are physical structures using a statistically more reliable data set constructed from the SDSS data release 16 (DR16) large-scale structure (LSS) quasar catalogue. Considering the Gaussian primordial density fluctuations and shot noise, I estimated the mass density contrasts of the LQGs from the number counts of the DR16 LSS quasars and found that most of the LQGs do not trace statistically significant high-density regions. I conclude that the LQG sample is a collection of unphysical chance associations and should not be used for any cosmological studies.

Fujii, Hirokazu (ORCID:0000000161473512)↗

Tandem Photovoltaics Core Program Final Technical Report

The Tandem Photovoltaics Core Program was a multi-year initiative aimed at advancing hybrid tandem solar cell technologies to enhance solar module efficiency beyond the limits of single junction devices. This project focused on the development, testing, and scaling of prototype photovoltaic devices, with the goal of achieving commercial relevance and driving industry adoption. The work was divided into three tasks: 1) Comparative Analysis of Tandem Technologies: This task focused on quantifying energy yield under real-world conditions and assessing economic viability of tandems relative to silicon-based modules. The project's modeling framework incorporated performance data, cost of materials, and manufacturing process impacts to optimize tandem designs 2) Tandem Integration and Prototyping: In this task, we developed innovative tandem designs by combining metal halide perovskite (MHP) top cells and silicon (Si) bottom cells. The project focuses on both mechanical integration and direct deposition techniques to enable compatibility with commercially relevant Si technologies, such as passivated contact or PERC cells. 3) Scale-up and Reliability: This task addressed the challenges of large-area fabrication by developing scalable deposition methods and robust interconnection schemes for tandems. The project looked at different accelerated testing such as thermal cycling, damp heat exposure, and potential induced degradation, to ensure long-term stability of devices in field conditions. Tandem solar cells can greatly increase module efficiency beyond conventional single junction (SJ) devices, which are approaching their theoretical limit. There are many ways to fabricate a tandem cell or module in terms of materials used, configuration, and terminal connection. This SETO core project focused critical factors in enabling tandems to enter the market, including hardware integration, technoeconomic analysis (TEA), and energy yield analysis. We focused on MHP/Si hybrid tandem solar cells and modules as a model system for their versatility in module design comparisons, providing valuable insights for other tandem options. While champion cells with areas <1cm2 are regularly demonstrated by groups around the world, it is significantly more challenging to translate these advances into modules, and fewer institutions and companies are working at the module level. This project addressed questions about module fabrication, testing, and reliability that are hard to answer without actually fabricating prototypes. We also performed analysis and road-mapping activities to understand the potential for a wider variety of tandems, including all-perovskite tandems fabricated in collaboration with the Perovskite PV core program. Detailed technical results from this project are described for each task in Section 7.

14 SOLAR ENERGY↗

Using Machine Learning to Predict Future Temperature Outputs in Geothermal Systems

Optimizing the power output, and economic value, of geothermal power plants over decades of operation is a major challenge in renewable energy. Optimizing the output requires the ability to predict the mass flow rates and the output temperatures of production wells based on the inputs of injection wells, as well as the time history of the system. Machine Learning (ML) that incorporates the known physics of geothermal systems is one possible solution to this challenge. In this work, we explore the ability of ML algorithms to predict future temperature outputs based on historical data. Considering the challenges with obtaining an empirical dataset from field data that is large enough to enable reliable ML, we propose an alternate approach: developing a high-fidelity reservoir model and using computational resources to build a dataset that enables ML. As a first step towards achieving this goal, we present preliminary results from applying ML to predict the temperature timeseries of simple modeled geothermal systems. We describe the application of relevant state-of-the-art ML approaches, such as the Long Short-Term Memory (LSTM) networks and Convolutional Neural Networks (CNN), to extract temporal structures in the model data. We assess the accuracy of the forecasts we obtain, compare the selected approaches, and share the lessons learned that would inform the process of training and utilizing ML algorithms for larger and more complex geothermal systems.

GEOTHERMAL ENERGY↗

Envelope-driven comfort risk in residential demand response

Residential demand response (DR) is a valuable resource for grid reliability, but remains challenging because the highly heterogeneous residential building stock leads to widely varying and hard-to-predict load and comfort responses during DR events. Although prior research has estimated the technical potential of DR-capable technologies for achieving energy demand savings, little is known about how they affect thermal comfort. In particular, it remains unclear how indoor thermal conditions due to DR depend on the thermal envelope characteristics of the housing stock. To address this gap, this study provides a systematic, location-specific assessment of indoor thermal performance during DR-events across the US housing stock using both typical DR weather data and detailed building metadata. We evaluate how envelope characteristics influence indoor temperatures during realistic simulated summer and winter DR events across 37 US locations, applying both temperature threshold and rate of temperature change criteria to estimate region-level probabilities of discomfort. Additionally, we show the impact of distinct weather patterns that intensify or abate thermal stress on comfort outcomes. Results show a near-universal overheating risk in summer DR events, where comfort outcomes are strongly influenced by rapid risk of comfort violations. In contrast, overall winter DR discomfort risk is lower, risk escalation is more gradual and shows greater sensitivity to event duration. These findings offer a data-driven quantification of comfort risk across diverse climates and building envelopes, demonstrating the need for region-specific DR scheduling and discomfort mitigation strategies tailored to local weather patterns and the performance of existing residential buildings.

Demand response↗

Electronic structure theory on modeling short-range noncovalent interactions between amino acids

While short-range noncovalent interactions (NCIs) are proving to be of importance in many chemical and biological systems, these atypical bindings happen within the so-called van der Waals envelope and pose an enormous challenge for current computational methods. We introduce SNCIAA, a database of 723 benchmark interaction energies of short-range noncovalent interactions between neutral/charged amino acids originated from protein x-ray crystal structures at the “gold standard” coupled-cluster with singles, doubles, and perturbative triples/complete basis set [CCSD(T)/CBS] level of theory with a mean absolute binding uncertainty less than 0.1 kcal/mol. Subsequently, a systematic assessment of commonly used computational methods, such as the second-order Møller−Plesset theory (MP2), density functional theory (DFT), symmetry-adapted perturbation theory (SAPT), composite electronic-structure methods, semiempirical approaches, and the physical-based potentials with machine learning (IPML) on SNCIAA is carried out. It is shown that the inclusion of dispersion corrections is essential even though these dimers are dominated by electrostatics, such as hydrogen bondings and salt bridges. Overall, MP2, ωB97M-V, and B3LYP+D4 turned out to be the most reliable methods for the description of short-range NCIs even in strongly attractive/repulsive complexes. SAPT is also recommended in describing short-range NCIs only if the δMP2 correction has been included. The good performance of IPML for dimers at close-equilibrium and long-range conditions is not transferable to the short-range. We expect that SNCIAA will assist the development/improvement/validation of computational methods, such as DFT, force-fields, and ML models, in describing NCIs across entire potential energy surfaces (short-, intermediate-, and long-range NCIs) on the same footing.

Chemistry↗

Analysis of Respirator Cartridge Performance Testing on a Hanford AN Tank Farm Exhauster Slipstream

Washington River Protection Solutions (WRPS) conducted tests on two types of chemical cartridges for use in air purifying respirators to determine the period of time that the cartridges would provide adequate performance to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPCs) from vapors exiting the exhauster at the Hanford AN tank farm. The Occupational Safety and Health Administration (OSHA) identifies cartridge testing as a valid approach for establishing cartridge change schedule. Testing is commonly applied in situations where mixtures of COPCs exist and where other approaches, such as manufacturer recommendations and modeling, are less reliable. The tests were designed and conducted to assure measurement and/or control of the key variables OSHA identified as important to estimate cartridge service life, including temperature, humidity, COPC concentration, breathing rate, and cartridge adsorption capacity. Testing was conducted from September 30−October 2, 2016, on a slipstream from the AN Exhauster under static conditions fed to a respirator cartridge test stand developed by WRPS in collaboration with HiLine Engineering (Richland, Washington). Multipurpose respirator cartridges, SCOTT 7422-SD1 and SCOTT 7422-SC1 (SCOTT Safety, Monroe, North Carolina) were assessed on separate days. Sample media (sorbent tubes) were used to collect samples of the vapor stream entering and exiting the respirator cartridge and were subsequently analyzed for COPC concentrations. Pacific Northwest National Laboratory was tasked with conducting an independent analysis of the analytical results and making recommendations based on the results for respiratory cartridge performance and service life.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Analysis of Respirator Cartridge Performance Testing on the 702-AZ Primary Exhauster for the Hanford AY/AZ Tank Farms

Washington River Protection Solutions (WRPS) conducted tests on two types of chemical cartridges for use in air purifying respirators to determine the period of time that the cartridges would provide adequate performance to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPC) from vapors exiting the 702-AZ primary exhauster for the Hanford AY/AZ tank farms. The Occupational Safety and Health Administration (OSHA) identifies cartridge testing as a valid approach for establishing cartridge change schedules. Testing is commonly applied in situations where mixtures of COPCs exist, and where other approaches, such as manufacturer recommendations and modeling, are less reliable. The tests were designed and conducted to assure measurement and/or control of the key variables OSHA identified as important to estimate cartridge service life, including temperature, humidity, COPC concentration, breathing rate, and cartridge adsorption capacity. Testing was conducted from August 26–28, 2016, on a slipstream from the 702-AZ exhauster, under static conditions fed to a respirator cartridge test stand developed by WRPS in collaboration with HiLine Engineering (Richland, Washington). Multipurpose respirator cartridges, SCOTT 7422-SD1 and SCOTT 7422-SC1(SCOTT Safety, Monroe, North Carolina) were assessed on separate days. Sample media (sorbent tubes) were used to collect samples of the vapor stream entering and exiting the respirator cartridge, and were subsequently analyzed for COPC concentrations. Pacific Northwest National Laboratory was tasked with conducting an independent analysis of the analytical results and making recommendations based on the results for respiratory cartridge performance and change-out frequency.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Analysis of Respirator Cartridge Performance Testing on a Hanford AW Tank Farm Exhauster Slipstream

Washington River Protection Solutions (WRPS) conducted tests on two types of chemical cartridges for use in air-purifying respirators (APR) to determine the period of time that the cartridges would provide adequate performance for APRs used to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPCs) from vapors exiting the exhauster for the Hanford AW tank farm. The Occupational Safety and Health Administration (OSHA) identifies cartridge testing as a valid approach for establishing a cartridge change schedules. Testing is commonly applied in situations where mixtures of COPCs exist, and where other approaches, such as manufacturer recommendations and modeling, are less reliable. The tests were designed and conducted to assure measurement and/or control of the key variables OSHA identified as important to estimate cartridge service-life, including temperature, humidity, COPC concentration, breathing rate, and cartridge adsorption capacity. Testing was conducted from September 23-25, 2016, on a slipstream from the AW exhauster, under static conditions fed to a respirator cartridge test stand developed by WRPS in collaboration with HiLine Engineering (Richland, Washington). Multipurpose respirator cartridges, SCOTT 7422-SD1 and SCOTT 7422-SC1 (SCOTT Safety, Monroe, North Carolina), were assessed on separate days. Sample media (sorbent tubes) were used to collect samples of the vapor stream entering and exiting the respirator cartridge, and were subsequently analyzed for COPC concentrations. Pacific Northwest National Laboratory was tasked with conducting an independent analysis of the analytical results and making recommendations based on the results for respiratory cartridge performance and service life.

54 ENVIRONMENTAL SCIENCES↗

Exploring Local Ionic Motion in Perovskite Solar Cells at Nanoscale through Scanning Thermo-Ionic Microscopy

We investigate the local ionic motion in the absorber layer of perovskite solar cells using scanning thermo-ionic microscopy (STIM). STIM images of perovskite films show higher STIM amplitude at most of the grain boundaries due to higher ionic motion at those regions. The perovskite absorber layer of devices aged under blue (450 nm) light soaking shows higher amplitude in STIM signal compared to controls kept in dark storage. Such enhancement of STIM amplitude upon aging under light implies an increased concentration or diffusivity (or both) of mobile ionic species in stressed devices. Our results demonstrate the utilization of the STIM technique to assess and understand the intrinsic local ionic motion in perovskite absorbers for further advancement in device stability and functionality.

aging↗

Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-human interactions

Understanding protein-protein interactions (PPIs) between viruses and host organisms is crucial for uncovering infection mechanisms and identifying potential therapeutic targets. The ability to generalize PPI predictive models across understudied viruses presents a significant challenge. In this work, we use arenavirus-human PPIs to illustrate the difficulties associated with model generalization, which are compounded by a lack of both positive and negative data. We employ a Transfer Learning approach to investigate arenavirus-human PPIs by utilizing models trained on better-studied virus-human and human-human PPIs. Additionally, we curate and assess four types of negative sampling datasets to evaluate their impact on model performance. Despite the overall high accuracies (93–99 %) and AUPRC scores (0.8–0.9) appearing promising, further analysis indicates that these performance metrics can be misleading due to data leakage, data bias, and overfitting, especially concerning under-represented viral proteins. We reveal these gaps and assess the impact of data imbalance using standard k-fold cross-validation and Independent Blind Testing with a Balanced Dataset, resulting in a drop in accuracy below 50 %. We propose a viral protein-specific evaluation framework that categorizes viral proteins into majority and minority classes based on their representation in the dataset, enabling comparison of model performance across these groups using balanced accuracies. This framework offers a more robust evaluation of model generalizability, addressing biases inherent in standard evaluation techniques and paving the way for more reliable PPI prediction models for understudied viruses.

59 BASIC BIOLOGICAL SCIENCES↗