Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Comprehension”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Emergency department overcrowding and its associated factors at HARME medical emergency center in Eastern Ethiopia

Introduction: Emergency department (ED) overcrowding has become a significant concern as it can lead to compromised patient care in emergency settings. Various tools have been used to evaluate overcrowding in ED. However, there is a lack of data regarding this issue in resource-limited countries, including Ethiopia. This study aimed to validate NEDOCS, assess level of ED overcrowding and identify associated factors at HARME Medical Emergency Center, located in Hiwot Fana Comprehensive Specialized Hospital, Harar, Ethiopia. Methods: A cross-sectional study was conducted at the HARME Medical Emergency Center, Hiwot Fana Comprehensive Specialized Hospital, involving a total of 899 patients during 120 sampling intervals. The area under the receiver operating characteristic curves (AUC) was calculated to evaluate the agreement between objective and subjective assessments of ED overcrowding. A multivariable logistic regression analysis was employed to identify factors associated with ED overcrowding and statistically significant association was declared using 95% confidence level and a p-value < 0.05. Results: The interrater agreement showed a strong correlation with a Cohen's kappa (κ) of 0.80. The National Emergency Department Overcrowding Study Score demonstrated a strong association with subjective assessments from residents and case team nurses, with an AUC of 0.81 and 0.79, respectively. According to residents' perceptions, ED were considered overcrowded 65.8% of the time. Factors significantly associated with ED overcrowding included waiting time for triage (AOR: 2.24; 95% CI: 1.54–3.27), working time (AOR: 2.23; 95% CI: 1.52–3.26), length of stay (AOR: 2.40; 95% CI: 1.27–4.54), saturation level (AOR: 2.35; 95% CI: 1.31–4.20), chronic illness (AOR: 2.19; 95% CI: 1.37–3.53), and abnormal pulse rate (AOR: 1.52; 95% CI: 1.06–2.16). Conclusion: The study revealed that ED were overcrowded approximately two-thirds of the time.

60 APPLIED LIFE SCIENCES↗

Simulation-based Performance Evaluation of Model Predictive Control for Building Energy Systems

The performance of model predictive control (MPC) can be significantly affected by different choices of controller parameters such as the time intervals for model discretization and control sampling. Due to the lack of a systematic understanding on how these parameters affect control performance, they are usually selected arbitrarily in practice.In this paper, the combined impacts of selected time intervals for model discretization and control sampling on the performance of MPC are comprehensively investigated for the first time through detailed simulations. Specifically, a typical MPC strategy is first designed to improve building operations based on a reduced-order model of building dynamics. Then, the performance of the designed MPC is evaluated against different choices of time intervals for model discretization and control sampling on a simulated office building. The detailed simulation results reveal that the time interval for model discretization has a much greater influence on the performance of MPC than the time interval for control sampling. Although the time interval for control sampling usually receives more attentions in practice, it turns out that the time interval for model discretization affects the prediction performance, cost saving, and computation time simultaneously and more significantly. Therefore, the simulation-based performance evaluation presented here sheds light on the impacts of different time intervals and facilitates their selection for practical applications of MPC to building operations

Huang, Sen↗

A review of machine learning in building load prediction

The surge of machine learning in recent years has been empowering engineer modeling in various fields. The decreasing hardware cost, increasing data accessibility, and advances of building automation system (BAS) allow the collection and storage of a significant amount of building operation data. The two facts provide great opportunities of applying machine learning to building energy systems modeling and analysis. There are a great number of research papers on this topic but there lacks a comprehensive and general review to summarize the current development, limitations, gaps and future trend. In this review paper series, machine learning techniques in building energy system modeling and analysis are reviewed under the organization and logic of the machine learning definition by Tom M. Mitchell: a computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E. This paper is the first part of the review paper series, which focuses on building load prediction. First, the applications of building load prediction model (task T) are reviewed. Then, the modeling algorithms improving machine learning performance and accuracy (performance P) are reviewed. At the same time, the literature on the data perspective for modeling (experience E), including data engineering from sensors level to data level, pre-processing, feature extraction and selection, is reviewed. Finally, what is well-studied and what is lacking but with great potential are concluded; the gaps between present and future utilization of machine learning techniques are identified; the future trend and development are also predicted. The target readers of this paper are not only researchers from the building side who can get exposed to cutting edge machine learning tools, but also those from machine learning side who can understand the potential and challenge to apply machine learning in buildings.

Liang, Zhang↗

An economic assessment of behind-the-meter photovoltaics paired with batteries on the Hawaiian Islands.

Due to natural variability and uncertainty, the ever-increasing penetration of solar generation in Hawaii presents challenges to power grid operators to maintain reliable system operation. Demand response (DR) has the potential to be a cost-effective tool for Hawaii to reach its aggressive renewable energy goals while maintaining the reliability of power grids. The Hawaii Public Utilities Commission has approved the Hawaiian Electric Company's revised portfolio of DR programs. The companies have released a grid services purchase agreement and subscribed an initial tranche of load into their DR programs. This paper presents innovative analytical methods and comprehensive economic assessment for distributed photovoltaics (PV) paired with battery energy storage systems (BESSs) for two new DR programs, including fast frequency response and capacity grid service. Optimal dispatch and sizing methods are proposed for the paired system considering different tariff schedules and PV compensation programs across five islands. It was found that while the best resource configuration and potential economic benefits vary with tariff structure, a BESS paired with PV can be optimally dispatched to generate multiple value streams simultaneously. Compensation from DR programs is an important value stream to help increase the cost-effectiveness of the integrated system.

Battery energy storage system↗

Development of an integrated platform for hardware-in-the-loop evaluation of microgrids prior to site commissioning

This paper presents an integrated hardware-in-the-loop (HIL) platform for testing the operation and control of a real-world microgrid system prior to site commissioning. The proposed testing approach shows the value of setting up an integrated HIL platform to test multiple hardware devices (including the system-level controller, device controllers, and field devices). A test bed developed for the Borrego Springs community microgrid is used as an example to demonstrate the feasibility of the integrated platform. Comprehensive tests are carried out using the Borrego Springs test bed to validate the platform, meet the test objectives, and gain valuable insight prior to site commissioning. The selected test scenarios, initial conditions, events, test metrics, etc., are similar to those defined in IEEE P2030.8. The test objectives are to evaluate the microgrid controller and the operation of the microgrid. The HIL platform presented in this paper shows good value for microgrid testing in terms of its flexibility and scalability for testing various microgrids; its accuracy in its representation of the field; the comprehensiveness of the testing capability; and the efficiency of testing, which can reduce risks prior to field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Open data sets for assessing photovoltaic system reliability

Photovoltaic (PV) systems have become a cornerstone of renewable energy strategies, particularly due to the significant reduction in solar power costs over the past decade. However, the long-term reliability of PV installations presents a persistent challenge, requiring the development of advanced monitoring and predictive maintenance strategies. A wide range of data types is used to evaluate the health of PV systems, including environmental conditions, electrical performance, and inspection imagery. These data enable methodologies such as machine learning (ML) models for lifetime prediction and computer vision techniques for defect detection. However, the acquisition of high-quality and comprehensive data is difficult, particularly in terms of long-term consistency and data variety. Publicly available data sets serve as valuable resources for addressing these challenges, but they often suffer from fragmentation and are difficult to access. This paper presents a comprehensive review of existing open-source data sets related to PV degradation, analyzing their features, functionalities, and potential applications. We categorize these data sets based on the specific aspects of PV system information they cover, such as environmental conditions, operational monitoring, image inspection and module materials, and propose relevant tools and ML models for processing them. In addition, we propose practices for future data collection and usage, while also discussing potential directions in data-driven research. Our aim is to enhance data utilization and publication among researchers and industry professionals, promoting a deeper understanding of the role of data in enhancing the performance and durability of PV systems.

14 SOLAR ENERGY↗

Multi-scale and multi-physics analysis, design optimization, and experimental validation of heat exchangers utilizing high performance, non-round tubes

Air-to-refrigerant heat exchangers (HXs) are fundamental components in HVAC&R systems, and considerable research has been dedicated designing continually smaller, lighter, and more efficient HX designs. In recent years, researchers have leveraged advancements in Computational Fluid Dynamics (CFD), Finite Element Analysis (FEA), and optimization algorithms to consider primary tube shape and topology optimization to design highly compact, high performance HXs for a multitude of applications. In this research, we present a computationally efficient, comprehensive, multi-scale, and multi-physics analysis and optimization method for air-to-refrigerant HXs featuring automated CFD and FEA simulations and approximation-assisted optimization. This methodology was utilized to design HXs with shape-optimized, non-round tubes which outperform current state-of-the-art tube-fin HXs without compromising structural integrity. The optimal HXs were shown to deliver similar thermal performance to the baseline HXs while also achieving more than 20% reductions in airside pressure drop and core envelope volume and more than 30% reduction in internal volume. Comprehensive experimental validation of the optimization methodology was conducted through the testing of two prototypes in a standardized wind tunnel facility under multiple operating conditions. For prototype #1 under dry evaporator conditions, the predicted heat load agreed within ± 10% of measured values and the predicted airside pressure drop agreed within ± 30%, while for dehumidifying conditions, the predicted sensible and latent heat loads agreed within ± 10% and ± 20% of the measured values, respectively. For prototype #2, the predicted condenser heat load agreed within ± 3.0% of measured values, and the predicted airside pressure drop agreed within ± 27%. The acceptable agreement between simulation and experimental results for the present application highlights the flexibility of the novel optimization methodology to design next generation HXs with improved performance and reduced volume, weight, and environmental impact.

42 ENGINEERING↗

CFD modeling of turbulent air flow in self-heated gyroid TPMS structures: Thermal-hydraulic performance and validation

The application of mathematically derived geometries, such as triply periodic minimal surface (TPMS) lattices, has garnered significant interest across various fields, including the nuclear sector, due to their superior thermal-hydraulic characteristics for heat transfer compared to traditional plain or finned tubes. Here, this study validates a computational fluid dynamics (CFD) model, evaluates different turbulence models and CFD model settings, and performs uncertainty quantification to provide a comprehensive analysis. Despite extensive research on CFD modeling of TPMS lattices, such as gyroid and diamond geometries, there is a notable lack of publicly available literature providing comprehensive details on numerical analysis aspects, including convergence and methodological best practices. This study embarks on a benchmark analysis of a gyroid geometry to evaluate its thermal-hydraulic performance under turbulent flow conditions and scrutinize various CFD model configurations. The main contributions of this work include validating the CFD model, assessing and comparing different turbulence models, and enhancing pressure drop and temperature prediction capabilities. The results aim to support the development of methodologies needed to benchmark and enhance numerical analysis techniques for TPMS lattices. This work seeks to complement the existing body of knowledge, support the development of TPMS reactor concepts, and improve best practices for CFD modeling of TPMS lattices, ultimately advancing methodologies to support future applications in this domain.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

A critical review of electrochemical heat pump technologies: Status, challenges, and perspectives

The development of advanced heat pump technologies is critical for reducing global energy consumption in the building sector, where space heating and cooling account for nearly 50% of energy use. Electrochemical heat pumps (EHPs) offer a promising alternative to vapor compression systems by enabling direct electrochemical-to-thermal energy conversion, often with environmentally benign working fluids that exhibit low or zero global warming potential (GWP). Prior literature has predominantly focused on chemically reactive heat pumps, while comprehensive assessments of electrochemical mechanisms remain limited. Here, this review addresses this gap by systematically evaluating the underlying principles, architectures, and performance metrics of EHP systems. Compared to conventional vapor compression systems, EHPs can achieve 10%-30% higher energy efficiency, with reported cooling coefficients of performance (COP c ) ranging from 3.5 to 14.3 under standard operating conditions. Despite these advantages, widespread adoption is hindered by challenges including membrane degradation, electrode fouling, sluggish redox kinetics, and elevated system-level capital costs. To address these limitations, the review outlines three research priorities: (i) the development of advanced membranes, catalysts, and electrode materials with enhanced chemical and mechanical stability; (ii) the application of molecular-level simulations for the rational design of high-performance redox-active working fluids; and (iii) the integration of advanced diagnostic techniques for real-time monitoring and sustained operation of EHPs. By consolidating recent advances and explicitly identifying technological and scientific gaps, this work uniquely contributes a comprehensive framework for guiding future electrochemical heat pump research and facilitating the transition to sustainable thermal management technologies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Global kinetic modeling of NH 3 -SCR with two sites of NH 3 storage on Cu-SSZ-13

A comprehensive selective catalytic reduction (SCR) model is developed to detail the global kinetic reactions in the catalyst which is involved in two type of sites for high- and low-temperature NH 3 adsorption/desorption, as well as a low temperature H 2 O storage. The model accounts for the formation of ammonium nitrate in fast SCR and the decomposition formation of ammonium nitrate in the absence of NO, and addresses N 2 O relative to NO and NO 2 reactions with NH 3 . The model has been validated against commercial Cu-SSZ-13 measurements of NH 3 inventory, NH 3 oxidation, NO oxidation, standard SCR, fast SCR and NO 2 SCR at both comprehensive steady-state and transient conditions. In addition, the application of the SCR model for emissions control over a transient drive cycle at cold start was demonstrated based on diesel oxidation catalyst (DOC) and SCR aftertreatment system for a passenger car. In conclusion, the results show that the SCR model can provide the detailed emissions estimations for steady-state and transient conditions, can assist with understanding the impact of the SCR reaction mechanism, and can assist with the design and optimization of SCR catalysts to develop innovative technologies for co-optimization of engine fuel economy and emissions control technologies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Equilibrium carbon isotope fractionation factors of hydrocarbons: Semi-empirical force-field method

Here, we have calculated the reduced partition function ratios for carbon isotopes (β-factor) of 67 hydrocarbons (alkanes, alkenes, alkynes, cycloalkanes, and aromatics), including their 267 single-substituted isotopomers. The calculations were performed using the harmonic oscillator – rigid rotator model and the Urey / Bigeleisen-Mayer approach. Normal frequencies of molecular vibrations of the isotopologues were calculated from the molecular structures data and valence field force constants stored in the Light-handled Elucidation of Vibrations (LEV) database elaborated by Dr. Gribov and his colleagues in Russia. The LEV database is constructed from experimental spectroscopic and structural data by solving inverse problems of molecular vibrations. The LEV is internally consistent and the most comprehensive database available to date. The β-factor were calculated in the temperature range of 200–800 K with a 10 K step. Our calculations predict that the β-factors increase with an increasing number of C atoms within the same groups of hydrocarbons (e.g., alkanes). Our calculations also show a general descending order of 13 C enrichments among the different groups of hydrocarbons: cycloalkanes, aromatics, alkenes (double bonds) and isoalkanes, alkanes, alkynes (triple bonds). Position-specific, intramolecular isotope effects within hydrocarbons are determined by the β-factors of C in the different functional groups in the order: quaternary (C), tertiary (methine, CH), secondary (methylene, CH 2 ), primary (methyl, CH 3 ) and double bond (C=C), saturated bond (C - C), triple bond (HC≡). Our calculations on bulk and position-specific carbon isotope β-factors of the hydrocarbons, which are generally consistent with very limited ab initio calculations in the literature, are internally consistent and the most comprehensive to date for future applications to position-specific isotope geochemistry of hydrocarbons.

58 GEOSCIENCES↗

Discussion on molecular dynamics (MD) simulations of the asphalt materials

The application of asphalt materials in pavement engineering has been increasingly widespread and sophisticated over the past several decades. Variations in the properties of asphalt binder during mixing, transportation, and paving can affect the performance of asphalt pavement. However, the asphalt material is a non-homogeneous and complex organic substance, consisting of various molecules with widely various molecular weights, elemental compositions, and structures. This complexity leads to difficulties for researchers to clearly and immediately understand the properties of asphalt materials and their variations. The multi-scale research approach combines macroscopic experimental data and microscopic simulation results from a practical engineering perspective. It helps to improve the understanding of asphalt materials. The molecular dynamics (MD) simulation proposes a corresponding molecular model of asphalt material based on experimental data, and the simulation algorithm is able to derive properties similar to those of real asphalt. Here, this paper provides a comprehensive review of the current studies on MD simulation of asphalt materials, including modeling, properties, and multi-scale analysis. As a key part of the computational simulation, this paper discusses the typical asphalt binder and asphalt-aggregate interface models constructed by different groups, and also presents their differences from real samples and their feasibility based on fundamental properties. After the introduction of molecular models, the extensive work made by researchers based on molecular models is categorically reviewed and discussed. The strengths and weaknesses of MD simulation methods in the study of asphalt materials are also summarized in order to provide the reader with a more comprehensive understanding of the relevant contents and to guide subsequent research.

36 MATERIALS SCIENCE↗

Large language model-driven database for thermoelectric materials

Thermoelectric materials have the ability to convert waste heat into electricity, offering a valuable solution for energy harvesting. However, their widespread use is hindered by low conversion efficiency, the reliance on expensive rare earth elements, and the environmental and regulatory concerns associated with lead-based materials. A fast and cost-effective way to identify highly efficient thermoelectric materials is through data-driven methods. These approaches rely on robust and comprehensive datasets to train models. Although there are several databases on thermoelectric materials, there is still a need to collect and integrate experimental data from peer-reviewed research articles to capture diverse compositions and properties of materials. Here, in this work, we developed a comprehensive database of 7,123 thermoelectric compounds, containing key information such as chemical composition, structural detail, seebeck coefficient, electrical and thermal conductivity, power factor, and figure of merit (ZT). We used the GPTArticleExtractor workflow, powered by large language models (LLM), to extract and curate data automatically from the scientific literature published in Elsevier journals. This process enabled the creation of a structured database that addresses the challenges of manual data collection. The open access database could stimulate data-driven research and advance thermoelectric material analysis and discovery.

Database↗

The Path towards Plasma Facing Components: A Review of State-of-the-art in W-Based Refractory High-Entropy Alloys

Developing advanced materials for plasma-facing components (PFCs) in fusion reactors is a crucial aspect for achieving sustained energy production. Tungsten (W) - based refractory high-entropy alloys (RHEAs) have emerged as promising candidates due to their superior radiation tolerance and high-temperature strength. This review paper will focus on recent advancements in W-based RHEA research, particularly emphasizing the key role of modelling using machine learning (ML) in the stage of discovery by predicting properties for each composition and expediting the identification of optimal RHEA compositions with desired properties. Additionally, the application of additive manufacturing (AM) techniques for fabricating W-based RHEAs is explored, highlighting their advantages for rapid prototyping and multi-compositional sample production in a high throughput manner. The review critically evaluates the current understanding of mechanical properties relevant to PFC applications, including high-temperature strength and ductility. Furthermore, the radiation tolerance of W-based RHEAs under irradiated conditions is discussed. Finally, the validity of current AM-manufactured W-based RHEAs as PFC materials is assessed, and key challenges and opportunities for future research are identified. This review aims to provide a comprehensive overview of W-based RHEAs for fusion applications and their potential to guide the development and validation of advanced refractory high entropy alloys.

Hatler, Caleb [University of Wisconsin-Madison]↗

Computational materials assessment of the D/Li-stripping neutron source as a prototypical facility for fusion materials testing

As the US fusion materials community awaits the selection and design of a fusion prototypical neutron source (FPNS), a risk reduction exercise has been conducted to (i) provide an updated materials performance evaluation using state-of-the-art computational materials modeling, (ii) expand on legacy analysis based on pure Fe to other relevant fusion structural materials types, and (iii) ensure that materials response under FPNS operational conditions is consistent with referential fusion reactor conditions. The current paper describes the efforts undertaken to assemble a comprehensive computational methodology that includes neutronics, primary damage calculations, atomistic simulations of displacement cascades, chemical inventory evolution calculations, and a computational thermodynamic analysis of emerging phases during irradiation. Our work extends existing studies in pure Fe to reduced-activation ferritic/martensitic steels, tungsten, silicon carbide, and vanadium alloys. We focus on the single-beam deuteron/lithium-stripping neutron source behind the IFMIF-DONES concept, which we assess against ITER, two DEMO designs, and an ideal pure 14-MeV flux. Our analysis indicates that, within standard uncertainties inherent to the models employed, the DONES concept adequately captures fusion conditions in the four materials analyzed. Our work is intended as a comprehensive irradiation damage analysis of fusion-representative neutron sources, to be used for further neutron source evaluation and fusion facility operation.

Marian, Jaime [Univ. of California, Los Angeles, C↗

Motif-centric phosphoproteomics to target kinase-mediated signaling pathways

Identifying cellular phosphorylation pathways based on kinase-substrate relationships is a critical step to understanding the regulation of physiological functions in cells. Mass spectrometry-based phosphoproteomics workflows have made it possible to comprehensively collect information on individual phosphorylation sites in a variety of samples. However, there is still no generic approach to uncover phosphorylation networks based on kinase-substrate relationships in rare cell populations. Here, we describe a motif-centric phosphoproteomics approach combined with multiplexed isobaric labeling, in which in vitro kinase reactions are used to generate targeted phosphopeptides, which are spiked into one of the isobaric channels to increase detectability. Proof-of-concept experiments demonstrate selective and comprehensive quantification of targeted phosphopeptides by using multiple kinases for motif-centric channels. More than 7,000 tyrosine phosphorylation sites were quantified from several tens of micrograms of starting materials. This approach enables the quantification of multiple phosphorylation pathways under physiological or pathological regulation in a motif-centric manner.

59 BASIC BIOLOGICAL SCIENCES↗

Innovations in underground hydrogen storage with multiphysics simulations, optimization, and monitoring: A review

Underground Hydrogen Storage (UHS) is a promising solution for large-scale energy storage and a critical component in advancing low-carbon energy system. Ensuring the safety and efficiency of UHS necessitates a comprehensive understanding of multiphysical interactions driven by cyclic pore fluid pressure fluctuations and coupled physicochemical processes. Here, this review examines the key geomechanical responses in UHS, including rock property variations under cyclic loading, fracture evolution and propagation, reservoir stress sensitivity, and fault stability. It also explores the impact of geochemical and microbial reactions on geomechanical characteristics. We provide an in-depth analysis of Thermal-Hydraulic-Mechanical-Chemical (THMC) coupled numerical simulations, highlighting their potential for future multi-scale modeling. Limitations of current machine learning (ML) approaches in addressing UHS challenges are highlighted, emphasizing the need for innovative ML-based methodologies. Operational strategies for hydrogen injection and production are reviewed, focusing on safety, efficiency, and economic viability. The necessity for multi-objective optimization (MOO) to balance storage efficiency, risk mitigation, and cost-effectiveness is also discussed. Current monitoring technologies are evaluated to ensure safe and efficient UHS operations. Finally, this review identifies critical knowledge gaps and underscores the importance of advancing geomechanical understanding under multiphysics-coupling. We highlight the need for ML-driven multiphysics theories, enhanced modeling techniques, and robust optimization strategies to improve UHS performance. This study serves as a comprehensive reference for future research and the large-scale implementation of UHS systems.

25 ENERGY STORAGE↗

Consistent performance of large language models in rare disease diagnosis across ten languages and 4917 cases

Background Large language models (LLMs) are increasingly used medicine for diverse applications including differential diagnostic support. The training data used to create LLMs such as the Generative Pretrained Transformer (GPT) predominantly consist of English-language texts, but LLMs could be used across the globe to support diagnostics if language barriers could be overcome. Initial pilot studies on the utility of LLMs for differential diagnosis in languages other than English have shown promise, but a large-scale assessment on the relative performance of these models in a variety of European and non-European languages on a comprehensive corpus of challenging rare-disease cases is lacking. Methods We created 4917 clinical vignettes using structured data captured with Human Phenotype Ontology (HPO) terms with the Global Alliance for Genomics and Health (GA4GH) Phenopacket Schema. These clinical vignettes span a total of 360 distinct genetic diseases with 2525 associated phenotypic features. We used translations of the Human Phenotype Ontology together with language-specific templates to generate prompts in English, Chinese, Czech, Dutch, French, German, Italian, Japanese, Spanish, and Turkish. We applied GPT-4o, version gpt-4o-2024-08-06, and the medically fine-tuned Meditron3-70B to the task of delivering a ranked differential diagnosis using a zero-shot prompt. An ontology-based approach with the Mondo disease ontology was used to map synonyms and to map disease subtypes to clinical diagnoses in order to automate evaluation of LLM responses. Findings For English, GPT-4o placed the correct diagnosis at the first rank 19.9% and within the top-3 ranks 27.0% of the time. In comparison, for the nine non-English languages tested here the correct diagnosis was placed at rank 1 between 16.9% and 20.6%, within top-3 between 25.4% and 28.6% of cases. The Meditron3 model placed the correct diagnosis within the first 3 ranks for 20.9% of cases in English and between 19.9% and 24.0% for the other nine languages. Interpretation The differential diagnostic performance of LLMs across a comprehensive corpus of rare-disease cases was largely consistent across the ten languages tested. This suggests that the utility of LLMs in clinical settings may extend to non-English clinical settings.

Artificial intelligence↗