Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visual Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Composition and in situ structure of the Methanospirillum hungatei cell envelope and surface layer

Archaea share genomic similarities with Eukarya and cellular architectural similarities with Bacteria, though archaeal and bacterial surface layers (S-layers) differ. Using cellular cryo–electron tomography, we visualized the S-layer lattice surroundingMethanospirillum hungatei, a methanogenic archaeon. Though more compact than known structures,M. hungatei’s S-layer is a flexible hexagonal lattice of dome-shaped tiles, uniformly spaced from both the overlying cell sheath and the underlying cell membrane. Subtomogram averaging resolved the S-layer hexamer tile at 6.4-angstrom resolution. By fitting an AlphaFold model into hexamer tiles in flat and curved conformations, we uncover intra- and intertile interactions that contribute to the S-layer’s cylindrical and flexible architecture, along with a spacer extension for cell membrane attachment.M. hungateicell’s end plug structure, likely composed of S-layer isoforms, further highlights the uniqueness of this archaeal cell. These structural features offer advantages for methane release and reflect divergent evolutionary adaptations to environmental pressures during early microbial emergence.

Science & Technology - Other Topics↗
DOE OSTI2021

Online Monitoring System for Concrete Structures Affected by Alkali-Silica Reaction

This report presents a comprehensive study of developing ultrasonic wave and acoustic emission (AE) techniques for long-term monitoring of alkali-silica reaction (ASR) development in concrete. Small, medium, and full-scale concrete specimens were cast, conditioned, and monitored for various periods, from at least one year to 2.4 years. The reactive concrete specimens contain coarse or fine reactive aggregates to study the effects of different types of reactive aggregates. Confinements were also designed to simulate the 2-dimensional confinement effects of reinforcement in the shield building of nuclear power plants. The concrete specimens were stored in a environmental chamber with high humidity and high temperature to accelerate the ASR development. The ultrasonic monitoring data shows high sensitivity to ASR development and could detect cracking initiation well before visible surface cracks occurred. However, the linear ultrasonic analysis based on wave velocity is strongly affected by temperature variation. Therefore, a nonlinear ultrasonic method was proposed to measure thermally induced nonlinear acoustic responses of concrete (thermal modulation of ultrasonic wave). The measured nonlinear acoustic parameter shows a high correlation with ASR expansion across specimens with different reactive aggregates and confinement conditions. The same conclusion was obtained from nonlinear resonance tests on small concrete prisms. Compared to the linear acoustic methods, the nonlinear tests show high sensitivities to ASR damage from internal microcracking initiation at the early stage to visible cracks at the late stage of ASR. The attributes of the thermal modulation of nonlinear ultrasonic method include high sensitivity, immunity to temperature effects, and strong correlation with ASR expansion, which demonstrate great potentials of the nonlinear ultrasonic method for diagnosis of ASR damage and prediction of concrete deterioration process. Acoustic emission is a passive sensing technique for damage assessment, and access to only one surface is needed even for thick and heavily reinforced elements such as the walls utilized for nuclear shield building. Additionally, relatively few sensors are required to monitor the progression of the damage process. Results indicate that the AE data can be related to the damage rating index, which is a petrography-based means of assessing damage due to ASR in reinforced concrete. Furthermore, AE is capable of detecting ASR damage long before surface cracking is visually noticeable. Boundary conditions play in important role in the progression of ASR damage and differences in boundary conditions are reflected in the AE data. Entropy based data assessment methods provide a means to assess the damage state, and convolutional neural network based data assessment provided a means to assess the damage state in real-time. Results indicate that artificial neural network models may be used as a means to predict volumetric expansion based on AE data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

2D IR Microscopy—Technology for Visualizing Chemical Dynamics in Heterogeneous Environments (Final Technical Report)

The primary focus of this project was the design, prototype, and demonstration of a 2D IR microscope. The start date of this project was July 15, 2016 and the project end date was July 14, 2022. In the early years of this project our team designed, prototyped, and completely integrated a homebuilt microscope head with our high-repetition rate 2D IR spectrometer. Once in place our research team focused on characterizing the 2D IR microscope and using it to investigate model systems relevant to energy technologies. As part of this process, we identified two initial chemical systems to use to further develop 2D IR imaging modalities. The first chemical system developed was a room temperature ionic liquid (RTIL) electrolyte system and the second chemical system was a mixture of carbonates and salts developed as a battery electrolyte system. The completion of this project resulted in the full characterization of chemical dynamics in a bulk RTIL system and the demonstration of 2D IR imaging across the RTIL cast as a microdroplet in silicon oil. In addition, we explored the liquid structures and dynamics of organic carbonate mixtures from the vantage point of the vibrational probe, methyl thiocyanate. By the end of the project, we had moved toward in-depth studies of the organic carbonate mixtures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

An Applied Strategy for Using Empirical and Hybrid Models in Online Monitoring

The monitoring of plant equipment for failure prediction is one of the key contributors to operation and maintenance (O&M) costs for a nuclear power plant (NPP) because O&M monitoring depends on labor-intensive activities that are required to meet high equipment reliability standards. These activities rely primarily on humans for information gathering, condition diagnosis, and predictive analysis. Online monitoring aims to automate these activities by relying on sensors to replace human information gathering and machine learning to replace human analysis and decision making. To facilitate automated monitoring, a systematic strategy for anomaly detection is needed to optimally use the available sensor data, empirical models, and physics-supported models. This strategy is essential to provide credible reasoning on why and when an empirical (i.e., purely data-driven) versus hybrid (i.e., physics-supported) approach should be used and to determine the ideal mix of these two approaches for a defined anomaly detection scope. The extant methods usually adopt an ad hoc trial-and-error approach that, in addition to being time-consuming and costly, is also highly subjective; it is impacted by the background and the skill set of the personnel making the decisions. Thus, such an approach cannot guarantee an optimum outcome. This represents the motivation of the current research effort, which is focused on devising a scientifically supported strategy for the optimum selection of anomaly detection methods. This report presents a detailed assessment of the main anomaly detection techniques within the empirical or hybrid method streams. Empirical methods include pattern, statistical, and causal inference. Hybrid methods include the use of physics models to train and test data methods, reduce data dimensionality, reduce data-model complexity, augment data, and reduce empirical uncertainty; hybrid methods also include the use of data to tune physics models. The listed techniques within these two streams represent the vast majority of techniques performed for anomaly detection. Using the techniques as outcomes, a strategy was developed to enable a systematic decision-making process to lead to one of these techniques. The strategy is driven by key decision points related to data relevance, simple modeling feasibility, data inference, physics-modeling value, data dimensionality, physics knowledge, method of validation, performance, data availability and suitability for training and testing, cause-effect, entropy inference, and model fitting. Each of these decision points in the strategy is explained in detail in this report with examples, along with the scientific basis behind the decisions and outcomes in common and simplified terminology. The strategy is developed for use by any NPP staff with basic engineering or science knowledge. A user-friendly graphical state flow diagram was also developed as a visual presentation of the strategy. The strategy was tested and demonstrated through two pilot projects for the application of anomaly detection at an NPP. Each pilot had two use cases: an initial case in which certain decisions were made that resulted in one or more empirical techniques and a revised use case where one or more key decisions were modified resulting in using a set of hybrid methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Visualizing electronic structure of twisted bilayer MoTe 2 in devices

The pursuit of emergent quantum phenomena lies at the forefront of modern condensed matter physics. A recent breakthrough in this arena is the discovery of the fractional quantum anomalous Hall effect (FQAHE) in twisted bilayer MoTe₂ (tbMoTe₂), marking a paradigm shift and establishing a versatile platform for exploring the intricate interplay among topology, magnetism, and electron correlations. While significant progress has been made through both optical and electrical transport measurements, direct experimental insights into the electronic structure – crucial for understanding and modeling this system – have remained elusive. Here, using spatially and angle-resolved photoemission spectroscopy (μ-ARPES), we directly map the electronic band structure of tbMoTe₂. We identify the valence band maximum, whose partial filling underlies the FQAHE, at the K points, situated approximately 150 meV above the Γ valley. By fine-tuning the doping level via in-situ alkali metal deposition, we also resolve the conduction band minimum at the K point, providing direct evidence that tbMoTe₂ exhibits a direct band gap – distinct from all previously known moiré bilayer transition metal dichalcogenide systems. These results offer critical insights for theoretical modeling and advance our understanding of fractionalized excitations and correlated topological phases in this emergent quantum material.

Chen, Cheng [Univ. of Oxford (United Kingdom)]↗
DOE OSTI2023

Experimental and numerical investigation of proppant embedment and conductivity reduction within a fracture in the Caney Shale, Southern Oklahoma, USA

The current worldwide energy supply is insufficient to meet the rising demand. As a result, the energy prices are expected to keep soaring despite the recent increases in a variety of renewable energy resources. Although not renewable, shale oil and gas — “unconventional” hydrocarbon resources are relatively clean forms of energy resources, which still hold a vast share of the energy market. For many oil and gas companies, meeting profitable production goals from shale reservoirs is sometimes challenging, due to the loss of fracture conductivity and premature declines in the production. In this paper we investigate the stress-dependent changes in the hydraulic conductivity of proppant-filled fractures and mechanical fracture–proppant interactions in Caney Shale, a calcareous, organic-rich mudrock, through laboratory experiments and numerical modeling. American Petroleum Institute (API) fracture conductivity tests were conducted using 2% KCl on five locations within the Caney Shale that consisted of selecting three brittle (reservoir) zones and two ductile zones. Confining pressures ranged from 1,000 psi to 12,000 psi at 210 °F. Conductivity, permeability as well as embedment were measured during the test. Also, an additional, laboratory in-situ visualization test was conducted to examine the detailed proppant-shale matrix interaction under elevated stress (3,920 psi effective stress) and temperature (252 °F), with a synthetic reservoir fluid. Our experimental results have confirmed that improved fracture conductivity is attributed to proppant size, and that the increase in porosity of the proppant pack, closure pressure changes and the reduction in fracture conductivity are a function of many factors such as fracture closure stress.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2026

Evaluating Supply Prioritization Strategies for Risk-Informed Decision Making in an Arbitrary Gas Network

Supply disruptions and infrastructure failures in natural gas networks present critical challenges to energy reliability and risk-informed planning. This study evaluates two supply prioritization strategies, Maximum Delivery Prioritization (MDP) and Demand-Based Prioritization (DBP), within an arbitrary natural gas network under conditions of supply shortage. Model performance under both strategies is assessed in response to node and edge failure using demand satisfaction metrics, system-wide and localized dependency scores, and geographic information system (GIS)-based spatial analysis. Results show that DBP better preserves supply for high-demand nodes, while MDP offers broader coverage. The underlying network topology plays a critical role in shaping prioritization outcomes. Integrated GIS visualization enhances the interpretability of vulnerability assessments, revealing structurally critical components and localized vulnerabilities. The proposed framework supports scalable, data-driven decision-making for infrastructure planners and engineers, enabling improved disruption recovery and efficiency in constrained natural gas networks. These insights contribute to the development of more robust energy systems capable of withstanding stress and disruptions.

Peterson, Steven [ORNL] (ORCID:0000000287672998)↗
DOE OSTI2021

Ion correlations drive charge overscreening and heterogeneous nucleation at solid–aqueous electrolyte interfaces

Significance Ion distributions at charged solid–water interfaces, referred to as the electrical double layer (EDL), are poorly understood at high ion concentrations, in part due to the lack of molecular-scale descriptions of the interactions between adsorbed hydrated ions. Here, direct visualization of the salinity-dependent evolution of EDL structure reveals molecular origins of nonclassical transformation of the EDL, in which charge overscreening and heterogeneous nucleation are driven by ion–ion correlations at the interfaces. This manifestation of the atomistic basis of nonclassical behaviors provides a much-needed understanding of the impact of ion cooperativity at charged interfaces for the development of predictive models for element transport in natural environments and advanced technologies for material growth and synthesis in saline environments.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Imaging plant metabolism in situ

Abstract Mass spectrometry imaging (MSI) has emerged as an invaluable analytical technique for investigating the spatial distribution of molecules within biological systems. In the realm of plant science, MSI is increasingly employed to explore metabolic processes across a wide array of plant tissues, including those in leaves, fruits, stems, roots, and seeds, spanning various plant systems such as model species, staple and energy crops, and medicinal plants. By generating spatial maps of metabolites, MSI has elucidated the distribution patterns of diverse metabolites and phytochemicals, encompassing lipids, carbohydrates, amino acids, organic acids, phenolics, terpenes, alkaloids, vitamins, pigments, and others, thereby providing insights into their metabolic pathways and functional roles. In this review, we present recent MSI studies that demonstrate the advances made in visualizing the plant spatial metabolome. Moreover, we emphasize the technical progress that enhances the identification and interpretation of spatial metabolite maps. Within a mere decade since the inception of plant MSI studies, this robust technology is poised to continue as a vital tool for tackling complex challenges in plant metabolism.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Exploring Explicit Uncertainty for Binary Analysis (EUBA)

Reverse engineering (RE) analysts struggle to address critical questions about the safety of binary code accurately and promptly, and their supporting program analysis tools are simply wrong sometimes. The analysis tools have to approximate in order to provide any information at all, but this means that they introduce uncertainty into their results. And those uncertainties chain from analysis to analysis. We hypothesize that exposing sources, impacts, and control of uncertainty to human binary analysts will allow the analysts to approach their hardest problems with high-powered analytic techniques that they know when to trust. Combining expertise in binary analysis algorithms, human cognition, uncertainty quantification, verification and validation, and visualization, we pursue research that should benefit binary software analysis efforts across the board. We find a strong analogy between RE and exploratory data analysis (EDA); we begin to characterize sources and types of uncertainty found in practice in RE (both in the process and in supporting analyses); we explore a domain-specific focus on uncertainty in pointer analysis, showing that more precise models do help analysts answer small information flow questions faster and more accurately; and we test a general population with domain-general sudoku problems, showing that adding "knobs" to an analysis does not significantly slow down performance. This document describes our explorations in uncertainty in binary analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Triton Field Trials - Changes in Habitats, a Literature Review of Monitoring Technologies

Marine energy devices are installed in highly dynamic environments and have the potential to affect benthic and pelagic habitats around them. Regulatory bodies often require baseline characterization and/or post-installation monitoring to determine whether changes in these habitats are being observed. However, a great diversity of technologies is available for surveying and sampling marine habitats. Selecting the most suitable instrument to identify and measure changes in habitats at marine energy sites can become a daunting task. We conducted a thorough review of journal articles, survey reports, and grey literature to extract information about the technologies used, the data collection and processing methods, and the performance and effectiveness of these instruments. We examined documents related to marine energy development, offshore wind farms, oil and gas offshore sites, and other marine industries around the world over the last 20 years, as well as national and international guidelines for surveying habitats around offshore activities. A total of 120 different technologies were identified across six main habitat categories: seafloor, sediment, infauna, epifauna, pelagic, and biofouling. The technologies were organized into 12 broad technology classes: acoustic, corer, dredge, grab, hook and line, net and trawl, plate, remote sensing, scrape samples, trap, visual, and others. Visual was the most common and the most diverse technology class, with applications across all six habitat categories. Sampling designs varied considerably among the reviewed studies but transect was the predominant design for surveying seafloor, epifauna, and pelagic habitats. The most common data analyses were univariate and multivariate statistical analyses aimed at calculating and comparing biodiversity indices, characterizing faunal assemblages or sediment classes, or modeling the distribution of animals related to abiotic parameters. Technologies and sampling methods adaptable and designed to work efficiently in energetic environments have greater success at marine energy sites. In addition, sampling designs and statistical analyses should be carefully thought through to identify differences in faunal assemblages and spatiotemporal changes in habitats.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

WELLBASE - An Interactive Platform for Wellbore Material Assessment

This project seeks to build an open-source wellbore material data repository with adequate material performance and contextual data to support Geological Carbon Storage (GCS). By appropriately evaluating the data types as mentioned earlier made available by the WELLBASE tool, stakeholders can make more informed decisions regarding well selections, risk assessment, and economic analysis for geologic carbon storage projects. Advanced Natural Language Processing models and other custom python scripts will be deployed in an automated process to extract unstructured data from documents, reports, and web applications and subsequently parse to more usable formats. The processed data will then be integrated into a robust and comprehensive database architecture, optimizing data accessibility, and usability for analytical purposes. The final data products will be accessible through a user-friendly visualization platform that will allow users to query and visualize the data, as well as download data in usable formats.

Tetteh, Daniel A.↗
DOE OSTI2020

Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization

In an in transit setting, a parallel data producer, such as a numerical simulation, runs on one set of ranks M, while a data consumer, such as a parallel visualization application, runs on a different set of ranks N. One of the central challenges in this in transit setting is to determine the mapping of data from the set of M producer ranks to the set of N consumer ranks. This is a challenging problem for several reasons, such as the producer and consumer codes potentially having different scaling characteristics and different data models. The resulting mapping from M to N ranks can have a significant impact on aggregate application performance. In this work, we present an approach for performing this M-to-N mapping in a way that has broad applicability across a diversity of data producer and consumer applications. We evaluate its design and performance with a study that runs at high concurrency on a modern HPC platform. By leveraging design characteristics, which facilitate an “intelligent” mapping from M-to-N, we observe significant performance gains are possible in terms of several different metrics, including time-to-solution and amount of data moved.

Loring, Burlen↗
DOE OSTI2020

Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization

In an in transit setting, a parallel data producer, such as a numerical simulation, runs on one set of ranks M, while a data consumer, such as a parallel visualization application, runs on a different set of ranks N: One of the central challenges in this in transit setting is to determine the mapping of data from the set of M producer ranks to the set of N consumer ranks. This is a challenging problem for several reasons, such as the producer and consumer codes potentially having different scaling characteristics and different data models. The resulting mapping from M to N ranks can have a significant impact on aggregate application performance. In this work, we present an approach for performing this M-to-N mapping in a way that has broad applicability across a diversity of data producer and consumer applications. We evaluate its design and performance with a study that runs at high concurrency on a modern HPC platform. By leveraging design characteristics, which facilitate an ''intelligent'' mapping from M-to-N, we observe significant performance gains are possible in terms of several different metrics, including time-to-solution and amount of data moved.

Loring, Burlen↗
DOE OSTI2023

Wassersplines for Neural Vector Field-Controlled Animation

Much of computer-generated animation is created by manipulating meshes with rigs. While this approach works well for animating articulated objects like animals, it has limited flexibility for animating less structured free-form objects. Here we introduce Wassersplines, a novel trajectory inference method for animating unstructured densities based on recent advances in continuous normalizing flows and optimal transport. The key idea is to train a neurally-parameterized velocity field that represents the motion between keyframes. Trajectories are then computed by advecting keyframes through the velocity field. We solve an additional Wasserstein barycenter interpolation problem to guarantee strict adherence to keyframes. Our tool can stylize trajectories through a variety of PDE-based regularizers to create different visual effects. We demonstrate our tool on various keyframe interpolation problems to produce temporally-coherent animations without meshing or rigging.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Securing Grid-interactive Efficient Buildings (GEB) through Cyber Defense and Resilient System (CYDRES)

The DOE CYDRES project is driven by the urgent need to address critical research gaps in the domain of cyber-physical security of smart buildings, including Grid-interactive Efficient Buildings (GEBs). CYDRES, a real-time advanced building resilient platform, aims to enhance the cyber-attack-immune capabilities of buildings through multi-layered prevention, detection, and adaptation mechanisms. CYDRES consists of five key modules: a multi-layer network analyzer, an Automatic Fault Detection, Diagnosis, and Prognosis (AFDDP) framework, an intelligent mode selector, a cyber-resilient control framework, and a situation awareness platform. The Network Analyzer employs a data-driven framework that includes a protocol state learning tool and a CRF (Conditional Random Field) command validator. In Hardware-In-the-Loop (HIL) testbeds, it achieved 100% detection accuracy with a false alarm rate of 3%, validating its efficacy in identifying selected cyber-attacks. The AFDDP framework leverages pattern matching, PCA (Principal Component Analysis)-based strategies, and a DBN (Dynamic Bayesian Network)-based fault diagnosis approach to pinpoint the causes of physical system abnormalities using Building Automation System (BAS) data. In HIL experiments, the AFDDP module attained a detection accuracy of over 95% with a false alarm rate below 7%. Additionally, the fault detector utilized machine learning (Random Forest) and deep learning (Multi-Layer Perceptron) methods with acoustic sensor data to achieve a 100% fault detection accuracy in Heating, Ventilation, and Air-Conditioning (HVAC) equipment. The Mode Selector offered real-time impact analysis, allowing immediate actions to protect BASs in the face of emerging threats. The cyber-resilient control framework included an adaptive Model Predictive Control (MPC) and a measurement compensator, reducing temperature violations by up to 94% and improving the total demand flexibility by up to 70% in HIL experiments. Such HIL experiments covered a cyber-attack case and a physical fault case, showcasing CYDRES’ efficiency in maintaining operational continuity during threats. The situation awareness platform in Grafana enhanced real-time threat detection and response visualization, augmenting the operational awareness for building operators. CYDRES demonstrated high technical effectiveness in various test scenarios, particularly in HIL environments. The project's phased development approach ensured efficient use of resources, highlighting its practical feasibility and readiness for commercialization. By enhancing the security and resilience of building operations, CYDRES represents a significant advance in mitigating risks associated with cyber-physical systems, thereby enhancing public confidence in the safety of modern building infrastructure. Future directions for the project include expanding testing protocols, refining AFDDP methodologies, exploring more comprehensive resilient control strategies, and testing in real commercial buildings.

42 ENGINEERING↗
DOE OSTI2023

Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .

Chen, Xiaoyi↗