Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “brain imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Network-level encoding of local neurotransmitters in cortical astrocytes

Abstract Astrocytes, the most abundant non-neuronal cell type in the mammalian brain, are crucial circuit components that respond to and modulate neuronal activity through calcium (Ca 2+ ) signalling 1–7 . Astrocyte Ca 2+ activity is highly heterogeneous and occurs across multiple spatiotemporal scales—from fast, subcellular activity 3,4 to slow, synchronized activity across connected astrocyte networks 8–10 —to influence many processes 5,7,11 . However, the inputs that drive astrocyte network dynamics remain unclear. Here we used ex vivo and in vivo two-photon astrocyte imaging while mimicking neuronal neurotransmitter inputs at multiple spatiotemporal scales. We find that brief, subcellular inputs of GABA and glutamate lead to widespread, long-lasting astrocyte Ca 2+ responses beyond an individual stimulated cell. Further, we find that a key subset of Ca 2+ activity—propagative activity—differentiates astrocyte network responses to these two main neurotransmitters, and may influence responses to future inputs. Together, our results demonstrate that local, transient neurotransmitter inputs are encoded by broad cortical astrocyte networks over a minutes-long time course, contributing to accumulating evidence that substantial astrocyte–neuron communication occurs across slow, network-level spatiotemporal scales 12–14 . These findings will enable future studies to investigate the link between specific astrocyte Ca 2+ activity and specific functional outputs, which could build a consistent framework for astrocytic modulation of neuronal activity.

Science & Technology - Other Topics↗

YOLO2U-Net: Detection-guided 3D instance segmentation for microscopy

Microscopy imaging techniques are instrumental for characterization and analysis of biological structures. As these techniques typically render 3D visualization of cells by stacking 2D projections, issues such as out-of-plane excitation and low resolution in the z-axis may pose challenges (even for human experts) to detect individual cells in 3D volumes as these non-overlapping cells may appear as overlapping. In this paper a comprehensive method for accurate 3D instance segmentation of cells in the brain tissue is introduced. The proposed method combines the 2D YOLO detection method with a multi-view fusion algorithm to construct a 3D localization of the cells. Next, the 3D bounding boxes along with the data volume are input to a 3D U-Net network that is designed to segment the primary cell in each 3D bounding box, and in turn, to carry out instance segmentation of cells in the entire volume. The promising performance of the proposed method is shown in comparison with current deep learning-based 3D instance segmentation methods.

3D instance segmentation↗

Neuroanatomical and cognitive correlates of visual hallucinations in Parkinson’s disease and dementia with Lewy bodies: Voxel-based morphometry and neuropsychological meta-analysis

Visual hallucinations (VH) are common in Parkinson's disease and dementia with Lewy bodies, two forms of Lewy body disease (LBD), but the neural substrates and mechanisms involved are still unclear. We conducted meta-analyses of voxel-based morphometry (VBM) and neuropsychological studies investigating the neuroanatomical and cognitive correlates of VH in LBD. For VBM (12 studies), we used Seed-based d Mapping with Permutation of Subject Images (SDM-PSI), including statistical parametric maps for 50% of the studies. For neuropsychology (35 studies), we used MetaNSUE to consider non-statistically significant unreported effects. VH were associated with smaller grey matter volume in occipital, frontal, occipitotemporal, and parietal areas (peak Hedges' g -0.34 to -0.49). In patients with Parkinson's disease without dementia, VH were associated with lower verbal immediate memory performance (Hedges' g -0.52). Both results survived correction for multiple comparisons. Here, abnormalities in these brain regions might reflect dysfunctions in brain networks sustaining visuoperceptive, attention, and executive abilities, with the latter also being at the basis of poor immediate memory performance.

60 APPLIED LIFE SCIENCES↗

PCM1 coordinates centrosome asymmetry with polarized endosome dynamics to regulate daughter cell fate

Vertebrate radial glia progenitors (RGPs) balance self-renewal and differentiation through asymmetric cell division (ACD), which involves unequal centrosome inheritance. How centrosome asymmetry directs cell fate remains poorly understood. Here, we identify Pericentriolar material 1 (Pcm1) as a key player in this process. In zebrafish embryonic RGPs, Pcm1 is asymmetrically associated with Cep83, a mother centrosome marker. Using in vivo time-lapse imaging and nanoscale-resolution expansion microscopy, we detect Pcm1 on Notch ligand-containing endosomes, where it interacts–either directly or indirectly–with Par-3 and dynein. Loss of pcm1 disrupts endosome dynamics, increasing neuronal differentiation at the expense of RGP self-renewal. Mechanistically, Pcm1 facilitates the transition from Rab5b to Rab11a and promotes the assembly of Par-3 and dynein macromolecular complexes on recycling endosomes. Furthermore, we find conserved PARD3-PCM1-CEP83-RAB11 associations in human cortical brain organoids. Our findings uncover that Pcm1 links centrosome asymmetry to polarized endosome trafficking, thereby regulating RGP fate decisions.

Cell fate and cell lineage↗

Direct observation of a dynamical glass transition in a nanomagnetic artificial Hopfield network

Spin glasses, generally defined as disordered systems with randomized competing interactions, are a widely investigated complex system. Theoretical models describing spin glasses are broadly used in other complex systems, such as those describing brain function, error-correcting codes5 or stock-market dynamics. This wide interest in spin glasses provides strong motivation to generate an artificial spin glass within the framework of artificial spin ice systems. Here we present the experimental realization of an artificial spin glass consisting of dipolar coupled single-domain Ising-type nanomagnets arranged onto an interaction network that replicates the aspects of a Hopfield neural network. Using cryogenic X-ray photoemission electron microscopy (XPEEM), we performed temperature-dependent imaging of thermally driven moment fluctuations within these networks and observed characteristic features of a two-dimensional Ising spin glass. Specifically, the temperature dependence of the spin glass correlation function follows a power-law trend predicted from theoretical models on two-dimensional spin glasses. As a result, we observe clear signatures of the hard-to-observe rugged spin glass free energy in the form of sub-aging, out-of-equilibrium autocorrelations and a transition from stable to unstable dynamics.

36 MATERIALS SCIENCE↗

MemXCT: Design, Optimization, Scaling, and Reproducibility of X-Ray Tomography Imaging

Here, this work extends our previous research entitled "MemXCT: Memory-centric X-ray CT Reconstruction with Massive Parallelization" that was originally published at SC19 conference (Hidayetoglu et al., 2019) with reproducibility of the computational imaging performance. X-ray computed tomography (XCT) is regularly used at synchrotron light sources to study the internal morphology of materials at high resolution. However, experimental constraints, such as radiation sensitivity, can result in noisy or undersampled measurements. Further, depending on the resolution, sample size and data acquisition rates, the resulting noisy dataset can be in the order of terabytes. Advanced iterative reconstruction techniques can produce high-quality images from noisy measurements, but their computational requirements have made their use an exception rather than the rule. We propose a novel memory-centric approach that avoids redundant computations at the expense of additional memory complexity. We develop a memory-centric iterative reconstruction system, MemXCT, that uses an optimized SpMV implementation with two-level pseudo-Hilbert ordering and multi-stage input buffering. We evaluate MemXCT on various supercomputer architectures involving KNL and GPU. MemXCT can reconstruct a large (11Kx11K) mouse brain tomogram in 10 seconds using 4096 KNL nodes (256K cores). The results presented in our original article at the SC19 were based on large-scale supercomputing resources. The MemXCT application was selected for the Student Cluster Competition (SCC) Reproducibility Challenge and evaluated on a variety of cloud computing resources by universities around the world in the SC20 conference. We summarize the results of the top-ranked SCC Reproducibility Challenge teams and identify the most pertinent measures for ensuring the reproducibility of our experiments in this article.

47 OTHER INSTRUMENTATION↗

Broadband Fourier-Transform Optical Photothermal Infrared Spectroscopy and Imaging

Infrared (IR) spectroscopy is a powerful method for mapping chemical heterogeneity on the microscale. Synchrotron IR radiation uniquely provides a high brightness and broad bandwidth to further extend the capabilities of IR spectroscopic imaging. However, the diffraction-limited spatial resolution of IR spectroscopy is insufficient for studies requiring submicrometer spatial differentiation. Optical photothermal IR (O-PTIR) microscopy is a powerful, emerging method that overcomes the IR diffraction limit in IR hyperspectral imaging by employing a modulated IR beam and a visible probe laser beam to detect local temperature-induced modulation at the visible diffraction limit. In this work, we extend the spectral range of photothermal infrared measurements by incorporating a synchrotron IR source, demonstrating a combined synchrotron-based O-PTIR modality that enables high spatial resolution far-field chemical imaging spanning the entire mid-IR range. Both optical- and fluorescence-detected photothermal modalities were performed using a step-scan interferometer, demonstrating improved spectral range (541-4000 cm-1) when compared to optical photothermal microscopy with commercial laser sources (800-1800 cm-1 for this particular source) and improved spatial resolution, when compared to synchrotron microspectroscopy measurements. Following these initial validation studies, synchrotron Fourier-transform fluorescence-detected photothermal IR spectroscopy in combination with synchrotron microspectroscopy measurements was used to differentiate cells in mouse brain tissue sections, which requires submicron spatial resolutions beyond those accessible by IR spectroscopy alone.

Razumtcev, Aleksandr↗

Discovering a reaction–diffusion model for Alzheimer’s disease by combining PINNs with symbolic regression

Misfolded tau proteins play a critical role in the progression and pathology of Alzheimer's disease. Recent studies suggest that the spatio-temporal pattern of misfolded tau follows a reaction-diffusion type equation. However, the precise mathematical model and parameters that characterize the progression of misfolded protein across the brain remain incompletely understood. Here, we use deep learning and artificial intelligence to discover a mathematical model for the progression of Alzheimer's disease using longitudinal tau positron emission tomography from the Alzheimer's Disease Neuroimaging Initiative database. Specifically, we integrate physics informed neural networks (PINNs) and symbolic regression to discover a reaction-diffusion type partial differential equation for tau protein misfolding and spreading. First, we demonstrate the potential of our model and parameter discovery on synthetic data. Then, we apply our method to discover the best model and parameters to explain tau imaging data from 46 individuals who are likely to develop Alzheimer's disease and 30 healthy controls. Our symbolic regression discovers different misfolding models f(c) for two groups, with a faster misfolding for the Alzheimer's group, f(c) = 0.23c 3 – 1.34c 2 + 1.11c, than for the healthy control group, f(c) = –c 3 + 0.62c 2 + 0.39c. Our results suggest that PINNs, supplemented by symbolic regression, can discover a reaction-diffusion type model to explain misfolded tau protein concentrations in Alzheimer's disease. Furthermore, we expect our study to be the starting point for a more holistic analysis to provide image-based technologies for early diagnosis, and ideally early treatment of neurodegeneration in Alzheimer's disease and possibly other misfolding-protein based neurodegenerative disorders.

60 APPLIED LIFE SCIENCES↗

Striatal dopamine synthesis and cognitive flexibility differ between hormonal contraceptive users and nonusers

In rodents and nonhuman primates, sex hormones are powerful modulators of dopamine (DA) neurotransmission. Yet less is known about hormonal regulation of the DA system in the human brain. Using positron emission tomography (PET), we address this gap by comparing hormonal contraceptive users and nonusers across multiple aspects of DA function: DA synthesis capacity via the PET radioligand 6-[ 18 F]fluoro-m-tyrosine ([ 18 F]FMT), baseline D2/3 receptor binding potential using [ 11 C]raclopride, and DA release using methylphenidate-paired [ 11 C]raclopride. Participants consisted of 36 healthy women (n = 15 hormonal contraceptive users; n = 21 naturally cycling/non users of hormonal contraception), and men (n = 20) as a comparison group. A behavioral index of cognitive flexibility was assessed prior to PET imaging. Hormonal contraceptive users exhibited greater DA synthesis capacity than NC participants, particularly in dorsal caudate, and greater cognitive flexibility. Furthermore, across individuals, the magnitude of striatal DA synthesis capacity was associated with cognitive flexibility. No group differences were observed in D2/3 receptor binding or DA release. Analyses by sex alone may obscure underlying differences in DA synthesis tied to women’s hormone status. Hormonal contraception (in the form of pill, shot, implant, ring, or intrauterine device) is used by ~400 million women worldwide, yet few studies have examined whether chronic hormonal manipulations impact basic properties of the DA system. Findings from this study begin to address this critical gap in women’s health.

59 BASIC BIOLOGICAL SCIENCES↗

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗

Connectivity‐based parcellation of normal and anatomically distorted human cerebral cortex

Abstract For over a century, neuroscientists have been working toward parcellating the human cortex into distinct neurobiological regions. Modern technologies offer many parcellation methods for healthy cortices acquired through magnetic resonance imaging. However, these methods are suboptimal for personalized neurosurgical application given that pathology and resection distort the cerebrum. We sought to overcome this problem by developing a novel connectivity‐based parcellation approach that can be applied at the single‐subject level. Utilizing normative diffusion data, we first developed a machine‐learning (ML) classifier to learn the typical structural connectivity patterns of healthy subjects. Specifically, the Glasser HCP atlas was utilized as a prior to calculate the streamline connectivity between each voxel and each parcel of the atlas. Using the resultant feature vector, we determined the parcel identity of each voxel in neurosurgical patients ( n = 40) and thereby iteratively adjusted the prior. This approach enabled us to create patient‐specific maps independent of brain shape and pathological distortion. The supervised ML classifier re‐parcellated an average of 2.65% of cortical voxels across a healthy dataset ( n = 178) and an average of 5.5% in neurosurgical patients. Our patient dataset consisted of subjects with supratentorial infiltrating gliomas operated on by the senior author who then assessed the validity and practical utility of the re‐parcellated diffusion data. We demonstrate a rapid and effective ML parcellation approach to parcellation of the human cortex during anatomical distortion. Our approach overcomes limitations of indiscriminately applying atlas‐based registration from healthy subjects by employing a voxel‐wise connectivity approach based on individual data.

59 BASIC BIOLOGICAL SCIENCES↗

Metaplastic and energy-efficient biocompatible graphene artificial synaptic transistors for enhanced accuracy neuromorphic computing

CMOS-based computing systems that employ the von Neumann architecture are relatively limited when it comes to parallel data storage and processing. In contrast, the human brain is a living computational signal processing unit that operates with extreme parallelism and energy efficiency. Although numerous neuromorphic electronic devices have emerged in the last decade, most of them are rigid or contain materials that are toxic to biological systems. In this work, we report on biocompatible bilayer graphene-based artificial synaptic transistors (BLAST) capable of mimicking synaptic behavior. The BLAST devices leverage a dry ion-selective membrane, enabling long-term potentiation, with ~50 aJ/µm 2 switching energy efficiency, at least an order of magnitude lower than previous reports on two-dimensional material-based artificial synapses. The devices show unique metaplasticity, a useful feature for generalizable deep neural networks, and we demonstrate that metaplastic BLASTs outperform ideal linear synapses in classic image classification tasks. With switching energy well below the 1 fJ energy estimated per biological synapse, the proposed devices are powerful candidates for bio-interfaced online learning, bridging the gap between artificial and biological neural networks.

97 MATHEMATICS AND COMPUTING↗

Global functional connectivity density alterations in patients with bipolar disorder with auditory verbal hallucinations and modest short‐term effects of transcranial direct current stimulation augmentation treatment—Baseline and follow‐up study

Abstract Objectives To investigate the neuroimaging characteristics of auditory verbal hallucinations (AVHs) in patients with bipolar disorder (BP) experiencing depressive episodes with and without AVHs, and alterations in those characteristics after transcranial direct current stimulation (tDCS). Methods For a baseline pilot study, we recruited 80 patients with BP and depressive status (40 with and 40 without AVHs), and 40 healthy controls (HCs). Their global functional connectivity density (gFCD) was screened by functional magnetic resonance imaging (fMRI). Voxel‐wise one‐way analysis of covariance (ANCOVA) was conducted to detect intergroup differences in gFCD. In a follow‐up study, the effects of 5 weeks of tDCS augmentation treatment on clinical symptoms and gFCD were assessed in the 40 BP patients with AVHs. Results Compared to HCs, BP patients with and without AVHs exhibited increased gFCD in the central parietal lobe, insular lobe, and middle cingulate cortex, with decreased gFCD in the posterior parietal cortex, lateral prefrontal cortex, and occipital lobe (all bilateral). Only patients with AVHs showed increased gFCD in the Broca and Wernicke regions, and decreased gFCD in the hippocampus (all bilateral). After 5 weeks of tDCS, AVHs were slightly alleviated and gFCD abnormalities in the hippocampus were mildly attenuated. Conclusions Patients with BP and AVHs showed disturbances in the brain's communication capacity mainly in the left frontoparietal network, control network, and memory circuitry. Five weeks of tDCS alleviated AVHs slightly, without improving depressive symptoms, and attenuated hippocampal gFCD alterations in these patients.

Zhuo, Chuanjun↗

OzMALDI: A Gas-Phase, In-Source Ozonolysis Reaction for Efficient Double-Bond Assignment in Mass Spectrometry Imaging with Matrix-Assisted Laser Desorption/Ionization

Lipids make up an important class of biomolecules with diverse structures and varied chemical functions. This diversity is a major challenge in chemical analysis and limits our understanding of biological functions and regulation. A major way lipid isomers differ is by double-bond (db) position, and analyzing db-isomers is especially challenging for mass spectrometry imaging (MSI). Ozonolysis can be used to determine the dbposition and has been paired with MSI before. However, previous techniques require increased analysis time to allow for gas-phase reactions within an ion trap or ion mobility cell or additional sample preparation time to allow for offline ozonation. Here, we introduce a new ozonolysis method inside the matrix-assisted laser desorption-ionization (MALDI) source, termed OzMALDI, that simultaneously produces ozonides from all unsaturated lipids. This allows us to determine db-positions without adding additional reaction time while maintaining the high mass resolution provided by Orbitrap MS. This new technique is especially effective at determining multiple db-positions in lipids containing polyunsaturated fatty acids, which is a limitation of many previous techniques. OzMALDI-MSI was applied to the analysis of rat brain and genetically engineered Camelina and soybean seed samples, demonstrating the utility of this method and uncovering novel biological information.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Shape‐Dependent Multi‐Weight Magnetic Artificial Synapses for Neuromorphic Computing

Abstract In neuromorphic computing, artificial synapses provide a multi‐weight (MW) conductance state that is set based on inputs from neurons, analogous to the brain. Herein, artificial synapses based on magnetic materials that use a magnetic tunnel junction (MTJ) and a magnetic domain wall (DW) are explored. By fabricating lithographic notches in a DW track underneath a single MTJ, 3–5 stable resistance states that can be repeatably controlled electrically using spin‐orbit torque are achieved. The effect of geometry on the synapse behavior is explored, showing that a trapezoidal device has asymmetric weight updates with high controllability, while a rectangular device has higher stochasticity, but with stable resistance levels. The device data is input into neuromorphic computing simulators to show the usefulness of application‐specific synaptic functions. Implementing an artificial neural network (NN) applied to streamed Fashion‐MNIST data, the trapezoidal magnetic synapse can be used as a metaplastic function for efficient online learning. Implementing a convolutional NN for CIFAR‐100 image recognition, the rectangular magnetic synapse achieves near‐ideal inference accuracy, due to the stability of its resistance levels. This work shows MW magnetic synapses are a feasible technology for neuromorphic computing and provides design guidelines for emerging artificial synapse technologies.

Leonard, Thomas↗

Experimental and Computational Evaluation of Lipidomic In-Source Fragmentation as a Result of Postionization with Matrix-Assisted Laser Desorption/Ionization

Matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI-MSI) can provide spatially resolved molecular information about a sample. Recently, a postionization approach (MALDI-2) has been commercially integrated with MALDI-MSI, allowing for bettered sensitivity and consequent improved spatial resolution. While advantages of MALDI-2 have previously been established, we demonstrate here statistically increased in-source fragmentation (ISF) results from postionization with a commercial instrument. Via lipid standard analyses, known MALDI ISF pathways (e.g., loss of trimethylamine) were statistically increased in MALDI-2 compared to MALDI-1 (65–172% increase in fragmentation). Gas phase molecular modeling with density functional theory estimated that the most-weighted virtual orbitals to excite within lipids involve ester and phosphate bonds. Protonated lipid excitation energies are furthermore red-shifted compared to those of other adduct types [e.g., 254 nm for protonated PC(16:0/18:1)] and approach the MALDI-2 laser energy (266 nm). Analysis of rat brain homogenate detected statistically more positive-ion mode peaks with MALDI-2 (1090) than that with MALDI-1 (719), where Kernel density estimations showed that the majority of this enhancement occurs with low m/z ions (i.e., m/z 75–500). Taken together with the lipid standard data, these observations may indicate ISF due to postionization. Finally, while artifact contributions from matrix blanks were also noted, both experimental and computational data sets suggest that the overall extent of ISF is statistically increased in MALDI-2 compared to MALDI-1.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Heterotrimeric G‐protein, Gi1, is involved in the regulation of proliferation, neuronal migration, and dendrite morphology during cortical development in vivo

Abstract Heterotrimeric G‐proteins are composed of α, β, and γ subunits, and function as signal transducers. Critical roles of the α‐subunits of Gi/o family heterotrimeric G‐proteins, Gαi2, and Gαo1, have so far been reported in brain development and neurodevelopmental disorders. In this study, we tried to clarify the role of Gαi1, α‐subunit of another Gi/o family member Gi1, during corticogenesis, based on the recent identification of its gene abnormalities in neurodevelopmental disorders. In western blot analyses, Gαi1 was found to be expressed in mouse brain in a developmental stage‐dependent manner. Morphological analyses revealed that Gαi1 was broadly distributed in cerebral cortex with relatively high expression in the ventricular zone (VZ) at embryonic day (E) 14. Meanwhile, Gαi1 was enriched in membrane area of yet unidentified early mitotic cells in the VZ and the marginal zone at E14. Acute knockdown of Gαi1 with in utero electroporation in cerebral cortex caused cell cycle elongation of the neural progenitor cells and promoted their cell cycle exit. Gαi1‐deficient cortical neurons also exhibited delayed radial migration during corticogenesis, with abnormally elongated leading processes and hampered nucleokinesis. In addition, silencing of Gαi1 prevented basal dendrite development. The migration and dendritic phenotypes were at least partially rescued by an RNAi‐resistant version of Gαi1. Collectively, these results strongly suggest a crucial role of Gi1 in cortical development, and disturbance of its function may cause deficits in synaptic network formation, leading to neurodevelopmental disorders. image

Hamada, Nanako↗

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

Models that predict brain responses to stimuli provide one measure of understanding of a sensory system and have many potential applications in science and engineering. Deep artificial neural networks have emerged as the leading such predictive models of the visual system but are less explored in audition. Prior work provided examples of audio-trained neural networks that produced good predictions of auditory cortical fMRI responses and exhibited correspondence between model stages and brain regions, but left it unclear whether these results generalize to other neural network models and, thus, how to further improve models in this domain. We evaluated model-brain correspondence for publicly available audio neural network models along with in-house models trained on 4 different tasks. Most tested models outpredicted standard spectromporal filter-bank models of auditory cortex and exhibited systematic model-brain correspondence: Middle stages best predicted primary auditory cortex, while deep stages best predicted non-primary cortex. However, some state-of-the-art models produced substantially worse brain predictions. Models trained to recognize speech in background noise produced better brain predictions than models trained to recognize speech in quiet, potentially because hearing in noise imposes constraints on biological auditory representations. The training task influenced the prediction quality for specific cortical tuning properties, with best overall predictions resulting from models trained on multiple tasks. The results generally support the promise of deep neural networks as models of audition, though they also indicate that current models do not explain auditory cortical responses in their entirety.

59 BASIC BIOLOGICAL SCIENCES↗