Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neuronal network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Two-dimensional materials for bio-realistic neuronal computing networks

Two-dimensional (2D) van der Waals materials have found broad utility in a diverse range of applications including electronics, optoelectronics, renewable energy, and quantum information technologies. Meanwhile, exponentially growing digital data coupled with the ubiquity of artificial intelligence algorithms have generated significant interest in edge neuromorphic computing as an alternative to centralized cloud computing. The drive to incorporate neuroscience principles into computing hardware is motivated by the low power consumption, parallel processing, and reconfigurability of the human brain. The diverse library of 2D materials with atomic-level thicknesses, exceptional electrostatic tunability, and integration versatility is particularly well-suited for realizing bio-realistic synaptic and neuronal functionality. Here, we summarize past and present work in this field and outline the frontier challenges that have not yet been overcome. Here we also delineate potential solutions and suggest that the neuroscience principles of criticality and synchrony have the potential to inspire breakthrough applications of 2D materials in neuronal computing networks.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Structural differences between human and mouse neurons and their implementation in generative AIs

Mouse and human brains have different functions that depend on their neuronal networks. We analyzed nanometer-scale three-dimensional structures of brain tissues of the mouse medial prefrontal cortex and compared them with structures of the human anterior cingulate cortex. The obtained results indicated that mouse neuronal somata are smaller and neurites are thinner than those of human neurons. We implemented these characteristics of mouse neurons in convolutional layers of a generative adversarial network (GAN) and a denoising diffusion implicit model (DDIM), which were then subjected to image generation tasks using photo datasets of cat faces, cheese, human faces, birds, and automobiles. The mouse-mimetic GAN outperformed a standard GAN in the image generation task using the cat faces and cheese photo datasets, but underperformed for human faces and birds. The mouse-mimetic DDIM gave similar results, suggesting that the nature of the datasets affected the results. Analyses of the five datasets indicated differences in their image entropy, which should influence the number of parameters required for image generation. The preferences of the mouse-mimetic AIs coincided with the impressions commonly associated with mice. The relationship between the neuronal network and brain function should be investigated by implementing other biological findings in artificial neural networks.

generative AI↗
DOE OSTI2021

Structural diverseness of neurons between brain areas and between cases

The cerebral cortex is composed of multiple cortical areas that exert a wide variety of brain functions. Although human brain neurons are genetically and areally mosaic, the three-dimensional structural differences between neurons in different brain areas or between the neurons of different individuals have not been delineated. Here we report a nanometer-scale geometric analysis of brain tissues of the superior temporal gyrus of schizophrenia and control cases. The results of the analysis and a comparison with results for the anterior cingulate cortex indicated that (1) neuron structures are significantly dissimilar between brain areas and that (2) the dissimilarity varies from case to case. The structural diverseness was mainly observed in terms of the neurite curvature that inversely correlates with the diameters of the neurites and spines. The analysis also revealed the geometric differences between the neurons of the schizophrenia and control cases. The schizophrenia cases showed a thin and tortuous neuronal network compared with the controls, suggesting that the neuron structure is associated with the disorder. The area dependency of the neuron structure and its diverseness between individuals should represent the individuality of brain functions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Ultra-Sharp Nanowire Arrays Natively Permeate, Record, and Stimulate Intracellular Activity in Neuronal and Cardiac Networks

Intracellular access with high spatiotemporal resolution can enhance the understanding of how neurons or cardiomyocytes regulate and orchestrate network activity and how this activity can be affected with pharmacology or other interventional modalities. Nanoscale devices often employ electroporation to transiently permeate the cell membrane and record intracellular potentials, which tend to decrease rapidly with time. Here, one reports innovative scalable, vertical, ultrasharp nanowire arrays that are individually addressable to enable long-term, native recordings of intracellular potentials. One reports electrophysiological recordings that are indicative of intracellular access from 3D tissue-like networks of neurons and cardiomyocytes across recording days and that do not decrease to extracellular amplitudes for the duration of the recording of several minutes. The findings are validated with cross-sectional microscopy, pharmacology, and electrical interventions. The experiments and simulations demonstrate that the individual electrical addressability of nanowires is necessary for high-fidelity intracellular electrophysiological recordings. This work advances the understanding of and control over high-quality multichannel intracellular recordings and paves the way toward predictive, high-throughput, and low-cost electrophysiological drug screening platforms.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Mean Field Theory of Self‐Organizing Memristive Connectomes

Abstract Biological neuronal networks are characterized by nonlinear interactions and complex connectivity. Given the growing impetus to build neuromorphic computers, understanding physical devices that exhibit structures and functionalities similar to biological neural networks is an important step toward this goal. Self‐organizing circuits of nanodevices are at the forefront of the research in neuromorphic computing, as their behavior mimics synaptic plasticity features of biological neuronal circuits. However, an effective theory to describe their behavior is lacking. This study provides for the first time an effective mean field theory for the emergent voltage‐induced polymorphism of circuits of a nanowire connectome, showing that the behavior of these circuits can be explained by a low‐dimensional dynamical equation. The equation can be derived from the microscopic dynamics of a single memristive junction in analytical form. The effective model is tested on experiments of nanowire networks and show that it fits both the potentiation and depression of these synapse‐mimicking circuits. It is shown that this theory applies beyond the case of nanowire networks by formulating a general mean‐field theory of conductance transitions in self‐organizing memristive connectomes.

Caravelli, Francesco↗
DOE OSTI2022

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Black Swan Event Small-Sample Transfer Learning (BEST-L) and its Case Study on Electrical Power Prediction in COVID-19

The black swan event will usually cause a great impact on the normal operation of society. The scarcity of such events leads to a lack of relevant data and challenges in dealing with related problems. Different situations also make the traditional methods invalid. In this paper, a transfer learning framework and a convolutional neuron network are proposed to deal with the black swan small-sample events (BEST-L). Taking the COVID-19 as a typical black swan event, the BEST-L is utilized to achieve accurate mid-term load forecasting using the relationship between economy and electricity consumption. The experiment results show that the transfer learning model can effectively learn the basic knowledge about the relationship between the adopted input and output data and use a relatively small amount of data during the black swan event to improve the target areas' generalization. The approach and results can provide an effective approach to respond and react to sudden changes quickly and effectively in similar open problems.

black swan event↗
DOE OSTI2025

Plasma phosphorylated tau217 strongly associates with memory deficits in the Alzheimer’s disease spectrum

Abstract Plasma phosphorylated tau (p-tau) biomarkers open unprecedented opportunities for identifying carriers of Alzheimer’s disease pathophysiology in early disease stages using minimally invasive techniques. Plasma p-tau biomarkers are believed to reflect tau phosphorylation and secretion. However, it remains unclear to what extent the magnitude of plasma p-tau abnormalities reflects neuronal network disturbance in the form of cognitive impairment. To address this question, we included 103 cognitively unimpaired elderly and 40 cognitively impaired, amyloid-β-positive individuals from the TRIAD cohort, in addition to 336 cognitively unimpaired and 216 cognitively impaired, amyloid-β-positive older adults from the BioFINDER-2 cohort. Participants had tau PET scans, amyloid PET scans or amyloid CSF, p-tau217, p-tau181 and p-tau231 blood measures, structural T1-MRI and cognitive assessments. In this cross-sectional study, we used regression models and correlation analyses to assess the relationship between plasma biomarkers and cognitive scores. Furthermore, we applied receiver operating characteristic curves to assess cognitive impairment across plasma biomarkers. Finally, we categorized participants into amyloid (A), p-tau (T1) and tau PET (T2) positive (+) or negative (−) profiles and ran non-parametric comparisons to assess differences across cognitive domains. We found that plasma p-tau217 was more associated with cognitive performance than p-tau181 and p-tau231 and that this relationship was particularly strong for memory scores (TRIAD: βp-tau217 = −0.53, βp-tau181 = −0.35 and βp-tau231 = −0.24; BioFINDER-2: βp-tau217 = −0.52, βp-tau181 = −0.24 and βp-tau231 = −0.29). Associations in amyloid-β-positive participants resembled these results, but other cognitive scores also showed strong associations in cognitively impaired individuals. Moreover, plasma p-tau217 outperformed plasma p-tau181 and plasma p-tau231 in identifying memory impairment (area under the curve values for TRIAD: p-tau217 = 0.86, p-tau181 = 0.77 and p-tau231 = 0.75; and for BioFINDER-2: p-tau217 = 0.86, p-tau181 = 0.76 and p-tau231 = 0.81) and in identifying executive function impairment only in the BioFINDER-2 cohort (p-tau217 = 0.82, p-tau181 = 0.76 and p-tau231 = 0.76). Lastly, we showed that subtle memory deficits were present in A+T1+T2− participants for plasma p-tau217 (P = 0.007) and plasma p-tau181 (P = 0.01) in the TRIAD cohort and for all biomarkers across cognitive domains in A+T1+T2− and A+T1+T2− individuals (P < 0.001 in all) in the BioFINDER-2 cohort. The A+T1+T2− individuals showed cognitive deficits in both cohorts (P < 0.001 in all). Together, our results suggest that plasma p-tau217 stands out as a biomarker capable of identifying memory deficits attributable to Alzheimer’s disease and that memory impairment certainly occurs in amyloid-β- and plasma p-tau-positive individuals who have no significant amounts of tau in the neocortex.

Neurosciences & Neurology↗
DOE OSTI2022

Integrating Data From In Vitro New Approach Methodologies for Developmental Neurotoxicity

Abstract In vivo developmental neurotoxicity (DNT) testing is resource intensive and lacks information on cellular processes affected by chemicals. To address this, DNT new approach methodologies (NAMs) are being evaluated, including: the microelectrode array neuronal network formation assay; and high-content imaging to evaluate proliferation, apoptosis, neurite outgrowth, and synaptogenesis. This work addresses 3 hypotheses: (1) a broad screening battery provides a sensitive marker of DNT bioactivity; (2) selective bioactivity (occurring at noncytotoxic concentrations) may indicate functional processes disrupted; and, (3) a subset of endpoints may optimally classify chemicals with in vivo evidence for DNT. The dataset was comprised of 92 chemicals screened in all 57 assay endpoints sourced from publicly available data, including a set of DNT NAM evaluation chemicals with putative positives (53) and negatives (13). The DNT NAM battery provides a sensitive marker of DNT bioactivity, particularly in cytotoxicity and network connectivity parameters. Hierarchical clustering suggested potency (including cytotoxicity) was important for classifying positive chemicals with high sensitivity (93%) but failed to distinguish patterns of disrupted functional processes. In contrast, clustering of selective values revealed informative patterns of differential activity but demonstrated lower sensitivity (74%). The false negatives were associated with several limitations, such as the maximal concentration tested or gaps in the biology captured by the current battery. This work demonstrates that this multi-dimensional assay suite provides a sensitive biomarker for DNT bioactivity, with selective activity providing possible insight into specific functional processes affected by chemical exposure and a basis for further research.

Carstens, Kelly E.↗
DOE OSTI2021

Considerations and recent advances in nanoscale interfaces with neuronal and cardiac networks

Nanoscale interfaces with biological tissue, principally made with nanowires (NWs), are envisioned as minimally destructive to the tissue and as scalable tools to directly transduce the electrochemical activity of a neuron at its finest resolution. This review lays the foundations for understanding the material and device considerations required to interrogate neuronal activity at the nanoscale. We first discuss the electrochemical nanoelectrode-neuron interfaces and then present new results concerning the electrochemical impedance and charge injection capacities of millimeter, micrometer, and nanometer scale wires with Pt, PEDOT:PSS, Si, Ti, ITO, IrO x , Ag, and AgCl materials. Using established circuit models for NW-neuron interfaces, we discuss the impact of having multiple NWs interfacing with a single neuron on the amplitude and temporal characteristics of the recorded potentials. We review state of the art advances in nanoelectrode-neuron interfaces, the standard control experiments to investigate their electrophysiological behavior, and present recent high fidelity recordings of intracellular potentials obtained with ultrasharp NWs developed in our laboratory that naturally permeate neuronal cell bodies. Recordings from arrays and individually addressable electrically shorted NWs are presented, and the long-term stability of intracellular recording is discussed and put in the context of established techniques. Finally, a perspective on future research directions and applications is presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Energy-efficient Mott activation neuron for full-hardware implementation of neural networks

To circumvent the von Neumann bottleneck, substantial progress has been made towards in-memory computing with synaptic devices. However, compact nanodevices implementing non-linear activation functions are required for efficient full-hardware implementation of deep neural networks. Here, in this work, we present an energy-efficient and compact Mott activation neuron based on vanadium dioxide and its successful integration with a conductive bridge random access memory (CBRAM) crossbar array in hardware. The Mott activation neuron implements the rectified linear unit function in the analogue domain. The neuron devices consume substantially less energy and occupy two orders of magnitude smaller area than those of analogue complementary metal–oxide semiconductor implementations. The LeNet-5 network with Mott activation neurons achieves 98.38% accuracy on the MNIST dataset, close to the ideal software accuracy. We perform large-scale image edge detection using the Mott activation neurons integrated with a CBRAM crossbar array. Our findings provide a solution towards large-scale, highly parallel and energy-efficient in-memory computing systems for neural networks.

electrical and electronic engineering↗
DOE OSTI2026

Viability of perturbative expansion for quantum field theories on neurons

Neural Network (NN) architectures that break statistical independence of parameters have been proposed as a new approach for simulating local quantum field theories (QFTs) [1]. In the infinite neuron number limit, single-layer NNs can exactly reproduce QFT results. This paper examines the viability of this architecture for perturbative calculations of local QFTs for finite neuron number N using scalar ϕ 4 theory in d Euclidean dimensions as an example. We find that the renormalized O(1/N ) corrections to two-and four-point correlators yield perturbative series which are sensitive to the UV cut-off and therefore have a weak convergence. We propose a modification to the architecture to improve this convergence and discuss constraints on the parameters of the theory and the scaling of N which allow us to extract accurate field theory results.

Sen, Srimoyee [Iowa State University, Ames, IA (Un↗
DOE OSTI2021

Superconducting neural networks with disordered Josephson junction array synaptic networks and leaky integrate-and-fire loop neurons

Fully coupled randomly disordered recurrent superconducting networks with additional open-ended channels for inputs and outputs are considered the basis to introduce a new architecture to neuromorphic computing in this work. Various building blocks of such a network are designed around disordered array synaptic networks using superconducting devices and circuits as an example, while emphasizing that a similar architectural approach may be compatible with several other materials and devices. A multiply coupled (interconnected) disordered array of superconducting loops containing Josephson junctions [equivalent to superconducting quantum interference devices (SQUIDs)] forms the aforementioned collective synaptic network that forms a fully recurrent network together with compatible neuron-like elements and feedback loops, enabling unsupervised learning. This approach aims to take advantage of superior power efficiency, propagation speed, and synchronizability of a small world or a random network over an ordered/regular network. Additionally, it offers a significant factor of increase in scalability. Here, a compatible leaky integrate-and-fire neuron made of superconducting loops with Josephson junctions is presented, along with circuit components for feedback loops as needed to complete the recurrent network. Several of these individual disordered array neural networks can further be coupled together in a similarly disordered way to form a hierarchical architecture of recurrent neural networks that is often suggested as similar to a biological brain.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Neuromorphic Graph Algorithms

Graph algorithms enable myriad large-scale applications including cybersecurity, social network analysis, resource allocation, and routing. The scalability of current graph algorithm implementations on conventional computing architectures are hampered by the demise of Moore’s law. We present a theoretical framework for designing and assessing the performance of graph algorithms executing in networks of spiking artificial neurons. Although spiking neural networks (SNNs) are capable of general-purpose computation, few algorithmic results with rigorous asymptotic performance analysis are known. SNNs are exceptionally well-motivated practically, as neuromorphic computing systems with 100 million spiking neurons are available, and systems with a billion neurons are anticipated in the next few years. Beyond massive parallelism and scalability, neuromorphic computing systems offer energy consumption orders of magnitude lower than conventional high-performance computing systems. We employ our framework to design and analyze new spiking algorithms for shortest path and dynamic programming problems. Our neuromorphic algorithms are message-passing algorithms relying critically on data movement for computation. For fair and rigorous comparison with conventional algorithms and architectures, which is challenging but paramount, we develop new models of data-movement in conventional computing architectures. This allows us to prove polynomial-factor advantages, even when we assume a SNN consisting of a simple grid-like network of neurons. To the best of our knowledge, this is one of the first examples of a rigorous asymptotic computational advantage for neuromorphic computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Overview of RFID Applications Utilizing Neural Networks

As Radio Frequency Identification (RFID) methods continue to evolve to higher levels of complexity, one form of machine learning is making its appearance. The use of Neural Networks (NN) in the RFID field is steadily increasing, and in the fields of localization and activity recognition, promising results are being shown from a variety of research. RFID applications fall primarily under two types of problems including regression and classification. We analyze RIFD localization techniques which fall under regression, and activity recognition which falls under classification. Many works don’t classify themselves as activity recognition methods, but because they fall under the classification category, we still consider them as activity recognition techniques. This research overviews the Neural Network models in the localization field based on whether they can perform independently of the environment in which they were tested. For activity recognition and accessory fields, the major methods involve tag-based and tag-free approaches. In conclusion, after the models are surveyed, a comparison study is given to examine what may be the cause for increased accuracy between different Neural Network models.

42 ENGINEERING↗
DOE OSTI2020

Functional and transcriptional characterization of complex neuronal co-cultures

Brain-on-a-chip systems are designed to simulate brain activity using traditional in vitro cell culture on an engineered platform. It is a noninvasive tool to screen new drugs, evaluate toxicants, and elucidate disease mechanisms. However, successful recapitulation of brain function on these systems is dependent on the complexity of the cell culture. In this study, we increased cellular complexity of traditional (simple) neuronal cultures by co-culturing with astrocytes and oligodendrocyte precursor cells (complex culture). We evaluated and compared neuronal activity (e.g., network formation and maturation), cellular composition in long-term culture, and the transcriptome of the two cultures. Compared to simple cultures, neurons from complex co-cultures exhibited earlier synapse and network development and maturation, which was supported by localized synaptophysin expression, up-regulation of genes involved in mature neuronal processes, and synchronized neural network activity. Also, mature oligodendrocytes and reactive astrocytes were only detected in complex cultures upon transcriptomic analysis of age-matched cultures. Functionally, the GABA antagonist bicuculline had a greater influence on bursting activity in complex versus simple cultures. Collectively, the cellular complexity of brain-on-a-chip systems intrinsically develops cell type-specific phenotypes relevant to the brain while accelerating the maturation of neuronal networks, important features underdeveloped in traditional cultures.

59 BASIC BIOLOGICAL SCIENCES↗