Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neuronal network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Fuzzy operators and cyclic behavior in formal neuronal networks

Formal neuronal networks (FNN), which are comprised of threshold gates, make use of the unit step function. It is regarded as a degenerated distribution function (DDF) and will be referred to here as a non-fuzzy threshold operator (nFTO). Special networks of this kind generating long cycles of states are modified by introduction of fuzzy threshold operators (FTO), i.e., non-degenerated distribution functions (nDDF). The cyclic behavior of the new nets is compared with the original ones. The interconnection matrix and threshold values are not modified. It is concluded that the original long cycles change the fixed points and short cycles, and as the computer simulations demonstrate, the aperiodic motion that is associated with chaotic behavior appears. The emergence of the above changes depend on the steepness of the threshold operators.

Labos, E.↗

Two-dimensional materials for bio-realistic neuronal computing networks

Two-dimensional (2D) van der Waals materials have found broad utility in a diverse range of applications including electronics, optoelectronics, renewable energy, and quantum information technologies. Meanwhile, exponentially growing digital data coupled with the ubiquity of artificial intelligence algorithms have generated significant interest in edge neuromorphic computing as an alternative to centralized cloud computing. The drive to incorporate neuroscience principles into computing hardware is motivated by the low power consumption, parallel processing, and reconfigurability of the human brain. The diverse library of 2D materials with atomic-level thicknesses, exceptional electrostatic tunability, and integration versatility is particularly well-suited for realizing bio-realistic synaptic and neuronal functionality. Here, we summarize past and present work in this field and outline the frontier challenges that have not yet been overcome. Here we also delineate potential solutions and suggest that the neuroscience principles of criticality and synchrony have the potential to inspire breakthrough applications of 2D materials in neuronal computing networks.

36 MATERIALS SCIENCE↗

An Investigation of Synchrony in Transport Networks

The cumulative degree distributions of transport networks, such as air transportation networks and respiratory neuronal networks, follow power laws. The significance of power laws with respect to other network performance measures, such as throughput and synchronization, remains an open question. Evolving methods for the analysis and design of air transportation networks must address network performance in the face of increasing demands and the need to contain and control local network disturbances, such as congestion. Toward this end, we investigate functional relationships that govern the performance of transport networks; for example, the links between the first nontrivial eigenvalue of a network's Laplacian matrix - a quantitative measure of network synchronizability - and other global network parameters. In particular, among networks with a fixed degree distribution and fixed network assortativity (a measure of a network's preference to attach nodes based on a similarity or difference), those with the small eigenvalue are shown to be poor synchronizers, to have much longer shortest paths and to have greater clustering in comparison to those with large. A simulation of a respiratory network adds data to our investigation. This study is a beginning step in developing metrics and design variables for the analysis and active design of air transport networks.

Kincaid, Rex K.↗

Geometrical approach to neural net control of movements and posture

In one approach to modeling brain function, sensorimotor integration is described as geometrical mapping among coordinates of non-orthogonal frames that are intrinsic to the system; in such a case sensors represent (covariant) afferents and motor effectors represent (contravariant) motor efferents. The neuronal networks that perform such a function are viewed as general tensor transformations among different expressions and metric tensors determining the geometry of neural functional spaces. Although the non-orthogonality of a coordinate system does not impose a specific geometry on the space, this "Tensor Network Theory of brain function" allows for the possibility that the geometry is non-Euclidean. It is suggested that investigation of the non-Euclidean nature of the geometry is the key to understanding brain function and to interpreting neuronal network function. This paper outlines three contemporary applications of such a theoretical modeling approach. The first is the analysis and interpretation of multi-electrode recordings. The internal geometries of neural networks controlling external behavior of the skeletomuscle system is experimentally determinable using such multi-unit recordings. The second application of this geometrical approach to brain theory is modeling the control of posture and movement. A preliminary simulation study has been conducted with the aim of understanding the control of balance in a standing human. The model appears to unify postural control strategies that have previously been considered to be independent of each other. Third, this paper emphasizes the importance of the geometrical approach for the design and fabrication of neurocomputers that could be used in functional neuromuscular stimulation (FNS) for replacing lost motor control.

Review↗

Structural differences between human and mouse neurons and their implementation in generative AIs

Mouse and human brains have different functions that depend on their neuronal networks. We analyzed nanometer-scale three-dimensional structures of brain tissues of the mouse medial prefrontal cortex and compared them with structures of the human anterior cingulate cortex. The obtained results indicated that mouse neuronal somata are smaller and neurites are thinner than those of human neurons. We implemented these characteristics of mouse neurons in convolutional layers of a generative adversarial network (GAN) and a denoising diffusion implicit model (DDIM), which were then subjected to image generation tasks using photo datasets of cat faces, cheese, human faces, birds, and automobiles. The mouse-mimetic GAN outperformed a standard GAN in the image generation task using the cat faces and cheese photo datasets, but underperformed for human faces and birds. The mouse-mimetic DDIM gave similar results, suggesting that the nature of the datasets affected the results. Analyses of the five datasets indicated differences in their image entropy, which should influence the number of parameters required for image generation. The preferences of the mouse-mimetic AIs coincided with the impressions commonly associated with mice. The relationship between the neuronal network and brain function should be investigated by implementing other biological findings in artificial neural networks.

generative AI↗

Synchronization in neural nets

The paper presents an artificial neural network concept (the Synchronizable Oscillator Networks) where the instants of individual firings in the form of point processes constitute the only form of information transmitted between joining neurons. In the model, neurons fire spontaneously and regularly in the absence of perturbation. When interaction is present, the scheduled firings are advanced or delayed by the firing of neighboring neurons. Networks of such neurons become global oscillators which exhibit multiple synchronizing attractors. From arbitrary initial states, energy minimization learning procedures can make the network converge to oscillatory modes that satisfy multi-dimensional constraints. Such networks can directly represent routing and scheduling problems that consist of ordering sequences of events.

Vidal, Jacques J.↗

Structural diverseness of neurons between brain areas and between cases

The cerebral cortex is composed of multiple cortical areas that exert a wide variety of brain functions. Although human brain neurons are genetically and areally mosaic, the three-dimensional structural differences between neurons in different brain areas or between the neurons of different individuals have not been delineated. Here we report a nanometer-scale geometric analysis of brain tissues of the superior temporal gyrus of schizophrenia and control cases. The results of the analysis and a comparison with results for the anterior cingulate cortex indicated that (1) neuron structures are significantly dissimilar between brain areas and that (2) the dissimilarity varies from case to case. The structural diverseness was mainly observed in terms of the neurite curvature that inversely correlates with the diameters of the neurites and spines. The analysis also revealed the geometric differences between the neurons of the schizophrenia and control cases. The schizophrenia cases showed a thin and tortuous neuronal network compared with the controls, suggesting that the neuron structure is associated with the disorder. The area dependency of the neuron structure and its diverseness between individuals should represent the individuality of brain functions.

60 APPLIED LIFE SCIENCES↗

Ultra-Sharp Nanowire Arrays Natively Permeate, Record, and Stimulate Intracellular Activity in Neuronal and Cardiac Networks

Intracellular access with high spatiotemporal resolution can enhance the understanding of how neurons or cardiomyocytes regulate and orchestrate network activity and how this activity can be affected with pharmacology or other interventional modalities. Nanoscale devices often employ electroporation to transiently permeate the cell membrane and record intracellular potentials, which tend to decrease rapidly with time. Here, one reports innovative scalable, vertical, ultrasharp nanowire arrays that are individually addressable to enable long-term, native recordings of intracellular potentials. One reports electrophysiological recordings that are indicative of intracellular access from 3D tissue-like networks of neurons and cardiomyocytes across recording days and that do not decrease to extracellular amplitudes for the duration of the recording of several minutes. The findings are validated with cross-sectional microscopy, pharmacology, and electrical interventions. The experiments and simulations demonstrate that the individual electrical addressability of nanowires is necessary for high-fidelity intracellular electrophysiological recordings. This work advances the understanding of and control over high-quality multichannel intracellular recordings and paves the way toward predictive, high-throughput, and low-cost electrophysiological drug screening platforms.

36 MATERIALS SCIENCE↗

Simulated weightlessness in fish and neurophysiological studies on memory storage

Simulated weightlessness was used to study the different types of gravity responses in blind fish. It was found that a shift in the direction of low magnitude acceleration in weightlessness causes a rapid 180 deg turn in the blind fish, while a shift in the direction of the applied acceleration in the earth's gravitational field is not significant because of a higher acceleration magnitude threshold than during the zero g condition. This increased responsiveness seems to be explained by a combination of directional sensitivity with a Weber-Fechner relationship of increased receptor sensitivity at diminished levels of background stimulation. Neurophysical studies of the statocyst nerve of the gastropod Mollusc Pleurobranchaea Californica were undertaken in order to understand how complex otolith systems operate. Information storage was investigated on relatively simple neuronal networks in the mollusc Aplysia. Intracellular electrical stimulation of isolated neurons show that a manipulation of autoditonous rhymicity is possible. It was also found that glycolysis and oxidative phosphorylation are involved in inherent rhymicity of Aplysis neurons.

Vonbaumgarten, R. J.↗

On the stability, storage capacity, and design of nonlinear continuous neural networks

The stability, capacity, and design of a nonlinear continuous neural network are analyzed. Sufficient conditions for existence and asymptotic stability of the network's equilibria are reduced to a set of piecewise-linear inequality relations that can be solved by a feedforward binary network, or by methods such as Fourier elimination. The stability and capacity of the network is characterized by the post synaptic firing rate function. An N-neuron network with sigmoidal firing function is shown to have up to 3N equilibrium points. This offers a higher capacity than the (0.1-0.2)N obtained in the binary Hopfield network. Moreover, it is shown that by a proper selection of the postsynaptic firing rate function, one can significantly extend the capacity storage of the network.

Guez, Allon↗

A reevaluation of the vestibulo-ocular reflex: new ideas of its purpose, properties, neural substrate, and disorders

Conventional views of the vestibulo-ocular reflex (VOR) have emphasized testing with caloric stimuli and by passively rotating patients at low frequencies in a chair. The properties of the VOR tested under these conditions differ from the performance of this reflex during the natural function for which it evolved--locomotion. Only the VOR (and not visually mediated eye movements) can cope with the high-frequency angular and linear perturbations of the head that occur during locomotion; this is achieved by generating eye movements at short latency (< 16 msec). Interpretation of vestibular testing is enhanced by the realization that, although the di- and trisynaptic components of the VOR are essential for this short-latency response, the overall accuracy and plasticity of the VOR depend upon a distributed, parallel network of neurons involving the vestibular nuclei. Neurons in this network variously upon a distributed, parallel network of neurons involving the vestibular nuclei. Neurons in this network variously encode inputs from the labyrinthine semicircular canals and otoliths, as well as from the visual and somatosensory systems. The central vestibular pathways branch to contact vestibular cortex (for perception) and the spinal cord (for control of posture). Thus, the vestibular nuclei basically coordinate the stabilization of gaze and posture, and contribute to the perception of verticality and self-motion. Consequently, brainstem disorders that disrupt the VOR cause not just only nystagmus, but also instability of posture (eg, increased fore-aft sway in patients with downbeat nystagmus) and disturbance of spatial orientation (eg, tilt of the subjective visual vertical in Wallenberg's syndrome).

Review↗

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Mean Field Theory of Self‐Organizing Memristive Connectomes

Abstract Biological neuronal networks are characterized by nonlinear interactions and complex connectivity. Given the growing impetus to build neuromorphic computers, understanding physical devices that exhibit structures and functionalities similar to biological neural networks is an important step toward this goal. Self‐organizing circuits of nanodevices are at the forefront of the research in neuromorphic computing, as their behavior mimics synaptic plasticity features of biological neuronal circuits. However, an effective theory to describe their behavior is lacking. This study provides for the first time an effective mean field theory for the emergent voltage‐induced polymorphism of circuits of a nanowire connectome, showing that the behavior of these circuits can be explained by a low‐dimensional dynamical equation. The equation can be derived from the microscopic dynamics of a single memristive junction in analytical form. The effective model is tested on experiments of nanowire networks and show that it fits both the potentiation and depression of these synapse‐mimicking circuits. It is shown that this theory applies beyond the case of nanowire networks by formulating a general mean‐field theory of conductance transitions in self‐organizing memristive connectomes.

Caravelli, Francesco↗

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗

Black Swan Event Small-Sample Transfer Learning (BEST-L) and its Case Study on Electrical Power Prediction in COVID-19

The black swan event will usually cause a great impact on the normal operation of society. The scarcity of such events leads to a lack of relevant data and challenges in dealing with related problems. Different situations also make the traditional methods invalid. In this paper, a transfer learning framework and a convolutional neuron network are proposed to deal with the black swan small-sample events (BEST-L). Taking the COVID-19 as a typical black swan event, the BEST-L is utilized to achieve accurate mid-term load forecasting using the relationship between economy and electricity consumption. The experiment results show that the transfer learning model can effectively learn the basic knowledge about the relationship between the adopted input and output data and use a relatively small amount of data during the black swan event to improve the target areas' generalization. The approach and results can provide an effective approach to respond and react to sudden changes quickly and effectively in similar open problems.

black swan event↗

Plasma phosphorylated tau217 strongly associates with memory deficits in the Alzheimer’s disease spectrum

Abstract Plasma phosphorylated tau (p-tau) biomarkers open unprecedented opportunities for identifying carriers of Alzheimer’s disease pathophysiology in early disease stages using minimally invasive techniques. Plasma p-tau biomarkers are believed to reflect tau phosphorylation and secretion. However, it remains unclear to what extent the magnitude of plasma p-tau abnormalities reflects neuronal network disturbance in the form of cognitive impairment. To address this question, we included 103 cognitively unimpaired elderly and 40 cognitively impaired, amyloid-β-positive individuals from the TRIAD cohort, in addition to 336 cognitively unimpaired and 216 cognitively impaired, amyloid-β-positive older adults from the BioFINDER-2 cohort. Participants had tau PET scans, amyloid PET scans or amyloid CSF, p-tau217, p-tau181 and p-tau231 blood measures, structural T1-MRI and cognitive assessments. In this cross-sectional study, we used regression models and correlation analyses to assess the relationship between plasma biomarkers and cognitive scores. Furthermore, we applied receiver operating characteristic curves to assess cognitive impairment across plasma biomarkers. Finally, we categorized participants into amyloid (A), p-tau (T1) and tau PET (T2) positive (+) or negative (−) profiles and ran non-parametric comparisons to assess differences across cognitive domains. We found that plasma p-tau217 was more associated with cognitive performance than p-tau181 and p-tau231 and that this relationship was particularly strong for memory scores (TRIAD: βp-tau217 = −0.53, βp-tau181 = −0.35 and βp-tau231 = −0.24; BioFINDER-2: βp-tau217 = −0.52, βp-tau181 = −0.24 and βp-tau231 = −0.29). Associations in amyloid-β-positive participants resembled these results, but other cognitive scores also showed strong associations in cognitively impaired individuals. Moreover, plasma p-tau217 outperformed plasma p-tau181 and plasma p-tau231 in identifying memory impairment (area under the curve values for TRIAD: p-tau217 = 0.86, p-tau181 = 0.77 and p-tau231 = 0.75; and for BioFINDER-2: p-tau217 = 0.86, p-tau181 = 0.76 and p-tau231 = 0.81) and in identifying executive function impairment only in the BioFINDER-2 cohort (p-tau217 = 0.82, p-tau181 = 0.76 and p-tau231 = 0.76). Lastly, we showed that subtle memory deficits were present in A+T1+T2− participants for plasma p-tau217 (P = 0.007) and plasma p-tau181 (P = 0.01) in the TRIAD cohort and for all biomarkers across cognitive domains in A+T1+T2− and A+T1+T2− individuals (P < 0.001 in all) in the BioFINDER-2 cohort. The A+T1+T2− individuals showed cognitive deficits in both cohorts (P < 0.001 in all). Together, our results suggest that plasma p-tau217 stands out as a biomarker capable of identifying memory deficits attributable to Alzheimer’s disease and that memory impairment certainly occurs in amyloid-β- and plasma p-tau-positive individuals who have no significant amounts of tau in the neocortex.

Neurosciences & Neurology↗

Integrating Data From In Vitro New Approach Methodologies for Developmental Neurotoxicity

Abstract In vivo developmental neurotoxicity (DNT) testing is resource intensive and lacks information on cellular processes affected by chemicals. To address this, DNT new approach methodologies (NAMs) are being evaluated, including: the microelectrode array neuronal network formation assay; and high-content imaging to evaluate proliferation, apoptosis, neurite outgrowth, and synaptogenesis. This work addresses 3 hypotheses: (1) a broad screening battery provides a sensitive marker of DNT bioactivity; (2) selective bioactivity (occurring at noncytotoxic concentrations) may indicate functional processes disrupted; and, (3) a subset of endpoints may optimally classify chemicals with in vivo evidence for DNT. The dataset was comprised of 92 chemicals screened in all 57 assay endpoints sourced from publicly available data, including a set of DNT NAM evaluation chemicals with putative positives (53) and negatives (13). The DNT NAM battery provides a sensitive marker of DNT bioactivity, particularly in cytotoxicity and network connectivity parameters. Hierarchical clustering suggested potency (including cytotoxicity) was important for classifying positive chemicals with high sensitivity (93%) but failed to distinguish patterns of disrupted functional processes. In contrast, clustering of selective values revealed informative patterns of differential activity but demonstrated lower sensitivity (74%). The false negatives were associated with several limitations, such as the maximal concentration tested or gaps in the biology captured by the current battery. This work demonstrates that this multi-dimensional assay suite provides a sensitive biomarker for DNT bioactivity, with selective activity providing possible insight into specific functional processes affected by chemical exposure and a basis for further research.

Carstens, Kelly E.↗