Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neuron”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Mutants of Cytochrome P450 Reductase Lacking Either Gly-141 or Gly-143 Destabilize Its FMN Semiquinone

NADPH-cytochrome P450 oxidoreductase transfers electrons from NADPH to cytochromes P450 via its FAD and FMN. To understand the biochemical and structural basis of electron transfer from FMN-hydroquinone to its partners, three deletion mutants in a conserved loop near the FMN were characterized. Comparison of oxidized and reduced wild type and mutant structures reveals that the basis for the air stability of the neutral blue semiquinone is protonation of the flavin N5 and strong H-bond formation with the Gly-141 carbonyl. Further, the ΔGly-143 protein had moderately decreased activity with cytochrome P450 and cytochrome c. It formed a flexible loop, which transiently interacts with the flavin N5, resulting in the generation of both an unstable neutral blue semiquinone and hydroquinone. The ΔGly-141 and ΔG141/E142N mutants were inactive with cytochrome P450 but fully active in reducing cytochrome c. In the ΔGly-141 mutants, the backbone amide of Glu/Asn-142 forms an H-bond to the N5 of the oxidized flavin, which leads to formation of an unstable red anionic semiquinone with a more negative potential than the hydroquinone. The semiquinone of ΔG141/E142N was slightly more stable than that of ΔGly-141, consistent with its crystallographically demonstrated more rigid loop. Nonetheless, both ΔGly-141 red semiquinones were less stable than those of the corresponding loop in cytochrome P450 BM3 and the neuronal NOS mutant (ΔGly-810). Our results indicate that the catalytic activity of cytochrome P450 oxidoreductase is a function of the length, sequence, and flexibility of the 140s loop and illustrate the sophisticated variety of biochemical mechanisms employed in fine-tuning its redox properties and function.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Monte Carlo Dropout Uncertainty Quantification of Long Short-Term Memory Autoencoder Anomaly Detection in a Liquid Sodium Cold Trap

Advanced high-temperature fluid reactors, such as sodium-cooled fast reactors (SFRs) and molten salt–cooled reactors (MSCRs), require coolant purification systems to prevent fluid contamination and local freezing that can lead to plugging. Liquid sodium purification can be achieved with a cold trap, where the sodium temperature is reduced to a near-freezing point to precipitate out impurities. Automation of monitoring of the cold trap performance with machine learning algorithms can aid in early detection of incipient anomalies. An efficient approach to loss-of-coolant–type anomaly detection in a cold trap monitored with more than two dozen thermal-hydraulic sensors consists of a long short-term memory (LSTM) autoencoder. This work develops the uncertainty quantification of the LSTM autoencoder performance for cold trap anomaly detection using the Monte Carlo (MC) dropout method. The MC dropout methodology creates a distribution of sister distributions that all slightly differ from each other because of random neurons being turned off for testing. The variances of the sister network distributions are used to make an uncertainty interval. Our analysis shows that the uncertainty in the autoencoder performance is largest near the peak of the anomaly signal. Using the MC dropout method, we investigate the uncertainty in the anomaly detection with missing sensor inputs. This capability allows the reactor operator to evaluate resilience of the anomaly detection system and to make informed decisions about continuity of operation in the event of sensor failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Deep Learning for Multigroup Cross-Section Representation in Two-Step Core Calculations

Here we investigate using deep learning, a type of machine-learning algorithm employing multiple layers of artificial neurons, for the mathematical representation of multigroup cross sections for use in the Griffin reactor multiphysics code for two-step deterministic neutronics calculations. A three-dimensional fuel element typical of a high-temperature gas reactor as well as a two-dimensional sodium-cooled fast reactor lattice are modeled using the Serpent Monte Carlo code, and multigroup macroscopic cross sections are generated for various state parameters to produce a training data set and a separate validation data set. A fully connected, feedforward neural network is trained using the open-source PyTorch machine-learning framework, and its accuracy is compared against the standard piecewise linear interpolation model. Additionally, we provide in this work a generic technique for propagating the cross-section model errors up to the k eff using sensitivity coefficients with the first-order uncertainty propagation rule. Quantifying the eigenvalue error due to the cross-section regression errors is especially practical for appropriately selecting the mathematical representation of the cross sections. We demonstrate that the artificial neural network model produces lower errors and therefore enables better accuracy relative to the piecewise linear model when the cross sections exhibit nonlinear dependencies; especially when a coarse grid is employed, where the errors can be halved by the artificial neural network. However, for linearly dependent multigroup cross sections as found for the sodium-cooled fast reactor case, a simpler linear regression outperforms deeper networks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comparative electrophysiological evaluation of hippocampal function following repeated inhalation exposures to JP-8, Jet A, JP-5, and the synthetic Fischer Tropsch fuel

Exposure to fuels continues to be a concern in both military and general populations. The aim of this study was to examine effects of in vivo rat repeated exposures to different types of jet fuel utilizing microelectrode arrays for comparative electrophysiological (EP) measurements in hippocampal slices. Animals were exposed to increasing concentrations of four jet fuels, Jet Propellant (JP)-8, Jet A, JP-5, or synthetic Fischer Tropsch (FT) fuel via whole-body inhalation for 20 d (6 hr/d, 5 d/week for 28 d) and synaptic transmission as well as behavioral performance were assessed. Our behavioral studies indicated no significant changes in behavioral performance in animals exposed to JP-8, Jet A, or JP-5. A significant deviation in learning pattern during the Morris water maze task was observed in rats exposed to the highest concentration of FT (2000 mg/m 3 ). There were also significant differences in the EP profile of hippocampal neurons from animals exposed to JP-8, Jet A, JP-5, or FT compared to control air. However, these differences were not consistent across fuels or dose dependent. As expected, patterns of EP alterations in brain slices from JP-8 and Jet A exposures were more similar compared to those from JP-5 and FT. Further longitudinal investigations are needed to determine if these EP effects are transient or persistent. Such studies may dictate if and how one may use EP measurements to indicate potential susceptibility to neurological impairments, particularly those that result from inhalation exposure to chemicals or mixtures.

54 ENVIRONMENTAL SCIENCES↗

Channel properties of the splicing isoforms of the olfactory calcium-activated chloride channel Anoctamin 2

Anoctamin (ANO)2 (or TMEM16B) forms a cell membrane Ca 2+ -activated Cl - channel that is present in cilia of olfactory receptor neurons, vomeronasal microvilli, and photoreceptor synaptic terminals. Alternative splicing of Ano2 transcripts generates multiple variants with the olfactory variants skipping exon 14 and having alternative splicing of exon 4. In the present study, 5' rapid amplification of cDNA ends analysis was conducted to characterize the 5'end of olfactory Ano2 transcripts, which showed that the most abundant Ano2 transcripts in the olfactory epithelium contain a novel starting exon that encodes a translation initiation site, whereas transcripts of the publically available sequence variant, which has an alternative and longer 5' end, were present in lower abundance. With two alternative starting exons and alternative splicing of exon 4, four olfactory ANO2 isoforms are thus possible. Patch-clamp experiments in transfected HEK293T cells expressing these isoforms showed that N-terminal sequences affect Ca 2+ sensitivity and that the exon 4–encoded sequence is required to form functional channels. Coexpression of the two predominant isoforms, one with and one without the exon 4 sequence, as well as coexpression of the two rarer isoforms showed alterations in channel properties, indicating that different isoforms interact with each other. Furthermore, channel properties observed from the coexpression of the predominant isoforms better recapitulated the native channel properties, suggesting that the native channel may be composed of two or more splicing isoforms acting as subunits that together shape the channel properties.

59 BASIC BIOLOGICAL SCIENCES↗

Searching for pulsars using image pattern recognition

In the modern era of big data, many fields of astronomy are generating huge volumes of data, the analysis of which can sometimes be the limiting factor in research. Fortunately, computer scientists have developed powerful data-mining techniques that can be applied to various fields. In this paper, we present a novel artificial intelligence (AI) program that identifies pulsars from recent surveys by using image pattern recognition with deep neural nets—the PICS (Pulsar Image-based Classification System) AI. The AI mimics human experts and distinguishes pulsars from noise and interference by looking for patterns from candidate plots. Different from other pulsar selection programs that search for expected patterns, the PICS AI is taught the salient features of different pulsars from a set of human-labeled candidates through machine learning. The training candidates are collected from the Pulsar Arecibo L-band Feed Array (PALFA) survey. The information from each pulsar candidate is synthesized in four diagnostic plots, which consist of image data with up to thousands of pixels. The AI takes these data from each candidate as its input and uses thousands of such candidates to train its ∼9000 neurons. The deep neural networks in this AI system grant it superior ability to recognize various types of pulsars as well as their harmonic signals. The trained AI's performance has been validated with a large set of candidates from a different pulsar survey, the Green Bank North Celestial Cap survey. In this completely independent test, the PICS ranked 264 out of 277 pulsar-related candidates, including all 56 previously known pulsars and 208 of their harmonics, in the top 961 (1%) of 90,008 test candidates, missing only 13 harmonics. The first non-pulsar candidate appears at rank 187, following 45 pulsars and 141 harmonics. In other words, 100% of the pulsars were ranked in the top 1% of all candidates, while 80% were ranked higher than any noise or interference. The performance of this system can be improved over time as more training data are accumulated. This AI system has been integrated into the PALFA survey pipeline and has discovered six new pulsars to date.

79 ASTRONOMY AND ASTROPHYSICS↗

On the spin period distribution in Be/X-ray binaries

There is a remarkable correlation between the spin periods of the accreting neutron stars (NSs) in Be/X-ray binaries (BeXBs) and their orbital periods. Recently, Knigge et al. showed that the distribution of the spin periods contains two distinct subpopulations peaked at ∼10 s and ∼200 s, respectively, and suggested that they may be related to two types of supernovae for the formation of the NSs, i.e., core-collapse and electron-capture supernovae. Here we propose that the bimodal spin period distribution is likely to be ascribed to different accretion modes of the NSs in BeXBs. When the NS tends to capture material from the warped, outer part of the Be star disk and experiences giant outbursts, a radiatively cooling dominated disk is formed around the NS, which spins up the NS and is responsible for the short-period subpopulation. In BeXBs that are dominated by normal outbursts or are persistent, the accretion flow is advection-dominated or quasi-spherical. The spin-up process is accordingly inefficient, leading to longer periods of the neuron stars. The potential relation between the subpopulations and the supernova mechanism is also discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Electrically-driven IMT and volatile memristor behavior in NdNiO 3 films

Abstract Transition metal oxides with insulator-metal transitions (IMTs) are uniquely suited for volatile memristor devices that mimic the spiking of biological neurons. Unlike most non-volatile memristors, which often operate via ion migration into filaments, volatile devices utilize a reversible phase change that returns to a ground state in the absence of applied stimulus. In these devices, Joule heating triggers the IMT and changes the bulk resistivity rather than influencing conduction through defects, as in previous studies. This volatile resistive switching behavior has previous been leveraged in niobium and vanadium oxides, but not in rare-earth nickelates, despite their tunable transition temperatures. This study demonstrates an electrically driven IMT in the prototypical rare-earth nickelate, NdNiO 3 , in large area devices. While previous work examining the electrically-driven IMT in NdNiO 3 suggests defect-dominated conduction, this study shows clear s-type negative differential resistance (NDR) consistent with temperature-dependent resistivity measurements. The NDR peak-to-valley voltage scales linearly with temperature as expected for conductivity pathways dominated by bulk IMT behavior. Unlike other transition metal oxides, which are modeled using the insulator-metal phase fraction as the internal state variable, a thermoelectric model with temperature as the internal state variable is found to more accurately describe the current–voltage characteristic of NdNiO 3 volatile memristors. Overall, we report the synthesis, fabrication, and characterization of NdNiO 3 volatile memristors with resistivity dominated by bulk-like IMT behavior which is scalable and not dependent upon oxygen vacancy migration or defect mediated conduction pathways.

36 MATERIALS SCIENCE↗

Metal Chalcogenides for Neuromorphic Computing: Emerging Materials and Mechanisms

The approaching end of Moore's Law scaling has significantly accelerated multiple fields of research including neuromorphic-, quantum-, and photonic computing, each of which possesses unique benefits unobtained through conventional binary computers. One of the most compelling arguments for neuromorphic computing systems is power consumption, noting that computations made in the human brain are approximately 106 times more efficient than conventional CMOS logic. This review article focuses on the materials science and physical mechanisms found in metal chalcogenides that are currently being explored for use in neuromorphic applications. We begin by reviewing the key biological signal generation and transduction mechanisms within neuronal components of mammalian brains and subsequently compare with observed experimental measurements in chalcogenides. With robustness and energy efficiency in mind, we will focus on short-range mechanisms such as structural phase changes and correlated electron systems that can be driven by low-energy stimuli, such as temperature or electric field. We aim to highlight fundamental materials research and existing gaps that need to be overcome to enable further integration or advancement of metal chalcogenides for neuromorphic systems.

36 MATERIALS SCIENCE↗

A minimum assumption approach to MEG sensor array design

Objective. Our objective is to formulate the problem of the magnetoencephalographic (MEG) sensor array design as a well-posed engineering problem of accurately measuring the neuronal magnetic fields. This is in contrast to the traditional approach that formulates the sensor array design problem in terms of neurobiological interpretability the sensor array measurements. Approach. We use the vector spherical harmonics (VSH) formalism to define a figure-of-merit for an MEG sensor array. We start with an observation that, under certain reasonable assumptions, any array of m perfectly noiseless sensors will attain exactly the same performance, regardless of the sensors' locations and orientations (with the exception of a negligible set of singularly bad sensor configurations). We proceed to the conclusion that under the aforementioned assumptions, the only difference between different array configurations is the effect of (sensor) noise on their performance. We then propose a figure-of-merit that quantifies, with a single number, how much the sensor array in question amplifies the sensor noise. Main results. We derive a formula for intuitively meaningful, yet mathematically rigorous figure-of-merit that summarizes how desirable a particular sensor array design is. We demonstrate that this figure-of-merit is well-behaved enough to be used as a cost function for a general-purpose nonlinear optimization methods such as simulated annealing. We also show that sensor array configurations obtained by such optimizations exhibit properties that are typically expected of 'high-quality' MEG sensor arrays, e.g. high channel information capacity. Significance. Our work paves the way toward designing better MEG sensor arrays by isolating the engineering problem of measuring the neuromagnetic fields out of the bigger problem of studying brain function through neuromagnetic measurements.

60 APPLIED LIFE SCIENCES↗

High performance FPGA embedded system for machine learning based tracking and trigger in sPhenix and EIC

We present a comprehensive end-to-end pipeline to classify triggers versus background events in this paper. This pipeline makes online decisions to select signal data and enables the intelligent trigger system for efficient data collection in the Data Acquisition System (DAQ) of the upcoming sPHENIX and future EIC (Electron-Ion Collider) experiments. Starting from the coordinates of pixel hits that are lightened by passing particles in the detector, the pipeline applies three-stage of event processing (hits clustering, track reconstruction, and trigger detection) and labels all processed events with the binary tag of trigger versus background events. The pipeline consists of deterministic algorithms such as clustering pixels to reduce event size, tracking reconstruction to predict candidate edges, and advanced graph neural network-based models for recognizing the entire jet pattern. In particular, we apply the message-passing graph neural network to predict links between hits and reconstruct tracks and a hierarchical pooling algorithm (DiffPool) to make the graph-level trigger detection. We obtain an impressive performance (≥70% accuracy) for trigger detection with only 3200 neuron weights in the end-to-end pipeline. We deploy the end-to-end pipeline into a field-programmable gate array (FPGA) and accelerate the three stages with speedup factors of 1152, 280, and 21, respectively.

Instruments & Instrumentation↗

The possibility of anesthesia stimulated by a train of current pulses

This study considers a simple theoretical model of blocking the passage of signals (action potentials) from sensory neurons, thereby affecting anesthesia without the use of anesthetics as a result of a sequence of unipolar current pulses generated by an external source. The proposed model allows the selection of parameters and the required frequency of the repetition of current pulses for the possible implementation of anesthesia, depending on the electrical characteristics of the skin and the conductivity of the saline solution in which the myelinated nerve fibers are located.

59 BASIC BIOLOGICAL SCIENCES↗

Network analysis of memristive device circuits: dynamics, stability and correlations

Abstract Networks with memristive devices are a potential basis for the next generation of computing devices. They are also an important model system for basic science, from modeling nanoscale conductivity to providing insight into the information-processing of neurons. The resistance in a memristive device depends on the history of the applied bias and thus displays a type of memory. The interplay of this memory with the dynamic properties of the network can give rise to new behavior, offering many fascinating theoretical challenges. But methods to analyze general memristive circuits are not well described in the literature. In this paper we develop a general circuit analysis for networks that combine memristive devices alongside resistors, capacitors and inductors and under various types of control. We derive equations of motion for the memory parameters of these circuits and describe the conditions for which a network should display properties characteristic of a resonator system. For the case of a purely memresistive network, we derive Lyapunov functions, which can be used to study the stability of the network dynamics. Surprisingly, analysis of the Lyapunov functions show that these circuits do not always have a stable equilibrium in the case of nonlinear resistance and window functions. The Lyapunov function allows us to study circuit invariances, wherein different circuits give rise to similar equations of motion, which manifest through a gauge freedom and node permutations. Finally, we identify the relation between the graph Laplacian and the operators governing the dynamics of memristor networks operators, and we use these tools to study the correlations between distant memristive devices through the effective resistance.

97 MATHEMATICS AND COMPUTING↗

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗

Leveraging dendritic complexity for neuromorphic computing

Abstract Beyond-von Neumann computing approaches are necessary to sustain the growth of microelectronics and the increasing appetite for artificial intelligence/machine learning algorithms. Neuromorphic computing is an emerging paradigm that takes inspiration from the brain to provide a path forward to improve the computational efficiency and computational density of next-generation computing architectures. In nature, we observe brains performing complex computations with a much smaller energy footprint than conventional computing approaches. Current neuromorphic systems are focused primarily on scalability, namely, increasing the number of computational units (neurons) and connections between units (synapses). However, for brain-like cognition and efficiency in next-generation computing hardware, we need increased complexity in function, as well as improved connection density for scalability. Here, we present our work that aims to incorporate dendrites for ‘compute-on-wire’ in neuromorphic architectures to increase the computational complexity (e.g. number of programmable parameters, nonlinear dynamics) as well as computational efficiency (energy/compute) of artificial neural networks (ANNs). We do this by showcasing neuromorphic dendrite elements that can be leveraged for various applications. We will present examples of neuroscience-inspired direction-selective circuits and an ANN with active dendrites leveraging shunting inhibition. We also demonstrate the benefits of using dendrites in deep neural networks. To conclude, we discuss how we can utilize emerging hardware devices in these systems and design next-generation neuromorphic architectures with dendrites.

Cardwell, Suma G. (ORCID:0000000226575545)↗

Plasma phosphorylated tau217 strongly associates with memory deficits in the Alzheimer’s disease spectrum

Abstract Plasma phosphorylated tau (p-tau) biomarkers open unprecedented opportunities for identifying carriers of Alzheimer’s disease pathophysiology in early disease stages using minimally invasive techniques. Plasma p-tau biomarkers are believed to reflect tau phosphorylation and secretion. However, it remains unclear to what extent the magnitude of plasma p-tau abnormalities reflects neuronal network disturbance in the form of cognitive impairment. To address this question, we included 103 cognitively unimpaired elderly and 40 cognitively impaired, amyloid-β-positive individuals from the TRIAD cohort, in addition to 336 cognitively unimpaired and 216 cognitively impaired, amyloid-β-positive older adults from the BioFINDER-2 cohort. Participants had tau PET scans, amyloid PET scans or amyloid CSF, p-tau217, p-tau181 and p-tau231 blood measures, structural T1-MRI and cognitive assessments. In this cross-sectional study, we used regression models and correlation analyses to assess the relationship between plasma biomarkers and cognitive scores. Furthermore, we applied receiver operating characteristic curves to assess cognitive impairment across plasma biomarkers. Finally, we categorized participants into amyloid (A), p-tau (T1) and tau PET (T2) positive (+) or negative (−) profiles and ran non-parametric comparisons to assess differences across cognitive domains. We found that plasma p-tau217 was more associated with cognitive performance than p-tau181 and p-tau231 and that this relationship was particularly strong for memory scores (TRIAD: βp-tau217 = −0.53, βp-tau181 = −0.35 and βp-tau231 = −0.24; BioFINDER-2: βp-tau217 = −0.52, βp-tau181 = −0.24 and βp-tau231 = −0.29). Associations in amyloid-β-positive participants resembled these results, but other cognitive scores also showed strong associations in cognitively impaired individuals. Moreover, plasma p-tau217 outperformed plasma p-tau181 and plasma p-tau231 in identifying memory impairment (area under the curve values for TRIAD: p-tau217 = 0.86, p-tau181 = 0.77 and p-tau231 = 0.75; and for BioFINDER-2: p-tau217 = 0.86, p-tau181 = 0.76 and p-tau231 = 0.81) and in identifying executive function impairment only in the BioFINDER-2 cohort (p-tau217 = 0.82, p-tau181 = 0.76 and p-tau231 = 0.76). Lastly, we showed that subtle memory deficits were present in A+T1+T2− participants for plasma p-tau217 (P = 0.007) and plasma p-tau181 (P = 0.01) in the TRIAD cohort and for all biomarkers across cognitive domains in A+T1+T2− and A+T1+T2− individuals (P < 0.001 in all) in the BioFINDER-2 cohort. The A+T1+T2− individuals showed cognitive deficits in both cohorts (P < 0.001 in all). Together, our results suggest that plasma p-tau217 stands out as a biomarker capable of identifying memory deficits attributable to Alzheimer’s disease and that memory impairment certainly occurs in amyloid-β- and plasma p-tau-positive individuals who have no significant amounts of tau in the neocortex.

Neurosciences & Neurology↗

A unified and constructive framework for the universality of neural networks

Abstract One of the reasons why many neural networks are capable of replicating complicated tasks or functions is their universal approximation property. Though the past few decades have seen tremendous advances in theories of neural networks, a single constructive and elementary framework for neural network universality remains unavailable. This paper is an effort to provide a unified and constructive framework for the universality of a large class of activation functions including most of the existing ones. At the heart of the framework is the concept of neural network approximate identity (nAI). The main result is as follows: any nAI activation function is universal in the space of continuous functions on compacta. It turns out that most of the existing activation functions are nAI, and thus universal. The framework induces several advantages over the contemporary counterparts. First, it is constructive with elementary means from functional analysis, probability theory, and numerical analysis. Second, it is one of the first unified and constructive attempts that is valid for most of the existing activation functions. Third, it provides new proofs for most activation functions. Fourth, for a given activation and error tolerance, the framework provides precisely the architecture of the corresponding one-hidden neural network with a predetermined number of neurons and the values of weights/biases. Fifth, the framework allows us to abstractly present the first universal approximation with a favorable non-asymptotic rate. Sixth, our framework also provides insights into the developments, and hence providing constructive derivations, of some of the existing approaches.

97 MATHEMATICS AND COMPUTING↗