Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Biologically plausible”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Electromechanical memcapacitor model offering biologically plausible spiking.

In this article, we introduce a new nanoscale electromechanical device - a leaky memcapacitor - and show that it may be useful for the hardware implementation of spiking neurons. The leaky memcapacitor is a movableplate capacitor that becomes quite conductive when the plates come close to each other. The equivalent circuit of the leaky memcapacitor involves a memcapacitive and memristive system connected in parallel. In the leaky memcapacitor, resistance and capacitance depend on the same internal state variable, which is the displacement of the movable plate. We have performed a comprehensive analysis showing that several types of spiking observed in biological neurons can be implemented with the leaky memcapacitor. Significant attention is paid to the dynamic properties of the model. As in leaky memcapacitors the capacitive, leaking resistive, and reset functionalities are implemented naturally within the same device structure, their use will simplify the creation of spiking neural networks.

Zhang, Zixi↗
DOE OSTI2025

Backpropagation-based learning with local derivative approximation and memory replay in biologically plausible neural systems

When learning, the brain modifies individual synaptic connections to reach a desired behavior. Animal and human brains have been shown to be incredibly capable of learning complex and varied functions across a wide variety of tasks. In recent years, artificial neural networks, inspired by human and animal brains, have shown great capabilities in learning a wide variety of difficult tasks. However, artificial neural networks primarily teach themselves through the use of backpropagation, a learning method which has no clear analogue within the brain. Additionally, Artificial Neural Networks primarily use continuous activation functions, which differ significantly from the spiking neuronal behavior present in the brain. In this paper, we discuss and demonstrate a biologically plausible learning method that approximates backpropagation through two techniques on Spiking Neural Networks. First, we show that the local temporal derivatives that are necessary for backpropagation can be approximately recovered through reconstruction using spike timings. Second, we show that through learning during a sleep phase, inspired by neuroscience research into memory replay, the localized parallel feedback path can learn to approximate the derivative through the forward path weight matrix, thus solving the weight transport problem. Lastly, we demonstrate that the combination of these two methods can approach or exceed the accuracy of backpropagation-based methods for a variety of neuromorphic vision tasks while maintaining biological plausibility.

42 ENGINEERING↗
DOE OSTI2023

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

A Unidirectional Two-Compartment Neuron Circuit with On-chip STDP learning

Most neuromorphic chips implement the single-compartment point neuron model where synapse circuits connect directly to a leaky integrate and fire (LIF) soma circuit. However, when using a biologically plausible soma circuit (e.g., Hodgkin-Huxley neuron model), an interface circuitry, such as a current conveyor circuit, is needed to transmit synaptic current to the soma circuit. This is especially true for ultra-low power neuron circuits, where membrane capacitance is on the order of 20 fF. This need for an interface circuit arises because the parasitic capacitance and leakage current caused by fabrication mismatch and second-order effects of the output transistors in the synapse circuits can disturb the spiking dynamics of the soma circuit if connected without an interface. Using an interface circuit to isolate the soma’s membrane capacitor from synapses resolves this issue. We propose to use a unidirectional resistor (a transconductance circuit) to connect the synapse and soma circuits instead of conventional current conveyor circuits. Using a biologically plausible spike pattern detection model, we show that the on-chip spike-timing-dependent plasticity (STDP) learning performance of the proposed unidirectional two-compartment neuron circuit is similar to a single-compartment circuit (with a current conveyor as an interface) and additionally, it is more power-efficient and biologically plausible. The chip is fabricated in the Taiwan Semiconductor Manufacturing Company (TSMC) 250 nm technology node and comprises a single neuron circuit.

Gautam, Ashish [ORNL]↗
DOE OSTI2021

Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware

Spiking neural networks (SNN) offer a power efficient, biologically plausible learning paradigm by encoding information into spikes. The discovery of the memristor has accelerated the progress of spiking neuromorphic systems, as the intrinsic plasticity of the device makes it an ideal candidate to mimic a biological synapse. Despite providing a nanoscale form factor, non-volatility, and low-power operation, memristors suffer from device-level non-idealities, which impact system-level performance. To address these issues, this article presents a memristive crossbar-based neuromorphic system using unsupervised learning with twin-memristor synapses, fully digital pulse width modulated spike-timing-dependent plasticity, and homeostasis neurons. Additionally, the implemented single-layer SNN was applied to a pattern-recognition task of classifying handwritten-digits. The performance of the system was analyzed by varying design parameters such as number of training epochs, neurons, and capacitors. Furthermore, the impact of memristor device non-idealities, such as device-switching mismatch, aging, failure, and process variations, were investigated and the resilience of the proposed system was demonstrated.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Sulfur Species in Zinc-Rich Condylar Zones of a Rat Temporomandibular Joint

We performed synchrotron-based micro-X-ray absorption near-edge spectroscopy (µ-XANES) coupled with micro-X-ray fluorescence (µ-XRF) for the identification of elements that included biometal zinc (Zn) and nonmetal sulfur (S) (and its species) in the condylar zones of a rat temporomandibular joint (TMJ). Zone-specific spatial localization of biometal Zn and nonmetal S from a materials viewpoint when correlated with hypoxia inducible factor-1α (HIF-1α) (a surrogate for tissue oxygenation) can provide insights into Zn-specific redox pathways at the vulnerable subchondral interface. Histologic localization of Zn, HIF-1α, and sulfur-rich proteoglycans (PGs) were mapped using an optical microscope. The µ-XRF maps coupled with site-specific micro-X-ray diffraction (µ-XRD) patterns were used to underline Zn-incorporated biological apatite in the subchondral bone and the bone of a rat TMJ condyle. Results demonstrated an association between Zn, PG, and HIF-1α histologic maps with µ-XRF, µ-XANES, and µ-XRD data and provided insights into plausible biological S species in Zn-enriched zones of a rat TMJ condyle. Spatially localized Zn and S underscore their roles in cell and tissue functions in a zone-specific manner. Elemental Zn with organic and inorganic S species at the cartilage-bone interface and the biomineral phase of Zn-enriched biological apatite from subchondral bone to condylar bone were ascertained using µ-XRF-XANES and µ-XRF-XRD. The coupled µ-XRF-XANES in situ complemented with µ-XRF-XRD in situ and immunohistochemistry provided valuable biological insights into zone-specific biological pathways in rat TMJ condyles. Based on these data, we present a workflow to reliably map and correlate S species within Zn-enriched regions of cartilage, bone, and their interface. We suggest the use of this correlative and complementary microspectroscopic spatial information for zone-specific localization of biometal Zn and nonmetal S to gain insights into plausible microanatomy-specific oxidative stress in the TMJ.

apatites↗
DOE OSTI2024

Chaotic neural dynamics facilitate probabilistic computations through sampling

Cortical neurons exhibit highly variable responses over trials and time. Theoretical works posit that this variability arises potentially from chaotic network dynamics of recurrently connected neurons. Here, we demonstrate that chaotic neural dynamics, formed through synaptic learning, allow networks to perform sensory cue integration in a sampling-based implementation. We show that the emergent chaotic dynamics provide neural substrates for generating samples not only of a static variable but also of a dynamical trajectory, where generic recurrent networks acquire these abilities with a biologically plausible learning rule through trial and error. Furthermore, the networks generalize their experience in the stimulus-evoked samples to the inference without partial or all sensory information, which suggests a computational role of spontaneous activity as a representation of the priors as well as a tractable biological computation for marginal distributions. These findings suggest that chaotic neural dynamics may serve for the brain function as a Bayesian generative model.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Biological underpinnings for lifelong learning machines

Biological organisms learn from interactions with their environment throughout their lifetime. For artificial systems to successfully act and adapt in the real world, it is desirable to similarly be able to learn on a continual basis. This challenge is known as lifelong learning, and remains to a large extent unsolved. In this Perspective article, we identify a set of key capabilities that artificial systems will need to achieve lifelong learning. We describe a number of biological mechanisms, both neuronal and non-neuronal, that help explain how organisms solve these challenges, and present examples of biologically inspired models and biologically plausible mechanisms that have been applied to artificial systems in the quest towards development of lifelong learning machines. We discuss opportunities to further our understanding and advance the state of the art in lifelong learning, aiming to bridge the gap between natural and artificial intelligence. It is an outstanding challenge to develop intelligent machines that can learn continually from interactions with their environment, throughout their lifetime. Kudithipudi et al. review neuronal and non-neuronal processes in organisms that address this challenge and discuss pathways to developing biologically inspired approaches for lifelong learning machines.

Kudithipudi, Dhireesha↗
DOE OSTI2025

CRCNS22 Learning Rules in the Hippocampus and their Mapping to Neuromorphic Systems (Final Technical Report)

Large scale biologically-realistic computational models are key to investigating the interplay between structure and function in nervous systems, thus paving the way to new clinical methods and neuro-inspired computing solutions. This project focuses on the hippocampus, in particular the CA3-CA1 regions, due to their role in associative learning and memory, pattern separation and completion, and spatial navigation. Investigations into the neuronal organization and learning rule(s) of this circuit can shed light into how declarative memories are formed, stored, recalled and forgotten and inform computational, experimental and clinical neuroscience work. Our project aims at developing a novel data-driven methodology supported by a broad heterogeneous base of neuroscience experimental knowledge and inspired from advances in computer science and engineering. Specifically, this work will benchmark existing and new learning rules within a full-scale spiking neural network simulation of the CA3-CA1 region. The model will be based on an open-source repository, called the Hippocampome, which contains neuronal morphologies, firing patterns, synapse probabilities, and most other required parameters for all known neuron types in the rodent hippocampal formation. The model will be first trained in a supervised fashion for associative memory tasks using backpropagation through time traditionally used in computer science, enhanced with a new technique called the surrogate gradient method. This optimization method will be used to obtain a global loss minimization, but it is not biologically inspired as it assumes the use of data not locally available to the synapses. However, we propose its use as a benchmarking tool, to compare the training performance of local biologically plausible and hardware-mappable learning rules at scale. New rules or combinations will be proposed and tested as needed, based on the obtained results. Progress in this area will also drive the development of novel hardware-mappable algorithms for continual lifelong learning and categorization of new events from few presented examples. This project goes beyond the existing state-of-the-art by looking at large scale realistic neuronal circuits as networks trainable via global optimization methods such as surrogate gradient descent. The objective function of the brain that supports learning is largely unknown, but it is likely that it operates through local learning rules. Studying network trajectories around local minima as proposed in this work represents a useful strategy for understanding whether a network is training by using a specific (set of) learning rule(s). Starting from a completely untrained network is a challenging test since it is difficult to determine how the learning rule affects the trajectory of the network. This interdisciplinary project will help understand what rule governs learning in these regions or if multiple learning rules are involved. The work will develop a robust methodology to measure if the network is converging to the target solution, oscillating around it, or diverging away.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

LCA-PyTorch

LCA-PyTorch is a code repository which contains PyTorch implementations of the Locally Competitive Algorithm (LCA), which is a biologically-plausible sparse coding model. LCA-PyTorch allows for the training, testing, and analysis of single layer LCA networks, multi-layer LCA networks, and hybrid LCA-based deep neural network models on a wide variety of applications and data types. LCA-PyTorch was developed in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning. LCA-PyTorch interfaces heavily with the open-source PyTorch Python package.

Teti, Michael↗
DOE OSTI2021

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Humans quickly and accurately learn new visual concepts from sparse data, sometimes just a single example. The impressive performance of artificial neural networks which hierarchically pool afferents across scales and positions suggests that the hierarchical organization of the human visual system is critical to its accuracy. These approaches, however, require magnitudes of order more examples than human learners. We used a benchmark deep learning model to show that the hierarchy can also be leveraged to vastly improve the speed of learning. We specifically show how previously learned but broadly tuned conceptual representations can be used to learn visual concepts from as few as two positive examples; reusing visual representations from earlier in the visual hierarchy, as in prior approaches, requires significantly more examples to perform comparably. These results suggest techniques for learning even more efficiently and provide a biologically plausible way to learn new visual concepts from few examples.

Rule, Joshua S.↗
DOE OSTI2024

Emergence of catalytic function in prebiotic information-coding polymers

Life as we know it relies on the interplay between catalytic activity and information processing carried out by biological polymers. Here we present a plausible pathway by which a pool of prebiotic information-coding oligomers could acquire an early catalytic function, namely sequence-specific cleavage activity. Starting with a system capable of non-enzymatic templated replication, we demonstrate that even non-catalyzed spontaneous cleavage would promote proliferation by generating short fragments that act as primers. Furthermore, we show that catalytic cleavage function can naturally emerge and proliferate in this system. Specifically, a cooperative catalytic network with four subpopulations of oligomers is selected by the evolution in competition with chains lacking catalytic activity. The cooperative system emerges through the functional differentiation of oligomers into catalysts and their substrates. The model is inspired by the structure of the hammerhead RNA enzyme as well as other DNA- and RNA-based enzymes with cleavage activity that readily emerge through natural or artificial selection. We identify the conditions necessary for the emergence of the cooperative catalytic network. In particular, we show that it requires the catalytic rate enhancement over the spontaneous cleavage rate to be at least 10 2 –10 3 , a factor consistent with the existing experiments. The evolutionary pressure leads to a further increase in catalytic efficiency. The presented mechanism provides an escape route from a relatively simple pairwise replication of oligomers toward a more complex behavior involving catalytic function. This provides a bridge between the information-first origin of life scenarios and the paradigm of autocatalytic sets and hypercycles, albeit based on cleavage rather than synthesis of reactants.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Emergence of catalytic function in prebiotic information-coding polymers

Life as we know it relies on the interplay between catalytic activity and information processing carried out by biological polymers. Here we present a plausible pathway by which a pool of prebiotic information-coding oligomers could acquire an early catalytic function, namely sequence-specific cleavage activity. Starting with a system capable of non-enzymatic templated replication, we demonstrate that even non-catalyzed spontaneous cleavage would promote proliferation by generating short fragments that act as primers. Furthermore, we show that catalytic cleavage function can naturally emerge and proliferate in this system. Specifically, a cooperative catalytic network with four subpopulations of oligomers is selected by the evolution in competition with chains lacking catalytic activity. The cooperative system emerges through the functional differentiation of oligomers into catalysts and their substrates. The model is inspired by the structure of the hammerhead RNA enzyme as well as other DNA- and RNA-based enzymes with cleavage activity that readily emerge through natural or artificial selection. We identify the conditions necessary for the emergence of the cooperative catalytic network. In particular, we show that it requires the catalytic rate enhancement over the spontaneous cleavage rate to be at least 10 2 –10 3 , a factor consistent with the existing experiments. The evolutionary pressure leads to a further increase in catalytic efficiency. The presented mechanism provides an escape route from a relatively simple pairwise replication of oligomers toward a more complex behavior involving catalytic function. This provides a bridge between the information-first origin of life scenarios and the paradigm of autocatalytic sets and hypercycles, albeit based on cleavage rather than synthesis of reactants.

Tkachenko, Alexei V. (ORCID:000000031291243X)↗
DOE OSTI2024

Digital Multiphase Composites via Additive Manufacturing

Abstract Mechanical properties of traditional engineering materials are typically coupled to each other, presenting a challenge to practitioners with multi‐dimensional material property requirements. In this work, continuous, independent control over multiple mechanical properties is demonstrated in composite materials realized using additive manufacturing. For the first time, composites additively manufactured from rigid plastic, soft elastomer, and liquid constituents are experimentally characterized, demonstrating materials which span four orders of magnitude in modulus and two orders of magnitude in toughness. By forming analytical mappings between relative concentrations of constituents at the microscale and resulting macroscale material properties, inverse material design is enabled; the method is showcased by printing artifacts with prescribed toughness and elasticity distributions. The properties of these composites are placed in the context of biological tissues, showing they have promise as mechanically plausible tissue mimics.

Smith, Lawrence T.↗
DOE OSTI2025

Gut microbiome changes with micronutrient supplementation in children with attention–deficit/hyperactivity disorder: the MADDY study

Micronutrients have demonstrated promise in managing inattention and emotional dysregulation in children with attention-deficit/hyperactivity disorder (ADHD). The biological mechanism by which micronutrients improve these symptoms remains unclear. One plausible pathway is through the gut-brain axis, the bi-directional communication network that links the gastrointestinal tract with the brain. This study examines changes in gut microbiome composition and diversity after micronutrients supplementation in children with ADHD (N=44) and sheds light on potential mechanisms responsible for the response to micronutrients as measured by clinician-rated global impression. Participants from this investigation represent a sub-group of the Micronutrients for ADHD in Youth (MADDY) study, a double blind randomized controlled study in which participants received either micronutrients or a placebo for 8 weeks, followed by an 8-week open label extension with micronutrients for all participants. Stool samples collected at baseline, week 8, and week 16 were analyzed using 16S rRNA amplicon sequencing targeting the V4 hypervariable region. Pairwise compositional analyses served as the primary means for investigating changes in gut microbiome composition between micronutrients versus placebo groups and responders versus non-responders. A significant change in microbial evenness, as measured by alpha diversity, was observed following micronutrients, and the phylum Actinobacteriota decreased in the micronutrients group compared to placebo. Additionally, two bacterial families: Rikenellaceae and Oscillospiraceae, exhibited a significant increase in change of gut microbiome composition following micronutrients between responders and non-responders. These findings suggest that micronutrients modulated the composition of the gut microbiome and point towards specific bacterial changes associated with response to micronutrients.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Near-canopy horizontal concentration heterogeneity of semivolatile oxygenated organic compounds and implications for 2-methyltetrols primary emissions

Semivolatile oxygenated organic compounds (SV-OVOCs) are important atmospheric species, in particular for the production and chemistry of atmospheric particulate matter and related impacts on air quality and climate. In this study, SV-OVOCs were collected in the horizontal plane of the roughness layer over the tropical forest in the central Amazon during the wet season of 2018. A sampler mounted to a copter-type, hovering unmanned aerial vehicle was used. Underlying the collection region, a plateau forest transitioned into a slope forest across several hundred meters. The concentrations of pinonic and pinic acids, which are monoterpene oxidation products, had no statistical difference over the two forests. By comparison, across the study period, differences in the concentration of 2-methyltetrols, which are products of isoprene oxidation, ranged from -70% to +480% over the two forests. The chemical lifetime of 2-methyltetrols in the atmosphere is sufficiently long that heterogeneity in the isoprene emission rate from the two forests followed by atmospheric oxidation does not explain the concentration heterogeneity of 2-methyltetrols. Standing waves and local meteorology also cannot account for the heterogeneity. Of the possibilities considered, the most plausible explanation is the direct emission from the forest of 2-methyltetrols produced through biological processes within the plants. Under this explanation, the rate of direct SV-OVOC emissions should be modulated by forest type and related environmental stressors. Direct emissions of SV-OVOCs should be more broadly considered for constraining and improving models of atmospheric composition, transport, and chemistry over tropical forests.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Solving the puzzle of Fe homeostasis by integrating molecular, mathematical, and societal models

To ensure optimal utilization and bioavailability, iron uptake, transport, subcellular localization, and assimilation are tightly regulated in plants. In this work, we examine recent advances in our understanding of cellular responses to Fe deficiency. We then use intracellular mechanisms of Fe homeostasis to discuss how formalizing cell biology knowledge via a mathematical model can advance discovery even when quantitative data is limited. Using simulation-based inference to identify plausible systems mechanisms that conform to known emergent phenotypes can yield novel, testable hypotheses to guide targeted experiments. However, this approach relies on the accurate encoding of domain-expert knowledge in exploratory mathematical models. We argue that this would be facilitated by fostering more “systems thinking” life scientists and that diversifying your research team may be a practical path to achieve that goal.

59 BASIC BIOLOGICAL SCIENCES↗