QUANTUM LONG SHORT-TERM MEMORY
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “long memory”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Probabilistic resource allocation system with self-adaptive capability
A probabilistic resource allocation system is disclosed containing a low capacity computational module (Short Term Memory or STM) and a self-organizing associative network (Long Term Memory or LTM) where nodes represent elementary resources, terminal end nodes represent goals, and weighted links represent the order of resource association in different allocation episodes. Goals and their priorities are indicated by the user, and allocation decisions are made in the STM, while candidate associations of resources are supplied by the LTM based on the association strength (reliability). Weights are automatically assigned to the network links based on the frequency and relative success of exercising those links in the previous allocation decisions. Accumulation of allocation history in the form of an associative network in the LTM reduces computational demands on subsequent allocations. For this purpose, the network automatically partitions itself into strongly associated high reliability packets, allowing fast approximate computation and display of allocation solutions satisfying the overall reliability and other user-imposed constraints. System performance improves in time due to modification of network parameters and partitioning criteria based on the performance feedback.
Yufik, Yan M.↗
Probabilistic resource allocation system with self-adaptive capability
A probabilistic resource allocation system is disclosed containing a low capacity computational module (Short Term Memory or STM) and a self-organizing associative network (Long Term Memory or LTM) where nodes represent elementary resources, terminal end nodes represent goals, and directed links represent the order of resource association in different allocation episodes. Goals and their priorities are indicated by the user, and allocation decisions are made in the STM, while candidate associations of resources are supplied by the LTM based on the association strength (reliability). Reliability values are automatically assigned to the network links based on the frequency and relative success of exercising those links in the previous allocation decisions. Accumulation of allocation history in the form of an associative network in the LTM reduces computational demands on subsequent allocations. For this purpose, the network automatically partitions itself into strongly associated high reliability packets, allowing fast approximate computation and display of allocation solutions satisfying the overall reliability and other user-imposed constraints. System performance improves in time due to modification of network parameters and partitioning criteria based on the performance feedback.
Yufik, Yan M.↗
Environmental modeling and recognition for an autonomous land vehicle
An architecture for object modeling and recognition for an autonomous land vehicle is presented. Examples of objects of interest include terrain features, fields, roads, horizon features, trees, etc. The architecture is organized around a set of data bases for generic object models and perceptual structures, temporary memory for the instantiation of object and relational hypotheses, and a long term memory for storing stable hypotheses that are affixed to the terrain representation. Multiple inference processes operate over these databases. Researchers describe these particular components: the perceptual structure database, the grouping processes that operate over this, schemas, and the long term terrain database. A processing example that matches predictions from the long term terrain model to imagery, extracts significant perceptual structures for consideration as potential landmarks, and extracts a relational structure to update the long term terrain database is given.
Lawton, D. T.↗
Rapid wavefield forecasting for earthquake early warning via deep sequence to sequence learning
We propose a deep learning model, WaveCastNet, to forecast high-dimensional wavefields. WaveCastNet integrates a convolutional long expressive memory architecture into a sequence-to-sequence forecasting framework, enabling it to model long-term dependencies and multiscale patterns in both space and time. By sharing weights across spatial and temporal dimensions, WaveCastNet requires significantly fewer parameters than more resource-intensive models such as transformers, resulting in faster inference times. Crucially, WaveCastNet also generalizes better than transformers to rare and critical seismic scenarios, such as high-magnitude earthquakes. Here, we show the ability of the model to predict the intensity and timing of destructive ground motions in real time, using simulated data from the San Francisco Bay Area. Furthermore, we demonstrate its zero-shot capabilities by evaluating WaveCastNet on real earthquake data. Our approach does not require estimating earthquake magnitudes and epicenters, steps that are prone to error in conventional methods, nor does it rely on empirical ground-motion models, which often fail to capture strongly heterogeneous wave propagation effects.
Geophysics↗
Recall of paired-associates as a function of overt and covert rehearsal procedures
Effect on memory of mode of studying paired associates, and mathematical model employing short term rehearsal buffer and long term memory
MATHEMATICAL MODEL↗
Architecture for Multiple Interacting Robot Intelligences
An architecture for robot intelligence enables a robot to learn new behaviors and create new behavior sequences autonomously and interact with a dynamically changing environment. Sensory information is mapped onto a Sensory Ego-Sphere (SES) that rapidly identifies important changes in the environment and functions much like short term memory. Behaviors are stored in a database associative memory (DBAM) that creates an active map from the robot's current state to a goal state and functions much like long term memory. A dream state converts recent activities stored in the SES and creates or modifies behaviors in the DBAM.
Peters, Richard Alan, II↗
Architecture for robot intelligence
An architecture for robot intelligence enables a robot to learn new behaviors and create new behavior sequences autonomously and interact with a dynamically changing environment. Sensory information is mapped onto a Sensory Ego-Sphere (SES) that rapidly identifies important changes in the environment and functions much like short term memory. Behaviors are stored in a DBAM that creates an active map from the robot's current state to a goal state and functions much like long term memory. A dream state converts recent activities stored in the SES and creates or modifies behaviors in the DBAM.
Peters, II, Richard Alan↗
Apparatus for multiprocessor-based control of a multiagent robot
An architecture for robot intelligence enables a robot to learn new behaviors and create new behavior sequences autonomously and interact with a dynamically changing environment. Sensory information is mapped onto a Sensory Ego-Sphere (SES) that rapidly identifies important changes in the environment and functions much like short term memory. Behaviors are stored in a DBAM that creates an active map from the robot's current state to a goal state and functions much like long term memory. A dream state converts recent activities stored in the SES and creates or modifies behaviors in the DBAM.
Peters, II, Richard Alan↗
Auto-programmable impulse neural circuits
Impulse neural networks use pulse trains to communicate neuron activation levels. Impulse neural circuits emulate natural neurons at a more detailed level than that typically employed by contemporary neural network implementation methods. An impulse neural circuit which realizes short term memory dynamics is presented. The operation of that circuit is then characterized in terms of pulse frequency modulated signals. Both fixed and programmable synapse circuits for realizing long term memory are also described. The implementation of a simple and useful unsupervised learning law is then presented. The implementation of a differential Hebbian learning rule for a specific mean-frequency signal interpretation is shown to have a straightforward implementation using digital combinational logic with a variation of a previously developed programmable synapse circuit. This circuit is expected to be exploited for simple and straightforward implementation of future auto-adaptive neural circuits.
Watula, D.↗
Observation of long-radial-range-correlation in turbulence in high-collisionality high-confinement plasmas on DIII-D
Abstract We report on the observation of spatially asymmetric turbulent structures with a long radial correlation length in the core of high-collisionality H -mode plasmas on DIII-D tokamak. These turbulent structures develop from shorter wavelength turbulence and have a radially elongated structure. The envelope of turbulence spans a broad radial range in the mid-radius region, leading to streamer-like transport events. The underlying turbulence is featured by intermittency, long-term memory effect, and the characteristic spectrum of self-organized criticality. The amplitude and the radial scale increase substantially when the shearing rate of the mean flow is reduced below the turbulent scattering rate. The enhanced long-radial-range-correlated (LRRC) transport events are accompanied by apparent degradation of normalized energy confinement time. The emergence of such LRRC transport events may serve as a candidate explanation for the degrading nature of H-mode core plasma confinement at high collisionality on DIII-D tokamak.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Effective field theory of stochastic diffusion from gravity
Planar black holes in AdS have long-lived quasinormal modes which capture the physics of charge and momentum diffusion in the dual field theory. How should we characterize the effective dynamics of a probe system coupled to the conserved currents of the dual field theory? Specifically, how would such a probe record the long-lived memory of the black hole and its Hawking fluctuations? We address this question by exhibiting a universal gauge invariant framework which captures the physics of stochastic diffusion in holography: a designer scalar with a gravitational coupling governed by a single parameter, the Markovianity index. We argue that the physics of gauge and gravitational perturbations of a planar Schwarzschild-AdS black hole can be efficiently captured by such designer scalars. We demonstrate that this framework allows one to decouple, at the quadratic order, the long-lived quasinormal and Hawking modes from the short-lived ones. It furthermore provides a template for analyzing fluctuating open quantum field theories with memory. In particular, we use this set-up to analyze the diffusive Hawking photons and gravitons about a planar Schwarzschild-AdS black hole and derive the quadratic effective action that governs fluctuating hydrodynamics of the dual CFT. Along the way we also derive results relevant for probes of hyperscaling violating backgrounds at finite temperature.
79 ASTRONOMY AND ASTROPHYSICS↗
Short-Term Rainfall Prediction Based on Radar Echo Using an Improved Self-Attention PredRNN Deep Learning Model
Accurate short-term precipitation forecast is extremely important for urban flood warning and natural disaster prevention. In this paper, we present an innovative deep learning model named ISA-PredRNN (improved self-attention PredRNN) for precipitation nowcasting based on radar echoes on the basis of the advanced PredRNN-V2. We introduce the self-attention mechanism and the long-term memory state into the model and design a new set of gating mechanisms. To better capture different intensities of precipitation, the loss function with weights was designed. We further train the model using a combination of reverse scheduled sampling and scheduled sampling to learn the long-term dynamics from the radar echo sequences. Experimental results show that the new model (ISA-PredRNN) can effectively extract the spatiotemporal features of radar echo maps and obtain radar echo prediction results with a small gap from the ground truths. From the comparison with the other six models, the new ISA-PredRNN model has the most accurate prediction results with a critical success index (CSI) of 0.7001, 0.5812 and 0.3052 under the radar echo thresholds of 10 dBZ, 20 dBZ and 30 dBZ, respectively.
Wu, Dali (ORCID:0000000231177074)↗
Composite oscillator systems for meeting user needs for time and frequency
Frequency standards are used in most navigation and telecommunications systems to provide a long term memory of either frequency, phase, or time epoch. From a systems point of view, the performance aspects of the frequency standard are weighed against other systems characteristics, such as overall performance, cost, size, and accessibility; a number of examples are very briefly reviewed. The theory of phase lock and frequency lock systems is outlined in sufficient detail that total oscillator system performance can be predicted from measurements on the individual components. As an example, details of the performance of a high spectral purity oscillator phase locked to a long term stable oscillator are given. Results for several systems, including the best system stability that can be obtained from present commercially available 5-MHz sources, are shown.
Stein, S. R.↗
Collective neural network behavior in a dynamically driven disordered system of superconducting loops
Collective properties of complex systems composed of many interacting components such as neurons in our brain can be modeled by artificial networks based on disordered systems. We show that a disordered neural network of superconducting loops with Josephson junctions can exhibit computational properties like categorization and associative memory in the time evolution of its state in response to information from external excitations. Superconducting loops can trap multiples of fluxons in many discrete memory configurations defined by the local free energy minima in the configuration space of all possible states. A memory state can be updated by exciting the Josephson junctions to fire or allow the movement of fluxons through the network as the current through them surpasses their critical current thresholds. Simulations performed with a lumped element circuit model of a 4-loop network show that information written through excitations is translated into stable states of trapped flux and their time evolution. Experimental implementation on a high-Tc superconductor YBCO-based 4-loop network shows dynamically stable flux flow in each pathway characterized by the correlations between junction firing statistics. Neural network behavior is observed as energy barriers separating state categories in simulations in response to multiple excitations, and experimentally as junction responses characterizing different flux flow patterns in the network. The state categories that produce these patterns have different temporal stabilities relative to each other and the excitations. This provides strong evidence for time-dependent (short-to-long-term) memories, that are dependent on the geometrical and junction parameters of the loops, as described with a network model.
Josephson junctions↗
GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects
Simulation-based approaches to microstructure generation can suffer from a variety of limitations, such as high memory usage, long computational times, and difficulties in generating complex geometries. Generative machine learning models present a way around these issues, but they have previously been limited by the fixed size of their generation area. Here, we present a new microstructure generation methodology leveraging advances in inpainting using denoising diffusion models to overcome this generation area limitation. We show that microstructures generated with the presented methodology are statistically similar to grain structures generated with a kinetic Monte Carlo simulator, SPPARKS.
36 MATERIALS SCIENCE↗
Structural insights into protection against a SARS-CoV-2 spike variant by T cell receptor diversity
T cells play a crucial role in combatting SARS-CoV-2 and forming long-term memory responses to this coronavirus. The emergence of SARS-CoV-2 variants that can evade T cell immunity has raised concerns about vaccine efficacy and the risk of reinfection. Some SARS-CoV-2 T cell epitopes elicit clonally restricted CD8 + T cell responses characterized by T cell receptors (TCRs) that lack structural diversity. Mutations in such epitopes can lead to loss of recognition by most T cells specific for that epitope, facilitating viral escape. Here, we studied an HLA-A2–restricted spike protein epitope (RLQ) that elicits CD8 + T cell responses in COVID-19 convalescent patients characterized by highly diverse TCRs. We previously reported the structure of an RLQ-specific TCR (RLQ3) with greatly reduced recognition of the most common natural variant of the RLQ epitope (T1006I). Opposite to RLQ3, TCR RLQ7 recognizes T1006I with even higher functional avidity than the WT epitope. To explain the ability of RLQ7, but not RLQ3, to tolerate the T1006I mutation, we determined structures of RLQ7 bound to RLQ–HLA-A2 and T1006I–HLA-A2. These complexes show that there are multiple structural solutions to recognizing RLQ and thereby generating a clonally diverse T cell response to this epitope that assures protection against viral escape and T cell clonal loss.
60 APPLIED LIFE SCIENCES↗
A physically-informed long short-term memory-based tool for predicting extensive droughts in the distant future
Not Available
Ghaffari, Ali (ORCID:0000000200169258)↗