Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Long Short-term Memory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

297 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Wattile: Probabilistic Deep Learning-based Forecasting of Building Energy Consumption [SWR-20-94]

Accurate energy forecasting is becoming critical due to many reasons: i ) optimal distributed energy resources operations and dispatch, ii) fault detection and diagnostics, and iii) meeting operational energy efficiency targets. Wattile uses deep learning (DL) for the building's short-term load forecasting application. Two specific types of neural networks called, Long Short Term Memory (LSTM) and Sequence-to-Sequence (S2S) models are used to make predictions. Forecasting models are trained using online historical weather and occupancy indicator data streams from the Intelligent Campus Program's data acquisition systems at the National Renewable Energy Laboratory (NREL) for main meters and sub-meters of multiple building types. These models use probabilistic methods to provide quantile-based forecasts in addition to nominal conditional median predictions of electricity consumption.

Frank, Stephen↗
DOE OSTI2020

Multi-Frequency Analysis of Simulated versus Observed Variability in Tropospheric Temperature

Studies seeking to identify a human-caused global warming signal generally rely on climate model estimates of the “noise” of intrinsic natural variability. Assessing the reliability of these noise estimates is of critical importance. We evaluate here the statistical significance of differences between climate model and observational natural variability spectra for global-mean mid- to upper-tropospheric temperature (TMT). We use TMT information from satellites and large multimodel ensembles of forced and unforced simulations. Our main goal is to explore the sensitivity of model-versus-data spectral comparisons to a wide range of subjective decisions. These include the choice of satellite and climate model TMT datasets, the method for separating signal and noise, the frequency range considered, and the statistical model used to represent observed natural variability. Of particular interest is the amplitude of the interdecadal noise against which an anthropogenic tropospheric warming signal must be detected. We find that on time scales of 5–20 years, observed TMT variability is (on average) overestimated by the last two generations of climate models participating in the Coupled Model Intercomparison Project. This result is relatively insensitive to different plausible analyst choices, enhancing confidence in previous claims of detectable anthropogenic warming of the troposphere and indicating that these claims may be conservative. A further key finding is that two commonly used statistical models of short-term and long-term memory have deficiencies in their ability to capture the complex shape of observed TMT spectra.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Heterosynaptic plasticity in biomembrane memristors controlled by pH

Abstract In biology, heterosynaptic plasticity maintains homeostasis in synaptic inputs during associative learning and memory, and initiates long-term changes in synaptic strengths that nonspecifically modulate different synapse types. In bioinspired neuromorphic circuits, heterosynaptic plasticity may be used to extend the functionality of two-terminal, biomimetic memristors. In this article, we explore how changes in the pH of droplet interface bilayer aqueous solutions modulate the memristive responses of a lipid bilayer membrane in the pH range 4.97–7.40. Surprisingly, we did not find conclusive evidence for pH-dependent shifts in the voltage thresholds ( V* ) needed for alamethicin ion channel formation in the membrane. However, we did observe a clear modulation in the dynamics of pore formation with pH in time-dependent, pulsed voltage experiments. Moreover, at the same voltage, lowering the pH resulted in higher steady-state currents because of increased numbers of conductive peptide ion channels in the membrane. This was due to increased partitioning of alamethicin monomers into the membrane at pH 4.97, which is below the pKa (~5.3–5.7) of carboxylate groups on the glutamate residues of the peptide, making the monomers more hydrophobic. Neutralization of the negative charges on these residues, under acidic conditions, increased the concentration of peptide monomers in the membrane, shifting the equilibrium concentrations of peptide aggregate assemblies in the membrane to favor greater numbers of larger, increasingly more conductive pores. It also increased the relaxation time constants for pore formation and decay, and enhanced short-term facilitation and depression of the switching characteristics of the device. Modulating these thresholds globally and independently of alamethicin concentration and applied voltage will enable the assembly of neuromorphic computational circuitry with enhanced functionality. Impact statement We describe how to use pH as a modulatory “interneuron” that changes the voltage-dependent memristance of alamethicin ion channels in lipid bilayers by changing the structure and dynamical properties of the bilayer. Having the ability to independently control the threshold levels for pore conduction from voltage or ion channel concentration enables additional levels of programmability in a neuromorphic system. In this article, we note that barriers to conduction from membrane-bound ion channels can be lowered by reducing solution pH, resulting in higher currents, and enhanced short-term learning behavior in the form of paired-pulse facilitation. Tuning threshold values with environmental variables, such as pH, provide additional training and learning algorithms that can be used to elicit complex functionality within spiking neural networks. Graphical abstract

36 MATERIALS SCIENCE↗
DOE OSTI2022

Short-Term Rainfall Prediction Based on Radar Echo Using an Improved Self-Attention PredRNN Deep Learning Model

Accurate short-term precipitation forecast is extremely important for urban flood warning and natural disaster prevention. In this paper, we present an innovative deep learning model named ISA-PredRNN (improved self-attention PredRNN) for precipitation nowcasting based on radar echoes on the basis of the advanced PredRNN-V2. We introduce the self-attention mechanism and the long-term memory state into the model and design a new set of gating mechanisms. To better capture different intensities of precipitation, the loss function with weights was designed. We further train the model using a combination of reverse scheduled sampling and scheduled sampling to learn the long-term dynamics from the radar echo sequences. Experimental results show that the new model (ISA-PredRNN) can effectively extract the spatiotemporal features of radar echo maps and obtain radar echo prediction results with a small gap from the ground truths. From the comparison with the other six models, the new ISA-PredRNN model has the most accurate prediction results with a critical success index (CSI) of 0.7001, 0.5812 and 0.3052 under the radar echo thresholds of 10 dBZ, 20 dBZ and 30 dBZ, respectively.

Wu, Dali (ORCID:0000000231177074)↗
NASA NTRS1979

On the design of a postprocessor for a search for extraterrestrial intelligence /SETI/ system

The design of an on-line postprocessor for a search for extraterrestrial intelligence (SETI) system is described. Signal processing tasks of the postprocessor include: (1) analysis of power level, phase coherence, and state of polarization of single-channel signals in a search for significant signals; (2) grouping or aggregation of adjacent channel data, time averaging of data; and (3) the detection of drifting and modulated signals. Control functions include multichannel spectrum analyzer frequency and clock control, system calibration and selfdiagnostic, control of data flow to and from short-term and long-term (archival) memories, and operation of detection subsystems, such as a visual display and a tunable receiver.

Healy, T. J.↗
NASA NTRS1987

Analytical design of intelligent machines

The problem of designing 'intelligent machines' to operate in uncertain environments with minimum supervision or interaction with a human operator is examined. The structure of an 'intelligent machine' is defined to be the structure of a Hierarchically Intelligent Control System, composed of three levels hierarchically ordered according to the principle of 'increasing precision with decreasing intelligence', namely: the organizational level, performing general information processing tasks in association with a long-term memory; the coordination level, dealing with specific information processing tasks with a short-term memory; and the control level, which performs the execution of various tasks through hardware using feedback control methods. The behavior of such a machine may be managed by controls with special considerations and its 'intelligence' is directly related to the derivation of a compatible measure that associates the intelligence of the higher levels with the concept of entropy, which is a sufficient analytic measure that unifies the treatment of all the levels of an 'intelligent machine' as the mathematical problem of finding the right sequence of internal decisions and controls for a system structured in the order of intelligence and inverse order of precision such that it minimizes its total entropy. A case study on the automatic maintenance of a nuclear plant illustrates the proposed approach.

Saridis, George N.↗
NASA NTRS2003

The Effect of Spaceflight on the Ultrastructure of the Cerebellum

In weightlessness, astronauts and cosmonauts may experience postural illusions as well as motion sickness symptoms known as the space adaptation syndrome. Upon return to Earth, they have irregularities in posture and balance. The adaptation to microgravity and subsequent re-adaptation to Earth occurs over several days. At the cellular level, a process called neuronal plasticity may mediate this adaptation. The term plasticity refers to the flexibility and modifiability in the architecture and functions of the nervous system. In fact, plastic changes are thought to underlie not just behavioral adaptation, but also the more generalized phenomena of learning and memory. The goal of this experiment was to identify some of the structural alterations that occur in the rat brain during the sensory and motor adaptation to microgravity. One brain region where plasticity has been studied extensively is the cerebellar cortex-a structure thought to be critical for motor control, coordination, the timing of movements, and, most relevant to the present experiment, motor learning. Also, there are direct as well as indirect connections between projections from the gravity-sensing otolith organs and several subregions of the cerebellum. We tested the hypothesis that alterations in the ultrastructural (the structure within the cell) architecture of rat cerebellar cortex occur during the early period of adaptation to microgravity, as the cerebellum adapts to the absence of the usual gravitational inputs. The results show ultrastructural evidence for neuronal plasticity in the central nervous system of adult rats after 24 hours of spaceflight. Qualitative studies conducted on tissue from the cerebellar cortex (specifically, the nodulus of the cerebellum) indicate that ultrastructural signs of plasticity are present in the cerebellar zones that receive input from the gravity-sensing organs in the inner ear (the otoliths). These changes are not observed in this region in cagematched ground control animals. The specific changes include the formation of lamellar bodies, profoundly enlarged Purkinje cell mitochondria, the presence of inter-neuronal cellular protrusions in the molecular layer, and signs of degeneration in the distal dendrites of the Purkinje cells. Since these morphologic signs are not apparent in the control animals, they are not likely to be due to caging or tissue processing effects. The particular nature of the structural alterations in the nodulus, most notably the formation of lamellar bodies and the presence of degeneration, further suggests that excitotoxicity (damaging overstimulation of neurons) may play a role in the short-term neural response to spaceflight. These findings suggest a structural basis for the neuronal and synaptic plasticity accompanying the central nervous system response to altered gravity and help identify the cellular bases underlying the vestibular abnormalities experienced by astronauts during periods of adaptation and re-adaptation to different gravitational forces. Also, since the short- and long-term changes in neural structure occurring during such periods of adaptation resemble the neuronal alterations that occur in some neurologic disorders such as stroke, these findings may offer guidance in the development of strategies for rehabilitation and treatment of such disorders.

Holstein, Gay R.↗
NASA NTRS1998

Working and strategic memory deficits in schizophrenia

Working memory and its contribution to performance on strategic memory tests in schizophrenia were studied. Patients (n = 18) and control participants (n = 15), all men, received tests of immediate memory (forward digit span), working memory (listening, computation, and backward digit span), and long-term strategic (free recall, temporal order, and self-ordered pointing) and nonstrategic (recognition) memory. Schizophrenia patients performed worse on all tests. Education, verbal intelligence, and immediate memory capacity did not account for deficits in working memory in schizophrenia patients. Reduced working memory capacity accounted for group differences in strategic memory but not in recognition memory. Working memory impairment may be central to the profile of impaired cognitive performance in schizophrenia and is consistent with hypothesized frontal lobe dysfunction associated with this disease. Additional medial-temporal dysfunction may account for the recognition memory deficit.

Memory Disorders/etiology/physiopathology↗
NASA NTRS2009

Got Mercury?

Many of the operational and payload lighting units used in various spacecraft contain elemental mercury. If these devices were damaged on-orbit, elemental mercury could be released into the cabin. Although there are plans to replace operational units with alternate light sources, such as LEDs, that do not contain mercury, mercury-containing lamps efficiently produce high quality illumination and may never be completely replaced on orbit. Therefore, exposure to elemental mercury during spaceflight will remain possible and represents a toxicological hazard. Elemental mercury is a liquid metal that vaporizes slowly at room temperature. However, it may be completely vaporized at the elevated operating temperatures of lamps. Although liquid mercury is not readily absorbed through the skin or digestive tract, mercury vapors are efficiently absorbed through the respiratory tract. Therefore, the amount of mercury in the vapor form must be estimated. For mercury releases from lamps that are not being operated, we utilized a study conducted by the New Jersey Department of Environmental Quality to calculate the amount of mercury vapor expected to form over a 2-week period. For longer missions and for mercury releases occurring when lamps are operating, we conservatively assumed complete volatilization of the available mercury. Because current spacecraft environmental control systems are unable to remove mercury vapors, both short-term and long-term exposures to mercury vapors are possible. Acute exposure to high concentrations of mercury vapors can cause irritation of the respiratory tract and behavioral symptoms, such as irritability and hyperactivity. Chronic exposure can result in damage to the nervous system (tremors, memory loss, insomnia, etc.) and kidneys (proteinurea). Therefore, the JSC Toxicology Group recommends that stringent safety controls and verifications (vibrational testing, etc.) be applied to any hardware that contains elemental mercury that could yield airborne mercury vapor concentrations greater than 0.1 mg/cu m in the total spacecraft atmosphere for exposures lasting 30 days or less or 0.01 mg/cu m mercury vapor for exposures lasting more than 30 days. We also encourage the use of alternative devices that do not contain mercury.

Meyers, Valerie E.↗