Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “long memory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Photophysics of O-band and transition metal color centers in monolithic silicon for quantum communications

Color centers in the O-band (1260–1360 nm) are crucial for realizing long-coherence quantum network nodes in memory-assisted quantum communications. However, only a limited number of O-band color centers have been thoroughly explored in silicon hosts as spin-photon interfaces. This study explores and compares two promising O-band color centers in silicon for high-fidelity spin-photon interfaces: T and *Cu (transition metal) centers. During T center generation process, we observed the formation and dissolution of other color centers, including the copper-silver related centers with a doublet line around 1312 nm (*Cu$^0_n$), near the optical fiber zero dispersion wavelength (around 1310 nm). We then investigated the photophysics of both T and *Cu centers, focusing on their emission spectra and spin properties. The *Cu$^0_0$ line under a 0.5 T magnetic field demonstrated a 25% broadening, potentially due to spin degeneracy, suggesting that this center can be a promising alternative to T centers.

42 ENGINEERING↗
DOE OSTI2020

GentenMPI: Distributed Memory Sparse Tensor Decomposition

GentenMPl is a toolkit of sparse canonical polyadic (CP) tensor decomposition algorithms that is designed to run effectively on distributed-memory high-performance computers. Its use of distributed-memory parallelism enables it to efficiently decompose tensors that are too large for a single compute node's memory. GentenMPl leverages Sandia's decades-long investment in the Trilinos solver framework for much of its parallel-computation capability. Trilinos contains numerical algorithms and linear algebra classes that have been optimized for parallel simulation of complex physical phenomena. This work applies these tools to the data science problem of sparse tensor decomposition. In this report, we describe the use of Trilinos in GentenMPl, extensions needed for sparse tensor decomposition, and implementations of the CP-ALS (CP via alternating least squares) and GCP-SGD (generalized CP via stochastic gradient descent) sparse tensor decomposition algorithms. We show that GentenMPl can decompose sparse tensors of extreme size, e.g., a 12.6-terabyte tensor on 8192 computer cores. We demonstrate that the Trilinos backbone provides good strong and weak scaling of the tensor decomposition algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

EpiPro, a Novel, Synthetic, Activity-Regulated Promoter That Targets Hyperactive Neurons in Epilepsy for Gene Therapy Applications

Epileptogenesis is characterized by intrinsic changes in neuronal firing, resulting in hyperactive neurons and the subsequent generation of seizure activity. These alterations are accompanied by changes in gene transcription networks, first with the activation of early-immediate genes and later with the long-term activation of genes involved in memory. Our objective was to engineer a promoter containing binding sites for activity-dependent transcription factors upregulated in chronic epilepsy (EpiPro) and validate it in multiple rodent models of epilepsy. First, we assessed the activity dependence of EpiPro: initial electrophysiology studies found that EpiPro-driven GFP expression was associated with increased firing rates when compared with unlabeled neurons, and the assessment of EpiPro-driven GFP expression revealed that GFP expression was increased ~150× after status epilepticus. Following this, we compared EpiPro-driven GFP expression in two rodent models of epilepsy, rat lithium/pilocarpine and mouse electrical kindling. In rodents with chronic epilepsy, GFP expression was increased in most neurons, but particularly in dentate granule cells, providing in vivo evidence to support the “breakdown of the dentate gate” hypothesis of limbic epileptogenesis. Finally, we assessed the time course of EpiPro activation and found that it was rapidly induced after seizures, with inactivation following over weeks, confirming EpiPro’s potential utility as a gene therapy driver for epilepsy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

The neutrino gravitational memory from a core collapse supernova: phenomenology and physics potential

General Relativity predicts that the passage of matter or radiation from an asymmetrically-emitting source should cause a permanent change in the local space-time metric. This phenomenon, called the gravitational memory effect, has never been observed, however supernova neutrinos have long been considered a promising avenue for its detection in the future. With the advent of deci-Hertz gravitational wave interferometers, observing the supernova neutrino memory will be possible, with important implications for multimessenger astronomy and for tests of gravity. In this work, we develop a phenomenological (analytical) toy model for the supernova neutrino memory effect, which is overall consistent with the results of numerical simulations. This description is then generalized to several case studies of interest. We find that, for a galactic supernova, the dimensionless strain, h(t), is of order ~ 10 -22 - 10 -21 , and develops over a typical time scale that varies between ~ 0.1 - 10 s, depending on the time-evolution of the anisotropy of the neutrino emission. The characteristic strain, h c (f), has a maximum at a frequency f max ~ Script $\mathcal{O}$(10 -1 ) - Script $\mathcal{O}$(1) Hz. The detailed features of the time- and frequency-structure of the memory strain will inform us of the matter dynamics near the collapsed core, and allow to distinguish between different stellar collapse scenarios. Next generation gravitational wave detectors like DECIGO and BBO will be sensitive to the neutrino memory effect for supernovae at typical galactic distances and beyond; with Ultimate DECIGO exceeding a detectability distance of 10 Mpc

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Comparative study of the effects of prenatal sevoflurane exposure at different cortical stages on forebrain development and maturation in offspring

Introduction Brain development involves several critical stages, such as proliferation, neuronal migration, axonal pathfinding, and connection formation. Sevoflurane, a γ -aminobutyric acid (GABA) receptor agonist, is widely used as an inhaled general anesthetic. However, its impact on brain development has raised increasing concerns, particularly regarding prenatal exposure. This study aims to investigate the effects of prenatal sevoflurane exposure (PSE) at different cortical stages, focusing on its impact on the migration of glutamatergic and GABAergic neurons and neuronal behavior in offspring. Methods PSE was administered at two critical prenatal stages: embryonic day (E) 12.5 and E18.5. Double in situ hybridization was used to identify the coexpression of GABA receptors in Pax6- and Mash1-positive cells in the forebrain. The radial migration of glutamatergic neurons and the tangential migration of GABAergic neurons were analyzed. Behavioral tests, including the open-field test, elevated plus-maze test, forced swim test, tail suspension test, sucrose preference test, and Morris water maze, were performed on offspring to assess anxiety-like behaviors, depression, and learning and memory impairments. Results PSE inhibits the radial migration of glutamatergic neurons and promotes the tangential migration of GABAergic neurons. Specifically, early exposure (E12.5) inhibited the expression of the Pax6–Tbr2–Tbr1 cascade and the radial migration of Tbr1 in the ventral prefrontal cortex (PFC), whereas late exposure (E18.5) inhibited this process on the dorsal side. In addition, offspring mice with PSE exhibited increased anxiety-like behaviors, rather than depression, as demonstrated by reduced time spent in the center of the open-field test and in the open arms of the elevated plus-maze test. No significant differences were observed in the forced swim test, tail suspension test, or sucrose preference test. Furthermore, learning and memory impairments were observed in the Morris water maze. Conclusion Our results indicate that PSE at E12.5 and E18.5 leads to abnormalities in the migration of glutamatergic and GABAergic neurons, affecting long-term anxiety-like behaviors and causing learning and memory impairments in offspring mice.

Wang, Tianyuan↗
DOE OSTI2024

Diabatic Eddy Forcing Increases Persistence and Opposes Propagation of the Southern Annular Mode in MERRA-2

Abstract As a dominant mode of jet variability on subseasonal time scales, the Southern Annular Mode (SAM) provides a window into how the atmosphere can produce internal oscillations on longer-than-synoptic time scales. While SAM’s existence can be explained by dry, purely barotropic theories, the time scale for its persistence and propagation is set by a lagged interaction between barotropic and baroclinic mechanisms, making the exact physical mechanisms challenging to identify and to simulate, even in latest generation models. By partitioning the eddy momentum flux convergence in MERRA-2 using an eddy–mean flow interaction framework, we demonstrate that diabatic processes (condensation and radiative heating) are the main contributors to SAM’s persistence in its stationary regime, as well as the key for preventing propagation in this regime. In SAM’s propagating regime, baroclinic and diabatic feedbacks also dominate the eddy–jet feedback. However, propagation is initiated by barotropic shifts in upper-level wave breaking and then sustained by a baroclinic response, leading to a roughly 60-day oscillation period. This barotropic propagation mechanism has been identified in dry, idealized models, but here we show evidence of this mechanism for the first time in reanalysis. The diabatic feedbacks on SAM are consistent with modulation of the storm-track latitude by SAM, altering the emission temperature and cloud cover over individual waves. Therefore, future attempts to improve the SAM time scale in models should focus on the storm-track location, as well as the roles of the cloud and moisture parameterizations. Significance Statement As they circumnavigate the planet, the tropospheric jet streams slowly drift north and south over about 30 days, longer than the normal limit of weather prediction. Understanding the source of this “memory” could improve our knowledge of how the atmosphere organizes itself and our ability to make long-term forecasts. Current theories have identified several possible internal atmospheric interactions responsible for this memory. Yet most of the theories for understanding the jets’ behavior assume that this behavior is only weakly influenced by atmospheric water vapor. We show that this assumption is not enough to understand jet persistence. Instead, clouds and precipitation are more important contributors in reanalysis data than internal “dry” mechanisms to this memory of the Southern Hemisphere jet.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Subspace-Driven Learning for Anomaly Detection in Process Transients

Nuclear power plant (NPP) monitoring and diagnostic centers are actively investigating and implementing automated anomaly detection algorithms to help plants catch anomalies sooner, thereby preventing or reducing the duration of unexpected shutdowns. Current machine learning-based anomaly detection methods are expected to be highly effective during stable, full-power operations because NPPs typically operate as baseload power generators, meaning there are extensive operating data available from plant equipment. However, it is expected that anomaly detection methods will face significant challenges during transient conditions (i.e., when power output falls below full power) because plants only occasionally operate at these lower power levels, generating sparse transient operational data, and resulting in false alarms or missed detections. Here, to address this issue, transfer learning is used, which for this problem leverages knowledge (in the form of learned features) from stable, full-power operations to improve detection accuracy during transient conditions, even with limited data. In this effort, a novel subspace approach is developed to transfer a subset of the data features from full power operation to transients. This approach is validated through experiments using synthetic data and was found to outperform two baseline transfer learning approaches in anomaly detection performance across a range of amounts of transient data used in the training process.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
DOE OSTI2024

Automated Framework for Groundwater Monitoring Using DWT with LSTM and Transformers

Environmental monitoring is critical for safeguarding public health and ecological well-being. Traditional data structuring and workflow monitoring methods consume significant time and effort, hindering timely insights and effective decision-making. Our study addresses this challenge by presenting an AI framework that automates data cleaning, structuring, and modeling processes, specifically targeting applications in groundwater monitoring. By leveraging automation for data processing and model training, our framework establishes a novel and efficient paradigm for environmental monitoring, with its potential application to the vast network of over a hundred Department of Energy Environmental Management (DoE-EM) cleanup sites across the country. It analyzes data streams from a network of groundwater Internet-of-Things (IoT) sensors deployed at the Savannah River Site (SRS) for prediction modeling. This allows human experts to focus on analysis and decision-making, ultimately leading to better environmental outcomes.The framework employs multivariate time-series forecasting methods to study and model the behavior of varying chemical analytes. The continuous learning process is enabled by utilizing deep learning techniques. It allows the framework to become more nuanced in its analysis over time, adapting to the specific characteristics of the environmental site and the evolving nature of contaminant behavior. Deep learning models known for sequence modeling, LSTM, and Transformers are employed for time series forecasting. Data processing and structuring are essential components significantly impacting the final model's performance. This hypothesis was proven by presenting a comparative analysis of model performance with processed and unprocessed data. The feature engineering approach utilized was the Discrete Wavelet Transform, which works well with time series data.

Discrete Wavelet Transform (DWT)↗
DOE OSTI2024

Overview of RFID Applications Utilizing Neural Networks

As Radio Frequency Identification (RFID) methods continue to evolve to higher levels of complexity, one form of machine learning is making its appearance. The use of Neural Networks (NN) in the RFID field is steadily increasing, and in the fields of localization and activity recognition, promising results are being shown from a variety of research. RFID applications fall primarily under two types of problems including regression and classification. We analyze RIFD localization techniques which fall under regression, and activity recognition which falls under classification. Many works don’t classify themselves as activity recognition methods, but because they fall under the classification category, we still consider them as activity recognition techniques. This research overviews the Neural Network models in the localization field based on whether they can perform independently of the environment in which they were tested. For activity recognition and accessory fields, the major methods involve tag-based and tag-free approaches. In conclusion, after the models are surveyed, a comparison study is given to examine what may be the cause for increased accuracy between different Neural Network models.

42 ENGINEERING↗
DOE OSTI2023

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decom- pose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high- level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗
DOE OSTI2021

Deep Cellular Recurrent Network for Efficient Analysis of Time-Series Data With Spatial Information

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high dimensional data. Deep recurrent neural networks have shown promise in automated feature learning for improved time-series processing. However, generic deep recurrent models grow in scale and depth with increased complexity of the data. This is particularly challenging in presence of high dimensional data with temporal and spatial characteristics. Consequently, this work proposes a novel deep cellular recurrent neural network (DCRNN) architecture to efficiently process complex multi-dimensional time series data with spatial information. Here, the cellular recurrent architecture in the proposed model allows for location-aware synchronous processing of time series data from spatially distributed sensor signal sources. Extensive trainable parameter sharing due to cellularity in the proposed architecture ensures efficiency in the use of recurrent processing units with high-dimensional inputs. This study also investigates the versatility of the proposed DCRNN model for classification of multi-class time series data from different application domains. Consequently, the proposed DCRNN architecture is evaluated using two time-series datasets: a multichannel scalp EEG dataset for seizure detection, and a machine fault detection dataset obtained in-house. The results suggest that the proposed architecture achieves state-of-the-art performance while utilizing substantially less trainable parameters when compared to comparable methods in the literature.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Comparative Analysis of ANN and LSTM Prediction Accuracy and Cooling Energy Savings through AHU-DAT Control in an Office Building

This paper proposes the optimal algorithm for controlling the HVAC system in the target building. Previous studies have analyzed pre-selected algorithms without considering the unique data characteristics of the target building, such as location, climate conditions, and HVAC system type. To address this, we compare the accuracy of cooling load prediction using ANN and LSTM algorithms, widely used in building energy research, to determine the optimal algorithm for HVAC control in the target building. We develop a simulation model calibrated with actual data to ensure data reliability and compare the energy consumption of the existing HVAC control method and the two algorithms-based methods. Results show that the ANN algorithm, with a CV(RMSE) of 12.7%, has a higher prediction accuracy than the LSTM algorithm, CV(RMSE) of 17.3%, making it a more suitable algorithm for HVAC control. Furthermore, implementing the ANN-based approach results in a 3.2% cooling energy reduction from the optimal control of Air Handling Unit (AHU) Discharge Air Temperature (DAT) compared to the fixed DAT at 12.8 °C in a representative day. This study demonstrates that ML-based HVAC system control can effectively reduce cooling energy consumption in HVAC systems, providing an effective strategy for energy conservation and improved HVAC system efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An Evolve-Then-Correct Reduced Order Model for Hidden Fluid Dynamics

In this paper, we put forth an evolve-then-correct reduced order modeling approach that combines intrusive and nonintrusive models to take hidden physical processes into account. Specifically, we split the underlying dynamics into known and unknown components. In the known part, we first utilize an intrusive Galerkin method projected on a set of basis functions obtained by proper orthogonal decomposition. We then present two variants of correction formula based on the assumption that the observed data are a manifestation of all relevant processes. The first method uses a standard least-squares regression with a quadratic approximation and requires solving a rank-deficient linear system, while the second approach employs a recurrent neural network emulator to account for the correction term. We further enhance our approach by using an orthonormality conforming basis interpolation approach on a Grassmannian manifold to address off-design conditions. The proposed framework is illustrated here with the application of two-dimensional co-rotating vortex simulations under modeling uncertainty. The results demonstrate highly accurate predictions underlining the effectiveness of the evolve-then-correct approach toward real-time simulations, where the full process model is not known a priori.

long short-term memory↗
DOE OSTI2023

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decompose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep-learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high-level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for a one-year lead hourly load below $5\%$ MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗
DOE OSTI2023

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM: Preprint

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decompose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep-learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high-level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for a one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗