Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “echo state networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

14 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Echo state network for coarsening dynamics of charge density waves

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its training process. Yet, despite the seemingly restricted learnable parameters, ESN has been shown to successfully capture the spatial-temporal dynamics of complex patterns. Here we build an ESN to model the coarsening dynamics of charge-density waves (CDWs) in a semiclassical Holstein model, which exhibits a checkerboard electron density modulation at half-filling stabilized by a commensurate lattice distortion. The inputs to the ESN are local CDW order parameters in a finite neighborhood centered around a given site, while the output is the predicted CDW order of the center site at the next time step. Special care is taken in the design of couplings between hidden layer and input nodes to ensure lattice symmetries are properly incorporated into the ESN model. Since the model predictions depend only on CDW configurations of a finite domain, the ESN is scalable and transferrable in the sense that a model trained on dataset from a small system can be directly applied to dynamical simulations on larger lattices. Furthermore, our work opens avenues for efficient dynamical modeling of pattern formations in functional electron materials.

2-dimensional systems↗
DOE OSTI2024

xesn: Echo state networks powered by Xarray and Dask

Xesn is a Python package that allows scientists to easily design Echo State Networks (ESNs) for forecasting problems. ESNs are a Recurrent Neural Network architecture introduced by Jaeger (2001) that are part of a class of techniques termed Reservoir Computing. One defining characteristic of these techniques is that all internal weights are determined by a handful of global, scalar parameters, thereby avoiding problems during backpropagation and reducing training time significantly. Because this architecture is conceptually simple, many scientists implement ESNs from scratch, leading to questions about computational performance. Xesn offers a straightforward, standard implementation of ESNs that operates efficiently on CPU and GPU hardware. The package leverages optimization tools to automate the parameter selection process, so that scientists can reduce the time finding a good architecture and focus on using ESNs for their domain application. Importantly, the package flexibly handles forecasting tasks for out-of-core, multi-dimensional datasets, eliminating the need to write parallel programming code. Xesn was initially developed to handle the problem of forecasting weather dynamics, and so it integrates naturally with Python packages that have become familiar to weather and climate scientists such as Xarray (Hoyer & Hamman, 2017). However, the software is ultimately general enough to be utilized in other domains where ESNs have been useful, such as in signal processing (Jaeger & Haas, 2004).

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2007

Identification and Control of Aircrafts using Multiple Models and Adaptive Critics

We compared two possible implementations of local linear models for control: one approach is based on a self-organizing map (SOM) to cluster the dynamics followed by a set of linear models operating at each cluster. Therefore the gating function is hard (a single local model will represent the regional dynamics). This simplifies the controller design since there is a one to one mapping between controllers and local models. The second approach uses a soft gate using a probabilistic framework based on a Gaussian Mixture Model (also called a dynamic mixture of experts). In this approach several models may be active at a given time, we can expect a smaller number of models, but the controller design is more involved, with potentially better noise rejection characteristics. Our experiments showed that the SOM provides overall best performance in high SNRs, but the performance degrades faster than with the GMM for the same noise conditions. The SOM approach required about an order of magnitude more models than the GMM, so in terms of implementation cost, the GMM is preferable. The design of the SOM is straight forward, while the design of the GMM controllers, although still reasonable, is more involved and needs more care in the selection of the parameters. Either one of these locally linear approaches outperform global nonlinear controllers based on neural networks, such as the time delay neural network (TDNN). Therefore, in essence the local model approach warrants practical implementations. In order to call the attention of the control community for this design methodology we extended successfully the multiple model approach to PID controllers (still today the most widely used control scheme in the industry), and wrote a paper on this subject. The echo state network (ESN) is a recurrent neural network with the special characteristics that only the output parameters are trained. The recurrent connections are preset according to the problem domain and are fixed. In a nutshell, the states of the reservoir of recurrent processing elements implement a projection space, where the desired response is optimally projected. This architecture trades training efficiency by a large increase in the dimension of the recurrent layer. However, the power of the recurrent neural networks can be brought to bear on practical difficult problems. Our goal was to implement an adaptive critic architecture implementing Bellman s approach to optimal control. However, we could only characterize the ESN performance as a critic in value function evaluation, which is just one of the pieces of the overall adaptive critic controller. The results were very convincing, and the simplicity of the implementation was unparalleled.

Principe, Jose C.↗
DOE OSTI2024

SQMS Quantum R&D in Machine Learning, Optimization and Sensing beyond Fundamental Physics Applications

This newly formed team at SQMS under the Ecosystem Thrust is looking to develop capabilities impacting societal advances outside the core domain of HEP and condensed matter physics. We explicitly leverage the experimental and algorithmic innovations developed across all groups as well as connect to broad-scope external projects of the diverse team of PIs. As the inaugural set of projects, we are studying numerically quantum machine learning models inspired by efficiently trainable echo-state and orthogonal neural networks and developing designs for related experiments to be performed on quantum processors based on SQMS SRF cQED technology and Rigetti s transmon arrays. Investigated models exploit ideas and lessons learned from multiple prior work by SQMS team members in a variety of internal and external activities [R1]. Target initial applications include noisy signal processing, potentially captured by quantum sensors or noisy QPUs, as well as simulation and classification of healthcare data. For instance, image reconstruction of the brain s electrical properties by solving the inverse Maxwell equation problem with uncertainty [R2] through a hybrid quantum-classical physics-informed architecture for time-dependent processes [R3]. The group is also investigating the application and development of novel quantum sensors based on magnetic levitation of a superconducting sphere coupled to a superconducting qubit. This coupling enables high-precision measurements of the position of the sphere, which can be used for sensitive detection of forces, enabling practical applications such as gravimetry for geophysics analysis, or accelerometry for GPS-denied navigation [R4] [R1] Rieffel, Eleanor G., Ata Akbari Asanjan, M. Sohaib Alam, Namit Anand, David E. Bernal Neira, Sophie Block, Lucas T. Brady et al. "Assessing and advancing the potential of quantum computing: A NASA case study." Future Generation Computer Systems (2024). [R2] Yu, X., Serrall s, J.E., Giannakopoulos, I.I., Liu, Z., Daniel, L., Lattanzi, R. and Zhang, Z., 2023. Pifon-ept: Mr-based electrical property tomography using physics-informed fourier networks. IEEE Journal on Multiscale and Multiphysics Computational Techniques. [R3] Wudarski, Filip, Daniel OConnor, Shaun Geaney, Ata Akbari Asanjan, Max Wilson, Elena Strbac, P. Aaron Lott, and Davide Venturelli. "Hybrid quantum-classical reservoir computing for simulating chaotic systems." arXiv preprint arXiv:2311.14105 (2023). [R4] Higgins, Gerard, Saarik Kalia, and Zhen Liu. "Maglev for dark matter: Dark-photon and axion dark matter sensing with levitated superconductors." Physical Review D 109.5 (2024): 055024.

Venturelli, Davide↗
DOE OSTI2025

A derecho climatology (2004–2021) in the United States based on machine learning identification of bow echoes

Due to their persistent widespread severe winds, derechos pose significant threats to human safety and property, with impacts comparable to many tornadoes and hurricanes. Yet, automated detection of derechos remains challenging due to the absence of spatiotemporally continuous observations and the complex criteria employed to define the phenomenon. This study presents an objective derecho detection approach capable of automatically identifying derechos through both observations and model results. The approach is grounded in a physically based definition of derechos and integrates three algorithms: (1) the Python Flexible Object Tracker (PyFLEXTRKR) algorithm to track mesoscale convective systems (MCSs), (2) a semantic segmentation convolutional neural network to identify bow echoes, and (3) a comprehensive classification algorithm to detect derechos within MCS life cycles and distinguish derecho-producing from non-derecho-producing MCSs. Using this approach, we developed a novel high-resolution (4 km and hourly) observational dataset of derechos and accompanying derecho-producing MCSs over the United States east of the Rocky Mountains from 2004 to 2021. The dataset consists of two subsets based on different gust speed data sources and is analyzed to document the climatology of derechos in the United States. On average, 12–15 derechos are identified per year, aligning with previous estimations (∼6–21 events annually). The spatial distribution and seasonal variation patterns are consistent with prior studies, showing peak occurrences in the Great Plains and the Midwest during the warm season. Additionally, during the study period, derechos account for approximately 3.1 % of measured damaging gusts (≥25.93 m s−1) over the eastern United States. The dataset is publicly available at https://doi.org/10.5281/zenodo.14835362 (Li et al., 2025).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Correlated Noise Estimation with Quantum Sensor Networks

We address the metrological problem of estimating collective stochastic properties imprinted on a network of quantum sensors. Canonical examples include center-of-mass quadrature fluctuations in a system of bosonic modes and correlated dephasing in an ensemble of qubits (e.g., spins), bosons, or fermions. We develop a theoretical framework to determine the limits of correlated (weak) noise estimation with quantum sensor networks and reveal the requirements for entanglement advantage. Notably, an advantage emerges from the synergistic interplay between quantum correlations of the sensors and “classical” correlations of the noises. Here, we determine optimal entangled probe states and identify a sensing protocol—reminiscent of a many-body echo—that achieves the fundamental limits of measurement sensitivity for a broad class of problems, unveiling a route toward entanglement-enhanced metrology of correlated many-body phenomena.

Quantum metrology↗
NASA NTRS2017

Detection of Hail Storms in Radar Imagery Using Deep Learning

In 2016, hail was responsible for 3.5 billion and 23 million dollars in damage to property and crops, respectively, making it the second costliest weather phenomenon in the United States. In an effort to improve hail-prediction techniques and reduce the societal impacts associated with hail storms, we propose a deep learning technique that leverages radar imagery for automatic detection of hail storms. The technique is applied to radar imagery from 2011 to 2016 for the contiguous United States and achieved a precision of 0.848. Hail storms are primarily detected through the visual interpretation of radar imagery (Mrozet al., 2017). With radars providing data every two minutes, the detection of hail storms has become a big data task. As a result, scientists have turned to neural networks that employ computer vision to identify hail-bearing storms (Marzbanet al., 2001). In this study, we propose a deep Convolutional Neural Network (ConvNet) to understand the spatial features and patterns of radar echoes for detecting hailstorms.

natural hazard↗
DOE OSTI2025

Insights into distorted lamellar phases with small-angle scattering and machine learning

Lamellar phases are essential in various soft matter systems, with topological defects significantly influencing their mechanical properties. In this report, we present a machine-learning approach for quantitatively analyzing the structure and dynamics of distorted lamellar phases using scattering techniques. By leveraging the mathematical framework of Kolmogorov–Arnold networks, we demonstrate that the conformations of these distorted phases – expressed as superpositions of complex waves – can be reconstructed from small-angle scattering intensities. Through the contour analysis of wave field phase singularities, we obtain the statistics of the spatial distribution of topological defects. Furthermore, we establish that the temporal evolution of these defects can be derived from the time-dependent traveling wave field, informed by the dispersion relation of spectral components. This method opens new avenues for investigating the dynamics of distorted lamellar phases using various dynamic scattering techniques such as neutron spin echo and X-ray photon correlation spectroscopy. These findings enhance our microscopic understanding of how defects influence the physical properties of lamellar materials, with implications for both equilibrium and non-equilibrium states in general lamellar systems.

36 MATERIALS SCIENCE↗
NASA NTRS1989

Environmental Projects. Volume 8: Modifications of wastewater evaporation ponds

The Goldstone Deep Space Communications Complex (GDSCC), located in the Mojave Desert about 45 miles north of Barstow, California, and about 160 miles northeast of Pasadena, is part of NASA's Deep Space Network, one of the world's largest and most sensitive scientific telecommunications and radio navigation networks. The Goldstone Complex is managed, technically directed, and operated for NASA by the Jet Propulsion Laboratory (JPL) of the California Institute of Technology in Pasadena, California. Activities at the GDSCC are carried out in support of seven parabolic dish antennas. These activities may give rise to environmental hazards: use of hazardous chemicals, asbestos, and underground storage tanks as well as the generation of hazardous wastes and the disposal of wastewater. Federal, state, and local laws governing the management of hazardous substances, asbestos, underground storage tanks and wastewater disposal have become so complex there is a need to devise specific programs to comply with the many regulations that implement these laws. In support of the national goal of the preservation of the environment and the protection of human health and safety, NASA, JPL, and the GDSCC have adopted a position that their operating installations shall maintain a high level of compliance with these laws. One of the environmental problems at the GDSCC involved four active, operational, wastewater evaporation ponds designed to receive and evaporate sewage effluent from upstream septic tank systems. One pair of active wastewater evaporation ponds is located at Echo Site, while another operational pair is at Mars Site.

Source record↗
NASA NTRS2012

The Kinematic and Microphysical Control of Storm Integrated Lightning Flash Extent

The objective of this preliminary study is to investigate the kinematic and microphysical control of lightning properties, particularly those that may govern the production of nitrogen oxides (NOx) in thunderstorms, such as flash rate, type and extent. The mixed-phase region is where the noninductive charging (NIC) process is thought to generate most storm electrification during rebounding collisions between ice particles in the presence of supercooled water. As a result, prior radar-based studies have demonstrated that lightning flash rate is well correlated to kinematic and microphysical properties in the mixed-phase region of thunderstorms such as updraft volume, graupel mass, or ice mass flux. There is also some evidence that lightning type is associated with the convective state. Intracloud (IC) lightning tends to dominate during the updraft accumulation of precipitation ice mass while cloud-to-ground (CG) lightning is more numerous during the downdraft-driven descent of radar echo associated with graupel and hail. More study is required to generalize these relationships, especially regarding lightning type, in a wide variety of storm modes and meteorological conditions. Less is known about the co-evolving relationship between storm kinematics, microphysics, morphology and three-dimensional flash extent, despite its importance for lightning NOx production. To address this conceptual gap, the NASA MSFC Lightning Nitrogen Oxides Model (LNOM) is applied to North Alabama Lightning Mapping Array (NALMA) and Vaisala National Lightning Detection NetworkTM (NLDN) observations following ordinary convective cells through their lifecycle. LNOM provides estimates of flash type, channel length distributions, lightning segment altitude distributions (SADs) and lightning NOx production profiles. For this study, LNOM is applied in a Lagrangian sense to well isolated convective cells on 3 April 2007 (single cell and multi-cell hailstorm, non-severe multicell) and 6 July 2007 (non-severe multi-cell) over Northern Alabama. The LNOM lightning characteristics are compared to the evolution of updraft and precipitation properties inferred from dual-Doppler and polarimetric radar analyses applied to observations from a nearby Doppler radar network, including the UA Huntsville Advanced Radar for Meteorological and Operational Research (ARMOR, C-band, polarimetric). The LNOM estimated SAD and lightning NOx production profiles are placed in the context of radar derived profiles of vertical motion, precipitation types and amounts. Finally, these analyses are used to determine if storm integrated flash channel extent is as well correlated to volumetric updraft and precipitation ice characteristics in the mixed phase region as flash rate for these individual convective cells.

Carey, Lawrence↗
DOE OSTI2025

Dynamic Interfacial Architectures: Cruciferin‐Stabilized Oil/Water Interfaces for Sustainable Emulsions

Stabilizing oil-water interfaces in emulsions by plant-based proteins provides sustainable and tunable ways for designing emulsions with specific properties, for food, healthcare, and pharmaceuticals. Cruciferin, a protein from rapeseed, has great potential as green emulsifier, but details about its structure and mobility at oil-water interfaces are largely unknown. Here, these properties are studied with small angle neutron and x-ray scattering, and neutron spin echo spectroscopy, analyzed by atomistic modelling of scattering curves and coarse-grained modelling, to gain insight into interface coverage, and molecular conformation and mobility at the interface. Cruciferin assumes trimeric conformations at the interface, as in solution, but with its protrusions from the central core of the subunits (“arms”) more compressed. Interfacial mobility is only marginally lower than in solution, indicating the arms still transiently extend and preserve a network, for the first time revealing the mechanism how cruciferin forms highly elastic 2d gel-like oil-water interfaces, as observed in macroscopic rheology. The high interfacial mobility may help in self-repairing non-stabilized interfacial fractions, reducing coalescence. These findings provide a deeper molecular level understanding of proteins at oil-water interfaces, which can stimulate development of new plant-based emulsion products, and contribute to the global protein transition.

cruciferin↗
NASA NTRS1992

Environmental projects. Volume 15: Environmental assessment: Proposed 1-megawatt radar transmitter at the Mars site

The Goldstone Deep Space Communications Complex (GDSCC), located in the Mojave Desert about 64.5 km (40 mi) north of Barstow, California. and about 258 km (160 mi) northeast of Pasadena, California, is part of the National Aeronautics and Space Administration's (NASA's) Deep Space Network (DSN), one of the world's larger and more sensitive scientific telecommunications and radio navigation networks. The Goldstone Complex is managed, technically directed, and operated for NASA by the Jet Propulsion Laboratory (JPL) of the California Institute of Technology in Pasadena, California. Activities at the GDSCC support the operation of six parabolic dish antennas located at five separate sites called Deep Space Stations (DSS's). Four sites, named Echo, Mars, Uranus, and Apollo, are operational for space missions, while the remaining Venus Site is devoted to research and development activities. The Mars Site at the GDSCC contains two antennas: the Uranus antenna (DSS 15, 34 m) and the Mars antenna (DSS 14, 70 m). This present volume deals solely with the DSS-14 Mars antenna. The Mars antenna not only can act as a sensitive receiver to detect signals from spacecraft, but it also can be used in radar astronomy as a powerful transmitter to send out signals to probe the solar system. At present, the Mars antenna operates as a continuous-wave microwave system at a frequency of 8.51 GHz at a power level of 0.5 MW. JPL has plans to upgrade the Mars antenna to a power level of 1 MW. Because of the anticipated increase in the ambient levels of radio frequency radiation (RFR), JPL retained Battelle Pacific Northwest Laboratories (BPNL), Richland, Washington, to conduct an environmental assessment with respect to this increased RFR. This present volume is a JPL-expanded version of the BPNL report titled Environmental Assessment of the Goldstone Solar System Radar, which was submitted to JPL in Nov. 1991. This BPNL report concluded that the operation of the upgraded Mars antenna at the GDSCC, with its increased potential electromagnetic radiation hazards and interferences, would have no significantly adverse biological, physical, or socioeconomic effects on the environment. Thus, a Finding of No Significant Impact (FONSI) is appropriate in accordance with local, State, Federal, and NASA environmental rules and regulations.

Source record↗
DOE OSTI2025

Erbium quantum memory platform with long optical coherence via back-end-of-line deposition on foundry-fabricated photonics

Realizing scalable quantum interconnects necessitates the integration of solid-state quantum memories with foundry photonics processes. While prior photonic integration efforts have relied upon specialized, laboratory-scale fabrication techniques, this work demonstrates the monolithic integration of a quantum memory platform with low-loss foundry photonic circuits via back-end-of-line deposition. We deposited thin films of titanium dioxide (Ti⁢O 2 ) doped with erbium (Er) onto silicon nitride nanophotonic waveguides and studied Er optical coherence at subkelvin temperatures with photon echo techniques. Furthermore, we suppressed optical dephasing through ex-situ oxygen annealing and optimized measurement conditions, which yielded an optical coherence time of 64 μ⁢s (a 5-kHz homogeneous linewidth) and slow spectral diffusion of 27 kHz over 4 ms, results that are comparable to state-of-the-art Er nanophotonic devices. Combined with second-long electron spin lifetimes and demonstrated electrical control of Er emission, our findings establish Er:Ti⁢O 2 on foundry photonics as a manufacturable platform for ensemble and single-ion quantum memories.

Electro-optic effects↗