Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dynamic network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Dynamic machine learning-based optimization algorithm to improve boiler efficiency

With decreasing computational costs, improvement in algorithms, and the aggregation of large industrial and commercial datasets, machine learning is becoming a ubiquitous tool for process and business innovations. Machine learning is still lacking applications in the field of dynamic optimization for real-time control. This work presents a novel framework for performing constrained dynamic optimization using a recurrent neural network model combined with a metaheuristic optimizer. The framework is designed to augment an existing control system and is purely data-driven, like most industrial Model Predictive Control applications. Several recurrent neural network models are compared as well as several metaheuristic optimizers. Hyperparameters and optimizer parameters are tuned with parameter sweeps, and the resulting values are reported. Further, the best parameters for each optimizer and model combination are demonstrated in closed-loop control of a dynamic simulation, and several recommendations are made for generalizing this framework to other systems. Up to 0.953% improvement is realized over the non-optimized case for a simulated coal-fired boiler. While this is not a large improvement in percentage, the total economic impact is $991,000 per year, and this study builds a foundation for future machine learning with dynamic optimization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Quantum tensor network algorithms for evaluation of spectral functions on quantum computers

We investigate quantum algorithms derived from tensor networks to simulate the static and dynamic properties of quantum many-body systems. Using a sequentially prepared quantum circuit representation of a matrix product state (MPS) that we call a quantum tensor network (QTN), we demonstrate algorithms to prepare ground and excited states on a quantum computer and apply them to molecular nanomagnets (MNMs) as a paradigmatic example. In this setting, we develop two approaches for extracting the spectral correlation functions measured in neutron-scattering experiments: (a) a generalization of the SWAP test for computing wave function overlaps and, (b) a generalization of the notion of matrix product operators to the QTN setting which generates a linear combination of unitaries. The latter method is discussed in detail for translationally invariant spin-half systems, where it is shown to reduce the qubit resource requirements compared with the SWAP method and may be generalized to other systems. We demonstrate the versatility of our approaches by simulating spin-1/2 and spin-3/2 MNMs, with the latter being an experimentally relevant model of a Cr$^{3+}_{8}$ ring. Here, our approach has qubit requirements that are independent of the number of constituents of the many-body system and scale only logarithmically with the bond dimension of the MPS representation, making them appealing for implementation on near-term quantum hardware with mid-circuit measurement and reset.

Neutron scattering↗

Polarization- and Azimuth-Resolved Infrared Spectroscopy of Water on TiO2(110): Anisotropy and the Hydrogen-Bonding Network

We have investigated the structure and dynamics of thin water films adsorbed on TiO2(110) using infrared reflection absorption spectroscopy (IRAS) and ab-initio molecular dynamics. Infrared spectra were obtained for s- and p-polarized light with the plane of incidence parallel to the [001] and azimuths for water coverages ≤ 4 monolayers. The spectra indicate strong anisotropy in the water films. The vibrational densities of states predicted by the ab-initio simulations for 1 and 2 monolayer coverages agree well with the observations. The results provide unprecedented insight into the structure of water on TiO2(110) and resolve a long-standing puzzle regarding the hydrogen-bonding within thin water films on this surface. The results also demonstrate the capabilities of polarization- and azimuthally-resolved IRAS for investigating the structure and dynamics of adsorbates on dielectric substrates.

36 MATERIALS SCIENCE↗

Understanding Group/Party Affiliation Using Social Networks and Agent-Based Modeling

The dynamics of group affiliation and group dispersion is a concept that is most often studied in order for political candidates to better understand the most efficient way to conduct their campaigns. While political campaigning in the United States is a very hot topic that most politicians analyze and study, the concept of group/party affiliation presents its own area of study that producers very interesting results. One tool for examining party affiliation on a large scale is agent-based modeling (ABM), a paradigm in the modeling and simulation (M&S) field perfectly suited for aggregating individual behaviors to observe large swaths of a population. For this study agent based modeling was used in order to look at a community of agents and determine what factors can affect the group/party affiliation patterns that are present. In the agent-based model that was used for this experiment many factors were present but two main factors were used to determine the results. The results of this study show that it is possible to use agent-based modeling to explore group/party affiliation and construct a model that can mimic real world events. More importantly, the model in the study allows for the results found in a smaller community to be translated into larger experiments to determine if the results will remain present on a much larger scale.

Campbell, Kenyth↗

Measuring, Predicting and Visualizing Short-Term Change in Word Representation and Usage in VKontakte Social Network

Language in social media is extremely dynamic: new words emerge, trend and disappear, while the meaning of existing words can fluctuate over time. This work addresses several important tasks of visualizing and predicting short term text representation shift, i.e. the change in a word’s contextual semantics. We study the relationship between short-term concept drift and representation shift on a large social media corpus – VKontakte collected during the Russia-Ukraine crisis in 2014 – 2015. We visualize short-term representation shift for example keywords and build predictive models to forecast short-term shifts in meaning from previous meaning as well as from concept drift. We show that short-term representation shift can be accurately predicted up to several weeks in advance and that visualization provides insight into meaning change. Our approach can be used to explore and characterize specific aspects of the streaming corpus during crisis events and potentially improve other downstream classification tasks including real-time event forecasting in social media.

concept drift↗

Projection-Based linear constrained estimation and fusion over long-haul links

We study estimation and fusion with linear dynamics in long-haul sensor networks, wherein a number of sensors are remotely deployed over a large geographical area for performing tasks such as target tracking, and a remote fusion center serves to combine the information provided by these sensors in order to improve the overall tracking accuracy. In reality, the motion of a dynamic target might be subject to certain constraints, for instance, those defined by a road network. We explore the accuracy performance of projection-based constrained estimation and fusion methods that is affected by information loss over the long-haul links. We use an example to compare the tracking errors under various implementations of centralized and distributed projection-based estimation and fusion methods and demonstrate the effectiveness of using projection-based methods in these settings.

Rao, Nageswara S↗

Projection-Based Linear Constrained Estimation and Fusion over Long-Haul Links

In this work, we study estimation and fusion with linear dynamics in long-haul sensor networks, wherein a number of sensors are remotely deployed over a large geographical area for performing tasks such as target tracking, and a remote fusion center serves to combine the information provided by these sensors in order to improve the overall tracking accuracy. In reality, the motion of a dynamic target might be subject to certain constraints, for instance, those defined by a road network. We explore the accuracy performance of projection-based constrained estimation and fusion methods that is affected by information loss over the long-haul links. We use a tracking example to compare the tracking errors under various implementations of centralized and distributed projection-based estimation and fusion methods.

Rao, Nageswara S↗

Equivalence between classical and quantum dynamics. Neutral kaons and electric circuits

An equivalence between the Schroedinger dynamics of a quantum system with a finite number of basis states and a classical dynamics is presented. The equivalence is an isomorphism that connects in univocal way both dynamical systems. We treat the particular case of neutral kaons and found a class of electric networks uniquely related to the kaon system finding the complete map between the matrix elements of the effective Hamiltonian of kaons and those elements of the classical dynamics of the networks. As a consequence, the relevant {epsilon} parameter that measures CP violation in the kaon system is completely determined in terms of network parameters. - Highlights: > We provide a formal equivalence between classical and quantum dynamics. > We make use of the decomplexification concept. > Neutral kaon systems can be represented by electric circuits. > CP symmetry violation can be taken into account by non-reciprocity. > Non-reciprocity is represented by gyrators.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Methanol synthesis on ZnO(0001{sup ¯}). IV. Reaction mechanisms and electronic structure

Methanol synthesis from CO and H{sub 2} over ZnO, which requires high temperatures and high pressures giving rise to a complex interplay of physical and chemical processes over this heterogeneous catalyst surface, is investigated using ab initio simulations. The redox properties of the surrounding gas phase are known to directly impact on the catalyst properties and thus, set the overall catalytic reactivity of this easily reducible oxide material. In Paper III of our series [J. Kiss, J. Frenzel, N. N. Nair, B. Meyer, and D. Marx, J. Chem. Phys. 134, 064710 (2011)] we have qualitatively shown that for the partially hydroxylated and defective ZnO(0001{sup ¯}) surface there exists an intricate network of surface chemical reactions. In the present study, we employ advanced molecular dynamics techniques to resolve in detail this reaction network in terms of elementary steps on the defective surface, which is in stepwise equilibrium with the gas phase. The two individual reduction steps were investigated by ab initio metadynamics sampling of free energy landscapes in three-dimensional reaction subspaces. By also sampling adsorption and desorption processes and thus molecular species that are in the gas phase but close to the surface, our approach successfully generated several alternative pathways of methanol synthesis. The obtained results suggest an Eley-Rideal mechanism for both reduction steps, thus involving “near-surface” molecules from the gas phase, to give methanol preferentially over a strongly reduced catalyst surface, while important side reactions are of Langmuir-Hinshelwood type. Catalyst re-reduction by H{sub 2} stemming from the gas phase is a crucial process after each reduction step in order to maintain the catalyst's activity toward methanol formation and to close the catalytic cycle in some reaction channels. Furthermore, the role of oxygen vacancies, side reactions, and spectator species is investigated and mechanistic details are discussed based on extensive electronic structure analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Chaotic dynamics and diffusion in a piecewise linear equation

Genetic interactions are often modeled by logical networks in which time is discrete and all gene activity states update simultaneously. However, there is no synchronizing clock in organisms. An alternative model assumes that the logical network is preserved and plays a key role in driving the dynamics in piecewise nonlinear differential equations. We examine dynamics in a particular 4-dimensional equation of this class. In the equation, two of the variables form a negative feedback loop that drives a second negative feedback loop. By modifying the original equations by eliminating exponential decay, we generate a modified system that is amenable to detailed analysis. In the modified system, we can determine in detail the Poincaré (return) map on a cross section to the flow. By analyzing the eigenvalues of the map for the different trajectories, we are able to show that except for a set of measure 0, the flow must necessarily have an eigenvalue greater than 1 and hence there is sensitive dependence on initial conditions. Further, there is an irregular oscillation whose amplitude is described by a diffusive process that is well-modeled by the Irwin-Hall distribution. There is a large class of other piecewise-linear networks that might be analyzed using similar methods. The analysis gives insight into possible origins of chaotic dynamics in periodically forced dynamical systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Adaptive nonequilibrium design of actin-based metamaterials: Fundamental and practical limits of control

The adaptive and surprising emergent properties of biological materials self-assembled in far-from-equilibrium environments serve as an inspiration for efforts to design nanomaterials. In particular, controlling the conditions of self-assembly can modulate material properties, but there is no systematic understanding of either how to parameterize external control or how controllable a given material can be. Here, we demonstrate that branched actin networks can be encoded with metamaterial properties by dynamically controlling the applied force under which they grow and that the protocols can be selected using multi-task reinforcement learning. These actin networks have tunable responses over a large dynamic range depending on the chosen external protocol, providing a pathway to encoding “memory” within these structures. Interestingly, we obtain a bound that relates the dissipation rate and the rate of “encoding” that gives insight into the constraints on control—both physical and information theoretical. Taken together, these results emphasize the utility and necessity of nonequilibrium control for designing self-assembled nanostructures.

59 BASIC BIOLOGICAL SCIENCES↗

Modulation of structure and dynamics of water under alternating electric field and the role of hydrogen bonding

Using Molecular Dynamics simulations, we investigate the effect of alternating (AC) electric field on static and dynamic properties of water. Here, the central question we address is how hydrogen bonds respond to perpetual field-induced dipole reorientations. We assess structural perturbations of water network and changes of hydrogen bond dynamics in a range of alternating electric field strengths and frequencies using a non-polarizable water model, SPC/E, and two distinct polarizable models: SWM4-NDP and BK3. We confirm that AC field causes only moderate structural perturbations. Dynamic properties, including the rates of bond breaking, switching of hydrogen-bonding partners, and diffusion, accelerate with the strength of AC fields. All models reveal a nonmonotonic frequency dependence with fastest dynamics at frequencies around 200 GHz where the period of the field oscillation is commensurate with the average time it takes a typical proton to switch from one acceptor to another. Higher frequencies result in smaller amplitudes of angle oscillations and in reduced probability to complete the switch to another acceptor before the field reversal restores the original configuration. As frequency increases, these effects gradually weaken the influence of the field on the kinetics of hydrogen bonding and the associated rates of translational and rotational diffusion in water.

74 ATOMIC AND MOLECULAR PHYSICS↗

Functional expansion representations of artificial neural networks

In the past few years, significant interest has developed in using artificial neural networks to model and control nonlinear dynamical systems. While there exists many proposed schemes for accomplishing this and a wealth of supporting empirical results, most approaches to date tend to be ad hoc in nature and rely mainly on heuristic justifications. The purpose of this project was to further develop some analytical tools for representing nonlinear discrete-time input-output systems, which when applied to neural networks would give insight on architecture selection, pruning strategies, and learning algorithms. A long term goal is to determine in what sense, if any, a neural network can be used as a universal approximator for nonliner input-output maps with memory (i.e., realized by a dynamical system). This property is well known for the case of static or memoryless input-output maps. The general architecture under consideration in this project was a single-input, single-output recurrent feedforward network.

Gray, W. Steven↗

Transformer Neural Networks with Spatiotemporal Attention for Predictive Control and Optimization of Industrial Processes

In the context of real-time optimization and model predictive control of industrial systems, machine learning, and neural networks represent cutting-edge tools that hold promise for enhancing dynamic modeling. This work presents a novel transformer neural network architecture for real-time optimization and model predictive control. This network design includes a modified attention mechanism inspired by positional embedding attention from vision transformers and task-specific modifications to the input-output structure of the transformer’s decoder stack. Experiments were conducted using data from a 450 MW coal-fired power plant to evaluate this approach's effectiveness. The transformer neural network was compared with conventional recurrent models, including GRU and LSTM. The transformer exhibited a 6% increase in the R-squared (R2) value of predictions and an 83% reduction in mean squared error (MSE). Computation time was also reduced by 84% compared to conventional recurrent models.

Gallup, Ethan R.↗

Design of Neural Networks for Fast Convergence and Accuracy

A novel procedure for the design and training of artificial neural networks, used for rapid and efficient controls and dynamics design and analysis for flexible space systems, has been developed. Artificial neural networks are employed to provide a means of evaluating the impact of design changes rapidly. Specifically, two-layer feedforward neural networks are designed to approximate the functional relationship between the component spacecraft design changes and measures of its performance. A training algorithm, based on statistical sampling theory, is presented, which guarantees that the trained networks provide a designer-specified degree of accuracy in mapping the functional relationship. Within each iteration of this statistical-based algorithm, a sequential design algorithm is used for the design and training of the feedforward network to provide rapid convergence to the network goals. Here, at each sequence a new network is trained to minimize the error of previous network. The design algorithm attempts to avoid the local minima phenomenon that hampers the traditional network training. A numerical example is performed on a spacecraft application in order to demonstrate the feasibility of the proposed approach.

Maghami, Peiman G.↗

Generative Thermodynamic Computing

Here, we introduce a generative modeling framework for thermodynamic computing, in which structured data are synthesized from noise by the natural time evolution of a physical system governed by Langevin dynamics. While conventional diffusion models use neural networks to perform denoising, here the information needed to generate structure from noise is encoded by the dynamics of a thermodynamic system. Training proceeds by maximizing the probability with which the computer generates the reverse of a noising trajectory, which ensures that the computer generates data with minimal heat emission. We demonstrate this framework within a digital simulation of a thermodynamic computer. If realized in analog hardware, such a system would function as a generative model that produces structured samples without the need for artificially injected noise or active control of denoising.

Whitelam, Stephen [Lawrence Berkeley National Labo↗

Improving Cyber-Security of Smart Grid Systems via Anomaly Detection and Linguistic Domain Knowledge

The planned large scale deployment of smart grid network devices will generate a large amount of information exchanged over various types of communication networks. The implementation of these critical systems will require appropriate cyber-security measures. A network anomaly detection solution is considered in this work. In common network architectures multiple communications streams are simultaneously present, making it difficult to build an anomaly detection solution for the entire system. In addition, common anomaly detection algorithms require specification of a sensitivity threshold, which inevitably leads to a tradeoff between false positives and false negatives rates. In order to alleviate these issues, this paper proposes a novel anomaly detection architecture. The designed system applies the previously developed network security cyber-sensor method to individual selected communication streams allowing for learning accurate normal network behavior models. Furthermore, the developed system dynamically adjusts the sensitivity threshold of each anomaly detection algorithm based on domain knowledge about the specific network system. It is proposed to model this domain knowledge using Interval Type-2 Fuzzy Logic rules, which linguistically describe the relationship between various features of the network communication and the possibility of a cyber attack. The proposed method was tested on experimental smart grid system demonstrating enhanced cyber-security.

97 MATHEMATICS AND COMPUTING↗