Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network robustness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Learning to train neural networks for real-world control problems

Over the past three years, our group has concentrated on the application of neural network methods to the training of controllers for real-world systems. This presentation describes our approach, surveys what we have found to be important, mentions some contributions to the field, and shows some representative results. Topics discussed include: (1) executing model studies as rehearsal for experimental studies; (2) the importance of correct derivatives; (3) effective training with second-order (DEKF) methods; (4) the efficacy of time-lagged recurrent networks; (5) liberation from the tyranny of the control cycle using asynchronous truncated backpropagation through time; and (6) multistream training for robustness. Results from model studies of automotive idle speed control serve as examples for several of these topics.

Feldkamp, Lee A.↗

Identification and interpretation of patterns in rocket engine data: Artificial intelligence and neural network approaches

This paper describes an expert system which is designed to perform automatic data analysis, identify anomalous events, and determine the characteristic features of these events. We have employed both artificial intelligence and neural net approaches in the design of this expert system. The artificial intelligence approach is useful because it provides (1) the use of human experts' knowledge of sensor behavior and faulty engine conditions in interpreting data; (2) the use of engine design knowledge and physical sensor locations in establishing relationships among the events of multiple sensors; (3) the use of stored analysis of past data of faulty engine conditions; and (4) the use of knowledge-based reasoning in distinguishing sensor failure from actual faults. The neural network approach appears promising because neural nets (1) can be trained on extremely noisy data and produce classifications which are more robust under noisy conditions than other classification techniques; (2) avoid the necessity of noise removal by digital filtering and therefore avoid the need to make assumptions about frequency bands or other signal characteristics of anomalous behavior; (3) can, in effect, generate their own feature detectors based on the characteristics of the sensor data used in training; and (4) are inherently parallel and therefore are potentially implementable in special-purpose parallel hardware.

Ali, Moonis↗

Diurnal Cycle of Convection in the East Pacific ITCZ during EPIC-2001

During the last three weeks of September 2001, the EPIC-2001 intensive field campaign focused on studies of deep convection in the ITCZ over the Mexican warm pool region (10N, 95W) of the East Pacific. This study focuses on the pronounced observed diurnal cycle of environmental and convective parameters within the experiment domain. Data from three primary sources are examined: the R/V Ronald H. Brown C-band weather radar, 4-hourly soundings from the Brown and the Global Atmospherics, Inc. National Lightning Detection Network (long range product). Satellite data from TRMM, GOES and OV-1 are also used. The domain boundary layer shows a robust daily evolution of moist enthalpy (as reflect by equivalent potential temperature, theta-e, or wet bulb potential temperature, theta-w), with contributions from changes in both dry and moist entropy. Peak theta-w is found after local nightfall; the average diurnal range of theta-w is approximately 1 deg C. A composite diurnal cycle of convective properties was derived from the C-band volume scans, sampled continuously through the experiment at 10 minute updates. Products derived from the volumetric data include a surface PPI, 15 and 30 dBZ echo top height, vertically integrated liquid, and 6 km (mixed phase region) reflectivity CAPPIs. For almost all products, the parameter means showed virtually no diurnal cycle. However, for the upper-level products, the parameter spectra showed a clear peak in the occurrence of deep/vigorous convection (the "tail end of the distribution") between 7-9 UTC (1-3 AM local), while overall frequency of occurrence peaked later, from 12-15 UTC (6-9 AM local). This represents a daily "outbreak" of isolated deep cells a couple of hours after sunset and subsequent growth, organization and decay through the nighttime hours. The coherence of the diurnal cycle of the convective spectrum is impressive given the wide variety of convective organization observed during the experiment, and given the modulation by passage of 3-5 day easterly waves. While earlier satellite OLR composites suggested an offshore coastal migration of storms into the domain at night, examination of the 150 km and 300 km range radar products showed little evidence of such organization; almost all convection developed "in-place" within the analysis domain. Consistent with the diurnal thermodynamic and microphysical evolution, a clear cycle in cloud-to-ground (CG) lightning occurrence was observed. The local CG diurnal cycle is significantly stronger than the satellite-derived tropical ocean diurnal cycle of total (IC+CG) lightning. Flash rates of 3-4 fl/min were often visually observed after nightfall; these are fairly 'healthy' flash rates for tropical ocean storms, and the domain was qualitatively noted to be unusually lightning-productive by the R/V Brown crew (also consistent with satellite-based climatologies).

Boccippio, Dennis J.↗

Exploring Black-box Adversarial Attacks on Low-rank Constrained Neural Networks

Low-rank compression has been shown as an effective tool to reduce parameter counts of convolutional and vision transformer architectures; however, low-rank training often reduces model robustness to adversarial perturbations. In this work, we explore the effects of low-rank training on black-box attacks, where attacked images are generated without knowledge of the low-rank parameters. We find that low-rank training is not sufficient as a black-box defense and can sometimes produce worse than expected as compared to baseline models. Influencing the spectrum of the low-rank models during training, which is known to increase model robustness against white-box attacks, improves black-box performance as well.

Schnake, Stefan [ORNL] (ORCID:0000000215183538)↗

Distributed Sensor Coordination for Advanced Energy Systems

The ability to collect key system level information is critical to the safe, efficient and reliable operation of advanced energy systems. With recent advances in sensor development, it is now possible to push some level of decision making directly to computationally sophisticated sensors, rather than wait for data to arrive to a massive centralized location before a decision is made. This type of approach relies on networked sensors (called “agents” from here on) to actively collect and process data, and provide key control decisions to significantly improve both the quality/relevance of the collected data and the associating decision making. The technological bottlenecks for such sensor networks stem from a lack of mathematics and algorithms to manage the systems, rather than difficulties associated with building and deploying them. Indeed, traditional sensor coordination strategies do not provide adequate solutions for this problem. Passive data collection methods (e.g., large sensor webs) can scale to large systems, but are generally not suited to highly dynamic environments, such as advanced energy systems, where crucial decisions may need to be reached quickly and locally. Approaches based on local decisions on the other hand cannot guarantee that each agent performing its task (maximize an agent objective) will lead to good network wide solution (maximize a network objective) without invoking cumbersome coordination routines. There is currently a lack of algorithms that will enable self-organization and blend the efficiency of local decision making with the system level guarantees of global decision making, particularly when the systems operate in dynamic and stochastic environments. In this work we addressed this critical gap and provided a comprehensive solution to the problem of sensor coordination to ensure the safe, reliable, and robust operation of advanced energy systems. The differentiating aspect of the proposed work is in shifting the focus towards “what to observe” rather than “how to observe” in large sensor networks, allowing the agents to actively determine both the structure of the network and the relevance of the information they are seeking to collect. In addition to providing an implicit coordination mechanism, this approach allows the system to be reconfigured in response to changing needs (e.g., sudden external events requiring new responses) or changing sensor network characteristics (e.g., sudden changes to plant condition). Outcome Summary: All milestones associated with this project have been completed. In particular, private sensor objective functions were developed which are aligned with the global objective function, sensor effectiveness has been improved by using “sensor teams,” system efficiency has been improved by 30% using difference evaluation functions, we have demonstrated system reconfigurability for 20% changes in system conditions, we have demonstrated extreme scalability of our proposed algorithm, we have demonstrated that sensor networks can overcome disruptions of up to 20% in network conditions, and have demonstrated system reconfigurability to 20% changes in system conditions in hardware-based simulations. This final report summarizes how each of these milestones was achieved, and gives insight into future research possibilities past the work which has been completed. The following publications support these milestones [6, 8, 9, 10, 16, 18, 19].

97 MATHEMATICS AND COMPUTING↗

Enhanced memory performance thanks to neural network assortativity

The behaviour of many complex dynamical systems has been found to depend crucially on the structure of the underlying networks of interactions. An intriguing feature of empirical networks is their assortativity--i.e., the extent to which the degrees of neighbouring nodes are correlated. However, until very recently it was difficult to take this property into account analytically, most work being exclusively numerical. We get round this problem by considering ensembles of equally correlated graphs and apply this novel technique to the case of attractor neural networks. Assortativity turns out to be a key feature for memory performance in these systems - so much so that for sufficiently correlated topologies the critical temperature diverges. We predict that artificial and biological neural systems could significantly enhance their robustness to noise by developing positive correlations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Model for Effective Professional Development of Formal Science Educators

The Lunar Workshops for Educators (LWE) series was developed by the Lunar Reconnaissance Orbiter (LRO) education team in 2010 to provide professional development on lunar science and exploration concepts for grades 6-9 science teachers. Over 300 educators have been trained to date. The LWE model incorporates best practices from pedagogical research of science education, thoughtful integration of scientists and engineer subject matter experts for both content presentations and informal networking with educators, access to NASA-unique facilities, hands-on and data-rich activities aligned with education standards, exposure to the practice of science, tools for addressing common misconceptions, follow-up with participants, and extensive evaluation. Evaluation of the LWE model via pre- and post-assessments, daily workshop surveys, and follow-up surveys at 6-month and 1-year intervals indicate that the LWE are extremely effective in increasing educators' content knowledge, confidence in incorporating content into the classroom, understanding of the practice of science, and ability to address common student misconceptions. In order to address the efficacy of the LWE model for other science content areas, the Dynamic Response of Environments at Asteroids, the Moon, and moons of Mars (DREAM2) education team, funded by NASA's Solar System Exploration Research Virtual Institute, developed and ran a pilot workshop called Dream2Explore at NASA's Goddard Space Flight Center in June, 2015. Dream2Explore utilized the LWE model, but incorporated content related to the science and exploration of asteroids and the moons of Mars. Evaluation results indicate that the LWE model was effectively used for educator professional development on non-lunar content. We will present more detail on the LWE model, evaluation results from the Dream2Explore pilot workshop, and suggestions for the application of the model with other science content for robust educator professional development.

Orbiter↗

Specifying angular reference for robust three-phase state estimation

While the phase angle of any of the bus voltages can be chosen as the angular reference in the state estimation formulation of positive sequence networks, the same approach does not readily extend to three-phase network state estimation problem. It is commonly assumed that there is at least one bus where the bus voltages are perfectly balanced with phase angles displaced ±120° and these balanced three phase voltages are used as the three-phase reference in solving the three-phase state estimation problem. This assumption may be quite realistic in transmission networks, and for distribution networks with a strong transmission system connection. However, it might not be realistic to assume existence of a perfectly balanced reference bus in today’s distribution systems with ever increasing penetration of renewable sources or for isolated operation of microgrids. In this paper, a novel state estimation formulation will be presented which facilitates correct solution irrespective of the existence of buses with perfectly balanced voltages. The new formulation is general, and lends itself to bad data processing. It yields accurate results in any three-phase power system irrespective of its operating conditions (balanced or highly unbalanced), configuration (isolated microgrid, connected to transmission system, etc.) and whether or not it contains any synchronous generators. The performance of the method is validated using the IEEE 123 bus three-phase system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Chaos control of the micro-electro-mechanical resonator by using adaptive dynamic surface technology with extended state observer

This paper addresses chaos control of the micro-electro- mechanical resonator by using adaptive dynamic surface technology with extended state observer. To reveal the mechanism of the micro- electro-mechanical resonator, the phase diagrams and corresponding time histories are given to research the nonlinear dynamics and chaotic behavior, and Homoclinic and heteroclinic chaos which relate closely with the appearance of chaos are presented based on the potential function. To eliminate the effect of chaos, an adaptive dynamic surface control scheme with extended state observer is designed to convert random motion into regular motion without precise system model parameters and measured variables. Putting tracking differentiator into chaos controller solves the ‘explosion of complexity’ of backstepping and poor precision of the first-order filters. Meanwhile, to obtain high performance, a neural network with adaptive law is employed to approximate unknown nonlinear function in the process of controller design. The boundedness of all the signals of the closed-loop system is proved in theoretical analysis. Finally, numerical simulations are executed and extensive results illustrate effectiveness and robustness of the proposed scheme.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonlinear Multiple Models Adaptive Secondary Voltage Control of Microgrids

This article proposes a model-free secondary voltage control (SVC) for microgrids (MG) using nonlinear multiple models adaptive control. Firstly, a linear robust adaptive controller is designed to guarantee the voltage stability in the bounded-input- bounded-output (BIBO) manner so as to meet the operation requirements of MGs. Secondly, a nonlinear adaptive controller is developed to improve the voltage tracking performance with the help of artificial neural networks (ANNs). A switching mechanism for coordinating such two controllers is designed to guarantee the closed-loop stability while achieving accurate voltage tracking. Here, by an online identification based on the input and output data of MGs, the proposed method does not resort to any apriori information of system model and primary control, thus exhibiting good robustness, ease of deployment and disturbance rejection.

17 WIND ENERGY↗

QC-GN 2 oMS 2 : a Graph Neural Net for High Resolution Mass Spectra Prediction

Predicting the mass spectrum of a molecular ion is often accomplished via three generalized approaches: rules-based methods for bond breaking, deep learning, or quantum chemical (QC) modeling. Rules-based approaches are often limited by the conditions for different chemical subspaces and perform poorly under chemical regimes with few defined rules. QC modeling is theoretically robust but requires significant amounts of computational time to produce a spectrum for a given target. Among deep learning techniques, graph neural networks (GNNs) have performed better than previous work with fingerprint-based neural networks in mass spectra prediction. To explore this technique further, we investigate the effects of including quantum chemically derived information as edge features in the GNN to increase predictive accuracy. The models we investigated include categorical bond order, bond force constants derived from extended tight-binding (xTB) quantum chemistry, and acyclic bond dissociation energies. Throughout this work, we evaluated these models against a control GNN with no edge features in the input graphs. Bond dissociation enthalpies yielded the best improvement with a cosine similarity score of 0.462 relative to the baseline model (0.437). In this work we also apply dynamic graph attention which improves performance on benchmark problems and supports the inclusion of edge features. Between implementations, we investigate the nature of the molecular embedding for spectra prediction and discuss the recognition of fragment topographies in distinct chemistries for further development in tandem mass spectrometry prediction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiterminal Inverse AC Josephson Effect

When a Josephson junction is exposed to microwave radiation, it undergoes the inverse AC Josephson effect–the phase of the junction locks to the drive frequency. As a result, the I–V curves of the junction acquire “Shapiro steps” of quantized voltage. If the junction has three or more superconducting contacts, coupling between different pairs of terminals must be taken into account and the state of the junction evolves in a phase space of higher dimensionality. Here, we study the multiterminal inverse AC Josephson effect in a graphene sample with three superconducting terminals. We observe robust fractional Shapiro steps and correlated switching events, which can only be explained by considering the device as a completely connected Josephson network. We successfully simulate the observed behaviors using a modified two-dimensional RCSJ model. Our results suggest that multiterminal Josephson junctions are a playground to study highly connected nonlinear networks with novel topologies.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

From predicting to learning dissipation from pair correlations of active liquids

Active systems, which are driven out of equilibrium by local non-conservative forces, can adopt unique behaviors and configurations. Towards designing such materials, an important challenge is to precisely connect the static structure of active systems to the dissipation of energy induced by the local driving. Here, we use tools from liquid-state theories and machine learning to take on these challenges. We first demonstrate analytically for an isotropic active matter system that dissipation and pair correlations are closely related when driving forces behave like an active temperature. We then extend a nonequilibrium mean-field framework for predicting these pair correlations which, unlike most existing approaches, is applicable even for strongly interacting particles and far from equilibrium, to predict dissipation in these systems. Based on this theory, we reveal analytically a robust relation between dissipation and structure which holds even as the system approaches a nonequilibrium phase transition. Finally, we construct a neural network which maps static configurations of particles to their dissipation rate without any prior knowledge of the underlying dynamics. Furthermore, our results open novel perspectives on the interplay between dissipation and organization out-of-equilibrium.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Secondary building units as the turning point in the development of the reticular chemistry of MOFs

The secondary building unit (SBU) approach was a turning point in the discovery of permanently porous metal-organic frameworks (MOFs) and in launching the field of reticular chemistry. In contrast to the single-metal nodes known in coordination networks, the polynuclear nature of SBUs allows these structures to serve as rigid, directional, and stable building units in the design of robust crystalline materials with predetermined structures and properties. This concept has also enabled the development of MOFs with ultra-high porosity and structural complexity. The architectural, mechanical, and chemical stability of MOFs imparted by their SBUs also gives rise to unique framework chemistry. All of this chemistry –including ligand, linker, metal exchange, and metallation reactions, as well as precisely controlled formation of ordered vacancies– is carried out with full retention of the MOF structure, crystallinity, and porosity. The unique chemical nature of SBUs makes MOFs useful in many applications including gas and vapor adsorption, separation processes, and SBU-mediated catalysis. In essence, the SBU approach realizes a long-standing dream of scientists by bringing molecular chemistry (both organic and inorganic) to extended solid-state structures. This contribution highlights the importance of the SBUs in the development of MOFs and points to the tremendous potential still to be harnessed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

IP Profiling via Service Cluster Membership Vectors

This study investigates the feasibility of establishing and maintaining a system of compact IP behavioral profiles as a robust means of computer anomaly definition and detection. These profiles are based upon the degree to which a system's (IP's) network traffic is distributed among stable characteristic clusters derived of the aggregate session traffic generated by each of the major network services. In short, an IP's profile represents its degree of membership in these derived service clusters. The goal is to quantify and rank behaviors that are outside of the statistical norm for the services in question, or present significant deviation from profile for individual client IPs. Herein, we establish stable clusters for accessible features of common session traffic, migrate these clusters over time, define IP behavior profiles with respect to these clusters, migrate individual IP profiles over time, and demonstrate the detection of IP behavioral changes in terms of deviation from profile.

99 GENERAL AND MISCELLANEOUS↗

Darwinian Spacecraft: Soft Computing Strategies Breeding Better, Faster Cheaper

Computers can create infinite lists of combinations to try to solve a particular problem, a process called "soft-computing." This process uses statistical comparables, neural networks, genetic algorithms, fuzzy variables in uncertain environments, and flexible machine learning to create a system which will allow spacecraft to increase robustness, and metric evaluation. These concepts will allow for the development of a spacecraft which will allow missions to be performed at lower costs.

Noever, David A.↗

Cyberguardians Webinar

Robust solar industry growth is creating a shortage of U.S. workers who are knowledgeable in emerging Distributed Energy Resource (DER) technologies including networking, operational software, smart advanced inverters, smart advanced PV modules, and cybersecurity. Retraining military veterans and other qualified individuals to fill workforce gaps in those technologies is the project focus. The project leverages the experience and contributions of DER and cybersecurity experts, educational organizations offering accreditation, and groups serving our nation’s veterans to meet its goals. To bridge this workforce skills gap, the Cyberguardians and STEM Warriors project will establish a complete learning and career advancement system for veterans, transitioning military personnel and other qualified individuals into the DER workforce. The project will guide participants successfully through the process of program/vocation selection, curriculum enrollment, academic mentoring, degree or certificate attainment, job board enrollment, introduction to hiring managers at DER companies, and successful job acquisition. This webinar was used to promote the Cyberguardians program and to ensure ample news coverage to reach veterans, employers, and others that would benefit from this program.

14 SOLAR ENERGY↗

Developing an AI-Powered Zero-Trust Cybersecurity Framework for Malware Prevention in Nuclear Power Plants

This study presents the development of an AI-powered Zero-Trust cybersecurity framework for malware prevention in nuclear power plants. The framework aims to enhance the security of critical systems within nuclear power plants by adopting the principles of Zero-Trust and leveraging artificial intelligence (AI) technologies. By assuming no implicit trust in any user or device and continuously authenticating and authorizing access, the framework ensures a robust defense against malware attacks. The integration of AI allows for the detection and prevention of malware through behavioral analytics, endpoint protection, network segmentation, and continuous monitoring. The paper discusses the key considerations, steps, and technologies involved in developing this framework, emphasizing the importance of regular updates, training, compliance, and auditing. The proposed framework serves as a comprehensive approach to safeguarding nuclear power plants from sophisticated malware threats and protecting the integrity and safety of critical infrastructure.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗