Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Online Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

NeMO-Net – The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment

We present NeMO-Net, the Srst open-source deep convolutional neural network (CNN) and interactive learning and training software aimed at assessing the present and past dynamics of coral reef ecosystems through habitat mapping into 10 biological and physical classes. Shallow marine systems, particularly coral reefs, are under significant pressures due to climate change, ocean acidification, and other anthropogenic pressures, leading to rapid, often devastating changes, in these fragile and diverse ecosystems. Historically, remote sensing of shallow marine habitats has been limited to meter-scale imagery due to the optical effects of ocean wave distortion, refraction, and optical attenuation. NeMO-Net combines 3D cm-scale distortion-free imagery captured using NASA FluidCam and Fluid lensing remote sensing technology with low resolution airborne and spaceborne datasets of varying spatial resolutions, spectral spaces, calibrations, and temporal cadence in a supercomputer-based machine learning framework. NeMO-Net augments and improves the benthic habitat classification accuracy of low-resolution datasets across large geographic ad temporal scales using high-resolution training data from FluidCam.NeMO-Net uses fully convolutional networks based upon ResNet and ReSneNet to perform semantic segmentation of remote sensing imagery of shallow marine systems captured by drones, aircraft, and satellites, including WorldView and Sentinel. Deep Laplacian Pyramid Super-Resolution Networks (LapSRN) alongside Domain Adversarial Neural Networks (DANNs) are used to reconstruct high resolution information from low resolution imagery, and to recognize domain-invariant features across datasets from multiple platforms to achieve high classification accuracies, overcoming inter-sensor spatial, spectral and temporal variations.Finally, we share our online active learning and citizen science platform, which allows users to provide interactive training data for NeMO-Net in 2D and 3D, integrated within a deep learning framework. We present results from the PaciSc Islands including Fiji, Guam and Peros Banhos 1 1 2 1 3 1 where 24-class classification accuracy exceeds 91%.

Chirayath, Ved↗

SU-F-E-14: Global Radiation Oncology Education and Training in Medical Physics Powered by Information and Communication Technologies

Purpose: Recent publications have highlighted the potential of Information and Communication Technologies (ICTs) to catalyze collaborations in cancer care, research and education in global radiation oncology. This work reports on the use of ICTs for global Medical Physics education and training across three countries: USA, Tanzania and Kuwait Methods: An online education platform was established by Radiation Oncology Faculty from Harvard Medical School, and the University of Pennsylvania with integrated Medical Physics Course modules accessible to trainees in Tanzania via partnership with the Muhimbili University of Health and Allied Sciences, and the Ocean Road Cancer Institute. The course modules incorporated lectures covering Radiation Therapy Physics with videos, discussion board, assessments and grade center. Faculty at Harvard Medical School and the University of Massachusetts Lowell also employed weekly Skype meetings to train/mentor three graduate students, living out-of-state and in Kuwait for up to 9 research credits per semester for over two semesters towards obtaining their graduate degrees Results: Students were able to successfully access the Medical Physics course modules and participate in learning activities, online discussion boards, and assessments. Other instructors could also access/co-teach the course modules from USA and Tanzania. Meanwhile all three graduate students with remote training via Skype and email made major progress in their graduate training with each one of them submitting their research results as abstracts to be presented at the 2016 AAPM conference. One student has also published her work already and all three are developing these abstracts for publication in peer-reviewed journals. Conclusion: Altogether, this work highlights concrete examples/model on how ICTs can be used for capacity building in Medical Physics across continents, for both education and research training needed for Masters/PhD degrees. The developed modules and model will be scaled to benefit many more trainees and other developing countries.

60 APPLIED LIFE SCIENCES↗

Online evolutionary neural architecture search for multivariate non-stationary time series forecasting

Time series forecasting (TSF) is one of the most important tasks in data science. TSF models are usually pre-trained with historical data and then applied on future unseen datapoints. However, real-world time series data is usually non-stationary and models trained offline usually face problems from data drift. Models trained and designed in an offline fashion can not quickly adapt to changes quickly or be deployed in real-time. To address these issues, this work presents the Online NeuroEvolution-based Neural Architecture Search (ONE-NAS) algorithm, which is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Without any pre-training, ONE-NAS utilizes populations of RNNs that are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world, large-scale multivariate wind turbine data as well as the univariate Dow Jones Industrial Average (DJIA) dataset. These results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods, including online linear regression, fixed long short-term memory (LSTM) and gated recurrent unit (GRU) models trained online, as well as state-of-the-art, online ARIMA strategies. Additionally, results show that utilizing multiple populations of RNNs which are periodically repopulated provide significant performance improvements, allowing this online neural network architecture design and training to be successful.

97 MATHEMATICS AND COMPUTING↗

A bi-level advanced control framework for large-scale control of buildings with system-level impact

Increased electricity consumption combined with new forms of generation is testing the reliability of our grid infrastructure. This work describes a method to improve the reliability of the grid through large-scale advanced building control. This paper develops a bi-level distributed control framework to shift the load of 153 buildings to achieve a system-level objective of tracking a power reference signal. This bi-level control is based on the previously-developed ANPV-MPC, a predictive controller that uses a Bayesian neural network to generate an accurate control model and adapt to changing conditions over time. By shifting the building electricity demand to better match the available power, the grid system supplying the buildings is more reliable as evidenced by the analysis of node voltages across an IEEE 13-bus distribution system. The proposed bi-level control framework tracks the system-level power reference with enough accuracy to regulate node voltages across the IEEE 13-bus distribution system within ANSI limits of ±5%. Additionally, the adaptive nature of ANPV-MPC allows each building across the system to adapt to changing conditions, further amplifying the system-level reliability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

WinnowML: Stable feature selection for maximizing prediction accuracy of time-based system modeling

Online deep learning (ODL) has become an important methodology for modeling time-based performance of computer systems. An open problem is the intelligent selection of features from raw workload traces of computer systems. The best methods are overly sensitive to noisy data, causing frequent feature changes and re-training. Using all available features inflates training time and introduces model artifacts if some features should have been dropped. We present WinnowML, a method for automatically determining the most relevant feature subset for a predictive time-series model. WinnowML combines existing feature ranking algorithms and a history of each feature's ranking to iteratively rank a feature set to lower prediction error and maximize long term relevance. From this ranked feature set, the most relevant and stable subset is selected to train a model. Experimentally, we show how WinnowML can lower a model's mean absolute relative error up to 42% on average compared to the closest performing approach. Additionally, we lower the fluctuation in feature ranking and selection up to 65%. We also demonstrate how to combine WinnowML and a model search tool to provide improvements in performance of up to 14.5% when compared to using all the feature available.

Bel, Oceane MS↗

Consumption Behavior Analytics-Aided Energy Forecasting and Dispatch

For decades, electricity customers have been treated as mere recipients of electricity in vertically integrated power systems. However, as customers have widely adopted distributed energy resources and other forms of customer participation in active dispatch (such as demand response) have taken shape, the value of mining knowledge from customer behavior patterns and using it for power system operation is increasing. Further, the variability of renewable energy resources has been considered a liability to the grid. However, electricity consumption has shown the same level of variability and uncertainty, and this is sometimes overlooked. This article investigates data analytics and forecasting methods to identify correlations between electricity consumption behavior and distributed photovoltaic (PV) output. The forecasting results feed into a predictive energy management system that optimizes energy consumption in the near future to balance customer demand and power system needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Local Power-Voltage Sensitivity and Thevenin Impedance Estimation from Phasor Measurements

This paper describes how to use voltage phasor measurements to produce a sensitivity matrix that describes how real and reactive power injections at a node on a distribution network affect the local voltage magnitude and angle. Rather than estimating the sensitivity directly, the voltage phasor measurements and power commands/measurements are used to estimate the unbalanced, three-phase Thevenin impedance. The Thevenin impedance estimation is conducted using recursive least squares on temporal difference measurements. The Thevenin impedance and voltage phasor measurement are then used to build the local power-voltage sensitivity matrix with the closed form expression for the Jacobian of the power flow manifold. Hardware-in-the-loop simulations with phasor measurement units providing real phasor measurements are used to evaluate the recursive temporal difference Thevenin impedance estimation and Thevenin-based power-voltage sensitivity methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deep-Learning-Based Koopman Modeling for Online Control Synthesis of Nonlinear Power System Transient Dynamics

Power system stability and control have become more challenging due to the increasing uncertainty associated with renewable generation. Here, the performance of conventional control is highly driven by the physics-based offline-developed dynamic models that can deviate from the actual system characteristics under different operating conditions and/or configurations. Data-driven approaches based on online measurements can be a better solution to addressing these issues by capturing real-time operation conditions. This article describes a novel fully data-driven probabilistic framework to derive a linear representation of postcontingency grid dynamics and online prescribe control based on the derived model to enhance transient stability. The complex nonlinear power system dynamics is approximated by a linear model by using multiple neural network modules that infer distributions of the observations and introducing a Koopman layer to sample possible Koopman linear models from the inferred distributions. The trained model features linearity that can be easily incorporated into the existing linear control design paradigm and ease the controller design process. The effectiveness of Koopman-based control designs is validated through comparative case studies, which demonstrate increased prediction accuracy and control performance when applied to a power system with heterogeneous generator dynamics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Distributed Energy Management for Networked Microgrids Using Online ADMM With Regret

We propose a distributed algorithm for online energy management in networked microgrids with a high penetration of distributed energy resources (DERs). A high penetration of DERs introduces high uncertainty of power generation to the microgrids. In general, the state-of-the-art forecasting for non-dispatchable DERs such as solar energy is not sufficiently accurate, which results in inaccurate energy scheduling. To address the high uncertainty issue in the networked microgrids, we propose an online energy management based on the online alternating direction method of multipliers algorithm with the past power generation information from the DERs. The online algorithm provides less conservative schedule than the robust optimization-based approach. The effectiveness of the proposed algorithm is verified by various numerical examples.

alternating direction method of multipliers↗

Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly Detection

Deep learning has recently demonstrated state-of-the art performance on key tasks related to the maintenance of computer systems, such as intrusion detection, denial of service attack detection, hardware and software system failures, and malware detection. In these contexts, model interpretability is vital for administrator and analyst to trust and act on the automated analysis of machine learning models. Deep learning methods have been criticized as black box oracles which allow limited insight into decision factors. In this work we seek to "bridge the gap'' between the impressive performance of deep learning models and the need for interpretable model introspection. To this end we present recurrent neural network (RNN) language models augmented with attention for anomaly detection in system logs. Our methods are generally applicable to any computer system and logging source. By incorporating attention variants into our RNN language models we create opportunities for model introspection and analysis without sacrificing state-of-the art performance. We demonstrate model performance and illustrate model interpretability on an intrusion detection task using the Los Alamos National Laboratory (LANL) cyber security dataset, reporting upward of 0.99 area under the receiver operator characteristic curve despite being trained only on a single day's worth of data.

Anomaly detection, Attention, Recurrent Neural Net↗

pbd-industrial-limit-of-performance (PBD limit of performance) v1.0.0

Software repository that contains models used for a paper about Platform-Based Design with limit of performance analysis for an industrial pilot study. This repository contains process and control models in Modelica and IDAES and scripts to develop an ML based controller that computes the control function that maximizes the techno-economic performance of cost and energy computed by the model. This software is meant to be released to reproduce the work described in a Journal publication that is now drafted with the working title "Energy System Limit of Performance Analysis using an Online Machine Learning Multi-Resolution Optimization Framework".

Amusat, Oluwamayowa [Lawrence Berkeley National La↗

Comparing Designed Training Sets to Optimize Multivariate Regression Models for Pr, Nd, and Nitric Acid Using Spectrophotometry

Chemometric regression models were developed for the quantification of praseodymium (Pr, 0–1000 µg/mL), neodymium (Nd, 0–1000 µg/mL), and nitric acid (HNO 3 , 0.1–5 M) using spectrophotometry. Designed calibration sets were composed of 20 samples each: 10 model points and 10 lack-of-fit (LOF) points. The D-optimal designs effectively minimized the number of samples required to build models, and each design resulted in similar prediction performance, suggesting that statistical design of experiments can provide a reliable framework for selecting training set samples in three-variable systems. Partial least squares regression (PLSR) models were validated against a one-factor-at-a-time validation set composed of 125 samples (three variables, five levels). The top PLS-1 models resulted in average percent root mean square error of prediction error values of 3.5%, 1.7%, and 1.2% for Pr(III), Nd(III), and HNO 3 , respectively. Power set augmentations of the model and LOF samples were investigated to optimize the number of training set samples. PLSR models built using just required model points (10) had similar predictive capabilities as models including the LOF points (20) but with fewer samples. The number of validation samples was also varied systematically to learn how many samples are needed to validate regression models. This work addresses long-standing questions in the field of chemometrics to help make this approach amenable to the near-real-time quantification of hazardous species in remote settings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Demand Response Optimization and Management System for Real-TIme (DROMS-RT)

To design and demonstrate DROMS-RT, a highly distributed Demand Response Optimization and Management System for Real-Time (DROMS-RT) power flow control to support large scale integration of distributed renewable generation into the grid. AutoGrid developed a novel control and communications platform to allow highly dispatchable demand response (DR) services in time frames suitable for providing ancillary services to the transmission grid. These services will be substantially less expensive and more efficient than other forms of ancillary services options currently available to manage the intermittency associated with large-scale renewable integration. DROMSRT successfully leveraged Automated Demand Response (ADR) by fundamentally re-thinking the architecture of the DR platform from the ground up and by developing innovative new technologies in a number of areas related to DR. DROMS-RT leveraged the low-cost, open, interoperable DR signaling technology, OpenADR, and low-cost, internet-protocol based telemetry solutions to reduce the cost of hardware. This allowed DROMS-RT to provide dynamic price signals to millions of OpenADR clients. Statistically rigorous signal processing techniques were developed to reliably detect even small load reductions in the presence of noisy baseline profiles. Novel forecasting engines based on modern online machine learning algorithms enabled accurate individualized forecasts for customer loads in the presence of dynamic pricing signals, and a real-time decision engines enabled continuous optimization and optimal dispatch of DR resources across a large portfolio of heterogeneous loads that respond at varying time-scales. Moreover, the real-time optimization conducted by the decision engine can utilize grid physics to maximize load reduction at the transmission system in addition to the distribution sites, for more efficient grid operation. Finally, the Software-as-a-Service (SaaS) availability of the DROMS-RT platform has reduced the cost of deployment and enable participation of small commercial and residential customers in DR who otherwise would not be able to do so.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Integrated Aeropropulsion Control System Design

%T Integrated Aeropropulsion Control System Design%A C-F. Lin%A Francis X. Hurley%A Jie Huang%A F. Y. Hadaegh%J International Conference on Control and Information(psi)995%C Hong Kong%D June 1995%K aeropropulsion, control, system%U http://jpltrs.jpl.nasa.gov/1995/95-0658.pdfAn integrated intelligent control approach is proposed to design a high performance control system for aeropropulsion systems based on advanced sensor processing, nonlinear control and neural fuzzy control integration. Our approach features the following innovations:??e complexity and uncertainty issues are addressed via the distributed parallel processing, learning, and online reoptimization properties of neural networks.??e nonlinear dynamics and the severe coupling can be naturally incorporated into the design framework.??e knowledge base and decision making logic furnished by fuzzy systems leads to a human intelligence enhanced control scheme.In addition, fault tolerance, health monitoring and reconfigurable control strategies will be accommodated by this approach to ensure stability, graceful degradation and reoptimization in the case of failures, malfunctions and damage.!.

aeropropulsion control systems↗

Proactive Intrusion Detection and Mitigation System

SAND2023-05661O The proactive intrusion detection and mitigation system (PIDMS) provides grid-edge situational awareness for cybersecurity defense by capturing real-time distributed energy resource (DER) network traffic and performance data with a novel approach that improves the detection and prevention of cyber-physical attacks. The PIDMS addresses the grid-edge security gap with real-time analysis of both network traffic and photovoltaic performance data to deliver a novel, cyber-physical intrusion detection system (IDS) approach that increases the accuracy and effectiveness of detection and mitigation. This hybrid IDS analysis enables dual monitoring that increases the workload of the adversary; both cyber and physical data would have to be simultaneously spoofed to evade detection. Furthermore, monitoring and analyzing cyber data are insufficient in some cases. For example, in an insider threat aimed at disrupting inverter grid-support functions where proper credentials and authentication are achieved, only the altered PV performance would indicate abnormal behavior. All in all, the PIDMS provides novel capabilities for: • Distributed, real-time cyber-physical detection and mitigation analysis • Cybersecurity defense for grid-edge systems • Analysis framework that can provide situational awareness across the transmission, distribution, and DER systems The PIDMS sensor is designed to collect cyber-physical data, process the data using machine-learning algorithms, detect abnormal events, and deploy mitigations. With these goals, the main functional PIDMS objectives are: • Capability to collect cyber-physical data • Onboard storage of cyber-physical data • Peer-to-peer communication • Computationally efficient machine-learning algorithms • Online cyber-physical data analysis • Alerting/visualization capabilities • Mitigation deployment capability with bump-in-the-wire (BITW) implementation Each of these functional objectives enable PIDMS to perform effective cyber-physical intrusion detection and mitigation. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Jones, Christian↗