Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Online Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Metaplastic and energy-efficient biocompatible graphene artificial synaptic transistors for enhanced accuracy neuromorphic computing

CMOS-based computing systems that employ the von Neumann architecture are relatively limited when it comes to parallel data storage and processing. In contrast, the human brain is a living computational signal processing unit that operates with extreme parallelism and energy efficiency. Although numerous neuromorphic electronic devices have emerged in the last decade, most of them are rigid or contain materials that are toxic to biological systems. In this work, we report on biocompatible bilayer graphene-based artificial synaptic transistors (BLAST) capable of mimicking synaptic behavior. The BLAST devices leverage a dry ion-selective membrane, enabling long-term potentiation, with ~50 aJ/µm 2 switching energy efficiency, at least an order of magnitude lower than previous reports on two-dimensional material-based artificial synapses. The devices show unique metaplasticity, a useful feature for generalizable deep neural networks, and we demonstrate that metaplastic BLASTs outperform ideal linear synapses in classic image classification tasks. With switching energy well below the 1 fJ energy estimated per biological synapse, the proposed devices are powerful candidates for bio-interfaced online learning, bridging the gap between artificial and biological neural networks.

97 MATHEMATICS AND COMPUTING↗

Spin-orbit torque induced spike-timing dependent plasticity

Nanoelectronic devices that mimic the functionality of synapses are a crucial requirement for performing cortical simulations of the brain. In this work, we propose a ferromagnet-heavy metal heterostructure that employs spin-orbit torque to implement spike-timing dependent plasticity. The proposed device offers the advantage of decoupled spike transmission and programming current paths, thereby leading to reliable operation during online learning. Possible arrangement of such devices in a crosspoint architecture can pave the way for ultra-dense neural networks. Simulation studies indicate that the device has the potential of achieving pico-Joule level energy consumption (maximum 2 pJ per synaptic event) which is comparable to the energy consumption for synaptic events in biological synapses.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A Soft-Matter Biomolecular Memristor Synapse for Neuromorphic Systems

The goal of neuromorphic computing is to recreate the computational power and efficiency of the human brain with circuitry. The ability of the brain to solve complex real time tasks, while consuming 20 W of power on average, is made possible through its connection density, adaptability, and parallel processing. Recreating these features using traditional electronics circuit elements is incredibly difficult, and therefore, soft-matter memristors made of biomolecules similar to those found in biological synapses and capable of emulating various synaptic features can be used as neuromorphic hardware. In this work, we introduce and experimentally demonstrate an electronic neuron circuit capable of interacting with ionic, soft-matter memristors. These memristors are proven to exhibit short-term plasticity, especially paired-pulse facilitation and depression found in presynaptic terminals - features that are not found in state-of-the-art solid-state memristors. We make use of these features for applications in online learning by developing a synapse-neuron circuit which implements spike-rate-dependent plasticity (SRDP) as a learning function.

Weiss, Ryan↗

Real Time Effective Impedance Estimation for Power System State Estimation

Here, we introduce two tools-the Effective Impedance State Estimator (EISE), and the Real Time Effective Impedance Estimator (RTEIE). The EISE is novel in that it is an entirely data-driven state estimator, and does not require a network model. Thus, the EISE is well suited for applications in which an accurate network model is not available. Instead of using a network impedance model, the EISE uses an effective impedance network model that is learned online by the RTEIE. The RTEIE recursively estimates the effective impedance network model using phasor measurement unit (PMU) measurements. The mathematical reasoning for using an effective impedance model, rather than a full network impedance model, is given. The recursive estimation framework allows the RTEIE to take the entire history of phasor measurements into account to produce a model estimate, while still adjusting to changes in the network impedance due to external factors such as topology changes and temperature. The merits of the RTEIE and EISE are demonstrated by comparing the accuracy of the EISE with a conventional state estimator on a toy network.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evolution at the Edge: Real-Time Evolution for Neuromorphic Engine Control

Neuromorphic computing systems are attractive for real-time control at the edge because of their low power operation, real-time processing capabilities and their potential ability to do online learning. In this work, we describe an approach for performing real-time evolution of spiking neural networks for neuromorphic systems at the edge called Neuromorphic Optimization using Dynamic Evolutionary Systems or NODES. We apply this approach to real-time combustion engine control and develop an engine-specific hardware platform for NODES called FireBox. We demonstrate how the real-time evolution approach works in simulation and the performance of networks trained in simulation on the physical engine.

Maldonado Puente, Bryan [ORNL] (ORCID:000000033880↗

Intelliquench: An Adaptive Machine Learning System for Detection of Superconducting Magnet Quenches

In superconducting magnets, the irreversible transition of a portion of the conductor to resistive state is called a “quench.” Having large stored energy, magnets can be damaged by quenches due to localized heating, high voltage, or large force transients. Unfortunately, current quench protection systems can only detect a quench after it happens, and mitigating risks in Low Temperature Superconducting (LTS) accelerator magnets often requires fast response (down to ms). Additionally, protection of High Temperature Superconducting (HTS) magnets is still suffering from prohibitively slow quench detection. In this study, we lay the groundwork for a quench prediction system using an auto-encoder fully-connected deep neural network. After dynamically trained with data features extracted from acoustic sensors around the magnet, the system detects anomalous events seconds before the quench in most of our data. While the exact nature of the events is under investigation, we show that the system can “forecast” a quench before it happens under magnet training conditions through a randomized experiment. This opens up the way of integrated data processing, potentially leading to faster and better diagnostics and detection of magnet quenches

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Hyperdimensional computing for image classification (HDC) v1.0

This is an implementation of the hyperdimensional computing technique to classify images. It consists of a python script that trains the system for a set of images from a set of images (dataset) specified by the user. This training produces hardware configuration parameters and description vectors that are then loaded into the hardware description part of the project. The hardware description consists of hardware described in Verilog (a well known language for this purpose) that is synthesizable and can be implemented in a real chip. This hardware received the training information generated by python, and then is able to accept images to produce answers for each image on which category (class) from the pre-=trained ones the image belongs to. The hardware and python training scripts are configurable and documented. The advantage of hyperdimensional computing is its robustness to errors and the easy capability for online learning (refining the training during inference slowly over time), which this implementation supports.

Michelogiannakis, Georgios [Lawrence Berkeley Nati↗

COVID-19 prevention at institutions of higher education, United States, 2020–2021: implementation of nonpharmaceutical interventions

Background, In early 2020, following the start of the coronavirus disease 2019 (COVID-19) pandemic, institutions of higher education (IHEs) across the United States rapidly pivoted to online learning to reduce the risk of on-campus virus transmission. We explored IHEs’ use of this and other nonpharmaceutical interventions (NPIs) during the subsequent pandemic-affected academic year 2020–2021. Methods, From December 2020 to June 2021, we collected publicly available data from official webpages of 847 IHEs, including all public (n = 547) and a stratified random sample of private four-year institutions (n = 300). Abstracted data included NPIs deployed during the academic year such as changes to the calendar, learning environment, housing, common areas, and dining; COVID-19 testing; and facemask protocols. We performed weighted analysis to assess congruence with the October 29, 2020, US Centers for Disease Control and Prevention (CDC) guidance for IHEs. For IHEs offering ≥50% of courses in person, we used weighted multivariable linear regression to explore the association between IHE characteristics and the summated number of implemented NPIs. Results, Overall, 20% of IHEs implemented all CDC-recommended NPIs. The most frequently utilized NPI was learning environment changes (91%), practiced as one or more of the following modalities: distance or hybrid learning opportunities (98%), 6-ft spacing (60%), and reduced class sizes (51%). Additionally, 88% of IHEs specified facemask protocols, 78% physically changed common areas, and 67% offered COVID-19 testing. Among the 33% of IHEs offering ≥50% of courses in person, having < 1000 students was associated with having implemented fewer NPIs than IHEs with ≥ 1000 students. Conclusions, Only 1 in 5 IHEs implemented all CDC recommendations, while a majority implemented a subset, most commonly changes to the classroom, facemask protocols, and COVID-19 testing. IHE enrollment size and location were associated with degree of NPI implementation. Additional research is needed to assess adherence to NPI implementation in IHE settings.

59 BASIC BIOLOGICAL SCIENCES↗

Phase I - Smart Grid Data Access Pilot Program: Utilizing STEM Education as a Catalyst for Residential Consumer Decision Making and Change

Under Phase I of the Smart Grid Data Access Pilot Program, the Gulf of Maine Research Institute (GMRI) partnered with Central Maine Power (CMP), and the Maine Mathematics and Science Alliance (MMSA) and engaged key vendors Tilson Government Services, LLC (Tilson), and Image Works to demonstrate the efficacy of PowerHouse, an interactive online learning environment linking middle school students with their home electricity consumption data provided through CMP’s Advanced Metering Infrastructure (AMI). The goal of the program is to harness the power of youth to alter home energy consumption behaviors using AMI data. Successful programs aimed at smoking cessation, recycling, and seat belt use have demonstrated the power of young people to influence household behaviors. In an era of increasing concern about energy costs, availability, and human impacts on global climate, GMRI sought to demonstrate the effectiveness of a student-focused approach to understanding and managing household energy use. We also sought to contribute to a solid foundation of science-literate students who can analyze evidence to find solutions to increasingly complex energy challenges.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Daily Forecasting of Regional Epidemics of Coronavirus Disease with Bayesian Uncertainty Quantification, United States

To increase situational awareness and support evidence-based policymaking, we formulated a mathematical model for coronavirus disease transmission within a regional population. This compartmental model accounts for quarantine, self-isolation, social distancing, a nonexponentially distributed incubation period, asymptomatic persons, and mild and severe forms of symptomatic disease. We used Bayesian inference to calibrate region-specific models for consistency with daily reports of confirmed cases in the 15 most populous metropolitan statistical areas in the United States. We also quantified uncertainty in parameter estimates and forecasts. This online learning approach enables early identification of new trends despite considerable variability in case reporting.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluation of fluxon synapse device based on superconducting loops for energy efficient neuromorphic computing

With Moore’s law nearing its end due to the physical scaling limitations of CMOS technology, alternative computing approaches have gained considerable attention as ways to improve computing performance. Here, we evaluate performance prospects of a new approach based on disordered superconducting loops with Josephson-junctions for energy efficient neuromorphic computing. Synaptic weights can be stored as internal trapped fluxon states of three superconducting loops connected with multiple Josephson-junctions (JJ) and modulated by input signals applied in the form of discrete fluxons (quantized flux) in a controlled manner. The stable trapped fluxon state directs the incoming flux through different pathways with the flow statistics representing different synaptic weights. We explore implementation of matrix–vector-multiplication (MVM) operations using arrays of these fluxon synapse devices. We investigate the energy efficiency of online-learning of MNIST dataset. Our results suggest that the fluxon synapse array can provide ~100× reduction in energy consumption compared to other state-of-the-art synaptic devices. This work presents a proof-of-concept that will pave the way for development of high-speed and highly energy efficient neuromorphic computing systems based on superconducting materials.

42 ENGINEERING↗

Monitoring the Performance of a Neuro-Adaptive Controller

Traditional control has proven to be ineffective to deal with catastrophic changes or slow degradation of complex, highly nonlinear systems like aircraft or spacecraft, robotics, or flexible manufacturing systems. Control systems which can adapt toward changes in the plant have been proposed as they offer many advantages (e.g., better performance, controllability of aircraft despite of a damaged wing). In the last few years, use of neural networks in adaptive controllers (neuro-adaptive control) has been studied actively. Neural networks of various architectures have been used successfully for online learning adaptive controllers. In such a typical control architecture, the neural network receives as an input the current deviation between desired and actual plant behavior and, by on-line training, tries to minimize this discrepancy (e.g.; by producing a control augmentation signal). Even though neuro-adaptive controllers offer many advantages, they have not been used in mission- or safety-critical applications, because performance and safety guarantees cannot b e provided at development time-a major prerequisite for safety certification (e.g., by the FAA or NASA). Verification and Validation (V&V) of an adaptive controller requires the development of new analysis techniques which can demonstrate that the control system behaves safely under all operating conditions. Because of the requirement to adapt toward unforeseen changes during operation, i.e., in real time, design-time V&V is not sufficient.

Schumann, Johann↗

Methodologies for Adaptive Flight Envelope Estimation and Protection

This paper reports the latest development of several techniques for adaptive flight envelope estimation and protection system for aircraft under damage upset conditions. Through the integration of advanced fault detection algorithms, real-time system identification of the damage/faulted aircraft and flight envelop estimation, real-time decision support can be executed autonomously for improving damage tolerance and flight recoverability. Particularly, a bank of adaptive nonlinear fault detection and isolation estimators were developed for flight control actuator faults; a real-time system identification method was developed for assessing the dynamics and performance limitation of impaired aircraft; online learning neural networks were used to approximate selected aircraft dynamics which were then inverted to estimate command margins. As off-line training of network weights is not required, the method has the advantage of adapting to varying flight conditions and different vehicle configurations. The key benefit of the envelope estimation and protection system is that it allows the aircraft to fly close to its limit boundary by constantly updating the controller command limits during flight. The developed techniques were demonstrated on NASA s Generic Transport Model (GTM) simulation environments with simulated actuator faults. Simulation results and remarks on future work are presented.

Tang, Liang↗

Hybrid Decompositional Verification for Discovering Failures in Adaptive Flight Control Systems

Adaptive flight control systems hold tremendous promise for maintaining the safety of a damaged aircraft and its passengers. However, most currently proposed adaptive control methodologies rely on online learning neural networks (OLNNs), which necessarily have the property that the controller is changing during the flight. These changes tend to be highly nonlinear, and difficult or impossible to analyze using standard techniques. In this paper, we approach the problem with a variant of compositional verification. The overall system is broken into components. Undesirable behavior is fed backwards through the system. Components which can be solved using formal methods techniques explicitly for the ranges of safe and unsafe input bounds are treated as white box components. The remaining black box components are analyzed with heuristic techniques that try to predict a range of component inputs that may lead to unsafe behavior. The composition of these component inputs throughout the system leads to overall system test vectors that may elucidate the undesirable behavior

Thompson, Sarah↗

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

He, Yuning↗

Regression Analysis of Top of Descent Location for Idle-thrust Descents

In this paper, multiple regression analysis is used to model the top of descent (TOD) location of user-preferred descent trajectories computed by the flight management system (FMS) on over 1000 commercial flights into Melbourne, Australia. The independent variables cruise altitude, final altitude, cruise Mach, descent speed, wind, and engine type were also recorded or computed post-operations. Both first-order and second-order models are considered, where cross-validation, hypothesis testing, and additional analysis are used to compare models. This identifies the models that should give the smallest errors if used to predict TOD location for new data in the future. A model that is linear in TOD altitude, final altitude, descent speed, and wind gives an estimated standard deviation of 3.9 nmi for TOD location given the trajec- tory parameters, which means about 80% of predictions would have error less than 5 nmi in absolute value. This accuracy is better than demonstrated by other ground automation predictions using kinetic models. Furthermore, this approach would enable online learning of the model. Additional data or further knowl- edge of algorithms is necessary to conclude definitively that no second-order terms are appropriate. Possible applications of the linear model are described, including enabling arriving aircraft to fly optimized descents computed by the FMS even in congested airspace. In particular, a model for TOD location that is linear in the independent variables would enable decision support tool human-machine interfaces for which a kinetic approach would be computationally too slow.

trajectory prediction↗

Fatigue and Fatigue Countermeasures

Sleep can play an important role in alleviating health disparities, as inadequate sleep is associated with serious, adverse health conditions including cardiovascular disease, diabetes, obesity, cancer, and premature mortality. Nonetheless, dissemination of sleep health interventions targeted towards health disparities populations remains limited. Social workers and social work students serve populations designated as health disparities populations and are in an optimal position to promote sleep health among their underserved clients. However, social work students lack the specific training and resources necessary to promote healthy sleep practices among their clients. In fact, bachelors, master's, and doctoral social work programs in the United States do not incorporate any sleep health training as part of their curriculum. To improve public health through the promotion of healthy sleep practices among underserved populations, we propose to equip social work students, through an online learning module, with the knowledge and resources necessary to promote healthy sleep practices among their clients in underserved communities. In order to maximize effectiveness and reach, this proposal employs: (1) a collaborative team of sleep medicine and social work professionals; and (2) an ideal university environment with sophisticated eLearning capabilities that has one of the largest social work programs in the state of Florida.

fatigue countermeasure↗

Online Self-Supervised Long-Range Scene Segmentation for MAVs

Recently, there have been numerous advances in the development of payload and power constrained lightweight Micro Aerial Vehicles (MAVs). As these robots aspire for high-speed autonomous flights in complex dynamic environments, robust scene understanding at long-range becomes critical. The problem is heavily characterized by either the limitations imposed by sensor capabilities for geometry-based methods, or the need for large-amounts of manually annotated training data required by data-driven methods. This motivates the need to build systems that have the capability to alleviate these problems by exploiting the complimentary strengths of both geometry and data-driven methods. In this paper, we take a step in this direction and propose a generic framework for adaptive scene segmentation using self-supervised online learning. We present this in the context of vision-based autonomous MAV flight, and demonstrate the efficacy of our proposed system through extensive experiments on benchmark datasets and real world field tests.

Matthies, Larry↗