Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Online Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗

An Approach to V&V of Embedded Adaptive Systems

Rigorous Verification and Validation (V&V) techniques are essential for high assurance systems. Lately, the performance of some of these systems is enhanced by embedded adaptive components in order to cope with environmental changes. Although the ability of adapting is appealing, it actually poses a problem in terms of V&V. Since uncertainties induced by environmental changes have a significant impact on system behavior, the applicability of conventional V&V techniques is limited. In safety-critical applications such as flight control system, the mechanisms of change must be observed, diagnosed, accommodated and well understood prior to deployment. In this paper, we propose a non-conventional V&V approach suitable for online adaptive systems. We apply our approach to an intelligent flight control system that employs a particular type of Neural Networks (NN) as the adaptive learning paradigm. Presented methodology consists of a novelty detection technique and online stability monitoring tools. The novelty detection technique is based on Support Vector Data Description that detects novel (abnormal) data patterns. The Online Stability Monitoring tools based on Lyapunov's Stability Theory detect unstable learning behavior in neural networks. Cases studies based on a high fidelity simulator of NASA's Intelligent Flight Control System demonstrate a successful application of the presented V&V methodology. ,

Liu, Yan↗

Multi-objective Bayesian active learning for MeV-ultrafast electron diffraction

Ultrafast electron diffraction using MeV energy beams(MeV-UED) has enabled unprecedented scientific opportunities in the study of ultrafast structural dynamics in a variety of gas, liquid and solid state systems. Broad scientific applications usually pose different requirements for electron probe properties. Due to the complex, nonlinear and correlated nature of accelerator systems, electron beam property optimization is a time-taking process and often relies on extensive hand-tuning by experienced human operators. Algorithm based efficient online tuning strategies are highly desired. Here, we demonstrate multi-objective Bayesian active learning for speeding up online beam tuning at the SLAC MeV-UED facility. The multi-objective Bayesian optimization algorithm was used for efficiently searching the parameter space and mapping out the Pareto Fronts which give the trade-offs between key beam properties. Such scheme enables an unprecedented overview of the global behavior of the experimental system and takes a significantly smaller number of measurements compared with traditional methods such as a grid scan. This methodology can be applied in other experimental scenarios that require simultaneously optimizing multiple objectives by explorations in high dimensional, nonlinear and correlated systems.

43 PARTICLE ACCELERATORS↗

CRCNS US-France Research Proposal: Collaborative Research: Encoding reward expectation in Drosophilia

The fruit fly Drosophila melanogaster has been a valuable model for investigating the genetic and neural bases that underlie learning and memory. Early and most current studies use basic behavior conditioning protocols to study learning in controlled laboratory settings. More recently, the ability to transgenically manipulate many of the brain neurons in the fruit fly with exquisite specificity, and the recent knowledge of the synaptic ‘connectome’ of the fruit fly brain, makes these animals almost unique as a comprehensive model for studies of learning, memory and motivated behavior. In fact, the connectome has revealed many types of new connections that had until now been overlooked. Within this context, the thesis of this proposal is that studies of learning and memory will be greatly enhanced by using more sophisticated means for evaluating memory representations, such as have been developed in vertebrates, and combining those studies with information from the connectome guided by computational modelling. We propose to push beyond the boundaries of existing conditioning protocols for fruit flies to investigate more complex memory representations. In particular, we will investigate the function of reinforcement pathways in relation to the absence of expected reinforcement. More specifically, we propose a series of experiments designed to investigate the memory representations in fruit flies when an expected consequence of a Conditioned Stimulus (CS) fails to occur. Although studies have evaluated how this failure can establish extinction memory for the CS, our studies will go beyond studying extinction. Specifically, we predict that in Drosophila when a CS is associated with a failed expectation of an appetitive food reinforcement it will acquire aversive value, and vice versa for a failed expectation of an aversive reinforcer. We combine these studies with manipulations of reinforcement pathways in the CNS inspired from the connectome, iteratively knitted in with established computational models. Intellectual Merit: The concept of reinforcement expectation and incentive contrast have been influential in the development of studies of associative learning in mammals. These questions are particularly challenging to answer in vertebrates because they require exquisite cellular, temporal, and genetic specificity of experimental manipulations. The recent development of work with identified neurons and their connectomes makes the larval and adult fly brains ripe as models for pushing our understanding of neural bases for these higher- order conditioning phenomena. Broader Impacts: Public health: These analyses and the conceptual framework of prediction error processing underlying them have a profound impact on our understanding of reinforcement-related behavior in humans, including monetary rewards and the mnemonic consequences of traumatic experiences, and for pathologies of the dopamine reinforcement system. Educational: This project will provide interdisciplinary training for postdoctoral researchers, Ph.D. and undergraduate students. The PIs will act as co-supervisors or mentors of students working in the different labs via face-to-face and internet-based technologies. We will also work with ASU’s award-winning Ask- A-Biologist program. This is an online science program designed to enrich the learning experiences of students of all ages and to provide classroom material for use by K-12 teachers. We will develop an extension of a game developed under a prior NSF award, and the new game will include modules to teach K-12 students about how insects learn. We will also integrate into the AAB site a program developed by a collaborator (B Gerber) at the Leibniz Institut für Neurobiologie, Magdeburg, and now in use in schools in Germany, to teach K-12 students how to train animals using the fruit fly larval learning paradigm. Underrepresented groups: All PIs will work with their university offices of Academic Diversity and Equal Opportunity for reaching underrepresented students.

59 BASIC BIOLOGICAL SCIENCES↗

Hybrid data-driven and model-informed online tool wear detection in milling machines

Precision machining tool wear is responsible for low product throughput and quality. Monitoring the tool wear online is vital to prevent degradation in machining quality. However, direct real-time tool wear measurement is not practical. This paper presents residual-based anomaly detection models, combining a hybrid model comprised of a physics-based model and a data-driven model (a decision tree or a neural network) to predict signals of interest (e.g., power or forces) under nominal conditions, followed by Page’s cumulative sum test for detecting tool wear on-line using the computer numerical control machine measurements. The most informative features are ranked using dynamic programming and its approximation variants from real-time measurements and machine settings, such as the width of cut, depth of cut, feed rate and spindle speed, that serve as inputs to the predictive models. The baseline nominal model is incrementally updated with experimental data via a gradient boosted adaptation model to generate the residuals that account for discrepancies between the actual machine data under normal conditions and the baseline nominal model predictions. The hybrid model is validated against 20 Mazak milling machine experimental tests and one Haas run-to-failure experiment. The proposed anomaly detector is applied to synthetic data from simulations of the physics-based model at different operating conditions, measurement noise levels, and tool wear levels, and the methods were able to achieve an overall 92% accuracy in data with 1% noise. The anomaly detection methods based on hybrid model reduced the false alarms of either the data-driven or physical-based models alone, and are found to be capable of good online detection of tool wear.

42 ENGINEERING↗

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Use of Online Media for Professional Development Amongst Medical Radiation Practitioners in Australia and Canada

Online media allows access to professional development (PD) regardless of geographical location and has the potential to provide equitable, immediate and quality PD. Online media includes online information and social media. The purpose of this mixed methods research study was to investigate the perceptions and use of online media for PD amongst medical radiation practitioners within Australia and Canada. An online survey was circulated to members of the Canadian Association of Medical Radiation Technologists (CAMRT) and the Australian Society of Medical Imaging and Radiation Therapy (ASMIRT). The survey collected data within three domains: current use, satisfaction of use, and future use. A four point Likert scale was used for both satisfaction with the online platform and frequency of use. Two hundred and thirty-nine responses were collected. Results indicated that the online mechanisms most frequently used by respondents for PD were Google, self-directed learning, and intranet. A correlating degree of satisfaction was indicated with the use of these platforms. The least used online media for PD were social media platforms including health related blogs, LinkedIn, Twitter, health related and professional applications, Facebook, and online journal clubs. Online media is well suited to PD for medical radiation practitioners. The platforms that are preferred offer speed and ease of access regardless of geographical location or occupation. Whilst inherent risks and instances of unprofessional online behaviour are acknowledged, Australian and Canadian practitioners are keen to learn what social media PD opportunities exist. Findings indicate that radiation therapists are more receptive to explore new social media platforms and tools than are radiographers. There is an opportunity to incorporate formal PD for medical radiation practitioners within recognised social media platforms.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The SSRI Knowledge Base Tool: Current Tool Functionality Review and Planned Future Enhancements

NASA’s Small Satellite Reliability Initiative (SSRI), in conjunction with NASA’s Small Spacecraft Systems Virtual Institute (S3VI), has developed the SSRI Knowledge Base to improve mission confidence for small spacecraft. The SSRI Knowledge Base provides vetted, high-quality sources of information on elements that are key to successful small spacecraft missions. These resources include SSRI working group generated documents and presentations in addition to existing guides, publications, standards, software tools, websites, and books. The Knowledge Base is fully searchable, offers downloadable content when possible, and otherwise links to or references content directly from within the tool. All 58 of the planned topic pages that comprise the SSRI Knowledge Base have been recently completed and include over 450 unique resources that are now available for review. Over the past several months significant enhancements to the tool’s capabilities have been developed and implemented. These enhancements consist of the completed baseline content; development of an Application Programming Interface (API); improved user interfaces; scalable and searchable Best Practices and Lessons Learned (BPLL) lists with ratings; and custom website analytics. The SSRI Knowledge Base is a comprehensive and searchable online tool that consolidates and organizes resources, best practices, and lessons learned from previous small spacecraft missions sponsored by NASA, other government agencies, and academia. This free, publicly available tool is available to the entire SmallSat community at: NASA SSRI Knowledge Base | Explore. This presentation will discuss the motivation for and development of the SSRI Knowledge Base, demonstrate the existing tool, share how the smallsat community can get involved and outline plans for further enhancement development. The SSRI is a collaborative activity with broad participation from civil, Department of Defense, and both national and international commercial space systems providers and stakeholders. The S3VI is jointly sponsored by NASA’s Space Technology Mission Directorate and Science Mission Directorate.

Small Spacecraft↗

The SSRI Knowledge Base Tool: Current Tool Functionality Review and Planned Future Enhancements

NASA’s Small Satellite Reliability Initiative (SSRI), in conjunction with NASA’s Small Spacecraft Systems Virtual Institute (S3VI), has developed the SSRI Knowledge Base to improve mission confidence for small spacecraft. The SSRI Knowledge Base provides vetted, high-quality sources of information on elements that are key to successful small spacecraft missions. These resources include SSRI working group generated documents and presentations in addition to existing guides, publications, standards, software tools, websites, and books. The Knowledge Base is fully searchable, offers downloadable content when possible, and otherwise links to or references content directly from within the tool. All 58 of the planned topic pages that comprise the SSRI Knowledge Base have been recently completed and include over 450 unique resources that are now available for review. Over the past several months significant enhancements to the tool’s capabilities have been developed and implemented. These enhancements consist of the completed baseline content; development of an Application Programming Interface (API); improved user interfaces; scalable and searchable Best Practices and Lessons Learned (BPLL) lists with ratings; and custom website analytics. The SSRI Knowledge Base is a comprehensive and searchable online tool that consolidates and organizes resources, best practices, and lessons learned from previous small spacecraft missions sponsored by NASA, other government agencies, and academia. This free, publicly available tool is available to the entire SmallSat community at: NASA SSRI Knowledge Base | Explore. This presentation will discuss the motivation for and development of the SSRI Knowledge Base, demonstrate the existing tool, share how the smallsat community can get involved and outline plans for further enhancement development. The SSRI is a collaborative activity with broad participation from civil, Department of Defense, and both national and international commercial space systems providers and stakeholders. The S3VI is jointly sponsored by NASA’s Space Technology Mission Directorate and Science Mission Directorate.

Small Spacecraft↗

MOFX-DB: An Online Database of Computational Adsorption Data for Nanoporous Materials

Machine learning and data mining coupled with molecular modeling have become powerful tools for materials discovery. Metal-organic frameworks (MOFs) are a rich area for this due to their modular construction and numerous applications. Here, we make data from several previous large-scale studies in MOFs and zeolites from our groups (and new data for N 2 and Ar adsorption in MOFs) easily accessible in one place. The database includes over 3 million simulated adsorption data points for H 2 , CH 4 , CO 2 , Xe, Kr, Ar, and N 2 in over 160 000 MOFs and zeolites, textural properties like pore sizes and surface areas, and the structure file for each material. We include metadata about the Monte Carlo simulations to enable reproducibility. The database is searchable by MOF properties, and the data are stored in a standardized JSON format that that is interoperable with the NIST adsorption database. We also identify several MOFs that meet high performance targets for multiple applications, such as high storage capacity for both hydrogen and methane or high CO 2 capacity plus good Xe/Kr selectivity. Here, by providing this data publicly, we hope to facilitate machine learning studies on these materials, leading to new insights on adsorption in MOFs and zeolites.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Combining Spike Time Dependent Plasticity (STDP) and Backpropagation (BP) for Robust and Data Efficient Spiking Neural Networks (SNN)

National security applications require artificial neural networks (ANNs) that consume less power, are fast and dynamic online learners, are fault tolerant, and can learn from unlabeled and imbalanced data. We explore whether two fundamentally different, traditional learning algorithms from artificial intelligence and the biological brain can be merged. We tackle this problem from two directions. First, we start from a theoretical point of view and show that the spike time dependent plasticity (STDP) learning curve observed in biological networks can be derived using the mathematical framework of backpropagation through time. Second, we show that transmission delays, as observed in biological networks, improve the ability of spiking networks to perform classification when trained using a backpropagation of error (BP) method. These results provide evidence that STDP could be compatible with a BP learning rule. Combining these learning algorithms will likely lead to networks more capable of meeting our national security missions.

97 MATHEMATICS AND COMPUTING↗

Evaluation of an Internet-Based, Bibliographic Database: Results of the NASA STI Program's ASAP User Test

This document summarizes the feedback gathered during the user-testing phase in the development of an electronic library application: the Aeronautics and Space Access Pages (ASAP). It first provides some historical background on the NASA Scientific and Technical Information (STI) program and its efforts to enhance the services it offers the aerospace community. Following a brief overview of the ASAP project, it reviews the results of an online user survey, and from the lessons learned therein, outlines direction for future development of the project.

Reid, John↗

Design and Operation of a Multi-Bed Catalytic Micro-Reactor for the Study of Co-Processing of Bio-Oils with VGO

An industry wide shift from fossil-based fuel to renewable fuel sources including biomass, municipal waste, and plastics will require new process monitoring methods to minimize transitional risks including off specification product formation and catalyst deactivation. This project aims to provide a machine learning based process monitoring tool composed of online, slipstream mass spectra for use in biomass refineries and co-processing in existing refineries allowing operators to monitor product qualities and adjust process conditions accordingly. In order to maximize the robustness of the tool, large volumes of data must be collected to fine tune model parameters which consists of both micro and pilot scale mass spectral data. Micro-scale data is collected with a multi-tube micro-reactor housing up to six catalysts in horizontal beds, coupled with a molecular beam mass spectrometer. A pyrolizer equipped with an auto-sampler streamlines the micro-scale data collection process. This type of pyrolizer/micro-reactor configuration does not exist on the market, and therefore had to be created for the purposes of this project. The design and commissioning of this reactor will be presented in detail. This reactor set-up is highly flexible and increases throughput of analysis. For catalyst testing, each bed can be individually selected simply by turning valves. For catalyst reduction and regeneration, simultaneous flow through all six beds is used. The reproducibility of the system was first assessed with whole biomass pyrolysis along with pyrolysis of calibration standards. Initial work on this system evaluated two FCC catalysts, equilibrium catalyst (E-cat), and a proprietary catalyst from Johnson Matthey specifically design for co-processing of bio-oil with vacuum gas oil (VGO). This work used model compounds and VGO which illuminated differences in products produced by the catalysts.

biomass↗

Developments in Online Monitoring Technologies for Autonomous Microreactor Operations

This report presents the results of an ongoing research and development (R&D) effort to develop an online monitoring (OLM) system to support autonomous microreactor operations. A key component of this work is an evaluation of Artificial Intelligence (AI) and Machine Learning (ML) techniques to identify, diagnose, and predict problems with sensors and processes of the reactor. As described herein, selected methods of AI/ML were used to identify and diagnose anomalous sensor and system behaviors using data from a thermal-hydraulic flow loop and from operating nuclear power plants. This work serves to further the state-of-the-art in OLM technologies for nuclear reactor applications and will ultimately result in a comprehensive system to enable OLM of critical structures, systems, components, and processes in microreactors.

Machine learning↗

Correction of the baseline fluctuations in the GEM-based ALICE TPC

To operate the ALICE Time Projection Chamber in continuous mode during the Run 3 and Run 4 data-taking periods of the Large Hadron Collider, the multi-wire proportional chamber-based readout was replaced with gas-electron multipliers. As expected, the detector performance is affected by the so-called common-mode effect, which leads to significant baseline fluctuations. A detailed study of the pulse shape with the new readout has revealed that it is also affected by ion tails. Since reconstruction and data compression are performed fully online, these effects must be corrected at the hardware level in the FPGA-based common readout units. The characteristics of the common-mode effect and of the ion tail, as well as the algorithms developed for their online correction, are described in this paper. The common-mode dependencies are studied using machine-learning techniques. Toy Monte Carlo simulations are performed to illustrate the importance of online corrections and to investigate the performance of the developed algorithms.

47 OTHER INSTRUMENTATION↗

Text-based Analytics for Biosurveillance

The ability to prevent, mitigate, or control a biological threat depends on how quickly the threat is identified and characterized. Ensuring the timely delivery of data and analytics is an essential aspect of providing adequate situational awareness in the face of a disease outbreak. This chapter outlines an analytic pipeline for supporting an advanced early warning system that can integrate multiple data sources and provide situational awareness of potential and occurring disease situations. The pipeline, includes real-time automated data analysis founded on natural language processing (NLP), semantic concept matching, and machine learning techniques, to enrich content with metadata related to biosurveillance. Online news articles are presented as an example use case for the pipeline, but the processes can be generalized to any textual data. In this chapter, the mechanics of a streaming pipeline are briefly discussed as well as the major steps required to provide targeted situational awareness. The text-based analytic pipeline includes various processing steps as well as identifying article relevance to biosurveillance (e.g., relevance algorithm) and article feature extraction (who, what, where, why, how, and when). The ability to prevent, mitigate, or control a biological threat depends on how quickly the threat is identified and characterized. Ensuring the timely delivery of data and analytics is an essential aspect of providing adequate situational awareness in the face of a disease outbreak. This chapter outlines an analytic pipeline for supporting an advanced early warning system that can integrate multiple data sources and provide situational awareness of potential and occurring disease situations. The pipeline, includes real-time automated data analysis founded on natural language processing (NLP), semantic concept matching, and machine learning techniques, to enrich content with metadata related to biosurveillance. Online news articles are presented as an example use case for the pipeline, but the processes can be generalized to any textual data. In this chapter, the mechanics of a streaming pipeline are briefly discussed as well as the major steps required to provide targeted situational awareness. The text-based analytic pipeline includes various processing steps as well as identifying article relevance to biosurveillance (e.g., relevance algorithm) and article feature extraction (who, what, where, why, how, and when).

Biomedical NLP↗