Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Expanding the representation of aerosol, cloud, and precipitation processes with graph network-based simulators

We explored a novel framework for simulating the small-scale processes that drive the evolution of aerosol, cloud, and precipitation particles, which are a critical gap in the predictive understanding of weather and climate. Particle-based methods have emerged as an effective tool for modeling aerosol-cloud-precipitation interactions, but existing particle-based models are computationally too expensive to simulate the large domains relevant for the atmosphere or to represent the full suite of relevant processes. The lack of a comprehensive and efficient reference model is a critical bottleneck in our understanding of cloud and precipitation processes and our ability to parameterize these processes for regional- and global-scale simulations. To address this need, we explored an approach to accelerate and expand particle-based models using a new machine learning approach, graph network-based simulators (GNS). Rather than modeling the evolution of the system by numerically integrating continuity equations, the GNS represents dynamics through learned message passing. Our aim was to develop fast and accurate surrogate models for particle-based simulations. We explored applying GNS to simulate cloud droplet transport, growth, and evaporation under turbulent conditions, but we found the GNS over-smoothed the simulations. We then applied the GNS to simulate aerosol dynamics through gas condensation and found the GNS was able to reproduce the benchmark, physics-based simulation with high accuracy.

54 ENVIRONMENTAL SCIENCES↗

SRF cavity instability detection with machine learning at CEBAF

During the operation of the Continuous Electron Beam Accelerator Facility (CEBAF), one or more unstable superconducting radio-frequency (SRF) cavities often cause beam loss trips while the unstable cavities themselves do not necessarily trip off. The present RF controls for the legacy cavities report at only 1 Hz, which is too slow to detectfast transient instabilities during these trip events. These challenges make the identification of an unstable cavity out of the hundreds installed at CEBAF a difficult and time-consuming task. To tackle these issues, a fast data acquisition system (DAQ) for the legacy SRF cavities has been developed, which records the sample at 5 kHz. An unsupervised learning framework has been developed to identify anomalous SRF cavity behavior. We will discuss the present status of the DAQ system and our framework, along with recent successes in detecting anomalous cavity behavior. Overall, our method offers a practical solution for identifying unstable SRF cavities, contributing to increased beam availability and machine reliability.

Accelerator Physics↗

Out-of-Distribution Generalization for Learning Quantum Channels with Low-Energy Coherent States

When experimentally learning the action of a continuous-variable quantum process by probing it with inputs, there will often be some restriction on the input states used. One experimentally simple way to probe a quantum channel is to use low-energy coherent states. Learning a quantum channel in this way presents difficulties, due to the fact that two channels may act similarly on low-energy inputs but very differently for high-energy inputs. They may also act similarly on coherent-state inputs but differently on nonclassical inputs. Extrapolating the behavior of a channel for more general input states from its action on the far more limited set of low-energy coherent states is a case of out-of-distribution generalization. To be sure that such generalization gives meaningful results, one needs to relate error bounds for the training set to bounds that are valid for all inputs. We show that for any pair of channels that act sufficiently similarly on low-energy coherent-state inputs, one can bound how different the input-output relations are for any (high-energy or highly nonclassical) input. This proves that out-of-distribution generalization is always possible for learning quantum channels using low-energy coherent states, as long as enough samples are used.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Scalability Testing Approach for Internet of Things for Manufacturing SQL and NoSQL Database Latency and Throughput

The proliferation of low-cost sensors and industrial data solutions has continued to push the frontier of manufacturing technology. Machine learning and other advanced statistical techniques stand to provide tremendous advantages in production capabilities, optimization, monitoring, and efficiency. The tremendous volume of data gathered continues to grow, and the methods for storing the data are critical underpinnings for advancing manufacturing technology. This work aims to investigate the ramifications and design tradeoffs within a decoupled architecture of two prominent database management systems (DBMS): sql and NoSQL. A representative comparison is carried out with Amazon Web Services (AWS) DynamoDB and AWS Aurora MySQL. The technologies and accompanying design constraints are investigated, and a side-by-side comparison is carried out through high-fidelity industrial data simulated load tests using metrics from a major US manufacturer. The results support the use of simulated client load testing for comparing the latency of database management systems as a system scales up from the prototype stage into production. As a result of complex query support, MySQL is favored for higher-order insights, while NoSQL can reduce system latency for known access patterns at the expense of integrated query flexibility. Here, by reviewing this work, a manufacturer can observe that the use of high-fidelity load testing can reveal tradeoffs in IoTfM write/ingestion performance in terms of latency that are not observable through prototype-scale testing of commercially available cloud DB solutions.

AWS↗

SRF cavity instability detection with machine learning at CEBAF

During the operation of the Continuous Electron Beam Accelerator Facility (CEBAF), one or more unstable superconducting radio-frequency (SRF) cavities often cause beam loss trips while the unstable cavities themselves do not necessarily trip off. The present RF controls for the legacy cavities report at only 1 Hz, which is too slow to detectfast transient instabilities during these trip events. These challenges make the identification of an unstable cavity out of the hundreds installed at CEBAF a difficult and time-consuming task. To tackle these issues, a fast data acquisition system (DAQ) for the legacy SRF cavities has been developed, which records the sample at 5 kHz. An unsupervised learning framework has been developed to identify anomalous SRF cavity behavior. We will discuss the present status of the DAQ system and our framework, along with recent successes in detecting anomalous cavity behavior. Overall, our method offers a practical solution for identifying unstable SRF cavities, contributing to increased beam availability and machine reliability.

Accelerator Physics↗

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗

Deep reinforcement learning for complex evaluation of one-loop diagrams in quantum field theory

In this paper we present a technique based on deep reinforcement learning that allows for numerical analytic continuation of integrals that are often encountered in one-loop diagrams in quantum field theory. To extract certain quantities of two-point functions, such as spectral densities, mass poles or multiparticle thresholds, it is necessary to perform an analytic continuation of the correlator in question. At one-loop level in Euclidean space, this results in the necessity to deform the integration contour of the loop integral in the complex plane of the square of the loop momentum, to avoid nonanalyticities in the integration plane. Using a toy model for which an exact solution is known, we train a reinforcement learning agent to perform the required contour deformations. We report our study shows great promise for an agent to be deployed in iterative numerical approaches used to compute nonperturbative two-point functions, such as the quark propagator Dyson-Schwinger equation, or more generally, Fredholm equations of the second kind, in the complex domain.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Reification of latent microstructures: On supervised unsupervised and semi-supervised deep learning applications for microstructures in materials informatics

Machine learning (ML), including deep learning (DL), has become increasingly popular in the last few years due to its continually outstanding performance. In this context, we apply machine learning techniques to "learn" the microstructure using both supervised and unsupervised DL techniques. In particular, we focus (1) on the localization problem bridging (micro)structure (localized) property using supervised DL and (2) on the microstructure reconstruction problem in latent space using unsupervised DL. The goal of supervised and semi-supervised DL is to replace crystal plasticity finite element model (CPFEM) that maps from (micro)structure (localized) property, and implicitly the (micro)structure (homogenized) property relationships, while the goal of unsupervised DL is (1) to represent high-dimensional microstructure images in a non-linear low-dimensional manifold, and (2) to discover a way to interpolate microstructures via latent space associating with latent microstructure variables. At the heart of this report is the applications of several common DL architectures, including convolutional neural networks (CNN), autoencoder (AE), and generative adversarial network (GAN), to multiple microstructure datasets, and the quest of neural architecture search for optimal DL architectures.

36 MATERIALS SCIENCE↗

SRF Cavity Instability Detection with Machine Learning at CEBAF

During the operation of the Continuous Electron Beam Accelerator Facility (CEBAF), one or more unstable superconducting radio-frequency (SRF) cavities often cause beam loss trips while the unstable cavities themselves do not necessarily trip off. The present RF controls for the legacy cavities report at only 1 Hz, which is too slow to detect fast transient instabilities during these trip events. These challenges make the identification of an unstable cavity out of the hundreds installed at CEBAF a difficult and time-consuming task. To tackle these issues, a fast data acquisition system (DAQ) for the legacy SRF cavities has been developed, which records the sample at 5 kHz. A Principal Component Analysis (PCA) approach is being developed to identify anomalous SRF cavity behavior. We will discuss the present status of the DAQ system and PCA model, along with initial performance metrics. Overall, our method offers a practical solution for identifying unstable SRF cavities, contributing to increased beam availability and machine reliability.

Carpenter, A.↗

SRF Cavity Instability Detection with Machine Learning at CEBAF

During the operation of the Continuous Electron Beam Accelerator Facility (CEBAF), one or more unstable superconducting radio-frequency (SRF) cavities often cause beam loss trips while the unstable cavities themselves do not necessarily trip off. The present RF controls for the legacy cavities report at only 1 Hz, which is too slow to detect fast transient instabilities during these trip events. These challenges make the identification of an unstable cavity out of the hundreds installed at CEBAF a difficult and time-consuming task. To tackle these issues, a fast data acquisition system (DAQ) for the legacy SRF cavities has been developed, which records the sample at 5 kHz. A Principal Component Analysis (PCA) approach is being developed to identify anomalous SRF cavity behavior. We will discuss the present status of the DAQ system and PCA model, along with initial performance metrics. Overall, our method offers a practical solution for identifying unstable SRF cavities, contributing to increased beam availability and machine reliability.

Carpenter, A.↗

Localization in Energy Materials (Final Project Report)

The last year of this award we have continued our research on using quantum machine learning to identify phase transitions. By combining quantum machine learning with quantum computing, we extended a hybrid classical-quantum algorithm to capture the metal-insulator quantum phase transition of the Hubbard model. We have also continued our studies of non-equilibrium dynamics of interacting disordered systems. In particular, we studied the non-equilibrium transient dynamics of a system described by the Anderson-Hubbard model following an interaction and disorder quench, and the effect of disorder on the out-of-time-order correlator on the Hubbard model.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Wavelet and Deep-Learning-Based Approach for Generation System Problematic Parameters Identification and Calibration

Accurate models of generation systems are critical for maintaining reliable and secure grid operations. In this paper, a novel and systematic approach is proposed to identify and calibrate the generation system problematic parameters using continuous wavelet transform (CWT) and advanced deep-learning technology. The phasor measurement unit (PMU) data are used through “event playback” to check whether the parameter calibration is required, and if yes, a group of suspicious parameters will be identified as the primary problematic parameter candidates (PPCs). These primary PPCs are randomly perturbed to generate the event playback simulation data, which are used by the CWT and convolutional neural networks (CNNs) to further narrow down the primary PPCs into a smaller set of candidates. Then, the identified candidates are perturbed again to generate massive event playback simulation data for training a parameter calibration neural network. Here, we designed a multi-output neural network structure to find the mappings between the perturbed parameters and the simulation data using both CNN and long short-term memory (LSTM) models. Finally, the well-trained and tested CNN-LSTM model is used to estimate the accurate value of the suspicious parameters with actual PMU measurements. The proposed CNN-LSTM network can accurately and reliably estimate the generation-system problematic parameters, and has better performance when compared to other machine-learning methods, such as the multilayer perceptron network and the conditional variational autoencoder method. The accuracy and effectiveness of the proposed approach have been validated through simulation and real-world data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

MO-B-19A-01: MOC: A How-To Guide

Medical physicists who were certified in 2002 or later, as well as those who become certified in the future, are enrolled in Maintenance of Certification. Many physicists with life-time certificates have voluntarily enrolled in MOC, as have physicists who volunteer their time to participate in the ABR exam development and administration processes. MOC consists of four components: Part 1, Professional standing; Part 2, Lifelong learning and self-assessment; Part 3, Cognitive expertise; and Part 4, Practice quality improvement. These four components together evaluate six competencies: Medical knowledge, patient care and procedural skills, interpersonal and communication skills, professionalism, practice-based learning and improvement, and systems-based practice. Parts 1, 2, and 3 of MOC are fairly straightforward, although many participants have questions about the process for attesting to professional standing, the opportunities for obtaining self-assessed continuing education, and the timing of the cognitive exam. MOC participants also have questions about Part 4, Practice Quality Improvement. PQI projects are powerful tools for improving the quality and safety of the environments in which we practice medical physics. In the current version of MOC known as “Continuous Certification” a medical physicist must have completed a PQI project within the previous three years, at the time of the ABR's annual look-back each March. For the first “full” annual look-back in March 2016, diplomates will be given an additional year, so that a PQI project completed in 2012, 2013, 2014, or 2015 will fulfill this requirement. Each component of MOC will be addressed, and the specifics of interest to medical physicists will be discussed. Learning Objectives: Understand the four components and six competencies evaluated by MOC. Become familiar with the annual requirements of Continuous Certification. Learn about opportunities for Practice Quality Improvement projects. Understand refinements occurring in the MOC program.

60 APPLIED LIFE SCIENCES↗

Learning subgrid-scale models with neural ordinary differential equations

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary differential equations (NODEs). Solving systems with fine temporal and spatial grid scales is an ongoing computational challenge, and closure models are generally difficult to tune. Machine learning approaches have increased the accuracy and efficiency of computational fluid dynamics solvers. In this approach neural networks are used to learn the coarse- to fine-grid map, which can be viewed as subgrid-scale parameterization. We propose a strategy that uses the NODE and partial knowledge to learn the source dynamics at a continuous level. Our method inherits the advantages of NODEs and can be used to parameterize subgrid scales, approximate coupling operators, and improve the efficiency of low-order solvers. Numerical results with the two-scale Lorenz 96 ODE, the convection-diffusion PDE, and the viscous Burgers' PDE are used to illustrate this approach.

97 MATHEMATICS AND COMPUTING↗

MO-DE-BRA-05: EUTEMPE-RX: Combining E-Learning and Face-To-Face Training to Build Expert Knowledge, Skills and Competences for Medical Physicists in Diagnostic and Interventional Radiology

Purpose: In 2013, the EURATOM authorities of the European Commission decided to support the Horizon2020 project submission ‘EUTEMPE-RX’ that aimed for a new set of course modules to train medical physicists in diagnostic and interventional radiology to expert level with small group deep learning. Each module would consist of 2 phases: an e-learning and a face-to-face phase, each phase requiring typically 40h of participant time. Methods: The European Federation (EFOMP) and 13 European partners, all of them selected for their excellent scientific and/or educational skills, led the 12 course modules. A quality manual ensured the quality of course content and organization. Educational workshops familiarized the teachers with e-learning techniques and methods for assessment. Content was set in accordance with the EC document RP174 that lists learning outcomes in terms of knowledge, skills and competences (KSCs) for different specialties and levels of medical physics. Surveys for stake holder satisfaction were prepared. Results: Today the course modules are being realized. The modules cover most of the KSCs in RP174 document. Teachers have challenged the participants with unique tasks: case studies in medical physics leadership, Monte Carlo simulation of a complete x-ray imaging chain, development of a task specific QA protocol, compilation of optimization plans, simulation tasks with anthropomorphic breast models, etc. Participants undertook practical sessions in modern hospitals and visited a synchrotron facility, a calibration lab, screening organizations, etc. Feedback form quality surveys was very positive and constructive. A sustainability plan has been worked out. Conclusion: The modules have enabled the participants to develop their KSCs and cope with challenges in medical physics. The sustainability plan will be implemented to continue the unique combined e-learning and face to face training at high level training in diagnostic and interventional radiology also beyond Europe. The EUTEMPE-RX project is funded by the Horizon2020 - EURATOM program of the European Commission.

60 APPLIED LIFE SCIENCES↗

Environmental Testing of the OVEN System for Lunar Water Extraction and Prospecting

Introduction: The presence of water ice in permanently shadowed regions on the lunar surface [1] may enable a sustained human presence on the Moon with minimal need for consumables. However, in order to develop a long term utilization plan that includes the usage of in-situ water we must first understand the abundance, stratigraphy and distribution of this re-source. Multiple space agencies currently have plans for lunar water prospecting missions. The Optimized Volatile Extraction Node (OVEN) was designed for water prospecting missions that require samples to be weighed, sealed, and heated as the means of determining water concentration. This method of water quantification necessitates a fair amount of automation, so a rigorous environmental test program was performed in order to build confidence in the performance of the OVEN design. The work presented here describes the OVEN environmental test program as well as ongoing efforts to improve on the design. Vibration: The OVEN participated in two rounds of random vibration tests. The first test was a stand-alone test performed at the Energy Systems Test Area of the Johnson Space Center. The second test was an integrated test with the mobile platform developed for the Resource Prospector project. The OVEN survived both tests without damage, but the tests did provide valuable lessons learned with regards to specific operations. Thermal Vacuum: The OVEN was successfully demonstrated at a temperature range of -50 to 75 C in a thermal vacuum chamber. The need to heat motor gearboxes at lower temperatures was predetermined so this test program was completed by implementing a method of gearbox heating that used the existing circuitry within the motors. Dust: A custom dynamometer was built in order to determine the torque required to move the various mechanisms within the OVEN at a range of temperatures. The OVEN system was coated with lunar dust simulant in order to determine mechanism torques under a worst-case operating condition. Sublimation: Sublimation losses within the OVEN were quantified through a series of test configurations, including an integrated test in a thermal vacuum chamber at Glenn Research Center [2]. Current Work: The OVEN subsystem is currently not a component of any existing prospecting missions, but work continues that will take the lessons learned from previous environmental tests and improve on the design in order to be considered for future prospecting opportunities. References: [1] Colaprete, A., Schultz, P., Heldmann, J., Wooden, D., Shirley, M., Ennico, K., ... & Sollitt, L. (2010). Detection of water in the LCROSS ejecta plume. science, 330(6003), 463-468. [2] Kleinhenz, J., Smith, J., Roush, T., Colaprete, A., Zacny, K., Paulsen, G., ... & Paz, A. (2018). Volatiles Loss from water bearing regolith simulant at Lunar Environments. In Earth and Space 2018: Engineering for Extreme Environments (pp. 454-466). Reston, VA: American Society of Civil Engineers.

A Paz↗

Machine Learning Solutions for a Stable Grid Recovery

Grid operating security studies are typically employed to establish operating boundaries, ensuring secure and stable operation for a range of operation under NERC guidelines. However, if these boundaries are severely violated, existing system security margins will be largely unknown, as would be a secure incremental dispatch path to higher security margins while continuing to serve load. As an alternative to the use of complex optimizations over dynamic conditions, this work employs the use of machine learning to identify a sequence of secure state transitions which place the grid in a higher degree of operating security with greater static and dynamic stability margins. Several reinforcement learning solution methods were developed using deep learning neural networks, including Deep Q-learning, Mu-Zero, and the continuous algorithms Proximal Reinforcement Learning, and Advantage Actor Critic Learning. The work is demonstrated on a power grid with three control dimensions but can be scaled in size and dimensionality, which is the subject of ongoing research.

24 POWER TRANSMISSION AND DISTRIBUTION↗