Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning and control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Enhancing gene regulatory network inference through data integration with markov random fields

Here, a gene regulatory network links transcription factors to their target genes and represents a map of transcriptional regulation. Much progress has been made in deciphering gene regulatory networks computationally. However, gene regulatory network inference for most eukaryotic organisms remain challenging. To improve the accuracy of gene regulatory network inference and facilitate candidate selection for experimentation, we developed an algorithm called GRACE (Gene Regulatory network inference ACcuracy Enhancement). GRACE exploits biological a priori and heterogeneous data integration to generate high- confidence network predictions for eukaryotic organisms using Markov Random Fields in a semi-supervised fashion. GRACE uses a novel optimization scheme to integrate regulatory evidence and biological relevance. It is particularly suited for model learning with sparse regulatory gold standard data. We show GRACE’s potential to produce high confidence regulatory networks compared to state of the art approaches using Drosophila melanogaster and Arabidopsis thaliana data. In an A. thaliana developmental gene regulatory network, GRACE recovers cell cycle related regulatory mechanisms and further hypothesizes several novel regulatory links, including a putative control mechanism of vascular structure formation due to modifications in cell proliferation.

59 BASIC BIOLOGICAL SCIENCES↗

Anion-derived contact ion pairing as a unifying principle for electrolyte design

Enabling new electrochemical technologies requires systems that can operate under ever-more demanding conditions, and progress in energy storage applications reveals tantalizing opportunities to reimagine electrolyte design for performance at extreme potentials. Here, a common thread among these innovations is the formation of significant populations of contact ion pairs (CIPs) in the electrolyte, regardless of the specific cation chemistry or solvent system. The examples summarized in this review suggest that a set of general electrolyte design rules likely exists, where the purposeful selection of anion chemistry can yield CIP structures with tunable control over reaction thermodynamics, kinetics, and interphase chemistry. Identifying the relevant descriptors for high-performance, anion-derived CIP structures can be achieved utilizing a combined experimental and computational approach, aided by machine learning and artificial intelligence, to more rapidly survey the vast combinatorial space available and to enable a new generation of electrolytes for decarbonized electrochemical processes at scale.

electrochemistry↗

All-optical reconfiguration of single silicon-vacancy centers in diamond for non-volatile memories

Strain engineering is vital for tuning the optical and spin properties of solid-state color centers, enhancing spin coherence and compensating emission wavelength shift. Here, we develop an all-optical approach to directly modify the local strain of color centers at the nanoscale by migrating the nearby defect. High-power pulsed optical irradiation triggers defect migration, which subsequently leads to the redistribution of the local crystal lattice of the host material. This redistribution alters the strain experienced by nearby color centers. Using silicon-vacancy centers in diamond, we validate this method and demonstrate a ground state splitting enhancement of up to 1.8 THz. Unlike conventional methods, our approach requires no external fields or nanostructure modifications, enabling non-volatile strain control and optical memory functionality across wide temperature ranges. Its local, permanent nature offers a scalable path for enhancing spin coherence in large-scale quantum systems and has potential applications in photonic machine learning.

Nanoscale devices↗

Aftershock Identification Using a Paired Neural Network Applied to Constructed Data

This report is intended to detail the findings of our investigation of the applicability of machine learning to the task of aftershock identification. The ability to automatically identify nuisance aftershock events to reduce analyst workload when searching for events of interest is an important step in improving nuclear monitoring capabilities and while waveform cross - correlation methods have proven successful, they have limitations (e.g., difficulties with spike artifacts, multiple aftershocks in the same window) that machine learning may be able to overcome. Here we apply a Paired Neural Network (PNN) to a dataset consisting of real, high quality signals added to real seismic noises in order to work with controlled, labeled data and establish a baseline of the PNN's capability to identify aftershocks. We compare to waveform cross - correlation and find that the PNN performs well, outperforming waveform cross - correlation when classifying similar waveform pairs, i.e., aftershocks.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Emerging Threats and Technology Investigation: Industrial Internet of Things - Risk and Mitigation for Nuclear Infrastructure

Industries supporting the global nuclear infrastructure striving for cost savings, expansions in efficiency, and convenience are likely to adopt components (e.g., hardware, software) that comprise the Internet of Things (IoT) and Industrial Internet of Things (IIoT). These devices offer potential improvements along with security challenges. Modern conveniences achieved through application of technology have propagated through society in the form of interconnected devices, from doorbells to microwave ovens, commonly referred to as IoT. IoT devices are often Internet-connected devices that are designed to send data back to a cloud-based server, where a smart phone application then presents device status and control options. Home-based IoT applications carry a different set of risks when compared to a business or security environment, where there is also a history of convenience and interconnection. Industrial settings have long relied on specifically designed Supervisory Control and Data Acquisition (SCADA) systems for process control where IIoT devices are intended to inform business decisions and augment traditional processes. A recent National Institute of Standards and Technology (NIST) report provides a distinction between process control and IIoT in that traditional process control is not replaced by IIoT, but rather IIoT devices are intended to enhance industrial processes through additional monitoring of various sensors and application of data analytics models using artificial intelligence (AI) and machine learning (ML) (Fagan, Marron, et al. 2021) (Ross, et al. 2021).

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A vision-based telerobotic control station

A telerobotic control station is described. In it, a machine vision system measures the position, orientation, and configuration of a user's hand. A robotic manipulator mirrors the status of the hand. This concept has two benefits: control actions are intuitive and easily learned, and the workstation requires little volume or mass.

Tillotson, Brian↗

Earth Independent Medical Operations (EIMO) DATASCOPE Technical Interchange Meeting 21st August 2023: Background and Summary of Discussion

An aspiration for EIMO datascope is to realize artificial intelligence-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A vision proposed to the meeting participants was that of a “system of systems,” whereby EIMO will utilize AI-supported natural language processing and machine learning techniques to synthesize embedded reference databases and real-time data streams [input vectors] from multiple data sources to continuously and seamlessly assess crew health & performance. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will ideally have a degree of mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats.

Artificial Intelligence↗

Natural Language Processing Methods for Air Traffic Management Text and Speech Data

This presentation discusses two efforts of the NARI AI/ML Intern team during the Fall 2021 OSTEM Internship term. For Letters of Agreement (LoA), we have studied how LoAs are structured and explored the question ‘What is an LoA constraint?’ To do this, our approach is data-driven, iterative, and assisted by machine learning when available. In this presentation, we will walk through our tasks of manually scanning through documents, performing a preliminary entity labelling task, and our unsupervised analysis on LoA procedures sections. After this research phase, we define the smallest constraint unit in an LoA, and start to perform entity extraction. Looking towards constraint extraction, we are also exploring the use of a one-class support vector machine (OneClassSVM) model to identify patterns within the data. The second effort of our team this term is focused on Air Traffic Control System Command Center (ATCSCC) advisory meetings, and the subsequent advisory documents that get published from their content. These advisory documents are important to give readily accessible summaries of daily operations, so that data centers, airline officials, and other stakeholders can easily understand the context of these meetings in real time. In applying machine learning to this scenario, two natural language processing tasks are used. First is developing machine learning models to convert the meeting speech data into text. With this text, use of extractive and abstractive text summarization models are used to automatically generate preliminary versions of the advisory documents.

Natural Language Processing↗

Hybrid Modeling of Unmanned Aerial Vehicle Electric Powertrain for Fault Detection and Diagnostics

This paper shows the application of hybrid physics-informed machine learning to a representative electric powertrain for unmanned aerial vehicles. The model is composed of physics-derived principles and empirical equations, as well as fully connected networks that are strategically placed within the model to substitute equations that are subject to large uncertainty. Polynomial fit driven by heuristics or empirical observations can be substituted by more flexible networks that can minimize the error between model predictions and observations without being restricted to a predefined functional form. This modeling strategy allows training of networks deep inside the model and unknown parameters in a single learning stage. It has already been applied to Li-ion batteries in the past, and in this work, we extend the applications to other components of an electric powertrain, namely electronic speed controller with pulse-width modulation, and brushless DC motor with connected propeller. Training and testing of the model is carried out using experimental data from Li-ion battery discharge and powertrain testing in a laboratory environment.

Physics-Informed Machine Learning↗

Bilinear dynamic mode decomposition for quantum control

Abstract Data-driven methods for establishing quantum optimal control (QOC) using time-dependent control pulses tailored to specific quantum dynamical systems and desired control objectives are critical for many emerging quantum technologies. We develop a data-driven regression procedure, bilinear dynamic mode decomposition (biDMD), that leverages time-series measurements to establish quantum system identification for QOC. The biDMD optimization framework is a physics-informed regression that makes use of the known underlying Hamiltonian structure. Further, the biDMD can be modified to model both fast and slow sampling of control signals, the latter by way of stroboscopic sampling strategies. The biDMD method provides a flexible, interpretable, and adaptive regression framework for real-time, online implementation in quantum systems. Further, the method has strong theoretical connections to Koopman theory, which approximates nonlinear dynamics with linear operators. In comparison with many machine learning paradigms minimal data is needed to construct a biDMD model, and the model is easily updated as new data is collected. We demonstrate the efficacy and performance of the approach on a number of representative quantum systems, showing that it also matches experimental results.

97 MATHEMATICS AND COMPUTING↗

Jefferson Laboratory C100 Superconducting Radio-Frequency Cavity Fault Data, 2020

The dataset was created to train machine learning models for the task of identifying the (1) cavity and (2) fault type from C100-type cryomodules at the Thomas Jefferson National Accelerator Facility (Jefferson Lab), thereby replacing the time-consuming efforts of a subject matter expert. Superconducting radio-frequency (SRF) cavity trips represent a significant source of accelerator downtime. Real-time – rather than post-mortem – identification of the offending cavity and classification of the fault type would give control room operators valuable feedback for corrective action planning. The anticipated benefit is increased beam-on-target time for users and provides performance metrics that can be used to improve future cavity designs. A series of 17 RF signals are recorded for each of the 8 cavities in a C100 cryomodule every time a cavity trips. These time-series signals are written to file using a specially designed data acquisition system. The dataset represents fault events recorded during Continuous Electron Beam Accelerator Facility (CEBAF) beam operations between January 18, 2019 and March 9, 2020. The following filtering steps were applied to collected data; (1) only 4 of the 17 signals per cavity are retained (GMES, GASK, CRFP, DETA2) (2) only events with data from each of the eight cavities in the cryomodule are kept, (3) only events that were sampled at 5 kHz were kept, (4) events from cryomodule 0L04 were neglected, (5) events occurring between February 4, 3PM and February 5, 12PM were neglected. As a result of preprocessing, the dataset is comprised of 2,375 unique events. The full dataset is comprised of three files: features.csv, cavity_labels.csv, fault_labels.csv. Each instance in faults.csv includes a timestamp (“date_time”), a label for the cryomodule which experienced the trip (“zone_label”), and 192 features (“feature_1”, “feature_2”... “feature_192”). The features correspond to 6 autoregressive features for each of 4 signals per cavity for each of the 8 cavities (6 × 4 signals/cavity × 8 cavities/cryomodule = 192). To deal with the large variation of signal amplitudes, time-series standardization via the z-score (standard score) function was applied prior to computing the features. For each instance, there is an associated label for the (1) cavity which faulted first (cavity_labels.csv) and (2) the type of fault that caused the trip (fault_labels.csv). The cavity identification can take values of [0, 1, 2, 3, 4, 5, 6, 7, 8] and the fault type can take values of [‘Microphonics’, ‘Quench_100ms’, ‘Controls_Fault’, ‘E_Quench’, ‘Quench_3ms’, ‘Single_Cav_Turn_Off’ , ‘Heat_Riser_Choke’, ‘Multi_Cav_Turn_Off’].

43 PARTICLE ACCELERATORS↗

Bio-inspired gas sensing: boosting performance with sensor optimization guided by “machine learning”

The performance of existing gas sensors often degrades in field conditions because of the loss of measurement accuracy in the presence of interferences. Thus, new sensing approaches are required with improved sensor selectivity. We are developing a new generation of gas sensors, known as multivariable sensors, that have several independent responses for multi-gas detection with a single sensor. In this study, we analyze the capabilities of natural and fabricated photonic three-dimensional (3-D) nanostructures as sensors for the detection of different gaseous species, such as vapors and non-condensable gases. We employed bare Morpho butterfly wing scales to control their gas selectivity with different illumination angles. Next, we chemically functionalized Morpho butterfly wing scales with a fluorinated silane to boost the response of these nanostructures to the vapors of interest and to suppress the response to ambient humidity. Further, we followed our previously developed design rules for sensing nanostructures and fabricated bioinspired inorganic 3-D nanostructures to achieve functionality beyond natural Morpho scales. These fabricated nanostructures have embedded catalytically active gold nanoparticles to operate at high temperatures of ≈300 °C for the detection of gases for solid oxide fuel cell (SOFC) applications. Our performance advances in the detection of multiple gaseous species with specific nanostructure designs were achieved by coupling the spectral responses of these nanostructures with machine learning (a.k.a. multivariate analysis, chemometrics) tools. Our newly acquired knowledge from studies of these natural and fabricated inorganic nanostructures coupled with machine learning data analytics allowed us to advance our design rules for sensing nanostructures toward the required gas selectivity for numerous gas monitoring scenarios at room and high temperatures for industrial, environmental, and other applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

Loss of Control↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T 2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

Loss of Control↗

Anomaly Detection for Power System Generation Control based on Hierarchical DBSCAN

The generation level of a generator in power grid is under control of multiple control loops such as governor action, Automatic Generation Control (AGC), and manual control. These control loops are vulnerable to cyber attacks and could become potential targets for the malicious adversary. In this paper, we investigated the detection of abnormal generation controls induced by cyber attacks. One data-driven anomaly detection methodology is presented based on the behavior conformity of generation units located in the same balancing authority. A semi-supervised clustering algorithm with Hierarchical Density based Spatial Clustering of Application with Noise (HDBSCAN) is proposed for the detection model training. In our previous work, we obtained a synthetic dataset that covers scenarios including normal operation, generation control under ramp attack, switching attack, AGC integrity attacks, etc. and it is used to evaluate the proposed clustering algorithm. Experimental results show that the proposed algorithm provides better detection accuracy than K-means clustering and can distinguish not only between normal and abnormal generation controls but also among various anomaly scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Full-scale Demonstration of Multi-process Sensor at a Cycling PC-fired Boiler

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of coal-fired utility boilers in this project but can be applied to many other industries and applications as well. This project leveraged the existing electrochemical noise-based monitoring system and the new sensor design is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data is transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, the three mMPMS were installed at a full-scale pulverized coal-fired plant, PacifiCorp’s Hunter 3. The systems were demonstrated over 20,000 hours at the plant during regular operation. Also, the sensor data was fed to the plant’s advanced process control system to evaluate the corrosion control by the operation changes and utilized to understand the impacts of load cycling with different ramping up and down speeds. At the end of the project, the systems were converted to the permanent installation at the power plant to be used with the advanced process control system installed at the plant.

Advanced Sensors, Corrosion, Ash Deposition, Optim↗

Parametric Optimization of Rigid Wheels for Planetary Surface Mobility Applications

Design-Build-Test approaches for spaceflight hardware are time and cost intensive, which can result in suboptimal mechanism designs. Optimization-based approaches that utilize high-fidelity models and physics simulation could overcome these limitations while simultaneously speeding up the mechanical design process and reducing cost. In this work, we present a toolchain that enables the multi-objective optimization of rigid rover wheels for planetary surface mobility applications. The toolchain uses Chrono’s Continuous Representation Model (CRM) functionality to simulate granular soil and performs multi-objective parametric optimization on candidate rover wheels to meet a desired performance criterion. The resulting wheel design is then evaluated experimentally using a single-wheel testbed. We end with a discussion of how the toolchain can be extended to simultaneously co-optimize other system parameters, such as system power consumption and feedback control gains.

Optimization↗

WE-D-BRE-05: Prediction of Late Radiation-Induced Proctitis in Prostate Cancer Patients Using Chromosome Aberration and Cell Proliferation Rate

Purpose: Chromosome damage and cell proliferation rate have been investigated as potential biomarkers for the early prediction of late radiationinduced toxicity. Incorporating these endpoints, we explored the predictive power for late radiation proctitis using a machine learning method. Methods: Recently, Beaton et al. showed that chromosome aberration and cell proliferation rate could be used as biomarkers to predict late radiation proctitis (Beaton et al. (2013) Int J Rad Onc Biol Phys, 85:1346–1352). For the identification of radiosensitive biomarkers, blood samples were collected from 10 patients with grade 3 late proctitis along with 20 control patients with grade 0 proctitis. After irradiation at 6 Gy, statistically significant difference was observed between the two groups, using the number of dicentrics and excess fragments, and the number of cells in metaphase 2 (M2). However, Beaton et al. did not show the usefulness of combining these endpoints. We reanalyzed the dataset to investigate whether incorporating these endpoints can increase the predictive power of radiation proctitis, using a support vector machine (SVM). Results: Using the SVM method with the number of fragments and M2 endpoints, perfect classification was achieved. In addition, to avoid biased estimate of the classification method, leave-one-out cross-validation (LOO-CV) was performed. The best performance was achieved when all three endpoints were used with 87% accuracy, 90% sensitivity, 85% specificity, and 0.85 AUC (the area under the receiver operating characteristic (ROC) curve). The most significant endpoint was the number of fragments that obtained 83% accuracy, 70% sensitivity, 90% specificity, and 0.82 AUC. Conclusion: We demonstrated that chromosome damage and cell proliferation rate could be significant biomarkers to predict late radiation proctitis. When these endpoints were used together in conjunction with a machine learning method, the better performance was obtained. However, evaluation for other late radiation toxicities is necessary to elucidate these observations.

60 APPLIED LIFE SCIENCES↗