Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Active Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗

Anomalous And Normal High Performance Computing Datacenter Activities

This code provides annotation and an interface to 10+ hours of video activities in a high performance datacenter with 20+ different types of anomalous activities. The purpose is to enable machine learning for video surveillance systems in high performance computing centers. This is the first code of this type addressing the space of high performance computing datacenters.

Anderson, Matthew↗

SRNL Phase 1 Assessment of the WTP Waste Qualification Program

The Hanford Tank Waste Treatment and Immobilization Plant (WTP) Project is currently transitioning its emphasis from an engineering design and construction phase toward facility completion, start-up and commissioning. With this transition, the WTP Project has initiated more detailed assessments of the requirements that must be met during the actual processing of the Hanford Site tank waste. One particular area of interest is the waste qualification program. In general, the waste qualification program involves testing and analysis to demonstrate compliance with waste acceptance criteria, determine waste processability, and demonstrate laboratory-scale unit operations to support WTP operations. The testing and analysis are driven by data quality objectives (DQO) requirements necessary for meeting waste acceptance criteria for transfer of high-level wastes from the tank farms to the WTP, and for ensuring waste processability including proper glass formulations during processing within the WTP complex. Given the successful implementation of similar waste qualification efforts at the Savannah River Site (SRS) which were based on critical technical support and guidance from the Savannah River National Laboratory (SRNL), WTP requested subject matter experts (SMEs) from SRNL to support a technology exchange with respect to waste qualification programs in which a critical review of the WTP program could be initiated and lessons learned could be shared. The technology exchange was held on July 18-20, 2011 in Richland, Washington, and was the initial step in a multi-phased approach to support development and implementation of a successful waste qualification program at the WTP. The 3-day workshop was hosted by WTP with representatives from the Tank Operations Contractor (TOC) and SRNL in attendance as well as representatives from the US DOE Office of River Protection (ORP) and the Defense Nuclear Facility Safety Board (DNFSB) Site Representative office. The purpose of the workshop was to share lessons learned and provide a technology exchange to support development of a technically defensible waste qualification program. The objective of this report is to provide a review, from SRNL's perspective, of the WTP waste qualification program as presented during the workshop. In addition to SRNL's perspective on the general approach to the waste qualification program, more detailed insight into the specific unit operations presented by WTP during the workshop is provided. This report also provides a general overview of the SRS qualification program which serves as a basis for a comparison between the two programs. Recommendations regarding specific steps are made based on the review and SRNL's lessons learned from qualification of SRS low-activity waste (LAW) and high-level waste (HLW) to support maturation of the waste qualification program leading to WTP implementation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Space Geodesy and Geochemistry Applied to the Monitoring, Verification of Carbon Capture and Storage

This award was a training grant awarded by the U.S. Department of Energy (DOE). The purpose of this award was solely to provide training for two PhD graduate students for three years in the general area of carbon capture and storage (CCS). The training consisted of course work and conducting research in the area of CCS. Attendance at conferences was also encouraged as an activity and positive experience for students to learn the process of sharing research findings with the scientific community, and the peer review process. At the time of this report, both students have approximately two years remaining of their studies, so have not fully completed their scientific research projects.

54 ENVIRONMENTAL SCIENCES↗

Lessons Learned from the Development of an Example Precision Information Environment for International Safeguards

The International Atomic Energy Agency (IAEA) is interested in increasing capabilities of IAEA safeguards inspectors to access information that would improve their situational awareness on the job. A mobile information platform could potentially provide access to information, analytics, and technical and logistical support to inspectors in the field, as well as providing regular updates to analysts at IAEA Headquarters in Vienna or at satellite offices. To demonstrate the potential capability of such a system, Pacific Northwest National Laboratory (PNNL) implemented a number of example capabilities within a PNNL-developed precision information environment (PIE), and using a tablet as a mobile information platform. PNNL’s safeguards proof-of-concept PIE intends to; demonstrate novel applications of mobile information platforms to international safeguards use cases; demonstrate proof-of-principle capability implementation; and provide “vision” for capabilities that could be implemented. This report documents the lessons learned from this two-year development activity for the Precision Information Environment for International Safeguards (PIE-IS), describing the developed capabilities, technical challenges, and considerations for future development, so that developers working to develop a similar system for the IAEA or other safeguards agencies might benefit from our work.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Study of MHD Stability, Active Mode Control, and Disruption Avoidance in NSTX-U

Learning how to achieve sustained operation at high plasma pressure is an important goal of the National Spherical Torus Upgrade (NSTX-U) program and is critically important to any future fusion power plant. This research addresses high priority stability and control issues outlined by the NSTX-U Program. Reduced models of the stabilization physics learned continue to be created and tested against actual plasma operation in NSTX, NSTX-U, and other tokamak devices. This research is forming physics-based models for disruption forecasting that aims to unify results across different fusion machines for more confident extrapolation of the techniques studied to future devices including ITER. The Disruption Event Characterization and Forecasting (DECAF) code was expanded to analyze data from the TCV tokamak, including real-time MHD analysis signals. The presence of a mode and likelihood of its m/n numbers can be tracked, as well as the mode frequency, although a limitation at low frequency does not yet allow tracking modes to the locking point in TCV. Initial analyses of NSTX-U operation were conducted using the DECAF code. The timing of sawtooth oscillations was investigated taking advantage of the more extensive L-mode operation of the device in its first run campaign. An initial investigation of thermal collapses in NSTX-U was also conducted with specific comparison to the Greenwald density limit. A local island power balance model to explain the density limit in tokamaks has been tested with NSTX data and is being evaluated as a potential disruption forecaster in the DECAF code, presently showing similarities to the global Greenwald density evolution and limit. A module was written for the DECAF code that generalizes magnetic spectrogram analysis of MHD modes. This new portable code, written in Python, discriminates the toroidal mode number of instabilities and can track each mode as a DECAF event, monitoring the evolution of the mode through bifurcation and locking points. This is a critical new capability to allow disruption event characterization for general tokamak databases.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An Accuracy-Maximization Approach for Claims Classifiers in Document Content Analytics for Cybersecurity

This paper presents our research approach and findings towards maximizing the accuracy of our classifier of feature claims for cybersecurity literature analytics, and introduces the resulting model ClaimsBERT. Its architecture, after extensive evaluations of different approaches, introduces a feature map concatenated with a Bidirectional Encoder Representation from Transformers (BERT) model. We discuss deployment of this new concept and the research insights that resulted in the selection of Convolution Neural Networks for its feature mapping aspects. We also present our results showing ClaimsBERT to outperform all other evaluated approaches. This new claims classifier represents an essential processing stage within our vetting framework aiming to improve the cybersecurity of industrial control systems (ICS). Furthermore, in order to maximize the accuracy of our new ClaimsBERT classifier, we propose an approach for optimal architecture selection and determination of optimized hyperparameters, in particular the best learning rate, number of convolutions, filter sizes, activation function, the number of dense layers, as well as the number of neurons and the drop-out rate for each layer. Fine-tuning these hyperparameters within our model led to an increase in classification accuracy from 76% obtained with BertForSequenceClassification’s original model to a 97% accuracy obtained with ClaimsBERT.

Ameri, Kimia (ORCID:0000000328791871)↗

Bottleneck Detection in Modular Construction Factories Using Computer Vision

The construction industry is increasingly adopting off-site and modular construction methods due to the advantages offered in terms of safety, quality, and productivity for construction projects. Despite the advantages promised by this method of construction, modular construction factories still rely on manually-intensive work, which can lead to highly variable cycle times. As a result, these factories experience bottlenecks in production that can reduce productivity and cause delays to modular integrated construction projects. To remedy this effect, computer vision-based methods have been proposed to monitor the progress of work in modular construction factories. However, these methods fail to account for changes in the appearance of the modular units during production, they are difficult to adapt to other stations and factories, and they require a significant amount of annotation effort. Due to these drawbacks, this paper proposes a computer vision-based progress monitoring method that is easy to adapt to different stations and factories and relies only on two image annotations per station. In doing so, the Scale-invariant feature transform (SIFT) method is used to identify the presence of modular units at workstations, and the Mask R-CNN deep learning-based method is used to identify active workstations. This information was synthesized using a near real-time data-driven bottleneck identification method suited for assembly lines in modular construction factories. This framework was successfully validated using 420 h of surveillance videos of a production line in a modular construction factory in the U.S., providing 96% accuracy in identifying the occupancy of the workstations and an F-1 Score of 89% in identifying the state of each station on the production line. The extracted active and inactive durations were successfully used via a data-driven bottleneck detection method to detect bottleneck stations inside a modular construction factory. The implementation of this method in factories can lead to continuous and comprehensive monitoring of the production line and prevent delays by timely identification of bottlenecks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluation Of Sludge Heel Dissolution Efficiency With Oxalic Acid Cleaning At Savannah River Site

The chemical cleaning process baseline strategy at the Savannah River Site was revised to improve efficiency during future execution of the process based on lessons learned during previous bulk oxalic acid cleaning activities and to account for operational constraints imposed by safety basis requirements. These improvements were also intended to transcend the difficulties that arise from waste removal in higher rheological yield stress sludge tanks. Tank 12 implemented this improved strategy and the bulk oxalic acid cleaning efforts concluded in July 2013. The Tank 12 radiological removal results were similar to previous bulk oxalic acid cleaning campaigns despite the fact that Tank 12 contained higher rheological yield stress sludge that would make removal more difficult than the sludge treated in previous cleaning campaigns. No appreciable oxalate precipitation occurred during the cleaning process in Tank 12 compared to previous campaigns, which aided in the net volume reduction of 75-80%. Overall, the controls established for Tank 12 provide a template for an improved cleaning process.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Research and Development on the Storage Ring Vacuum System for the APS Upgrade Project

A number of research and development activities are underway at Argonne National Laboratory to build confidence in the designs for the storage ring vacuum system required for the Advanced Photon Source Up-grade project (APS-U) [1]. The predominant technical risks are: excessive residual gas pressures during operation; insufficient beam position monitor stability; excessive beam impedance; excessive heating by induced electrical surface currents; and insufficient operational reliability. Present efforts to mitigate these risks include: building and evaluating mockup assemblies; performing mechanical testing of chamber weld joints; developing computational tools; investigating design alternatives; and performing electrical bench measurements. Status of these activities and some of what has been learned to date will be shared.

APS-U, APS UPGRADE PROJECT, STORAGE RING VACUUM SY↗

Dynamic defense and network randomization for computer systems

The various technologies presented herein relate to determining a network attack is taking place, and further to adjust one or more network parameters such that the network becomes dynamically configured. A plurality of machine learning algorithms are configured to recognize an active attack pattern. Notification of the attack can be generated, and knowledge gained from the detected attack pattern can be utilized to improve the knowledge of the algorithms to detect a subsequent attack vector(s). Further, network settings and application communications can be dynamically randomized, wherein artificial diversity converts control systems into moving targets that help mitigate the early reconnaissance stages of an attack. An attack(s) based upon a known static address(es) of a critical infrastructure network device(s) can be mitigated by the dynamic randomization. Network parameters that can be randomized include IP addresses, application port numbers, paths data packets navigate through the network, application randomization, etc.

97 MATHEMATICS AND COMPUTING↗

From Theory to Practice: Lessons Learned from an Advanced M&V Commercial Pilot

Advanced measurement & verification (M&V), or M&V 2.0, is an energy data analysis method using advanced metering infrastructure (AMI) data in combination with analytics to quantify energy efficiency project savings. Advanced M&V is viewed as an enabler for underutilized behavioral, retrocommissioning, and holistic multi-measure efficiency efforts, as quantifying savings for these programs with existing methods has typically been very challenging. Despite its promise, there are still several unanswered questions about the use of advanced M&V such as: How accurately can these tools quantify energy savings? How can advanced M&V satisfy regulatory requirements for rigorous savings estimates? Where and how does advanced M&V intersect with traditional impact evaluation and the principles of ‘embedded’ evaluation, measurement & verification (EM&V)? Pilots are being pursued in various regions and program contexts to address these research questions. However, results from these pilots are rarely made public, meaning that lessons may not be widely shared and the scope of analyses varies widely. The paper presents encouraging results from a recent advanced M&V pilot and discusses key process-related aspects such as managing AMI data and refining analysis methodologies. An approach to reviewing and classifying projects based on savings characteristics and magnitude is demonstrated, as a potential risk management tool. The authors also demonstrate how advanced M&V can identify underperforming projects and non-routine events in a timely manner. The paper also outlines lessons learned from this and other recent pilot activity and barriers to be overcome in moving toward the goal of widespread adoption of holistic meter-based programs.

Crowe, Eliot↗

A Revised International Standard for Gearboxes in Wind Turbine Systems

Gearbox and wind turbine design and application standards have contributed significantly to improvements in reliability over the past two decades. The International Electrotechnical Commission (IEC) 61400-4 standard of wind turbine gearbox design is currently being revised by a joint working group (JWG) of experts in IEC TC 88 (wind energy) and International Organization for Standardization (ISO) TC60 (gears) to further that effort. Experts from ISO TC4 (rolling bearings) and ISO TC28 (lubricants) have actively participated. This revision has implemented lessons learned from industry use of edition 1 since its publication in 2012. The main document, IEC 61400-4, was pared down to essential design requirements and application-specific recommendations along with a design verification framework. The JWG leveraged concurrent development of other standards, such as IEC 61400-8 on wind turbine structures, to replace edition 1 content. These are described along with how this works with the IEC Renewable Energy certification scheme for wind turbines (IECRE-WE). The JWG recognized the interest in maintaining informative parts of edition 1 including annexes on wind turbine architecture and loads, bearing and gear arrangements, bearing selection, lubrication system descriptions and lubricant performance recommendations. This information was retained in two technical reports: IEC/TR 61400-4-2 Lubrication and IEC/TR 61400-4-3 Explanatory Notes. Additionally, a technical specification, IEC/TS 61400-4-1, was drafted to provide a reliability calculation method for comparing different design options or conditions. Salient elements of these documents are described. All four documents were recently distributed for IEC/ISO review, ballot, and comment. Publication is expected in 2023.

gearbox↗

A Revised International Standard for Gearboxes in Wind Turbine Systems: Preprint

Gearbox and wind turbine design and application standards have contributed significantly to improvements in reliability over the past two decades. The International Electrotechnical Commission (IEC) 61400-4 standard of wind turbine gearbox design is currently being revised by a joint working group (JWG) of experts in IEC TC 88 (wind energy) and International Organization for Standardization (ISO) TC60 (gears) to further that effort. Experts from ISO TC4 (rolling bearings) and ISO TC28 (lubricants) have actively participated. This revision has implemented lessons learned from industry use of edition 1 since its publication in 2012. The main document, IEC 61400-4, was pared down to essential design requirements and application-specific recommendations along with a design verification framework. The JWG leveraged concurrent development of other standards, such as IEC 61400-8 on wind turbine structures, to replace edition 1 content. These are described along with how this works with the IEC Renewable Energy certification scheme for wind turbines (IECRE-WE). The JWG recognized the interest in maintaining informative parts of edition 1 including annexes on wind turbine architecture and loads, bearing and gear arrangements, bearing selection, lubrication system descriptions and lubricant performance recommendations. This information was retained in two technical reports: IEC/TR 61400-4-2 Lubrication and IEC/TR 61400-4-3 Explanatory Notes. Additionally, a technical specification, IEC/TS 61400-4-1, was drafted to provide a reliability calculation method for comparing different design options or conditions. Salient elements of these documents are described. All four documents were recently distributed for IEC/ISO review, ballot, and comment. Publication is expected in 2023.

ENGINEERING,WIND ENERGY↗

Sourcing thermotolerant poly(ethylene terephthalate) hydrolase scaffolds from natural diversity

Enzymatic deconstruction of poly(ethylene terephthalate) (PET) is under intense investigation, given the ability of hydrolase enzymes to depolymerize PET to its constituent monomers near the polymer glass transition temperature. To date, reported PET hydrolases have been sourced from a relatively narrow sequence space. Here, we identify additional PET-active biocatalysts from natural diversity by using bioinformatics and machine learning to mine 74 putative thermotolerant PET hydrolases. We successfully express, purify, and assay 51 enzymes from seven distinct phylogenetic groups; observing PET hydrolysis activity on amorphous PET film from 37 enzymes in reactions spanning pH from 4.5–9.0 and temperatures from 30–70 °C. We conduct PET hydrolysis time-course reactions with the best-performing enzymes, where we observe differences in substrate selectivity as function of PET morphology. We employed X-ray crystallography and AlphaFold to examine the enzyme architectures of all 74 candidates, revealing protein folds and accessory domains not previously associated with PET deconstruction. Overall, this study expands the number and diversity of thermotolerant scaffolds for enzymatic PET deconstruction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning for Anomaly Detection in Neural Network Security and SRF Cavities

This dissertation explores the development and deployment of machine learning approaches to address critical challenges in anomaly detection across two distinct domains: neural network security in federated learning settings and cavity behavior analysis in particle accelerator operations at Jefferson Lab in Newport News, Virginia. Anomaly detection identifies deviations from expected patterns, safeguarding systems in cybersecurity, industry, and research against malicious activities and failures. This dissertation demonstrates how our machine learning approaches enhance detection accuracy and efficiency in both neural network security and industrial applications. First, we investigate vulnerabilities in deep neural networks deployed in federated learning. Although federated learning preserves user privacy by training models locally, it remains vulnerable to backdoor attacks, in which malicious participants embed hidden triggers that induce targeted misbehavior. We propose a self-supervised contrastive learning framework to detect and mitigate such backdoor attacks. In our experiments, this method achieves higher detection accuracy and lower false positive rates than existing defenses, while operating without access to local model updates or original training data and thus preserving the privacy guarantees of the federated setting. Second, we address the operational reliability of superconducting radio-frequency (SRF) cavities at the Continuous Electron Beam Accelerator Facility (CEBAF). Our research leverages an unsupervised learning approach, combined with Principal Component Analysis (PCA) and k-means clustering, to identify anomalous behaviors in SRF cavities. Our method detects subtle anomalous behavior by analyzing SRF signal data. This knowledge allows for the early detection and resolution of potential faults, significantly improving the efficiency and reliability of operations. Third, we extend these insights to time-series anomaly detection more broadly. We design a contrastive-learning based model tailored to increasingly dynamic environments and academic research. This model improves detection accuracy in settings that require real-time monitoring and predictive maintenance. Our research underscores the broader applicability and impact of advanced machine learning techniques in anomaly detection. By extracting meaningful patterns from complex data, machine learning can significantly enhance security in distributed neural networks and improve the efficiency of particle accelerator operations. This dissertation serves as a stepping stone for future investigations into the vast possibilities of anomaly detection, inspiring further exploration and development of machine learning techniques in this field.

Ferguson, Hal [Old Dominion University]↗

A Weakly Supervised Machine Learning Procedure for Magnet Quench Diagnostics

Voltage taps remain the standard and reliable diagnostic tool for detecting quenches in superconducting magnets. However, they identify a quench only at the time of voltage rise and do not provide information on earlier physical precursors. In this work, we investigate whether acoustic emission data can reveal precursor activity that occurs before conventional voltage detection using machine learning techniques. We introduce an event selection method and a weakly supervised machine learning procedure to learn data-driven criteria for identifying potential acoustic precursors to quenches. Two Convolutional Neural Network (CNN) architectures are trained: one on acoustic sensor events from our selection procedure and one on the Fast Fourier Transforms (FFTs) of these events. Both networks are trained iteratively using confidence-weighted loss functions to associate certain subsets of training data with a precursor label. We evaluate the performance of these models by examining the time distribution of events classified as potential precursors relative to the quench onset. Results indicate that the proposed approach can possibly distinguish acoustic emission events occurring closer to the quench from earlier acoustic activity during ramping, suggesting the potential for flagging quench precursors in acoustic data.

Khan, Maira [Fermilab] (ORCID:0009000891602387)↗

Learning nonlinear level sets for dimensionality reduction in function approximation

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications, where practitioners would replace their computationally intensive physical models (e.g., high-resolution fluid simulators) with fast-to-evaluate predictive machine learning models, so as to accelerate the engineering design processes. There are two major challenges in constructing such predictive models: (a) high-dimensional inputs (e.g., many independent design parameters) and (b) small training data, generated by running extremely time-consuming simulations. Thus, reducing the input dimension is critical to alleviate the over-fitting issue caused by data insufficiency. Existing methods, including sliced inverse regression and active subspace approaches, reduce the input dimension by learning a linear coordinate transformation; our main contribution is to extend the transformation approach to a nonlinear regime. Specifically, we exploit reversible networks (RevNets) to learn nonlinear level sets of a high-dimensional function and parameterize its level sets in low-dimensional spaces. A new loss function was designed to utilize samples of the target functions' gradient to encourage the transformed function to be sensitive to only a few transformed coordinates. The NLL approach is demonstrated by applying it to three 2D functions and two 20D functions for showing the improved approximation accuracy with the use of nonlinear transformation, as well as to an 8D composite material design problem for optimizing the buckling-resistance performance of composite shells of rocket inter-stages.

Zhang, Guannan↗