Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Panel Session 62: Progress on Deep Repository Programs Around the World

This panel session focused on the progress of deep repository programs, worldwide. While efforts on a deep geological repository for SNF/UNF and HLW in the USA were terminated in 2010, several other repository programs continue to make considerable progress and deserve to be recognized. Panelists were invited from national, multi-national, and international repository programs and organizations to report upon the status and future as well as the perceived reasons underlying the success and the failure of components of their respective repository program. This panel provided a forum for interested parties to present, exchange, and take advantage of, as appropriate, repository progress, challenges, concepts/designs and other lessons learned around the world, including site characterization, site selection, research and development, licensing, construction, operation, and public acceptance and participation. Presentations proposed include: 1 - Cigeo (French Deep Geological Repository Project) update 2018 (Daniel Delort, Andra (France)); 2 - Progress on Deep Geological Repository Programs Around the World (Bruce McKirdy, Radioactive Waste Management (United Kingdom)); 3 - Geological disposal facility in Belgium (Didier Leonard, ONDRAF/NIRAS (Belgium))

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Panel Session 89: Progress on Deep Repository Around the World

This panel focused on the progress of deep repository programs, worldwide. While efforts on a deep geological repository for SNF/UNF and HLW in the USA were terminated in 2010, several other repository programs continue to make considerable progress 10 and deserve to be recognized. Panelists from national, multi-national, and international repository programs and organizations reported on the status and future plans as well as the perceived reasons underlying the success and the failure of components of their respective repository program. This session provided a forum for interested parties to present, exchange, and take advantage of, as appropriate, repository progress, challenges, concepts/designs and other lessons learned around the world, including site characterization, site selection, research and development, licensing, construction, operation, and public acceptance and participation. Panelists with presentations: Switzerland's Geological Repository Program for Radioactive Waste (Tim Vietor); Update on NWMO's Progress in Implementing Canada's Plan (Sarah Hirschorn); Cigeo Project Progress and Next Milestones (Corinne Bauer)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Ensuring Safe, Effective, and Reliable Use of Artificial Intelligence-Based Applications for Nuclear Electricity Generation through a Systems Approach

There is a significant potential to reduce operating and maintenance cost at nuclear power plants using artificial intelligence (AI) and machine learning (ML). For instance, AI/ML has the potential to significant improve work management processes, condition reporting, and plant surveillance activities. However, the nuclear industry has been slow in adopting AI/ML due to several multifaceted barriers discussed in this paper. This work presents such multidisciplinary approach intended to 1) accelerate industry adoption of AI/ML-based applications at nuclear power plants and 2) ensure their safe, reliable, and effective use. This approach is discussed further in this work and will be used to address overarching challenges associated with AI deployment at scale to provide industry guidance that support accelerated adoption of AI/ML technologies throughout the industry.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Luna

SAND2021-15051 O Luna is an experimental cognitive architecture that seeks to enable continuous learning in an embodied agent. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Dellana, Ryan↗
DOE OSTI2025

Efficient and assured reinforcement learning-based building HVAC control with heterogeneous expert-guided training

Abstract Building heating, ventilation, and air conditioning (HVAC) systems account for nearly half of building energy consumption and $$20\%$$ of total energy consumption in the US. Their operation is also crucial for ensuring the physical and mental health of building occupants. Compared with traditional model-based HVAC control methods, the recent model-free deep reinforcement learning (DRL) based methods have shown good performance while do not require the development of detailed and costly physical models. However, these model-free DRL approaches often suffer from long training time to reach a good performance, which is a major obstacle for their practical deployment. In this work, we present a systematic approach to accelerate online reinforcement learning for HVAC control by taking full advantage of the knowledge from domain experts in various forms . Specifically, the algorithm stages include learning expert functions from existing abstract physical models and from historical data via offline reinforcement learning, integrating the expert functions with rule-based guidelines, conducting training guided by the integrated expert function and performing policy initialization from distilled expert function. Moreover, to ensure that the learned DRL-based HVAC controller can effectively keep room temperature within the comfortable range for occupants, we design a runtime shielding framework to reduce the temperature violation rate and incorporate the learned controller into it. Experimental results demonstrate up to 8.8 X speedup in DRL training from our approach over previous methods, with low temperature violation rate.

Xu, Shichao↗
DOE OSTI2024

Anomaly Detection and Mitigation for Dynamic Frequency Regulation in Hydropower-Battery Systems: Preprint

Hydropower operators and energy storage providers are increasingly interested in participating in frequency regulation services, driven by the incentives offered by independent system operators, such as the Pennsylvania-New Jersey-Maryland Interconnection (PJM), in a competitive electricity market. This transition, however, unfolds against the backdrop of a modernizing and rapidly digitizing power grid, exposing the integrated legacy infrastructure and vulnerable communication networks to a multitude of cybersecurity threats. These evolving threats not only endanger grid operations but also have the potential to trigger cascading disruptions across the broader grid network and influence regulation markets. This work presents an approach for developing an anomaly detection and mitigation system to address cybersecurity challenges during the participation of a hydropower-integrated battery energy storage system (BESS) in a frequency regulation market. The applied anomaly detector utilizes machine learning algorithms to provide detailed classification of cyber-physical events and provide a comprehensive situation awareness to grid operators. Later, the applied mitigation system triggers predefined corrective actions to minimize the impact of data integrity attacks on the regulation market and system stability. We evaluated the proposed approach on a fully active BESS topology using the slow regulation signal (Reg A) coming from the PJM market. Our simulation results reveal that the proposed approach performs well in detecting data integrity attacks within the allocated time frame and also minimizes the system's instability and economic loss during the participation of hydropower and BESS in the regulation market.

battery energy storage system↗
DOE OSTI2024

An Autonomous Critical Data Extrapolator for the AGN-201m

Nuclear nonproliferation serves as a key goal, being undertaken by the International Atomic Energy Agency (IAEA). To recognize proliferation there are two pathways that states, who intend to use nuclear material for malicious purposes can take, diversion can misuse. Diversion is when fissile nuclear material is declared to the IAEA for non-weapon purposes, but then covertly removed. If the source of nuclear material, that is not declared and not fissionable, is placed inside the reactor core to create fissile material used to create weapons then the state is using the second pathway of proliferation, misuse. With the emerging development in areas of simulation and machine learning the creation of virtual models of reactor systems, digital twins, serve as a potential method to identify proliferation through detecting anomalous behavior in the reactor. A digital twin for a physical nuclear reactor has never been developed, as digital twins serve as an emerging technology. To investigate the process for development and use of a digital twin for a nuclear reactor Idaho State University’s AGN-201m serves as the nuclear reactor used for development of this digital twin. A data acquisition system has been installed to the reactor system allowing for the transfer of collected data from a reactor operation to Idaho National Laboratory’s Deeplynx data warehouse. When utilizing data to train reactor physics and machine learning models, a significant challenge encountered is the initial state of the data. Nuclear proliferation will have the capacity to be detected when the reactor immediately starts up, nor will it occur after the reactor shuts down. Generally, it will be detected when the reactor is operating at some desired power over a sufficient period for that specific reactor design. For the AGN-201m this will be when the reactor is critical (generally 1 mW or above) for a timespan that is within or less than the range of a regular business day. Datasets sent to Deeplynx have had to be manually cut to when the reactor is critical based on plots of power levels. This method is inefficient and laborious, especially when using multiple datasets at once to train a model. To provide a more streamlined approach an automated critical data extrapolator is developed, with capabilities of recognizing when the reactor operation first reaches criticality, and when the reactor undergoes a SCRAM and is shutdown.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Learning model combining convolutional deep neural network with a self-attention mechanism for AC optimal power flow

Alternating current optimal power flow (OPF) analysis is critical for efficient and reliable operation of power systems. For large systems or repetitive computations, the traditional methods such as the direct and gradient methods, or non-traditional methods, such as the genetic algorithm and simulating annealing, are time-consuming and unsuitable for real-time computing. The work in this paper proposes a novel framework to obtain the optimal solution of power flow in real-time using a combination of convolutional neural networks and a self-attention mechanism. All parameters of the power networks are rearranged in an image-like shape of a multi-channel image where each channel is a two-dimensional matrix. The proposed approach is adaptive with every input size of power systems as well as frequent variations of network topologies without intervention to the framework core. The encompassment of all power system contexts in which all parameters of internal elements, generation costs, and topology information are included, contributes to the higher accuracy of inference compared to other current machine-learning-based OPF-solving methods. Besides, the proposed framework established on ubiquitous platforms is effortlessly integrated into current infrastructures of power systems, and the great efficiency along with the computation speed may serve as a critical point for practical implications, such as enabling faster decision-making during real-time operations, predicting system contingencies, and remedial actions based on an offline pre-trained model. Furthermore, this supervised learning process is applied to the dataset of four case studies of meshed power systems: the IEEE 5-bus system (IEEE-5), the IEEE 30-bus system (IEEE-30), the IEEE 39-bus system (IEEE-39), and the IEEE 57-bus system (IEEE-57) to prove the efficacy of the proposed method.

42 ENGINEERING↗
DOE OSTI2024

Fermilab s Transition to Token Authentication

Fermilab is the first High Energy Physics institution to transition from X.509 user certificates to authentication tokens in production systems. All of the experiments that Fermilab hosts are now using JSON Web Token (JWT) access tokens in their grid jobs. Many software components have been either updated or created for this transition, and most of the software is available to others as open source. The tokens are defined using the WLCG Common JWT Profile. Token attributes for all the tokens are stored in the Fermilab FERRY system which generates the configuration for the CILogon token issuer. High security-value refresh tokens are stored in Hashicorp Vault configured by htvault-config, and JWT access tokens are requested by the htgettoken client through its integration with HTCondor. The Fermilab job submission system jobsub was redesigned to be a lightweight wrapper around HTCondor. For automated job submissions a managed tokens service was created to reduce duplication of effort and knowledge of how to securely keep tokens active. The existing Fermilab file transfer tool ifdh was updated to work seamlessly with tokens, as well as the Fermilab POMS (Production Operations Management System) which is used to manage automatic job submission and the RCDS (Rapid Code Distribution System) which is used to distribute analysis code via the CernVM FileSystem. The dCache storage system was reconfigured to accept tokens for authentication in place of X.509 proxy certificates. As some services and sites have not yet implemented token support, proxy certificates are still sent with jobs for backwards compatibility but some experiments are beginning to transition to stop using them. There have been some glitches and learning curve issues but in general the system has been performing well and is being improved as operational problems are addressed.

Dykstra, David↗
DOE OSTI2024

Low latency optical-based mode tracking with machine learning deployed on FPGAs on a tokamak

Active feedback control in magnetic confinement fusion devices is desirable to mitigate plasma instabilities and enable robust operation. Optical high-speed cameras provide a powerful, non-invasive diagnostic and can be suitable for these applications. Here, in this study, we process high-speed camera data, at rates exceeding 100 kfps, on in situ field-programmable gate array (FPGA) hardware to track magnetohydrodynamic (MHD) mode evolution and generate control signals in real time. Our system utilizes a convolutional neural network (CNN) model, which predicts the n = 1 MHD mode amplitude and phase using camera images with better accuracy than other tested non-deep-learning-based methods. By implementing this model directly within the standard FPGA readout hardware of the high-speed camera diagnostic, our mode tracking system achieves a total trigger-to-output latency of 17.6 μs and a throughput of up to 120 kfps. This study at the High Beta Tokamak-Extended Pulse (HBT-EP) experiment demonstrates an FPGA-based high-speed camera data acquisition and processing system, enabling application in real-time machine-learning-based tokamak diagnostic and control as well as potential applications in other scientific domains.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

Predicting and Preventing Failures [Slides]

Unpredicted bearings failures can be costly and dangerous. Current methods of detecting bearing faults rely on trained specialists with expensive detection equipment. Specialists must react daily, as the sheer number of bearings and the machines they operate are critical and any downtime will result in loss of productivity and endanger personal. My method utilizes machine learning algorithms coupled with relatively inexpensive accelerometers to remotely monitor data for specialists for fault detection, and estimate the diameter of the fault that has been caused by the bearing. The algorithm offers high accuracy detection using solely accelerometer data that can be obtained remotely, reducing the strain on analysists and ensuring that equipment is always running at an optimal and safe level. The algorithms operate in two layers, one layer detects the type of fault, and the second estimates the diameter of wear to determine the severity of the fault. The detection layer operates in the frequency space using a high accuracy Support Vector Machine algorithm and is trained on different types and sizes of machines to ensure generalization. The second layer uses a modified k-means clustering algorithm and vector calculus to estimate the bearing wear.

42 ENGINEERING↗
DOE OSTI2023

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗
DOE OSTI2026

Spatiotemporal Learning in Power Modules: Wavelet-Enhanced Forecasting of Thermomechanical Degradation

Detecting internal defects in power electronics packages is critical for their performance and reliability, especially under extreme operating conditions, as these defects can lead to catastrophic failure if not properly addressed. Confocal scanning acoustic microscopy (C-SAM) plays a key role in the nondestructive evaluation of bond layer degradation within a power electronics package by detecting defects such as delamination, voids, and cracks. However, accurately quantifying and predicting these defects from C-SAM images remains a significant challenge due to the low noise-to-signal ratio, which typically arises from both imaging process and bond patterns itself. In this paper, we explore machine learning strategies for processing C-SAM images and providing predictive models of defect growth. We use C-SAM images of sintered copper and sintered silver samples, which are obtained under accelerated thermal experiments, as the representative dataset for our study. We investigate the effect of Fourier transforms and wavelet transforms on these datasets to remove high-frequency noise and address noise across multiple scales with histogram equalization to enhance the contrast and improve the visibility of defects. As a result, defect boundaries can be clearly distinguished, enabling more accurate tracking of their growth over time. We then employ different time-series forecasting algorithms on the denoised images to formulate an image-based lifetime prediction model. Statistical models and deep-learning techniques are trained on images obtained in the early stages of thermal shock, and defect growth in the later stages is predicted. Our work serves as a preliminary attempt to improve the accuracy of lifetime prediction models of power electronics packages, which is critical under extreme operating environments.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2017

Formation enthalpies for transition metal alloys using machine learning

The enthalpy of formation is an important thermodynamic property. Developing fast and accurate methods for its prediction is of practical interest in a variety of applications. Material informatics techniques based on machine learning have recently been introduced in the literature as an inexpensive means of exploiting materials data, and can be used to examine a variety of thermodynamics properties. Here we investigate the use of such machine learning tools for predicting the formation enthalpies of binary intermetallic compounds that contain at least one transition metal. We consider certain easily available properties of the constituting elements complemented by some basic properties of the compounds, to predict the formation enthalpies. We show how choosing these properties (input features) based on a literature study (using prior physics knowledge) seems to outperform machine learning based feature selection methods such as sensitivity analysis and LASSO (least absolute shrinkage and selection operator) based methods. A nonlinear kernel based support vector regression method is employed to perform the predictions. The predictive ability of our model is illustrated via several experiments on a dataset containing 648 binary alloys. We train and validate the model using the formation enthalpies calculated using a model by Miedema, which is a popular semiempirical model used for the prediction of formation enthalpies of metal alloys.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Lessons Learned for Rapid Decarbonization Of Power Sectors: Key Messages for Energy Ministers

This report covers key lessons learned for the rapid decarbonization of power systems, emphasizing best practices in planning, building, and operating power systems. This report is the result of a collaborative effort among various Clean Energy Ministerial (CEM) workstreams and partner initiatives: 21st Century Power Partnership (21CPP); Carbon Capture, Utilization and Storage (CCUS); Global Power System Transformation Consortium (G-PST), a partner to CEM; Industrial Deep Decarbonization Initiative (IDDI); International Energy Agency Digital Demand-Driven Electricity Networks Initiative (IEA 3DEN), a partner to CEM; International Smart Grid Action Network (ISGAN); Long Term Scenarios for the Energy Transition (LTES); Nuclear Innovation: Clean Energy Future (NICE Future); Super-Efficient Equipment and Appliance Deployment (SEAD). The contents are not intended to be comprehensive of all power sector topics, and there may be overlap between content in each section due to the nature of this first-of-its-kind collaborative effort to deliver unified messaging on power sector decarbonization to energy ministers. This work is intended to complement other work at the Clean Energy Ministerial and offers options for consideration, not specific policy recommendations.

21CPP↗
DOE OSTI2025

Safe Physics-Informed Machine Learning for Dynamics and Control

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques enhance the modeling and control of complex dynamical systems, ensuring safety and stability remains a critical challenge, especially in safety-critical applications like autonomous vehicles, robotics, medical decision-making, and energy systems. We explore various approaches for embedding and ensuring safety constraints, including structural priors, Lyapunov and Control Barrier Functions, predictive control, projections, and robust optimization techniques. Additionally, we delve into methods for uncertainty quantification and safety verification, including reachability analysis and neural network verification tools, which help validate that control policies remain within safe operating bounds even in uncertain environments. The paper includes illustrative examples demonstrating the implementation aspects of safe learning frameworks that combine the strengths of data-driven approaches with the rigor of physical principles, offering a path toward the safe control of complex dynamical systems.

Drgona, Jan↗
DOE OSTI2023

Data Challenges in Multi-Sensor Data Science System for Monitoring a Solvent Extraction Process

Idaho National Laboratory (INL) is maintaining and gaining knowledge into the nuclear fuel cycle by building a test bed to allow researchers the opportunity to study nuclear fuel processing operations. This includes studying solvent extraction processes that use centrifugal contactors. As part of INL’s mission, the goal of this project is to develop a system that utilizes non-traditional measurement sources such as vibration, acoustics, current, light, flow, and temperature in conjunction with data-based, machine learning techniques that will allow for signal discovery. This multisensory data can support the development of safeguards by design, provide operator process awareness, and discover process anomalies. This poster will highlight some of the data collection and analytics challenges for the multi-sensor system as well as the mitigation strategies to build a robust system. Additionally, some preliminary data from the first testing campaign will be shown to help illustrate the data needs of the system.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗