Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “real time optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Open-Loop Control of Adjustable Tuned Mass Dampers for Floating Wind Turbine Platforms: Preprint

Floating offshore wind turbines have several advantages over their land-based counterparts, including access to stronger, more consistent winds and proximity to population centers. However, increased costs from the platform have been a challenge inhibiting their widespread adoption. New damping technologies with tunable target frequencies and damping ratios promise a greater degree of control over platform motions, allowing hulls to be designed smaller and reducing the overall cost of the turbines. In this work, a control strategy is proposed for these adjustable tuned mass dampers (TMDs). A frequency-domain model of the system is developed, from which response amplitude operators (RAOs) for the platform's rigid-body modes can be obtained for different natural frequencies and damping ratios of the dampers. Using these RAOs, and JONSWAP spectrums of operational and extreme sea states, the performance of the various damper settings are compared by evaluating the standard deviation of a rigid-body motion of interest (platform pitch or heave). By finding the optimal damper setting for a range of representative design load cases (DLCs), a lookup function is made to return the damper target frequency given the peak period of the sea state. To determine the current sea state, we propose a simple estimator that uses wave measurements (e.g., from a measurement buoy) to determine the peak period and significant wave height. The significant wave height is determined using the statistics of the past 100 seconds of wave elevation information and the peak period is computed using a frequency locked loop. Initial results show that we can use these estimated values to control the TMD natural frequency with an open loop controller. The controlled system is tested in a range of environmental conditions determined by the International Electrotechnical Commission design load cases (DLCs), which include normal and extreme wind and wave models. In these tests, we compare the performance of 4 cases: (1) no TMD, (2) a constant TMD based on the worst case DLC, (3) a controlled TMD based on known wind and wave environments, and (4) a real-time controlled TMD using estimated wind and wave environments. The effect of hull-based TMD control is also compared to changes in traditional wind turbine control via blade pitch.

control↗
DOE OSTI2026

Plasma-Assisted Pre-Chamber Ignition System for Highly Dilute Stoichiometric Heavy-Duty Natural Gas Engines (Final Technical Report)

This project explored advanced ignition technologies to significantly enhance efficiency and reduce operating costs for heavy-duty natural gas engines operating at stoichiometric conditions, while meeting ultra-low NOx emission standards. The main goal was to develop and validate a plasma-assisted pre-chamber ignition system that could deliver at least a 2% increase in brake thermal efficiency (BTE) and a 4% decrease in total cost of ownership (TCO) compared to a typical multi-cylinder engine with three-way catalyst aftertreatment, ensuring compatibility with the expected 2027 EPA/CARB regulations. In the first half of the project, the research team concentrated on developing and testing plasma-assisted pre-chamber ignition using nanosecond pulsed discharges. Extensive experiments were conducted in an optically accessible rapid-compression and expansion machine, a constant-volume chamber, and an optical single-cylinder engine. Experiments were coupled with CFD simulations. The work produced unique insights into pre-chamber flame formation, jet ignition, dilution effects, and flame quenching at pressures, temperatures, and dilution levels relevant to engines. Although plasma-assisted ignition showed promise in controlled lab settings, the research also identified fundamental and practical challenges when applying this technology to real engine conditions. Midway through the project, a crucial pivot was made, guided by three key findings. First, the power electronics required for nanosecond plasma discharges were found to be too costly for commercial use, undermining the project’s cost-of-ownership goals. Second, nanosecond plasma ignition was highly sensitive to turbulent flow in the pre-chamber, resulting in lower ignition reliability than traditional spark under engine-like conditions. Third, achieving a truly diffuse low-temperature plasma at high pressures near top dead center was not possible, reducing the anticipated chemical enhancement benefits. These results collectively suggested that continuing with plasma-assisted ignition was unlikely to meet both efficiency and cost objectives. In response, the project shifted focus to a more realistic approach: enhancing traditional spark-based pre-chamber ignition with significantly less spark energy. Using insights gained earlier in the project, the team redesigned the pre-chamber to maintain high dilution tolerance and quick combustion, even with lower ignition energy. Testing confirmed that with optimized pre-chamber design and combustion timing, a lower-energy spark could reliably ignite highly diluted stoichiometric mixtures, reduce burn time, and boost thermal efficiency. Final engine testing and techno-economic analysis verified that this revised approach successfully achieved the project goals. The optimized pre-chamber ignition system provided over a 2% increase in calculated brake thermal efficiency compared to the baseline engine. Notably, the lower ignition energy and simplified hardware reduced component stress, extended maintenance intervals, and lowered the total cost of ownership. When used with stoichiometric operation and traditional three-way aftertreatment, the system remained compatible with near-zero NOx emissions targets without increasing cost or complexity in the emissions control system. In summary, although the project deviated from its initial plasma-assisted ignition idea, the work produced a more practical and commercially viable solution. The results show that precisely optimized, low-energy pre-chamber spark ignition can significantly improve efficiency and reduce overall ownership costs for heavy-duty natural gas engines. This directly aligns with DOE goals for cleaner, more efficient, and cost-effective transportation technologies.

03 NATURAL GAS↗
DOE OSTI2020

Development and Evaluation of Occupancy-Aware HVAC Control for Residential Building Energy Efficiency and Occupant Comfort

Occupancy-aware heating, ventilation, and air conditioning (HVAC) control offers the opportunity to reduce energy use without sacrificing thermal comfort. Residential HVAC systems often use manually-adjusted or constant setpoint temperatures, which heat and cool the house regardless of whether it is needed. By incorporating occupancy-awareness into HVAC control, heating and cooling can be used for only those time periods it is needed. Yet, bringing this technology to fruition is dependent on accurately predicting occupancy. Non-probabilistic prediction models offer an opportunity to use collected occupancy data to predict future occupancy profiles. Smart devices, such as a connected thermostat, which already include occupancy sensors, can be used to provide a continually growing collection of data that can then be harnessed for short-term occupancy prediction by compiling and creating a binary occupancy prediction. Real occupancy data from six homes located in Colorado is analyzed and investigated using this occupancy prediction model. Results show that non-probabilistic occupancy models in combination with occupancy sensors can be combined to provide a hybrid HVAC control with savings on average of 5.0% and without degradation of thermal comfort. Model predictive control provides further opportunities, with the ability to adjust the relative importance between thermal comfort and energy savings to achieve savings between 1% and 13.3% depending on the relative weighting between thermal comfort and energy savings. In all cases, occupancy prediction allows the opportunity for a more intelligent and optimized strategy to residential HVAC control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Initial-State Dependent Optimization of Controlled Gate Operations with Quantum Computer

There is no unique way to encode a quantum algorithm into a quantum circuit. With limited qubit counts, connectivity, and coherence times, a quantum circuit optimization is essential to make the best use of near-term quantum devices. We introduce a new circuit optimizer called AQCEL, which aims to remove redundant controlled operations from controlled gates, depending on initial states of the circuit. Especially, the AQCEL can remove unnecessary qubit controls from multi-controlled gates in polynomial computational resources, even when all the relevant qubits are entangled, by identifying zero-amplitude computational basis states using a quantum computer. As a benchmark, the AQCEL is deployed on a quantum algorithm designed to model final state radiation in high energy physics. For this benchmark, we have demonstrated that the AQCEL-optimized circuit can produce equivalent final states with much smaller number of gates. Moreover, when deploying AQCEL with a noisy intermediate scale quantum computer, it efficiently produces a quantum circuit that approximates the original circuit with high fidelity by truncating low-amplitude computational basis states below certain thresholds. Our technique is useful for a wide variety of quantum algorithms, opening up new possibilities to further simplify quantum circuits to be more effective for real devices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Achieving Runtime State Verification Assurance in Critical Cyber-Physical Infrastructures

Industrial Cyber-Physical Systems (ICPS) are an essential backbone of national critical infrastructures. They help monitor and control crucial cyber-enabled services such as energy generation. Commonly ICPS monitors the physical process through Supervisory Control and Data Acquisition (SCADA) systems. The SCADA ecosystem takes critical real-time and future system operational decisions based on the runtime state behavior of field sensors. Traditional SCADA systems use legacy and insecure communication protocols such as the Modbus protocol that lack adequate security mechanisms to provide robust runtime state behavior assurance of constrained field sensors. Therefore, constrained field sensors are commonly vulnerable to standard semantic attacks that gradually change the behavior state of infected devices. This paper discusses process integrity assurance techniques necessary to enhance the security of behavior-based protocols such as the Modbus protocol. The Runtime State Verification (RSV) protocol proposed in this paper aims to address semantic attacks in the SCADA ecosystem by integrating behavior-based Mandatory Results Automata (MRA) and a Hyperledger Fabric (HLF) network. The RSV protocol provides high process integrity assurance through enhanced behavior-based MRA suitable for the constrained field devices. A proof of concept of the RSV protocol has been evaluated in an emulated water-tube boiler. Preliminary evaluations of the RSV protocol aimed to measure the efficiency of the proposed protocol by monitoring an Combustion Efficiency (CE) process necessary to preserve optimal combustion, thus minimizing costs and future maintenance of water-tube boilers. We analyze the overall network overhead and latency of the proposed RSV protocol by evaluating the HLF network performance and comparing the proposed RSV protocol with the state-ofart BloSPAI protocol. Through the preliminary evaluations of the proposed RSV protocol, this paper demonstrates that the proposed RSV protocol overcomes the shortcomings and network overhead of the BloSPAI protocol by integrating behavior-based authentication through novel MRAs and HLF networks.

Rivera, Abel Gomez↗
DOE OSTI2020

GPS-Based Gamma Survey for Characterizing and Decommissioning NORM Sites - 20389

Gamma survey techniques are an especially powerful decommissioning tool at naturally occurring radioactive material (NORM) sites due to both the low cost to obtain data over a large spatial scale and the abundance of gamma emitters in the uranium and thorium decay series. Gamma surveys are executed by coupling a detector - most often a sodium iodide crystal - to a global positioning system (GPS), then reporting a location and gross gamma reading coincidentally to a data logger. Systems may be carried by workers or mounted to a car, all-terrain vehicle, or unmanned aerial system (UAS). The resulting data set provides a high-resolution but low precision map of the gamma radiation field over the area surveyed. Frequently this map is also correlated to soil concentrations of NORM radionuclides (most often, Ra-226) and/or exposure rate. Gamma survey parameters such as movement speed, transect spacing, and data logging frequency define the spatial resolution of the resulting surface, and can be optimized depending on the desired survey sensitivity. This paper examines gamma survey as a tool for decommissioning NORM sites and provides an overview of current gamma survey technology designed to improve the efficiency and effectiveness of the decommissioning process. Topics to be discussed in the paper include: - An overview of gamma survey systems, and the utility of different delivery vehicles depending on desired cost, desired spatial resolution, and site topography. - The influence of physical detector characteristics on detection sensitivity and survey planning. - The tradeoff between high-resolution and large spatial extent, but inherently uncertain data, and low-resolution, low spatial extent, but highly certain data, as well as the specific utility of each of these types of data during NORM facility decommissioning. - Confounding variables that may limit the utility of gamma survey at some sites (e.g., radon gas and spatial heterogeneity / hot spots), and methods to plan for and control these conditions. Results show that the confounding variables, such as radon and data output can greatly influence the overall data quality associated with the decommissioning process. In addition, the use of real-time and aerial survey platforms provides a method for ensuring proper spatial extent of the data. When applied thoughtfully, gamma survey is a powerful tool for detecting NORM radionuclides in the environment and a cost-effective technique for identifying areas requiring remediation. However, entities performing or using gamma survey as a decommissioning tool must be aware of both its advantages and its limitations before basing remediation or regulatory action on gamma survey results. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Optimizing Error-Bounded Lossy Compression for Scientific Data by Dynamic Spline Interpolation

Today's scientific simulations are producing vast volumes of data that cannot be stored and transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and network bandwidth. The situation is getting worse over time because of the ever-increasing gap between relatively slow data transfer speed and fast-growing computation power in modern supercomputers. Error-bounded lossy compression is becoming one of the most critical techniques for resolving the big scientific data issue, in that it can significantly reduce the scientific data volume while guaranteeing that the reconstructed data is valid for users because of its compression-error-bounding feature. In this paper, we present a novel error-bounded lossy compressor based on a state-of-the-art prediction-based compression framework. Our solution exhibits substantially better compression quality than all of the existing error-bounded lossy compressors, with comparable compression speed. Specifically, our contribution is threefold. (1) We provide an in-depth analysis of why the best-existing prediction-based lossy compressor can only minimally improve the compression quality. (2) We propose a dynamic spline interpolation approach with a series of optimization strategies that can significantly improve the data prediction accuracy, substantially improving the compression quality in turn. (3) We perform a thorough evaluation using six real-world scientific simulation datasets across different science domains to evaluate our solution vs. all other related works. Experiments show that the compression ratio of our solution is higher than that of the second-best lossy compressor by 20%similar to 460% with the same error bound in most of the cases.

Zhao, Kai↗
DOE OSTI2023

An Integrated Approach to Predicting Ash Deposition and Heat Transfer in Coal-Fired Boilers

The overall goal of this project is to develop via measurements and simulations an advanced online technology to predict, monitor and manage fireside ash deposition in a coal-fired boiler allowing for more efficient operations under a range of load conditions and fuel property variability. With this in place fuel sorting and blending can be done upstream and operations can be optimized to compensate for load and fuel properties. In support of this objective, three experimental campaigns were undertaken during the course of the project to measure ash deposition rates within the boiler at different fuel flow rates and its ash composition variability. Simulations of the experimental conditions representing actual geometry, operational scenarios in terms of air flow rates, coal flow rates as well as coal compositions, heating values, and particle size distributions were also carried out. Deposition rates were predicted using a unique particle kinetic energy and viscosity based ash deposition methodology whose validity was ascertained by comparing against deposition rate measurements for widely varying operating conditions and ash compositions in a lab-scale furnace. With a unique end-to-end combustion modeling methodology established and different simulation scenarios carried out, the results from our computational fluid dynamic (CFD) simulations in conjunction with the plant data summarized in this report were used to refine Microbeam Technology Incorporated’s MTI CSPI-CT Tool to predict and monitor fire-side ash deposition under a range of load conditions and fuel property variability in real time.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2026

Scheduler Modeling of Distributed Energy Resources for Providing Ancillary Services

Distribution energy resources (DERs) have been integral components of modern power systems, and their capability to provide grid services has been widely studied. To promote the deployment of these resources in providing grid services in real-world utility operations, this paper proposes a day-ahead scheduler model for a distribution system connected DER plant. A certain amount of generation capacity of this DER plant is reserved for frequency services, and some ancillary services for the distribution system-including peak load reduction, voltage regulation, and power factor control-are integrated into the model. The model is tested on a real-world distribution system. From the simulation results, the energy and reserve schedule of the solar photovoltaic (PV) unit and battery energy storage system (BESS) can be determined, and voltage and power factor are well maintained. Additionally, in order to demonstrate the specific characteristics of the co-located and hybrid operation modes for the PV and BESS, these two modes are analyzed both theoretically and through real-time simulation. Simulation results show that most of PV's variability is transferred to the net power in the co-located mode, whereas it is transferred to the BESS in the hybrid mode. This proposed scheduler model and the comparison of co-located and hybrid modes can provide practical guidance for the applications of DER plant in the real-world utility.

14 SOLAR ENERGY↗
DOE OSTI2023

Downhole Sensing and Event-Driven Sensor Fusion for Depth-of-Cut Based Autonomous Fault Response and Drilling Optimization

Achieving robust and efficient drilling is a critical part of reducing the cost of geothermal energy exploration and extraction. Drilling performance is often evaluated using one or more of three key metrics: depth of cut (DOC), rate of penetration (ROP), and mechanical specific energy (MSE). All three of these quantities are related to each other. DOC refers to the depth a bit penetrates into rock during drilling. This is an important quantity for estimating bit behavior. ROP is the simply the DOC multiplied by the rotational rate, and represents how quickly the drill bit is advancing through the ground. ROP is often the parameter used for drilling control and optimization. Finally, MSE provides insight into drilling efficiency and rock type. MSE calculations rely on ROP, drilling force, and drilling torque. Surface-based sensors at the top of the drill are often used to measure all these quantities. However, top-hole measurements can deviate substantially from the behavior at the bit due to lag, vibrations, and friction. Therefore, relying only on top-hole information can lead to suboptimal drilling control. In this work, we describe recent progress towards estimating ROP, DOC, and MSE using down-hole sensing. We assume down-hole measurements of torque, weight-on-bit (WOB). Our hypothesis is that these measurements can provide more rapid and accurate measures of drilling performance. We show how a multi-layer perceptron (MLP) machine learning algorithm can provide rapid and accurate performance when evaluated on experimental data taken from Sandia’s Hard Rock Drilling Facility. In addition, we implement our algorithms on an embedded system intended to emulate a bottom-hole-assembly for sensing and estimation. Our experimental results show that DOC can be estimated accurately and in real-time. These estimates when combined with measurements for rotary speed, torque, and force can provide improved estimates for ROP and MSE. These results have the potential to enable better drilling assessment, improved control, and extended component lifetimes.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

An automated approach to the alignment of compound refractive lenses

Compound refractive lenses (CRLs) are established X-ray focusing optics, and are used to focus the beam or image the sample in many beamlines at X-ray facilities. While CRLs are quite established, the stack of single lens elements affords a very small numerical aperture because of the thick lens profile, making them far more difficult to align than classical optical lenses that obey the thin-lens approximation. This means that the alignment must be very precise and is highly sensitive to changes to the incident beam, often requiring regular readjustments. Some groups circumvent the full realignment procedure by using engineering controls ( e.g. mounting optics) that sacrifice some of the beam's focusing precision, i.e. spot size, or resolution. While these choices minimize setup time, there are clear disadvantages. This work presents a new automated approach to align CRLs using a simple alignment apparatus that is easy to adapt and install at different types of X-ray experiments or facilities. This approach builds on recent CRL modeling efforts, using an approach based on the Stochastic Nelder–Mead (SNM) simplex method. This method is outlined and its efficacy is demonstrated with numerical simulation that is tested in real experiments conducted at the Advanced Photon Source to confirm its performance with a synchrotron beam. This work provides an opportunity to automate key instrumentation at X-ray facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Pairwise connected tensor network representation of path integrals

It has been recently shown how the tensorial nature of real-time path integrals (PIs) involving the Feynman-Vernon influence functional can be utilized with matrix product states, taking advantage of the finite length of the bath-induced memory. Tensor networks (TNs) promise to provide a unified language to express the structure of a PI. A generalized TN specifically incorporating the pairwise interaction structure of the influence functional and its invariance with respect to the average forward-backward position or the sojourn value in the form of the blip representation is derived and implemented. This pairwise connected TNPI (PC-TNPI) is illustrated through applications to typical spin-boson problems and explorations of the differences caused by the exact form of the spectral density. The storage and performance scalings are reported, showing the compactness of the representation and the efficiency of the contraction process. Finally, taking advantage of the compressed representation, the viability of using PC-TNPI for simulating multistate problems is demonstrated. The PC-TNPI structure can be shown to yield other TN algorithms currently in use. Consequently, it should be possible to use it as a starting point for deriving other optimized procedures.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Towards Precision Photometric Type ia Supernova Cosmology With Machine Learning

The revolutionary discovery of dark energy and accelerating cosmic expansion was made with just 42 type Ia supernovae (SNe Ia) in 1999. Since then, large synoptic surveys, e.g., Dark Energy Survey (DES), have observed thousands more SNe Ia and the upcoming Rubin Legacy Survey of Space and Time (LSST) and Roman Space Telescope promise to deliver millions in the next decade. This unprecedented data volume can produce the required precision to unambiguously test concordance cosmology which could represent a monumental shift in our understanding of dark energy and its role in cosmic history. However, extracting a pure SN Ia sample with accurate redshifts for such a large dataset will be a challenge. Specifically, spectroscopic classification will not be possible for the vast majority of discovered objects, and only ~25% will have spectroscopic redshifts. This thesis presents a series of observational and methodological studies designed to address the questions associated with this new era of photometric SN Ia cosmology. First, we present a machine learning method for photometric classification of SNe, Supernova Classification with a COnvolutional Neural Network (SCONE). Photometric classification enables SNe with no spectroscopic information to be confidently categorized, and is a critical component of current and future analysis pipelines. SCONE achieves >99% accuracy distinguishing simulated SNe Ia from non-Ia SNe, and has been integrated into DES, LSST, and Roman analysis pipelines. We also demonstrate the efficacy of SCONE on early-time photometric classification, which will be vital for optimal allocation of spectroscopic resources. We show that SCONE can distinguish between 6 SN types with 75% accuracy on the night of initial discovery, comparable to results in the literature for full-phase SNe. Next, we study current methods for estimating SN Ia redshifts and propose a machine learning alternative that uses SN photometry alone to extract redshift information. Most SNe Ia inherit redshift information from their host galaxy, but the process of matching SNe to the correct host galaxy can be challenging. We systematically analyze the impact of incorrect redshifts from host galaxy mismatch on 5 years of DES SN data, and conclude that improved host matching or redshift estimation methods can reduce our systematic errors by ~10%. In response to this finding, we present a SN photometry-only method for estimating redshifts independent of host galaxy information, Photo-zSNthesis. We show that Photo-zSNthesis redshift estimates are accurate to within 2% across the full redshift range of LSST, a first in the literature. Finally, we focus on the robustness of machine learning (ML) algorithms for real-world and scientific applications. ML models generalize poorly beyond their training set and often experience severe performance degradation when deployed on new data. We demonstrate a general method for improving robustness that achieves new state-of-the-art results on astronomical object classification, wildlife identification, and tumor detection.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Active Lithium Injection for a Real Time Control of the Divertor Heat Flux for Fusion Devices

When the local heat flux exceeds specified flux limit, tungsten PFC surfaces can be damaged, which is not acceptable for a reliable reactor operations. The divertor PFCs are typically designed for a specific heat flux limit usually assuming an average steady-state heat flux which is typically 5–10 MW/m 2 . However, in addition to steady-state heat flux, fusion reactor divertor PFCs could experience transient heat fluxes such as ELMs and/or other magnetic reconnection events which can deposit large transient heat fluxes onto the divertor PFCs. The transient divertor heat flux could be significantly larger than the steady-state heat flux which could damage the solid PFC surfaces. The divertor heat flux can be subjected to additional complications such as the uncertainties in the the divertor strike point heat flux projection. Moreover, there are additional experimental observations of non-axisymmetric power flux which can occur under non-axisymmetric magnetic perturbations. The liquid lithium (LL) PFCs is more resilient against such transient heat fluxes as they could evaporate LL as needed and the lost LL can be then replenished afterward. In this paper, we analyze a case for a transient divertor heat pulse of 1 MJ in 10 ms for a ITER-size reactor. This is a small perturbation (~ 0.1%) to the expected plasma stored energy compared to the previously analyzed case of 20 MJ heat pulse. Even with this relatively modest heat pulse, the LL surface undergoes ~ 100 °C temperature rise. However, the resulting LL surface heating without rapid cooldown mechanism could lead to excessive LL evaporation continuing well after the transient heat flux resulting in a significant Li injection of ~ 0.6 mol in about a 200 ms period. This amount of Li injection could cause plasma dilution and performance degradation. On the other hand, an active Li injection capability if optimized could prevent the LL surface temperature rise and thus reducing subsequent Li evaporation into the plasma by a factor of 7 compared to the passive LL PFC case. A crucial tool of active Li injection is a rapid response pellet injector which could inject light impurity pellets before the excessive heat flux could reach the divertor plate causing serious damage. A simple pellet ablation model suggests a favorable pellet deposition profile for smaller ~ 0.1 mm radius pellet with ~ 10–20 m/s velocity. Moreover, if it is possible to inject from the private flux region, the pellet injection efficiency into the high heat flux strike point region can be as high as 80% compared to ~ 50% for the injection from outer radius region. The pellet deposition efficiency can be further improved by designing a shell-pellet which can burst when a certain ablation fraction is reached. Finally, a possible implementation technique using an inductive pellet injector with a rapid time response of a few msec is proposed here which can be tested in NSTX-U.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Support for Reactor Operators in Case of Cyber-Security Threats (NEUP Final Report)

Increasing use of digital technology in nuclear power plants (NPPs) poses cyber-security as a crucial threat to public safety and to continuous energy production. Cyber-security risks are comprised of complex known and unknown interactions between various entities, system vulnerabilities, network protocols, human users and malicious attacks. There is little understanding or research geared towards plant operators’ response under cyber-security threats and operational procedures to cope with such threats. This is particularly critical when a cyber-security event masquerades as a safety incident or an evolving accident. Instead of leading operators to the remediation of the accident, the masked cyber event may lead them to circumvent the safety mechanisms of the plant. Given these challenges, the objective of this project is to develop a tool to characterize abnormal NPP events as “cyber” or “safety” incidents, and to further develop this tool as a real-time operator aid to assist in response to the incident. This NEUP Final Report summarizes the research efforts towards the above goals and the results in the following three aspects. First, a methodology for classifying abnormal NPP events as cyber-attacks or safety incidents was developed. This provides the basis for responding to potential cyber-attacks. In this methodology, the causal relationships between various variables (i.e., physical variables, network variables, and control variables) for a nuclear system under consideration are modeled using dynamic Bayesian networks. Based on observations of certain variables (i.e., the evidence), inference is performed to identify the state of hidden variables, which helps indicate the occurrence of cyber-attacks or safety incidents. The proposed methodology was applied to the full scope NPP simulator system at The Ohio State University as a case study. The result shows that the proposed methodology is capable of distinguishing between cyber-attacks and safety incidents. Second, a game-theoretic approach for responding to cyber-attacks on nuclear power plants was developed. This is the second major goal of the project, and the method is used to recommend optimal responses to reactor operators in the case of cyber-attacks. We consider two cases in this research. In the first case, the interaction between the defender (i.e., the reactor operator) and the attacker is modeled as a two-player, nonzero-sum, Markov game with an infinite time horizon. In the second case, we consider a semi-Markov game between the defender and the attacker within a finite time horizon. The model in the second case enables us to consider the time sensitive response of the defender. In each case, the method for deriving the Nash equilibrium is developed. The Nash Equilibrium of the game provides the valid prediction of both players’ actions because no single player can benefit from unilaterally deviating from the equilibrium policy if the other player adheres to his/hers, hence it provides the best response of the defender to cyber-attacks. The proposed method in each case is demonstrated through a simplified benchmark digital feedwater control system. Third, a prototype display is developed to integrate the above information. The prototype display depicts the communication information to the operator and incorporates the cyber-security tool developed by the team into the interface. It consists of the regular display in current control rooms, as well as a panel used to indicate the occurrence of cyber-attacks or safety events and a panel used to guide the operator’s response to detected cyber-attacks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings

In recent years, advanced control strategies based on Deep Reinforcement Learning (DRL) proved to be effective in optimizing the management of integrated energy systems in buildings, reducing energy costs and improving indoor comfort conditions when compared to traditional reactive controllers. However, the scalability and implementation of DRL controllers are still limited since they require a considerable amount of time before converging to a near-optimal solution. This issue is currently addressed in literature through the offline pre-training of the DRL agent. However this solution results in two main critical issues: (1) the need to develop a building surrogate model to perform the training task, and (2) the need to perform a fine-tuning process over several training episodes to obtain a near-optimal control policy. In this context, this paper introduces an Online Transfer Learning (OTL) strategy that exploits two knowledge-sharing techniques, weight-initialization and imitation learning, to transfer a DRL control policy from a source office building to various target buildings in a simulation environment coupling EnergyPlus and Python. A DRL controller based on discrete Soft Actor–Critic (SAC) is trained on the source building to manage the operation of a cooling system consisting of a chiller and a thermal storage. Several target buildings are defined to benchmark the performance of the OTL strategy with that of a Rule-Based Controller (RBC) and two DRL-based control strategies, deployed in offline and online fashion. The strategy adopted for OTL emulates the real world implementation with a simulation process by implementing the transferred DRL agent for a single episode in the target buildings. Target buildings have the same geometrical features and are served by the same energy system as the source building, but differ in terms of weather conditions, electricity price schedules, occupancy patterns, and building envelope efficiency levels. The results show that the OTL strategy can reduce the cumulated sum of temperature violations on average by 50% and 80% respectively when compared to RBC and online DRL while enhancing the energy system operation with electricity cost savings ranging between 20% and 40%. Furthermore, the OTL agent performs slightly worse than the offline DRL controller but it does not require any modeling effort and can be implemented directly on target buildings emulating a real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Cloud-based implementation of white-box model predictive control for a GEOTABS office building: A field test demonstration

Model predictive control (MPC) has been proven in simulations and pilot case studies to be a superior control strategy for large buildings. MPC can utilize the weather and occupancy schedule forecasts, together with the system model, to predict the future thermal behavior of the building and minimize the overall energy use and maximize thermal comfort. However, these advantages come with the cost of increased modeling effort, computational demands, communication infrastructure, and commissioning efforts. Thus a typical approach is to, often rapidly, simplify the building modeling and MPC optimization problem while paying a price of not reaching the full performance potential. It has been shown that by employing accurate physics-based models, MPC performance can be notably increased closer to its theoretical performance bound. However, implementation of such high-fidelity MPC in real buildings remains a challenge, resulting in a lack of successful field test studies. This work presents the methodology and field test demonstration of a computationally efficient implementation of the white-box MPC in an office building in Belgium. The detailed model of the building is based on first-principle physical equations. The deployment and supervision of MPC operation in a practical setting are supported by an automated cloud-based communication infrastructure. The motivating factor behind the cloud-based architecture is its compatibility with a commercially appealing control as a service concept. The building is equipped with a ground source heat pump (GSHP) and thermally activated building structures (TABS), where the combination of both is also known as GEOTABS. From a control perspective, GEOTABS buildings are particularly challenging systems due to large scale, complex heating, ventilation and air conditioning (HVAC) system, and slow dynamics with time delays. On the other hand, there is an increased potential for energy savings due to the high thermal mass, which acts as thermal storage. The MPC operation is demonstrated during the challenging transient seasons (switching between heating and cooling), and its performance is compared to a traditional rule-based controller (RBC). We provide a proof of concept of real MPC operation for the most difficult seasons with notable GSHP energy use savings equal to 53.5% and thermal comfort improvement by 36.9%. Other MPC applications found in the literature describe tests for only cooling or only heating, and up to now only for a black-box or a grey-box approach.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Multi-Fidelity Stochastic Economic Dispatch for Operating Low Carbon Power Grids

Grid operators can address the inherently stochastic nature of renewables by solving a two-stage stochastic programming model that minimizes the cost of dispatch decisions while accounting for the complex grid dynamics. It is common to use a sample average approximation to estimate the expectation of the second stage costs in this model. However, the large sample count needed for numerical accuracy makes effective modeling large-scale electric grids computationally intractable. We introduce a control variate multi-fidelity estimator for the second-stage recourse that enables high quality dispatch decisions in real-time with a reduced computational burden. We obtain a hierarchy of model fidelities by linearizing the AC power flow system representation to DC power flow, and by relaxing transmission and voltage network constraints. We evaluate the performance of our proposed method on a synthetic grid with 73 buses against a deterministic baseline with persistence forecast and a high-fidelity reference. Our analysis shows a computational speed-up of 7.62x with a minimal loss in accuracy. The multi-fidelity method is well suited to fidelity combinations that use a simplified network topology in their lower fidelity model and is an attractive option for applications where accurate grid modeling needed on a limited computational budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗