Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “operator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

New Technologies for Power System Operation and Analysis, 1st Edition

New Technologies for Power System Operation and Analysis considers the very latest developments in renewable energy integration and system operation, including electricity markets and wide-area monitoring systems and forecasting. Helping readers quickly grasp the essential information needed to address renewable energy integration challenges, this new book looks at basic power system mathematical models, advanced renewable integration and system optimizations from transmission and distribution system sides. Sections cover wind, solar, gas and petroleum, making this a useful reference for all engineers interested in power system operation.

electricity markets↗

Generalization error guaranteed auto-encoder-based nonlinear model reduction for operator learning

Many physical processes in science and engineering are naturally represented by operators between infinite-dimensional function spaces. The problem of operator learning, in this context, seeks to extract these physical processes from empirical data, which is challenging due to the infinite or high dimensionality of data. An integral component in addressing this challenge is model reduction, which reduces both the data dimensionality and problem size. In this paper, we utilize low-dimensional nonlinear structures in model reduction by investigating Auto-Encoder-based Neural Network (AENet). AENet first learns the latent variables of the input data and then learns the transformation from these latent variables to corresponding output data. Our numerical experiments validate the ability of AENet to accurately learn the solution operator of nonlinear partial differential equations. Furthermore, we establish a mathematical and statistical estimation theory that analyzes the generalization error of AENet. Finally, our theoretical framework shows that the sample complexity of training AENet is intricately tied to the intrinsic dimension of the modeled process, while also demonstrating the robustness of AENet to noise.

Auto-encoder↗

Pathway for decarbonizing residential building operations in the US and China beyond the mid-century

With global carbon budget targets looming, residential buildings in top economies must become carbon neutral as soon as possible to reserve more emission space for emerging carbon-emitting economies. This study is the first to compare the operational decarbonization process of China’s and the United States (US) residential buildings from 2000 to 2060 by combining the end-use emission model with the decomposing structural decomposition (DSD) method and Monte Carlo simulation. The results show that from 2001 to 2020 China decarbonized 1544 mega-tons of carbon dioxide (MtCO 2 ) and the US decarbonized 1848 MtCO 2 . In the business-as-usual scenario, China will hit its emission peak in 2031 (±3) with 934 (±61) MtCO 2 , while the US will maintain a lock-in level of 736 (±133) MtCO 2 since the 2030s. In the decarbonization scenario, operational carbon neutrality for residential buildings in 2060 is promoted by an increase in clean power generation proportion, building-integrated power generation level, building electrification level, and a reduction in end-use energy intensity, which will contribute 34.4 %, 21.4 %, 14.3 %, and 29.9 % in China and 32.9 %, 33.1 %, 8.2 %, and 25.8 % in the US, respectively. Especially, building-integrated power generation in China only costs about 40 % of what it costs in the US. Besides, high-decarbonization strategies for residential building operations are proposed as references for governments to formulate targeted climate policies. Overall, this study offers data benchmarks for buildings’ carbon neutrality of top economies to further promote synergistic carbon neutrality with the buildings of emerging economies in the age of Post COP27.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

D2NO: Efficient handling of heterogeneous input function spaces with distributed deep neural operators

Neural operators have been applied in various scientific fields, such as solving parametric partial differential equations, dynamical systems with control, and inverse problems. However, challenges arise when dealing with input functions that exhibit heterogeneous properties, requiring multiple sensors to handle functions with minimal regularity. To address this issue, discretization-invariant neural operators have been used, allowing the sampling of diverse input functions with different sensor locations. However, existing frameworks still require an equal number of sensors for all functions. We propose a novel distributed approach to further relax the discretization requirements and solve the heterogeneous dataset challenges. Our method involves partitioning the input function space and processing individual input functions using independent and separate neural networks. A centralized neural network is used to handle shared information across all output functions. This distributed methodology reduces the number of gradient descent back-propagation steps, improving efficiency while maintaining accuracy. Here, we demonstrate that the corresponding neural network is a universal approximator of continuous nonlinear operators and present three numerical examples to validate its performance.

97 MATHEMATICS AND COMPUTING↗

Data-driven reduced-order models for port-Hamiltonian systems with operator inference

Hamiltonian operator inference has been developed in Sharma et al. (2022) to learn structure-preserving reduced-order models (ROMs) for Hamiltonian systems. The method constructs a low-dimensional model using only data and knowledge of the functional form of the Hamiltonian. The resulting ROMs preserve the intrinsic structure of the system, ensuring that the mechanical and physical properties of the system are maintained. In this work, we extend this approach to port-Hamiltonian systems, which generalize Hamiltonian systems by including energy dissipation, external input, and output. Based on snapshots of the system’s state and output, together with the information about the functional form of the Hamiltonian, reduced operators are inferred through optimization and are then used to construct data-driven ROMs. To further alleviate the complexity of evaluating nonlinear terms in the ROMs, a hyper-reduction method via discrete empirical interpolation is applied. Accordingly, we derive error estimates for the ROM approximations of the state and output. Lastly, we demonstrate the structure preservation, as well as the accuracy of the proposed port-Hamiltonian operator inference framework, through numerical experiments on a linear mass–spring-damper problem and a nonlinear Toda lattice problem.

97 MATHEMATICS AND COMPUTING↗

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗

Impact of a dynamic grid mix and climate on operational carbon emissions modeling for different building typologies and climate zones

Calculating operational carbon emissions through a building’s lifecycle is complex due to the dynamic nature of influencing factors such as climate and energy grid mix. This paper introduces a novel methodology for modeling 30-year operational carbon impacts of buildings and applies this method to mid-rise office and residential typologies across various US climate zones. The method accounts for these temporal variabilities using new and scarcely cited data sources. Key findings indicate that future changes in the climate, while impactful, play a relatively modest role in operational carbon emissions compared to significant reductions with modeling scenarios using the projected decarbonization of the electricity grid. Here, the study also finds that using annual, month-hourly, or hourly grid emission factors have a minimal impact on carbon accounting, except in certain climates and program types where emission patterns do not align with a building’s energy consumption. Warmer climates like Miami, Florida and Tucson, Arizona, which rely heavily on cooling, demonstrate larger variations in carbon emissions when using higher temporal resolution emission factors. Ultimately, this study underscores the critical role of grid decarbonization in reducing long-term emissions and the importance of incorporating this variable in life cycle assessment (LCA) modeling.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Novel artificial neural network model for instantaneous power losses and operational efficiency mapping of MW-scale vanadium redox flow battery for improved technoeconomic analysis

A novel data-driven, machine-learning-based method for modeling the instantaneous power losses of a distribution-sited 2 MW/8MWh vanadium redox flow battery (VRFB), a grid-scale electrochemical storage technology, is introduced and compared against benchmark empirical modeling approaches, including symmetric and asymmetric models, as well as a recent convex hull modeling approach. The novel loss modeling method introduces several advantages over the benchmark models and over simplistic efficiency estimates, the most significant of which is that the model can accurately reflect the stepwise and non-linear parasitic losses associated with the duty cycles of mechanical auxiliary systems like pump motor drives and blower fans. Residuals of the models are compared; the proposed data driven model features significantly improved accuracy over the benchmark models. The model's coefficient of determination is also improved relative to that of the benchmark models. Furthermore, a novel method for visualization of operational efficiency of the grid-scale storage technology is introduced. To demonstrate the benefits of the novel data-driven method for modeling the VRFB, the benchmark models and the proposed models are embedded into an Open DSS distribution network model to study two applications of the grid-scale electrical storage system: load leveling for grid support and energy arbitrage. This article demonstrates that the accuracy of the instantaneous power loss model significantly impacts the understanding of the state of charge of the VRFB. In turn, the accuracy of the efficiency modeling of the VRFB impacts the understanding of the potential economic value and technical benefits to the distribution network operators. In conclusion, the presented power loss modeling approach is, therefore, highly relevant for utility-stakeholders, battery asset owners, system engineers, system designers, and financial planners interested in evaluating or optimizing the operation of grid-scale VRFBs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Using X-ray radiography to study oxygen flow in a proton exchange membrane electrolyzer operating under balanced pressure conditions

Of the various water electrolyzer technologies, the proton exchange membrane electrolyzer (PEMWE) is one of the best solutions for producing clean hydrogen without releasing CO 2 . In order to allow for widespread use of clean hydrogen, it is necessary to decrease its cost, which is intrinsically related to system operation. Current PEMWE plants operate in differential mode, directly pressurizing hydrogen and benefiting from thermodynamic compression, which increases overall system efficiency. However, high differential pressure above 30 bar can cause membrane stress, resulting in membrane creeping and failure. Pressurizing the water and operating at balanced pressure allows hydrogen to be produced at higher pressures while preserving the integrity of the membrane and porous layers. Nevertheless, the impact of pressurizing water on PEMWE performance must be better understood to maximize performance under balanced pressure conditions. Here, this study examined the impact of water pressure on two-phase flow. A high-pressure electrolyzer setup was developed to perform operando X-ray radiography and examine oxygen transport with high temporal resolution. The imaging segmentation process, developed to capture bubble properties in the channel, was applied to a specific experiment. The results clearly showed that as pressure increased up to 30 bars, the initial bubbly flow transitioned to slug flow, which led to channel saturation with oxygen. This work demonstrates that two-phase flow in an electrolyzer can be studied using X-ray radiography, which has the advantages of fast measurements and the ability to probe dense materials, such as those required for pressurized electrolyzers.

Balanced high pressure operation↗

DeepONet-grid-UQ: A trustworthy deep operator framework for predicting the power grid’s post-fault trajectories

This paper proposes a novel data-driven method for the reliable prediction of the power grid’s post-fault trajectories, i.e., the power grid’s dynamic response after a disturbance or fault. Here, the proposed method is based on the recently proposed concept of Deep Operator Networks (DeepONets). Unlike traditional neural networks that learn to approximate functions, DeepONets are designed to approximate nonlinear operators, i.e., mappings between infinite-dimensional spaces. Under this operator framework, we design a novel and efficient DeepONet that (i) takes as inputs the trajectories collected before and during the fault and (ii) outputs the predicted post-fault trajectories. In addition, we endow our method with the much-needed ability to balance efficiency with reliable/trustworthy predictions via uncertainty quantification. To this end, we propose and compare two novel methods that enable quantifying the predictive uncertainty. First, we propose a Bayesian DeepONet (B-DeepONet) that uses stochastic gradient Hamiltonian Monte-Carlo to sample from the posterior distribution of the DeepONet trainable parameters. Then, we design a Probabilistic DeepONet (Prob-DeepONet) that uses a probabilistic training strategy to enable quantifying uncertainty at virtually no extra computational cost. Finally, we validate the proposed methods’ predictive power and uncertainty quantification capability using the New York-New England power grid model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

$\mathrm{REX}$: An analytical tool for reactor operating envelope expansion through fuel-clad thermo-mechanics

Here REX, an analytical reactor design tool for the identification and expansion of reactor operating envelopes, is introduced and detailed. Written in MATLAB, REX takes core geometries and axially discretized detector and depletion output from the Serpent neutron transport code and performs full-core, pin-specific thermal-hydraulic and thermo-mechanical calculations. REX identifies the operating envelopes of advanced, solid-fuel nuclear reactors on the basis of their fuel-cladding, fuel-gas, and coolant-cladding interfacial thermo-mechanics. It iteratively pushes coolant inlet temperatures and modifies fuel pin geometries to induce mechanical failure in their original cladding materials at the fullest extent of their fuel cycle lengths and permissible coolant inlet temperatures. It then attempts to expand their operating envelopes by determining the mechanical responses of alternative cladding materials under the same geometric conditions. The result of the REX calculation sequence is a set of 5-D variables describing the temperatures, pressures, geometries, and mechanics of the core as functions of assembly, fuel pin, axial zone, depletion step, and coolant inlet temperature for each candidate cladding material with the limiting fuel pin geometry for the original material.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Estimating value of information for heliostat washing operations at solar thermal plants

Concentrating solar power (CSP) plants depend on thousands of heliostats whose reflectance declines as dust accumulates. Operators routinely measure reflectance to estimate soiling and, in turn, inform cleaning schedules, but the value of collecting more frequent or more accurate data has not been formally quantified. This study introduces a Monte Carlo discrete event simulation framework that integrates stochastic models of soiling, weather, and measurement error with a dynamic cleaning dispatch policy to estimate annual energy production and operations costs. Applied to two representative central-receiver field configurations, the results show that both the frequency and accuracy of reflectance measurements can meaningfully impact plant performance. In both case studies, reducing measurement intervals yields significant returns, with the energy gains greatly exceeding the cost of more frequent data collection. The simulation framework serves as a decision-support tool for CSP operators, allowing them to input site-specific soiling conditions, measurement accuracy, and survey frequency to evaluate the tradeoffs between data collection cost and energy recovery, and to identify measurement strategies that maximize plant profit.

14 SOLAR ENERGY↗

Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

Ensemble-based simulation and learning (ESnL) has long been used in hydrology for parameter inference, but computational demands of process-based ESnL can be quite high. To address this issue, we propose a deep neural operator learning approach. Neural operators are generic machine learning algorithms that can learn functional mappings between infinite-dimensional spaces, providing a highly flexible tool for scientific machine learning. Our approach is built upon DeepONet, a specific deep neural operator, and is designed to address several common problems in hydrology, namely, model parameter estimation, prediction at ungaged locations, and uncertainty quantification. Here we demonstrate the effectiveness of our DeepONet-based workflow using an existing large model ensemble created for an eastern U.S. watershed that is instrumented with 10 streamflow gages. Results suggest DeepONet achieves high efficiency in learning an ML surrogate model from the model ensemble, with the modified Kling-Gupta Efficiency exceeding 0.9 on holdout test sets. Parameter inference, carried out using the trained DeepONet surrogate model and genetic algorithm, also yields robust results. Additionally, we formulate and train a separate DeepONet model for physics-informed, seq-to-seq streamflow forecasting, which further reduces biases in the pre-trained DeepONet surrogate model. While this study focuses primarily on a single watershed, our approach is general and may be extended to enable learning from model ensembles across multiple basins or models. Thus, this research represents a significant contribution to the application of hybrid machine learning in hydrology.

54 ENVIRONMENTAL SCIENCES↗

Deep transfer operator learning for partial differential equations under conditional shift

Transfer learning enables the transfer of knowledge gained while learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labelling, potential computational power limitations and dataset distribution mismatches. Here, we propose a new transfer learning framework for task-specific learning (functional regression in partial differential equations) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of the target data. Inspired by conditional embedding operator theory, we minimize the statistical distance between labelled target data and the surrogate prediction on unlabelled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various transfer learning scenarios involving nonlinear partial differential equations under diverse conditions due to shifts in the geometric domain and model dynamics. Our transfer learning framework enables fast and efficient learning of heterogeneous tasks despite considerable differences between the source and target domains.

42 ENGINEERING↗

Machine Learning Derived Dynamic Operating Reserve Requirements in High-Renewable Power Systems

Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multi-stage production simulation modeling of the California Independent System Operator (CAISO) system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. Addition of these batteries saturate reserve needs and results in minimal within-hour balancing costs in 2030.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A smart alarm for particle accelerator beamline operations

We present the initial results of a proof-of-concept 'smart alarm' for the Continuous Electron Beam Accelerator Facility injector beamline at Jefferson Lab. To minimize machine downtime and improve operational efficiency, an autonomous alarm system able to identify and diagnose unusual machine states is needed. Our approach leverages a trained neural network capable of alerting operators (a) when an anomalous condition exists in the beamline and (b) identifying the element setting that is the root cause. The tool is based on an inverse model that maps beamline readings (diagnostic readbacks) to settings (beamline attributes operators can modify). The model takes as input readings from the machine and computes machine settings which are compared to control setpoints. Instances where predictions differ from setpoints by a user-defined threshold are flagged as anomalous. Given data corresponding to 354 anomalous injector configurations, the model can narrow the root cause of an anomalous condition to three potential candidates with 94.6% accuracy. Furthermore, compared to the current method of identifying anomalous conditions which raises an alarm when machine parameters drift outside their normal tolerances, the data-driven model can identify 83% more anomalous conditions.

43 PARTICLE ACCELERATORS↗

Predicting nonequilibrium Green’s function dynamics and photoemission spectra via nonlinear integral operator learning

Understanding the dynamics of nonequilibrium quantum many-body systems is an important research topic in a wide range of fields across condensed matter physics, quantum optics, and high-energy physics. However, numerical studies of large-scale nonequilibrium phenomena in realistic materials face serious challenges due to intrinsic high-dimensionality of quantum many-body problems and the absence of time-invariance. The nonequilibrium properties of many-body systems can be described by the dynamics of the correlator, or the Green's function of the system, whose time evolution is given by a high-dimensional system of integro-differential equations, known as the Kadanoff–Baym equations (KBEs). The time-convolution term in KBEs, which needs to be recalculated at each time step, makes it difficult to perform long-time numerical simulation. In this paper, we develop an operator-learning framework based on recurrent neural networks (RNNs) to address this challenge. We utilize RNNs to learn the nonlinear mapping between Green's functions and convolution integrals in KBEs. By using the learned operators as a surrogate model in the KBE solver, we obtain a general machine-learning scheme for predicting the dynamics of nonequilibrium Green's functions. Besides significant savings per each time step, the new methodology reduces the temporal computational complexity from $O(N_t^3)$ to $O(N_t)$ where N t is the number of steps taken in a simulation, thereby making it possible to study large many-body problems which are currently infeasible with conventional KBE solvers. Through various numerical examples, we demonstrate the effectiveness of the operator-learning based approach in providing accurate predictions of physical observables such as the reduced density matrix and time-resolved photoemission spectra. Moreover, our framework exhibits clear numerical convergence and can be easily parallelized, thereby facilitating many possible further developments and applications.

97 MATHEMATICS AND COMPUTING↗

Providing Ancillary Services with Photovoltaic Generation in Multi- Timescale Grid Operation

With penetration levels of photovoltaic (PV) generation substantially increasing, electric power systems need more flexible resources that can provide ancillary services to mitigate the variability and uncertainty of the PV. On one hand, the increase in PV generation necessitates more flexible resources; on the other hand, because of its low operation cost, PV generation has been replacing conventional generation, which is currently the main flexible resource. Consequently, there is a trend to require renewable generation, including PV, to provide flexible ancillary services. This paper proposes a multi-timescale grid operation model considering the various control strategies of PV providing different ancillary services. Numerical case studies demonstrate that with PV providing both regulation reserve and primary frequency reserve, the system operating costs and PV curtailment will be reduced significantly. Results show that not only the system reliability can be improved but also PV profitability with PV providing more ancillary services.

41 EE - Solar Energy Technologies Office (EE-4S)↗