SEARCH · Engineering Papers

Results for “model order reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2025

FedOSAA: Improving Federated Learning with One-Step Anderson Acceleration

Federated learning (FL) is a distributed machine learning approach that enables multiple local clients and a central server to collaboratively train a model while keeping the data on their own devices. First-order methods, particularly those incorporating variance reduction techniques, are the most widely used FL algorithms due to their simple implementation and stable performance. However, these methods tend to be slow and require a large number of communication rounds to reach the global minimizer. We propose FedOSAA, a novel approach that preserves the simplicity of first-order methods while achieving the rapid convergence typically associated with second-order methods. Our approach applies one Anderson acceleration (AA) step following classical local updates based on first-order methods with variance reduction, such as FedSVRG and SCAFFOLD, during local training. This AA step is able to leverage curvature information from the history points and gives a new update that approximates the Newton-GMRES direction, thereby significantly improving the convergence. We establish a local linear convergence rate to the global minimizer of FedOSAA for smooth and strongly convex loss functions. Numerical comparisons show that FedOSAA substantially improves the communication and computation efficiency of the original first-order methods, achieving performance comparable to second-order methods like GIANT.

Feng, Xue [University of California, Davis]↗

DOE OSTI2025

Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work

Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.

Johnson, Charles A.↗

DOE OSTI2021

Modeling the impact of COVID-19 on air quality in southern California: implications for future control policies

Abstract. In response to the coronavirus disease of 2019 (COVID-19), California issued statewide stay-at-home orders, bringing about abrupt and dramatic reductions in air pollutant emissions. This crisis offers us an unprecedented opportunity to evaluate the effectiveness of emission reductions in terms of air quality. Here we use the Weather Research and Forecasting model with Chemistry (WRF-Chem) in combination with surface observations to study the impact of the COVID-19 lockdown measures on air quality in southern California. Based on activity level statistics and satellite observations, we estimate the sectoral emission changes during the lockdown. Due to the reduced emissions, the population-weighted concentrations of fine particulate matter (PM2.5) decrease by 15 % in southern California. The emission reductions contribute 68 % of the PM2.5 concentration decrease before and after the lockdown, while meteorology variations contribute the remaining 32 %. Among all chemical compositions, the PM2.5 concentration decrease due to emission reductions is dominated by nitrate and primary components. For O3 concentrations, the emission reductions cause a decrease in rural areas but an increase in urban areas; the increase can be offset by a 70 % emission reduction in anthropogenic volatile organic compounds (VOCs). These findings suggest that a strengthened control on primary PM2.5 emissions and a well-balanced control on nitrogen oxides and VOC emissions are needed to effectively and sustainably alleviate PM2.5 and O3 pollution in southern California.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

ORBIT: Offshore Renewables Balance-of-System and Installation Tool

This report describes the Offshore Renewables Balance-of-system Installation Tool ("ORBIT"), a new model developed by the National Renewable Energy Laboratory (NREL) to evaluate the balance-of-system (BOS) costs associated with offshore wind projects. In the context of wind energy projects BOS costs encompass all expenses required to construct a project other than the capital expenditures (CapEx) of the turbines and towers, including the procurement costs for all other components (such as substructures, cables, and electrical infrastructure), offshore and land-based construction costs, port costs, site surveying fees, permitting fees, and leasing fees are all categorized as BOS costs. BOS costs significantly contribute to the levelized cost of energy (LCOE) for offshore wind, typically comprising over 50\% of the CapEx for a fixed-bottom offshore wind project and 60\% for a floating project. In addition, technology solutions and installation methods vary drastically between projects as they are impacted by factors such as vessel availability, geographic considerations and site geotechnical conditions. These effects require a model with appropriate fidelity to understand how these costs scale as turbine rating increases and the offshore wind supply chain, particularly offshore construction vessels, is expanded. For offshore wind, cost savings attributed to increased turbine rating are primarily realized through BOS procurement and project installation as fewer substructures and less cable are required. BOS costs represent both a modeling challenge, as well as an opportunity, for project developers to optimize solutions to reduce costs. It is critical to understand how these costs are affected by novel technologies, innovative installation processes, and operational constraints in order identify meaningful cost reductions for offshore wind energy.

17 WIND ENERGY↗

DOE OSTI2022

Reduced-order modeling of neutron transport separated in energy by Minimax Proper Generalized Decomposition

In this article, we demonstrate a Petrov-Galerkin Proper Generalized Decomposition (PGD) known as Minimax PGD for modeling neutron transport separated in energy. To compare the Minimax with the classical Galerkin PGD, we assess both on a model problem of UO{sub 2} or Mixed Oxide (MOX) fuel pins in an infinite lattice with 3 industry-standard energy meshes. We find the Minimax PGD achieves a superior decomposition to Galerkin PGD, both with and without update of the energy modes. This suggests Minimax PGD may be more computationally efficient, provided this reduction in modes (to achieve a given accuracy) outweighs the cost of solving the necessary adjoint problems. In either case, we note that PGD offers an a priori Reduced-Order Model (ROM) which may be dramatically cheaper to solve than the full-order model, especially in problems with fine to ultrafine energy meshes. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Statistical Learning for Nonlinear Model Reduction from Local Simulations of Stochastic and Particle- and Agent-Based Systems

Stochastic physical systems across the sciences that have very high-dimensional state spaces, with a large number of fast degrees of freedom that force direct simulators to proceed by integration steps that are orders of magnitude smaller than events of interests (e.g., particle collisions). Examples range from molecular motion to dynamics of large populations of cells. A grand challenge in the simulation and understanding of such systems is the systematic construction of accurate, interpretable, reduced models, enabling faster simulations, revealing fundamental properties of the dynamics, and predicting phenomena of interest that the original simulator could not reached with sufficient accuracy or within a given computational budget. In this projected we developed novel statistical estimation/machine learning techniques for analyzing and building empirical reduced models for important families of high-dimensional stochastic systems, in particular: - we developed techniques for estimating interaction kernels in interacting particle- and agent-based systems, which are ubiquitous in Physics, Biology and many other sciences, given observed trajectories of the system; - we developed techniques for nonlinear model reduction for high-dimensional stochastic systems that have a small number of unknown, nonlinear slow variables, and a large number of fast modes, that are possibly of large magnitude, given observed short trajectories of the system in the form of bursts of trajectories from different initial conditions; - we developed novel techniques for estimating linear dynamical systems on graphs when both the dynamics and the underlying graph are unknown, and we have a sparse set of space-time observations; - we considered the problem of estimating an unknown nonlinear observation function of a standard process (e.g. Brownian motion), so that we can recognized if an observed dynamics is "just" a nonlinear version of a known dynamics; we also developed benchmarks for learning algorithms aimed at learning and classifying diffusion processes.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Data reduction through optimized scalar quantization for more compact neural networks

Raw data generation for several existing and planned large physics experiments now exceeds TB/s rates, generating untenable data sets in very little time. Those data often demonstrate high dimensionality while containing limited information. Meanwhile, Machine Learning algorithms are now becoming an essential part of data processing and data analysis. Those algorithms can be used offline for post processing and post data analysis, or they can be used online for real time processing providing ultra low latency experiment monitoring. Both use cases would benefit from data throughput reduction while preserving relevant information: one by reducing the offline storage requirements by several orders of magnitude and the other by allowing ultra fast online inferencing with low complexity Machine Learning models. Moreover, reducing the data source throughput also reduces material cost, power and data management requirements. In this work we demonstrate optimized nonuniform scalar quantization for data source reduction. This data reduction allows lower dimensional representations while preserving the relevant information of the data, thus enabling high accuracy Tiny Machine Learning classifier models for online fast inferences. We demonstrate this approach with an initial proof of concept targeting the CookieBox, an array of electron spectrometers used for angular streaking, that was developed for LCLS-II as an online beam diagnostic tool. We used the Lloyd-Max algorithm with the CookieBox dataset to design an optimized nonuniform scalar quantizer. Optimized quantization lets us reduce input data volume by 69% with no significant impact on inference accuracy. When we tolerate a 2% loss on inference accuracy, we achieved 81% of input data reduction. Finally, the change from a 7-bit to a 3-bit input data quantization reduces our neural network size by 38%.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Bayesian learning for rapid prediction of lithium-ion battery-cycling protocols

Advancing lithium-ion battery technology requires the optimization of cycling protocols. A new data-driven methodology is demonstrated for rapid, accurate prediction of the cycle life obtained by new cycling protocols using a single test lasting only 3 cycles, enabling rapid exploration of cycling protocol design spaces with orders of magnitude reduction in testing time. We achieve this by combining lifetime early prediction with a hierarchical Bayesian model (HBM) to rapidly predict performance distributions without the need for extensive repetitive testing. The methodology is applied to a comprehensive dataset of lithium-iron-phosphate/graphite comprising 29 different fast-charging protocols. HBM alone provides high protocol-lifetime prediction performance, with 6.5% of overall test average percent error, after cycling only one battery to failure. Here, by combining HBM with a battery lifetime prediction model, we achieve a test error of 8.8% using a single 3-cycle test. In addition, the generalizability of the HBM approach is demonstrated for lithium-manganese-cobalt-oxide/graphite cells.

25 ENERGY STORAGE↗

DOE OSTI2025

Physics-informed transformation toward improving the machine-learned NLTE models of ICF simulations

The integration of machine-learning techniques into inertial confinement fusion (ICF) simulations has emerged as a powerful approach for enhancing computational efficiency. By replacing the costly nonlocal thermodynamic equilibrium (NLTE) model with machine-learning models, significant reductions in calculation time have been achieved. However, determining how to optimize machine-learning-based NLTE models in order to match ICF simulation dynamics remains challenging, underscoring the need for physically relevant error metrics and strategies to enhance model accuracy with respect to these metrics. Thus, we propose novel physics-informed transformations designed to emphasize energy transport, use these transformations to establish new error metrics, and demonstrate that they yield smaller errors within reduced principal-component spaces compared to conventional transformations. Published by the American Physical Society 2025

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Acceleration of Power System Dynamic Simulations Using a Deep Equilibrium Layer and Neural ODE Surrogate

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based resources exacerbates the computational burden of running time domain simulations. Here, in this paper, we propose a data-driven surrogate model based on implicit machine learningspecifically deep equilibrium layers and neural ordinary differential equationsto learn a reduced order model of a portion of the full underlying system. The data-driven surrogate achieves similar accuracy and reduction in simulation time compared to a physics-based surrogate, without the constraint of requiring detailed knowledge of the underlying dynamic models. This work also establishes key requirements needed to integrate the surrogate into existing simulation workflows; the proposed surrogate is initialized to a steady state operating point that matches the power flow solution by design.

Neural ordinary differential equations↗

DOE OSTI2020

Reduction kinetics of hercynite redox materials for solar thermochemical water splitting

Solar thermochemical water splitting (STWS) using a hercynite redox cycle is a promising technology for producing renewable H 2 . Here, the reduction kinetics of hercynite (FeAl 2 O 4 ) is evaluated using thermogravimetric and XRD analyses. The results indicate that as-prepared hercynite materials undergo reduction via two different reaction mechanisms. The reaction first proceeds by a nucleation and growth mechanism (AE1), followed by a third-order kinetic model (F3). XRD analyses show the occurrence of superstoichiometric oxygen in the spinel structure of FeAl 2 O 4+δ in the second reaction mechanism, which indicates the formation of cationic vacancies. TGA and XRD analyses confirm that hercynite maintains its spinel structure when the materials are thermally reduced and oxidized with steam. Differential scanning calorimetry (DSC) performed on FeAl 2 O 4 particles shows two heats of reaction in agreement with the two observed mechanisms. This is the first kinetics study to report on the thermal reduction of hercynite.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Internal Model-Based Active Damping Strategy for a Back-to-Back Modular Multilevel Converter System for Advanced Grid Support: Preprint

The proposed work focuses on the possibility of achieving the reduction in the size of the interfacing filter for the grid connection for a back-to-back modular multilevel converter system with the use of third order LCL filters. To achieve the same attenuation, it is possible to reduce the size of the interfacing filters by the usage of third order filters. However, this kind of filtering comes with the limitation of having sustained oscillations due to lack of damping especially during transient changes. Therefore, in this work, a methodology has been proposed based on the principle of internal model to cater for this unwanted oscillations. The third order system is modeled inside the microcontroller with the damping enabled. The error between the output from the model and the actual are compared and the error is utilized to accomplish the active damping strategy. The proposed architecture is verified via computer simulations based on MATLAB/Simulink domain and various case study results along with their discussion is presented in this paper.

dq control↗

DOE OSTI2020

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters.

42 ENGINEERING↗

DOE OSTI2022

Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

Post-training model compression can reduce the inference costs of deep neural networks, but uncompressed training still consumes enormous hardware resources and energy. To enable low-energy training on edge devices, it is highly desirable to directly train a compact neural network from scratch with a low memory cost. Low-rank tensor decomposition is an effective approach to reduce the memory and computing costs of large neural networks. However, directly training low-rank tensorized neural networks is a very challenging task because it is hard to determine a proper tensor rank a priori, and the tensor rank controls both model complexity and accuracy. Here, this paper presents a novel end-to-end framework for low-rank tensorized training. We first develop a Bayesian model that supports various low-rank tensor formats (e.g., CANDECOMP/PARAFAC, Tucker, tensor-train, and tensor-train matrix) and reduces neural network parameters with automatic rank determination during training. Then we develop a customized Bayesian solver to train large-scale tensorized neural networks. Our training methods shows orders-of-magnitude parameter reduction and little accuracy loss (or even better accuracy) in the experiments. On a very large deep learning recommendation system with over 4.2 ×10 9 model parameters, our method can reduce the parameter number to 1.6 ×10 5 automatically in the training process (i.e., by 2.6 ×10 4 times) while achieving almost the same accuracy. Code is available at https://github.com/colehawkins/bayesian-tensor-rank-determination.

compact neural networks↗

DOE OSTI2020

Enhanced dynamic equivalent identification method of large-scale power systems using multiple events

The increasing complexity of the interconnected power system makes high-fidelity dynamic simulation models computationally more intensive. To improve computation efficiency, model reduction techniques have been investigated to only preserve the dynamics in a limited area of interest (study area), while deriving equivalent representation for the external area. For this purpose, a measurement-based reduction approach using system identification techniques has been previously proposed. Accordingly, external areas are represented by dynamic equivalent loads using transfer function estimation. In this paper, in order to enhance the accuracy of the reduced model in preserving dynamics of the study area, multiple “grid” events of different types and at different locations are considered for identifying the parameters of the equivalent loads. Additionally, case studies are carried out in the NPCC 140-bus system. Comparisons are made between multiple events training and single event training, highlighting the advantages of the proposed method in providing a better representation of the grid dynamics under different operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Modeling of Liquid Hydrogen Tank Cooled with Para-Orthohydrogen Conversion

With the accelerating development of liquid-hydrogen storage facilities, the problem of boil-off hydrogen losses becomes very important. A promising method to reduce these losses is to utilize the endothermic para-orthohydrogen conversion of vented hydrogen, which can effectively decrease heat loads on a hydrogen tank. To model such a process, a hybrid computational model has been developed, based on the application of computational fluid dynamics for an ullage space, where knowledge of thermal stratification is important, and reduced-order models for other system elements. The simulation results for a spheroidal tank in selected conditions indicated a 10–25% reduction of boil-off losses due to cooling produced by vented hydrogen undergoing para-ortho-conversion.

08 HYDROGEN↗

DOE OSTI2021

A Study on Computational Cost Reduction of Simulations of Phase-Change Material (PCM) Embedded Heat Exchangers

Thermal storage can be implemented using Phase-Change Materials (PCM), which absorb significant latent heat with a relatively small temperature change. PCM phase-change processes are transient and are driven by thermal diffusion and natural convection – the latter, especially for melting process. Modeling and simulation of PCM heat exchangers (HX’s) is typically computationally intensive due to the relatively complex time-dependent physics. Most of the PCM modeling work in the literature uses high-order modeling tools such as Computational Fluid Dynamics (CFD) and Lattice-Boltzmann Method (LBM). For design purposes, the existing PCM modeling approaches are not practical, limiting researchers in their ability to investigate new ideas and different PCM’s with faster turnarounds. This paper presents a study investigating the reduction of computational cost of PCM embedded HX’s CFD models by evaluating the feasibility of spatial reduction without losing accuracy. The analysis consists of comparing full and partial domain under full melting conditions. The subject of this study is a single straight tube with circular transverse fins in the vertical orientation, using PCM’s with 35oC nominal melting temperature. Different tube and fin dimensions are investigated. Results indicate that the reduced domain reproduces - in half the run time - the same behavior as the full domain since the buoyancy effects are localized and patterned. The outputs from the partial domain simulation were used to build a non-general correlation for the PCM heat transfer characteristics and demonstrated how it can be implemented in a Finite Control Volume Reduced Order Model (ROM). The ROM can accurately reproduce the CFD simulations at 4 to 5 orders of magnitude faster.

25 ENERGY STORAGE↗

DOE OSTI2023

Neural message-passing for objective-based uncertainty quantification and optimal experimental design

Various real-world scientific applications involve the mathematical modeling of complex uncertain systems with numerous unknown parameters. Accurate parameter estimation is often practically infeasible in such systems, as the available training data may be insufficient and the cost of acquiring additional data may be high. In such cases, based on a Bayesian paradigm, we can design robust operators retaining the best overall performance across all possible models and design optimal experiments that can effectively reduce uncertainty to enhance the performance of such operators maximally. While objective-based uncertainty quantification (objective-UQ) based on MOCU (mean objective cost of uncertainty) provides an effective means for quantifying uncertainty in complex systems, the high computational cost of estimating MOCU has been a challenge in applying it to real-world scientific/engineering problems. In this work, we propose a novel scheme to reduce the computational cost for objective-UQ via MOCU based on a data-driven approach. We adopt a neural message-passing model for surrogate modeling, incorporating a novel axiomatic constraint loss that penalizes an increase in the estimated system uncertainty. As an illustrative example, we consider the optimal experimental design (OED) problem for uncertain Kuramoto models, where the goal is to predict the experiments that can most effectively enhance robust synchronization performance through uncertainty reduction. We show that our proposed approach can accelerate MOCU-based OED by four to five orders of magnitude, without any visible performance loss compared to the state-of-the-art. The proposed approach applies to general OED tasks, beyond the Kuramoto model.

97 MATHEMATICS AND COMPUTING↗