Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Combined selection of the dynamic model and modeling error in nonlinear aeroelastic systems using Bayesian Inference

Here, we report a Bayesian framework for concurrent selection of physics-based models and (modeling) error models. We investigate the use of colored noise to capture the mismatch between the predictions of calibrated models and observational data that cannot be explained by measurement error alone within the context of Bayesian estimation for stochastic ordinary differential equations. Proposed models are characterized by the average data-fit, a measure of how well a model fits the measurements, and the model complexity measured using the Kullback–Leibler divergence. The use of a more complex error models increases the average data-fit but also increases the complexity of the combined model, possibly over-fitting the data. Bayesian model selection is used to find the optimal physical model as well as the optimal error model. The optimal model is defined using the evidence, where the average data-fit is balanced by the complexity of the model. The effect of colored noise process is illustrated using a nonlinear aeroelastic oscillator representing a rigid NACA0012 airfoil undergoing limit cycle oscillations due to complex fluid–structure interactions. Several quasi-steady and unsteady aerodynamic models are proposed with colored noise or white noise for the model error. The use of colored noise improves the predictive capabilities of simpler models.

42 ENGINEERING↗

Comparing Designed Training Sets to Optimize Multivariate Regression Models for Pr, Nd, and Nitric Acid Using Spectrophotometry

Chemometric regression models were developed for the quantification of praseodymium (Pr, 0–1000 µg/mL), neodymium (Nd, 0–1000 µg/mL), and nitric acid (HNO 3 , 0.1–5 M) using spectrophotometry. Designed calibration sets were composed of 20 samples each: 10 model points and 10 lack-of-fit (LOF) points. The D-optimal designs effectively minimized the number of samples required to build models, and each design resulted in similar prediction performance, suggesting that statistical design of experiments can provide a reliable framework for selecting training set samples in three-variable systems. Partial least squares regression (PLSR) models were validated against a one-factor-at-a-time validation set composed of 125 samples (three variables, five levels). The top PLS-1 models resulted in average percent root mean square error of prediction error values of 3.5%, 1.7%, and 1.2% for Pr(III), Nd(III), and HNO 3 , respectively. Power set augmentations of the model and LOF samples were investigated to optimize the number of training set samples. PLSR models built using just required model points (10) had similar predictive capabilities as models including the LOF points (20) but with fewer samples. The number of validation samples was also varied systematically to learn how many samples are needed to validate regression models. This work addresses long-standing questions in the field of chemometrics to help make this approach amenable to the near-real-time quantification of hazardous species in remote settings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Model-based Design Optimization to Achieve the Performance Goals (16.0 SEER/9.5 HSPF), Developing Heat Pump by Using Low-GWP Refrigerants and 5 mm Diameter Tubes

Usage of low-GWP refrigerants can reduce the Green House Gas (GHG) emission of HVAC systems. Our research in previous milestone report has shown that using heat exchangers with 5 mm diameter tubes instead of 9 mm diameter tubes is a promising solution to meet the performance goals of heat pump using low-GWP refrigerants. In addition, the 5mm tube heat exchangers can lead to lower system refrigerant charge and as a result, reduce environmental impact further. However, shifting to small tube diameters requires in-depth heat exchanger design optimization to adapt to the transition to low-GWP refrigerants. In the 2nd quarter of FY21, we conducted multi-objective optimizations using Particle Swarm Optimization algorithm on a residential 5-ton air source heat pump to investigate the potential system performance improvements and material savings. 4 low-GWP refrigerants, ARM20A, ARM20B, R454A and R454C are investigated in this study. The objectives of the optimization are to minimize the heat pump material cost and to maximize the system performance simultaneously. As a result, the HXs material cost is reduced by up to 77% according to the copper and aluminum material price in current market. Under heating mode operation, the smart 4-way valve guarantees that the optimal low-GWP systems maintain or outperform the heating performance of the R410A baseline system. The model-based design optimization yields 18.3-18.9 SEER and 10.6-11.9 HSPF for optimal systems using different low-GWP refrigerants. The initial performance goals (16.0 SEER/9.5 HSPF) are achieved. Furthermore, up to 50% system refrigerant charge reduction is possible in the optimized low-GWP heat pump system using ARM20B. And 91%-95% predicted life-time direct CO 2 emission reduction is achieved by using the optimal 5mm tube low-GWP heat pumps. The significant material saving, charge reduction and direct CO 2 emission reduction help in reducing the environmental impacts of heat pump systems. The optimal heat exchangers resulting from this research can fit into the original baseline indoor and outdoor fan-coil unit. This can reduce the retrofitting effort by minimizing the change in manufacturing and installation of the heat pumps and guarantee the compatibility with end-users’ house structure. Finally, the new products can be easily accepted by manufacturers and end-users.

42 ENGINEERING↗

Machine learning-enhanced model-based scenario optimization for DIII-D

Abstract Scenario development in tokamaks is an open area of investigation that can be approached in a variety of different ways. Experimental trial and error has been the traditional method, but this required a massive amount of experimental time and resources. As high fidelity predictive models have become available, offline development and testing of proposed scenarios has become an option to reduce the required experimental resources. The use of predictive models also offers the possibility of using a numerical optimization process to find the controllable inputs that most closely achieve the desired plasma state. However, this type of optimization can require as many as hundreds or thousands of predictive simulation cases to converge to a solution; many of the commonly used high fidelity models have high computational burdens, so it is only reasonable to run a handful of predictive simulations. In order to make use of numerical optimization approaches, a compromise needs to be found between model fidelity and computational burden. This compromise can be achieved using neural networks surrogates of high fidelity models that retain nearly the same level of accuracy as the models they are trained to replicate while reducing the computation time by orders of magnitude. In this work, a model-based numerical optimization tool for scenario development is described. The predictive model used by the optimizer includes neural network surrogate models integrated into the fast Control-Oriented Transport simulation framework. This optimization scheme is able to converge to the optimal values of the controllable inputs that produce the target plasma scenario by running thousands of predictive simulations in under an hour without sacrificing too much prediction accuracy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Stochastic Continuous-time Flexibility Scheduling and Pricing in Wholesale Electricity Markets

Large-scale integration of intermittent renewable energy sources (RES) is calling for additional flexibility resources as well as more advanced modeling and optimization techniques to account for the increasing uncertainty and variability in power systems operation. As the RES integration gains momentum, the magnitude and frequency of their variations increase, which may trigger ramping scarcity events in real-time power systems operation. This necessitates revisiting the present definition of power systems flexibility and reserve services to reflect their robustness and adequacy towards sub-interval variations of the load and RES, as well as adjusting the operation models to accommodate the new reserve services. This project took a fundamental approach and aimed at developing continuous-time scheduling and pricing model that accurately models the continuous-time variations of load and RES and efficiently deploys the ramping capability of flexible resources to compensate the sources of variability and uncertainty in the market. In this regard, this project pursued the following goals: Developing stochastic multi-fidelity continuous-time optimization models for scheduling of energy storage (ES) systems and flexible loads in wholesale energy markets; Developing the theory and practices of continuous-time locational marginal pricing for valuating energy storage systems and flexible loads in wholesale energy markets; Developing function space solution approach to convert the proposed stochastic multi-fidelity continuous-time optimization models into tractable mixed-integer linear optimization models; and Defining flexibility reserve as a new type of reserve in markets that would enable ultimate participation of energy storage devices in provision of services to compensate the variability and uncertainty of RES in electricity markets. This project successfully completed all five major tasks defined in the SOPO, and produced 8 high-impact journal papers, 6 conference papers, 3 published U.S. patents, and one web-based software for continuous-time operation optimization of power systems. The application of the proposed flexibility reserve and the stochastic multi-fidelity continuous-time operation scheduling models would modify the forward commitment and schedule of generating units, ES devices and flexible loads, and would line up the resources in such a way that the composition of available resources is better prepared to respond to the sub-hourly variations of the load and renewable resources in real-time operation. Therefore, this project paves the way to sustainable, reliable, and economic integration of renewable energy resources in power system, supporting the progress towards reaching the national targets on energy independence. Even if the proposed models offers a radically different point of view as compared to existing models, it does not alter fundamentally the architecture of power systems operations, nor the complexity of the scheduling problem, so the integration of this project in power systems is extremely practical.

24 POWER TRANSMISSION AND DISTRIBUTION↗

GOOML Big Kahuna Forecast Modeling and Genetic Optimization Files

This submission includes example files associated with the Geothermal Operational Optimization using Machine Learning (GOOML) Big Kahuna fictional power plant, which uses synthetic data to model a fictional power plant. A forecast was produced using the GOOML data model framework and fictional input data, and a genetic optimization is included which determines optimal flash plant parameters. The inputs and outputs associated with the forecast and genetic optimization are included. The input and output files consist of data, configuration files, and plots. A link to the Physics-Guided Neural Networks (phygnn) GitHub repository is also included, which augments a traditional neural network loss function with a generic loss term that can be used to guide the neural network to learn physical or theoretical constraints. phygnn is used by the GOOML framework to help integrate its machine learning models into the relevant physics and engineering applications. Note that the data included in this submission are intended to provide a demonstration of GOOML's capabilities. Additional files that have not been released to the public are needed for users to run these models and reproduce these results. Units can be found in the readme data resource.

15 GEOTHERMAL ENERGY↗

Modeling, analysis, and optimization of complex nuclear processes and facilities via computational methods: The HALEU process case study

Improving and adapting industrial systems to timely meet changing programmatic and market demands is an important goal to achieve, including when operating and maintaining complex nuclear processes and facilities. However, changes to these complex systems are costly, particularly when they are already in place and bounded to stringent requirements and constraints such as when handling radioactive material and contaminated equipment. These conditions often exist when treating spent nuclear fuel remotely within shielded nuclear radiation chambers, commonly referred as hot cells, to condition nuclear material and/or fabricate products for utilization in other nuclear enterprises such as in the manufacture of advanced nuclear fuel. The illustrative case considered here is the production of high assay low enriched uranium (HALEU) products supporting the deployment of advanced nuclear reactors. For the HALEU program, resources invested were and are being systematically analyzed so that these investments are maximized in a facility that is nearly 60 years old. A methodology that has effectively enabled optimized and improvements in the Spent Fuel Treatment (SFT) program, and consequently the HALEU program, involves discrete event simulation as addressed in this article. Here, the quantification of multiple productivity metrics, including material processing rates, cycle times, bottlenecks, number of material transfers as well as equipment, workstation, and material handling utilization, has resulted in a myriad of diverse discoveries and data-informed decisions regarding process layout and constituent, labor levels and schedules, selection of new process units, storage needs, and other critical process configurations. This article describes such a computational capability being applied for decision-making, illustrates its application to an actual process and program, provides illustrative results, and argues how computational methods for the modeling, analysis, and optimization of complex processes and facilities does lead to informed decisions derived from data and not only from intuition.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Optimization based process modeling of an anaerobic membrane bioreactor system: Application to swine wastewater

To maintain current levels of consumption in the economy with the dwindling supply of non-renewable material and energy, alternative resource streams more traditionally viewed as waste streams must be considered. Fermentation of high-strength wastewaters is one such pathway that allows for the recovery of energy, nitrogen, phosphorus, and carbon compounds. Anaerobic membrane bioreactors (AnMBRs) are an emerging technology that allow for the digestion of wastewater in a much smaller footprint than traditional anaerobic digesters. Adoption of this technology into industry has been limited by membrane capital and cleaning costs, but these costs may be offset through the recovery of valuable products. To evaluate the viability of AnMBR technology in the context of swine wastewater treatment, an optimization-based process model built upon Anaerobic Digestion Model No. 1 (ADM1) has been developed. Modeling results show that a swine wastewater stream provides potential for net positive energy generation from the AnMBR system in most cases. Sensitivity analyses around important variables were conducted to determine focus areas for future research into AnMBR technology and evaluate the robustness of the model to microbial variables that may change with different microbial communities.

09 BIOMASS FUELS↗

Leveraging prior mean models for faster Bayesian optimization of particle accelerators

Tuning particle accelerators is a challenging and time-consuming task that can be automated and carried out efficiently using suitable optimization algorithms, such as model-based Bayesian optimization techniques. One of the major advantages of Bayesian algorithms is the ability to incorporate prior information about beam physics and historical behavior into the model used to make control decisions. In this work, we examine incorporating prior accelerator physics information into Bayesian optimization algorithms by utilizing fast executing, neural network models trained on simulated or historical datasets as prior mean functions in Gaussian process models. We show that in ideal cases, this technique substantially increases convergence speed to optimal solutions in high-dimensional tuning parameter spaces. Additionally, we demonstrate that even in non-ideal cases, where prior models of beam dynamics do not exactly match experimental conditions, the use of this technique can still enhance convergence speed. Finally, we demonstrate how these methods can be used to improve optimization in practical applications, such as transferring information gained from beam dynamics simulations to online control of the LCLS injector, and transferring knowledge gained from experimental measurements across different operating modes, such as accelerating different ion species at the ATLAS heavy ion accelerator.

43 PARTICLE ACCELERATORS↗

Network-Wide Traffic Signal Control Using Bilinear System Modeling and Adaptive Optimization

This study proposes a new multi-input multi-output optimal bilinear signal control method in which a bilinear dynamic model approximation is used to capture the nonlinear dynamics of the urban traffic networks. With signal green time splits as the control input and traffic delay changes as the output for each intersections in the network, a bilinear system model was developed, which, on the basis of linear system modeling, takes interactions among traffic delays and signal timing splits into consideration. Based on the bilinear system modeling framework, we conducted two steps in each time interval to derive traffic control strategies: (1) we used the normalized least-squared algorithm to estimate system parameters; and (2) we solved an online optimization problem to obtain the updated traffic control inputs for the signal timing that minimizes future traffic delays. We evaluated the proposed method in a microscopic traffic simulation environment (VISSIM) with a 35-intersection network of Bellevue city in Washington. Two different traffic demand patterns: (1) normal traffic demands; and (2) time-varying traffic demands were simulated to compare the performance of different control strategies. Experimental results show that (1) the proposed bilinear system model can better describe traffic system dynamics than linear-model based methods, such as our previously developed linear-quadratic regulator control; and (2) the proposed method outperforms the state-of-the-art signal control strategies, namely the max-pressure and the self-organizing traffic light control methods. We have also shown that the proposed method is applicable to all other possible network layouts and signal controller phasing structures.

42 ENGINEERING↗

Optimizing Geant4 Hadronic Models

Geant4, the leading detector simulation toolkit used in high energy physics, employs a set of physics models to simulate interactions of particles with matter across a wide range of energies. These models, especially the hadronic ones, rely largely on directly measured cross-sections and inclusive characteristics, and use physically motivated parameters. However, they generally aim to cover a broad range of possible simulation tasks and may not always be optimized for a particular process or a given material. The Geant4 collaboration recently made many parameters of the models accessible via a configuration interface. This opens a possibility to fit simulated distributions to the thin target experimental datasets and extract optimal values of the model parameters and the associated uncertainties. Such efforts are currently undertaken by the Geant4 collaboration with the goal of offering alternative sets of model parameters, also known as "tunes", for certain applications. The effort should subsequently lead to more accurate estimates of the systematic errors in physics measurements given the detector simulation role in performing the physics measurements. Results of the study are presented to illustrate how Geant4 model parameters can be optimized through applying fitting techniques, to improve the agreement between the Geant4 and the experimental data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Heat Integration Optimization and Dynamic Modeling Investigation for Advancing the Coal-Direct Chemical Looping Process

The purpose of the project is to address the optimization and startup operation of a modular coal direct chemical looping (CDCL) combustion system integrated with a steam cycle for power generation to reduce the risks involved in further scale-up of the technology. The modular reactor design of the CDCL process provides flexibility in the fabrication of the reactor and in its operating capacity (i.e. turndown ratio) at the cost of a more complex heat exchange network (HEN) design and integration. To address the technology gaps and advance the efficiency and economic feasibility of the CDCL technology, the project will perform a detailed and comprehensive analysis of the integration of a modular CDCL reactor system and a steam cycle system under both static and transient conditions via HEN process performance simulations and system dynamic modeling, respectively. The scope of work consists of 1) Experimental and computational studies of the CDCL combustor reactor 2) Comprehensive static (i.e. steady-state) system HEN design analysis in CDCL 550 MWe commercial unit for power generation and 3) Dynamic modeling of site specific design of 10MWe CDCL large pilot plant. The project team has successfully developed and validated a kinetic model for the oxidation of oxygen carriers in the combustor using the unreacted shrinking core model (UCSM). The model is capable of capturing the oxidation kinetics of fully or partially reduced oxygen carrier particles. A computational fluid dynamics (CFD) model is developed to simulate the hydrodynamics, heat transfer, and chemical reaction occurring in the CDCL combustor. The model is developed in MFIX and ANSYS Fluent. Key aspects of CDCL combustor operation, including heat transfer, oxygen carrier oxidation, and the transport of oxygen carrier particles, are simulated using this CFD model. The HEN for a commercial scale 550 MWe CDCL power plant is simulated and optimized using ASPEN Plus. Practical design considerations are incorporated based on industrial experiences. The performance and cost for the commercial CDCL plant is updated based on these analyses. A dynamic model for the 10 MWe CDCL pilot plant is developed in ProTRAX simulation software. The model is based on the pilot plant design developed in project DE-FE0027654 “10 MWe CDCL Large Pilot Plang – Pre-FEED Study” and the steam cycle data obtained from Dover Light & Power plant. The transient behaviors during pilot plant load variation are simulated using the dynamic model.

01 COAL, LIGNITE, AND PEAT↗

Glass formulation and composition optimization with property models: A review

Abstract Glass is a versatile material with a remarkable history and many practical applications. It plays a critical role in our everyday lives, the advancement of science, and the development of many technologies. The Edisonian type trial‐and‐error method was commonly used for conventional design of glass compositions, which was time‐consuming and costly. With the urgent need to develop new glass compositions for technology applications rapidly, it has become necessary to develop precise property models with predictive powers using large databases and efficient formulation approaches. This paper reviews the design of glass compositions using these analytical and numerical models of composition–structure–property relations of glasses, some based on large databases and machine learning approaches. Aspects of data collection, model fitting, feature extraction, model evaluation, and uncertainty quantification will be covered. Furthermore, advances in the glass optimization framework and available tools are summarized with examples. The outlook and perspective for further glass property model development and formulation approaches are discussed.

Lu, Xiaonan↗

Encoding nonlinear and unsteady aerodynamics of limit cycle oscillations using nonlinear sparse Bayesian learning

This article investigates the applicability of a recently proposed, nonlinear sparse Bayesian learning (NSBL) algorithm to identify and estimate the complex aerodynamics of limit cycle oscillations. NSBL provides a semi-analytical framework for determining the data-optimal sparse model nested within a (potentially) over-parameterized model. This is particularly relevant to nonlinear dynamical systems where modelling approaches involve the use of physics-based and data-driven components. In such cases, the data-driven components, where analytical descriptions of the physical processes are not readily available, are often prone to overfitting, meaning that the empirical aspects of these models will often involve the calibration of an unnecessarily large number of parameters. While an overparameterized model may fit the observed data well, such models may be inadequate for making predictions in regimes that are different from those wherein the data were recorded. In view of this, it is desirable to not only calibrate the model parameters, but also identify the optimal compromise between data fit and model complexity. In this article, we exhibit the optimal model discovery for an aeroelastic system wherein the structural dynamics are well-known and described by a differential equation model, coupled with a semi-empirical aerodynamic model for laminar separation flutter, resulting in low-amplitude limit cycle oscillations (LCO). To illustrate the performance of the algorithm, in this article, we use synthetic data and demonstrate the ability of the algorithm to correctly rediscover the optimal model and model parameters, given a known data-generating model. The synthetic data are generated from a forward simulation of a known differential equation model with parameters selected so as to mimic the dynamics observed in wind-tunnel experiments. Subsequently, we demonstrate the performance of the algorithm for model selection using noisy LCO data from wind tunnel experiments. As there is no ground truth available for the experimental data case, we provide a comparison between NSBL and Bayesian model selection to validate the results, and demonstrate the use of NSBL as an efficient alternative to traditional methods.

97 MATHEMATICS AND COMPUTING↗

WaterTAP Technical Brief: Ion Exchange Model Demonstration and Optimization

Ion exchange is an important water treatment process for removal of targeted contaminants, including those associated with hardness. In this report, we introduce the ion exchange model developed for WaterTAP and present some example analysis of Ca 2+ removal for 0.1 MGD and 10 MGD systems. The model is a single-component, steady-state implementation that enables process optimization based on the influent ion concentration, resin capacity, and resin selectivity. Based on a survey of costing references for ion exchange, the WaterTAP ion exchange model returns reasonable estimates for the levelized cost of water (LCOW) of an ion exchange process, and performs as expected when critical design parameters, such as the resin capacity and selectivity, are varied.

54 ENVIRONMENTAL SCIENCES↗

Membrane-based carbon capture process optimization using CFD modeling

Carbon capture is a promising option to mitigate CO2 emissions from existing coal-fired power plants, cement and steel industries, and petrochemical complexes. Among the available technologies, membrane-based carbon capture presents the lowest energy consumption, operating costs, and carbon footprint. In addition, membrane processes have important operational flexibility and response times. On the other hand, the major challenges to widespread application of this technology are related to reducing capital costs and improving membrane stability and durability. To upscale the technology into stacked flat sheet configurations, high fidelity computational fluid dynamics (CFD) that describes the separation process accurately are required. High fidelity simulations have been shown to be effective in studying the complex transport phenomena in membrane systems. In addition, obtaining high CO2 recovery percentages and product purity requires a multi-stage membrane process, where the optimal network configuration of the membrane modules must be studied in a systematic way. In order to address the design problem at process scale, we formulate a superstructure for the membrane-based carbon capture, including up to three separation stages. In the formulation of the optimization problem, we include reduced models, based on rigorous CFD simulations of the membrane modules. Numerical results indicate that the optimal design includes three membrane stages, and the capture cost is 45.4 $/t-CO2.

Pedrozo, Hector A.↗

Language model-accelerated deep symbolic optimization

Symbolic optimization methods have been used to solve varied challenging and relevant problems such as symbolic regression and neural architecture search. However, the current state of the art typically learns each problem from scratch and is unable to leverage pre-existing knowledge and datasets that are available for many applications. Here, inspired by the similarity between sequence representations learned in natural language processing and the formulation of symbolic optimization as a discrete sequence optimization problem, we propose language model-accelerated deep symbolic optimization (LA-DSO), a method that leverages language models to learn symbolic optimization solutions more efficiently. We demonstrate LA-DSO in two tasks: symbolic regression, which allows us to perform extensive experimentation due to its low computation requirements, and computational antibody optimization, which shows that our proposal accelerates learning in challenging real-world problems.

97 MATHEMATICS AND COMPUTING↗