Multi-Objective Bayesian Optimization at SLAC MeV-UED
Explore the source record for details and available documents.
Ji, F.↗
SEARCH · Engineering Papers
Results for “multi objective optimization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Pareto-Front Training for Multi-objective Symbolic Optimization
Explore the source record for details and available documents.
Mathematics and Computing↗
CAMEO: A Co-design Architecture for Multi-objective Energy System Optimization (Project Report)
CAMEO (Codesign Architecture for Multi-objective Energy System Optimization) is a modular workflow management framework that abstracts co-design problems as Directed Acyclic Graphs (DAG). The framework employs JSON-based workflow specifications that enable systematic decomposition of complex optimization problems into reusable, interchangeable components including data loaders, scenario generators, optimization solvers, and result summarizers.
97 MATHEMATICS AND COMPUTING↗
Multi-objective latent space optimization of generative molecular design models
Not Available
97 MATHEMATICS AND COMPUTING↗
HARMONY: Large-Scale Architecture Search for Efficient Hybrid Language Models
As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.
Herron, Emily [ORNL] (ORCID:0000000273008172)↗
Practical CO2—WAG Field Operational Designs Using Hybrid Numerical-Machine-Learning Approaches
Machine-learning technologies have exhibited robust competences in solving many petroleum engineering problems. The accurate predictivity and fast computational speed enable a large volume of time-consuming engineering processes such as history-matching and field development optimization. The Southwest Regional Partnership on Carbon Sequestration (SWP) project desires rigorous history-matching and multi-objective optimization processes, which fits the superiorities of the machine-learning approaches. Although the machine-learning proxy models are trained and validated before imposing to solve practical problems, the error margin would essentially introduce uncertainties to the results. In this paper, a hybrid numerical machine-learning workflow solving various optimization problems is presented. By coupling the expert machine-learning proxies with a global optimizer, the workflow successfully solves the history-matching and CO2 water alternative gas (WAG) design problem with low computational overheads. The history-matching work considers the heterogeneities of multiphase relative characteristics, and the CO2-WAG injection design takes multiple techno-economic objective functions into accounts. This work trained an expert response surface, a support vector machine, and a multi-layer neural network as proxy models to effectively learn the high-dimensional nonlinear data structure. The proposed workflow suggests revisiting the high-fidelity numerical simulator for validation purposes. The experience gained from this work would provide valuable guiding insights to similar CO2 enhanced oil recovery (EOR) projects.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Parametric Optimization of Rigid Wheels for Planetary Surface Mobility Applications
Design-Build-Test approaches for spaceflight hardware are time and cost intensive, which can result in suboptimal mechanism designs. Optimization-based approaches that utilize high-fidelity models and physics simulation could overcome these limitations while simultaneously speeding up the mechanical design process and reducing cost. In this work, we present a toolchain that enables the multi-objective optimization of rigid rover wheels for planetary surface mobility applications. The toolchain uses Chrono’s Continuous Representation Model (CRM) functionality to simulate granular soil and performs multi-objective parametric optimization on candidate rover wheels to meet a desired performance criterion. The resulting wheel design is then evaluated experimentally using a single-wheel testbed. We end with a discussion of how the toolchain can be extended to simultaneously co-optimize other system parameters, such as system power consumption and feedback control gains.
Optimization↗
Numerical modeling based machine learning approach for the optimization of falling - film evaporator in thermal desalination application
Scale formation that drastically increases thermal resistance and reduces freshwater production remains a critical challenge in thermal desalination. Novel designs of falling film evaporator and optimal operating condition hold great promise to mitigate scale formation, and increase heat transfer performance and fresh water production. In this work, CFD simulation based machine learning and multi-objective optimization are performed to identify optimal conditions and tube arrangement for evaporator. Non-dominated sorting genetic algorithm is adopted to determine and analyze the optimal pareto front for multiple objectives in desalination criteria. The errors of training, validation, and testing set are computed to identify an optimal hyperparameter set. For performance ratio, fouling resistance, and water production rate, the average relative error is 2.26%, 3.67%, and 3.24%. At pareto front, both performance ratio and water production rate increase at high temperature with fouling resistance (thermal resistance of the fouling layer) increasing as well. Tradeoffs between mitigating scale formation and enhancing desalination performance are evaluated in optimizations for different objectives. Finally, potential optima are identified and can be applied as guidelines to determine evaporator design and system operating conditions.
42 ENGINEERING↗
Methodology for Exploring Water and Hydropower Operating Criteria That Simultaneously Improve Economic and Environmental Considerations
Despite the reliability and flexibility of hydropower, the operation of hydroelectric power plants may have significant impacts on the downstream river system, including its water stage, sediment transport, and water temperature, ultimately affecting the ecology. To address these challenges, there is a need to identify water scheduling patterns that improve both hydropower economics and the environment relative to current operations. This paper presents a new methodology to explore promising operational criteria/rules that can achieve such improvements. Typical environmental impact statements and relicensing processes generally perform detailed site-specific analyses of a few alternatives that focus on reservoir water release operating rules and their associated environmental impacts. In contrast, the methodology presented in this article uses a widely applicable approach that explores a much larger solution space. This large set of potential alternatives can be represented in a multidimensional space for which one axis represents the economic value and the other axis quantify individual environmental impacts (e.g., sediment transport and fish growth), and they are explored via two approaches: a Monte Carlo simulation that identifies “win–win” alternatives and a multi-objective optimization problem that identifies Pareto-optimal alternatives.
13 HYDRO ENERGY↗
Scaling considerations for supercritical carbon dioxide cycles including turbomachinery loss models
A modeling framework for the supercritical carbon dioxide recompressed closed Brayton cycle was developed. Unlike typical models, this effort incorporated generalized empirical turbomachinery loss models. Aerodynamic, windage, and leakage losses were considered in order to address the limitations of conventional constant-efficiency turbomachinery assumptions without relying on machine-specific or computationally expensive simulations. The model enables system-level exploration of optimal cycle design across a range of power scales, including smaller scales that are relevant to microreactors and extraterrestrial power applications. Parametric studies and multi-objective optimizations are used to evaluate the trade-offs between thermal efficiency and system compactness based on an analytical heat exchanger scaling model, yielding Pareto-optimal fronts across a range of operating pressures. Results reveal that at small power scales, the Pareto-optimal compressor inlet pressure becomes subcritical due to the increasing influence of density-dependent turbomachinery losses. Here, the relative contributions of each loss mechanism are quantified, and design recommendations are provided for key parameters such as recompression split ratio and generator cavity pressure across varying power scales.
Multi-objective optimization↗
Optics Studies for Multipass Energy Recovery at CEBAF: ER@CEBAF
Energy recovery linacs (ERLs), focus on recycling the kinetic energy of electron beam for the purpose of accelerating a newly injected beam within the same accelerating structure. The rising developments in the super conducting radio frequency technology, ERL technology has achieved several noteworthy milestones over the past few decades. In year 2003, Jefferson Lab has successfully demonstrated a single pass energy recovery at the CEBAF accelerator. Furthermore, they conducted successful experiments with IR-FEL demo and upgrades, as well as the UV FEL driver. This multi-pass, multi-GeV range energy recovery demonstration proposed to be carried out at CEBAF accelerator at Jefferson Lab focuses on demonstrating highest energy recovery in super conducting linac in the low-current range. Continuous electron beam accelerate up to 7.5 GeV within 5-passes and decelerate in the next 5-passes recovering RF energy and dumps at a low energy dump. The beamline optics design for recirculating linacs require special attention to avoid beam instabilities due to RF wakefields. Usually, multi-pass linac beam lines require stronger focusing at lower energies as that is necessary to avoid beam breakup (BBU) instabilities, even with this small beam current. The CEBAF linac optics optimization is focused on balancing over-focusing at higher energies and beta excursions at lower energies. The race-track-shaped geometry of CEBAF accelerator allows its linacs to accommodate multiple energy beams simultaneously, while individual recirculating arcs transporting one beam energy, are shared between accelerating/decelerating beams. For the linac optics optimization process, an extended strategy is used that is originally used in 6-pass Recirculating Linac design of the LHeC, to represent the ten passes through a single linac. Using proper mathematical expressions, linac optics optimization can be achieved with evolutionary genetic algorithms, with Multi-Objective optimization. This thesis introduces a CEBAF optics redesign tailored to accommodates the ER@CEBAF multi-pass ER scheme. The isochronous arcs were retuned to match into optics solutions for optimized 10-pass linacs. Within this work, a single bunch particle tracking analysis presented here focuses on the further improvements of the beamline and beam transportation.
Neththikumara, Isurumali↗
Machine-learning-assisted high-temperature reservoir thermal energy storage optimization
High-temperature reservoir thermal energy storage (HT-RTES) has the potential to become an indispensable component in achieving the goal of the net-zero carbon economy, given its capability to balance the intermittent nature of renewable energy generation. In this study, a machine-learning-assisted computational framework is presented to co-optimize the performance metrics of HT-RTES by combining physics-based simulation with stochastic hydrogeologic formation and thermal energy storage operation parameters, artificial neural network regression of the simulation data, and genetic algorithm-enabled multi-objective optimization. A doublet well configuration with a layered (aquitard-aquifer-aquitard) generic reservoir is simulated for cases of continuous operation and seasonal-cycle operation scenarios. Further, neural network-based surrogate models are developed for the two scenarios and applied to generate the Pareto fronts of the HT-RTES performance for four potential HT-RTES sites. The developed Pareto optimal solutions indicate the performance of HT-RTES is operation-scenario (i.e., fluid cycle) and reservoir-site dependent, and the performance metrics have competing effects for a given site and a given fluid cycle. The developed neural network models can be applied to identify suitable sites for HT-RTES, and the proposed framework sheds light on the design of resilient HT-RTES systems.
15 GEOTHERMAL ENERGY↗
Multidisciplinary design optimization in Architecture, Engineering, and Construction: a detailed review and call for collaboration
The design of buildings has become a complex and multidisciplinary problem involving multiple conflicting objectives as architects and designers address competing technical, economic, environmental, and societal concerns. This has been driving research in Architecture, Engineering, and Construction (AEC) toward rigorous multidisciplinary decision-making frameworks that generate and evaluate numerous design alternatives using multi-objective optimization in concert with simulation and analysis models of varying fidelity and computational expense. While such frameworks are well known and widely employed in the aerospace and systems engineering domains, efforts by design professionals and researchers in the AEC field are scattered at best. In this paper, we provide a detailed review of recent developments in optimization frameworks in the AEC field and subsequently highlight how such developments are largely compartmentalized into separate domains such as structural, energy, daylighting, and other performance factors. Herein, we further discuss the technical challenges involved in concurrent coupled multidisciplinary design optimization (MDO) in the AEC field such as interoperability issues between Building Information Modeling (BIM) environments, analysis/simulation tools, and optimization frameworks. We conclude by outlining research needed for more unified modeling and simulation-based optimization frameworks to aid in complex and multidisciplinary building design processes. We also highlight the need for the identification and development of multi-fidelity simulation tools for use across multiple design phases. As such, this paper contributes a novel roadmap to leverage aerospace and systems engineering research in MDO into the field of AEC, along with a call for researchers in the MDO community to seek collaborations in AEC field.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Input-response space-filling designs
Traditional space-filling designs are a convenient way to explore throughout an input space of flexible dimension and have design points close to any region where future predictions might be of interest. In some applications, there may be a model connecting the input factors to the response(s), which provides an opportunity to consider the spacing not only in the input space but also in the response space. In this paper, we present an approach for leveraging current understanding of the relationship between inputs and responses to generate designs that allow the experimenter to flexibly balance the spacing in these two regions to find an appropriate design for the experimental goals. Applications where good spacing of the observed response values include calibration problems where the goal is to demonstrate the adequacy of the model across the range of the responses, sensitivity studies where the outputs from a submodel may be used as inputs for subsequent models, and inverse problems where the outputs of a process will be used in the inverse prediction for the unknown inputs. Here, we use the multi-objective optimization method of Pareto fronts to generate multiple non-dominated designs with different emphases on the input and response space-filling criteria from which the experimenter can choose. The methods are illustrated through several examples and a chemical engineering case study.
42 ENGINEERING↗
Genetic Algorithms Applied to Multi-Objective Aerodynamic Shape Optimization
A genetic algorithm approach suitable for solving multi-objective problems is described and evaluated using a series of aerodynamic shape optimization problems. Several new features including two variations of a binning selection algorithm and a gene-space transformation procedure are included. The genetic algorithm is suitable for finding Pareto optimal solutions in search spaces that are defined by any number of genes and that contain any number of local extrema. A new masking array capability is included allowing any gene or gene subset to be eliminated as decision variables from the design space. This allows determination of the effect of a single gene or gene subset on the Pareto optimal solution. Results indicate that the genetic algorithm optimization approach is flexible in application and reliable. The binning selection algorithms generally provide Pareto front quality enhancements and moderate convergence efficiency improvements for most of the problems solved.
Holst, Terry L.↗
Optimal environmental and economic performance trade-offs for fifth generation district heating and cooling network topologies with waste heat recovery
Network topology greatly influences both the economic and environmental performance of fifth generation district heating and cooling (5GDHC) systems. In this study the optimal trade-offs between the environmental and economic performance of 5GDHC network topologies for a five-building district with waste heat recovery were explored. A life cycle assessment method was used to calculate the total life cycle CO 2 emissions (LCCO2) associated with the installation and operation of various network topologies. Twelve months of empirical data from a data center cooling system were analyzed to assess its suitability for integration into a 5GDHC system. The most suitable method for utilizing this waste heat was selected based on the ambient loop warm pipe setpoint, waste heat temperature, and district energy system configuration. A multi-objective optimization algorithm was used to select the 5GDHC network topology that provided the optimal trade-off between LCCO2 and life cycle cost (LCC). A trade-off parameter was employed to weigh the importance of each objective in the selection process. The results showed waste heat from the data center was suitable for integration into the 5GDHC system due to its availability and consistent temperature profile. When return temperatures of 25 °C or higher were available from the liquid-cooled system, direct pre-heating of the ambient loop warm pipe was found to be the most effective waste heat integration method. The selection of the network topology that provided the optimal trade-off between LCCO2 and LCC (optimal trade-off topology) was highly dependent on factors such as fuel prices, CO 2 prices, electricity CO 2 emissions factors, availability of waste heat, embodied CO 2 emissions associated with network installation and network infrastructure costs. Optimal trade-off topologies produced substantial LCCO2 reductions relative to corresponding LCC increases. LCCO2 reduction to LCC increase ratios from 5.78 to 117.79 were identified with CO 2 offset costs ranging from 4.77 to 60.08 ($/tCO 2 e).
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Hardware-in-the-Loop Evaluation of an Advanced Distributed Energy Resource Management Algorithm
This paper presents the laboratory performance evaluation of voltage regulation under a new distributed energy resource management system (DERMS) algorithm via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of a full-scale real-world distribution system from a utility partner, the DERMS software controller, and power hardware photovoltaic (PV) inverters. The new DERMS algorithm is developed based on online multi-objective optimization (OMOO) algorithms that perform fast dispatch of distributed solar PV simulated in a real-time digital simulator and real physical hardware devices. Experimental tests confirm the correct functioning of the HIL platform for evaluating controller algorithms and satisfactory voltage regulation performance of the developed OMOO algorithms.
41 EE - Solar Energy Technologies Office (EE-4S)↗
Innovations in underground hydrogen storage with multiphysics simulations, optimization, and monitoring: A review
Underground Hydrogen Storage (UHS) is a promising solution for large-scale energy storage and a critical component in advancing low-carbon energy system. Ensuring the safety and efficiency of UHS necessitates a comprehensive understanding of multiphysical interactions driven by cyclic pore fluid pressure fluctuations and coupled physicochemical processes. Here, this review examines the key geomechanical responses in UHS, including rock property variations under cyclic loading, fracture evolution and propagation, reservoir stress sensitivity, and fault stability. It also explores the impact of geochemical and microbial reactions on geomechanical characteristics. We provide an in-depth analysis of Thermal-Hydraulic-Mechanical-Chemical (THMC) coupled numerical simulations, highlighting their potential for future multi-scale modeling. Limitations of current machine learning (ML) approaches in addressing UHS challenges are highlighted, emphasizing the need for innovative ML-based methodologies. Operational strategies for hydrogen injection and production are reviewed, focusing on safety, efficiency, and economic viability. The necessity for multi-objective optimization (MOO) to balance storage efficiency, risk mitigation, and cost-effectiveness is also discussed. Current monitoring technologies are evaluated to ensure safe and efficient UHS operations. Finally, this review identifies critical knowledge gaps and underscores the importance of advancing geomechanical understanding under multiphysics-coupling. We highlight the need for ML-driven multiphysics theories, enhanced modeling techniques, and robust optimization strategies to improve UHS performance. This study serves as a comprehensive reference for future research and the large-scale implementation of UHS systems.
25 ENERGY STORAGE↗