Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Global optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

SANE: strategic autonomous non-smooth exploration for multiple optima discovery in multi-modal and non-differentiable black-box functions

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and multimodal parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, material structure image spaces, and molecular embedding spaces. Often these systems are black-boxes and time-consuming to evaluate, which resulted in strong interest towards active learning methods such as Bayesian optimization (BO). However, these systems are often noisy which make the black box function severely multi-modal and non-differentiable, where a vanilla BO can get overly focused near a single or faux optimum, deviating from the broader goal of scientific discovery. To address these limitations, here we developed Strategic Autonomous Non-Smooth Exploration (SANE) to facilitate an intelligent Bayesian optimized navigation with a proposed cost-driven probabilistic acquisition function to find multiple global and local optimal regions, avoiding the tendency to becoming trapped in a single optimum. To distinguish between a true and false optimal region due to noisy experimental measurements, a human (domain) knowledge driven dynamic surrogate gate is integrated with SANE. We implemented the gate-SANE into pre-acquired piezoresponse spectroscopy data of a ferroelectric combinatorial library with high noise levels in specific regions, and piezoresponse force microscopy (PFM) hyperspectral data. SANE demonstrated better performance than classical BO to facilitate the exploration of multiple optimal regions and thereby prioritized learning with higher coverage of scientific values in autonomous experiments. Our work showcases the potential application of this method to real-world experiments, where such combined strategic and human intervening approaches can be critical to unlocking new discoveries in autonomous research.

Biswas, Arpan [University of Tennessee, Knoxville,↗

Mapping the global distribution of C 4 vegetation using observations and optimality theory

Plants with the C 4 photosynthesis pathway typically respond to climate change differently from more common C 3 -type plants, due to their distinct anatomical and biochemical characteristics. These different responses are expected to drive changes in global C 4 and C 3 vegetation distributions. However, current C 4 vegetation distribution models may not predict this response as they do not capture multiple interacting factors and often lack observational constraints. Here, we used global observations of plant photosynthetic pathways, satellite remote sensing, and photosynthetic optimality theory to produce an observation-constrained global map of C 4 vegetation. We find that global C 4 vegetation coverage decreased from 17.7% to 17.1% of the land surface during 2001 to 2019. This was the net result of a reduction in C 4 natural grass cover due to elevated CO 2 favoring C 3 -type photosynthesis, and an increase in C 4 crop cover, mainly from corn (maize) expansion. Using an emergent constraint approach, we estimated that C 4 vegetation contributed 19.5% of global photosynthetic carbon assimilation, a value within the range of previous estimates (18–23%) but higher than the ensemble mean of dynamic global vegetation models (14 ± 13%; mean ± one standard deviation). Our study sheds insight on the critical and underappreciated role of C 4 plants in the contemporary global carbon cycle.

54 ENVIRONMENTAL SCIENCES↗

MOOSE ProbML: Parallelizable Probabilistic Machine Learning and Uncertainty Quantification Capabilities

The Multiphysics Object Oriented Simulation Environment (MOOSE) is a widely used open- source finite element software for performing multiphysics multiscale simulations in a massively parallel fashion. Recently, the computational team at Idaho National Laboratory (INL) has implemented Probabilistic Machine Learning (ProbML) capabilities in MOOSE—in a parallelized fashion—and enable active learning with large-scale computational models for tasks such as surrogate model development, scale bridging, forward/inverse uncertainty quantification (UQ), Bayesian optimization, etc. This presentation summarizes these developments in MOOSE along with demonstrations on several real applications relevant to nuclear energy. At the fundamental level, samplers like Monte Carlo/Latin Hypercube, variance reduction, parallelized Markov Chain Monte Carlo (MCMC) support uncertainty propagation in both forward and inverse settings. These samplers can be integrated with the Gaussian processes (GP) suite in MOOSE, which offer several variants like scalar GPs, multi-output GPs, and deep GPs, to enable active learning. These GPs can be tuned using gradient-based optimization methods like Adam and its variants or gradient-free methods like the elliptical slice sampler (a variant of MCMC adept under Gaussian settings) for more complex covariance kernels or likelihoods whose gradient computations can be cumbersome. A variety of batch acquisition functions permit parallelized evaluation of the computational model and support different learning objectives with high efficiency like Bayesian inference, global surrogate development, optimization, etc. Furthermore, libtorch integration supports training, evaluation, and re-training of neural networks and other complex machine learning models in active learning settings. The impacts of these developments are shown on several real applications: (1) nuclear fuel inverse UQ and model inadequacy assessment using the Kennedy O’Hagan framework; (2) uncertainty aware surrogate modeling for additive manufacturing to predict field quantities; (3) nuclear reactor rare events analysis; and (4) complex fluid flow prediction using a global surrogate with quantified prediction uncertainty. Finally, the outlook of MOOSE ProbML is discussed for both outer-loop and inner-loop computations in the broad view to accelerate fuels and materials qualification, address gaps in knowledge and data, and assess new reactor/fuel systems.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development of a hybrid neural network and transfer learning model for optimized ICP-MS/MS operation

Correct function and calibration of instrumentation is a crucial assumption for any scientific experiment. One such instrument, tandem inductively coupled plasma mass spectrometer (ICP-MS/MS), has in-depth calibration settings that range across 30+ different parameters, making it difficult to determine optimal conditions without expertise and some degree of trial and error. Often, these settings are hand-tuned, a time-intensive process prone to local maxima and human error. While some automation is available, the automation also may favor local optimizations over a global optimum. In addition to these difficulties, day to day instrument variability can further complicate the calibration process. We propose a solution to this problem as a machine learning (ML) algorithm that learns how each parameter helps determine the calibration sensitivity across several elements, and re-weights parameters over time as instrument variability changes (e.g., a global neural network (NN) with a time-dependent transfer learning (TL) component). This model would be able to generate a surface of predicted calibration sensitivities and their respective parameters, and a simple multivariate algorithm would be able to pull out the optimum results with the settings associated with them. Here-in, we describe our initial findings in working towards this goal, including data extraction from historical files, exploratory data analysis, and some initial model building to better describe the data and the feasibility of our goal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Abstract for CRADA among NETL, Mälardalen University, University College Cork (acting through its Tyndall National Institute), and Micro Electricity Generation Association

GeoCoHorT aims to accelerate the transition to 4 th generation district heating and cooling (4GDHC) in Europe and globally, by assessing, optimizing, and demonstrating the integration of shallow geothermal heat extraction with other renewable sources and smart buildings. The target geo-source is ground water from River Shannon (Limerick, Ireland), which will provide both an efficiency and noise-reduction benefit to the micro-district and a method of combatting climate-change-warming of the Shannon Estuary. The heat from this low-temperature source will be recycled and supplied to a smart district located in Limerick, Ireland, through heat pumps powered by renewable electricity and by means of a suitable DH network design. The mandate is to find solutions that work for entire communities in a fair and sustainable manner, with the involvement of the communities themselves to highlight their needs. The project brings together four partners from Ireland, Sweden, and the U.S.A. with strong multi-disciplinary competencies. The Tyndall Institute at University of Cork (UCC) and Mälardalen University (MDU) will design and optimize the 4GDH micro-district system, and the Micro Electricity Generation Association (MEGA) will work with the community to build a sense of ownership of the Climate Challenge and ensure close community involvement. The National Energy Technology Laboratory of the U.S. Department of Energy (NETL) will design the prospective geo-fluid loop to optimize heat-extraction effectiveness with ecological safety and assess the environmental benefits of the proposed solutions. Industrial advisors (Eskilstuna Strängnäs Energi och Miljö (ESEM) and Mimer in Sweden, and Smart MPOWER in Ireland) will steer the technology development to meet the needs of public utilities and consumers. Current infrastructure in the smart district in Limerick (demonstration site of an EU Lighthouse project) will be exploited and modified with support of MEGA, UCC, and MPOWER to integrate micro-DH from low-temperature heat sources, such as the river heat, and to allow increasing penetration of prosumers in the grid. Additional case studies will be developed with the help of industrial advisors to extend the results to other regions (e.g., Sweden and USA) and provide valuable insights for the development of 4GDH worldwide.

15 GEOTHERMAL ENERGY↗

Modeling and Characterization of Surface Discharges in Insulating Material for Spacers: Electrode Shape, Discharge Mode, and Revision of the Creepage Concept

In the design of MV AC and DC spacers, the predominant factors are surface and interface conditions. Design is generally carried out on specifications and standards which are based on long-term experience and lab testing. However, the diffusion of power electronics with a trend to increase electric field, switching frequency, and rise time to achieve higher power density calls for an innovative, global approach to optimized insulation system design. A new methodology, based on field simulation, discharge modeling, and partial discharge inception measurements, called the three-leg approach, can form the basis to optimize insulation design for any type of supply voltage waveform. This paper focuses on the influence of the type of electrode on the inception and phenomenology of surface discharges and, as a consequence, on the interpretation of the results used for application of the three-leg approach. It is demonstrated that a typical electrode system used for insulating material testing can generate both gas and surface discharges at the triple point, when the electrodes have a smooth profile that is used to avoid corona or flashover. Hence, testing partial discharge may not provide a straightforward indication of the surface discharge inception and, thus, be partially misleading for insulation design. Another takeover is that such analysis must benefit from PD testing tools endowed with analytics able to provide automatic identification of the type of defect generating PD, i.e., internal, surface, and corona, since design and remedy actions can be taken, and adequate insulating materials developed, only knowing the type of source generating PD. Hence, testing partial discharge may not provide a straightforward indication of surface discharge inception and, thus, be partially misleading for insulation design. In addition to the importance of the three-leg approach to favor reliable and optimized design of insulation systems, there is a clear need to have a PD testing tool endowed with analytics. It should preferably be able to provide automatic identification of the type of defect generating PD, i.e., internal, surface, and corona.

36 MATERIALS SCIENCE↗

Kinetics Modeling and Reactor Design Study of Glucose-to-Terpenes Cell-Free Conversion

Cell-free systems offer many advantages over traditional biological conversion by eliminating biological growth constraints. It also offers easy manipulation and finetuning of the reaction conditions for each individual enzyme. The conversion of cellulosic glucose to Limonene, a terpene, is a promising pathway for producing fuels and chemicals. Recent advances in developing cell-free systems focuses on bench scale optimization of terpene yield and to demonstrate its feasibility towards commercialization [1,2]. There is significant knowledge gap regarding reaction kinetics of these cell-free systems to further study how it will perform at larger scale. We present here, our studies on reaction kinetics and reactor design implications of cell-free glucose to Limonene conversion to facilitate the further development and commercialization of this process. We developed a novel kinetic model based on the metabolic-network structure of the cell-free system with multi-substrate reversible Michaelis-Menten rate law. To estimate kinetic parameters for this system of rate equations, we employed Bayesian optimization to perform global search with the assistance of gaussian processes to balance exploration and exploitation. The model parameters estimated showed good results compared with experimental data. The estimated parameters were used to perform sensitivity analysis. We found that Hexokinase is one of the most critical enzymes that affect the conversion of the glucose. We also observed that abundance of co-factors is also critical to the conversion of glucose to limonene. We investigated packed bed reactors with enzymes immobilized on the surface of particles to convert glucose stream into Limonene for larger scale production. The reactor design such as particle size, enzyme loading, and flow rate are found to be critical for improving yields. [1] Dudley, Q.M., Nash, C.J. and Jewett, M.C., 2019. Synthetic Biology, 4(1), p.ysz003. [2] Korman, T.P., Opgenorth, P.H. and Bowie, J.U., 2017. Nature communications, 8(1), p.15526.

09 BIOMASS FUELS↗

Adaptive learning-driven high-throughput synthesis of oxygen reduction reaction Fe–N–C electrocatalysts

Reducing human reliance on inefficient energy systems and fossil fuels has become more urgent due to the consequences of global climate change. However, traditional trial-and-error approaches have hampered our ability to accelerate the discovery and implementation of functional materials for efficient energy conversion devices, such as polymer electrolyte fuel cells (PEFCs). To address this, we develop an adaptive learning framework that integrates machine learning and state-of-the-art capabilities in high-throughput synthesis to achieve expedited optimization of iron-nitrogen-carbon PEFC oxygen reduction reaction (ORR) electrocatalysts. We use statistical inference, uncertainty quantification, and global optimization to build a computational design-of-experiment tool that identifies the optimum compositions to be investigated next to reduce the demands placed on experimental materials discovery. We benchmark the ability of the proposed strategy to discover optimum catalyst synthesis conditions in a six-dimensional search space when starting with a thirty-six-sample database. By following the adaptive learning strategy, we synthesize fourteen new catalysts from approximately ten billion unique compositions and discover four catalysts that outperform all original samples. The best machine learning-optimized catalyst is 33% more active than the highest-performing one in the initial database, showing an ORR activity seven times larger than those typically reported for the same class of materials.

36 MATERIALS SCIENCE↗

Optimization of distributed compute resources utilization in the CMS Global Pool

The CMS Submission Infrastructure is the primary system for managing computing resources for CMS workflows, including data processing, simulation, and analysis. It integrates geographically distributed resources from Grid, HPC, and cloud providers into federated pools managed by HTCondor and Glidein- WMS, for a total of around 500k CPU cores. This system dynamically manages workloads based on priorities defined by the collaboration. Additionally, CMS scheduling strategies must be flexible to handle multiple concurrent workloads while considering changing processing demands and resource availability from various providers.Efficient utilization of vast amounts of distributed compute resources is a key element for the success of the scientific programs of the LHC experiments. Optimizing the system is essential to maximize resource efficiency and fully utilize the distributed computing power. The CMS Submission Infrastructure team thus systematically investigates sources of inefficiency in workload scheduling to reduce their impact. In addition, a strategy of pilot overloading has been introduced to compensate for other inefficiency sources, thereby optimizing resource utilization and enhancing computational throughput.

Mascheroni, Marco [UC, San Diego (main)]↗

PRO-X Transportation Global Landscape

The Proliferation Resistance Optimization (PRO-X) program is actively supporting the design of new-build nuclear systems by identifying intrinsic characteristics or design choices to minimize the potential for diversion or production of weapons-usable nuclear material. The PRO-X program looks to optimize the safety, security, and performance of the fuel cycle infrastructure for a wide array of reactor types, including research reactors, small modular reactors (SMRs), and large advanced reactors (ARs).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Modeling noise in global Mølmer-Sørensen interactions applied to quantum approximate optimization

Many-qubit Mølmer-Sørensen (MS) interactions applied to trapped ions offer unique capabilities for quantum information processing, with applications including quantum simulation and the quantum approximate optimization algorithm (QAOA). Here, we develop a physical model to describe many-qubit MS interactions under four sources of experimental noise: vibrational mode frequency fluctuations, laser power fluctuations, thermal initial vibrational states, and state preparation and measurement errors. The model parametrizes these errors from simple experimental measurements, without free parameters. Herein, we validate the model in comparison with experiments that implement sequences of MS interactions on two 171 Yb + ions. The model shows reasonable agreement after several MS interactions as quantified by the reduced chi-squared statistic $χ^{2}_{red}$≈2. As an application we examine MaxCut QAOA experiments on three and six ions. The experimental performance is quantified by approximation ratios that are 91% and 83% of the optimal theoretical values. Our model predicts $0.93^{+0.03}_{-0.02}$ and $0.95^{+0.04}_{-0.03}$, respectively, with disagreement in the latter value attributable to secondary noise sources beyond those considered in our analysis. With realistic experimental improvements to reduce measurement error and radial trap frequency variations, the model achieves approximation ratios that are 99% of the optimal. Incorporating these improvements into future experiments is expected to reveal new aspects of noise for future modeling and experimental improvements.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enabling Real-time Scattering Data Analysis with Scalable Optimization [Slides]

Diffraction experiments produce datasets with rich multidimensional physics information such as microstructure, equations of state, crystal structure, elastoplastic properties, and other key inputs to LANL mission-essential multiphysics models. This information is typically extracted through a process called Rietveld refinement, which involves selecting appropriate models of the instrument, crystal structure, and microstructure, identifying suitable starting values, and then fitting often hundreds of model parameters using a sequence of empirical parameter turnon/off sequences within a non-global gradient-based optimization. Extensive user expertise is required to properly setup a refinement, identify appropriate models, and select initial parameter values close to truth, such that the refinement will yield parameter values that are optimally predictive. This is a very tedious manual process performed far after the beamline campaign has ended. As facilities have become capable of generating larger volumes of data, the limitation in throughput due to Rietveld refinement has led to a dramatic increase in unanalyzed data as opposed to an intended increase in new science. In our FY22 TED, we demonstrated an integrated toolset providing near real-time automated Rietveld analysis. If this toolset can be optimized to provide automated Rietveld analysis in real-time, this could alleviate the bottleneck in unanalyzed diffraction data, aid in decision-making during experiments, and increase efficiency of the facility.

74 ATOMIC AND MOLECULAR PHYSICS↗

Microgrid energy scheduling under uncertain extreme weather: Adaptation from parallelized reinforcement learning agents

Microgrids are useful solutions for integrating renewable energy resources and providing seamless green electricity to minimize carbon footprint. In recent years, extreme weather events happened often worldwide and caused significant economic and societal losses. Such events bring uncertainties to the microgrid energy scheduling problems and increase the challenges of microgrid operation. Traditional optimization approaches suffer from the inaccuracy of the uncertain microgrid model and the unseen events. Existing reinforcement learning (RL) - based approaches are also hampered by the limited generalization and the increasing computational burden when stochastic formulations are required to accommodate the uncertainties. This paper proposes a new parallelized reinforcement learning (PRL) method based on the probabilistic events to handle the microgrid energy uncertainties. Specifically, several local learning agents are employed to interact with pertinent microgrid environments in a distributed manner and report outcomes to the global agent, which will optimize microgrid energy resources online during extreme events. The stochastic microgrid energy optimization problem is reformulated to include all possible scenarios with probabilities. The advantage estimate functions of learning agents are designed with a backward sweep to transfer the outcomes to the value function updating process. Two simulation studies, stochastic optimization and online testing, are performed to compare with several existing RL approaches. Results substantiate that the proposed PRL method can achieve up to 20% optimization performance improvement with 4 and 28 times less computation cost than Q-learning with experience replay and multi-agent Q-learning approaches, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Core Design Optimization of the Westinghouse Lead Fast Reactor

Westinghouse is pursuing an advanced Nuclear Power Plant design based on Lead Fast Reactor (LFR) technology for global commercialization. To achieve an optimal combination of key attributes, such as safety, sustainability, and economic competitiveness, Westinghouse and ANL partnered in developing and applying a formalized core design optimization strategy. An LFR analysis workflow was developed to automate a suite of reactor physics, fuels performance, safety, and economics simulations on a selected LFR concept. The workflow streamlines analysis of a wide range of LFR designs with different dimensions and fuel types to assess their viability and economic performance, significantly reducing human processing time and risks of processing errors. The LFR optimization exercise was defined, resulting in selection of the design constraints (geometric, neutronics, thermo-mechanical, safety, thermal-hydraulics, and economics) and performance metrics researched (minimization of both the fuels LCOE and the first core inventory cost). A total of 14 varied design parameters were considered, including assembly dimensions, coolant temperature, and enrichment distribution throughout the core. The LFR analysis workflow was connected to DAKOTA for sensitivity and optimization analyses. Due to the extremely large size of the potential LFR optimization solution space relative to the computing time required to characterize one LFR solution, a multi-stage optimization approach was proposed to breakdown the problem into several stages with more reasonable sizes. This optimization approach enabled finding various viable core solutions with different cost tradeoffs that were considered by Westinghouse and justify selection of a smaller core with multi-batch 2-year cycle length.

Stauff, Nicolas E.↗

Orthogonal glycolytic pathway enables directed evolution of noncanonical cofactor oxidase

Abstract Noncanonical cofactor biomimetics (NCBs) such as nicotinamide mononucleotide (NMN + ) provide enhanced scalability for biomanufacturing. However, engineering enzymes to accept NCBs is difficult. Here, we establish a growth selection platform to evolve enzymes to utilize NMN + -based reducing power. This is based on an orthogonal, NMN + -dependent glycolytic pathway in Escherichia coli which can be coupled to any reciprocal enzyme to recycle the ensuing reduced NMN + . With a throughput of >10 6 variants per iteration, the growth selection discovers a Lactobacillus pentosus NADH oxidase variant with ~10-fold increase in NMNH catalytic efficiency and enhanced activity for other NCBs. Molecular modeling and experimental validation suggest that instead of directly contacting NCBs, the mutations optimize the enzyme’s global conformational dynamics to resemble the WT with the native cofactor bound. Restoring the enzyme’s access to catalytically competent conformation states via deep navigation of protein sequence space with high-throughput evolution provides a universal route to engineer NCB-dependent enzymes.

59 BASIC BIOLOGICAL SCIENCES↗

Optimization of the Second Target Station cold source moderators using an automated workflow

The Second Target Station (STS) at the US Department of Energy’s Oak Ridge National Laboratory is designed to become the world’s highest peak-brightness spallation source of cold neutrons. Successful completion of the STS, which is currently in the preliminary design phase, will provide transformative new capabilities to examine novel materials for future technologies. At STS, neutrons will be generated by spallation reactions in a solid tungsten target. They will be moderated and thermalized in two cold (20 K) para-hydrogen moderators. Careful optimization of these moderators is essential to the project’s success. To find optimal moderator designs, an advanced optimization workflow integrates high-fidelity neutronics calculations using the Monte Carlo N-Particle (MCNP) transport code MCNP6.2 with state-of-the-art optimization algorithms in the Dakota optimization toolkit. For each design iteration, a parametrized solid CAD geometry is generated in Creo and automatically converted into an unstructured mesh geometry by Attila 4MC for the neutronics calculation with MCNP. Iterations repeat until optimal designs are found. Herein this paper presents the results of a sensitivity and optimization study for the cylindrical and tube moderators. Both moderators can be optimized for maximum peak brightness, maximum time-integrated brightness, or any combination between these extremes. Maximum peak brightness is achieved by using smaller optimal dimensions of the moderators, whereas maximum time-integrated brightness is achieved by using larger dimensions. A Pareto front details the designs that optimally balance both brightness metrics. The Pareto front can be found in only 40–110 iterations with 4–5 design parameters when using the efficient global and Pareto-set optimization algorithms in Dakota. Additionally, important engineering constraints can be taken into account, such as the coupling between the cylindrical moderator radius and aluminum vessel wall thicknesses required to ensure structural integrity of the vessels. This interaction has a significant impact on the resulting optimal designs. Our new, highly efficient, fully automated optimization workflow will be used to optimize additional STS components in the future and can be adopted for design and optimization studies at other experimental neutron and accelerator facilities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

LandScan Mosaic Time Series Version 1.0: 1975-2024

The LandScan Mosaic Annual Global Ambient Population Time Series, Version 1.0, provides annual high-resolution global ambient population estimates from 1975 to 2024. The dataset is distributed as one Cloud-Optimized GeoTIFF per year on a globally aligned 3 arc-second WGS 84 grid. The 2024 layer is the LandScan Mosaic benchmark reference year, while the 1975–2023 layers are historical estimates generated using the LandCast backcasting framework.

Zimmer, Andrew [ORNL] (ORCID:0000000176838713)↗