Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Continuous Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Machine learning framework for quantum sampling of highly constrained, continuous optimization problems

In recent years, there is growing interest in using quantum computers for solving combinatorial optimization problems. In this work, we developed a generic, machine learning-based framework for mapping continuous-space inverse design problems into surrogate quadratic unconstrained binary optimization (QUBO) problems by employing a binary variational autoencoder and a factorization machine. The factorization machine is trained as a low-dimensional, binary surrogate model for the continuous design space and sampled using various QUBO samplers. Using the D-Wave Advantage hybrid sampler and simulated annealing, we demonstrate that by repeated resampling and retraining of the factorization machine, our framework finds designs that exhibit figures of merit exceeding those of its training set. We showcase the framework’s performance on two inverse design problems by optimizing (i) thermal emitter topologies for thermophotovoltaic applications and (ii) diffractive meta-gratings for highly efficient beam steering. This technique can be further scaled to leverage future developments in quantum optimization to solve advanced inverse design problems for science and engineering applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Improved stellarator permanent magnet designs through combined discrete and continuous optimizations

A common optimization problem in the areas of magnetized plasmas and fusion energy is the design of magnets to produce a given three-dimensional magnetic field distribution to high precision. When designing arrays of permanent magnets for stellarator plasma confinement, such problems have tens of thousands of degrees of freedom whose solutions, for practical reasons, should be constrained to discrete spaces. We perform a direct comparison between two algorithms that have been developed previously for this purpose, and demonstrate that composite procedures that apply both algorithms in sequence can produce substantially improved results. One approach uses a continuous, quasi-Newton procedure to optimize the dipole moments of a set of magnets and then projects the solution onto a discrete space. The second uses an inherently discrete greedy optimization procedure that has been enhanced and generalized for this work. Further, the approaches are both applied to design arrays cubic rare-Earth permanent magnets to confine a quasi-axisymmetric plasma with a magnetic field on axis of 0.5 T. The first approach tends to find solutions with higher field accuracy, whereas the second can find solutions with substantially (up to 30%) fewer magnets. When the approaches are combined, they can obtain solutions with magnet quantities comparable to the second approach while matching the field accuracy of the first.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quantum computing based hybrid solution strategies for large-scale discrete-continuous optimization problems

Technologies for a quantum/classical hybrid approach to solving optimization problems is disclosed. In the illustrative embodiment, an optimization problem is decomposed into two sub-problems. The first sub-problem is solved on a classical computer, and a result from the first sub-problem is provided to a quantum computer. The quantum computer then solves the second sub-problem based on the result of the first sub-problem from the classical computer. The quantum computer can then provide a result to the classical computer to re-solve the first problem. The iterative calculation is continued until an end condition is met.

You, Fengqi↗

Development of a Multi-physics Model to Optimize Continuous Liquid Interface Production (CLIP) for Additive Manufacturing (Carbon3D HPC4Mfg Final Report)

Continuous Liquid Interface Production (CLIP) is poised to bring additive manufacturing to multiple American manufacturing sectors owing to its unique combination of rapid print speeds and material options that resemble injection molding thermoplastics. In spite of these benefits, CLIP is still a maturing process. To improve our understanding and control of the process, this project developed a multi-physics computational model that encompasses the coupled chemical-physical processes of photopolymerization and fluid flow to predict part outcomes. A physically predictive model can enable rapid optimization of CLIP and reduce the current cycle time and waste associated with optimization by four-fold. Ultimately, this effort will help open the U.S. $400B plastic manufacturing industry to the key benefits of additive manufacturing, namely mass customization, unlimited design space, and a cost- and energy-effective path to mainstream manufacturing. In the course of the project we produced a model which coupled fluid-flow, species transport, and photochemistry to model the Carbon CLIP process. As the development proceeded, we validated the code against theory and experiments. The resulting code was transferred to Carbon, and we expect it to be a useful part of their modeling capability. Future work includes improvements to the fluid solver’s robustness and performance, along with the addition of additional physics models.

36 MATERIALS SCIENCE↗

Quantum computing based hybrid solution strategies for large-scale discrete-continuous optimization problems

Quantum computing (QC) has gained popularity due to its unique capabilities that are quite different from that of classical computers in terms of speed and methods of operations. This paper proposes hybrid models and methods that effectively leverage the complementary strengths of deterministic algorithms and QC techniques to overcome combinatorial complexity for solving large-scale mixed-integer programming problems. Four applications, namely the molecular conformation problem, job-shop scheduling problem, manufacturing cell formation problem, and the vehicle routing problem, are specifically addressed. Large-scale instances of these application problems across multiple scales ranging from molecular design to logistics optimization are computationally challenging for deterministic optimization algorithms on classical computers. To address the computational challenges, hybrid QC-based algorithms are proposed and extensive computational experimental results are presented to demonstrate their applicability and efficiency. The proposed QC-based solution strategies enjoy high computational efficiency in terms of solution quality and computation time, by utilizing the unique features of both classical and quantum computers.

97 MATHEMATICS AND COMPUTING↗

Tri-level hybrid interval-stochastic optimal scheduling for flexible residential loads under GAN-assisted multiple uncertainties

Various building loads, such as heating, ventilation, and air conditioners (HVACs), electric water heaters (EWHs), and electric vehicles (EVs), can introduce opportunities for improving the flexibility of electricity consumption while satisfying the needs of building owners as well as benefiting the resilience of distribution system. To utilize such flexibility, a tri-level distribution market framework is established, including residential consumers, load aggregators (LAs), and the distribution system operator (DSO). In this work, the uncertainties from all three levels are considered. The random consumption behavior at the consumer level is modeled as a Gaussian noise that is also aggregated and transmitted to the LA level. The weather temperature in the LA level is forecasted as an interval, and the photovoltaic (PV) power in the market-clearing level is modeled by a set of power scenarios generated by Generative Adversarial Networks (GANs). Then, a hybrid interval-stochastic programming is proposed to transform the uncertain problems in the first two levels into deterministic ones. For real-time implementations, a rolling horizon optimization (RHO) scheme is employed to continuously optimize the power consumption based on the latest operating information. Finally, case studies on a modified IEEE 69-bus system validate the effectiveness of the proposed uncertainty modeling strategies and the RHO scheme.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Approximating a linear multiplicative objective in watershed management optimization

Implementing management practices in a cost-efficient manner is critical for regional efforts to reduce the amount of pollutants entering the Chesapeake Bay. We study the problem of selecting a subset of practices that minimizes pollutant load—subject to budgetary and environmental constraints—as simulated in a widely used regulatory watershed model. Mimicking the computation of pollutant load in the regulatory model, we formulate this problem as a continuous optimization model with a linear multiplicative objective function and linear constraints. To lay the groundwork for incorporating additional stakeholder requirements in the future, especially those that would require integer variables, we present and study a continuous linear optimization model that approximates the nonlinear model. The linear model, which requires an exponential number of variables, arises naturally as an alternative model for the same underlying physical process. We examine the theoretical behavior of these optimization models and investigate restrictions of the linear model to handle its large number of variables. Through extensive computational tests on real and randomly generated instances, we demonstrate that the linear model and its restrictions provide optimal solutions close to those of the nonlinear model in practice, despite poor approximation properties in the worst case. We conclude that the linear model—together with our approach to handling its large number of variables—provides a viable framework from which to extend the optimization model to better meet the needs of the Chesapeake Bay watershed management stakeholders.

54 ENVIRONMENTAL SCIENCES↗

Reducing measurement costs by recycling the Hessian in adaptive variational quantum algorithms

Abstract Adaptive protocols enable the construction of more efficient state preparation circuits in variational quantum algorithms (VQAs) by utilizing data obtained from the quantum processor during the execution of the algorithm. This idea originated with Adaptive Derivative-Assembled Problem-Tailored variational quantum eigensolver (ADAPT-VQE), an algorithm that iteratively grows the state preparation circuit operator by operator, with each new operator accompanied by a new variational parameter, and where all parameters acquired thus far are optimized in each iteration. In ADAPT-VQE and other adaptive VQAs that followed it, it has been shown that initializing parameters to their optimal values from the previous iteration speeds up convergence and avoids shallow local traps in the parameter landscape. However, no other data from the optimization performed at one iteration is carried over to the next. In this work, we propose an improved quasi-Newton optimization protocol specifically tailored to adaptive VQAs. The distinctive feature in our proposal is that approximate second derivatives of the cost function are recycled across iterations in addition to optimal parameter values. We implement a quasi-Newton optimizer where an approximation to the inverse Hessian matrix is continuously built and grown across the iterations of an adaptive VQA. The resulting algorithm has the flavor of a continuous optimization where the dimension of the search space is augmented when the gradient norm falls below a given threshold. We show that this inter-optimization exchange of second-order information leads the approximate Hessian in the state of the optimizer to be consistently closer to the exact Hessian. As a result, our method achieves a superlinear convergence rate even in situations where the typical implementation of a quasi-Newton optimizer converges only linearly. Our protocol decreases the measurement costs in implementing adaptive VQAs on quantum hardware as well as the runtime of their classical simulation.

Ramôa, Mafalda (ORCID:0000000302187801)↗

Annual report for DOE VTO

Carbon fiber (CF)/polymer composites are a transformative class of high-performance, lightweight material, where high aspect-ratio CFs reinforce a polymer matrix and exceed the strength of steel alloys at a fraction of the density. Despite the advantages of such a class of material, the broader implementation of CF composites in a range of automotive, aerospace, and energy applications is hindered by limitations of current manufacturing methods. These current techniques (e.g., hand lay-up, wet filament winding) are costly and impose severe limitations on fiber placement, orientation, and angle, and thus a composite’s ultimate properties. Today’s CF composites are expensive to manufacture, limited in form factor, and utilize costly and sub-optimal continuous filament CF. Advanced additive manufacturing (AM) processes, combined with computational design optimization and new approaches to resin development, offer alternative design and manufacturing paradigms that have the realistic potential to lift these constraints. Such integrated AM approaches could thus help to realize the full potential of CF composite materials. One relevant application of CF composite materials where manufacturing constraints limit the cost-benefit ratio is in the manufacture of high-performance composite pressure vessels for onboard compressed natural gas (CNG) storage. Current CNG storage vessels (Types 3–5) are made from load-bearing filament-wound carbon-fiber composite and are ~3.5 times as expensive as an all-metallic Type-1 vessel. This cost is invariably tied to the complex and labor-intensive nature of conventional filament winding processes and the large volumes of expensive high tensile-strength CF tow feedstock required in manufacture. Our proposed approach to CNG storage vessel manufacture is based on a combination of AM technologies for CF composite printing and design optimization tools that were pioneered at Lawrence Livermore National Laboratory (LLNL), with advances in resin/composite formulation enabled by chemical and nano-material modification. Through the successful development of this technology, LLNL seeks to demonstrate the capability for advanced CNG storage vessel manufacture at reduced cost with no reduction in performance versus the most advanced, extant Type-5 designs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Seamlessly Fuel Flexible Heat Pump with Optimal Model-based Control Strategies to Reduce Peak Demand, Utility Cost and CO2 Emission

This research develops a novel hybrid fuel heat pump system for space heating of residential and small commercial buildings with built-in optimization and control. Whereas conventional dual fuel systems either run on gas or electricity at any given moment, the proposed seamlessly fuel flexible heat pump (SFFHP) simultaneously consumes gas and electricity and continuously optimizes the proportion of each. The building air flows across the heat pump condenser first and then flows across the furnace coil, and this reduces the heat pump temperature lift. The SFFHP delivers energy savings by allowing each subsystem (gas furnace and electric heat pump) to operate where it performs best to improve energy efficiency, minimize energy cost, and minimize carbon footprint. The capacities of the electric heat pump and gas furnace are continuously adjusted based on ambient conditions, utility price signals, and marginal grid emission signals. An optimal model predictive control strategy was developed with the goal of minimizing utility cost and minimizing CO2 emission. Two case studies were conducted to simulate the performance of SFFHP during the heating season in Chicago and Los Angeles, respectively. Compared with a conventional electric heat pump, SFFHP yields 33% utility cost reduction and 49% CO2 emission reduction in Chicago. Similarly, it achieves 23% utility cost reduction and 17% CO2 emission reduction in Los Angeles. Case studies demonstrate that SFFHP can deliver significant reductions in peak demand, utility cost, and CO2 emission. Due to the hybrid fuel nature of this novel equipment, user comfort will always be maintained. The fuel flexibility makes it an attractive option for demand response programs.

Li, Zhenning↗

Resilient Design of Continuous-time Distributed Optimization Algorithm in the Presence of Cyber-attacks

This paper presents a continuous-time resilient distributed optimization algorithm based on competitive interaction design method on connected graphs in the presence of adversaries. Here, the competitive interaction method allows us to design a network that protects the multi-agent systems from adversaries without requiring high network connectivity. In addition, the proposed algorithm does not require the global information about the number of adversaries. First, we show that the proposed distributed algorithm solves the resilient distributed optimization problem with no attack on the communication links. Second, we show that the proposed continuous-time distributed optimization algorithm on connected graphs converges to the small neighborhood of the optimal solution in the presence of cyber-attacks onto the communication channel. Simulations are presented to illustrate our theoretical results.

97 MATHEMATICS AND COMPUTING↗

Not so HOT Triangulations

Here, we propose primal–dual mesh optimization algorithms that overcome shortcomings of the standard algorithm while retaining some of its desirable features. “Hodge-Optimized Triangulations” defines the “HOT energy” as a bound on the discretization error of the diagonalized Delaunay Hodge star operator. HOT energy is a natural choice for an objective function, but unstable for both mathematical and algorithmic reasons: it has minima for collapsed edges, and its extrapolation to non-regular triangulations is inaccurate and has unbounded minima. We propose a different extrapolation with a stronger theoretical foundation, and avoid extrapolation by recalculating the objective just beyond the flip threshold. We propose new objectives, based on normalizations of the HOT energy, with barriers to edge collapses and other undesirable configurations. We propose mesh improvement algorithms coupling these. When HOT optimization nearly collapses an edge, we actually collapse the edge. Otherwise, we use the barrier objective to update positions and weights and remove vertices. By combining discrete connectivity changes with continuous optimization, we more fully explore the space of possible meshes and obtain higher quality solutions.

97 MATHEMATICS AND COMPUTING↗

Port and optimize the CEED software stack to Aurora/Frontier EA (ECP Milestone Report)

The goal of this milestone was to port the CEED software stack, including Nek, MFEM and libCEED to the Frontier and Aurora early access hardware, work on optimizing the performance on AMD and Intel GPUs, and demonstrate impact in CEED-enabled ECP applications. As part of this milestone, we also performed a number of other activities, including continued optimizations for CEED applications at scale on Summit, performance evaluation on non-ECP hardware, including the Fugaku’s A64FX chip and the NVIDIA A100 GPU architecture, exploring the use of just-in-time compilations in applications at scale and potential of mixed precision optimizations in the CEED discretization and solver algorithms, and more. During the milestone period, the CEED team released new versions of 6 of its packages, including major releases of MFEM, NekRS and OCCA. We also organized the fifth CEED Annual meeting (CEED5AM) which included nearly 100 researchers from national labs, universities and industry.

97 MATHEMATICS AND COMPUTING↗

DOE Bioenergy Technologies Office (BETO) 2023 Project Peer Review: WBS 2.4.1.100 Bench Scale Research & Development

Bench Scale Integration develops and optimizes fermentation processes to produce bio-based fuels and chemicals for commercial scale-up. The project uses fermentation science to achieve high titers and production rates by, for example, manipulating how the microorganisms are fed biomass sugars and nutrients, modifying fermentation conditions (pH, temperature, aeration) or developing online control strategies for better fermentation operations and high titer, rates, and yield (TRY). For this period of performance, we continued our development of a commercial-ready 2,3-butanediol (BDO) fermentation from biomass sugars utilizing NREL's proprietary Zymomonas mobilis microorganism. The engineered Z. mobilis can use all the main sugars in corn stover biomass, which are glucose, xylose, and arabinose. BDO is a versatile, low-carbon chemical which can be catalytically upgraded to a variety of hydrocarbon fuels and chemicals. The project had three goals during this review period; evaluate the technical feasibility of using whole slurry pretreated corn stover to achieve the techno-economic analysis (TEA) performance goals, continue optimizing a liquor-based fed-batch fermentation process for high titer, and develop strategies to enable scale-up. After evaluating different iterations of a whole slurry fermentation that did not meet the TEA goals, a Go/No-Go decision was made to pivot to liquor-only with new TEA performance targets, the main one being 140 g/L titer. We successfully met this goal, producing 141 g/L BDO at 1 g/L-hr productivity and 84% process yield. This titer and productivity attracted industrial interest to scale the fermentation resulting in a Technology Commercialization Fund project award in 2022. We used an NREL developed near-infra red (NIR) spectroscopy method for rapid analysis which allowed for changes to aeration levels and sugar feeding during the fermentation to maximize BDO production. The NIR analysis can be done using a hand-held spectrometer, essentially taking the analysis on to the plant floor during scale-up and preliminary work shows the feasibility of using an online probe for continuous monitoring and control. The other scale-up tool is mapping oxygen transfer coefficient (kLa) and oxygen transfer rate (OTR) in various vessels to find conditions that match the optimized 500 mL vessels. Showing a correlation to the mapping work, which is done with water and a dissolved oxygen probe, can reduce the risk of failed fermentations during scale-up. Our end-of-project goal is to meet the design target BDO titer (140-150 g/L) from DMR corn stover liquor at 1000L or larger scale to demonstrate BDO process design case and transfer the technology to industrial fermentation stakeholders for commercialization.

2 3-butanediol↗

The Uniform Methods Project: Smart Thermostat Evaluation Protocol

A smart thermostat is an internet-connected device that controls home heating, ventilation, and air-conditioning (HVAC) equipment and can automatically adjust temperature set points to optimize performance and achieve energy savings. Smart thermostat features often include two way communication, occupancy detection (such as geofencing and occupancy sensors), schedule learning, and seasonal optimization algorithms. Smart thermostats can control most conventional HVAC systems, including central air conditioners, heat pumps, and forced air furnaces. Several types of residential utility programs offer smart thermostats as replacements measures. Working with smart thermostat vendors, utilities can offer separate optimization programs to produce energy savings beyond those achieved by installing a smart thermostat. From an evaluation perspective, smart thermostat programs have several noteworthy features. First, the energy savings from a smart thermostat may change over the life of the device. As a smart thermostat is connected to the internet, original equipment manufacturers can update the thermostat software to improve the thermostat's energy efficiency. Likewise, users can adjust the thermostat settings and schedules over time in response to changes in weather, thermal comfort, energy prices, or preferences for energy efficiency. Additionally, many thermostat manufacturers offer seasonal optimization programs that recommend changes or make minor, automated adjustments to the thermostat settings to improve energy efficiency. These opt-in programs are now standard offerings for many smart thermostat manufacturers and provided at no additional cost to users. The potential for software updates and continuous optimization and the evolving nature of user interactions mean future energy savings may differ from first-year savings and the energy savings of smart thermostats may need to be evaluated more than once. Second, smart thermostats often have small unit energy savings relative to a home's total energy consumption, especially in comparison to whole- home retrofit programs. This can make it difficult to detect the smart thermostat savings in billing or advanced metering infrastructure (AMI) meter consumption data. For example, as cooling loads in many regions average about 20% of annual electricity consumption, smart thermostat savings of 10% of cooling energy use would equate to a 2% reduction in home electricity consumption. Evaluators should use regression analysis of whole-home billing consumption or advanced metering infrastructure (AMI) meter consumption data to evaluate smart thermostat savings because, as explained at greater length below , these data are usually available to evaluators and regression can control for the impacts of weather and other potentially confounding factors on a home's energy consumption. Finally, as with other energy efficiency programs, participation in smart thermostat programs is self-selective. As discussed at greater length below , smart thermostat participants tend to be, among other things, younger, higher-income, and more likely to adopt electric vehicles (EVs) and internet connected devices than nonparticipants. These differences are often unobservable to the evaluator and correlated with a home's energy consumption, creating the potential for bias in estimating savings. Due to the small unit savings of thermostats, errors and biases from self-selection that may not be very consequential when evaluating a whole- home retrofits (e.g., ±2% of home electricity consumption) can have a major impact when evaluating the savings and cost-effectiveness of smart thermostat programs. A percentage point change in the estimated savings could affect the cost-effectiveness of a program. This means it is important for evaluators to assess and to minimize the potential for error from selection bias in estimating smart thermostat program savings. The Uniform Methods Project provides model protocols for determining energy savings and demand reductions that result from specific energy efficiency measures implemented through state and utility programs. In most cases, the measure protocols are based on a particular option identified by the International Performance Verification and Measurement Protocol ; however, this work provides a more detailed approach to implementing that option. Each chapter is written by technical experts in collaboration with their peers, reviewed by industry experts, and subject to public review and comment. The UMP protocols can be used by utilities, program administrators, public utility commissions, evaluators, and other stakeholders for both program planning and evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Discrete versus continuous: Enhancing battery optimization in capacity expansion models

This study compares two battery modeling approaches for capacity expansion models: discrete-duration and continuous-duration formulations. In the discrete approach, battery duration is fixed, and power capacity is optimized. In the continuous approach, both power and energy capacities are decision variables, allowing storage duration to be optimized endogenously. Although both discrete-duration and continuous-duration battery formulations are used in long-term power system planning models, the literature has provided limited direct, systematic comparisons of their implications within a common modeling framework. To address this gap, this study implements both approaches in the Regional Energy Deployment System (ReEDS TM ) capacity expansion model using two resource adequacy methods, across a range of future system conditions, and with varying battery cost projections. Results show continuous-duration and high-resolution discrete approaches produce similar capacity expansion outcomes. The continuous formulation achieves faster runtimes compared to discrete-duration runs with many discrete-duration options. However, the discrete-duration approach allows users to choose to have limited fidelity for storage duration options, which in some cases can outperform the continuous formulation. The continuous formulation has the lowest overall system costs, indicating its ability to fine-tune storage duration to better meet specific system needs. This study's findings provide a side-by-side evaluation of discrete and continuous battery modeling approaches and offer guidance for improving the representation of real-world systems, flexibility, and computational efficiency for representing energy storage in long-term power system planning models.

25 ENERGY STORAGE↗