Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Warm Start”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

An online replanning method using warm start optimization and aperture morphing for flattening-filter-free beams

Purpose: In a situation where a couch shift for patient positioning is not preferred or prohibited (e.g., MR-linac), segment aperture morphing (SAM) can address target dislocation and deformation. For IMRT/VMAT with flattening-filter-free (FFF) beams, however, SAM method would lead to an adverse translational dose effect due to the beam unflattening. Here the authors propose a new two-step process to address both the translational effect of FFF beams and the target deformation. Methods: The replanning method consists of an offline and an online step. The offline step is to create a series of preshifted-plans (PSPs) obtained by a so-called “warm start” optimization (starting optimization from the original plan, rather than from scratch) at a series of isocenter shifts. The PSPs all have the same number of segments with very similar shapes, since the warm start optimization only adjusts the MLC positions instead of regenerating them. In the online step, a new plan is obtained by picking the closest PSP or linearly interpolating the MLC positions and the monitor units of the closest PSPs for the shift determined from the image of the day. This two-step process is completely automated and almost instantaneous (no optimization or dose calculation needed). The previously developed SAM algorithm is then applied for daily deformation. The authors tested the method on sample prostate and pancreas cases. Results: The two-step interpolation method can account for the adverse dose effects from FFF beams, while SAM corrects for the target deformation. Plan interpolation method is effective in diminishing the unflat beam effect and may allow reducing the required number of PSPs. The whole process takes the same time as the previously reported SAM process (5–10 min). Conclusions: The new two-step method plus SAM can address both the translation effects of FFF beams and target deformation, and can be executed in full automation except the delineation of target contour required by the SAM process.

60 APPLIED LIFE SCIENCES↗

A Real-Time Optimization with Warm-Start of Multiperiod AC Optimal Power Flows

We present a real-time optimization strategy based on warm-start for solving a moving horizon of multi period AC optimal power flow (ACOPF) problems. In each horizon, ACOPFs are temporally interlinked via generator ramp constraints, and we assume that each horizon needs to be solved every few seconds or minutes. We introduce two approximate tracking schemes that closely follow a solution path consisting of strongly regular points. We present theoretical results bounding the tracking error by the square of the parameter changes between time periods. Experimental results for networks of sizes up to 9K buses show a fast computation time while maintaining a good solution quality, thus making our approach well suited for real-time circumstances.

moving horizon↗

Piecewise linear approximation with minimum number of linear segments and minimum error: A fast approach to tighten and warm start the hierarchical mixed integer formulation

In several areas of economics and engineering, it is often necessary to fit discrete data points or approximate nonlinear functions with continuous functions. Piecewise linear (PWL) functions are a convenient way to achieve this. PWL functions can be modeled in mathematical problems using only linear and integer variables. Moreover, there is a computational benefit in using PWL functions that have the least possible number of segments. This work proposes a novel hierarchical mixed integer linear programming (MILP) formulation that identifies a continuous PWL approximation with minimum number of linear segments for a given target maximum error. The proposed MILP formulation also identifies the solution with the least maximum error among the solutions with minimum number of segments. Then, this work proposes a fast iterative algorithm that identifies non necessarily continuous PWL approximations by solving O(S log N) linear programming (LP) problems, where N is the number of data points and S is the minimum number of segments in the non necessarily continuous case. This work demonstrates that tight bounds for the MILP problem can be derived from these approximations. Next, a fast algorithm is introduced to transform a non necessarily continuous PWL approximation into a continuous one. Finally, the tight bounds and the continuous PWL approximations are used to tighten and warm start the MILP problem. The tightened formulation is shown in experimental results to be more efficient, especially for large data sets, with a solution time that is up to two orders of magnitude less than the existing literature.

97 MATHEMATICS AND COMPUTING↗

Poster — Thur Eve — 03: Application of the non-negative matrix factorization technique to [{sup 11}C]-DTBZ dynamic PET data for the early detection of Parkinson's disease

In this work, a class of non-negative matrix factorization (NMF) technique known as alternating non-negative least squares, combined with the projected gradient method, is used to analyze twenty-five [{sup 11}C]-DTBZ dynamic PET/CT brain data. For each subject, a two-factor model is assumed and two factors representing the striatum (factor 1) and the non-striatum (factor 2) tissues are extracted using the proposed NMF technique and commercially available factor analysis software “Pixies”. The extracted factor 1 and 2 curves represent the binding site of the radiotracer and describe the uptake and clearance of the radiotracer by soft tissues in the brain, respectively. The proposed NMF technique uses prior information about the dynamic data to obtain sample time-activity curves representing the striatum and the non-striatum tissues. These curves are then used for “warm” starting the optimization. Factor solutions from the two methods are compared graphically and quantitatively. In healthy subjects, radiotracer uptake by factors 1 and 2 are approximately 35–40% and 60–65%, respectively. The solutions are also used to develop a factor-based metric for the detection of early, untreated Parkinson's disease. The metric stratifies healthy subjects from suspected Parkinson's patients (based on the graphical method). The analysis shows that both techniques produce comparable results with similar computational time. The “semi-automatic” approach used by the NMF technique allows clinicians to manually set a starting condition for “warm” starting the optimization in order to facilitate control and efficient interaction with the data.

60 APPLIED LIFE SCIENCES↗

Realistic operation of two residential cordwood-fired outdoor hydronic heater appliances—Part 3: Optical properties of black and brown carbon emissions

Residential biomass combustion is a source of carbonaceous aerosol. Inefficient combustion, particularly of solid fuels produces large quantities of black and brown carbon (BC and BrC). These particle types are important as they have noted effects on climate forcing and human health. One method of measuring these quantities is by measurement of aerosol light-absorption and scattering, which can be performed using an aethalometer and nephelometer, respectively. These instruments are widely deployed in the study of ambient air and are frequently used in air quality modeling and source apportionment studies. In this study, we will describe (1) a method for measuring primary BC and BrC emissions from two residential log-fired wood hydronic heaters and (2) the BC and BrC emission from these devices over a wide range of operating conditions, such as cold-starts, warm-starts, four different levels of output ranging from 15% to 100% maximum rated output, and periods of repeated cycling. The range in flue-gas BC concentrations, measured using an aethalometer at the 880 nanometer (nm) wavelength, were between 5.09 × 10 2 and 2.24 × 10 4 micrograms per cubic meter (µg/m 3 ) while the scattering coefficient of the flue-gas, measured by a nephelometer at 880 nm, ranged between 2.20 × 10 3 and 8.56 × 10 5 inverse megameters (Mm –1 ). The BrC concentrations, measured using the 370 nm wavelength of an aethalometer, were between 9.10 × 10 1 and 3.56 × 10 4 µg/m 3 . The calculated Angstrom Absorption Exponent (AAE) of the flue-gas aerosol ranged between 1.54 and 3.63. Performing a comparison between the measured BC concentration and an external particulate matter (PM) concentration showed that overall BC makes up roughly a quarter of the PM emitted by either of the two appliances. Further for both appliances, the cold-start and the test phase immediately following it had the highest BC and BrC concentrations, the highest measured scattering coefficient, as well as a low AAE.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Framework for Characterizing the Initial Thermal Conditions of Light-Duty Vehicles in Response to Representative Utilization Patterns, Ambient Conditions, and Vehicle Technologies

It is widely understood that the thermal state of a light-duty vehicle at the beginning of a trip influences the vehicle performance throughout the drive cycle. Cold starts, or initial states with component temperatures near ambient conditions, are strongly correlated with reduced vehicle performance and energy efficiency and with increased emissions. Despite this understanding, there is little literature available that characterizes initial thermal states beyond empirical studies and simplified analyses of dwell times. We introduce a framework that considers vehicle activity patterns, including the previous drive event, duration of the previous dwell event, and relevant ambient conditions occurring during these events. Moreover, the framework allows for technologies to influence the prominence of cold starts and warm starts. An example application of the methodology using a powertrain model approach revealed the significance of all constituent factors: controlling for ambient conditions, the shortest dwell lengths corresponded to an average initial oil temperature of 70°C versus 23°C for the long dwell length simulations, and aggressive conditioning cycles corresponded to an average initial oil temperature of 51°C versus only 35°C for a short conditioning cycle. The coldest ambient conditions evaluated (-30°C to -10°C) produced a weighted initial oil temperature of 19°C versus 57°C for the warmest ambient conditions evaluated (30°C to 50°C). Finally, we introduce weighting factors that account for the real-world frequency of conditioning cycle and dwell length combinations. The procedure outlined may be useful for discovering real-world performance improvements associated with vehicle technologies, a topic of interest to both vehicle manufacturers and regulators.

33 ADVANCED PROPULSION SYSTEMS↗

Characterizing 51 Eri b from 1 to 5 μm: A Partly Cloudy Exoplanet

We present spectrophotometry spanning 1–5 μm of 51 Eridani b, a 2–10 M{sub Jup} planet discovered by the Gemini Planet Imager Exoplanet Survey. In this study, we present new K1 (1.90–2.19 μm) and K2 (2.10–2.40 μm) spectra taken with the Gemini Planet Imager as well as an updated L {sub P} (3.76 μm) and new M {sub S} (4.67 μm) photometry from the NIRC2 Narrow camera. The new data were combined with J (1.13–1.35 μm) and H (1.50–1.80 μm) spectra from the discovery epoch with the goal of better characterizing the planet properties. The 51 Eri b photometry is redder than field brown dwarfs as well as known young T-dwarfs with similar spectral type (between T4 and T8), and we propose that 51 Eri b might be in the process of undergoing the transition from L-type to T-type. We used two complementary atmosphere model grids including either deep iron/silicate clouds or sulfide/salt clouds in the photosphere, spanning a range of cloud properties, including fully cloudy, cloud-free, and patchy/intermediate-opacity clouds. The model fits suggest that 51 Eri b has an effective temperature ranging between 605 and 737 K, a solar metallicity, and a surface gravity of log(g) = 3.5–4.0 dex, and the atmosphere requires a patchy cloud atmosphere to model the spectral energy distribution (SED). From the model atmospheres, we infer a luminosity for the planet of −5.83 to −5.93 (logL/L{sub ⊙}), leaving 51 Eri b in the unique position of being one of the only directly imaged planets consistent with having formed via a cold-start scenario. Comparisons of the planet SED against warm-start models indicate that the planet luminosity is best reproduced by a planet formed via core accretion with a core mass between 15 and 127 M{sub ⊕}.

79 ASTRONOMY AND ASTROPHYSICS↗

Structure-aware Initialization via Numerical Continuation and Informed Priors

Scientific machine learning (SciML) often operates in ill-conditioned, weakly identifiable regimes due to limited data or indirect observations. In such settings, optimization and inference are highly sensitive to the starting point, making initialization--often under-reported--a consequential degree of freedom. Random initialization is not a neutral default as it induces an implicit prior over candidate solutions and can systematically bias the result, producing large run-to-run variability. Here, we formalize this view by treating initialization as a hidden confounder in SciML and develop a unifying theory for structure-aware initialization via numerical continuation, constructing warm starts from related problem instances. Across representative tasks, including physics-informed neural networks, maximum likelihood estimation, and variational inference, warm starts have been shown to consistently reduce optimization effort and improve reliability.

Data integrity↗

SU-E-J-126: An Online Replanning Method for FFF Beams Without Couch Shift

Purpose: In a situation that couch shift for patient positioning is not preferred or prohibited (e.g., MR-Linac), segment aperture morphing (SAM) can address target dislocation and deformation. For IMRT/VMAT with flattening filter free (FFF) beams, however, SAM method would lead to an adverse translational dose effect due to the beam unflattening. Here we propose a new 2-step process to address both the translational effect of FFF beams and the target deformation. Methods: The replanning method consists of an offline and an online steps. The offline step is to create a series of pre-shifted plans (PSP) obtained by a so called “warm start” optimization (starting optimization from the original plan, rather from scratch) at a series of isocenter shifts with fixed distance (e.g. 2 cm, at x,y,z = 2,0,0 ; 2,2,0 ; 0,2,0; …;− 2,0,0). The PSPs all have the same number of segments with very similar shapes, since the warm-start optimization only adjusts the MLC positions instead of regenerating them. In the online step, a new plan is obtained by linearly interpolating the MLC positions and the monitor units of the closest PSPs for the shift determined from the image of the day. This two-step process is completely automated, and instantaneously fast (no optimization or dose calculation needed). The previously-developed SAM algorithm is then applied for daily deformation. We tested the method on sample prostate and pancreas cases. Results: The two-step interpolation method can account for the adverse dose effects from FFF beams, while SAM corrects for the target deformation. The whole process takes the same time as the previously reported SAM process (5–10 min). Conclusion: The new two-step method plus SAM can address both the translation effects of FFF beams and target deformation, and can be executed in full automation requiring no additional time from the SAM process. This research was supported by Elekta inc. (Crawley, UK)

60 APPLIED LIFE SCIENCES↗

A fast two-stage algorithm for non-negative matrix factorization in smoothly varying data

This article reports the study of algorithms for non-negative matrix factorization (NMF) in various applications involving smoothly varying data such as time or temperature series diffraction data on a dense grid of points. Utilizing the continual nature of the data, a fast two-stage algorithm is developed for highly efficient and accurate NMF. In the first stage, an alternating non-negative least-squares framework is used in combination with the active set method with a warm-start strategy for the solution of subproblems. In the second stage, an interior point method is adopted to accelerate the local convergence. The convergence of the proposed algorithm is proved. The new algorithm is compared with some existing algorithms in benchmark tests using both real-world data and synthetic data. Furthermore, the results demonstrate the advantage of the algorithm in finding high-precision solutions.

interior point method↗

Stochastic Approximation for Multi-period Simulation Optimization with Streaming Input Data

We consider a continuous-valued simulation optimization (SO) problem, where a simulator is built to optimize an expected performance measure of a real-world system while parameters of the simulator are estimated from streaming data collected periodically from the system. At each period, a new batch of data is combined with the cumulative data and the parameters are re-estimated with higher precision. The system requires the decision variable to be selected in all periods. Therefore, it is sensible for the decision-maker to update the decision variable at each period by solving a more precise SO problem with the updated parameter estimate to reduce the performance loss with respect to the target system. We define this decision-making process as the multi-period SO problem and introduce a multi-period stochastic approximation (SA) framework that generates a sequence of solutions. Two algorithms are proposed: Re-start SA (ReSA) reinitializes the stepsize sequence in each period, whereas Warm-start SA (WaSA) carefully tunes the stepsizes, taking both fewer and shorter gradient-descent steps in later periods as parameter estimates become increasingly more precise. We show that under suitable strong convexity and regularity conditions, ReSA and WaSA achieve the best possible convergence rate in expected sub-optimality either when an unbiased or a simultaneous perturbation gradient estimator is employed, while WaSA accrues significantly lower computational cost as the number of periods increases. In addition, we present the regularized ReSA, which obviates the need to know the strong convexity constant and achieves the same convergence rate at the expense of additional computation.

Computer Science↗

Combined Cycle Integrated Thermal Energy Storage “CiTES” (Final Scientific/Technical Report)

The Phase I of this project confirmed the technical feasibility of a Combined Cycle integrated Thermal Energy Storage “CiTES” system, calculated the key performance parameters like power efficiency and costs, and proved its commercial value with full-year simulations for several US electricity markets with high degree of variable renewable generation and volatile hourly electricity prices. The core element of this project is the Electro Thermal Energy Storage (ETES) technology from Siemens Gamesa Renewable Energy GmbH, using thermally stable and inexpensive volcanic rocks as storage material and air as heat transfer medium. This technology is backed by more than 10 years of experience and a 440MMBTU (130MWh-th) pilot plant in Hamburg, Germany, which is in operation since 2019. The integration of this thermal storage in an existing combined cycle power plant (CCPP) is typical power plant technology without any major technology risks. It allows the storage of inexpensive renewable energy during times of surplus renewable generation and the discharge of this energy in times of high energy demand when the fossil plant is in operation. This supplements the fossil power generation with CO2-emission-free energy. The secondary effect of the CiTES system is that a small part of the stored thermal energy is used to keep the heat recovery steam generator (HRSG) and steam turbine (ST) of the combined cycle power plant in hot and ready-to-start condition. This enables the plant to start rapidly when fossil generation is required to satisfy demand as soon variable generation drops off in the evenings or during cloud cover and calm wind periods. Without pre-warming of the HRSG and ST, the CCPP would need several hours for a cold or warm start, burn a lot of gas and release high NOx emissions during start and wouldn’t be able to use the short times of high energy prices in an efficient or economical manner. The economic parameters of CiTES were determined by a full year “8760” simulation using a data set calculation for each of the hours of the year, and historical electricity and gas prices. For consistency, the simulations were focused on the pre-COVID year 2019. The financially most attractive markets were in the Energy Reliability Council of Texas (ERCOT) region, which allowed substantial value generation with arbitrage (charge with cheap energy during renewable surplus times and discharge when energy is needed and expensive). The improvement of flexibility with the CiTES system by pre-heating and warm-keeping of the CCPP allowed for additional power generation during short time periods when demand is high but renewable generation is down; when the hourly energy prices are highest in these markets. The simulations are based on 2019 data, when ERCOT had 27GW of installed photovoltaic (PV) and wind generation. They showed that the created revenue with the prototypically sized CiTES system of 1,000MMBTU (300MWh-th) falls a little bit short of what is expected from a commercially viable investment. The system has optimization opportunities for cost reduction and increased effectiveness which will be realized during a potential Phase II Pre-FEED study following this project. Furthermore, it is safe to assume that a lot of renewable generation capacity will be added all over the US in the coming years. As an example, ERCOT is predicting to more than double its renewable generation from 27GW in 2019 to a forecasted 63GW in 2023. This will increase the amount of renewable overproduction exponentially. This rapid increase of local overproduction and the need to curtail renewable generation is well documented by the California ISO (www.CAISO.com / managing oversupply). However, the simulations also revealed a weakness in the structure of the electricity markets in the US. More specifically, when electricity prices are very low and approaching negative levels, the owners of Variable Renewable Energy (VRE) will curtail a part of their facility to stabilize the price by reducing supply. This results in a situation in which storage facilities, which are integrated in existing fossil assets and don’t have the behind-the-meter benefit of a VRE, won’t be able to purchase low cost – otherwise curtailed – renewable energy off the grid. A special tariff, which motivates VRE owners to sell otherwise curtailed renewable energy to storage facilities (Hydrogen, thermal, pumped hydro, etc.) can solve this issue. The implementation of such a regulating tariff by Independent System Operators, thus avoiding renewable curtailment, is a pre condition for successful commercialization for renewable energy storage technologies. With this advancement of design and technology and improvements in the market environment, it can be expected that the Combined Cycle integrated Thermal Energy Storage proves itself as an important innovation to keep highly efficient, natural gas-based power generation economically successful and relevant for the power industry in the United States of America.

Wolf, Thorsten↗

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Here this article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results for model-free DRL-based methods in power systems control problems. But in power systems applications, these model-free methods have certain issues related to training time (clock time) and sample efficiency; both are critical for making state-of-the-art DRL algorithms practically applicable. DRL-agent learns an optimal policy via a trial-and-error method while interacting with the real-world environment. It is also desirable to minimize the direct interaction of the DRL agent with the real-world power grid due to its safety-critical nature. Additionally, the state-of-the-art DRL-based policies are mostly trained using a physics-based grid simulator where dynamic simulation is computationally intensive, lowering the training efficiency. We propose a novel model-based DRL framework where a deep neural network (DNN)-based dynamic surrogate model (SM), instead of a real-world power grid or physics-based simulation, is utilized within the policy learning framework, making the process faster and more sample efficient. However, having stable training in model-based DRL is challenging because of the complex system dynamics of large-scale power systems. We addressed these issues by incorporating imitation learning to have a warm start in policy learning, reward-shaping, and multi-step loss in surrogate model training. Finally, we achieved 97.5% reduction in samples and 87.7% reduction in training time for an application to the IEEE 300-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Optimal design and dispatch of a system of diesel generators, photovoltaics and batteries for remote locations

Renewable energy technologies, specifically, solar photovoltaic cells, combined with battery storage and diesel generators, form a hybrid system capable of independently powering remote locations, i.e., those isolated from larger grids. If sized correctly, hybrid systems reduce fuel consumption compared to diesel generator-only alternatives. We present an optimization model for establishing a hybrid power design and dispatch strategy for remote locations, such as a military forward operating base, that models the acquisition of different power technologies as integer variables and their operation using nonlinear expressions. Our cost-minimizing, nonconvex, mixed-integer, nonlinear program contains a detailed battery model. Due to its complexities, we present linearizations, which include exact and convex under-estimation techniques, and a heuristic, which determines an initial feasible solution to serve as a “warm start” for the solver. We determine, in a few hours at most, solutions within 5% of optimality for a candidate set of technologies; these solutions closely resemble those from the nonlinear model. Lastly, our instances contain real data spanning a yearly horizon at hour fidelity and demonstrate that a hybrid system could reduce fuel consumption by as much as 50% compared to a generator-only solution.

14 SOLAR ENERGY↗

A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (Biometrika 81(3):425–455, 1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform simulated and real data Monte Carlo experiments to quantify the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗

Artificial intelligence driven laser parameter search: Inverse design of photonic surfaces using greedy surrogate-based optimization

Photonic surfaces designed with specific optical characteristics are becoming increasingly crucial for novel energy harvesting and storage systems. The design of these surfaces can be achieved by texturing materials using lasers. The optimal adjustment of laser fabrication parameters to achieve target surface optical properties is an open challenge. Thus, we develop a surrogate-based optimization approach. Our framework employs the Random Forest algorithm to model the forward relationship between the laser fabrication parameters and the resulting optical characteristics. During the optimization process, we use a greedy, prediction-based exploration strategy that iteratively selects batches of laser parameters to be used in experimentation by minimizing the predicted discrepancy between the surrogate model’s outputs and the user-defined target optical characteristics. This strategy allows for efficient identification of optimal fabrication parameters without the need to model the error landscape directly. We demonstrate the efficiency and effectiveness of our approach on two synthetic benchmarks and two specific experimental applications of photonic surface inverse design targets. By calculating the average performance of our algorithm compared to other state of the art optimization methods, we show that our algorithm performs, on average, twice as well across all benchmarks. Additionally, a warm starting inverse design technique for changed target optical characteristics enhances the performance of the introduced approach.

97 MATHEMATICS AND COMPUTING↗