Scalable AI-assisted workflow management for detector design optimization using distributed computing
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “Distributed optimization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Distribution Grid Optimal Power Flow (D-OPF): Modeling, Analysis, and Benchmarking
Not provided.
Engineering↗
Distributed Asynchronous Optimization Methods in Skywing
Explore the source record for details and available documents.
Mathematics and Computing↗
Real time feedback-based optimization of distributed energy resources
An example device includes a processor configured to receive a plurality of voltage values representing respective voltage magnitudes at voltage nodes in a first portion of a power system and determine, for each voltage node, a respective value of first and second voltage-constraint coefficients. The processor is also configured to receive a power value corresponding to a connection point of the first portion of the power system with a second portion of the power system and determine for the connection point, a respective value of first and second power-constraint coefficients. The processor is also configured to cause at least one energy resource connected to the first portion of the power system to modify an output power of the at least one energy resource based on the value of the first and second voltage-constraint coefficients for each voltage node and the value of the first and second power-constraint coefficients.
Dall'Anese, Emiliano↗
Cooperative fault management for resilient integration of renewable energy
Cooperative fault management (CFM) is designed herein to control different types of renewable energy resources cooperatively during electrical faults. This paper studies systems with a high penetration of photovoltaic (PV) energy and wind energy. First, CFM leverages power converters of PV farms to boost the ride-through capability of nearby doubly-fed induction generators (DFIGs). By controlling PV farms’ output voltages to change smoothly during both fault initiation and fault clearance, the widely used crowbar in DFIGs is less likely to be activated. Crowbar activation adversely makes DFIGs lose controllability and absorb reactive power. The second contribution is the development of a software-defined CFM controller and a controller in-the-loop demonstration of the real-time performance of this optimization-based CFM. CFM capitalizes on distributed optimization formulation to enable flexibility, plug-and-play, and privacy-preserving. Computation time, however, is a major concern for optimization-based dynamics control. Here, real-time controller-in-the-loop simulation results show optimization-based CFM can output reference values around 60 ms and is quick enough for dynamic control.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Distribution Grid Impacts of Community Solar [Slides]
Community solar (CS) projects often face uncertain interconnection costs and fees associated with distribution grid infrastructure upgrades required to connect the project. These costs can determine the economic viability of a CS project, but they are difficult to assess. Cost uncertainty can discourage new projects and prevent communities from accessing the benefits of community solar projects. At the same time, CS deployment strategies hold potential to defer or avoid some distribution costs due to new loads. To mitigate CS interconnection costs, it is important to find least-cost combinations of distribution system infrastructure solutions (transformer upgrades, reconductoring, voltage regulators, storage), and to understand how location of CS projects within a feeder impact distribution grid upgrade costs. This study aims to quantify CS impacts on the distribution grid and provide policy and regulatory insights and CS deployment strategies to address them. It is the first analysis that has systematically studied the technical impacts of community solar projects on a wide range of distribution feeders using state-of-the-art optimization and power flow tools. The analysis employs Berkeley Lab’s novel Least-cost Optimal Distribution Grid Expansion (LODGE) model, a deterministic version of the REPAIR model, that optimally upgrades hundreds or even thousands of distribution circuits or feeders. This is the first application of the LODGE model. LODGE finds the least-cost portfolio of traditional distribution system upgrades to integrate CS in combination with alternative solutions, such as utility-owned storage and downsizing CS capacity. Working with a set of least-cost solutions per feeder allows us to benchmark, compare and find techno-economic trends in CS interconnection.
14 SOLAR ENERGY↗
Equity-driven Planning of Distributed Solar PV using Optimal Transport
Typically, distribution system planning processes do not explicitly incorporate energy equity considerations, such as identifying consumers most affected by energy costs and determining how investments in the distribution system can address existing energy burden imbalances. This paper proposes a novel optimal transport (OT)-based method to improve the energy burden distribution of consumers. The approach involves the strategic siting and sizing of solar PV in order to assist customers with high energy burden and improve the overall energy burden distribution of the community. The desired energy burden distribution is defined using the equal distribution equivalent (EDE) concept. The OT-based method is then used to estimate the distributed solar PV capacity to be installed at various locations and the tariffs to be adjusted, all while improving the energy burden distribution and providing valuable insights into distributed generation (DG) planning. The results on IEEE 37 bus test system demonstrate how DG planning, considering EDE and OT, can help reduce the energy burden of low-income consumers. Additionally, the approach also reveals optimal tariff adjustments needed to ensure revenue neutrality for distribution utilities.
Optimal transport, equal distribution equivalent, ↗
Efficient and choreographed quality-of- service management in dense 6G verticals with high-speed mobility requirements
Future 6G networks are envisioned to support very heterogeneous and extreme applications (known as verticals). Some examples are further-enhanced mobile broadband communications, where bitrates could go above one terabit per second, or extremely reliable and low-latency communications, whose end-to-end delay must be below one hundred microseconds. To achieve that ultra-high Quality-of-Service, 6G networks are commonly provided with redundant resources and intelligent management mechanisms to ensure that all devices get the expected performance. But this approach is not feasible or scalable for all verticals. Specifically, in 6G scenarios, mobile devices are expected to have speeds greater than 500 kilometers per hour, and device density will exceed ten million devices per square kilometer. In those verticals, resources cannot be redundant as, because of such a huge number of devices, Quality-of-Service requirements are pushing the effective performance of technologies at physical level. And, on the other hand, high-speed mobility prevents intelligent mechanisms to be useful, as devices move around and evolve faster than the usual convergence time of those intelligent solutions. New technologies are needed to fill this unexplored gap. Therefore, in this paper we propose a choreographed Quality-of-Service management solution, where 6G base stations predict the evolution of verticals at real-time, and run a lightweight distributed optimization algorithm in advance, so they can manage the resource consumption and ensure all devices get the required Quality-of-Service. Prediction mechanism includes mobility models (Markov, Bayesian, etc.) and models for time-variant communication channels. Besides, a traffic prediction solution is also considered to explore the achieved Quality-of-Service in advance. The optimization algorithm calculates an efficient resource distribution according to the predicted future vertical situation, so devices achieve the expected Quality-of-Service according to the proposed traffic models. An experimental validation based on simulation tools is also provided. Results show that the proposed approach reduces up to 12% of the network resource consumption for a given Quality-of-Service.
42 ENGINEERING↗
TAMM: Tensor algebra for many-body methods
Tensor algebra operations such as contractions in computational chemistry consume a significant fraction of the computing time on large-scale computing platforms. The widespread use of tensor contractions between large multi-dimensional tensors in describing electronic structure theory has motivated the development of multiple tensor algebra frameworks targeting heterogeneous computing platforms. In this paper, we present Tensor Algebra for Many-body Methods (TAMM), a framework for productive and performance-portable development of scalable computational chemistry methods. TAMM decouples the specification of the computation from the execution of these operations on available high-performance computing systems. With this design choice, the scientific application developers (domain scientists) can focus on the algorithmic requirements using the tensor algebra interface provided by TAMM, whereas high-performance computing developers can direct their attention to various optimizations on the underlying constructs, such as efficient data distribution, optimized scheduling algorithms, and efficient use of intra-node resources (e.g., graphics processing units). The modular structure of TAMM allows it to support different hardware architectures and incorporate new algorithmic advances. We describe the TAMM framework and our approach to the sustainable development of scalable ground- and excited-state electronic structure methods. We present case studies highlighting the ease of use, including the performance and productivity gains compared to other frameworks.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Electric Utility Distribution Costs: Scoping Study on Trends, Drivers, and Possible Response Strategies [Slides]
This scoping study synthesizes information that will help stakeholders understand the scope, scale, and drivers of recent increases in investor-owned utility (IOU) expenditures on local distribution power grids, while providing regulators and other decision-makers with potential strategies to keep electricity bills down. The study includes five distinct components. Drawing first on data from FERC Form 1, it summarizes key trends in past and recent IOU distribution costs. Next, through a review of a sample of distribution-system plans, it characterizes material drivers of planned distribution expenditures. Ultimately, regulators must approve cost recovery for IOU expenditures, including those for the distribution system. The study therefore also: examines trends in utility requests and regulatory approvals related to changes in retail rates and return on equity; identifies areas where utility shareholder and customer incentives may be misaligned; and develops a menu of options that state regulators might consider to optimize distribution system expenditures. Some of the key findings include: - IOU distribution spending at a national level has grown by 6%/yr since 2014 in real dollar terms, 4x faster than in the prior 20 years and consisting mostly of capital (not operating) expenditure. - On a per-kWh basis, increases in IOU distribution costs since 2014 represent over 30% of the overall national-average increase in retail electricity rates. - Regional spending growth has ranged from 2-8%/yr, with larger estimated rate impacts in CAISO, then NYISO & ISO-NE, and then the Southeast, MISO & PJM (see figure). - Some utilities are planning for significantly increased distribution system spending. Planned spending on managing the existing system (asset replacement, safety & reliability, and resilience are all important drivers) exceeds that for capacity expansion. - IOU rate increase requests ($18 billion in 2025) and public utility commission (PUC) approval levels (average of 64% of requested amounts from 2021-2025) have recently hit multi-decadal highs. - PUCs in New England and the Southeast have recently approved a greater fraction of rate requests (>75%, on average) than in ther regions, while PUCs in California and the Southeast have generally authorized higher equity returns than in other regions. - Regulators have many tools to tackle potential misalignments between utility and customer interests and, more specifically, to optimize and reduce distribution costs. Shorter-term options include those related to return on equity, capital structure, depreciation, trackers, construction work in progress, and securitization. Longer-term options include performance-based regulation and a wide variety of planning-related requirements. All options embed important tradeoffs.
24 POWER TRANSMISSION AND DISTRIBUTION↗
OPTIMIZATION OF COOLING DISTRIBUTION OF THE EIC SHC COOLER ERL
The Electron-Ion Collider (EIC) Hadron Storage Ring (HSR) will use strong hadron cooling to maintain the beam brightness and high luminosity during long collision ex?periments. An Energy Recovery Linac is used to deliver the high-current high-brightness electron beam for cooling. For the best cooling effect, the electron beam requires low emittance, small energy spread, and uniform longitudinal distribution. In this work, we simulate and optimize the longitudinal laser-beam distribution shaping at the photo?cathode, modeling space charge forces accurately. Machine parameters such as RF cavity phases are optimized in con?junction with the beam distribution using a genetic optimizer. We demonstrate improvement of the cooling distribution in key parameters.
Wang, N.↗
Equitable Transactive Market Design to Coordinate Networked Microgrids with Mixed Ownership
This paper presents an inter-microgrid peer-topeer (P2P) transactive market mechanism to support the coordination of multiple microgrids in a mixed-ownership environment, while enabling prosumers to actively participate in the market to get their own benefits. An equitable P2P transactive energy market is designed, in which the energy burden to customers within microgrids is fairly distributed by leveraging a peer-to-peer communication network among MG owners and the distribution system operator (DSO). To reach the market settlement, a consensus-based distributed optimization algorithm is introduced to enable each MG owner and the DSO to distributedly determine the cleared price which is compensated by a household-income-based discount factor to encourage the energy-burden equity among customers in networked microgrids service territory. Numerical results on the modified 123 node test feeder including 6 microgrids are used to demonstrate the operation of the introduced equitable transactive energy market.
Vu, Thanh Long↗
The Active Optics System on the Vera C. Rubin Observatory: Optimal Control of Degeneracy among the Large Number of Degrees of Freedom
Abstract The Vera C. Rubin Observatory is a unique facility for survey astronomy that will soon be commissioned and begin operations. Crucial to many of its scientific goals is the achievement of sustained high image quality, limited only by the seeing at the site. This will be maintained through an active optics system that controls optical element misalignments and corrects mirror figure error to minimize aberrations caused by both thermal and gravitational effects. However, the large number of adjustment degrees of freedom available on the Rubin Observatory introduces a range of degeneracies, including many that are induced by noise due to imperfect measurement of the wave-front errors. We present a structured methodology for identifying these degeneracies through an analysis of image noise level. We also present a novel scaling strategy based on truncated singular value decomposition that mitigates the degeneracy and optimally distributes the adjustment over the available degrees of freedom. Our approach ensures the attainment of optimal image quality, while avoiding excursions around the noise-induced subspace of degeneracies, marking a significant improvement over the previous techniques adopted for Rubin, which were based on an optimal integral controller. This new approach is likely to also yield significant benefits for all telescopes that incorporate large numbers of degrees of freedom of adjustment.
79 ASTRONOMY AND ASTROPHYSICS↗
There and Back Again: Reimagining Cryogenic Cooling for Scalable Arrays of Dilution Refrigerators for future Quantum Datacenters
While pulse tube cryocoolers enabled the rapid expansion of dilution refrigerator technology over the past two decades, the transition to large-scale quantum systems is now driving a reassessment of the DR’s higher-temperature-stage cooling strategies and how these systems can be effectively scaled in a modular way. Quasi-wet architectures based on centralized cryoplants and forced-flow helium distribution offer compelling advantages in energy efficiency, operational cost, and scalability. With appropriate redundancy, standardized interfaces, and optimized distribution system designs, these architectures will provide a practical and robust path forward for the next generation of quantum computing infrastructure.
Hansen, B. [Fermilab]↗
Limitations of Separate Cloud and Rain Categories in Parameterizing Collision-Coalescence for Bulk Microphysics Schemes
Warm rain collision-coalescence has been persistently difficult to parameterize in bulk microphysics schemes. We use a flexible bulk microphysics scheme with bin scheme process parameterizations, called AMP, to investigate reasons for the difficulty. AMP is configured in a variety of ways to mimic bulk schemes and is compared to simulations with the bin scheme upon which AMP is built. We find that an important limitation in traditional bulk schemes is the use of separate cloud and rain categories. When the drop size distribution is instead represented by a continuous distribution, the simulation of cloud-to-rain conversion is substantially improved. We also find large sensitivity to the threshold size to distinguish cloud and rain in traditional schemes; substantial improvement is found by decreasing the threshold from 40 to 25 μm. Neither the use of an assumed functional form for the size distribution nor the choice of predicted distribution moments has a large impact on the ability of AMP to simulate rain production. When predicting four total moments of the liquid drop size distribution, either with a traditional two-category, two-moment scheme with a reduced size threshold, or a four-moment single-category scheme, errors in the evolution of mass and the cloud size distribution are similar, but the single-category scheme has a substantially better representation of the rain size distribution. Optimal moment combinations for the single-category approach are investigated and appear to be linked more to the information content they provide for constraining the size distributions than to their correlation with collision-coalescence rates.
54 ENVIRONMENTAL SCIENCES↗
Planning Amidst Uncertainty: Identifying Core CCS Infrastructure Robust to Storage Uncertainty
Carbon Capture and Storage (CCS) is a critical technology for reducing anthropogenic CO2 emissions, but its large-scale deployment is complicated by uncertainties in geological storage performance. These uncertainties pose significant financial and operational risks, as underperforming storage sites can lead to costly infrastructure modifications, inefficient pipeline routing, and economic shortfalls. To address this challenge, we propose a novel optimization workflow that is based on mixed-integer linear programming and explicitly integrates probabilistic modeling of storage uncertainty into CCS infrastructure design. This workflow generates multiple infrastructure scenarios by sampling storage capacity distributions, optimally solving each scenario using a mixed-integer linear programming model, and aggregating results into a heatmap to identify core infrastructure components that have a low likelihood of underperforming. A risk index parameter is introduced to balance trade-offs between cost, CO2 processing capacity, and risk of underperformance, allowing stakeholders to quantify and mitigate uncertainty in CCS planning. Applying this workflow to a CCS dataset from the US Department of Energy’s Carbon Utilization and Storage Partnership project reveals key insights into infrastructure resilience. Reducing the risk index from 15% to 0% is observed to lead to an 83.7% reduction in CO2 processing capacity and a 77.1% decrease in project profit, quantifying the trade-off between risk tolerance and project performance. Furthermore, our results highlight critical breakpoints, where small adjustments in the risk index produce disproportionate shifts in infrastructure performance, providing actionable guidance for decision-makers. Unlike prior approaches that aimed to cheaply repair underperforming infrastructure, our workflow constructs robust CCS networks from the ground up, ensuring cost-effective infrastructure under storage uncertainty. These findings demonstrate the practical relevance of incorporating uncertainty-aware optimization into CCS planning, equipping decision-makers with a tool to make informed project planning decisions.
Olson, Daniel↗
Microgrid Assisted Design for Remote Areas
In this work, we present a three-stage multiobjective mixed-integer linear programming (MILP) for the optimal expansion planning and operation of isolated multienergy microgrids in remote areas. By selecting the optimal distributed generators (DGs) and energy storage systems (ESSs) mix selection, siting, sizing, and scheduling in the remote microgrid, the proposed model is targeted to minimize the annualized total cost of microgrids while enhancing the performance of the system, i.e., minimizing the voltage deviations and line power loss. To represent the electricity and heat flow between generation resources and various electrical, heating, and cooling loads in the isolated microgrid, linearized power flow, and heat flow constraints are employed in the proposed optimization model. The available capacity of DGs and ESSs are modeled as discrete constants instead of continuous variables for practical purpose. Numerical simulation results on a remote microgrid consisting of DGs, ESSs, and various loads validate the proposed method.
24 POWER TRANSMISSION AND DISTRIBUTION↗