Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Simulation and Optimization of Volatile Fatty Acid Upgrading Strategies for Sustainable Transportation Fuel Production

Underutilized wet waste is a promising feedstock for production of carbon-neutral or carbon-negative liquid transportation fuels. Arrested methanogenesis of wet wastes by microbes, which produces mixtures of C2-C8 carboxylic acids (volatile fatty acids, VFAs), is practiced industrially at a pilot scale and the VFA products can be catalytically upgraded to molecules suitable for use as transportation fuels (alcohols and alkanes) via sequential ketonization and hydrogenation, both steps of which have been demonstrated with high (>90%) yield at the lab scale. We present in this work a simulation-based decision-making framework which evaluates upgrading strategies of VFAs to alcohol- and hydrocarbon-based neat and blended diesel, jet, and gasoline fuels. The processes utilize sequential upgrading steps (ketonization and hydrogenation) accompanied by one distillation step (either separating VFAs before ketonization or alcohols after ketone hydrogenation) to form two liquid streams: a light alcohol stream best suited as a light-duty fuel and a heavy alcohol or hydrocarbon stream best suited as a diesel or jet fuel. Suitability of the liquid products as transportation fuels and maximum blending levels with petrofuels comes from simulation of critical fuel properties (boiling point, flash point, lower heating value, viscosity, melting point, water solubility, and cetane/octane number). Catalytic upgrading steps and fuel property mixing models used by the simulation are experimentally validated. We demonstrate the flexibility of the decision-making algorithm by evaluating processing scenarios for experimentally-observed VFA profiles with varied carbon chain length distributions. Processing scenarios are optimized for either maximum total renewable carbon utilization or production of heavy-duty (jet or diesel) fuels. We evaluate the economic viability and CO2 emissions of each proposed upgrading scenario using techno-economic and life cycle analyses. The decision-making framework developed in this work can also be used to down-select promising strategies for upgrading of other bio-based feedstocks to sustainable fuels and chemicals.

aviation fuel↗
DOE OSTI2025

Fast and robust strategies for large-scale mixed-integer SCOPF

This project develops scalable, computationally efficient algorithms to solve realistic large-scale power system optimization problems, including systems with more than 8,000 buses, as part of a larger series of competitions run by ARPA-E. These problems are critical because the secure and reliable operation of the power grid is becoming increasingly challenging, especially under conditions of increased uncertainty and variability. The economic feasibility of our methods is high, given that they are purely software-based solutions designed to operate power grids more efficiently. The technical effectiveness balances heuristics and approximations to provide a trade-off between speed and accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Tightest Mixed-Integer Programming Formulations for Quadratic SCUC Optimization

In this project, we developed new, tighter Mixed-Integer Programming (MIP) formulations for the combined Alternating Current (AC) Security-Constrained Unit Commitment (SCUC) and Security-Constrained Optimal Power Flow (SCOPF). The work addresses a critical challenge in power system operations: efficiently determining which generation units to commit and how to optimally dispatch them while maintaining network reliability constraints for both normal and contingency scenarios. Our efforts: 1. Advance the Understanding of SCUC/SCOPF Modeling: By introducing tighter MIP formulations and leveraging cutting-edge optimization tools (Julia/JuMP, PowerModels.jl), this project has pushed forward the state of the art in efficient power systems scheduling. 2. Enhance Technical and Economic Feasibility: The methods developed provide more accurate and potentially faster solutions to large-scale, realistic scheduling and dispatch problems in electric power systems, which can translate into improved reliability and potentially lower costs for grid operations. 3. Benefit to the Public: Greater efficiency in power system operations leads to cost savings for utilities and end-users. Improved reliability and integration of advanced modeling approaches can facilitate the adoption of clean energy resources and better accommodate uncertainties in renewable generation. Because this technology could impact bulk power markets and reliability, these innovations have far-reaching public benefits in terms of cost savings, reliability, and sustainability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Profiling the BLAST bioinformatics application for load balancing on high-performance computing clusters

Abstract Background The Basic Local Alignment Search Tool (BLAST) is a suite of commonly used algorithms for identifying matches between biological sequences. The user supplies a database file and query file of sequences for BLAST to find identical sequences between the two. The typical millions of database and query sequences make BLAST computationally challenging but also well suited for parallelization on high-performance computing clusters. The efficacy of parallelization depends on the data partitioning, where the optimal data partitioning relies on an accurate performance model. In previous studies, a BLAST job was sped up by 27 times by partitioning the database and query among thousands of processor nodes. However, the optimality of the partitioning method was not studied. Unlike BLAST performance models proposed in the literature that usually have problem size and hardware configuration as the only variables, the execution time of a BLAST job is a function of database size, query size, and hardware capability. In this work, the nucleotide BLAST application BLASTN was profiled using three methods: shell-level profiling with the Unix “time” command, code-level profiling with the built-in “profiler” module, and system-level profiling with the Unix “gprof” program. The runtimes were measured for six node types, using six different database files and 15 query files, on a heterogeneous HPC cluster with 500+ nodes. The empirical measurement data were fitted with quadratic functions to develop performance models that were used to guide the data parallelization for BLASTN jobs. Results Profiling results showed that BLASTN contains more than 34,500 different functions, but a single function, RunMTBySplitDB, takes 99.12% of the total runtime. Among its 53 child functions, five core functions were identified to make up 92.12% of the overall BLASTN runtime. Based on the performance models, static load balancing algorithms can be applied to the BLASTN input data to minimize the runtime of the longest job on an HPC cluster. Four test cases being run on homogeneous and heterogeneous clusters were tested. Experiment results showed that the runtime can be reduced by 81% on a homogeneous cluster and by 20% on a heterogeneous cluster by re-distributing the workload. Discussion Optimal data partitioning can improve BLASTN’s overall runtime 5.4-fold in comparison with dividing the database and query into the same number of fragments. The proposed methodology can be used in the other applications in the BLAST+ suite or any other application as long as source code is available.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1994

Aligning parallel arrays to reduce communication

Axis and stride alignment is an important optimization in compiling data-parallel programs for distributed-memory machines. We previously developed an optimal algorithm for aligning array expressions. Here, we examine alignment for more general program graphs. We show that optimal alignment is NP-complete in this setting, so we study heuristic methods. This paper makes two contributions. First, we show how local graph transformations can reduce the size of the problem significantly without changing the best solution. This allows more complex and effective heuristics to be used. Second, we give a heuristic that can explore the space of possible solutions in a number of ways. We show that some of these strategies can give better solutions than a simple greedy approach proposed earlier. Our algorithms have been implemented; we present experimental results showing their effect on the performance of some example programs running on the CM-5.

Sheffler, Thomas J.↗
NASA NTRS2002

Bi-Level Integrated System Synthesis (BLISS) for Concurrent and Distributed Processing

The paper introduces a new version of the Bi-Level Integrated System Synthesis (BLISS) methods intended for optimization of engineering systems conducted by distributed specialty groups working concurrently and using a multiprocessor computing environment. The method decomposes the overall optimization task into subtasks associated with disciplines or subsystems where the local design variables are numerous and a single, system-level optimization whose design variables are relatively few. The subtasks are fully autonomous as to their inner operations and decision making. Their purpose is to eliminate the local design variables and generate a wide spectrum of feasible designs whose behavior is represented by Response Surfaces to be accessed by a system-level optimization. It is shown that, if the problem is convex, the solution of the decomposed problem is the same as that obtained without decomposition. A simplified example of an aircraft design shows the method working as intended. The paper includes a discussion of the method merits and demerits and recommendations for further research.

Sobieszczanski-Sobieski, Jaroslaw↗
NASA NTRS2020

SWIRP (Submm-Wave and Long Wave InfraRed Polarimeter); Development and Characterization of a Sub-Mm Polarimeter for Ice Cloud Investigations

A major source of uncertainty in climate models is the presence, shape and distribution of ice particles in the uppermost layers of the clouds. The effects of this component are poorly constrained, turning ice particles into an almost-free variable in many climate models.NASA-GSFC is developing a new instrument aimed at measuring the size and shape of ice particles. The instrument consists of two sub-mm polarimeters (at 220 and 670 GHz) coupled with a long-wave infrared polarimeter at 10 micron. Each polarimeter has identical V-pol and H-pol channels; the axes of polarization are defined geometrically by the orientation of the waveguide elements, and the purity has been measured in the lab. The instrument is configured as a conical scanner, suitable for deployment as a payload on a small satellite or on a high-altitude sub-orbital platform. From a 400 km orbit, the instrument has a 3dB spatial resolution of 20 (10) km at 220 (670) GHz and a swath of 600 km over 180 degrees of view.The BAPTA (Bearing And Power Transfer Assembly) carries heritage from the SSMIS design, now in its 22nd year of on-orbit operation, but with a much reduced SWaP (Size Weight and Power) footprint, suitable for a small satellite.The main components of the instrument have been fabricated and are undergoing final testing prior to their integration as a single unit. The sub-mm channels have dedicated secondary reflectors which illuminate a shared primary reflector. The receiving units are placed behind the focal point of the optical arrangement, so that all beams equally illuminate the primary reflector and are almost co-located on the ground (within a single 220 GHz footprint). Primary and secondary beam patterns have been measured and verified to match the as-designed expectations. A Zytex (TM) window is deployed to protect the secondary reflectors and the feed horns from debris and other contaminants, and to reduce the heat load from the active (hot) IR calibration unit. The insertion loss of Zytex has been measured and is accounted in the calibration equation of the sub-mm channels.The radiometric performance of the sub-mm receivers has been characterized in the lab and under operational conditions of temperature and pressure.This paper discusses the design constraints on the sub-mm components, details of the scientific goals and their flowdown, and describes the characterization of the polarimeters. Options to optimize the layout and distribution of the masses within the assembly, with the goal of making the instrument even more compact and fully-compatible with cubesat-class satellites will be presented.

De Amici, G.↗
DOE OSTI2024

Grid Optimization Competition Challenge 3 Problem Formulation

This report contains the problem formulation for the Grid Optimization (GO) Competition Challenge 3. The Grid Optimization Competition is run by a team of researchers from a number of organizations, including the sponsor Advanced Research Projects Agency - Energy (ARPA-E), lead organization Pacific Northwest National Laboratory (PNNL), and technical contributors from Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), Texas A&M University (TAMU), Georgia Institute of Technology (GT), University of Wisconsin (UW), and others. The GO Competition poses challenge problems in the field of power grid management, invites entrants to develop solvers for these problems, invokes the solvers on a set of problem instances using common hardware, ranks the solvers according to their performance, and awards prizes according to the rankings. The overall goal of the GO Competition is to spur innovative research on high impact and computationally challenging problems in power grid management from initial development through commercial deployment. Complete information about the GO Competition can be found online at [2]. The webpage covers previous Challenges, rules, timeline, registration information, data formats, scoring methods, computational platform information, information on supported solvers and languages, sponsor information, frequently asked questions, administrator contact information, publicly available problem instances, computer code for reading and evaluating problem and solution data, a sandbox for testing solvers, and a solver submission interface, results, and publications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

MG-RAVENS: Working Group Update [Slides]

Problem Statement: Users in industry, who are planning the deployment and operation of microgrids, face a multi-domain problem that requires multiple engineering tools to solve; Existing tools lack interoperability, which requires tedious recreation and conversion of equipment models, and creates opportunities for errors in translation or through inconsistent assumptions; Microgrid modelers waste time reinventing the wheel because it is challenging to reuse existing distribution, load, generation, power flow, optimization models for new use cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

New Technologies for Power System Operation and Analysis, 1st Edition

New Technologies for Power System Operation and Analysis considers the very latest developments in renewable energy integration and system operation, including electricity markets and wide-area monitoring systems and forecasting. Helping readers quickly grasp the essential information needed to address renewable energy integration challenges, this new book looks at basic power system mathematical models, advanced renewable integration and system optimizations from transmission and distribution system sides. Sections cover wind, solar, gas and petroleum, making this a useful reference for all engineers interested in power system operation.

electricity markets↗
DOE OSTI2020

Controlled Dy-doping to nickel-rich cathode materials in high temperature aerosol synthesis

Layered nickel-rich materials are promising next-generation cathode materials for lithium ion batteries due to their high capacity and low cost. However, the poor thermal stability and longtime cycling performance hinders the commercial applications of high nickel materials. Doping with heteroatoms has been an effective approach for improving electrochemical performance of cathode materials. Controlling doping concentration and geometrical distribution is desired for optimal electrochemical performance, but it is challenging in traditional co-precipitation methods. In this work, controlled dysprosium (Dy) doping to NCM811 was studied in an aerosol synthesis method by controlling the precursor concentrations and heating parameters. The obtained materials were characterized by SEM, XRD, and XPS, and their electrochemical properties and thermal stability were evaluated. By controlling the doping concentration (1.5%), Dy-doped NCM811 was improved simultaneously in long-term cycling and high-rate performance. Here, the thermal-chemical stability of the Dy-doped cathode materials was examined in a microflow reactor with a mass spectrometer. The results showed that Dy-doping shifted the O 2 onset temperature to a higher temperature and reduced O 2 release by 80%, thus dramatically increasing the thermal-chemical stability and improving the fire safety of cathode materials. Since high temperature aerosol synthesis is a low-cost and scalable method, the findings in this work have broad implications for commercial synthesis of novel materials with controlled doping modification to achieve high electrochemical performance and safety in lithium ion batteries.

25 ENERGY STORAGE↗
DOE OSTI2024

Uncertainty quantification of mass models using ensemble Bayesian model averaging

Developments in the description of the masses of atomic nuclei have led to various nuclear mass models that provide predictions for masses across the whole chart of nuclides. These mass models play an important role in understanding the synthesis of heavy elements in the rapid neutron capture ( r ) process. However, it is still a challenging task to estimate the size of uncertainty associated with the predictions of each mass model. In this work, a method called ensemble Bayesian model averaging (EBMA) is introduced to quantify the uncertainty of one-neutron separation energies (S 1 n ) which are directly relevant in the calculations of r -process observables. Here, this Bayesian method provides a natural way to perform model averaging, selection, and uncertainty quantification, by combining the mass models as a mixture of normal distributions whose parameters are optimized against the experimental data, employing the Markov chain Monte Carlo method using the no-u-turn sampler. The EBMA model optimized with all the experimental S 1 n from the AME2003 nuclides are shown to provide reliable uncertainty estimates when tested with the new data in the AME2020.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Battery Degradation Modeling in Hybrid Power Plants: An Island System Unit Commitment Study: Preprint

As hybrid power plants (HPPs), such as photovoltaic (PV) and battery combinations, become increasingly important in power systems with high renewable energy penetration to address PV variability and ensure grid stability. This paper focuses on the urgent need to model the coordination between PV and battery systems in HPPs while accounting for battery degradation. We present a generation scheduling model that explicitly incorporates PV-battery hybridization in the unit commitment problem. Moreover, the cost function of the HPP scheduling problem endogenously considers battery degradation with adjustable weights to strike a balance between minimizing production costs and prolonging battery life, particularly when providing energy arbitrage and ancillary services. Using a realistic island system simulation, we demonstrate that accounting for battery degradation in the scheduling problem can significantly extend battery life with only minor additional production costs.

battery degradation↗
DOE OSTI2022

Laminated Permanent Magnets Enable Compact Magnetic Components in Current-Source Converters

Magnetic components have become one of the primary barriers to high power density converters, especially to current-source converters (CSCs). In CSCs, the inductors/transformers have a predominantly dc flux to store energy, which can be offset by standard permanent magnets (PMs). However, eddy currents in standard PMs induce significant losses and thermal stress for medium-frequency applications. This article proposes using laminated PMs to offset the dc flux while reducing eddy currents, leading to significant reductions in the size, cost, and losses of inductors/transformers. Furthermore, the laminated PMs’ optimal location, orientation, and distribution are investigated to generalize this approach for maximum benefits. Here, three-dimensional finite-element analysis simulation and hardware experiments are presented to validate the effectiveness of the proposed approach in a medium-frequency transformer (MFT) for CSCs. Compared with standard PMs, the proposed use of laminated PMs reduces aggregate core-plus-PM losses by 85% in experiments, and thus, relaxes the MFT thermal design. Finally, the proposed approach is experimentally validated in a 40 kVA flyback-type MFT for a soft-switching solid-state transformer. Compared to the traditional design without any PMs, the proposed design increases the saturation current by 46% while inducing only 5% more losses, leading to significant savings in magnetics cost and size.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2022

Quantum-Inspired Power System Reliability Assessment

To enable an in-depth study of power system operation and planning, the assessment of standard reliability indices is inevitable. The Monte Carlo Simulation (MCS) approach is a broadly used method in replacing the analytical methods in reliability indices assessment. The accuracy of MCS, however, highly depends on the sampling size, and hence, a complicated system with large number of components requires a large sampling size and daunting computational effort. To address this shortcoming, we, in this paper attempt to take advantage of potentials of the quantum computing (QC) for power system reliability assessment by realizing the following contributions: 1) an innovative quantum model designed for reliability assessment; 2) a quantum circuit that achieves the quadratic speed up compared to the classical MCS method; 3) an efficient quantum amplitude estimation (QAE) algorithm to accurately evaluate the reliability indices. The accuracy and efficacy of the quantum reliability method are extensively verified and demonstrated on both radial and mesh distribution systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Extending the predictive power of perturbative QCD using the principle of maximum conformality and the Bayesian analysis

In addition to the evaluation of high-order loop contributions, the precision and predictive power of perturbative QCD (pQCD) predictions depends on two important issues: (1) how to achieve a reliable, convergent fixed-order series, and (2) how to reliably estimate the contributions of unknown higher-order terms. The recursive use of renormalization group equation, together with the Principle of Maximum Conformality (PMC), eliminates the renormalization scheme-and-scale ambiguities of the conventional pQCD series. The result is a conformal, scale-invariant series of finite order which also satisfies all of the principles of the renormalization group. In this paper we propose a novel Bayesian-based approach to estimate the size of the unknown higher order contributions based on an optimized analysis of probability distributions. We show that by using the PMC conformal series, in combination with the Bayesian analysis, one can consistently achieve high degree of reliability estimates for the unknown high order terms. Thus the predictive power of pQCD can be greatly improved. We illustrate this procedure for two pQCD observables: R e+e– and R τ , which are each known up to four loops in pQCD. Numerical analyses confirm that by using the scale-independent and more convergent PMC conformal series, one can achieve reliable Bayesian probability estimates for the unknown higher-order contributions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

BULKI-Store v0.3.2

BULKI-Store is a distributed object storage system optimized for high-performance computing environments. Built with a Rust core and Python bindings, it efficiently manages scientific and machine learning datasets across HPC clusters. The system employs a client-server architecture with MPI integration, enabling seamless scaling on supercomputers like Perlmutter. BULKI-Store's object-oriented approach provides intuitive data organization with rich metadata support, contrasting with traditional file-based solutions. Key optimizations include selective checkpoint loading, unified checkpoint files, and object chunking for large data transfers. For machine learning workloads, BULKI-Store offers advantages through fine-grained access patterns, dynamic data sharing between training instances, and reduced memory pressure. Memory management features include strategic Python GC calls, minimized data copies, and batch processing capabilities. The system leverages Rayon's thread pool for asynchronous data prefetching and supports multiple CPU architectures (ARM64, x86, AMD, RISC-V). By combining performance optimizations with developer-friendly APIs, BULKI-Store addresses the complex data management challenges of modern HPC applications while maintaining compatibility across heterogeneous computing environments.

Zhang, Wei [Lawrence Berkeley National Laboratory ↗
DOE OSTI2022

Building Load Control Using Distributionally Robust Chance-Constrained Programs with Right-Hand Side Uncertainty and the Risk-Adjustable Variants

Aggregation of heating, ventilation, and air conditioning (HVAC) loads can provide reserves to absorb volatile renewable energy, especially solar photo-voltaic (PV) generation. In this paper, we decide HVAC control schedules under uncertain PV generation, using a distributionally robust chance-constrained (DRCC) building load control model under two typical ambiguity sets: the moment-based and Wasserstein ambiguity sets. We derive mixed integer linear programming (MILP) reformulations for DRCC problems under both sets. Especially, for the Wasserstein ambiguity set, we use the right-hand side (RHS) uncertainty to derive a more compact MILP reformulation than the commonly known MILP reformulations with big-M constants. All the results also apply to general individual chance constraints with RHS uncertainty. Furthermore, we propose an adjustable chance-constrained variant to achieve tradeoff between the operational risk and costs. We derive MILP reformulations under the Wasserstein ambiguity set and second-order conic programming (SOCP) reformulations under the moment-based set. Using real-world data, we conduct computational studies to demonstrate the efficiency of the solution approaches and the effectiveness of the solutions. Summary of Contribution: The problem studied in this paper is motivated by a building load control problem that uses the aggregation of heating, ventilation, and air conditioning (HVAC) loads as flexible reserves to absorb uncertain solar photovoltaic (PV) generation. The problem is formulated as distributionally robust chance-constrained (DRCC) programs with right-hand side (RHS) uncertainty. In addition, we propose a risk-adjustable variant of the DRCC programs, where the risk level, instead of being predetermined, is treated as a decision variable. The paper aims to provide tractable reformulations and solution algorithms for both the (general) DRCC and the (general) adjustable DRCC models with RHS uncertainty.

97 MATHEMATICS AND COMPUTING↗