Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “optimization methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Chapter 6: Surrogate Model Guided Optimization Algorithms and Their Potential Use in Autonomous Experimentation

This chapter reviews the basics of derivative-free optimization methods based on surrogate models and outlines how these methods can straightforwardly be applied to autonomously steering experimentation. It summarizes general solution approaches that use surrogate models and active learning. Surrogate modeling is often combined with active learning strategies, where in each iteration of the optimization algorithm, the surrogate model is used to identify which new inputs should be evaluated next and given the new input-output pair, the surrogate model is updated. Regardless of feasibility, the surrogate models for the constraints are updated in each iteration of the optimization algorithm, while the surrogate model for the objective function is only updated when a feasible point has been found. Similarly to the case of computationally cheap constraints, the surrogate models of the constraints should be incorporated into the definition of the auxiliary optimization problem that is solved to select new sample points.

active learning↗
DOE OSTI2017

Final Project Report: Composition and Realization of Source-to-Sink High-Performance Flows: File Systems, Storage, Hosts, LAN and WAN

A number of Department of Energy (DOE) science applications, involving exascale computing systems and large experimental facilities, are expected to generate large volumes of data, in the range of petabytes to exabytes, which will be transported over wide-area networks for the purpose of storage, visualization, and analysis. The objectives of this proposal are to (1) develop and test the component technologies and their synthesis methods to achieve source-to-sink high-performance flows, and (2) develop tools that provide these capabilities through simple interfaces to users and applications. In terms of the former, we propose to develop (1) optimization methods that align and transition multiple storage flows to multiple network flows on multicore, multibus hosts; and (2) edge and long-haul network path realization and maintenance using advanced provisioning methods including OSCARS and OpenFlow. We also propose synthesis methods that combine these individual technologies to compose high-performance flows using a collection of constituent storage-network flows, and realize them across the storage and local network connections as well as long-haul connections. We propose to develop automated user tools that profile the hosts, storage systems, and network connections; compose the source-to-sink complex flows; and set up and maintain the needed network connections.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Selecting the selector: Comparison of update rules for discrete global optimization

In this paper, we compare some well-known Bayesian global optimization methods in four distinct regimes, corresponding to high and low levels of measurement noise and to high and low levels of “quenched noise” (which term we use to describe the roughness of the function we are trying to optimize). We isolate the two stages of this optimization in terms of a “regressor,” which fits a model to the data measured so far, and a “selector,” which identifies the next point to be measured. Finally, the focus of this paper is to investigate the choice of selector when the regressor is well matched to the data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2022

Gapped-filtering for efficient Chebyshev expansion of the density projection operator

In this paper, we develop the gapped-filtering method, whereby a short Chebyshev expansion accurately represents the density-matrix operator. The method optimizes the Chebyshev coefficients to give the correct density matrix at all energies except within the gapped region where there are no eigenstates. Gapped filtering reduces the number of required terms in the Chebyshev expansion compared to traditional expansion methods, as long as one knows or can determine efficiently the HOMO and LUMO positions. The reduction is especially noticeable (factors of 2-3) when high accuracy is sought. To exemplify the method, we use gapped-filtering to increase the efficiency of stochastic-GW calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Statistical Multiobjective Optimization of Thiospinel CoNi 2 S 4 Nanocrystal Synthesis via Design of Experiments

Thiospinels, such as CoNi 2 S 4 , are showing promise for numerous applications, including as catalysts for the hydrogen evolution reaction, hydrodesulfurization, and oxygen evolution and reduction reactions; however, CoNi 2 S 4 has not been synthesized as small, colloidal nanocrystals with high surface-area-to-volume ratios. Traditional optimization methods to control nanocrystal attributes such as size typically rely upon one variable at a time (OVAT) methods that are not only time and labor intensive but also lack the ability to identify higher-order interactions between experimental variables that affect target outcomes. Herein, we demonstrate that a statistical design of experiments (DoE) approach can optimize the synthesis of CoNi 2 S 4 nanocrystals, allowing for control over the responses of nanocrystal size, size distribution, and isolated yield. After implementing a 2 5–2 fractional factorial design, the statistical screening of five different experimental variables identified temperature, Co:Ni precursor ratio, Co:thiol ratio, and their higher-order interactions as the most critical factors in influencing the aforementioned responses. Second-order design with a Doehlert matrix yielded polynomial functions used to predict the reaction parameters needed to individually optimize all three responses. A multiobjective optimization, allowing for the simultaneous optimization of size, size distribution, and isolated yield, predicted the synthetic conditions needed to achieve a minimum nanocrystal size of 6.1 nm, a minimum polydispersity (σ/$\bar{d}$) of 10%, and a maximum isolated yield of 99%, with a desirability of 96%. The resulting model was experimentally verified by performing reactions under the specified conditions. Furthermore, our work illustrates the advantage of multivariate experimental design as a powerful tool for accelerating control and optimization in nanocrystal syntheses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Morphology control enables thickness-insensitive efficient nonfullerene polymer solar cells

Owing to the use of cost-effective materials and excellent stability, nonfullerene polymer solar cells (PSCs) have great potential for realizing large-area industrial production. In contrast to fullerene-based devices, non-fullerene PSCs have exhibited a superior photovoltaic performance with up to 12% efficiency and long-term thermal stability. Presently, one of the major factors hindering industrial production is the high sensitivity of the power conversion efficiency (PCE) to thickness variations, which can significantly affect the manufacturing yields and production costs of roll-to-roll processing. Specifically, the device fill factors and PCEs of many high-efficiency nonfullerene PSCs show a significant loss when the thickness of the active layer is over 100 nm. In order to achieve high output capabilities earlier, there is an urgent need to find a processing method to fabricate high-efficiency thick-film nonfullerene PSCs. Controlling the morphology and performance sensitivity in thick-film non-fullerene devices is a great challenge in the field. In this paper, we present a simple morphology optimization method via thermal annealing to fabricate highly efficient thickness-insensitive non-fullerene PSCs. After this treatment, PBDB-T/IT-M-based nonfullerene PSCs can afford an impressive PCE of up to ~9.4% at an active layer thickness of 250 nm. In addition, the devices with an active layer thickness of 400 nm still maintain a high efficiency close to 9%. The photovoltaic properties and morphology parameters resolved from hard and soft X-ray scattering clearly indicate that thermal annealing plays a key role in improving the film thickness insensitivity for non-fullerene PSCs.

14 SOLAR ENERGY↗
DOE OSTI2020

Ubiquitous Power Electronics in Future Power Systems: Recommendations to fully utilize fast control capabilities

Power electronics is becoming ubiquitous in power systems because the rapid growth of variable renewable generation such as wind and solar, responsive load, electric vehicles, energy storage, as well as DC transmission. As a result, a high percentage of electricity will be generated, transmitted or consumed by power electronics in the future power system. Such a high penetration of power electronics is changing power system operation landscapes and dynamic characteristics. Two major kinds of impact are reduced system mechanical inertia by inverter-based resources displacing conventional generation and active participation of many distributed energy resources through inverters. This has caused significant reliability challenges for power system operation. The mitigation approach so far has mostly focused on accommodating power electronics inverters as passive devices or creating synthetic inertias to make inverter-based generation behaving as conventional generators. However, the high-speed control capabilities of power electronics present new opportunities for achieving an optimal performance beyond conventional power systems. A lower-inertia system can be more responsive for improving reliability, and distributed small resources can be more adaptive and scalable for better flexibility and resilience. Power electronic inverters are capable of multiple fast control functions. To fully utilized the ubiquitous power electronics in power systems requires technology advancements in the following areas: data and communications to capture the new dynamic behaviors introduced by power electronics; modeling and simulation to understand the behaviors of power electronics and its interactions with other components in the context of power systems; control and optimization methods for fully utilizing the capabilities of power electronics for a new paradigm of performance beyond the traditional inertia-heavy system; and significant upgrades in power electronics hardware to cater to the new control capabilities. If properly controlled and optimized, power electronics can help transform the power system to be responsive, adaptive, and scalable.

Huang, Zhenyu↗
DOE OSTI2023

Stochastic Price Generation for Evaluating Wholesale Electricity Market Bidding Strategies

This work presents a novel method for generating electricity price scenarios from statistical properties of past electricity prices using a hybrid statistical and reduced-form stochastic model. Previous work in applying stochastic differential equations (SDE) to model electricity prices has focused on daily average prices. To extend stochastic price generation methods to hourly or sub-hourly pricing, we address several weaknesses in the state-of-the-art: (1) we replace the mean-reversion component of the SDE with an ARIMA process that is better able to characterize the daily and weekly trends; (2) we extend the price-spike, or jump process to account for conditional probabilities of price spikes occurring in consecutive time steps by replacing the traditional Poisson process for modeling jumps with a generalized point process model inspired by brain neuron models; and (3) we replace the traditional method of estimating spike intensity with empirical variance with a Markov process based on observed price spike intensity transitions. The method is demonstrated with electricity prices from the US ERCOT market and a use-case example is provided for bidding an energy storage unit into the day-ahead and real-time energy markets of ERCOT using stochastic optimization methods. Results show that the the synthetic price model out performs a (naive) persistence forecast model by resulting in 24% to 47% more in profits over 168 simulated days.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2019

The addition of methanol to Criegee intermediates

Bimolecular reactions involving stabilized Criegee intermediates (SCI) have been the target of many studies due to the role these molecules play in atmospheric chemistry. Recently, kinetic rates for the addition reaction of the simplest SCI (formaldehyde oxide) and its methylated analogue (acetone oxide) with methanol were reported both experimentally and theoretically. We re-examine the energy profile of these reactions by employing rigorous ab initio methods. Optimized CCSD(T)/ANO1 geometries are reported for the stationary points along the reaction path. Energies are obtained at the CCSD(T)/CBS level of theory. Contributions of full triple and quadruple excitations are computed to assess the convergence of this method. Rate constants are obtained using conventional canonical transition state theory under the rigid rotor harmonic oscillator approximation and with the inclusion of a one-dimensional hindered rotor treatment. These corrections for internal rotations have a significant impact on computed kinetic rate constants. With this approach, we compute rate constants for the addition of methanol to formaldehyde oxide (H 2 COO) and acetone oxide [(CH 3 ) 2 COO] at 298.15 K as (1.2 ± 0.8) × 10 -13 and (2.8 ± 1.3) × 10 -15 cm 3 s -1 , respectively. Additionally, we investigate the temperature dependence of the rate constant, concluding that the transition state barrier height and tunneling contributions shape the qualitative behaviour of these reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Black-box optimization of CT acquisition and reconstruction parameters: a reinforcement learning approach

Protocol optimization is critical in Computed Tomography (CT) for achieving desired diagnostic image quality while minimizing radiation dose. Due to the inter-effect of influencing CT parameters, traditional optimization methods rely on the testing of exhaustive combinations of these parameters. This poses a notable limitation due to the impracticality of exhaustive parameter testing. This study introduces a novel methodology leveraging Virtual Imaging Trials (VITs) and reinforcement learning to more efficiently optimize CT protocols. Computational phantoms with liver lesions were imaged using a validated CT simulator and reconstructed with a novel CT reconstruction Toolkit. The optimization parameter space included tube voltage, tube current, reconstruction kernel, slice thickness, and pixel size. The optimization process was done using a Proximal Policy Optimization (PPO) agent which was trained to maximize the Detectability Index (d’) of the liver lesion for each reconstructed image. Results showed that our reinforcement learning approach found the absolute maximum d’ across the test cases while requiring 79.7% fewer steps compared to an exhaustive search, demonstrating both accuracy and computational efficiency, offering a efficient and robust framework for CT protocol optimization. The flexibility of the proposed technique allows for use of varying image quality metrics as the objective metric to maximize for. Our findings highlight the advantages of combining VIT and reinforcement learning for CT protocol management.

Fenwick, David [Duke University Medical Center]↗
DOE OSTI2021

Modeling of Thermal Decomposition of TATB-Based Explosive for Safety Analysis

We investigate and model the cook-off behavior of LX-17 to understand the response of explosive systems in abnormal thermal environments. Decomposition has been explored via conventional ODTX (One-Dimensional Time-to-eXplosion), PODTX (ODTX with pressure-measurement), TGA (Thermo-Gravimetric Analysis), and DSC (Differential Scanning Calorimetry) experiments under isothermal and ramped temperature profiles. The data were used to fit reaction rate parameters for proposed schemes in an ALE3D computational model. This model includes chemical reactions, thermo- and hydro-dynamics, and material properties, including thermal expansion, compressibility, and strength. These parameterizations were carried out utilizing a Python evolutionary optimization method on LLNL’s high-performance computing clusters. Additional experiments are being developed to further characterize and monitor decomposition intermediates to improve the model. Once experimentally validated, this model will be scalable to several applications involving LX-17. Furthermore, the optimization methodology developed herein should be applicable to other high explosive materials.

Chemistry - Chemical explosives↗
DOE OSTI2016

Structural, electronic and elastic properties of REIr{sub 2} (RE=La and Ce) Laves phase compounds

REIr{sub 2} (RE = La and Ce) Laves phase intermetallic compounds were investigated with respect to their structural, electronic and elastic properties using full potential linearized augmented plane wave (FP-LAPW) method within generalized gradient approximation (GGA) as implemented in WIEN2k code. The ground state properties such as lattice constants (a{sub 0}), bulk modulus (B), pressure derivative of bulk modulus (B′) and density of state at Fermi level N(E{sub F}) have been obtained by optimization method. The electronic structure (BS, TDOS and PDOS) reveals that these Laves phase compounds are metallic in nature. The calculated elastic constants indicate that these compounds are mechanically stable at ambient pressure and found to be ductile in nature.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2015

Visualizing and improving the robustness of phase retrieval algorithms

Coherent x-ray diffractive imaging is a novel imaging technique that utilizes phase retrieval and nonlinear optimization methods to image matter at nanometer scales. We explore how the convergence properties of a popular phase retrieval algorithm, Fienup's HIO, behave by introducing a reduced dimensionality problem allowing us to visualize and quantify convergence to local minima and the globally optimal solution. We then introduce generalizations of HIO that improve upon the original algorithm's ability to converge to the globally optimal solution.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Constrained quantum optimization for extractive summarization on a trapped-ion quantum computer

Abstract Realizing the potential of near-term quantum computers to solve industry-relevant constrained-optimization problems is a promising path to quantum advantage. In this work, we consider the extractive summarization constrained-optimization problem and demonstrate the largest-to-date execution of a quantum optimization algorithm that natively preserves constraints on quantum hardware. We report results with the Quantum Alternating Operator Ansatz algorithm with a Hamming-weight-preserving XY mixer (XY-QAOA) on trapped-ion quantum computer. We successfully execute XY-QAOA circuits that restrict the quantum evolution to the in-constraint subspace, using up to 20 qubits and a two-qubit gate depth of up to 159. We demonstrate the necessity of directly encoding the constraints into the quantum circuit by showing the trade-off between the in-constraint probability and the quality of the solution that is implicit if unconstrained quantum optimization methods are used. We show that this trade-off makes choosing good parameters difficult in general. We compare XY-QAOA to the Layer Variational Quantum Eigensolver algorithm, which has a highly expressive constant-depth circuit, and the Quantum Approximate Optimization Algorithm. We discuss the respective trade-offs of the algorithms and implications for their execution on near-term quantum hardware.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Input-response space-filling designs

Traditional space-filling designs are a convenient way to explore throughout an input space of flexible dimension and have design points close to any region where future predictions might be of interest. In some applications, there may be a model connecting the input factors to the response(s), which provides an opportunity to consider the spacing not only in the input space but also in the response space. In this paper, we present an approach for leveraging current understanding of the relationship between inputs and responses to generate designs that allow the experimenter to flexibly balance the spacing in these two regions to find an appropriate design for the experimental goals. Applications where good spacing of the observed response values include calibration problems where the goal is to demonstrate the adequacy of the model across the range of the responses, sensitivity studies where the outputs from a submodel may be used as inputs for subsequent models, and inverse problems where the outputs of a process will be used in the inverse prediction for the unknown inputs. Here, we use the multi-objective optimization method of Pareto fronts to generate multiple non-dominated designs with different emphases on the input and response space-filling criteria from which the experimenter can choose. The methods are illustrated through several examples and a chemical engineering case study.

42 ENGINEERING↗
DOE OSTI2024

Explosively driven Richtmyer–Meshkov instability jet suppression and enhancement via coupling machine learning and additive manufacturing

The ability to control the behavior of fluid instabilities at material interfaces, such as the shock-driven Richtmyer–Meshkov instability, is a grand technological challenge with a broad number of applications ranging from inertial confinement fusion experiments to explosively driven shaped charges. In this work, we use a linear-geometry shaped charge as a means of studying methods for controlling material jetting that results from the Richtmyer–Meshkov instability. A shaped charge produces a high-velocity jet by focusing the energy from the detonation of high explosives. The interaction of the resulting detonation wave with a hollowed cavity lined with a thin metal layer produces the unstable jetting effect. By modifying the characteristics of the detonation wave prior to striking the lined cavity, the kinetic energy of the jet can be enhanced or reduced. Modifying the geometry of the liner material can also be used to alter jetting properties. We apply optimization methods to investigate several design parameterizations for both enhancing or suppressing the shaped-charge jet. This is accomplished using 2D and 3D hydrodynamic simulations to investigate the design space that we consider. We also apply new additive manufacturing methods for producing the shaped-charge assemblies, which allow for the experimental testing of complicated design geometries obtained through computational optimization. We present a direct comparison of our optimized designs with experimental results carried out at the High Explosives Application Facility at Lawrence Livermore National Laboratory.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Accelerated Discovery of Large Electrostrains in BaTiO 3 ‐Based Piezoelectrics Using Active Learning

Abstract A key challenge in guiding experiments toward materials with desired properties is to effectively navigate the vast search space comprising the chemistry and structure of allowed compounds. Here, it is shown how the use of machine learning coupled to optimization methods can accelerate the discovery of new Pb‐free BaTiO 3 (BTO‐) based piezoelectrics with large electrostrains. By experimentally comparing several design strategies, it is shown that the approach balancing the trade‐off between exploration (using uncertainties) and exploitation (using only model predictions) gives the optimal criterion leading to the synthesis of the piezoelectric (Ba 0.84 Ca 0.16 )(Ti 0.90 Zr 0.07 Sn 0.03 )O 3 with the largest electrostrain of 0.23% in the BTO family. Using Landau theory and insights from density functional theory, it is uncovered that the observed large electrostrain is due to the presence of Sn, which allows for the ease of switching of tetragonal domains under an electric field.

Yuan, Ruihao↗