Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Robust optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Automated ICRF heating surrogate modeling via machine learning

This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.

Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗

Design, characterization and shape recovery behavior of 3D/4D printed shape memory polymers (SMPs)

Shape memory polymers (SMPs) represent a paradigm shift in material science, uniquely capable of undergoing reversible shape transformations triggered by external stimuli, positioning them as pivotal in developing next-generation biomedical devices, aerospace components, and adaptive structures. Extensive research has been done on SMPs with a major focus on high-temperature programming methods, which can limit energy efficiency and applicability with temperature-sensitive materials. Additionally, while various SMP blends have demonstrated great potential, limited work has been done on the suitability for 3D printing these materials, particularly under high-strain and ambient temperature programming conditions. In this study, a three-component optimized SMP composition was evaluated by 3D printing via the Material Extrusion (MEX) technique and investigating its ambient temperature-programming behavior at high strains. The SMP formulation studied was a tailored blend of thermoplastic polyurethane (TPU), polycaprolactone (PCL), and an octadecane diol-based copolymer (OBC) that exhibits robust shape memory behavior, high strain tolerance, and efficient force generation. Rigorous thermal, mechanical, and shape recovery analyses, along with optimized printing parameters and consistent shape recovery rates of up to 90%, were achieved under dynamic mechanical analysis (DMA), even under ambient programming conditions. This work demonstrates the SMP composition’s potential for adaptive, self-deployable systems with 4D printing characteristics ideal for bio-inspired structures and artificial muscle fibers.

Sudan, Kavish [University of Louisville, KY]↗

Sparse Cholesky factorization for solving nonlinear PDEs via Gaussian processes

In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered considerable interest due to their flexibility, robust theoretical guarantees, and close ties to traditional methods. They can transform the solving of general nonlinear PDEs into solving quadratic optimization problems with nonlinear, PDE-induced constraints. However, the complexity bottleneck lies in computing with dense kernel matrices obtained from pointwise evaluations of the covariance kernel, and its partial derivatives, a result of the PDE constraint and for which fast algorithms are scarce. The primary goal of this paper is to provide a near-linear complexity algorithm for working with such kernel matrices. We present a sparse Cholesky factorization algorithm for these matrices based on the near-sparsity of the Cholesky factor under a novel ordering of pointwise and derivative measurements. The near-sparsity is rigorously justified by directly connecting the factor to GP regression and exponential decay of basis functions in numerical homogenization. We then employ the Vecchia approximation of GPs, which is optimal in the Kullback-Leibler divergence, to compute the approximate factor. This enables us to compute ϵ-approximate inverse Cholesky factors of the kernel matrices with complexity O(N log d (N/ϵ)) in space and O(N log 2d (N/ϵ)) in time. We integrate sparse Cholesky factorizations into optimization algorithms to obtain fast solvers of the nonlinear PDE. We numerically illustrate our algorithm’s near-linear space/time complexity for a broad class of nonlinear PDEs such as the nonlinear elliptic, Burgers, and Monge-Ampère equations. In summary, we provide a fast, scalable, and accurate method for solving general PDEs with GPs and kernel methods.

97 MATHEMATICS AND COMPUTING↗

A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

Here, this study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.

97 MATHEMATICS AND COMPUTING↗

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗

Autocalibration of the E3SM Version 2 Atmosphere Model Using a PCA-Based Surrogate for Spatial Fields

Global Climate Model tuning (calibration) is a tedious and time-consuming process, with high-dimensional input and output fields. Experts typically tune by iteratively running climate simulations with hand-picked values of tuning parameters. Many, in both the statistical and climate literature, have proposed alternative calibration methods, but most are impractical or difficult to implement. We present a practical, robust, and rigorous calibration approach on the atmosphere-only model of the Department of Energy's Energy Exascale Earth System Model (E3SM) version 2. Our approach can be summarized into two main parts: (a) the training of a surrogate that predicts E3SM output in a fraction of the time compared to running E3SM, and (b) gradient-based parameter optimization. To train the surrogate, we generate a set of designed ensemble runs that span our input parameter space and use polynomial chaos expansions on a reduced output space to fit the E3SM output. We use this surrogate in an optimization scheme to identify values of the input parameters for which our model best matches gridded spatial fields of climate observations. To validate our choice of parameters, we run E3SMv2 with the optimal parameter values and compare prediction results to expertly-tuned simulations across 45 different output fields. This flexible, robust, and automated approach is straightforward to implement, and we demonstrate that the resulting model output matches present day climate observations as well or better than the corresponding output from expert tuned parameter values, while considering high-dimensional output and operating in a fraction of the time.

54 ENVIRONMENTAL SCIENCES↗

Fast Tuning-Free Distributed Algorithm for Solving the Network-Constrained Economic Dispatch

With the increasing penetration of distributed energy resources (DERs) and their participation in the electricity market, it becomes more desirable to apply distributed algorithms for resource allocation in order to address the resulting computational and communicational challenges. Most of the existing distributed algorithms for solving the network-constrained economic dispatch (NCED) problem require the tuning of certain auxiliary parameters. As a result, the robustness of these algorithms against the varieties in DERs is greatly undermined. In this paper, a new distributed algorithm, optimality condition consensus (OCC), is proposed to solve the NCED problem by using distributed power flow (DPF) and ratio consensus as fundamental tools. It inherits the advantages of existing distributed algorithms for the NCED problem but removes the need for parameter tuning to improve performance in practice. In conclusion, the effectiveness of the proposed distributed algorithm in terms of efficiency, scalability, and robustness is demonstrated through detailed case studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

FES 2023 Theory & Simulation Performance Target

The Report for the 2023 Theory & Simulation Performance Target (TSPT) is presented herein. The 1st, 2nd and 3rd Quarter Reports are given in Sec. I, Sec. II and Sec. III. These are unchanged from those previously submitted, except that in this final document the equations, figures and citations have been automatically renumbered. The 4th Quarter Report is given in Sec. IV. The following material presents verification calculations of several widely used three-dimensional (3D) magnetohydrodynamic (MHD) equilibrium codes in strongly shaped configurations; for both fixed and free-boundary equilibria; for the so-called vacuum case and for the case of high plasma pressure; and, for magnetic fields that have nested magnetic surfaces and for fields that have a magnetic island. The configurations studied includes the recently discovered “precise-QA” case [Phys. Rev. Lett., 128, 035001 (2002)] and other highly optimized configurations. Because of the strong (extreme) shaping, the latter of these pose challenges to the 3D MHD codes. A new method is introduced for constructing coordinates in arbitrarily shaped toroidal domains, and this can improve the robustness of 3D equilibrium calculations. Beyond the equilibrium calculation, this report demonstrates the capability of performing non-linear extended-MHD modelling of optimized stellarator equilibria. This capability allows the assessment not only of linear stability thresholds but also of the nonlinear evolution of unstable equilibria to new configurations that might be far from the original configuration, with significantly different transport properties and magnetic topology. They also enable the self-consistent determination of pressure profiles in non-integrable magnetic topology through the use of highly anisotropic thermal-transport equations. The calculations presented here represent the first demonstration of extended-MHD calculations in strongly-shaped, optimized quasi-symmetric configurations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Data efficiency and extrapolation trends in neural network interatomic potentials

Abstract Recently, key architectural advances have been proposed for neural network interatomic potentials (NNIPs), such as incorporating message-passing networks, equivariance, or many-body expansion terms. Although modern NNIP models exhibit small differences in test accuracy, this metric is still considered the main target when developing new NNIP architectures. In this work, we show how architectural and optimization choices influence the generalization of NNIPs, revealing trends in molecular dynamics (MD) stability, data efficiency, and loss landscapes. Using the 3BPA dataset, we uncover trends in NNIP errors and robustness to noise, showing these metrics are insufficient to predict MD stability in the high-accuracy regime. With a large-scale study on NequIP, MACE, and their optimizers, we show that our metric of loss entropy predicts out-of-distribution error and data efficiency despite being computed only on the training set. This work provides a deep learning justification for probing extrapolation and can inform the development of next-generation NNIPs.

36 MATERIALS SCIENCE↗

Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness

In this article, full waveform inversion (FWI) infers the subsurface structure information from seismic waveform data by solving a non-convex optimization problem. Data-driven FWI has been increasingly studied with various neural network architectures to improve accuracy and computational efficiency. Nevertheless, the applicability of pre-trained neural networks is severely restricted by potential discrepancies between the source function used in the field survey and the one utilized during training. Here, we develop a Fourier-enhanced deep operator network (Fourier-DeepONet) for FWI with the generalization of seismic sources, including the frequencies and locations of sources. Specifically, we employ the Fourier neural operator as the decoder of DeepONet, and we utilize source parameters as one input of Fourier-DeepONet, facilitating the resolution of FWI with variable sources. To test Fourier-DeepONet, we develop three new and realistic FWI benchmark datasets (FWI-F, FWI-L, and FWI-FL) with varying source frequencies, locations, or both. Our experiments demonstrate that compared with existing data-driven FWI methods, Fourier-DeepONet obtains more accurate predictions of subsurface structures in a wide range of source parameters. Moreover, the proposed Fourier-DeepONet exhibits superior robustness when handling data with Gaussian noise or missing traces and sources with Gaussian noise, paving the way for more reliable and accurate subsurface imaging across diverse real conditions.

42 ENGINEERING↗

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗

Design of a Molten Salt Flow Cell for Combined Absorbance and Laser-Induced Breakdown Spectroscopy for Online Measurements

A novel flow cell allowing for multiple optical spectroscopy measurements on flowing molten salts was designed, and demonstrative calibrations of impurities in aqueous samples were performed. Online compositional measurements of molten salts are of high interest to monitor the state of relevant solar and nuclear systems. Here, the Spectroscopic Configuration for Optical Real-Time Characterization of High-Temperature (SCORCH) fluids cell was designed to meet this need by providing optical access to a high-temperature molten salt sample stream without physical contact between the sample and window materials. Laser-induced breakdown spectroscopy (LIBS) was utilized to quantify Li, Cr, Fe, Ni, Sr, and Pr at concentrations ranging nominally from 0 to 315 mmol L −1 . Laser power, frequency, and plasma position were optimized to mitigate challenges associated with sample splashing. Univariate calibration models were built with R 2 > 0.98, percent root mean square error of cross-validation (%RMSECV) as low as 2.7%, and limits of quantification (LOQs) down to 4.1 mmol L −1 . Simultaneously, absorbance calibrations were developed for the applicable analytes (Cr, Ni, and Pr) using Beer’s law with a pathlength of 4.41 ± 0.10 mm. These models provide excellent quantification performance with R 2 > 0.999, %RMSECV as low as 0.6%, and LODs down to 0.08 mmol L −1 . Although these calibrations were performed for each spectroscopic technique separately, the two methods may be combined in the future through multivariate modeling and sensor fusion to provide more robust models with the benefits of both techniques (e.g., absorbance: oxidation state concentrations, LIBS: elemental concentration). Additionally, optimized spectrometers may be deployed to enhance sensitivity.

absorbance spectroscopy↗

Clear-sky detection for PV degradation analysis using multiple regression

A method is presented to detect clear-sky periods for plane-of-array irradiance time-averaged data that is based on the algorithm originally described by Reno and Hansen. Here we show this new method improves the state-of-the-art by providing accurate detection at longer data averaging intervals. Moreover, our new method detects clear periods in plane-of-array data, which is novel. The new method is developed by applying a Design of Experiment approach to optimize the parameters used in the Reno method, and Monte Carlo simulations are used to understand the robustness of the found parameters. Clear-sky detection accuracy is compared among four methods: the Reno method, the default clear-sky filter in RdTools, the Ellis method, and the method outlined in this work, using a hand-labeled two-year data set of 1-min plane-of-array irradiance for a fixed tilt system. The RdTools clear-sky filter is marred by excessive false positives. The other methods all perform well at 1-min data intervals; the method developed here provides more accurate detection at longer data averaging intervals. We show that the parameters are directly linked to the data frequency in the hope that these input variables may not have to be optimized for every data frequency and location. However, only a single fixed system in one location was carefully examined. Finally, we illustrate how accurate determination of clear-sky conditions helps to eliminate data noise and bias in the assessment of long-term performance of PV plants.

14 SOLAR ENERGY↗

Using Filter Methods to Guide Convergence for ADMM, with Applications to Nonnegative Matrix Factorization Problems

Nonconvex, nonlinear optimization problems arise naturally in parameter fitting and machine learning. While augmented Lagrangian methods have demonstrated robust convergence for classes of these problems, their convergence for block updates has been relatively unexplored outside of the context of the alternating direction method of multipliers (ADMM). ADMM has seen extensive use in these applications, but may exhibit uncertain convergence behavior in many practical nonconvex settings, and struggles with general nonlinear constraints. In contrast, filter methods have proved effective in enforcing convergence for sequential quadratic programming methods and interior point methods with feasibility criteria. We develop an ADMM-filter method for highly nonlinear and nonconvex problems. Here, we show convergence under mild assumptions for several types of coordinate descent schemes, and demonstrate our algorithm on nonnegative matrix factorization and completion problems in imaging and chemical spectrum analysis.

Nonconvex optimization↗

Practical algorithms for multivariate rational approximation

We present two approaches for computing rational approximations to multivariate functions, motivated by their effectiveness as surrogate models for high-energy physics (HEP) applications. Our first approach builds on the Stieltjes process to efficiently and robustly compute the coefficients of the rational approximation. Our second approach is based on an optimization formulation that allows us to include structural constraints on the rational approximation (in particular, constraints demanding the absence of singularities), resulting in a semi-infinite optimization problem that we solve using an outer approximation approach. We present results for synthetic and real-life HEP data, and we compare the approximation quality of our approaches with that of traditional polynomial approximations.

97 MATHEMATICS AND COMPUTING↗

Boosting the cycling stability of Ni-rich layered oxide cathode by dry coating of ultrastable Li 3 V 2 (PO 4 ) 3 nanoparticles

Nickel (Ni)-rich layered oxides such as LiNi 0.6 Co 0.2 Mn 0.2 O 2 (NCM622) represent one of the most promising candidates for next-generation high-energy lithium-ion batteries (LIBs). However, the pristine Ni-rich cathode materials usually suffer from poor structural stability during cycling. In this work, we demonstrate a simple but effective approach to improve the cycling stability of the NCM622 cathode by dry coating of ultrastable Li 3 V 2 (PO 4 ) 3 -carbon (LVP-C) nanoparticles, which leads to a robust composite cathode (NCM622/LVP-C) without sacrificing the specific energy density compared with pristine NCM622. The optimal NCM622/LVP-C composite presents a high specific capacity of 162 mA h g -1 at 0.5 C and excellent cycling performance with 85.0% capacity retention after 200 cycles at 2 C, higher than that of the pristine NCM622 (67.6%). Systematic characterization confirms that the LVP-C protective layer can effectively reduce the side reactions, restrict the cation mixing of NCM622 and improve its structural stability. Moreover, the NCM622/LVP-C||graphite full cells also show a commercial-level capacity of 3.2 mA h cm -2 and much improved cycling stability compared with NCM622/LVP-C||graphite full cells, indicating the great promise for low-cost, high-capacity and long-life LIBs.

36 MATERIALS SCIENCE↗

Luminescent MOFs (LMOFs): recent advancement towards a greener WLED technology

The replacement of traditional incandescent, halogen and fluorescent lamps by white light emitting diodes (WLEDs) is expected to reduce the global electricity consumption by one-third by 2030, according to the US Department of Energy. The current WLED technology uses rare-earth element (REE) based phosphor materials, which, not only is cost-intensive but also constitutes an environmental concern. Hence, researchers are in a quest for a new-generation of opto-electronic materials that can replace the conventional phosphors in WLEDs and thus aim towards a cleaner and more energy efficient lighting technology for the future. Luminescent metal–organic frameworks (LMOFs) have recently emerged as a new sub-class of MOFs which have demonstrated enormous potential for applications in sensing, imaging, optoelectronics and in solid-state lighting (SSL) technology. LMOFs could be game changers as lighting phosphors due to advantages such as high luminescence quantum yield, tunable excitation and emission which can be achieved by rational design and optimization of metal centers, linkers, and the guest molecules, facile fabrication into devices, and structural robustness. These clear advantageous features of LMOFs make them score over other contemporary materials, and enable them to be futuristic phosphor materials for WLED technology. Here, in this feature article, we will provide an overview of the most recent developments of LMOF-based phosphor materials for SSL with a special focus on WLED technology. The emphasis will be centered around REE-free LMOFs, as the aim is to direct the attention of the readers towards a more viable and greener lighting technology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Soft x-ray high-harmonic generation in an anti-resonant hollow core fiber driven by a 3 μ m ultrafast laser

High-harmonic upconversion driven by a mid-infrared femtosecond laser can generate coherent soft x-ray beams in a tabletop-scale setup. Here, we report on a compact ytterbium-pumped optical parametric chirped pulse amplifier (OPCPA) laser system seeded by an all-fiber front-end and employing periodically poled lithium niobate (PPLN) nonlinear media operated near the pulse fluence limits of current commercially available PPLN crystals. The OPCPA delivers 3 µm wavelength pulses with 775 µJ energy at 1 kHz repetition rate, with transform-limited 120 fs pulse duration, diffraction-limited beam quality, and ultrahigh 0.33% rms energy stability over >18 h. Using this laser, we generate soft x-ray high harmonics (HHG) in argon gas by focusing into a low-loss, high-pressure gas-filled anti-resonant hollow core fiber (ARHCF), generating coherent light at photon energies up to the argon L-edge (250 eV) and carbon K-edge (284 eV), with high beam quality and ∼1% rms energy stability. This work demonstrates soft x-ray HHG in a high-efficiency guided-wave phase matched geometry, overcoming the high losses inherent to mid-IR propagation in unstructured waveguides, or the short interaction lengths of gas cells or jets. The ARHCF can operate in the long term without damage and with the repetition rate, stability, and robustness required for demanding applications in spectromicroscopy and imaging. Finally, we discuss routes for further optimizing the soft x-ray HHG flux by driving He at higher laser intensities using either the signal (1.5 μm) or idler wavelengths (3 μm).

Femtosecond lasers↗