Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “(non)linear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Building an AI-enhanced modeling framework to address multiscale predictability challenges

Focal Area(s): Build an AI-enhanced modeling framework that integrates the three focus areas in the solicitation. Science Challenge: The 4M-2N complexities (Multiscale, Multiphysics, Multibody, Multidimension, Non-linearity, and Non-Gaussianality) of atmospheric aerosol-cloud-precipitation-turbulence-radiation system poses physical and computational challenges to further advance predictive models; We plan to address the challenges by developing an AI-enhanced modeling framework that facilitates automated calibration and improvement of subgrid parameterizations, enhance data assimilation of measurements to improve initial and boundary conditions used to drive the physical model, and optimally blends data-driven and physics-based forecasting models.

54 ENVIRONMENTAL SCIENCES↗

MARBLE: A Multi-GPU Aware Job Scheduler for Deep Learning on HPC Systems

Deep learning (DL) has become a key tool for solving complex scientific problems. However, managing the multi-dimensional large-scale data associated with DL, especially atop extant multiple graphics processing units (GPUs) in modern supercomputers poses significant challenges. Moreover, the latest high-performance computing (HPC) architectures bring different performance trends in training throughput compared to the existing studies. Existing DL optimizations such as larger batch size and GPU locality-aware scheduling have little effect on improving DL training throughput performance due to fast CPU-to-GPU connections. Additionally, DL training on multiple GPUs scales sublinearly. Thus, simply adding more GPUs to a system is ineffective. To this end, we design MARBLE, a first-of-its-kind job scheduler, which considers the non-linear scalability of GPUs at the intra-node level to schedule an appropriate number of GPUs per node for a job. By sharing the GPU resources on a node with multiple DL jobs, MARBLE avoids low GPU utilization in current multi-GPU DL training on HPC systems. Our comprehensive evaluation in the Summit supercomputer shows that MARBLE is able to improve DL training performance by up to 48.3% compared to the popular Platform Load Sharing Facility (LSF) scheduler. Compared to the state-of-the-art of DL scheduler, Optimus, MARBLE reduces the job completion time by up to 47%.

Han, Jingoo↗

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Non-linear hydrologic organization

We revisit three variants of the well-known Stommel diagrams that have been used to summarize knowledge of characteristic scales in time and space of some important hydrologic phenomena and modified these diagrams focusing on spatiotemporal scaling analyses of the underlying hydrologic processes. In the present paper we focus on soil formation, vegetation growth, and drainage network organization. We use existing scaling relationships for vegetation growth and soil formation, both of which refer to the same fundamental length and timescales defining flow rates at the pore scale but different powers of the power law relating time and space. The principle of a hierarchical organization of optimal subsurface flow paths could underlie both root lateral spread (RLS) of vegetation and drainage basin organization. To assess the applicability of scaling, and to extend the Stommel diagrams, data for soil depth, vegetation root lateral spread, and drainage basin length have been accessed. The new data considered here include timescales out to 150 Myr that correspond to depths of up to 240 m and horizontal length scales up to 6400 km and probe the limits of drainage basin development in time, depth, and horizontal extent.

58 GEOSCIENCES↗

Piecewise linear approximation with minimum number of linear segments and minimum error: A fast approach to tighten and warm start the hierarchical mixed integer formulation

In several areas of economics and engineering, it is often necessary to fit discrete data points or approximate nonlinear functions with continuous functions. Piecewise linear (PWL) functions are a convenient way to achieve this. PWL functions can be modeled in mathematical problems using only linear and integer variables. Moreover, there is a computational benefit in using PWL functions that have the least possible number of segments. This work proposes a novel hierarchical mixed integer linear programming (MILP) formulation that identifies a continuous PWL approximation with minimum number of linear segments for a given target maximum error. The proposed MILP formulation also identifies the solution with the least maximum error among the solutions with minimum number of segments. Then, this work proposes a fast iterative algorithm that identifies non necessarily continuous PWL approximations by solving O(S log N) linear programming (LP) problems, where N is the number of data points and S is the minimum number of segments in the non necessarily continuous case. This work demonstrates that tight bounds for the MILP problem can be derived from these approximations. Next, a fast algorithm is introduced to transform a non necessarily continuous PWL approximation into a continuous one. Finally, the tight bounds and the continuous PWL approximations are used to tighten and warm start the MILP problem. The tightened formulation is shown in experimental results to be more efficient, especially for large data sets, with a solution time that is up to two orders of magnitude less than the existing literature.

97 MATHEMATICS AND COMPUTING↗

On relaxations of the max k -cut problem formulations

Here, a tight continuous relaxation is a crucial factor in solving mixed integer formulations of many NP-hard combinatorial optimization problems. The (weighted) max k-cut problem is a fundamental combinatorial optimization problem with multiple notorious mixed integer optimization formulations. In this paper, we explore four existing mixed integer optimization formulations of the max k-cut problem. Specifically, we show that the continuous relaxation of a binary quadratic optimization formulation of the problem is: (i) stronger than the continuous relaxation of two mixed integer linear optimization formulations and (ii) at least as strong as the continuous relaxation of a mixed integer semidefinite optimization formulation. We also conduct a set of experiments on multiple sets of instances of the max k-cut problem using state-of-the-art solvers that empirically confirm the theoretical results in item (i). Furthermore, these numerical results illustrate the advances in the efficiency of global non-convex quadratic optimization solvers and more general mixed integer nonlinear optimization solvers. As a result, these solvers provide a promising option to solve combinatorial optimization problems. Our codes and data are available on GitHub.

97 MATHEMATICS AND COMPUTING↗

The virtual element method for linear elastodynamics models: Design, analysis, and implementation

We design the conforming virtual element method for the numerical simulation of two dimensional time-dependent elastodynamics problems. We investigate the performance of the method both theoretically and numerically. We prove the stability and the convergence of the semi-discrete approximation in the energy norm and derive optimal error estimates. We also show the convergence in the L 2 norm. The performance of the virtual element method is assessed on a set of different computational meshes, including non-convex cells up to order four in the h-refinement setting. Exponential convergence is also experimentally seen in the p-refinement setting.

97 MATHEMATICS AND COMPUTING↗

Finch: Toxicity Dose Response Curve Prediction of Chemical Compounds and Mixtures

A paradigm shift in chemical risk assessment is emphasizing mixture testing over single compound analysis, eliminating animal testing, and adopting advanced modeling approaches to understand mixture activity profiles. However, existing computational models largely focus on single chemicals, with few effective solutions for modeling complex mixtures that account for synergistic or antagonistic effects and multiple Modes of Action (MoA). Conventional methods like concentration addition (CA) and independent action (IA) are insufficient for this task as they are designed for simplistic interactions and struggle to account for the dynamic and multifaceted nature of chemical mixtures, such as overlapping MoA and non-linear interactions. Finch offers a novel approach utilizing deep learning (DL) embeddings and multi-task quantitative structure-activity relationship (QSAR) models to improve chemical exposure prediction. By leveraging molecular descriptors, physiochemical properties, and large language model (LLM) embeddings from SMILES inputs, Finch preserves critical information in a latent space thereby enhancing predictive accuracy. The multi-task learning aspect of Finch is highly advantageous, as it simultaneously optimizes multiple loss functions, leveraging all available data across tasks to develop generalized representations that effectively capture complex ingredient interactions within mixtures.

59 BASIC BIOLOGICAL SCIENCES↗

DIII-D research to provide solutions for ITER and fusion energy

The DIII-D tokamak has elucidated crucial physics and developed projectable solutions for ITER and fusion power plants in the key areas of core performance, boundary heat and particle transport, and integrated scenario operation, with closing the core-edge integration knowledge gap being the overarching mission. New experimental validation of high-fidelity, multi-channel, non-linear gyrokinetic turbulent transport models for ITER provides strong confidence it will achieve Q ≥ 10 operation. Experiments identify options for easing H-mode access in hydrogen, and give new insight into the isotopic dependence of transport and confinement. Analysis of 2,1 islands in unoptimized low-torque IBS demonstration discharges suggests their onset time occurs randomly in the constant β phase, most often triggered by non-linear 3-wave coupling, thus identifying an NTM seeding mechanism to avoid. Pure deuterium SPI for disruption mitigation is shown to provide favorable slow cooling, but poor core assimilation, suggesting paths for improved SPI on ITER. At the boundary, measured neutral density and ionization source fluxes are strongly poloidally asymmetric, implying a 2D treatment is needed to model pedestal fuelling. Detailed measurements of pedestal and SOL quantities and impurity charge state radiation in detached divertors has validated edge fluid modelling and new self-consistent 'pedestal-to-divertor' integrated modeling that can be used to optimize reactors. New feedback adaptive ELM control minimizes confinement reduction, and RMP ELM suppression with sustained high core performance was obtained for the first time with the outer strike point in a W-coated, compact and unpumped small-angle slot divertor. Advances have been made in integrated operational scenarios for ITER and power plants. Wide pedestal intrinsically ELM-free QH-modes are produced with more reactor-relevant conditions, Low torque IBS with W-equivalent radiators can exhibit predator-prey oscillations in Te and radiation which need control. High-β P scenarios with q min > 2, q 95 –7.9, β N > 4, β T –3.3% and H 98y2 > 1.5 are sustained with high density ($\overline{n}$ = 7E19 m -3 , f G –1) for 6 τ E , improving confidence in steady-state tokamak reactors. Diverted NT plasmas achieve high core performance with a non-ELMing edge, offering a possible highly attractive core-edge integration solution for reactors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SRF Resonators for a bi-directional Energy Ramping Upgrade of the Isotope Production Facility Beamline at LANL

The LANL Isotope Production Facility (IPF) is one of the two high-current proton linear accelerators operated under the auspices of the DOE Office of Nuclear Physics Isotope Development and Production for Research Applications Program. The IPF beamline operates with a fixed 100-MeV energy proton beam, diverted from the LANSCE accelerator and guided towards the isotope production target station. The fixed beam energy limits the number of isotopes that can be produced at IPF, and adversely affects the purity of isotopes produced at non-optimal energies. In particular, the IPF program is receiving increasing numbers of requests for high purity isotopes such as Np-236 (national security applications) and Re-186 (medical therapy). These are typically produced via (p,n) and (p,2n) nuclear reactions, requiring very tight control of the incident energies on the production targets to ensure an end product with a high radionuclidic purity. It is well known that this level of energy control cannot be achieved when a 100 MeV beam of mono-energetic protons is degraded to the required energies, typically below 30 MeV, as too much energy spread is acquired. Operating the IPF beamline at lower, mono-energetic beam energies such as at 40 MeV will allow the required tight energy control in target assemblies to ensure a high purity product. In addition, NP has requested a LANL/BNL/ORNL collaboration focus on establishing a national large-scale production capability for the therapy isotope Ac-225. Recent nuclear cross section measurements done at LANL show that due to a steep rise in production cross section towards higher proton energies (See Figure 2), proton beams at energies substantially greater than 100 MeV will be highly beneficial for Ac-225 production [AC255]. Such higher-energy beams cannot be delivered to IPF at present. Lower-energy beams (70 MeV and 40 MeV) can be delivered but only in sole-use mode; all other LANSCE users must be offline during 70 MeV or 40 MeV operation.

07 ISOTOPE AND RADIATION SOURCES↗

Solving the Dynamics-Aware Economic Dispatch Problem with the Koopman Operator

The dynamics-aware economic dispatch (DED) problem embeds low-level generator dynamics and operational constraints to enable near real-time scheduling of generation units in a power network. DED produces a more dynamic supervisory control policy than traditional economic dispatch (T-ED) that reduces overall generation costs. However, in contrast to T-ED, DED is a nonlinear, non-convex optimization problem that is computationally prohibitive to solve. We introduce a machine learning-based operator-theoretic approach for solving the DED problem efficiently. Specifically, we develop a novel discrete-time Koopman Operator (KO) formulation that embeds domain information into the structure of the KO to learn high-fidelity approximations of the generator dynamics. Using the KO approximation, the DED problem can be reformulated as a computationally tractable linear program (abbreviated DED-KO). We demonstrate the high solution quality and computational-time savings of the DED-KO model over the original DED formulation on a 9-bus test system.

King, Ethan↗

Dynamic Ride-Matching for Large-Scale Transportation Systems

Efficient dynamic ride-matching (DRM) in large-scale transportation systems is a key driver in transport simulations to yield answers to challenging problems. Although the DRM problem is simple to solve, it quickly becomes a computationally challenging problem in large-scale transportation system simulations. Therefore, this study thoroughly examines the DRM problem dynamics and proposes an optimization-based solution framework to solve the problem efficiently. To benefit from parallel computing and reduce computational times, the problem’s network is divided into clusters utilizing a commonly used unsupervised machine learning algorithm along with a linear programming model. Then, these sub-problems are solved using another linear program to finalize the ride-matching. At the clustering level, the framework allows users adjusting cluster sizes to balance the trade-off between the computational time savings and the solution quality deviation. A case study in the Chicago Metropolitan Area, U.S., illustrates that the framework can reduce the average computational time by 58% at the cost of increasing the average pick up time by 26% compared with a system optimum, that is, non-clustered, approach. Another case study in a relatively small city, Bloomington, Illinois, U.S., shows that the framework provides quite similar results to the system-optimum approach in approximately 62% less computational time.

33 ADVANCED PROPULSION SYSTEMS↗

The arbitrary-order virtual element method for linear elastodynamics models. Convergence, stability and dispersion-dissipation analysis.

We design the conforming virtual element method for the numerical approximation of the two dimensional elastodynamics problem. We prove stability and convergence of the semi-discrete approximation and derive optimal error estimates under $\textit{h}$-refinement in both the energy and the $L^2$ norms, and optimal error estimates under $\textit{p}$-refinement in the energy norm. The performance of the proposed virtual element method is assessed on a set of different computational meshes, including non-convex cells up to order four in the h-refinement setting. Exponential convergence is also experimentally observed under p-refinement. Finally, we present a dispersion-dissipation analysis for both the semi-discrete and fully-discrete schemes, showing that polygonal meshes behave as classical simplicial/quadrilateral grids in terms of dispersion-dissipation properties.

97 MATHEMATICS AND COMPUTING↗

Perfecting one-loop BCJ numerators in SYM and supergravity

We take a major step towards computing D-dimensional one-loop amplitudes in general gauge theories, compatible with the principles of unitarity and the color-kinematics duality. For n-point amplitudes with either supersymmetry multiplets or generic non-supersymmetric matter in the loop, simple all-multiplicity expressions are obtained for the maximal cuts of kinematic numerators of n-gon diagrams. At n = 6, 7 points with maximal supersymmetry, we extend the cubic-diagram numerators to encode all contact terms, and thus solve the long-standing problem of simultaneously realizing the following properties: color-kinematics duality, manifest locality, optimal power counting of loop momenta, quadratic rather than linearized Feynman propagators, compatibility with double copy as well as all graph symmetries. Color-kinematics dual representations with similar properties are presented in the half-maximally supersymmetric case at n = 4, 5 points. The resulting gauge-theory integrands and their supergravity counterparts obtained from the double copy are checked to reproduce the expected ultraviolet divergences.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Isogeometric Bézier dual mortaring: The Kirchhoff–Love shell problem

Here in this paper we develop an isogeometric Bézier dual mortar method for coupling multi-patch Kirchhoff–Love shell structures. The proposed approach weakly enforces the continuity of the solution at patch interfaces through a dual mortar method and can be applied to both conforming and non-conforming discretizations. As the employed dual basis functions have local supports and satisfy the biorthogonality property, the resulting stiffness matrix is sparse. In addition, the coupling accuracy is optimal because the dual basis possesses the polynomial reproduction property. We also formulate the continuity constraints through the Rodrigues’ rotation operator which gives a unified framework for coupling patches that are intersected with G 1 continuity as well as patches that meet at a kink. Several linear and nonlinear examples demonstrated the performance and robustness of the proposed coupling techniques.

42 ENGINEERING↗

Accurate and efficient open-source implementation of domain-based local pair natural orbital (DLPNO) coupled-cluster theory using a t1-transformed Hamiltonian

We present an efficient, open-source formulation for coupled-cluster theory through perturbative triples with domain-based local pair natural orbitals [DLPNO-CCSD(T)]. Similar to the implementation of the DLPNO-CCSD(T) method found in the ORCA package, the most expensive integral generation and contraction steps associated with the CCSD(T) method are linear-scaling. In this work, we show that the t1-transformed Hamiltonian allows for a less complex algorithm when evaluating the local CCSD(T) energy without compromising efficiency or accuracy. Our algorithm yields sub-kJ mol−1 deviations for relative energies when compared with canonical CCSD(T), with typical errors being on the order of 0.1 kcal mol−1, using our TightPNO parameters. We extensively tested and optimized our algorithm and parameters for non-covalent interactions, which have been the most difficult interaction to model for orbital (PNO)-based methods historically. To highlight the capabilities of our code, we tested it on large water clusters, as well as insulin (787 atoms).

Chemistry↗

HHL algorithm with mapping function and enhanced sampling for model predictive control in microgrids

Here, this paper presents a refined quantum Harrow Hassidim Lloyd (HHL) algorithm for microgrid control. The first novelty of the developed method is that a mapping shift function enables the original HHL algorithm to handle general linear equations with non-singular and indefinite matrix. Second, a method of Matrix Extension for Amplifying Sampling Probabilities of Intended Solution (ME-ASPI) is proposed to design the reformulated linear algebraic equations, allowing for improved sampling efficiency of the quantum tomography in the refined HHL algorithm. Then, we applied the method to solve the model predictive control (MPC) problem in nonlinear dynamical microgrids. Specifically, with the ME-ASPI method, the refined HHL algorithm can effectively obtain the intended partial optimal control inputs for MPC. The optimization of quadratic programming problem in each time step of MPC is transformed into a linear system problem, which is addressed by the proposed quantum solver through using only partial information, with the time complexity improved from $\mathscr{O}(\mathscr{N}^{2.37286})$ classically to $\mathscr{O}(\mathscr{N}^{2} log \mathscr{N}$ x $p$ log $p)$ in quantum. Numerical examples have validated the effectiveness of the refined HHL algorithm with the proposed mapping function and the ME-ASPI method. By leveraging quantum properties, the proposed method provides a hybrid quantum–classical framework for microgrid control. This generic method can also potentially tackle many other challenges in analyzing and controlling general complex engineered systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗