Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Probing lithium mobility at a solid electrolyte surface

Abstract Solid-state electrolytes overcome many challenges of present-day lithium ion batteries, such as safety hazards and dendrite formation 1,2 . However, detailed understanding of the involved lithium dynamics is missing due to a lack of in operando measurements with chemical and interfacial specificity. Here we investigate a prototypical solid-state electrolyte using linear and nonlinear extreme-ultraviolet spectroscopies. Leveraging the surface sensitivity of extreme-ultraviolet-second-harmonic-generation spectroscopy, we obtained a direct spectral signature of surface lithium ions, showing a distinct blueshift relative to bulk absorption spectra. First-principles simulations attributed the shift to transitions from the lithium 1 s state to hybridized Li- s /Ti- d orbitals at the surface. Our calculations further suggest a reduction in lithium interfacial mobility due to suppressed low-frequency rattling modes, which is the fundamental origin of the large interfacial resistance in this material. Our findings pave the way for new optimization strategies to develop these electrochemical devices via interfacial engineering of lithium ions.

25 ENERGY STORAGE↗
DOE OSTI2022

A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (Biometrika 81(3):425–455, 1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform simulated and real data Monte Carlo experiments to quantify the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Towards sharp error analysis of extended Lagrangian molecular dynamics

The extended Lagrangian molecular dynamics (XLMD) method provides a useful framework for reducing the computational cost of a class of molecular dynamics simulations with constrained latent variables. The XLMD method relaxes the constraints by introducing a fictitious mass ε for the latent variables and solving a set of singularly perturbed ordinary differential equations. While favorable numerical performance of XLMD has been demonstrated in several different contexts in the past decade, mathematical analysis of the method remains scarce. Here, we propose the first error analysis of the XLMD method in the context of a classical polarizable force field model. While the dynamics with respect to the atomic degrees of freedom are general and nonlinear, the key mathematical simplification of the polarizable force field model is that the constraints on the latent variables are given by a linear system of equations. We prove that when the initial value of the latent variables is compatible in a sense that we define, XLMD converges as the fictitious mass ε is made small with $\mathscr{O}$(ε) error for the atomic degrees of freedom and with $\mathscr{O}$($\sqrt{ε}$) error for the latent variables, when the dimension of the latent variable d' is 1. Furthermore, when the initial value of the latent variables is improved to be optimally compatible in a certain sense, we prove that the convergence rate can be improved to $\mathscr{O}$(ε) for the latent variables as well. Numerical results verify that both estimates are sharp not only for d'=1, but also for arbitrary d'. In the setting of general d', we do obtain convergence, but with the non-sharp rate of $\mathscr{O}$($\sqrt{ε}$) for both the atomic and latent variables.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

PhaseT3M: 3D imaging at 1.6 Å resolution via electron cryo-tomography with nonlinear phase retrieval

Electron cryo-tomography (cryo-ET) enables 3D imaging of complex, radiation-sensitive structures with molecular detail. However, image contrast from the interference of scattered electrons is nonlinear with atomic density and multiple scattering further complicates interpretation. These effects degrade resolution, particularly in conventional reconstruction algorithms, which assume linearity. Particle averaging can reduce such issues but is unsuitable for heterogeneous or dynamic samples ubiquitous in biology, chemistry, and materials sciences. Here, we develop a phase retrieval-based cryo-ET method, PhaseT3M. We experimentally demonstrate its application to an approximately 7 nm Co3O4 nanoparticle on an approximately 30 nm carbon substrate, achieving a maximum resolution of 1.6 Å, surpassing conventional limits using standard cryo-TEM equipment. PhaseT3M uses a multislice model for multiple scattering and Bayesian optimization for alignment and computational aberration correction, with a positivity constraint to recover ‘missing wedge’ information. Applied directly to biological particles, it enhances reconstruction quality and reduces artifacts, establishing a standard for routine 3D imaging with phase contrast.

Biophysics↗
DOE OSTI2021

Design of a compact, cryogen-free superconducting solenoid for the electron lens of the Fermilab Integrable Optics Test Accelerator (IOTA)

The proposed electron lens for Fermilab's Integrable Optics Test Accelerator (IOTA) will broaden its capabilities by enabling new research in nonlinear integrable optics, space-charge compensation, proton beam cooling, and more. The electron lens is based on a 5–10 keV, 1–2 A electron beam, shaped using a 0.7 m long, 0.8 T solenoidal magnetic field. A cryogen-free superconducting solenoid has been designed to provide this solenoidal field, taking into consideration the constraints on space, utilities, and infrastructure in the IOTA experimental hall. The solenoid is made of copper stabilized niobium-titanium conductor, conduction-cooled using 4 K closed-cycle cryocoolers. This paper describes the overall design of the solenoid encompassing its mechanical construction, current leads optimization, cryogenic thermal modeling that provides estimates of cooldown time and static/dynamic heat loads, and quench analysis.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

PINCH POINT ANALYSIS OF GAS COOLERS IN TRANSCRITICAL R1336mzz(Z) HIGH-TEMPERATURE HEAT PUMPS

The majority of high-temperature heat pumps (HTHPs) operate subcritical vapor compression cycles, where the maximum sink temperature is limited by the critical temperature of refrigerants. In HTHPs with a sink temperature of ≥ 150°C, transcritical cycles overcome this limitation by rejecting heat in the supercritical regions of refrigerant. Supercritical refrigerants in gas coolers have a large temperature glide and substantial nonlinear variation in specific heat capacity vs. temperature. Closely matching the refrigerant glide temperature and the heat sink temperature profile greatly impacts the heat transfer characteristic of gas coolers and the overall performance of HTHPs. This study conducts a pinch point analysis for the gas cooling process of supercritical R1336mzz(Z) in HTHPs. A finite volume element model of a supercritical R1336mzz(Z) counterflow gas cooler is built and solved. This study evaluates the influences of operating conditions, including inlet and outlet of coolants, refrigerant evaporation temperature and superheat degree, pinch temperature difference, and heat rejection pressure, on the performance of HTHPs. The optimal discharge pressures in gas coolers are proposed for industrial spray dryers in providing drying air at 170°C−210°C. The results of the present study help design gas coolers in transcritical R1336mzz(Z) HTHPs.

Wang, Pengtao↗
DOE OSTI2023

Multifidelity validation of digital surrogates using variable-density turbulent mixing models

In this study, ensembles of experimental data are presented and utilized to compare and validate two models used in the simulation of variable-density (Atwood = 0.22), compressible turbulent mixing. Though models of this kind (Reynolds averaged NavierStokes and large-eddy simulations) have been validated extensively with more canonical flows in previous studies, here the present approach offers novelty in the complexity of the geometry, the ensemble-based validation, and the uniformity of the computational framework on which the models are tested. Moreover, all experimental and computational tasks were completed by the authors which has led to a tightly coupled experimental configuration with its “digital twin.” The experimental divergent-shock-tube facility and its data acquisition methods are described and replicated in simulation space. A 2D Euler model which neglects the turbulent mixing at the interface is optimized to experimental data using a Gaussian process. This model then serves as the basis for both the 2D RANS and 3D LES studies that make comparisons to the mixing-layer data from the experiment. A relatively simple RANS model is shown to produce good agreement with experimental data only at late flow development times. The LES ensembles generally show good agreement with experimental data but display sensitivity to the characterization of initial conditions. Resolution-dependent behavior is also observed for certain higher-order statistics of interest. Overall, the LES model successfully captures the effects of divergent geometry, compressibility, and combined nonlinear instabilities inherent to the problem. The successful prediction of mixing width and its growth rate highlight the existence of three distinct regimes in the development of the instability, each with similarities to previously studied instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Instability Issue of Paralleled Dies in an SiC Power Module in Solid-State Circuit Breaker Applications

Paralleled dies in a power module could have instability issues during high current switching transients. Here, the instability is caused by the differential-mode oscillation among paralleled MOSFETs. Conventional analyses of paralleled MOSFETs’ stability are normally limited to a single operating point, which ignores the influences of the switching trajectory and nonlinear device parameters on stability. This article reveals that the switching trajectory can significantly influence parallel stability. The analysis is improved by solving eigenvalues of state-space modeling system matrices of all operating points that the switching trajectory goes through considering nonlinear device parameters. Higher voltage and current stresses result in greater real parts of complex eigenvalues, which explains why the paralleled MOSFETs are more unstable with higher voltage and current stresses. To improve stability in solid-state circuit breaker applications, we propose a method to manipulate the switching trajectory to avoid the unstable region where the conventional hard switching trajectory normally goes through. Experimental results show that the turn- off current capability can be increased from ~five times of rated current with the gate oscillation using the conventional turn- off trajectory to ~ten times of rated current without the gate oscillation using the optimal turn- off trajectory.

42 ENGINEERING↗
DOE OSTI2021

Application of real‐time nonlinear model predictive control for wave energy conversion

Abstract This article presents an approach to implement a Nonlinear Model Predictive Controller (NMPC) in real‐time with a non‐standard cost index. The proposed technique's applications are presented to maximize the energy produced by a Wave Energy Converter (WEC) when the cost index is a non‐quadratic piecewise discontinuous functional of some design variables. The presented framework is based on pseudo‐quadratisation and weight scheduling, which is implemented using the ACADO toolkit for MATLAB/Simulink. The proposed strategy features code generation and deployment on the real‐time target machines for industrial applications. The simulations and experiments confirm the success of the proposed approach in achieving the feasible operation of the NMPC and an optimal power capture by the wave energy converters.

16 TIDAL AND WAVE POWER↗
DOE OSTI2022

Sequential Decision Making (SDM) for Mesh Refinement and Model Selection in Multiscale, Multi-Physics Applications

Intelligent automation and decision support are needed to enhance computational efficiency and robustness in multiscale and multi-physics problems, including materials science, manufacturing, and climate and weather modeling. Current scientific computing approaches for enabling decisions by scientists fail to explore the role of learning, reasoning, and probabilistic planning. Often these decisions are not performed in real-time during the computation but are made prior to the start of the computation, which must be interrupted in order to make changes to the prior choices. Such interruptions at different stages of the computation increase the total computing time and the need for a human expert to frequently monitor the results. State of art scientific computing methods consist of rule-based algorithms that cannot automatically adapt to a dynamically changing computing environment. The development of a Sequential Decision Making (SDM) framework will automate scientific computing by optimizing the policies for mesh refinement, time-stepping, model and algorithm selection, resource allocation, and pre and post-processing. Our agent SDM framework for scientific computing will consist of data-driven learning (Classifier), automated reasoning (contextual knowledge), and probabilistic planning (Reinforcement Learning). In this project, we focused on three problems to demonstrate our SDM framework on a set of ordinary and partial differential equations. Classification of Lorenz system regions using Feed-Forward Neural Networks examined learning in the SDM framework. On the other hand, reasoning and planning in the SDM framework were used in two problems: adaptive time-stepping for nonlinear ODEs using on-policy RL algorithms, and adaptive mesh refinement for 2-D PDEs using off-policy RL algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Convergence Criteria for Multiphysics Simulations

The behavior of engineered systems is often influenced by multiple physical phenomena, such as mechanical deformation, heat transfer, and chemical species transport and reactions. There are often strong interactions between these phenomena, and there is increasing interest in applying coupled-physics models to improve understanding of physical behavior under complex environmental conditions. Multiple simulation frameworks that facilitate coupled-physics simulations are in widespread use, and these employ a variety of techniques to account for interactions between those physics. Many frameworks solve the physics models independently and transfer results between them. Alternatively, a single monolithic system of equations for every physics model can be formed and solved. Each of these approaches has its benefits and drawbacks, and the optimal approach varies depending on the nature of the problem. The open-source MOOSE framework was developed targeting solution of large-scale multiphysics problems. Although it provides options for all these coupling approaches, its standard approach for multiphysics solutions is to form and solve a single monolithic system of equations containing the unknowns for all physics models. MOOSE provides a streamlined approach for users to define the solution variables, the terms in the partial differential equations pertaining to each variable, and interactions between solution variables. One aspect of the monolithic solution approach that can be problematic, however, is defining appropriate convergence criteria for the nonlinear system. A standard approach is to determine convergence is to simply take a norm of the residual vector corresponding to the full vector of unknowns. However, if the residual vector contains variables for multiple physics models, the magnitudes of those variables can differ significantly, and the variables can converge at significantly different rates from each other. It is important to ensure that the variables for each of the physics are converged, and also ensure that the convergence criteria are not excessively stringent in cases when there is little change in the solution. This talk presents representative multiphysics problems to highlight these issues, and shows strategies for convergence criteria in MOOSE that are robust for multiphysics models under a variety of conditions.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Dynamic Modeling, Parameter Estimation, and Data Reconciliation of a Supercritical Pulverized Coal-Fired Boiler

A high-fidelity, spatially distributed dynamic model of a supercritical pulverized coal-fired boiler was developed for calculating transient thermal profiles of the boiler tubes, which are often not measured or unmeasurable in industrial settings due to the harsh operating conditions. In this work, rigorous models of the subcritical and supercritical steam properties, which can be highly nonlinear, were used to capture the transition between two-phase and one-phase flow, respectively, as supercritical boilers frequently transition through the critical point during load-following operation. The transient boiler model was also used for data reconciliation and parameter estimation for the purpose of model validation against industrial data. An approach was developed to reduce the size of large-scale reconciliation problem by focusing on the implementation of bias terms for the reconciled variables, which can be estimated in place of the reconciled variables themselves. In addition, a functional approximation of the reconciliation problem was defined so that it can be more simply optimized. Combining this functional approximation optimization with reformulation of the reconciliation problem considering measurement biases can significantly improve the tractability of many such large-scale problems. The validated boiler model was then used to study transient responses under load-following operation with specific attention on the calculation of unmeasurable variables.

42 ENGINEERING↗
DOE OSTI2024

Tracking the topology of neural manifolds across populations

Neural manifolds summarize the intrinsic structure of the information encoded by a population of neurons. Advances in experimental techniques have made simultaneous recordings from multiple brain regions increasingly commonplace, raising the possibility of studying how these manifolds relate across populations. However, when the manifolds are nonlinear and possibly code for multiple unknown variables, it is challenging to extract robust and falsifiable information about their relationships. We introduce a framework, called the method of analogous cycles, for matching topological features of neural manifolds using only observed dissimilarity matrices within and between neural populations. We demonstrate via analysis of simulations and in vivo experimental data that this method can be used to correctly identify multiple shared circular coordinate systems across both stimuli and inferred neural manifolds. Conversely, the method rejects matching features that are not intrinsic to one of the systems. Further, as this method is deterministic and does not rely on dimensionality reduction or optimization methods, it is amenable to direct mathematical investigation and interpretation in terms of the underlying neural activity. We thus propose the method of analogous cycles as a suitable foundation for a theory of cross-population analysis via neural manifolds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

PETSc TSAdjoint: A Discrete Adjoint ODE Solver for First-Order and Second-Order Sensitivity Analysis

Here, we present a new software system PETSc TSAdjoint for first-order and second order adjoint sensitivity analysis of time-dependent nonlinear differential equations. The derivative calculation in PETSc TSAdjoint is essentially a high-level algorithmic differentiation process. The adjoint models are derived by differentiating the timestepping algorithms and implementing them based on the parallel infrastructure in PETSc. Full differentiation of the library code, including MPI routines, is avoided, and users do not need to derive their own adjoint models for their specific applications. PETSc TSAdjoint can compute the first-order derivative, that is, the gradient of a scalar functional, and the Hessian-vector product, which carries second-order derivative information, while requiring minimal input (a few callbacks) from the users. The adjoint model employs optimal checkpointing schemes in a manner that is transparent to users. Finally, usability, efficiency, and scalability are demonstrated through examples from a variety of applications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Toward fusion plasma scenario planning for NSTX-U using machine-learning-accelerated models

One of the most promising devices for realizing power production through nuclear fusion is the tokamak. To maximize performance, it is preferable that tokamak reactors achieve advanced operating scenarios characterized by good plasma confinement, improved magnetohydrodynamic (MHD) stability, and a largely non-inductively driven plasma current. Such scenarios could enable steady-state reactor operation with high \emph{fusion gain} --- the ratio of produced fusion power to the external power provided through the plasma boundary. Precise and robust control of the evolution of the plasma boundary shape as well as the spatial distribution of the plasma current, density, temperature, and rotation will be essential to achieving and maintaining such scenarios. The complexity of the evolution of tokamak plasmas, arising due to nonlinearities and coupling between various parameters, motivates the use of model-based control algorithms that can account for the system dynamics. In this work, a learning-based accelerated model trained on data from the National Spherical Torus Experiment Upgrade (NSTX-U) is employed to develop planning and control strategies for regulating the density and temperature profile evolution around desired trajectories. The proposed model combines empirical scaling laws developed across multiple devices with neural networks trained on empirical data from NSTX-U and a database of first-principles-based computationally intensive simulations. The reduced execution time of the accelerated model will enable practical application of optimization algorithms and reinforcement learning approaches for scenario planning and control development. An initial demonstration of applying optimization approaches to the learning-based model is presented, including a strategy for mitigating the effect of leaving the finite validity range of the accelerated model. The approach shows promise for actuator planning between experiments and in real-time.

machine learning↗
DOE OSTI2021

Disjunctive linear separation conditions and mixed-integer formulations for aircraft conflict resolution

In this paper, we address the aircraft conflict resolution problem in air traffic control. We introduce new mixed-integer programming formulations for aircraft conflict resolution with speed, heading and altitude control which are based on disjunctive linear separation conditions. We first examine the two-dimensional aircraft conflict resolution problem with speed and heading control represented as continuous decision variables. We show that the proposed disjunctive linear separation conditions are equivalent to the classical nonlinear conditions for aircraft separation. Further, we characterise conflict-free trajectories based on aircraft velocity bounds and propose a simple pre-processing algorithm to identify aircraft pairs which are either always conflict-free, or which cannot be separated using speed and heading control only. We then incorporate altitude control and propose a lexicographic optimisation formulation that aims to minimise the number of flight level changes before resolving outstanding conflicts via two-dimensional velocity control. The proposed mixed-integer programming formulations are nonconvex, and we propose convex relaxations, decomposition methods and constraint generation algorithms to solve the two-dimensional and lexicographic optimisation formulations to guaranteed optimality. Numerical experiments on four types of conflict resolution benchmarking instances are conducted to test the performance of the proposed mixed-integer formulations. Further, the proposed method is compared against two benchmarks based on state-of-the-art approaches for the aircraft conflict resolution problem. Our numerical results show that the proposed method largely outperforms both benchmarks in terms of runtime and is able to solve significantly more instances to global optimality.

97 MATHEMATICS AND COMPUTING↗