Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Modeling Nonperturbative Field-Driven Vibronic Dynamics: Selective State Preparation and Nonlinear Spectroscopy

The partially linearized density matrix formalism for nonadiabatic dynamics is adapted to incorporate a classical external electromagentic field into the system Hamiltonian. This advancement encompasses the possibility of describing field-driven dynamics and computing a variety of linear and nonlinear spectroscopic signals beyond the perturbative limit. Here, the capabilities of the developed approach are demonstrated on a simple two-state vibronic model coupled to a bath, for which we (a) perform an exhaustive search in the field parameter space for optimal state preparation and (b) compute time-resolved transient absorption spectroscopy to monitor the effect of different pulse shapes on measurable experimental signals. While no restrictions on the form of the field have to be assumed, we focus here on Gaussian shaped (linearly) chirped pulses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Lifetime renormalization of weakly anharmonic superconducting qubits. I. Role of number nonconserving terms

The dynamics of a weakly anharmonic superconducting qubit in a complex electromagnetic environment is generally well described by an effective multimode Kerr Hamiltonian at sufficiently weak excitation. This Hamiltonian can be embedded in a master equation with losses determined by the details of the electromagnetic environment. Recent experiments indicate, however, that when a superconducting circuit is driven with microwave signals populating the system with sufficiently high excitations, the observed relaxation rates appear to be substantially different from expectations based on the electromagnetic environment of the qubit alone. This issue is a limiting factor in the optimization of superconducting qubit readout schemes. We claim here that an effective master equation with drive-power-dependent parameters is an efficient approach to model such quantum dynamics. In this sequence of papers, we derive effective master equations, whose parameters exhibit nonlinear dependence on the excitation level of the circuit as well as the electromagnetic environment of the qubit. Further, we show that the number nonconserving terms in the qubit nonlinearity generally lead to a renormalization of dissipative parameters of the effective master equation, while the number conserving terms give rise to a renormalization of the system frequencies. Here, in Paper I, we consider the excitation-relaxation dynamics of a transmon qubit that is prepared in a certain initial state, but is not driven otherwise. A unitary transformation technique is introduced to study the renormalization of (i) qubit relaxation due to coupling to a generic bath and (ii) Purcell decay. Analytic expressions are provided for the dependence of the nonlinear dissipative terms on the details of the electromagnetic environment of the qubit. The perturbation technique based on unitary transformations developed here is generalized to the continuously driven case in Paper II.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Improving cosmological analyses of HI clustering by reducing stochastic noise

High-number-density tracers of large-scale structure, such as the HI-rich galaxies measured by 21 cm intensity mapping, have low sampling noise, making them particularly promising as cosmological probes. At large scales, this sampling noise can be subdominant to other scale-independent contributions to the power spectrum; such contributions arise from nonlinear bias, and exceed the sampling noise if at least one of the associated bias coefficients is sufficiently large. This has important consequences for cosmological constraints obtained from such tracers, since it indicates that using the power spectrum does not lead to optimal constraints even in the linear regime. In this paper, we provide a conservative estimate of the possible improvement in constraining power of a 21 cm survey if one were to use an optimal analysis strategy (such as field-level analysis), where only the true sampling noise enters the error budget. We find that improvements in uncertainties on some cosmological parameters can be as large as 50%, depending on redshift, foreground cleaning efficiency, scales used in the analysis, and instrumental noise. One byproduct of our work is measurements of bias parameters and stochasticity for neutral hydrogen in the IllustrisTNG simulation over a wide range of redshifts; we provide simple fitting formulas for these measurements. Furthermore, our results motivate further exploration of new optimal analysis techniques and provide important insights into the constraining power of current and future 21 cm surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Long-term missing value imputation for time series data using deep neural networks

We present an approach that uses a deep learning model, in particular, a MultiLayer Perceptron, for estimating the missing values of a variable in multivariate time series data. We focus on filling a long continuous gap (e.g., multiple months of missing daily observations) rather than on individual randomly missing observations. Our proposed gap filling algorithm uses an automated method for determining the optimal MLP model architecture, thus allowing for optimal prediction performance for the given time series. We tested our approach by filling gaps of various lengths (three months to three years) in three environmental datasets with different time series characteristics, namely daily groundwater levels, daily soil moisture, and hourly Net Ecosystem Exchange. We compared the accuracy of the gap-filled values obtained with our approach to the widely used R-based time series gap filling methods ImputeTS and mtsdi. The results indicate that using an MLP for filling a large gap leads to better results, especially when the data behave nonlinearly. Thus, our approach enables the use of datasets that have a large gap in one variable, which is common in many long-term environmental monitoring observations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Automated identification of dominant physical processes

The identification of processes that locally and approximately dominate dynamical system behavior has enabled significant advances in understanding and modeling nonlinear differential dynamical systems. Conventional methods of dominant process identification involve piecemeal and ad hoc (non-rigorous, informal) scaling analyses to identify dominant balances of governing equation terms and to delineate the spatiotemporal boundaries (boundaries in space and/or time) of each dominant balance. For the first time, we present an objective global measure of the fit of dominant balances to observations, which is desirable for automation, and was previously undefined. Furthermore, we propose a formal definition of the dominant balance identification problem in the form of an optimization problem. Here, we show that the optimization can be performed by various machine learning algorithms, enabling the automatic identification of dominant balances. Our method is algorithm agnostic and it eliminates reliance upon expert knowledge to identify dominant balances which are not known beforehand.

42 ENGINEERING↗
DOE OSTI2022

Neural net modeling of equilibria in NSTX-U

Neural networks (NNs) offer a path towards synthesizing and interpreting data on faster timescales than traditional physics-informed computational models. In this work we develop two NNs relevant to equilibrium and shape control modeling, which are part of a suite of tools being developed for the National Spherical Torus Experiment-Upgrade for fast prediction, optimization, and visualization of plasma scenarios. The networks include Eqnet, a free-boundary equilibrium solver trained on the EFIT01 (Equilibrium FITtting 01) reconstruction algorithm, and Pertnet, which is trained on the Gspert code and predicts the non-rigid plasma response, a nonlinear term that arises in shape control modeling. The NNs are trained with different combinations of inputs and outputs in order to offer flexibility in use cases. In particular, Eqnet can use magnetic diagnostics as inputs and act as an EFIT-like reconstruction algorithm, or, by using pressure and current profile information the NN can act as a forward Grad–Shafranov equilibrium solver. This forward-mode version is envisioned to be implemented in the suite of tools for simulation of plasma scenarios. The reconstruction-mode version gives some performance improvements compared to the online reconstruction code real-time EFIT, especially when vessel eddy currents are significant. Here, we report strong performance for all NNs indicating that the models could reliably be used within closed-loop simulations or other applications. Some limitations are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

A Two-Stage Decomposition Approach for AC Optimal Power Flow

The alternating current optimal power flow (AC-OPF) problem is critical to power system operations and planning, but it is generally hard to solve due to its nonconvex and large-scale nature. Furthermore, this paper proposes a scalable decomposition approach in which the power network is decomposed into a master network and a number of subnetworks, where each network has its own AC-OPF subproblem. This formulates a two-stage optimization problem and requires only a small amount of communication between the master and subnetworks. The key contribution is a smoothing technique that renders the response of a subnetwork differentiable with respect to the input from the master problem, utilizing properties of the barrier problem formulation that naturally arises when subproblems are solved by a primal-dual interior-point algorithm. Consequently, existing efficient nonlinear programming solvers can be used for both the master problem and the subproblems. The advantage of this framework is that speedup can be obtained by processing the subnetworks in parallel, and it has convergence guarantees under reasonable assumptions. The formulation is readily extended to instances with stochastic subnetwork loads. Numerical results show favorable performance and illustrate the scalability of the algorithm which is able to solve instances with more than 11 million buses.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Nonlinear two-fluid modeling of plasma response to RMPs for the ELM control in the ITER baseline

Numerical modeling, combining the toroidal ideal MHD code GPEC and the nonlinear two-fluid MHD code TM1, was used for comprehensive studies of the plasma response to resonant magnetic perturbations (RMPs) with toroidal mode number n = 1–5 for controlling edge-localized modes (ELMs) in ITER for the standard operation scenario (15 MA Q = 10). Several issues related to RMP ELM control are investigated, including the optimization of the RMP coils configuration, the evaluation of the magnitude of density pump-out and the q95 windows of ELM suppression. GPEC calculates the magnetic response, which consistently includes the very important edge kink/peeling response to static magnetic perturbations. Furthermore, GPEC two-dimensional scans of the relative coil current phasing among the three rows of internal coils, at fixed coil current amplitude, reveal the optimal phasing for the RMP coil configuration with n = 1–5, respectively. The poloidal half wavelength of resonant mode at the edge of plasma calculated by GPEC indicates that the midplane row coils have the best resonant coupling with the plasma for n = 2, while the upper and lower row coils have the best resonant coupling with the plasma for n = 3. Based on the plasma kinetic equilibrium and the GPEC calculations of the magnetic response, TM1 was used to simulate the conditions for RMP field penetration in the ITER pedestal. TM1 shows magnetic island formation at the foot of ITER pedestal with RMP coil current threshold ranging from 4 kAt to 8 kAt with n = 2 to 4. These magnetic islands at the pedestal-foot lead to density pump-out, the magnitude of which scales as ${I}_{\text{RMP}}^{0.5}$ and ranges from 5% to 20% at the pedestal-top when scanning the coil current from 4 to 60 kAt. The density pump-out is found to be weaker for higher n RMP. The nonlinear TM1 simulations also show field penetration at the pedestal-top, where the threshold of RMP coil current depends on the q 95 . The alignment of the magnetic island and the location of the pedestal-top decreases the height and width of the pedestal to suppress ELMs. Simulations by two-dimensional scans of RMP coil current and q 95 reveal the accessible q 95 windows of ELM suppression for both n = 3 and 4 RMPs. The predicted q 95 windows of ELM suppression are very similar to the ones in currently operating tokamaks and the required RMP coil current for ELM suppression is less than 40–50 kAt, which is well within the designed capability for ITER. In addition, the simulations indicate that wide q 95 windows of ELM suppression may be accessible in ITER by operating with dominant n = 4 (or n = 5) RMPs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Practical CO2—WAG Field Operational Designs Using Hybrid Numerical-Machine-Learning Approaches

Machine-learning technologies have exhibited robust competences in solving many petroleum engineering problems. The accurate predictivity and fast computational speed enable a large volume of time-consuming engineering processes such as history-matching and field development optimization. The Southwest Regional Partnership on Carbon Sequestration (SWP) project desires rigorous history-matching and multi-objective optimization processes, which fits the superiorities of the machine-learning approaches. Although the machine-learning proxy models are trained and validated before imposing to solve practical problems, the error margin would essentially introduce uncertainties to the results. In this paper, a hybrid numerical machine-learning workflow solving various optimization problems is presented. By coupling the expert machine-learning proxies with a global optimizer, the workflow successfully solves the history-matching and CO2 water alternative gas (WAG) design problem with low computational overheads. The history-matching work considers the heterogeneities of multiphase relative characteristics, and the CO2-WAG injection design takes multiple techno-economic objective functions into accounts. This work trained an expert response surface, a support vector machine, and a multi-layer neural network as proxy models to effectively learn the high-dimensional nonlinear data structure. The proposed workflow suggests revisiting the high-fidelity numerical simulator for validation purposes. The experience gained from this work would provide valuable guiding insights to similar CO2 enhanced oil recovery (EOR) projects.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Semidefinite programming algorithm for the quantum mechanical bootstrap

Here, we present a semidefinite programming algorithm to find eigenvalues of Schrödinger operators within the bootstrap approach to quantum mechanics. The bootstrap approach involves two ingredients: a nonlinear set of constraints on the variables (expectation values of operators in an energy eigenstate), plus positivity constraints (unitarity) that need to be satisfied. By fixing the energy we linearize all the constraints and show that the feasibility problem can be presented as an optimization problem for the variables that are not fixed by the constraints and one additional slack variable that measures the failure of positivity. To illustrate the method we are able to obtain high-precision, sharp bounds on eigenenergies for arbitrary confining polynomial potentials in one dimension.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Signal-Compensation-Based Adaptive PID Control for Fused Magnesia Smelting Processes

For fused magnesia smelting processes, the proportional-integral-derivative (PID) controller is difficult to regulate the smelting currents within desired ranges due to unexpected variations of the dynamics caused by material feeding operations. To solve this problem, we first proposed its dynamic model composed of a linear model and an uncertain nonlinear dynamic system that describes the unknown time-varying dynamics of nonlinearity and strong couplings among controlled variables. Then, using the accurately calculated value of the uncertain part at the previous sampling time instant and the tracking error that reflects the influence of its change rate, we developed a feedforward and a one-step optimal control to obtain two signal compensators to eliminate the impact of frequent variations of the uncertainties. For the compensators, we proposed a weight selection method to minimize the sum of the squared tracking error with ensured closed-loop stability. Based on the abovementioned modeling and control structure, we finally developed a novel adaptive PID controller augmented with signal compensators to control the whole process. Industrial applications have shown that the proposed method can always keep the tracking error and the control input within their targeted ranges, leading to a significantly reduced energy consumption per ton and increased fused magnesia production.

Wang, Weizhou↗
DOE OSTI2021

Explicit physics-informed neural networks for nonlinear closure: The case of transport in tissues

In upscaling methods, closures for nonlinear problems present a well-known challenge. While a number of theoretical methods have been proposed for handling such closures, nonlinearities still remain a significant obstacle for many problems. In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in multiscale tissues. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used in an algorithm for numerically solving the upscaled (coarse-grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space rather than incorporating them as part of a constraint in the optimization process. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are three outcomes of this work of particular note. 1) Our overall approach results in an upscaled nonlinear PDE. The PDE is closed using a neural network, and our approach results in the definition of the classical effectiveness factor for effecting closure. 2) We identify particular source terms for the closure problem that are important for representing the structure of the closure. These source terms involve macroscale concentrations and their gradients. We adopt these source terms to use as explicit features in the learning algorithm. We find the trained networks that include the macroscale source terms generate models that are able to predict the correction factor with increased fidelity over those that do not. 3) We find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically-structured tissues despite the significantly different scale and geometrical complexity of the two example tissue types. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure; this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Material Model Parameters Optimization in Liquid Mercury Target Dynamics Simulation With Machine Learning Surrogates

A pulsed spallation target is subjected to very short (∼0.7μs) but intense loads (23.3 kJ) from repeated proton pulses, which knock away neutrons from the mercury atoms’ nuclei for a wide range application in physics, engineering, medicine, petroleum exploration, biology, chemistry, etc. The effect of this pulsed loading on the stainless-steel target module which contains the flowing mercury target material is difficult to predict not only due to its short but intense explosive-like physical reaction, but also the nonlinear material behavior of the liquid mercury in the structure. Injecting small helium bubbles in the mercury has been an efficient method of mitigating the pressure wave at high power level stage. However, prediction of the resultant loading on the target is more difficult when helium gas is intentionally injected into the mercury. A 2-phase material model that incorporates the Rayleigh-Plesset (R-P) model is expected to address this complex multi-physics dynamics problem by including the bubble dynamics in the liquid mercury. A parameter sensitivity study was firstly employed to understand their impact on the simulation strains. The investigated parameters included E, μ, γ, σ, n, VFgas, and gas cumulative volume curve control parameters a and b. Verification and validation results from sparse polynomial expansions (SPE) method and directional Gaussian smoothing (DGS) optimization show that the surrogate model had training error of ∼7% and validation error of ∼15%, indicating that machine learning methods and surrogate models can help optimize the uncertain parameters in the complex 2-phase material model. This approach is expected to fill the knowledge gap between unknown liquid-gas mixture material model and measured vessel strain responses.

Lin, Lianshan↗
DOE OSTI2023

Higher-order correlations between different moments of two flow amplitudes in Pb-Pb collisions at $\sqrt{s_{NN}} = 5.02$ TeV

The correlations between different moments of two flow amplitudes, extracted with the recently developed asymmetric cumulants, are measured in Pb-Pb collisions at $\sqrt {s_{NN}}$ = 5.02 TeV recorded by the ALICE detector at the CERN Large Hadron Collider. The magnitudes of the measured observables show a dependence on the different moments as well as on the collision centrality, indicating the presence of nonlinear response in all even moments up to the eighth. Furthermore, the higher-order asymmetric cumulants show different signatures than the symmetric and lower-order asymmetric cumulants. Comparisons with state-of-the-art event generators using two different parametrizations obtained from Bayesian optimization show differences between data and simulations in many of the studied observables, indicating a need for further tuning of the models behind those event generators. These results provide new and independent constraints on the initial conditions and transport properties of the system created in heavy-ion collisions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Iterative Linearization for Phasor-Defined Optimal Power Dispatch

Optimal power flow (OPF) problems, which dispatch power targets to controllable generating units across a network, must generally account for non-convex constraints on power flow. Furthermore, adapting those problems so as to make them solvable with convex optimization techniques is an area of much academic and operational interest. In this paper, we present a method for solving OPF as a quadratic program by iteratively refining and re-initializing a linearized model of power flow based on the outputs of an associated nonlinear solver. The linear model on which we demonstrate this method is an adapted version of an approximation designed for use with unbalanced distribution networks. As an important benefit, the model allows for the explicit inclusion of nodal voltage phasor values in both the OPF problem's objective and its constraints, which opens the door to the idea of phasor-based control (PBC) design. We show in simulations on the IEEE 13-node test feeder that our method quickly converges to a set of phasor targets that are sufficiently precise for use in operations at the distribution level.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Application of machine learning to estimate fireball characteristics and their uncertainty from infrared spectral data

Experiments or events involving high explosives (HE) can be monitored remotely by infrared (IR) sensors to gather information about the configuration or materials involved in the device. Researchers at the Air Force Institute of Technology (AFIT) developed a phenomenological model for HE fireball spectra in the IR range that allows for parameters to be extracted from Fourier transform infrared (FTIR) data. This model includes parameters tied to physical characteristics of the fireball: temperature, size, soot, and gas concentrations. Previous works have sought to recover these parameters by the fitting of either whole spectra or select wavenumber bands to this phenomenological model. Difficulties arise due to the complex relationships between the parameters to be fit. Uncertainty quantification of the estimated fireball parameters is also problematic since HE experiments do not have any ground truth information on the parameters. It is suggested that artificial neural network (ANN) based approaches may be well suited to this problem, because of their ability to capture complex and highly nonlinear relationships. As such, this work seeks to explore the efficacy of deep artificial neural networks (DNNs) for this problem of parameter recovery from spectra and to also investigate the uncertainty of recovering the fireball parameters from FTIR data. Networks are designed using the hyperparameter optimization tool Hyperopt and trained/tested on artificial data generated using the phenomenological model developed by AFIT. The results of applying the network to the artificial data set are compared to a physics-based band approach that uses a selected number of bands based on their physical properties. Information on the uncertainty of estimating parameters from remotely sensed experimental data is obtained by treating the accuracy of the DNN model on artificial data as an upper bound and by examining the impact of emissivity due to soot on parameter estimation error; the results for artificial data are likely to be optimistic as compared to recovering parameters from experimental data.

42 ENGINEERING↗
DOE OSTI2021

Simulating non-native cubic interactions on noisy quantum machines

As a milestone for general-purpose computing machines, we demonstrate that quantum processors can be programed to efficiently simulate dynamics that are not native to the hardware. Moreover, on noisy devices without error correction, we show that simulation results are significantly improved when the quantum program is compiled using modular gates instead of a restricted set of standard gates. We demonstrate the general methodology by solving a cubic interaction problem, which appears in nonlinear optics, gauge theories, as well as plasma and fluid dynamics. To encode the non-native Hamiltonian evolution, we decompose the Hilbert space into a direct sum of invariant subspaces in which the nonlinear problem is mapped to a finite-dimensional Hamiltonian simulation problem. Furthermore, in a three-states example, the resultant unitary evolution is realized by a product of approximately 20 standard gates, using which approximately ten simulation steps can be carried out on state-of-the-art quantum hardware before results are corrupted by decoherence. In comparison, the simulation depth is improved by more than an order of magnitude when the unitary evolution is realized as a single cubic gate, which is compiled directly using optimal control. Alternatively, parametric gates may also be compiled by interpolating control pulses. Modular gates thus obtained provide high-fidelity building blocks for quantum Hamiltonian simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗