Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Domain Decomposition for Integer Optimal Control with Total Variation Regularization

Total variation integer optimal control problems admit solutions and necessary optimality conditions via geometric variational analysis. In spite of the existence of said solutions, algorithms which solve the discretized objective suffer from high numerical cost associated with the combinatorial nature of integer programming. Hence, such methods are often limited to small and medium-sized problems. We propose a globally convergent, coordinate descent–inspired algorithm that allows tractable subproblem solutions restricted to a partition of the domain. Our decomposition method solves relatively small trust-region subproblems that modify the control variable on a subdomain only. Given nontrivial subdomain overlap, we prove that a global first-order necessary optimality condition is equivalent to a first-order necessary optimality condition per subdomain. We additionally show that a sufficient decrease is achieved on a single subdomain by way of a trust-region subproblem solver using geometric measure–theoretic arguments, which we integrate with a greedy patch selection to prove convergence of our algorithm. In conclusion, we demonstrate the practicality of our algorithm on a benchmark large-scale, PDE-constrained integer optimal control problem and find that our method is faster than the state of the art.

domain decomposition

Regularizing the linearly extrapolated BDF2 scheme for incompressible flows with time relaxation

This paper presents a highly-efficient finite element scheme for the time relaxation model (TRM). The efficiency is achieved through the second-order BDF2 time-stepping scheme with linear extrapolation (BDF2LE). The accuracy of the scheme is also greatly enhanced through the use of the divergence-free Scott-Vogeulis finite elements, and van Cittert approximate deconvolution. A complete finite element analysis is provided, which includes rigorous proofs for the stability, well-possessedness, and convergence of both velocity and pressure solutions. Furthermore, we also demonstrate that the inclusion of the linear time relaxation term preserves the long-time stability of the unregularized BDF2LE scheme. Finally, numerical experiments are presented that demonstrate the added stability and accuracy that time relaxation can provide.

97 MATHEMATICS AND COMPUTING

A Polar Scaling Technique for the Regularization of Strongly Singular and Strongly Near-Singular Helmholtz Surface Integrals Evaluated Over 2-D Domains

The numerical integration of expressions containing strong singularities or strong near-singularities has long been a challenging problem in the electromagnetics community. Much attention has been paid to this problem, as strong $1/R^{{2}}$ singularities routinely appear when implementing electromagnetic simulation techniques like the method of moments (MoM). To date, several techniques, from singularity extraction to singularity cancellation (SC), have been employed to deal with problems that require the evaluation of 2-D strongly singular integrals. However, no single technique has been proposed that can deal with both strong singularities and strong near-singularities in a fully numerical manner for arbitrary 2-D domains. Moreover, it has been claimed that the Helmholtz-type strongly singular integral found in the MoM is convergent in a principal value sense, but this convergence value has yet to be proven mathematically. In this work, we will conduct the convergence proof and introduce a “polar scaling” change of variables method that may be used to evaluate Helmholtz integrals with both strong and weak singularities/near-singularities. The technique is fully numerical and can in principle be applied to any planar or curved polygon and any nonsingular basis function. We will also provide numerical results showing useful convergence behavior for integrals involving both exact and near-singularities.

47 OTHER INSTRUMENTATION

Towards provision of regularly updated climate data from the Coupled Model Intercomparison Project

The Coupled Model Intercomparison Project (CMIP) is a flagship of the World Climate Research Programme (WCRP). CMIP has become a recognised ‘brand’ in climate circles evolving over the last thirty years from a targeted research activity by a small number of climate modelling centres intercomparing their Earth System Model (ESM) simulations to a broad international coordinated research effort (Durack et al, 2025). CMIP is organized as a research activity leveraging funded and in-kind contributions from experts within modelling centres and the broader scientific community supported more recently by a fully-funded International Project Office. Within CMIP, Model Intercomparison Projects (MIPs) are community-designed to understand past, present and future climate. CMIP data provides a valuable resource for climate research and is routinely used to assess model representation of climate processes and test scientific hypotheses in the context of model uncertainty and (forced and internal) variability as evident from its prolific use in scientific publications1 . The impact relies on enabling infrastructure (most prominently via the Earth System Grid Federation (ESGF)), which allows sharing of simulation output, provision of the boundary conditions used in each simulation, and definition of the data standards that are essential to facilitating wide use of the data. The impact is supplemented by the wide-ranging scrutiny to which model simulations are subjected. Beyond its use in research, CMIP data is a key resource for communities producing derived climate information from downscaling and impact studies, such as the Coordinated Regional Downscaling Experiment (CORDEX; Gutowski et al., 2016) and the Intersectoral Impacts MIP (ISIMIP; Frieler et al., 2024). Government, academic and commercial entities also increasingly rely on CMIP and its downstream data for climate risk assessments and climate services (for example, Copernicus Climate Change Service and World Bank portal). This means that, although CMIP is a research activity, it increasingly serves a secondary and very relevant role as a provider of climate data – a long-recognised dichotomy (Stevens, 2024). Research and applications have distinct needs, with the former requiring flexibility and generality and the latter consistency. Here we explain how the design of the research activity has been adapted to reduce the burdens imposed by applications and how the research infrastructure might evolve to further enable scientific inquiry. We propose one possible approach to consistently providing model information and projections for applications in the future.

Environmental sciences

MINLP for regularized symbolic regression with applications to data-driven modeling of critical minerals processes

The poster summarizes recent advances in symbolic regression developed as part of the PrOMMiS project over the past year. In particular, it describes the comparison of surrogates for critical minerals (CM) & rare earth element (REE) recovery flowsheets obtained via symbolic regression and ALAMO. It also compares the predictive ability and solvability of optimization models that incorporate these surrogates.

36 MATERIALS SCIENCE

A Particle Method for the Multispecies Landau Equation

Abstract The multispecies Landau collision operator describes the two-particle, small scattering angle or grazing collisions in a plasma made up of different species of particles such as electrons and ions. Recently, a structure preserving deterministic particle method (Carrillo et al. in J. Comput. Phys. 7:100066, 2020) has been developed for the single species spatially homogeneous Landau equation. This method relies on a regularization of the Landau collision operator so that an approximate solution, which is a linear combination of Dirac delta distributions, is well-defined. Based on a weak form of the regularized Landau equation, the time dependent locations of the Dirac delta functions satisfy a system of ordinary differential equations. In this work, we extend this particle method to the multispecies case, and examine its conservation of mass, momentum, and energy, and decay of entropy properties. We show that the equilibrium distribution of the regularized multispecies Landau equation is a Maxwellian distribution, and state a critical condition on the regularization parameters that guarantees a species independent equilibrium temperature. A convergence study comparing an exact multispecies Bobylev-Krook-Wu (BKW) solution to the particle solution shows approximately 2nd order accuracy. Important physical properties such as conservation, decay of entropy, and equilibrium distribution of the particle method are demonstrated with several numerical examples.

Mathematics

A chemical kinetic analysis of knock propensity of methanol-to-gasoline fuel

Production of low carbon gasoline-like fuels such as methanol-to-gasoline (MTG) is a promising approach to achieve rapid greenhouse gas emission reduction of the transportation sector. Despite the fact that gasoline that meets the ASTM D4814 standard for automotive spark-ignition engine fuel can be readily produced from these processes, it is unclear how the composition of MTG may affect engine performance and emissions. Here, in this paper, a surrogate for an MTG is used to numerically study the effects of gasoline composition on knock propensity and on the sensitivity of knock to thermal and fuel stratification, to oxygen dilution and to nitric oxide from exhaust gas recirculation of residual gases. Simulations were performed in ANSYS CHEMKIN-PRO using a comprehensive chemical kinetic mechanism for gasoline surrogates, and results of the MTG surrogate were compared against those of a petroleum-based regular E10 gasoline, termed PACE-20. A premium-grade MTG fuel was also formulated by adding ethanol to the MTG surrogate, and results were compared against those of four premium-grade, gasoline-like fuels representative of future alternative gasoline formulations. Surrogates and mechanism were evaluated by comparison against experimental engine data, and the model showed high accuracy at stoichiometric conditions (mean absolute error of ignition timing equal to 1.46 crank angle degrees) but larger deviations at lean conditions (mean absolute error of ignition timing equal to 5.52 crank angle degrees). Despite the fact that the MTG surrogate has a RON 1.1 units higher than that of PACE-20, it may show higher knock propensity at medium temperature conditions due to a less intense NTC behavior. MTG autoignition was more temperature- and equivalence ratio-sensitive than that of PACE20, suggesting that MTG can benefit more from naturally-occurring thermal stratification or from induced fuel stratification of the end gas to mitigate knock intensity. The sensitivity of autoignition reactivity to oxygen dilution and to NO concentration was higher for MTG than for regular gasoline at medium loads, but the opposite trend was observed at high loads due to the effect of pressure on the low-temperature chemistry of regular gasoline. Approximately 14 % vol ethanol content was required to upgrade the octane rating of MTG from regular grade to premium grade. Adding 13.6 % vol ethanol made the fuel autoignition less sensitive to both oxygen dilution and NO content (ignition time varies approx. 17 % and 50 % less with oxygen dilution and NO addition, respectively, when adding ethanol at high engine loads).

02 PETROLEUM

Repartitioning the Hamiltonian in many-body second-order Brillouin–Wigner perturbation theory: Uncovering new size-consistent models

Second-order Møller-Plesset perturbation theory is well-known as a computationally inexpensive approach to the electron correlation problem that is size-consistent with a size-consistent reference but fails to be regular. On the other hand, the less well-known many-body version of Brillouin-Wigner perturbation theory has the reverse properties: it is regular but fails to be size-consistent when used with the standard MP partitioning. Consequently, its widespread use remains limited. In this work, we analyze the ways in which it is possible to use alternative non-MP partitions of the Hamiltonian to yield variants of BW2 that are size-consistent as well as regular. We show that there is a vast space of such BW2 theories and also show that it is possible to define a repartitioned BW2 theory from the ground state density alone, which regenerates the exact correlation energy. We also provide a general recipe for deriving regular, size-consistent, and size-extensive partitions from physically meaningful components, and we apply the result to small model systems. The scope of these results appears to further set the stage for a revival of BW2 in quantum chemistry.

Ab initio perturbation

An adaptive and stability-promoting layerwise training approach for sparse deep neural network architecture

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a new layer is added each time and trained independently by freezing parameters in the previous layers. We impose desirable structures on the DNN by employing manifold regularization, sparsity regularization, and physics-informed terms. We introduce a ε – δ – stability-promoting concept as a desirable property for a learning algorithm and show that employing manifold regularization yields a ε – δ stability-promoting algorithm. Further, we also derive the necessary conditions for the trainability of a newly added layer and investigate the training saturation problem. In the second stage of the algorithm (post-processing), a sequence of shallow networks is employed to extract information from the residual produced in the first stage, thereby improving the prediction accuracy. Numerical investigations on prototype regression and classification problems demonstrate that the proposed approach can outperform fully connected DNNs of the same size. Moreover, by equipping the physics-informed neural network (PINN) with the proposed adaptive architecture strategy to solve partial differential equations, we numerically show that adaptive PINNs not only are superior to standard PINNs but also produce interpretable hidden layers with provable stability. As a result, we also apply our architecture design strategy to solve inverse problems governed by elliptic partial differential equations.

42 ENGINEERING

The approximate second order coupled-cluster method based on a size-consistent Brillouin–Wigner partitioning

We present a variant of the approximate second order coupled-cluster method (CC2) with a two-parameter size-consistent Brillouin–Wigner (BW-s) partitioning instead of a Møller–Plesset (MP) partitioning for the unperturbed Hamiltonian, which we refer to as BWs-CC2. The computational complexity of this model scales identically to CC2 with molecular size. Conventional CC2 and its regularized BWs-CC2 variants, as well as conventional MP2 and two of its regularized BW-s2 variants, were assessed on a 535 element database spanning thermochemistry, non-covalent interactions, barrier heights, and isomerization energies. To ensure a well-defined model chemistry, the assessment was performed using internally stable spin-polarized Hartree–Fock (HF) orbitals in the finite aug-cc-pVQZ basis without counterpoise corrections. As a result of using stable orbitals, contrary to conventional wisdom, we find that CC2 substantially outperforms MP2 on molecules with significantly spin contaminated reference orbitals without a significant increase in error on systems with a spin-pure reference, showing the value of its single substitutions. While no single choice of regularization parameters can be optimal for all datasets, we find that BWs-CC2 generally outperforms both CC2 and BW-s2 with a single judicious parameter choice. Additional tests on dipole moments and bond lengths of diatomics provide further support for the utility of this choice. Furthermore, the main outliers and poorest performing cases are associated with large amounts of spin-contamination in the HF reference, which is indicative of systems with either strong correlation or extensive artificial symmetry breaking. Overall, these findings argue that the perception of the quality of the CC2 ground state should be reevaluated and that it can be further improved upon by the soundly based BWs-CC2 variant with the recommended parameter choice.

Correlation energy

Improved Guarantees for Optimal Nash Equilibrium Seeking and Bilevel Variational Inequalities

We consider a class of hierarchical variational inequality (VI) problems that subsumes VI-constrained optimization and several other problem classes, including the optimal solution selection problem and the optimal Nash equilibrium (NE) seeking problem. Our main contribution is threefold. (i) We consider bilevel VIs with monotone and Lipschitz continuous mappings and devise a single-timescale iteratively regularized extragradient method, named IR-EG 𝚖,𝚖 . We improve the existing iteration complexity results for addressing both bilevel VI and VI-constrained convex optimization problems. (ii) Under the strong monotonicity of the outer-level mapping, we develop a method named IR-EG 𝚜,𝚖 and derive faster guarantees than those in (i). We also study the iteration complexity of this method under a constant regularization parameter. These results appear to be new for both bilevel VIs and VI-constrained optimization. (iii) To our knowledge, complexity guarantees for computing the optimal NE in nonconvex settings do not exist. Motivated by this lacuna, we consider VI-constrained nonconvex optimization problems and devise an inexactly projected gradient method, named IPR-EG, where the projection onto the unknown set of equilibria is performed using IR-EG 𝚜,𝚖 with a prescribed termination criterion and an adaptive regularization parameter. We obtain new complexity guarantees in terms of a residual map and an infeasibility metric for computing a stationary point. Here, we validate the theoretical findings using preliminary numerical experiments for computing the best and the worst NEs.

bilevel optimization

Virtual element approximations of the time-fractional nonlinear convection-diffusion equation on polygonal meshes

We extend the Virtual Element Method to a two-dimensional unsteady nonlinear convection-diffusion equation characterized by a fractional-order derivative with respect to the time variable. Our methodology is based on three fundamental technical components: a fractional version of the Grunwald-Letnikov approximation, discrete maximal regularity, and the regularity theory associated with non-linearity. We prove the method's well-posedness, i.e., the approximate solution's existence and uniqueness to the time-fractional convection-diffusion equation with a Lipschitz nonlinear source term. The fully discrete scheme inherently maintains stability and consistency by leveraging the discrete maximal regularity and the energy projection operator. The convergence in the L 2 -norm and H 1 -norm to various mesh configurations is validated by numerical results, underlining the practical effectiveness of the proposed method.

97 MATHEMATICS AND COMPUTING