Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Taylor approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Taylor approximation variance reduction for approximation errors in PDE-constrained Bayesian inverse problems

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a computationally cheaper alternative to the accurate parameter-to-observable mappings and/or may ignore additional unknowns or sources of uncertainty. The Bayesian approximation error (BAE) approach provides a means to account for the induced uncertainties and approximation errors, i.e. the errors between the accurate parameter-to-observable mapping and the surrogate. The statistics of these errors are, however, in general unknown a priori, and are thus calculated using Monte Carlo sampling. Although the sampling is typically carried out offline, i.e. before considering the data, the process can still represent a computational bottleneck. In this work, we develop a scalable computational approach for reducing the costs associated with the sampling stage of the BAE approach. Specifically, we consider the Taylor expansion of the accurate and surrogate forward models with respect to the uncertain parameter fields either as a control variate for variance reduction or as a means to directly and efficiently approximate the mean and covariance of the approximation errors. We propose efficient methods for evaluating the expressions for the mean and covariance of the Taylor approximations based on linear(-ized) PDE solves. Furthermore, the proposed approach is independent of the dimension of the uncertain parameter, depending instead on the intrinsic dimension of the data, ensuring scalability to high-dimensional problems. The potential benefits of the proposed approach are demonstrated for two high-dimensional inverse problems governed by PDE examples, namely for the estimation of a distributed Robin boundary coefficient in a linear diffusion problem, and for a coefficient estimation problem governed by a nonlinear diffusion problem.

Bayesian approximation error

Solving high-dimensional partial integral differential equations: The finite expression method

Partial integro-differential equations (PIDEs) have broad applications in the sciences, from electro-magnetism to options pricing. Here, in this paper, we introduce a new finite expression method (FEX) to solve PIDEs. This approach builds upon the original FEX and its inherent advantages with new advances: 1) A novel method of parameter grouping is proposed to reduce the number of coefficients in high-dimensional function approximation; 2) A Taylor series approximation method is implemented to significantly improve the computational efficiency and accuracy of the evaluation of the integral terms of PIDEs. The new FEX based method, denoted FEX-PG to indicate the addition of the parameter grouping (PG) step to the algorithm, provides both high accuracy and interpretable numerical solutions, with the outcome being an explicit equation that facilitates intuitive understanding of the underlying solution structures. These features are often absent in traditional methods, such as finite element methods (FEM) and finite difference methods, as well as in deep learning-based approaches. To benchmark our method against recent advances, we apply the new FEX-PG to solve benchmark PIDEs in the literature. In high-dimensional settings, FEX-PG exhibits strong and robust performance, achieving relative errors on the order of single precision machine epsilon, significantly outperforming existing approaches based on neural networks.

Combinatorial optimization

Spatially Accelerated Winding Numbers for Curved Geometry

The generalized winding number (GWN) is a scalar field that supports robust containment queries on curved geometry, including non-watertight, overlapping, and nested boundary representations. While queries can be easily parallelized over samples, direct evaluation on parametric curves and surfaces remains costly for large and complex models. Fast, state-of-the-art GWN approaches leverage a spatial index to approximate the GWN, typically coupled with a Taylor expansion which approximates the GWN contribution for far clusters of geometric primitives. However, such methods operate only on discrete inputs such as triangle meshes and point clouds, and would introduce containment errors near boundaries if applied to curved input. We extend support for fast GWN evaluation over arbitrary collections of NURBS curves in 2D and trimmed NURBS patches in 3D via a Bounding Volume Hierarchy that stores efficiently precomputed moment data in the hierarchy nodes. When querying the hierarchy, approximations for far clusters are used alongside direct evaluation for nearby NURBS primitives, achieving sub-linear complexity while preserving the geometric features in the vicinity of the query point. Central to our performance improvements is an adaptive subdivision strategy for NURBS primitives during a preprocessing phase, creating better spatial partitions while retaining the same accuracy for containment decisions as a direct evaluation. We demonstrate the performance and accuracy of our approach across a large collection of 2D and 3D datasets.

Computer science

Integration of multiple coinflip devices for high-quality random sampling

Artificial intelligence, scientific computing, and probabilistic computing use random sampling to approximate solutions to various problems, with larger models requiring a substantial quantity of random numbers. To generate the required vast quantity of random numbers at high rates, we explore so-called “coinflip” devices, which are stochastic microelectronic devices ideally capable of independently generating random bits with a tunable weight at a high rate. However, coinflip devices are inherently analog and demonstrate nonidealities, like temperature dependence and drift, that can introduce determinism into the outputs. We present important considerations for building systems of multiple coinflip devices to produce high-quality bitstreams with low error and little dependency on previous bits. Using tunnel diodes as coinflip devices, we implement a control loop to adapt to temperature dependence and generate fair bitstreams with each device. While this can lead to dependencies between bits in a single bitstream, we demonstrate that combining results generated in parallel with individual tunnel diodes can produce fair and unpredictable bitstreams. The suitability of these bitstreams for use in probabilistic computing is then demonstrated through a Monte Carlo approximation of π.

Taylor, Brady Garland [Sandia National Laboratorie

Taylor-Expansion-Based Robust Power Flow in Unbalanced Distribution Systems: A Hybrid Data-Aided Method

Traditional power flow methods often adopt certain assumptions designed for passive balanced distribution systems, thus lacking practicality for unbalanced operation. moreover, their computation accuracy and efficiency are heavily subject to unknown errors and bad data in measurements or prediction data of distributed energy resources (ders). to address these issues, this paper proposes a hybrid data-aided robust power flow algorithm in unbalanced distribution systems, which combines taylor series expansion knowledge with a data-driven regression technique. the proposed method initiates a linearization power flow model to derive an explicitly analytical solution by modified taylor expansion. to mitigate the approximation loss that surges due to the der integration and bad data, we further develop a data-aided robust support vector regression approach to estimate the errors efficiently. comparative analysis in the 13-bus and 123-bus ieee unbalanced feeders shows that the proposed hybrid algorithm achieves superior computational efficiency, with guaranteed accuracy and robustness against outliers.

data-driven

Uncertainty Quantification Enabled by Automatic Differentiation for Hydrodynamic Simulation of Shock‐to‐Detonation Transition in High Explosives

Quantifying the effects of uncertainty in a reactive burn model on the run-to-detonation time in high explosives (HEs) provides a robust methodology for assessing the probability of an HE failing the IHE qualification standard. Moreover, uncertainty quantification helps evaluate whether the model calibration accurately represents data outside the calibration set. This study uses a specialized hydrodynamic simulation code for modeling detonation to determine the run-to-detonation time of the HE PBX 9502 for various impact velocities. To quickly approximate uncertainties in the model, a surrogate was constructed using a Taylor series expansion centered at the mean of the input parameters. To obtain the sensitivities required for constructing the Taylor series, HYP-percomplex Automatic Differentiation (HYPAD) was implemented. HYPAD is a methodology for infusing existing codes with automatic differentiation capabilities by augmenting variables with one or more imaginary units to compute step-size independent partial derivatives. These derivatives are accurate to machine precision with respect to the implemented numerical algorithm, meaning their accuracy reflects that of the underlying method (e.g., integration or discretization schemes). Using reduced order modeling techniques, the mean and standard deviation of the run-to-detonation time of a shock within PBX 9502 were computed for a number of initial impact velocities. A weighted least squares regression was then performed to obtain a best fit curve and prediction interval for the computed statistics. Historical data points from explosively driven wedge tests were utilized to validate the prediction interval, ensuring its reliability in predicting future outcomes. With this prediction interval and a known safety constraint curve, the most probable point of failure and the probability of failure for the HE PBX 9502 were determined.

97 MATHEMATICS AND COMPUTING

TANTE: Time-adaptive operator learning via neural Taylor expansion

Operator learning for time-dependent partial differential equations (PDEs) has seen rapid progress in recent years, enabling efficient approximation of complex spatiotemporal dynamics. However, most existing methods rely on fixed time step sizes during rollout, which limits their ability to adapt to varying temporal complexity and often leads to error accumulation. In this work, we propose the Time-Adaptive Transformer with Neural Taylor Expansion (TANTE), a novel operator-learning framework that produces continuous-time predictions with adaptive step sizes. TANTE predicts future states by performing a Taylor expansion at the current state, where neural networks learn both the higher-order temporal derivatives and the local radius of convergence. This allows the model to dynamically adjust its rollout based on the local behavior of the solution, thereby reducing cumulative error and improving computational efficiency. We demonstrate the effectiveness of TANTE across a wide range of PDE benchmarks, achieving superior accuracy and adaptability compared to fixed-step baselines, delivering accuracy gains of 60-80 % and speed-ups of 30-40 % at inference time.

97 MATHEMATICS AND COMPUTING

Simplifying activations with linear approximations in neural networks

A key step in Neural Networks is activation. Among the different types of activation functions, sigmoid, tanh, and others involve the usage of exponents for calculation. From a hardware perspective, exponential implementation implies the usage of Taylor series or repeated methods involving many addition, multiplication, and division steps, and as a result are power-hungry and consume many clock cycles. We implement a piecewise linear approximation of the sigmoid function as a replacement for standard sigmoid activation libraries. This approach provides a practical alternative by leveraging piecewise segmentation, which simplifies hardware implementation and improves computational efficiency. In this paper, we detail piecewise functions that can be implemented using linear approximations and their implications for overall model accuracy and performance gain. Our results show that for the DenseNet, ResNet, and GoogLeNet architectures, the piecewise linear approximation of the sigmoid function provides faster execution times compared to the standard TensorFlow sigmoid implementation while maintaining comparable accuracy. Specifically, for MNIST with DenseNet, accuracy reaches 99.91% (Piecewise) vs. 99.97% (Base) with up to 1.31x speedup in execution time. For CIFAR-10 with DenseNet, accuracy improves to 98.97% (Piecewise) vs. 99.40% (Base) while achieving 1.24x faster execution. Similarly, for CIFAR-100 with DenseNet, the accuracy is 97.93% (Piecewise) vs. 98.39% (Base), with a 1.18x execution time reduction. These results confirm the proposed method’s capability to efficiently process large-scale datasets and computationally demanding tasks, offering a practical means to accelerate deep learning models, including LSTMs, without compromising accuracy.

Activation function

Development, Verification, and Validation of an OpenFOAM-Based Solver for Modeling Inertial Fusion Energy Chambers

Our work seeks to introduce a computational tool tailored to the physics of inertial fusion energy chambers, in particular, those concepts based on thick liquid walls. In this approach, the structural materials are protected by several neutron mean-free-paths of renewable liquid and thus will be able to survive much longer than un-shielded walls, with virtually all structures lasting for the life of the plant and enabling the use of commercially available and qualified materials. The OpenFOAM-based solver named rhoCentralFoam has been used as a starting point. rhoCentralFoam belongs to the standard OpenFOAM solver toolset. It is a high-speed, explicit compressible flow solver with shock-capturing capability. While the main features have been retained, the solver had to be restructured to make use of tabular data for equations of states, a necessary addition to model the complex thermo-physical properties of ionized gasses. This entailed the need to change the independent state variables used by the solver, resulting in a new thermodynamic library and slightly different solution algorithm. Moreover, a radiation heat transfer model based on the P-1 approximation was added to the solver. The solver is verified against an analytical solution from the Sedov-Taylor-Neumann test problem to showcase the ability of the hydrodynamic solvers to handle strong shocks, whereas the P-1 model was verified using a simple one-dimensional problem with an analytical solution. Additionally, a validation case involving shock-wave propagation through jet array is presented, and the results are compared with experimental data from the open literature. Lastly, in order to showcase the utility of the solver for practical cases, we applied the refined solver to two representative scenarios: gas venting within the HYLIFE-II chamber and the compression of the gas following the partial ablation of the liquid wall.

Chamber dynamics

Effects of Strain and Strain Rate on Dynamic Grain Growth and Subgrain Evolution During Plastic Deformation of an Interstitial-Free Steel at 850 ° C

Here, the effects of strain and strain rate on dynamic grain growth (DGG) and subgrain evolution are reported for an interstitial-free steel deformed at 850 ° C. Microstructures produced during tension tests at true-strain rates of 10 -4 and to 10 -3 s -1 true strains ranging from 0.02 to 0.2 were preserved following deformation. These were characterized using electron backscatter diffraction (EBSD), including the application of spherical harmonic transform indexing to produce high-angular-resolution EBSD (HR-EBSD) data. HR-EBSD data resolved the small misorientation angles of subgrain boundaries while imaging much larger data fields than possible with previously available techniques. The resulting data confirmed that steady-state flow stress is inversely proportional to the average subgrain size and that subgrain boundary misorientation angle increases with strain. The following new observations are reported. The rate of DGG increased with respect to time but decreased with respect to strain as strain rate increased. This behavior is rationalized through a simple model using separate rate parameters for the effects of time and strain. Subgrain size was not constant during steady-state deformation, but decreased slowly with increasing strain. Subgrain size distributions and subgrain boundary misorientation angle distributions were measured, and both remained approximately log-normal during steady-state deformation. Subgrain evolution demonstrated no dependence on parent grain size, crystallographic orientation, or Taylor factor. These new data suggest that steady-state flow stress is more likely controlled by the dislocation density internal to subgrains than by the spacing between subgrain boundaries.

dynamic grain growth

Adaptive Power Flow Approximations With Second-Order Sensitivity Insights

The power flow equations are fundamental to power system planning, analysis, and control. However, the inherent non-linearity and non-convexity of these equations present formidable obstacles in problem-solving processes. To mitigate these challenges, recent research has proposed adaptive power flow linearizations that aim to achieve accuracy over wide operating ranges. The accuracy of these approximations inherently depends on the curvature of the power flow equations within these ranges, which necessitates considering second-order sensitivities. In this paper, we leverage second-order sensitivities to both analyze and improve power flow approximations. We evaluate the curvature across broad operational ranges and subsequently utilize this information to inform the computation of various sample-based power flow approximation techniques. Additionally, we leverage second-order sensitivities to guide the development of rational approximations that yield linear constraints in optimization problems. In conclusion, this approach is extended to enhance accuracy beyond the limitations of linear functions across varied operational scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION

Augmenting subspace optimization methods with linear bandits

In this work, we consider the framework of methods for unconstrained minimization that are, in each iteration, restricted to a model that is only a valid approximation to the objective function on some affine subspace containing an incumbent point. These methods are of practical interest in computational settings where derivative information is either expensive or impossible to obtain. Recent attention has been paid in the literature to employing randomized matrix sketching for generating the affine subspaces within this framework. We consider a relatively straightforward, deterministic augmentation of such a generic subspace optimization method. In particular, we consider a sequential optimization framework where actions consist of one-dimensional linear subspaces and rewards consist of (approximations to) the magnitudes of directional derivatives computed in the direction of the action subspace. Reward maximization in this context is consistent with maximizing lower bounds on descent guaranteed by first-order Taylor models. This sequential optimization problem can be analysed through the lens of dynamic regret. We modify an existing linear upper confidence bound (UCB) bandit method and prove sublinear dynamic regret in the subspace optimization setting. We demonstrate the efficacy of employing this linear UCB method in a setting where forward-mode algorithmic differentiation can provide directional derivatives in arbitrary directions and in a derivative-free setting. For the derivative-free setting, we propose SS-POUNDers, an extension of the derivative-free optimization method POUNDers that employs the linear UCB mechanism to identify promising subspaces. Our numerical experiments suggest a preference, in either computational setting, for employing a linear UCB mechanism within a subspace optimization method.

97 MATHEMATICS AND COMPUTING

A high-order Shifted Interface Method for Lagrangian shock hydrodynamics

Here, we present a new method for two-material Lagrangian hydrodynamics, which combines the Shifted Interface Method (SIM) with a high-order Finite Element Method. Our approach relies on an exact (or sharp) material interface representation, that is, it uses the precise location of the material interface. The interface is represented by the zero level-set of a continuous high-order finite element function that moves with the material velocity. This strategy allows to evolve curved material interfaces inside curved elements. By reformulating the original interface problem over a surrogate (approximate) interface, located in proximity of the true interface, the SIM avoids cut cells and the associated problematic issues regarding implementation, numerical stability, and matrix conditioning. Accuracy is maintained by modifying the original interface conditions using Taylor expansions. We demonstrate the performance of the proposed algorithms on established numerical benchmarks in one, two and three dimensions.

97 MATHEMATICS AND COMPUTING

The QPO in RE J1034+396 Originates in the Hot Corona

RE J1034+396 is one of the few active galactic nuclei (AGNs) with a significant quasiperiodic oscillation (QPO). The QPO has been observed in over 1 Ms of XMM-Newton observations spanning over a decade. We investigate the power spectral density function (PSD) of seven long (∼90 ks) XMM-Newton observations of the AGN RE J1034+396 in two energy bands. The soft (0.3–0.5 keV) band targets emission from the disk, while the hard (2–7 keV) band isolates the primary X-ray continuum emission from the corona. The QPO is significantly detected in the hard band of five of the seven observations. The best-fitting models indicate that the QPO detection in both bands is entirely attributable to the coronal emission with no additional contribution from the disk. This explains the strong coherence between the hard and soft bands at the QPO frequency. The covariance spectrum is consistent with this picture as the variability at QPO frequencies is attributed solely to fluctuations in the hot corona. The time lag as a function of energy is well described by a ∼2000 s intrinsic soft lag, resulting from the disk responding to emission from the corona, that undergoes phase wrapping at approximately the QPO frequency. By demonstrating that in this system the QPO arises in the corona, we provide new insights into the mechanisms generating QPOs.

Active galactic nuclei

Evolution of highly multimodal Rayleigh–Taylor instabilities

Rayleigh–Taylor (RT) instabilities are important fluid instabilities that arise in inertial confinement fusion (ICF) capsule implosions, and many other contexts. Multi-mode coupling is observed in experiments and plays a substantial role in material mix from RT instabilities. In this work, we study the evolution of highly multimodal perturbations (power law distribution) that approximate those found at manufactured material interfaces. We use simulations of over 2000 different perturbations in the LANL code xRAGE to identify distinct phases in the processes of bubble growth and bubble merger which can be visualized in a 2D phase portrait with clear regimes of mode growth and decay. Our results show that the dynamic evolution of the instability strongly depends on the mode of the perturbations and mode interactions. The merger process accelerates bubble growth. A non-Markovian region and a transition of the instability from: (1) initial exponential growth to (2) linear growth and to (3) quadratic growth and asymptotic behavior, are clearly captured in the phase space. We have developed a quantitative model of bubble growth that reproduces the dynamic behavior of ensembles of perturbations. Implications for ICF capsules designed for robustness against instabilities are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

Larmor power limit for cyclotron radiation of relativistic particles in a waveguide

Cyclotron radiation emission spectroscopy (CRES) is a modern technique for high-precision energy spectroscopy, in which the energy of a charged particle in a magnetic field is measured via the frequency of the emitted cyclotron radiation. The He6-CRES collaboration aims to use CRES to probe beyond the standard model physics at the TeV scale by performing high-resolution and low-background beta-decay spectroscopy of 6 He and 19 Ne. Having demonstrated the first observation of individual, high-energy (0.1–2.5 MeV) positrons and electrons via their cyclotron radiation, the experiment provides a novel window into the radiation of relativistic charged particles in a waveguide via the time-derivative (slope) of the cyclotron radiation frequency, df c /dt. We show that analytic predictions for the total cyclotron radiation power emitted by a charged particle in circular and rectangular waveguides are approximately consistent with the Larmor formula, each scaling with the Lorentz factor of the underlying e ± as γ 4 . This hypothesis is corroborated with experimental CRES slope data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Competing mechanisms at vibrated interfaces of density-contrast fluids

Fluid-fluid interfacial instability and subsequent fluid mixing are ubiquitous in nature and engineering. The hydrodynamic instability of fluid interfaces has long centered on the pressure gradient-driven long-wavelength Rayleigh-Taylor instability and the resonance-induced short-wavelength Faraday instability. However, neither instability alone can explain the dynamics when both mechanisms are present. We identify a previously unseen multi-modal instability emerging from their coexistence. When the denser fluid is polydimethylsiloxane, the mixed region at a high density contrast (Atwood number = 0.9) spans a vibration amplitude range approximately twice the gravitational acceleration. Using Floquet stability analysis, we show how vibrations govern transitions between the RT and Faraday instabilities, leading to contention between these instabilities rather than resonant enhancement. Here, the initial transient growth is represented by the exponential modal growth of the most unstable Floquet exponent, along with its accompanying periodic behavior. Direct numerical simulations validate these findings and track interface breakup into the multiscale and nonlinear regimes. Specifically, we show that growing RT modes nonlinearly suppresses Faraday responses even when the initial growth rate of the Faraday instability is 3.63 times that of RT, so a bidirectional competition hinders their sustained coexistence.

Direct numerical simulations

AmeriFlux FLUXNET-1F US-UiC University of Illinois Maize-Soy

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-UiC University of Illinois Maize-Soy. This is the FLUXNET version of the carbon flux data for the site US-UiC University of Illinois Maize-Soy produced by applying the standard ONEFlux (1F) software. Site Description - Agricultural field planted with maize in a three year rotation with soy (maize-maize-soy). The first soy rotation year was 2010. This field is typically planted in May and harvested in October. This site is located at an experimental farm approximately 2 miles south of the University of Illinois at Urbana Champaign and is colocated with (500-1000m distance) all other Us-Ui sites.

Bernacchi, Carl J [USDA/ARS]