Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EXPONENTIAL FUNCTION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Experimental observations of bifurcated power decay lengths in the near Scrape-Off Layer of ST40 High Field Spherical Tokamak

The scrape-off layer parallel heat flux decay lengths measured at ST40, a high field, low aspect ratio spherical tokamak, have been observed to bifurcate into two groups. The wide group follows established H-mode scalings (ranging between 2 to 8 mm) while the narrow group falls up to 10 times below these scalings (between 0.2 and 0.8 mm), being comparable to the ion total Larmor radius rather than the ion poloidal Larmor radius. The heat flux profiles of the latter group can only be described by a multi-exponential function, rather than the single exponential function convoluted with a Gaussian. The onset of the narrow scrape-off layer width is observed to be associated with suppressed magnetic fluctuations, suggesting reduced electromagnetic turbulence levels in the SOL.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fracture length data for geothermal applications

Fracture lengths govern permeability and are unknowns in geothermal assessment. Along their lengths, fracture widths vary due to growth by linkage. Under the influence of diagenesis, narrow widths seal, breaking porosity continuity and reducing open length. The largest range of widths and thus susceptibility to fill occurs where fractures are linked by narrow segments. Outcrops of a geothermal target, Cambrian Potsdam quartz arenite, contain opening-mode fractures having lengths spanning five orders of magnitude from 0.082 mm to 17.9 m. Combined lengths measured at a range of scales can be described by power laws, but at a given image resolution, lengths are best fit by exponential functions. Owing to preferential sealing of small fractures, open fractures follow exponential functions, but values depend on rules for designating fractures as continuous. En échelon segments, offset 10 mm, are connected by narrow fractures or microfractures (hard linked) not evident on outcrop 1 m-elevation LiDAR or 30 m-height drone images. A rule that identifies where narrow and likely connected segments are located can yield lengths meaningful for flow simulation. Depending on diagenesis, continuity rules can halve or double average and maximum length values. Length values from outcrop for geothermal applications should be adjusted based on wellsite-specific diagenesis information.

15 GEOTHERMAL ENERGY↗

Multioutput Convolutional Neural Network for Improved Parameter Extraction in Time-Resolved Electrostatic Force Microscopy Data

Time-resolved scanning probe microscopy methods, like time-resolved electrostatic force microscopy (trEFM), enable imaging of dynamic processes ranging from ion motion in batteries to electronic dynamics in microstructured thin film semiconductors for solar cells. Reconstructing the underlying physical dynamics from these techniques can be challenging due to the interplay of cantilever physics with the actual transient kinetics of interest in the resulting signal. Previously, quantitative trEFM used empirical calibration of the cantilever or feed-forward neural networks trained on simulated data to extract the physical dynamics of interest. Both these approaches are limited by interpreting the underlying signal as a single exponential function, which serves as an approximation but does not adequately reflect many realistic systems. Here, we present a multi-branched, multi-output convolutional neural network (CNN) that uses the trEFM signal in addition to the physical cantilever parameters as input. The trained CNN accurately extracts parameters describing both single-exponential and bi-exponential underlying functions, and more accurately reconstructs real experimental data in the presence of noise. This article demonstrates an application of physics-informed machine learning to complex signal processing tasks, enabling more efficient and accurate analysis of trEFM.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predicting Pulsed-Laser Deposition SrTiO 3 Homoepitaxy Growth Dynamics Using High-Speed Reflection High-Energy Electron Diffraction

Pulsed-laser deposition (PLD) is a powerful technique for growing complex oxides with controlled stoichiometry. To understand growth dynamics therein, it is common to leverage in situ spectroscopies, such as reflection high-energy electron diffraction (RHEED), to monitor surface crystallinity. Most commercial systems rely on video-rate cameras operating at 60-120 Hz that lack sufficient temporal resolution to capture growth dynamics at practical deposition frequencies. Here, a high-speed platform to record in situ dynamics via RHEED at >500 Hz is implemented. An open-source analysis package is designed to fit diffraction spots to 2D Gaussians, allowing single-pulse surface reconstruction kinetics extraction. Using homoepitaxially deposited (001)-oriented SrTiO 3 as a model system, we demonstrate how high-speed RHEED can provide real-time insight into growth processes obscured by slower acquisition systems. By fitting the single-pulse intensity to a set of exponential functions, we observe changes in the characteristic decay time and mechanism correlated to the substrate step width and surface termination. We observe distinct surface effects, with diffraction intensity decaying on lower-energy TiO 2 -terminated surfaces and stabilizing on SrO- or mixed-terminated surfaces. Similarly, using an exponential model, the extracted characteristic time of adatom deposition decreases with increased density of bonding sites associated with mixed termination and narrower step widths. Ultimately, this work shows how increasing RHEED temporal resolution can uncover new insights into growth processes, with practical implications for the design and control of PLD processes. This experimental platform provides new capabilities to enable data-driven machine learning analysis and autonomous control systems to enhance the complexity and fecundity of PLD.

(SrO)↗

Self-Diffusivity Measurement of Eutectic F 7 LiNaK with and without Additives Using Quasi-Elastic Neutron Scattering

The atomic scale relaxation dynamics of eutectic F 7 LiNaK (46.5 LiF–11.5 NaF–42 KF mol %, Li-7 enriched) were measured using quasi-elastic neutron scattering (QENS) over a temperature range of 500–750 °C. Here, the effect of adding 0.988 mol % cerium, 0.499 mol % cesium, and 1.21 mol % zirconium individually to the dynamics of F 7 LiNaK was also investigated. The relaxation process in both pure and doped F 7 LiNaK molten salts was fit with a stretched exponential function and the temperature dependence follows an Arrhenius behavior over a wavevector transfer range of 0.4 Å –1 < Q < 0.9 Å –1 . The measured activation energy for self-diffusion is E a = 0.77 ± 0.02 eV/atom for pure molten F 7 LiNaK. The QENS response with additives added to F 7 LiNaK was also fit with a stretched exponential and the associated Arrhenius behavior was characterized with activation energies of E a = 0.88 ± 0.01 eV/atom for zirconium (1.21 mol %), E a = 1.02 ± 0.02 eV/atom for cerium (0.988 mol %), and E a = 0.71 ± 0.03 eV/atom for cesium (0.499 mol %). The measured diffusivities are compared to those simulated with a neural network force field model by Lee et al. [Lee, S.-C. Comparative Studies of the Structural and Transport Properties of Molten Salt FLiNaK Using the Machine-Learned Neural Network and Reparametrized Classical Forcefields. J. Phys. Chem. B 2021, 125(37), 10562–10570].

FLiNaK↗

Deep Learning without Global Optimization by Random Fourier Neural Networks

Here we introduce a new training algorithm for deep neural networks that utilize random complex exponential activation functions. Our approach employs a Markov chain Monte Carlo sampling procedure to iteratively train network layers, avoiding global and gradient-based optimization while maintaining error control. It consistently attains the theoretical approximation rate for residual networks with complex exponential activation functions, determined by network complexity. Additionally, it enables efficient learning of multiscale and high-frequency features, producing interpretable parameter distributions. Despite using sinusoidal basis functions, we do not observe Gibbs phenomena in approximating discontinuous target functions.

97 MATHEMATICS AND COMPUTING↗

Triangle Method for Dense ReLU Layers [SWR-25-72]

This software is an implementation of the methods for initializing and training neural networks to be more efficient per parameter, described more fully below and in the related publication: In theory, depth should make a ReLU network EXPONENTIALLY more efficient by enabling it to produce an exponential number of piecewise linear sections in its output. This reasoning is largely based on the work of mathematicians that have hand-constructed networks that make good use of depth. In practice however, even very deep ReLU networks that have been randomly initialized will behave identically to their shallow counterparts - missing an entire exponential dimension of efficiency. The triangle method is a first attempt at realizing the exponential potential of deep networks. Instead of randomly setting weights, we force pairs of neurons in each layer learn to build triangles (i.e. functions from [0,1] -> [0,1] that look like triangles). This is a very efficient pattern for generating lots of linear pieces because composing two triangular functions doubles the number of pieces with each composition. The triangle method is more than just a different initialization, it is a new paradigm of training. Instead of making direct updates to the matrix weights, we do an extra step of backpropagation to collect the derivatives of the loss function with respect to the shapes of the triangles, training them to tilt left or right. This process essentially holds the networks hand throughout the loss landscape and forces it to always use depth effectively by producing triangular shapes internally. This can produce several orders of magnitude of improvement on convex one-dimensional regression problems. Much more theoretical work is needed to realize its full potential beyond this context, but the implementation in this repository will still work in arbitrary numbers of dimensions. The file Triangle_Method.py is a generalized form of the method that will build each neuron its own custom 1-d convex activation function (with exponential efficiency). Example usage on one dimensional problems can be found in Example_Usage.ipynb and an example of using this in a real neural network can be found in Example_VGG16_CIFAR10.ipynb.

Milkert, Max [National Renewable Energy Laboratory↗

Topology-Aware Reinforcement Learning for Voltage Control: Centralized and Decentralized Strategies

Volt-VAR control (VVC) methods based on deep reinforcement learning (DRL) can effectively control distribution grid voltage and minimize power loss by implementing corrective and preventive control measures on the reactive power output of inverter-based distributed energy resources (DERs). However, model-free DRL-based VVC approaches usually cannot capture the important topological feature of the power system since they use a fully-connected network (FCN) to deliver the action. Therefore, this paper proposes a graph convolutional network (GCN)-based DRL approach that can employ the topological information of the network to take better control action for regulating the voltage. Our implementation allows for both centralized and decentralized configurations, utilizing a single agent and multiple agents respectively. Although the centralized GCN-based DRL approach has its advantages of minimizing voltage fluctuation and power loss, it is not suitable for large scale power systems due to its challenges in terms of scalability, computation speed and potential single points of failure. Therefore, these problems can be resolved using the decentralized GCN-based DRL approach. Moreover, to ensure the safe operation of the model, our proposed approach incorporates an exponential barrier function while formulating the reward function for each agent. To validate performance of the proposed approaches, the proposed model is tested on modified IEEE test systems and the performances are measured in terms on voltage fluctuation reduction, minimization of power loss and computational speed. Finally, the results show that the proposed topology-aware approach outperforms the FCN-based DRL approach in terms of reducing voltage fluctuation and minimizing power loss of the network. Moreover, it is shown that the decentralized GCN-based DRL has faster computational speed than other approaches.

42 ENGINEERING↗

Decoherence dynamics in molecular qubits: Exponential, Gaussian and beyond

In this article, we examine how the structure of system–bath interactions can determine commonly encountered temporal decoherence patterns, such as Gaussian and exponential decay, in molecular and other qubits coupled to a thermal bosonic bath. The analysis, based on a pure dephasing picture that admits analytical treatment, shows that decoherence, in general, is neither purely Gaussian nor exponential but rather the exponential of oscillatory functions, with periods determined by the bath’s frequencies. For initially unentangled qubit-bath states, Gaussian decay is always present at early times. It becomes increasingly dominant with increasing temperature, qubit–bath interaction strength, and bath correlation time. Initial system–bath entanglement that arises due to displacement in the position of the bath states preserves the Gaussian decay. By contrast, strict exponential decay arises only in very specific models that we isolate. However, it becomes dominant for times longer than the bath correlation time or for early times when there is initial entanglement due to momentum displacement of the bath states. For molecular electronic decoherence, the long-time exponential regime plays a limited role as it emerges after most coherence is lost. Thus, the Gaussian decay provides a more suitable (albeit imperfect) model of such decoherence. Furthermore, we discuss the connection between electronic decoherence dynamics and electronic spectroscopic line shape theory, where Gaussian spectral peaks correspond to Gaussian coherence decay and Lorentzian peaks correspond to exponential coherence decay. We find that Gaussian spectral peaks, usually associated with inhomogeneous broadening, can emerge from the entangling unitary system–bath dynamics even when there is no inhomogeneity in the initial conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cluster spin glass correlations and dynamics in Zn 0.5⁢ Mn 0.5⁢ Te

Here, we present a combined magnetometry, muon spin-relaxation (𝜇⁢SR), and neutron-scattering study of the insulating spin glass Zn 0.5 ⁢Mn 0.5 ⁢Te, for which magnetic Mn 2+ and nonmagnetic Zn 2+ ions are randomly distributed on a face-centered cubic lattice. The magnetometry and 𝜇⁢SR results confirm a spin freezing transition around 𝑇 𝑓 ≈ 23 K, with the spin-fluctuation rate decreasing gradually and somewhat inhomogeneously through the sample volume as the temperature decreases toward 𝑇 𝑓 . Characteristic spin-correlation times well above 𝑇 𝑓 are on the order of 10 −10 s, much slower than typically observed in canonical spin glasses but in line with expectations for a cluster spin glass. Using magnetic pair distribution function (mPDF) analysis and reverse Monte Carlo (RMC) modeling of the magnetic diffuse neutron-scattering data, we show that the spin-glass ground state consists of clusters of spins exhibiting short-range-ordered type-III antiferromagnetic correlations with a locally ordered moment of 3.1⁢(1)⁢𝜇 B between nearest-neighbor spins. The type-III correlations decay exponentially as a function of spin separation distance with a correlation length of approximately 5 Å. The diffuse magnetic scattering and corresponding mPDF show no significant changes across 𝑇 𝑓 , indicating that the dynamically fluctuating short-range spin correlations in the paramagnetic state retain the same basic type-III configuration that characterizes the spin-glass state; the only change apparent from the neutron-scattering data is a gradual reduction of the correlation length and locally ordered moment with increasing temperature. Taken together, these results paint a unique and detailed picture of the local magnetic structure and dynamics in Zn 0.5 ⁢Mn 0.5⁢ Te and provide strong evidence that this material is best described as a cluster spin glass. In addition, this work showcases a statistical method for extracting diffuse scattering signals from neutron powder diffraction data, which we developed to facilitate the mPDF and RMC analysis of the neutron data. This method has the potential to be broadly useful for neutron powder diffraction experiments on a variety of materials with short-range atomic or magnetic order.

magnetism↗

A variational framework for residual-based adaptivity in neural PDE solvers and operator learning

Residual-based adaptive strategies are widely used in scientific machine learning yet remain largely heuristic. We introduce a variational framework that formalizes these methods through convex transformations of the residual, where different transformations correspond to distinct objective functionals. For instance, exponential weights target uniform error minimization, while linear weights recover quadratic error minimization. This perspective reveals adaptive weighting as a means of selecting sampling distributions that optimize a primal objective, directly linking discretization choices to error metrics. This principled approach yields three key benefits: it enables systematic design of adaptive schemes, reduces discretization error by lowering estimator variance, and enhances learning dynamics by improving gradient signal-to-noise ratio. Extending the framework to operator learning, we demonstrate substantial performance gains across diverse optimizers and architectures. Our results provide a theoretical perspective for residual-based adaptivity and establish a foundation for principled discretization and training.

97 MATHEMATICS AND COMPUTING↗

Dataset for manuscript "Rotational Memory Function of SPC/E water"

Memory effect are essential for dynamics of condensed materials and are responsible for non-exponential relaxation of correlation functions of dynamic variables through the memory function entering the memory equation. Memory functions of dipole rotations for polar liquids have never been calculated. We present here calculations of memory functions and single-dipole rotations and of the overall system dipole moment for SPC/E water measured by dielectric spectroscopy. The memory functions for single-particle and collective dynamics turn out to be nearly identical. This result validates theories of dielectric spectroscopy in terms of single-particle time correlation function and the connection between the collective and single-particle relaxation times in terms of the Kirkwood factor. The dataset includes single particle and system dipole moments, including their time-dependence.

74 ATOMIC AND MOLECULAR PHYSICS↗

Rotational memory function of SPC/E water

Memory effects are essential for the dynamics of condensed materials and are responsible for non-exponential relaxation of correlation functions of dynamic variables through the memory function. Memory functions of dipole rotations for water have never been calculated directly from molecular dynamics simulations. We present here calculations of memory functions for single-dipole rotations and for the overall dipole moment of the sample for SPC/E water. The normalized memory functions for single-particle and collective dipole dynamics turn out to be nearly identical. This result validates theories of dielectric spectroscopy in terms of single-particle time correlation functions and the connection between the collective and single-particle relaxation times through the Kirkwood factor. The dielectric function in this formalism contains no new dynamic information that does not exist in the single-dipole correlation function. A short memory time, ≲1 fs, justifies the use of the mathematics of rotational diffusion to describe the dynamics of a single molecular dipole moment in bulk water. Here, an analytical equation for the rotational memory time is derived.

Asthagiri, Dilipkumar N. [Oak Ridge National Labor↗

Sparse Cholesky factorization for solving nonlinear PDEs via Gaussian processes

In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered considerable interest due to their flexibility, robust theoretical guarantees, and close ties to traditional methods. They can transform the solving of general nonlinear PDEs into solving quadratic optimization problems with nonlinear, PDE-induced constraints. However, the complexity bottleneck lies in computing with dense kernel matrices obtained from pointwise evaluations of the covariance kernel, and its partial derivatives, a result of the PDE constraint and for which fast algorithms are scarce. The primary goal of this paper is to provide a near-linear complexity algorithm for working with such kernel matrices. We present a sparse Cholesky factorization algorithm for these matrices based on the near-sparsity of the Cholesky factor under a novel ordering of pointwise and derivative measurements. The near-sparsity is rigorously justified by directly connecting the factor to GP regression and exponential decay of basis functions in numerical homogenization. We then employ the Vecchia approximation of GPs, which is optimal in the Kullback-Leibler divergence, to compute the approximate factor. This enables us to compute ϵ-approximate inverse Cholesky factors of the kernel matrices with complexity O(N log d (N/ϵ)) in space and O(N log 2d (N/ϵ)) in time. We integrate sparse Cholesky factorizations into optimization algorithms to obtain fast solvers of the nonlinear PDE. We numerically illustrate our algorithm’s near-linear space/time complexity for a broad class of nonlinear PDEs such as the nonlinear elliptic, Burgers, and Monge-Ampère equations. In summary, we provide a fast, scalable, and accurate method for solving general PDEs with GPs and kernel methods.

97 MATHEMATICS AND COMPUTING↗

Comparison between explicit and implicit discretization strategies for a dissipative thermal environment

We investigate strategies for simulating open quantum systems coupled to dissipative baths by comparing explicit wave function-based discretization [via multi-layer multi-configuration time-dependent Hartree (ML-MCTDH)] and the implicit density matrix-based master equation method [via tree tensor network hierarchical equations of motion (TTN-HEOM)]. For dissipative baths characterized by exponentially decaying bath correlation functions, the implicit discretization approach of HEOM—rooted in bath correlation function decompositions—proves significantly more efficient than explicit discretization of the bath into discrete harmonic modes. Explicit methods, like ML-MCTDH, require extensive mode discretization to approximate continuum baths, leading to computational bottlenecks. Case studies for two-level systems and a Fenna–Matthews–Olson complex model highlight TTN-HEOM’s superiority in capturing dissipative dynamics with relaxations with a minimal number of auxiliary modes, while the explicit methods are as exact as the HEOM in pure dephasing regimes. This comparison is enabled by the TENSO package, which has both ML-MCTDH and TTN-HEOM implemented using the same computational structure and propagation strategy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Complementing Dynamical Downscaling With Super‐Resolution Convolutional Neural Networks

Despite advancements in Artificial Intelligence (AI) methods for climate downscaling, significant challenges remain for their practicality in climate research. Current AI-methods exhibit notable limitations, such as limited application in downscaling Global Climate Models (GCMs), and accurately representing extremes. To address these challenges, we implement an AI-based methodology using super-resolution convolutional neural networks (SRCNN), trained and evaluated on 40 years of daily precipitation data from a reanalysis and a high-resolution dynamically downscaled counterpart. The dynamical downscaled simulations, constrained using spectral nudging, enable the replication of historical events at a higher resolution. This allows the SRCNN to emulate dynamical downscaling effectively. Modifications, such as incorporating elevation data and data pre-processing enhances overall model performance, while using exponential and quantile loss functions improve the simulation of extremes. Our findings show SRCNN models efficiently and skillfully downscale precipitation from GCMs. Future work will expand this methodology to downscale additional variables for future climate projections.

54 ENVIRONMENTAL SCIENCES↗

Emergent facilitation and glassy dynamics in supercooled liquids

In supercooled liquids, dynamical facilitation refers to a phenomenon where microscopic motion begets further motion nearby, resulting in spatially heterogeneous dynamics. This is central to the glassy relaxation dynamics of such liquids, which show super-Arrhenius growth of relaxation timescales with decreasing temperature. Despite the importance of dynamical facilitation, there is no theoretical understanding of how facilitation emerges and impacts relaxation dynamics. Here, we present a theory that explains the microscopic origins of dynamical facilitation. We show that dynamics proceeds by localized bond-exchange events, also known as excitations, resulting in the accumulation of elastic stresses with which new excitations can interact. At low temperatures, these elastic interactions dominate and facilitate the creation of new excitations near prior excitations. Using the theory of linear elasticity and Markov processes, we simulate a model, which reproduces multiple aspects of glassy dynamics observed in experiments and molecular simulations, including the stretched exponential decay of relaxation functions, the super-Arrhenius behavior of relaxation timescales as well as their two-dimensional finite-size effects. The model also predicts the subdiffusive behavior of the mean squared displacement (MSD) on short, intermediate timescales. Furthermore, we derive the phonon contributions to diffusion and relaxation, which when combined with the excitation contributions produce the two-step relaxation processes, and the ballistic–subdiffusive–diffusive crossover MSD behaviors commonly found in supercooled liquids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Code Generators for Floating-Point Unit Design in Integrated Circuits (OpenFloat) v1.0

This IP provides a comprehensive set of code generators for various floating-point units (FPUs) essential for integrated circuit design and integration, targeting a broad spectrum of applications, including machine learning and scientific computing. The suite includes FP adders, multipliers, subtractors, dividers, reciprocals, exponentials, square roots, trigonometric functions (sine, cosine, arctangent), and more. It supports customizable hardware design parameters, such as precision (16, 32, 64, and 128 bits) and pipeline depths, offering users enhanced flexibility and productivity. The generated code is in an industry-standard hardware description language, ensuring compatibility with standard design flows, including simulation, verification, synthesis, and implementation on both field-programmable gate arrays (FPGAs) and application-specific integrated circuits (ASICs).

Shalf, JohnM. [Lawrence Berkeley National Laborato↗