Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “differential equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Temporally quasiperiodic data, propagating in the laboratory frame, can be rendered periodic by Galilean transformation

For a broad class of distributions of temperature, concentration, or another quantity propagating rectilinearly, we show that temporally quasiperiodic behavior in the laboratory frame can be rendered periodic by Galilean transformation. The approach is illustrated analytically and numerically using as an example a closed-form model distribution generated from a one-dimensional partial differential equation, and a detailed process is developed to determine frame speed from more general quasiperiodic, one-dimensional, temporally- and spatially-discretized data. Furthermore, the approach is extended to two- and three-dimensional rectilinear propagation, and its application to nonrectilinear propagation, along with implications for interpreting noise-corrupted data, are also discussed.

97 MATHEMATICS AND COMPUTING↗

Machine learning for the identification of phase transitions in interacting agent-based systems: A Desai-Zwanzig example

Deriving closed-form analytical expressions for reduced-order models, and judiciously choosing the closures leading to them, has long been the strategy of choice for studying phase- and noise-induced transitions for agent-based models (ABMs). In this paper, we propose a data-driven framework that pinpoints phase transitions for an ABM—the Desai-Zwanzig model—in its mean-field limit, using a smaller number of variables than traditional closed-form models. To this end, we use the manifold learning algorithm Diffusion Maps to identify a parsimonious set of data-driven latent variables, and we show that they are in one-to-one correspondence with the expected theoretical order parameter of the ABM. We then utilize a deep learning framework to obtain a conformal reparametrization of the data-driven coordinates that facilitates, in our example, the identification of a single parameter-dependent ordinary differential equation (ODE) in these coordinates. Additionally, we identify this ODE through a residual neural network inspired by a numerical integration scheme (forward Euler). We then use the identified ODE—enabled through an odd symmetry transformation—to construct the bifurcation diagram exhibiting the phase transition.

97 MATHEMATICS AND COMPUTING↗

Mechanochemical topological defects in an active nematic

We propose a reaction-diffusion system that converts topological information of an active nematic into chemical signals. We show that a curvature-activated reaction dipole is sufficient for creating a system that dynamically senses topology by producing a concentration field possessing local extrema coinciding with ±$\frac{1}{2}$ defects. The enabling term is analogous to polarization charge density seen in dielectric materials. We demonstrate the ability of this system to identify defects in both passive and active nematics. Our results illustrate that a relatively simple feedback scheme, expressed as a system of partial differential equations, is capable of producing chemical signals in response to inherently nonlocal structures in anisotropic media. Here, we posit that such coarse-grained systems can help generate testable hypotheses for regulated processes in biological systems, such as morphogenesis, and motivate the creation of bio-inspired materials that utilize dynamic coupling between nematic structure and biochemistry.

42 ENGINEERING↗

Competition between roughness and strength for scale-dependent surfaces

Rocks famously have scale-dependent strength, yet the actual dependence is notoriously hard to measure or incorporate into any theoretical framework. Natural rough surfaces present an opportunity to solve the problem. Surfaces sliding in shear evolve as protrusions collide. These asperities can deform or break, thus creating a new surface shape. In particular, natural surfaces have roughness at all scales as well as scale-dependent strength. Based on a scaling analysis, we have previously suggested that the scale-dependent aspect ratio of steady-state surfaces should be proportional to the scale-dependent shear strain at yield. If true, scale-dependent strength could easily be inferred from natural surfaces. Thus, moving beyond the scaling argument to a rigorous treatment of scale-dependent strength for multiscale rough surfaces in shear is important. However, analytic frameworks for analyzing multiscale problems are challenging, as conventional continuum mechanics typically involves a single value for a material property across scales. Here, in this work, we build on the formalism of Persson (2001) that presents a method to compute contact area for rough surfaces with a prescribed topographic spectrum using a stochastic differential equation. The Persson formalism allows for plastic yield under normal loading of otherwise elastic materials and leaves open the possibility of scale-dependent yield stress. In this study, we pursue this route to develop a theory and numerical results for the yielding of a rough, elastoplastic surface with scale-dependent yield stress. Here, we examine surfaces for which the power spectrum of the topography 𝐶 and yield stress 𝑌 follow power laws as a function of scale 𝜆, such that 𝐶∼𝜆 −𝑚 and 𝑌∼𝜆 −𝑛 , respectively. In this formal treatment of the problem, we focus on surfaces in contact and the resulting yield and do not impose shear. Numerical solutions show that the deviation from the elastic scaling solution is bounded as expected by the prior 1D heuristic scaling argument that anticipates the Hurst exponent as 1−𝑛. We also show that the plasticity is expected to erode the contacts if 𝑚 is lower than 𝑛−3, which corresponds to a Hurst exponent lower than 1−𝑛/2. This result is rigorously sound for 2D, i.e., realistic surfaces, and quantitatively different than the prior scaling argument. The theory now permits a correspondingly quantitative approach to interpreting natural surfaces.

elasticity↗

Embedding hard physical constraints in neural network coarse-graining of three-dimensional turbulence

In recent years, deep learning approaches have shown much promise in modeling complex systems in the physical sciences. A major challenge in deep learning of partial differential equations is enforcing physical constraints and boundary conditions. In this work, we propose a general framework to directly embed the notion of an incompressible fluid into convolutional neural networks, and apply this to coarse-graining of turbulent flow. These physics-embedded neural networks leverage interpretable strategies from numerical methods and computational fluid dynamics to enforce physical laws and boundary conditions by taking advantage the mathematical properties of the underlying equations. Here, we demonstrate results on three-dimensional fully developed turbulence, showing that this technique drastically improves local conservation of mass, without sacrificing performance according to several other metrics characterizing the fluid flow.

97 MATHEMATICS AND COMPUTING↗

Autoregressive Neural Network for Simulating Open Quantum Systems via a Probabilistic Formulation

The theory of open quantum systems lays the foundation for a substantial part of modern research in quantum science and engineering. Rooted in the dimensionality of their extended Hilbert spaces, the high computational complexity of simulating open quantum systems calls for the development of strategies to approximate their dynamics. In this Letter, we present an approach for tackling open quantum system dynamics. Using an exact probabilistic formulation of quantum physics based on positive operator-valued measure, we compactly represent quantum states with autoregressive neural networks; such networks bring significant algorithmic flexibility due to efficient exact sampling and tractable density. We further introduce the concept of string states to partially restore the symmetry of the autoregressive neural network and improve the description of local correlations. Efficient algorithms have been developed to simulate the dynamics of the Liouvillian superoperator using a forward-backward trapezoid method and find the steady state via a variational formulation. Our approach is benchmarked on prototypical one-dimensional and two-dimensional systems, finding results which closely track the exact solution and achieve higher accuracy than alternative approaches based on using Markov chain Monte Carlo method to sample restricted Boltzmann machines. Our Letter provides general methods for understanding quantum dynamics in various contexts, as well as techniques for solving high-dimensional probabilistic differential equations in classical setups.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Deep Electric Field Predictions by Drift-Reduced Braginskii Theory with Plasma-Neutral Interactions Based on Experimental Images of Boundary Turbulence

We present 2-dimensional turbulent electric field calculations via physics-informed deep learning consistent with (i) drift-reduced Braginskii theory under the framework of an axisymmetric fusion plasma with purely toroidal field and (ii) experimental estimates of the fluctuating electron density and temperature on open field lines obtained from analysis of gas puff imaging of a discharge on the Alcator C-Mod tokamak. The inclusion of effects from the locally puffed atomic helium on particle and energy sources within the reduced plasma turbulence model are found to strengthen correlations between the electric field and electron pressure. The neutrals are also directly associated with broadening the distribution of turbulent field amplitudes and increasing ${\bf E \times B}$ shearing rates. As a result, this demonstrates a novel approach in plasma experiments by solving for nonlinear dynamics consistent with partial differential equations and data without encoding explicit boundary nor initial conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Data-Driven Discovery of Active Nematic Hydrodynamics

Active nematics can be modeled using phenomenological continuum theories that account for the dynamics of the nematic director and fluid velocity through partial differential equations (PDEs). While these models provide a statistical description of the experiments, the relevant terms in the PDEs and their parameters are usually identified indirectly. We adapt a recently developed method to automatically identify optimal continuum models for active nematics directly from spatio-temporal data, via sparse regression of the coarse-grained fields onto generic low order PDEs. After extensive benchmarking, we apply the method to experiments with microtubule-based active nematics, finding a surprisingly minimal description of the system. Furthermore, our approach can be generalized to gain insights into active gels, microswimmers, and diverse other experimental active matter systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Coulomb Branch Amplitudes from a Deformed Amplituhedron Geometry

The amplituhedron provides, via geometric means, the all-loop integrand of scattering amplitudes in maximally supersymmetric Yang-Mills theory. Unfortunately, dimensional regularization, used conventionally for integration, breaks the beautiful geometric picture. This motivates us to propose a “deformed” amplituhedron. Focusing on the four-particle amplitude, we introduce two deformation parameters, which can be interpreted as particle masses. We provide evidence that the mass pattern corresponds to a specific choice of vacuum expectation values on the Coulomb branch. The deformed amplitude is infrared finite, making the answer well defined in four dimensions. Leveraging four-dimensional integration techniques based on differential equations, we compute the amplitude up to two loops. In the limit where the deformation parameters are taken to zero, we recover the known Bern-Dixon-Smirnov amplitude. In the limit where only one deformation parameter is taken to zero, we find a connection to the angle-dependent cusp anomalous dimension. Published by the American Physical Society 2024

Physics↗

Conservative Binary Dynamics at Order 𝛼 5 in Electrodynamics

We compute the potential-photon contributions to the classical relativistic scattering angle of two charged nonspinning bodies in electrodynamics through fifth order in the coupling. We use the scattering amplitudes framework, effective field theory, and multiloop integration techniques based on integration by parts and differential equations. At fifth order, the result is expressed in terms of cyclotomic polylogarithms. Our calculation demonstrates the feasibility of the corresponding calculations in general relativity, including the evaluation of the encountered four-loop integrals.

classical electromagnetism↗

Mesoscopic structure of mixed type domain walls in multiaxial ferroelectrics

The structure of a 180° uncharged rotational domain wall in a multiaxial ferroelectric film is studied in the framework of an analytical Landau-Ginzburg-Devonshire (LGD) approach. Finite element modeling (FEM) is used to solve numerically the system of the coupled nonlinear Euler-Lagrange (EL) second-order differential equations for two components of polarization. We show that the structure of the domain wall and corresponding metastable or stable phase of the film are controlled by a single parameter—the dimensionless ferroelectric anisotropy factor μ. We fitted the static profile of a solitary domain wall, calculated by FEM, with kinklike functions for polarization components, and extracted the five μ-dependent parameters from the fitting to FEM curves. The surprisingly high accuracy of the fitting results for two polarization components in the entire μ range allows us to conclude that the analytical functions, which are trial functions in the direct variational method, can be treated as a high-accuracy variational solution of the static EL equations. We further derive exact two-component analytical solutions of the static EL equations for a polydomain 180° domain structure in a multiaxial ferroelectric film. Using these, we derive analytical expressions for the system free energy and analyze its dependence on the film thickness and boundary conditions at the film surfaces. The single-domain state is ground for zero polarization derivative at the surfaces, while the polydomain states minimize the system energy for zero polarization at the surfaces. Counterintuitively, the energy of the polydomain states split into two levels, “0” and “1,” for zero polarization at the surfaces, and each of the levels contains a large number of close-energy sublevels, whose structure is characterized by a different number and type of domain walls. The analytical solutions can become a useful tool for Bayesian analysis of high-resolution scanning transmission electron microscopy images in ferroelectric films.

36 MATERIALS SCIENCE↗

Adiabatic quantum imaginary time evolution

We introduce an adiabatic state preparation protocol which implements quantum imaginary time evolution under the Hamiltonian of the system. Unlike the original quantum imaginary time evolution algorithm, adiabatic quantum imaginary time evolution does not require quantum state tomography during its runtime and, unlike standard adiabatic state preparation, the final Hamiltonian is not the system Hamiltonian. Instead, the algorithm obtains the adiabatic Hamiltonian by integrating a classical differential equation that ensures that one follows the imaginary time evolution state trajectory. We introduce some heuristics that allow this protocol to be implemented on quantum architectures with limited resources. We explore the performance of this algorithm via classical simulations in a one-dimensional spin model and highlight essential features that determine its cost, performance, and implementability for longer times, and compare to the original quantum imaginary time evolution for ground-state preparation. More generally, our algorithm expands the range of states accessible to adiabatic state preparation methods beyond those that are expressed as ground states of simple explicit Hamiltonians. Published by the American Physical Society 2024

Hejazi, Kasra (ORCID:000000032349478X)↗

Large-scale white noise and cosmology

The generation of white noise on large scales is a generic property of the dynamics of physical systems described by local nonlinear partial differential equations. Nonlinearities prevent the small-scale dynamics from being erased by smoothing. Unresolved small-scale dynamics act as an uncorrelated (white or Poissonian) noise (seemingly stochastic but actually deterministic) contribution to large-scale dynamics. This white noise exists even when the dynamics is very nearly linear. In cases where the power spectrum is sub-Poissonian on large scales, this noise will dominate on the largest scale power no matter the amplitude of the inhomogeneities. Such is the case in the standard model of cosmology, where the primordial density power spectrum is expected to have an almost Harrison-Zel’dovich, P [ k ] ∼ k , spectrum on a much broader range of scales than can be observed. Even though linear gravitational evolution dominates nonlinear corrections by a factor of ∼ 10 5 , the nonobservation of white noise on the Hubble scale precludes the extrapolation of this power law below the comoving 1 pc scale. More generally, observation or nonobservation of large-scale white noise provides a powerful probe of the Universe on very small scales in the early Universe. Gravitational radiation, phase transitions, vorticity, and running of the spectral index are all phenomena that can be probed with large-scale white noise. Large-scale white noise is a nonoptional feature of all cosmological models but one which has not heretofore been appreciated.

Barenboim, Gabriela [Valencia U., IFIC; Valencia U↗

Adaptive PID Gain Scheduling Control for Hydropower Turbine Using Neural CDE and Stochastic Distribution Shaping

This paper introduces a gain-scheduling PID controller design strategy for hydroturbine frequency control mode. This scheme first uses real data to learn the nonlinear dynamics of the hydroturbine using neural controlled differential equations and then perturbs the obtained nonlinear system at different equilibrium points, based on which a static output feedback adaptive dynamic programming algorithm is then used to optimize the PID gains for each equilibrium point. Moreover, a continuous-time version of stochastic distribution control is proposed to further fine-tune the optimized PID gains. Finally, the controller is obtained by implementing linear interpolation between the optimized PID control gains. The simulation results show that the proposed gain-scheduling PID controller can control a larger range of operation points compared with the given fixed PID controller and the baseline method. Compared with the given fixed PID controller, the proposed gain-scheduling PID controller can regulate hydroturbine frequency against disturbances induced by power-load variation with over 50% less overshoot for some operation points.

13 HYDRO ENERGY↗

Joint Resource Modeling and Assessment for Hybrid Distributed Solar and Wind Systems

The inherent variability and uncertainty in distributed energy resources can presents myriad challenges to the planning and operations of power systems. These risks are poised to become larger as the penetration of renewable energy sources rises in the power generation mix. Hybrid solar-wind energy systems are able to mitigate some of these risks by their complementary resource availability. Surface solar and wind fields are coupled and correlated in both space and time. Appropriately estimating the hybrid solar wind energy system requires simulating the spatio-temporal structure of these fields that can be produced for each time horizon. We introduce a novel joint spatio-temporal stochastic differential equation (SPDE) approach that captures the spatio-temporal dynamics of solar and wind fields and their joint dependency over a domain for each time step. In the case study on Colorado, we consider nonstationary three-level hierarchical spatio temporal models for both hourly solar irradiance data and wind speed data in Colorado. Dependence between the solar irradiance data and wind speed data is captured by a shared spatio-temporal random effect. Our approach performs well in terms of the prediction score criterion.

joint modeling↗

Computing with a Chemical Reservoir

Contemporary computation is expensive, with large language models and artificial intelligence becoming more common in daily life. However, high-performance computing is reaching the limits in speed and energy expenditure, and domain science requires ever-increasing computational capacity, with simulations and data analysis pipelines ever-growing in complexity. As we progress towards post-exascale computation, with the associated high energy costs, new methods of energy-conscious computation are required. Novel analog and hybrid digital-analog systems can overcome these challenges, and chemical reactions offer a promising avenue. Computers based on chemistry can provide compact desktop devices with immense computational power. These devices are readily scalable by considering greater reaction systems or vessels, meeting the high-performance requirements for scientific workflows. In this article, we present ChemComp, a compilation pipeline for the conversion of ordinary differential equations into implementable chemical reactions. We then demonstrate the solving capabilities of ChemComp by emulating a potential chemical reservoir device. We leverage the multi-layer intermediate representation (MLIR) compiler framework to implement an expressive chemical reaction abstraction and propose a path for chemical reaction networks (CRNs) to represent mathematical problems effectively. Combined, we demonstrate a potential workflow that can harness chemistry’s computing power to create energy-efficient, high-performance computation systems for contemporary computing needs.

artificial intelligence↗

Certifiably Robust Neural ODE With Learning-Based Barrier Function

Neural Ordinary Differential Equations (ODEs) have gained traction in many applications. While recent studies have focused on empirically increasing the robustness of neural ODEs against natural or adversarial attacks, certified robustness is still lacking. In this work, we propose a framework for training a neural ODE using barrier functions and demonstrate improved robustness for classification problems. Finally, we further provide the first generalization guarantee of robustness against adversarial attacks using a wait-and-judge scenario approach.

97 MATHEMATICS AND COMPUTING↗

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been recently reported that successfully solve PDEs, with examples including deep feed forward networks, generative networks, and deep encoder-decoder networks. However, practical adoption of these approaches is limited by the difficulty in training these models, especially to make predictions at large output resolutions (≥1024×1024). Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models - training in reasonable time as well as distributing the storage requirements. Our framework provides several out of the box functionality including (a) loss integrity independent of number of processes, (b) synchronized batch normalization, and (c) distributed higher-order optimization methods. We show excellent scalability of this framework on both cloud as well as HPC clusters, and report on the interplay between bandwidth, network topology and bare metal vs cloud. We deploy this approach to train generative models of sizes hitherto not possible, showing that neural PDE solvers can be viably trained for practical applications. We also demonstrate that distributed higher-order optimization methods are 2-3× faster than stochastic gradient-based methods and provide minimal convergence drift with higher batch-size.

PDEs↗