SEARCH · Engineering Papers

Results for “nonlinear function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators

It is widely known that neural networks (NNs) are universal approximators of continuous functions. However, a less known but powerful result is that a NN with a single hidden layer can accurately approximate any nonlinear continuous operator. This universal approximation theorem of operators is suggestive of the structure and potential of deep neural networks (DNNs) in learning continuous operators or complex systems from streams of scattered data. Here, in this work, we thus extend this theorem to DNNs. We design a new network with small generalization error, the deep operator network (DeepONet), which consists of a DNN for encoding the discrete input function space (branch net) and another DNN for encoding the domain of the output functions (trunk net). We demonstrate that DeepONet can learn various explicit operators, such as integrals and fractional Laplacians, as well as implicit operators that represent deterministic and stochastic differential equations. We study different formulations of the input function space and its effect on the generalization error for 16 different diverse applications.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Time-reversed nonlinear acoustic downhole pore pressure measurements

Apparatus (10) and methods for measurement of pore pressure in rock formations through a metal borehole casing (32) after a well is cased and cemented, are described. Such measurements may be accomplished by using the Dynamic Acoustic Elasticity (DAE) method for characterizing nonlinear parameters by perturbing a selected rock formation region with a High Amplitude, Low Frequency (HALF) acoustic strain wave, and probing this region using a Low Amplitude, High Frequency (LAHF) acoustic wave (18), (22). Time reversal techniques (36) may be employed for focusing acoustic energy into the formation in the vicinity of the pipe or open hole. The change in wave speed of the probe pulses as the HALF induced strain wave oscillation propagates through the formation, as a function of the induced strain, may be used to determine the nonlinear elastic parameters α, β, δ, and A of the pore pressure, from which the pore pressure may be determined in the region of the HALF wave.

Goodman, Harvey E.↗

DOE OSTI2024

Development of Steady-State and Dynamic Mass and Energy Constrained Neural Networks for Distributed Chemical Systems Using Noisy Transient Data

The paper presents the development of algorithms for mass and energy constrained neural network models that can exactly conserve the overall mass and energy of distributed chemical process systems, even though the noisy transient data used for optimal model training violate the same. In contrast to approximately satisfying mass and energy balance constraints of a system by soft penalization of objective function, algorithms have been developed for solving equality-constrained nonlinear optimization problems, thus providing the guarantee of exactly satisfying the system mass and energy conservation laws. For developing dynamic mass-energy constrained network models for distributed systems, hybrid series and parallel dynamic-static neural networks have been leveraged. The developed algorithms for solving both the training and forward problems are validated using both steady-state and dynamic data in the presence of various noise characteristics. The developed data-driven algorithms are flexible to exactly satisfy mass and energy balance constraints for dynamic chemical processes if the system holdup information is available. The proposed network structures and algorithms are applied to the development of data-driven lumped and distributed models of an adiabatic superheater/reheater system, a nonisothermal continuous stirred tank reactor, as well as an electrically heated plug-flow reactor system where one form of energy gets transformed to another. It has been observed that the mass-energy constrained neural networks yield a root mean squared error of <1% with respect to the system truth for the case studies evaluated in this work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Investigation of Causal Relationships of the Cross‐Scale Wave Coupling Through Information Theoretical Approach

On 2015 October 2, MMS spacecraft observed an electron micro-injection event near the southern hemispheric high-altitude cusp, coinciding with intense wave activity across several frequency bands. Here, we investigated the MMS magnetic field and plasma during this event to explore cross-scale coupling among the wave modes. Employing the Hilbert-Huang transform, we perform an empirical mode decomposition to extract frequencies and amplitudes of the intrinsic mode functions (IMFs). In this analysis, we establish both linear and nonlinear relationships and examine the information transfer between the IMFs. Notably, the transfer entropy suggests that high frequency ion cyclotron waves may be driven by the mirror mode structures. Our case study effectively demonstrates the utility of the information theory based tools for studying cross-scale wave coupling phenomena.

Rivera, Elmer C. [Andrews University, Berrien Spri↗

DOE OSTI2023

Engineering the temporal dynamics of all-optical switching with fast and slow materials

Abstract All-optical switches control the amplitude, phase, and polarization of light using optical control pulses. They can operate at ultrafast timescales – essential for technology-driven applications like optical computing, and fundamental studies like time-reflection. Conventional all-optical switches have a fixed switching time, but this work demonstrates that the response-time can be controlled by selectively controlling the light-matter-interaction in so-called fast and slow materials. The bi-material switch has a nanosecond response when the probe interacts strongly with titanium nitride near its epsilon-near-zero (ENZ) wavelength. The response-time speeds up over two orders of magnitude with increasing probe-wavelength, as light’s interaction with the faster Aluminum-doped zinc oxide (AZO) increases, eventually reaching the picosecond-scale near AZO’s ENZ-regime. This scheme provides several additional degrees of freedom for switching time control, such as probe-polarization and incident angle, and the pump-wavelength. This approach could lead to new functionalities within key applications in multiband transmission, optical computing, and nonlinear optics.

42 ENGINEERING↗

DOE OSTI2023

Physics informed deep neural network embedded in a chemical transport model for the Amazon rainforest

Secondary organic aerosols (SOA) are fine particles in the atmosphere, which interact with clouds, radiation and affect the Earth’s energy budget. SOA formation involves chemistry in gas phase, aqueous aerosols, and clouds. Simulating these chemical processes involve solving a stiff set of differential equations, which are computationally expensive steps for three-dimensional chemical transport models. Deep neural networks (DNNs) are universal function approximators that could be used to represent the complex nonlinear changes in aerosol physical and chemical processes; however, key challenges such as generalizability to extended time periods, preservation of mass balance, simulating sparse model outputs, and maintaining physical constraints have limited their use in atmospheric chemistry. Here, we develop an approach of using a physics-informed DNN that overcomes previous such challenges and demonstrates its applicability for the chemical formation processes of isoprene epoxydiol SOA (IEPOX-SOA) over the Amazon rainforest. The DNN is trained with data generated by simulating IEPOX-SOA over the entire atmospheric column, using the Weather Research and Forecasting Model coupled with Chemistry (WRF-Chem). The trained DNN is then embedded within WRF-Chem to replace the computationally expensive default solver of IEPOX-SOA formation. The trained DNN predictions generalizes well with the default model simulation of the IEPOX-SOA mass concentrations and its size distribution (20 size bins) over several days of simulations in both dry and wet seasons. The embedded DNN reduces the computational expense of WRF-Chem by a factor of 2. Our approach shows promise in terms of application to other computationally expensive chemistry solvers in climate models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Hybrid particle-spectral method for kinetic plasma simulations

A hybrid model for numerical solutions of the Vlasov–Poisson equations is presented, which blends spectral and particle approaches. The model splits the distribution function for plasma species into both spectral and particle representations in the velocity space to combine the advantages of each approach. The spectral representation leverages asymmetrically weighted Hermite basis, whereas the particle representation leverages the particle-in-cell method. Configuration phase space is decomposed with the Fourier method, which is well suited for periodic problems. We derive conservation equations for mass, momentum, and energy for the proposed combined method. It is shown that the coupling error between the two methods is absent in the semi-discrete setting (not taking into account time discretization). Finally, numerical test cases are presented simulating a weak electron beam interaction with plasma, leading to beam–plasma instability. The initially localized electron beam evolved into a highly non-equilibrium distribution function in the velocity space. A small growth rate and the resonance nature of instability make it difficult to obtain accurate solutions for purely particle methods due to noise, which falls as ∼1/Np with a number of particles. At the same time, purely spectral methods may require a large number of modes to capture the highly non-equilibrium state of the evolved beam. We show that the hybrid method is well suited for such problems: it reproduces the linear stage as well as nonlinear dynamics with sufficient accuracy using a highly non-equilibrium distribution function.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators (surrogate models) for complex physico-chemical processes exhibiting highly non-smooth dynamics is challenging. The main question is what type of surrogate models we should construct and should these models be under-parameterized or over-parameterized. In this work, we propose new developments and perform comparisons for two promising approaches: manifold-based polynomial chaos expansion (m-PCE) and the deep neural operator (DeepONet), and we examine the effect of over-parameterization on generalization. While m-PCE enables the construction of a mapping by first identifying low-dimensional embeddings of the input functions, parameters, and quantities of interest (QoIs), a neural operator learns the nonlinear mapping via the use of deep neural networks. Here, we demonstrate the performance of these methods in terms of generalization accuracy by solving the 2D time-dependent Brusselator reaction-diffusion system with uncertainty sources, modeling an autocatalytic chemical reaction between two species. We first propose an extension of the m-PCE by constructing a mapping between latent spaces formed by two separate embeddings of the input functions and the output QoIs. To further enhance the accuracy of the DeepONet, we introduce weight self-adaptivity in the loss function. We demonstrate that the performance of m-PCE and DeepONet is comparable for cases of relatively smooth input-output mappings. However, when highly non-smooth dynamics is considered, DeepONet shows higher approximation accuracy. We also find that for m-PCE, modest over-parameterization leads to better generalization, both within and outside of distribution, whereas aggressive over-parameterization leads to over-fitting. In contrast, an even highly over-parameterized DeepONet leads to better generalization for both smooth and non-smooth dynamics. Furthermore, we compare the performance of the above models with another recently proposed operator learning model, the Fourier Neural Operator, and show that its over-parameterization also leads to better generalization. Taken together, our studies show that m-PCE can provide very good accuracy at very low training cost, whereas a highly over-parameterized DeepONet can provide better accuracy and robustness to noise but at higher training cost. In both methods, the inference cost is negligible.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Sparsified time-dependent Fourier neural operators for fusion simulations

This paper presents a sparsified Fourier neural operator for coupled time-dependent partial differential equations (ST-FNO) as an efficient machine learning surrogate for fluid and particle-based fusion codes such as NIMROD (Non-Ideal Magnetohydrodynamics with Rotation - Open Discussion) and GTC (Gyrokinetic Toroidal Code). ST-FNO leverages the structures in the governing equations and utilizes neural operators to represent Green's function-like numerical operators in the corresponding numerical solvers. Once trained, ST-FNO can rapidly and accurately predict dynamics in fusion devices compared with first-principle numerical algorithms. In general, ST-FNO represents an efficient and accurate machine learning surrogate for numerical simulators for multi-variable nonlinear time-dependent partial differential equations, with the proposed architectures and loss functions. The efficacy of ST-FNO has been demonstrated using quiescent H-mode simulation data from NIMROD and kink-mode simulation data from GTC. The ST-FNO H-mode results show orders of magnitude reduction in memory and central processing unit usage in comparison with the numerical solvers in NIMROD when computing fields over a selected poloidal plane. The ST-FNO kink-mode results achieve a factor of 2 reduction in the number of parameters compared to baseline FNO models without accuracy loss.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

In situ high-harmonic microscopy of a nanostructured solid

Nanostructured optical surfaces allow exquisite control over linear and nonlinear light interactions, where the surface actively creates new frequencies up to high-order harmonics of an intense infrared driving laser field. The function and performance of these surfaces depend sensitively on the distribution of the high-harmonic fields in and between the nanostructured elements, as the high-harmonic wavelength becomes comparable to the nanoscale features of the surface. Imaging the nonlinear response at the active surface with nanometer resolution would greatly benefit the optimization of the metasurface's function. Here we demonstrate an approach to lensless imaging of extreme ultraviolet high harmonics that resolves the amplitude and phase of nonlinear polarization at the active nanostructured surface of an MgO crystal. Imaging the near-field distribution of high harmonics is the gateway to optimized functional high-harmonic metasurfaces and the integration of high harmonics on a chip.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Uncovering extreme nonlinear dynamics in solids through time-domain field analysis

Time-domain analysis of harmonic fields with sub-cycle resolution is now experimentally viable due to the emergence of sensitive, on-chip techniques for petahertz-scale optical-field sampling. We demonstrate how such a time-domain, field-resolved analysis uncovers the extreme nonlinear electron dynamics responsible for high-harmonic generation within solids. Time-dependent density functional theory was used to simulate harmonic generation from a solid-state band-gap system driven by near- to mid-infrared waveforms. Particular attention was paid to regimes where both intraband and interband emission mechanisms play a critical role in shaping the nonlinear response. We show that a time-domain analysis of the harmonic radiation fields identifies the interplay between intra- and interband dynamical processes underlying the nonlinear light generation. With further analysis, we show that changes to the dominant emission regime can occur after only slight changes to the peak driving intensity and central driving wavelength. Furthermore, time-domain analysis of harmonic fields also reveals, for the first time, the possibility of rapid changes in the dominant emission mechanism within the temporal window of the driving pulse envelope. Finally, we examine the experimental viability of performing time-domain analysis of harmonic fields with sub-cycle resolution using realistic parameters.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2026

Tensor renormalization group approach to critical phenomena via symmetry-twisted partition functions

The locality of field theories strongly constrains the possible behaviors of symmetry-twisted partition functions, and thus they serve as order parameters to detect low-energy realizations of global symmetries, such as spontaneous symmetry breaking (SSB). We demonstrate that the tensor renormalization group (TRG) offers an efficient framework to compute the symmetry-twisted partition functions, which enables us to detect the symmetry-breaking transition and also to study associated critical phenomena. As concrete examples of SSB, we investigate the two-dimensional (2D) classical Ising model and the three-dimensional (3D) classical 𝑂⁡(2) nonlinear sigma model, and we identify their critical points solely from the twisted partition function. By employing the finite-size scaling argument, we find the critical temperature 𝑇 𝑐 = 2.2017⁢(2) with the critical exponent 𝜈 = 0.663⁢(33) for the 3D 𝑂⁡(2) model. In addition, we also study the Berezinskii–Kosterlitz–Thouless (BKT) criticality of the 2D classical 𝑂⁡(2) model by extracting the helicity modulus from the twisted partition functions, and we obtain the BKT transition temperature, 𝑇 BKT = 0.8928⁢(2).

lattice field theory↗

DOE OSTI2024

Hybrid particle-spectral method for kinetic plasma simulations

A hybrid model for numerical solutions of the Vlasov–Poisson equations is presented, which blends spectral and particle approaches. The model splits the distribution function for plasma species into both spectral and particle representations in the velocity space to combine the advantages of each approach. The spectral representation leverages asymmetrically weighted Hermite basis, whereas the particle representation leverages the particle-in-cell method. Configuration phase space is decomposed with the Fourier method, which is well suited for periodic problems. We derive conservation equations for mass, momentum, and energy for the proposed combined method. It is shown that the coupling error between the two methods is absent in the semi-discrete setting (not taking into account time discretization). Finally, numerical test cases are presented simulating a weak electron beam interaction with plasma, leading to beam–plasma instability. The initially localized electron beam evolved into a highly non-equilibrium distribution function in the velocity space. A small growth rate and the resonance nature of instability make it difficult to obtain accurate solutions for purely particle methods due to noise, which falls as ~1/$\sqrt{N_p}$ with a number of particles. At the same time, purely spectral methods may require a large number of modes to capture the highly nonequilibrium state of the evolved beam. We show that the hybrid method is well suited for such problems: it reproduces the linear stage as well as nonlinear dynamics with sufficient accuracy using a highly non-equilibrium distribution function.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

The impact of optical measurement techniques on measured aerosol particle size distributions

Ambient aerosol particle size distributions measured by the Ultra-High Sensitivity Aerosol Spectrometer (UHSAS) at various sites around the world exhibit modes at optical diameters near 600 nm and 850 nm. These modes are not present in concurrent measurements with the Grimm 11-D Optical Particle Counter (OPC). Here, in this study, we argue that these modes result from the optical measurement technique itself, and we explain why they appear in measurements by the UHSAS but not in those by the Grimm OPC. We construct computer models of the UHSAS and Grimm (“digital UHSAS” and “digital Grimm”) and use these to investigate the size distribution that would result from measurements of artificial aerosol particle size distributions that do not contain modes. The appearance of modes for the structureless incoming size distributions sampled by the digital UHSAS is explained by the nonlinear behavior of partial scattering cross sections of uniform spherical particles as a function of their diameter. The absence of modes in the digital Grimm is explained by the coarser size resolution of that instrument. Detailed analysis of the relationship between optical and geometric diameters for uniform spherical particles reveals two important results. First, these diameters generally have different numerical values for the same particle, and second, the relationship is nonlinear; thus, widths of size bins in terms of optical diameter differ from those in geometric diameter. These results explain the modes observed in the ambient size distributions and highlight concerns with attempts to create a merged size distribution by combining measurements from different instruments.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Robust Iterative Method for Symmetric Quantum Signal Processing in All Parameter Regimes

Here, this paper addresses the problem of solving nonlinear systems in the context of symmetric quantum signal processing (QSP), a powerful technique for implementing matrix functions on quantum computers. Symmetric QSP focuses on representing target polynomials as products of matrices in SU(2) that possess symmetry properties. We present a novel Newton’s method tailored for efficiently solving the nonlinear system involved in determining the phase factors within the symmetric QSP framework. Our method demonstrates rapid and robust convergence in all parameter regimes, including the challenging scenario with ill-conditioned Jacobian matrices, using standard double precision arithmetic operations. For instance, solving symmetric QSP for a highly oscillatory target function α cos(1000x) (polynomial degree ≈ 1433) takes 6 iterations to converge to machine precision when α = 0.9, and the number of iterations only increases to 18 iterations when α = 1 – 10 -9 with a highly ill-conditioned Jacobian matrix. Leveraging the matrix product state structure of symmetric QSP, the computation of the Jacobian matrix incurs a computational cost comparable to a single function evaluation. Moreover, we introduce a reformulation of symmetric QSP using real-number arithmetics, further enhancing the method’s efficiency. Extensive numerical tests validate the effectiveness and robustness of our approach, which has been implemented in the QSPPACK software package.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Ultrastrong magnon-magnon coupling and chiral spin-texture control in a dipolar 3D multilayered artificial spin-vortex ice

Strongly-interacting nanomagnetic arrays are ideal systems for exploring reconfigurable magnonics. They provide huge microstate spaces and integrated solutions for storage and neuromorphic computing alongside GHz functionality. These systems may be broadly assessed by their range of reliably accessible states and the strength of magnon coupling phenomena and nonlinearities. Increasingly, nanomagnetic systems are expanding into three-dimensional architectures. This has enhanced the range of available magnetic microstates and functional behaviours, but engineering control over 3D states and dynamics remains challenging. Here, we introduce a 3D magnonic metamaterial composed from multilayered artificial spin ice nanoarrays. Comprising two magnetic layers separated by a non-magnetic spacer, each nanoisland may assume four macrospin or vortex states per magnetic layer. This creates a system with a rich 16 N microstate space and intense static and dynamic dipolar magnetic coupling. The system exhibits a broad range of emergent phenomena driven by the strong inter-layer dipolar interaction, including ultrastrong magnon-magnon coupling with normalised coupling rates of $\frac{Δf}{v}$ = 0.57, GHz mode shifts in zero applied field and chirality-control of magnetic vortex microstates with corresponding magnonic spectra.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

Polar coupling enabled nonlinear optical filtering at MoS 2 /ferroelectric heterointerfaces

Complex oxide heterointerfaces and van der Waals heterostructures present two versatile but intrinsically different platforms for exploring emergent quantum phenomena and designing new functionalities. The rich opportunity offered by the synergy between these two classes of materials, however, is yet to be charted. Here, we report an unconventional nonlinear optical filtering effect resulting from the interfacial polar alignment between monolayer MoS 2 and a neighboring ferroelectric oxide thin film. The second harmonic generation response at the heterointerface is either substantially enhanced or almost entirely quenched by an underlying ferroelectric domain wall depending on its chirality, and can be further tailored by the polar domains. Unlike the extensively studied coupling mechanisms driven by charge, spin, and lattice, the interfacial tailoring effect is solely mediated by the polar symmetry, as well explained via our density functional theory calculations, pointing to a new material strategy for the functional design of nanoscale reconfigurable optical applications.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Application of Koopman operator for model-based control of fracture propagation and proppant transport in hydraulic fracturing operation

This work explores the application of the recently developed Koopman operator approach for model identification and feedback control of a hydraulic fracturing process. Controlling fracture propagation and proppant transport with precision is a challenge due in large part to the difficulty of constructing approximate models that accurately capture the characteristic moving boundary and highly-coupled dynamics exhibited by the process. Koopman operator theory is particularly attractive here as it offers a way to explicitly construct linear representations for even highly nonlinear dynamics. The method is data-driven and relies on lifting the states to an infinite-dimensional space of functions called observables where the dynamics are governed by a linear Koopman operator. Here this work considers two problems: (a) fracture geometry control, and (b) proppant concentration control. In both cases, an approximate linear model of the corresponding dynamics is constructed and used to design a model predictive controller (MPC). The manuscript shows that in the case of highly nonlinear dynamics, as observed in the proppant concentration, use of canonical functions in the observable basis fails. In such cases, a priori system knowledge can be leveraged to choose the required basis. The numerical experiments demonstrate that the Koopman linear model shows excellent agreement with the real system and successfully achieves the desired target values maximizing the oil and gas productivity. Additionally, due to its linear structure, the Koopman models allow convex MPC formulations that avoid any issues associated with nonlinear optimization.

42 ENGINEERING↗