Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Interplay between gain and loss in arrays of nonlinear plasmonic nanoparticles: toward parametric downconversion and amplification

With the help of a theoretical model and finite-difference time-domain (FDTD) simulations based on the hydrodynamic–Maxwell model, we examine the effect of difference-frequency generation (DFG) in an array of L-shaped metal nanoparticles (MNPs) characterized by intrinsic plasmonic nonlinearity. The outcomes of the calculations reveal the spectral interplay between gain and loss in the vicinity of the fundamental frequency of the localized surface plasmon resonances. Subsequently, we identify different array thicknesses and pumping regimes facilitating parametric amplification and spontaneous parametric downconversion. Our results suggest that the parametric amplification regime becomes feasible on a scale of hundreds of nanometers and spontaneous parametric downconversion on the scale of tens of nanometers, opening up new exciting opportunities for developing building blocks of photonic metasurfaces.

Shah, Syed A.↗
DOE OSTI2022

Numerical modeling of pedestal stability and broadband turbulence of wide-pedestal QH-mode plasmas on DIII-D

The wide-pedestal quiescent high confinement mode discovered on DIII-D in recent years is a stationary and quiescent H-mode (QH-mode) with the pedestal width exceeding EPED prediction by at least 25%. Its characteristics, such as low rotation, high energy confinement and edge localized mode-free operation, make it an attractive operation mode for future reactors. Linear and nonlinear simulations using BOUT++ reduced two fluid MHD models and awere carried out to investigate the bursty broadband turbulence often observed in the edge of wide-pedestal QH-mode plasmas. Two kinds of MHD-scale instabilities in different spatial locations within the pedestal were found in the simulations: one mild peeling–ballooning (PB) mode γ PB < 0.04ω A ) located near the minimum in E r</:sub> well propagating in ion diamagnetic drift direction; and one drift-Alfvén wave locates at smaller radius compared to E r</:sub> well propagating in the electron diamagnetic drift direction and unstable only when the parallel electron dynamics is included in the simulation. The coupling between drift wave and shear Alfvén wave provides a possible cause of the experimentally observed local profile flattening in the upper-pedestal. The rotation direction, mode location, as well as the wavenumber of these two modes from BOUT++ simulations agree reasonably well with the experimental measurements, while the lack of quantitative agreement is likely due to the lack of trapped electron physics in current fluid model. This work presents improved physics understanding of the pedestal stability and turbulence dynamics for wide-pedestal QH-mode.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Variability of near-fault seismic risk to reinforced concrete buildings based on high-resolution physics-based ground motion simulations

Broadband physics-based simulated earthquake ground motions are utilized to characterize the regional-scale seismic risk to modern reinforced concrete (RC) structures. A highly dense dataset of ground motions covering a 100-km urn:x-wiley:00988847:media:eqe3413:eqe3413-math-0001 40-km domain was generated using kinematic fault rupture models with varying rupture characteristics to represent shallow crustal earthquakes and resolved up to frequencies of 5 Hz. Over 40,000 nonlinear response history simulations of short- and mid-rise RC special moment frame buildings were conducted using simulation models that are capable of representing nonlinear behavior and component deterioration effects. The spatial variability of structural risk within a single earthquake scenario and between different rupture scenarios is examined, and the regions of strongest directivity effects and highest structural demands are identified. The structural demands may vary by factor of up to 8.0 at very short distances from the fault, and the large dispersion in the demands decreases significantly beyond a distance of 15 km. The interstory drift and member rotation demands are substantially impacted by important features of the geological structure and the characteristics of the rupture scenarios, particularly the presence of localized high-slip regions. The frequency characteristics of the structures are found to play an important role in determining the effects of near-fault ground motions on the structural response and expected damage. The results of this study suggest that the simulated ground motions, particularly those generated using the hybrid rupture approach, may offer reasonable structural risk estimates for low-frequency structures and conservative estimates for high-frequency structures.

58 GEOSCIENCES↗
DOE OSTI2025

Preserving nonlinear constraints in variational flow filtering data assimilation

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems of interest obey nonlinear physical constraints, and the corresponding dynamics is confined to a certain sub-manifold of the state space. Standard data assimilation techniques applied to such systems yield posterior states lying outside the manifold, violating the physical constraints. This work focuses on particle flow filters which use stochastic differential equations to evolve state samples from a prior distribution to samples from an observation-informed posterior distribution. The variational Fokker-Planck (VFP)—a generic particle flow filtering framework—is extended to incorporate non-linear, equality state constraints in the analysis. To this end, two algorithmic approaches that modify the VFP stochastic differential equation are discussed: (i) VFPSTAB, to inexactly preserve constraints with the addition of a stabilizing drift term, and (ii) VFPDAE, to exactly preserve constraints by treating the VFP dynamics as a stochastic differential-algebraic equation (SDAE). Additionally, an implicit-explicit time integrator is developed to evolve the VFPDAE dynamics. The strength of the proposed approach for constraint preservation in data assimilation is demonstrated on three test problems: the double pendulum, Korteweg-de-Vries, and the incompressible Navier-Stokes equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Nonlinear mode coupling and energetics of driven magnetized shear-flow turbulence

To comprehensively understand the saturation of two-dimensional (2D) magnetized Kelvin–Helmholtz-instability-driven turbulence, energy transfer analysis is extended from the traditional interaction between scales to include eigenmode interactions, by using the nonlinear couplings of linear eigenmodes of the ideal instability. While both kinetic and magnetic energies cascade to small scales, a significant fraction of turbulent energy deposited by unstable modes in the fluctuation spectrum is shown to be re-routed to the conjugate-stable modes at the instability scale. They remove energy from the forward cascade at its inception. The remaining cascading energy flux is shown to attenuate exponentially at a small scale, dictated by the large-scale stable modes. Guided by a widely used instability-saturation assumption, a general quasi-linear model of instability is tested by retaining all nonlinear interactions except those that couple to the large-scale stable modes. These complex interactions are analytically removed from the magnetohydrodynamic equations using a novel technique. Observations are an explosive large-scale vortex separation instead of the well-known merger of 2D, a dramatic enhancement in turbulence level and spectral energy fluxes, and a reduced small-scale dissipation length scale. These show the critical role of the stable modes in instability saturation. Possible reduced-order turbulence models are proposed for fusion and astrophysical plasmas, based on eigenmode-expanded energy transfer analyses.

Physics↗
DOE OSTI2020

Predictive Skill of Deep Learning Models Trained on Limited Sequence Data

In this report we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, especially variants of recurrent neural networks (RNNs) have been studied for influenza forecasting, and have achieved higher forecasting skill compared to conventional models such as ARIMA models. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block temporal convolutional networks and simple neural attentive meta-learner for epidemiological forecasting and test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

An Efficient Time-Domain Model to Simulate Parametric Resonances in a Floating Body Free to Move in Six Degrees of Freedom: Preprint

We present a computationally efficient time-domain model capable of simulating parametric resonances in a floating body in waves. The model assumes all wave forces to be linear, but the inertia and restoring forces acting on the body are expanded to second order in body motions. The simulation speed on a standard computer is approximately 40 times faster than real time. The model is applied to a soft-moored floating axisymmetric body which absorbs energy through heave, but is otherwise free to move in six degrees of freedom. Under certain conditions, we show that the body responds parametrically with large amplitudes not only in surge and pitch, but also in sway, roll, and yaw, provided it is given some small initial displacement in one of these out-of-plane modes. The predictions are confirmed by simulations using state-of-the-art nonlinear Froude-Krylov and computational fluid dynamics models.

parametric resonance↗
DOE OSTI2021

The predictive skill of convolutional neural networks models for disease forecasting

In this paper we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, in particular variants of recurrent neural networks (RNNs) have been studied for ILI (Influenza-Like Illness) forecasting, and have achieved a higher forecasting skill compared to conventional models such as ARIMA. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block—temporal convolutional networks and simple neural attentive meta-learners—for epidemiological forecasting. We then test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, plain RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Reduced models for ETG transport in the tokamak pedestal

This paper reports on the development of reduced models for electron temperature gradient (ETG) driven transport in the pedestal. Model development is enabled by a set of 61 nonlinear gyrokinetic simulations with input parameters taken from pedestals in a broad range of experimental scenarios. The simulation data have been consolidated in a new database for gyrokinetic simulation data, the multiscale gyrokinetic database (MGKDB), facilitating the analysis. The modeling approach may be considered a generalization of the standard quasilinear mixing length procedure. The parameter η, the ratio of the density to temperature gradient scale length, emerges as the key parameter for formulating an effective saturation rule. With a single order-unity fitting coefficient, the model achieves an error of 15%. A similar model for ETG particle flux is also described. We also present simple algebraic expressions for the transport informed by an algorithm for symbolic regression.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Regional-Scale 3D Ground-Motion Simulations of M w 7 Earthquakes on the Hayward Fault, Northern California Resolving Frequencies 0–10 Hz and Including Site-Response Corrections

Large earthquake ground-motion simulations in 3D Earth models provide constraints on site-specific shaking intensities but have suffered from limited frequency resolution and ignored site response in soft soils. In this work we report new regional-scale 3D simulations for moment magnitude 7.0 scenario earthquakes on the Hayward Fault, northern California with SW4. Simulations resolved significantly broader band frequencies (0–10 Hz) than previous studies and represent the highest resolution simulations for any such earthquake to date. Seismic waves were excited by a kinematic rupture following Graves and Pitarka (2016) and obeyed wave propagation in a 3D Earth model with topography from the U.S. Geological Survey (USGS) assuming a minimum shear wavespeed, VSmin, of 500 m/s. We corrected motions for linear and nonlinear site response for the shear wavespeed, VS, from the USGS 3D model, using a recently developed ground-motion model (GMM) for Fourier amplitude spectra . At soft soil locations subjected to strong shaking, the site-corrected intensities reflect the competing effects of linear amplification by low V S material, reduction of stiffness during nonlinear deformation, and damping of high frequencies. Sites with near-surface V S of 500 m/s or greater require no linear site correction but can experience amplitude reduction due to nonlinear response. Averaged over all sites, we obtained reasonable agreement with empirical ergodic median GMMs currently used for seismic hazard and design ground motions (epsilon less than 1), with marked improvement at soft sedimentary sites. At specific locations, the simulated shaking intensities show systematic differences from the GMMs that reveal path and site effects not captured in these ergodic models. Results suggest how next generation regional-scale earthquake simulations can provide higher spatial and frequency resolution while including effects of soft soils that are commonly ignored in scenario earthquake ground-motion simulations.

58 GEOSCIENCES↗
DOE OSTI2023

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Monitoring covariance in multivariate time series: Comparing machine learning and statistical approaches

Abstract In complex systems with multiple variables monitored at high‐frequency, variables are not only temporally autocorrelated, but they may also be nonlinearly related or exhibit nonstationarity as the inputs or operation changes. One approach to handling such variables is to detrend them prior to monitoring and then apply control charts that assume independence and stationarity to the residuals. Monitoring controlled systems is even more challenging because the control strategy seeks to maintain variables at prespecified mean levels, and to compensate, correlations among variables may change, making monitoring the covariance essential. In this paper, a vector autoregressive model (VAR) is compared with a multivariate random forest (MRF) and a neural network (NN) for detrending multivariate time series prior to monitoring the covariance of the residuals using a multivariate exponentially weighted moving average (MEWMA) control chart. Machine learning models have an advantage when the data's structure is unknown or may change. We design a novel simulation study with nonlinear, nonstationary, and autocorrelated data to compare the different detrending models and subsequent covariance monitoring. The machine learning models have superior performance for nonlinear and strongly autocorrelated data and similar performance for linear data. An illustration with data from a reverse osmosis process is given.

Weix, Derek↗
DOE OSTI2021

INTEGRATE - Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements

The INTEGRATE (Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements) project is developing a new inverse-design capability for the aerodynamic design of wind turbine rotors using invertible neural networks. This AI-based design technology can capture complex non-linear aerodynamic effects while being 100 times faster than design approaches based on computational fluid dynamics. This project enables innovation in wind turbine design by accelerating time to market through higher-accuracy early design iterations to reduce the levelized cost of energy. INVERTIBLE NEURAL NETWORKS Researchers are leveraging a specialized invertible neural network (INN) architecture along with the novel dimension-reduction methods and airfoil/blade shape representations developed by collaborators at the National Institute of Standards and Technology (NIST) learns complex relationships between airfoil or blade shapes and their associated aerodynamic and structural properties. This INN architecture will accelerate designs by providing a cost-effective alternative to current industrial aerodynamic design processes, including: - Blade element momentum (BEM) theory models: limited effectiveness for design of offshore rotors with large, flexible blades where nonlinear aerodynamic effects dominate - Direct design using computational fluid dynamics (CFD): cost-prohibitive - Inverse-design models based on deep neural networks (DNNs): attractive alternative to CFD for 2D design problems, but quickly overwhelmed by the increased number of design variables in 3D problems AUTOMATED COMPUTATIONAL FLUID DYNAMICS FOR TRAINING DATA GENERATION - MERCURY FRAMEWORK The INN is trained on data obtained using the University of Marylands (UMD) Mercury Framework, which has with robust automated mesh generation capabilities and advanced turbulence and transition models validated for wind energy applications. Mercury is a multi-mesh paradigm, heterogeneous CPU-GPU framework. The framework incorporates three flow solvers at UMD, 1) OverTURNS, a structured solver on CPUs, 2) HAMSTR, a line based unstructured solver on CPUs, and 3) GARFIELD, a structured solver on GPUs. The framework is based on Python, that is often used to wrap C or Fortran codes for interoperability with other solvers. Communication between multiple solvers is accomplished with a Topology Independent Overset Grid Assembler (TIOGA). NOVEL AIRFOIL SHAPE REPRESENTATIONS USING GRASSMAN SPACES We developed a novel representation of shapes which decouples affine-style deformations from a rich set of data-driven deformations over a submanifold of the Grassmannian. The Grassmannian representation as an analytic generative model, informed by a database of physically relevant airfoils, offers (i) a rich set of novel 2D airfoil deformations not previously captured in the data , (ii) improved low-dimensional parameter domain for inferential statistics informing design/manufacturing, and (iii) consistent 3D blade representation and perturbation over a sequence of nominal shapes. TECHNOLOGY TRANSFER DEMONSTRATION - COUPLING WITH NREL WISDEM Researchers have integrated the inverse-design tool for 2D airfoils (INN-Airfoil) into WISDEM (Wind Plant Integrated Systems Design and Engineering Model), a multidisciplinary design and optimization framework for assessing the cost of energy, as part of tech-transfer demonstration. The integration of INN-Airfoil into WISDEM allows for the design of airfoils along with the blades that meet the dynamic design constraints on cost of energy, annual energy production, and the capital costs. Through preliminary studies, researchers have shown that the coupled INN-Airfoil + WISDEM approach reduces the cost of energy by around 1% compared to the conventional design approach. This page will serve as a place to easily access all the publications from this work and the repositories for the software developed and released through this pr...

aerodynamics↗
DOE OSTI2022

Fast-neutron-induced fission of Pu 240 and Pu 242

Herein we report the measurement of the total kinetic energy (TKE) release in the fast neutron induced fission of 240 Pu and 242 Pu. The results are compared to the predictions of the GEF model, the CGMF model, and the model of Denisov and Sedykh as well as previous exptl. work on these reactions. Our absolute measurements of the TKE release are in good agreement with the previous measurements of Nethaway et al. for the interaction of 14.8 MeV neutrons with 240 Pu [Phys. Rev. C16, 1907 (1977)] and of Winkelmann and Aumann for the interaction of 15 MeV neutrons with 242 Pu [Phys. Rev. C30, 934 (1984)]. The general trends of the measured TKE values agree with phenomenol. models but the variances of the TKE distributions are significantly less than predicted by various models. The mean postneutron emission TKE release decreases nonlinearly with increasing neutron energy and can be represented as TKE(MeV) = 175.8 ± 0.3 - (2.4 ± 0.8) lo g 10 E n - (1.4 ± 0.4) lo g 10 $E^{2}_{n}$ for 240 Pu and TKE(MeV) = 177.1 ± 0.3 - (1.2 ± 0.9) lo g 10 E n - (1.8 ± 0.5)lo g 10 $E_{n}^{2}$ for 242 Pu.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Practical CO2—WAG Field Operational Designs Using Hybrid Numerical-Machine-Learning Approaches

Machine-learning technologies have exhibited robust competences in solving many petroleum engineering problems. The accurate predictivity and fast computational speed enable a large volume of time-consuming engineering processes such as history-matching and field development optimization. The Southwest Regional Partnership on Carbon Sequestration (SWP) project desires rigorous history-matching and multi-objective optimization processes, which fits the superiorities of the machine-learning approaches. Although the machine-learning proxy models are trained and validated before imposing to solve practical problems, the error margin would essentially introduce uncertainties to the results. In this paper, a hybrid numerical machine-learning workflow solving various optimization problems is presented. By coupling the expert machine-learning proxies with a global optimizer, the workflow successfully solves the history-matching and CO2 water alternative gas (WAG) design problem with low computational overheads. The history-matching work considers the heterogeneities of multiphase relative characteristics, and the CO2-WAG injection design takes multiple techno-economic objective functions into accounts. This work trained an expert response surface, a support vector machine, and a multi-layer neural network as proxy models to effectively learn the high-dimensional nonlinear data structure. The proposed workflow suggests revisiting the high-fidelity numerical simulator for validation purposes. The experience gained from this work would provide valuable guiding insights to similar CO2 enhanced oil recovery (EOR) projects.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference

This work introduces a method for learning low-dimensional models from data of high-dimensional black-box dynamical systems. The novelty is that the learned models are exactly the reduced models that are traditionally constructed with classical projection-based model reduction techniques. Thus, the proposed approach learns models that are guaranteed to have the well-studied properties of reduced models known from model reduction, without requiring full knowledge of the governing equations and without requiring the operators of the high-dimensional systems. The key ingredient is a new data sampling scheme to obtain re-projected trajectories of high-dimensional systems that correspond to Markovian dynamics in low-dimensional subspaces. The exact recovery of reduced models from these re-projected trajectories is guaranteed pre-asymptotically under certain conditions for finite amounts of data and for a large class of systems with polynomial nonlinear terms. Numerical results demonstrate that the low-dimensional models learned with the proposed approach match reduced models from traditional model reduction up to numerical errors in practice. In conclusion, the numerical results further indicate that low-dimensional models fitted to re-projected trajectories are predictive even in situations where models fitted to trajectories without re-projection are inaccurate and unstable.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Accelerating phase-field-based microstructure evolution predictions via surrogate models trained by machine learning methods

Abstract The phase-field method is a powerful and versatile computational approach for modeling the evolution of microstructures and associated properties for a wide variety of physical, chemical, and biological systems. However, existing high-fidelity phase-field models are inherently computationally expensive, requiring high-performance computing resources and sophisticated numerical integration schemes to achieve a useful degree of accuracy. In this paper, we present a computationally inexpensive, accurate, data-driven surrogate model that directly learns the microstructural evolution of targeted systems by combining phase-field and history-dependent machine-learning techniques. We integrate a statistically representative, low-dimensional description of the microstructure, obtained directly from phase-field simulations, with either a time-series multivariate adaptive regression splines autoregressive algorithm or a long short-term memory neural network. The neural-network-trained surrogate model shows the best performance and accurately predicts the nonlinear microstructure evolution of a two-phase mixture during spinodal decomposition in seconds, without the need for “on-the-fly” solutions of the phase-field equations of motion. We also show that the predictions from our machine-learned surrogate model can be fed directly as an input into a classical high-fidelity phase-field model in order to accelerate the high-fidelity phase-field simulations by leaping in time. Such machine-learned phase-field framework opens a promising path forward to use accelerated phase-field simulations for discovering, understanding, and predicting processing–microstructure–performance relationships.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Attention for Causal Relationship Discovery from Biological Neural Dynamics

This paper explores the potential of the transformer models for learning Granger causality in networks with complex nonlinear dynamics at every node, as in neurobiological and biophysical networks. Our study primarily focuses on a proof-of-concept investigation based on simulated neural dynamics, for which the ground-truth causality is known through the underlying connectivity matrix. For transformer models trained to forecast neuronal population dynamics, we show that the cross-attention module effectively captures the causal relationship among neurons, with an accuracy equal to or superior to that of the most popular Granger causality discovery method. While we acknowledge that real-world neurobiology data will bring further challenges, including dynamic connectivity and unobserved variability, this research offers an encouraging preliminary glimpse into the utility of the transformer model for causal representation learning in neuroscience.

Lu, Ziyu↗