Nonlinear Regression for Accurate and Efficient Surrogate Models of Materials.
Abstract not provided.
Logarzo, Hernan↗
SEARCH · Engineering Papers
Results for “Nonlinear models”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Second Harmonic Generation from a Single Plasmonic Nanorod Strongly Coupled to a WSe 2 Monolayer
Monolayer transition metal dichalcogenides, coupled to metal plasmonic nanocavities, have recently emerged as new platforms for strong light–matter interactions. These systems are expected to have nonlinear-optical properties that will enable them to be used as entangled photon sources, compact wave-mixing devices, and other elements for classical and quantum photonic technologies. Here, we report the first experimental investigation of the nonlinear properties of these strongly coupled systems, by observing second harmonic generation from a WSe 2 monolayer strongly coupled to a single gold nanorod. In this work, the pump-frequency dependence of the second-harmonic signal displays a pronounced splitting that can be explained by a coupled-oscillator model with second-order nonlinearities. Rigorous numerical simulations utilizing a nonperturbative nonlinear hydrodynamic model of conduction electrons support this interpretation and reproduce experimental results. Our study thus lays the groundwork for understanding the nonlinear properties of strongly coupled nanoscale systems.
77 NANOSCIENCE AND NANOTECHNOLOGY↗
Anticipating gelation and vitrification with medium amplitude parallel superposition (MAPS) rheology and artificial neural networks
Abstract Anticipating qualitative changes in the rheological response of complex fluids (e.g., a gelation or vitrification transition) is an important capability for processing operations that utilize such materials in real-world environments. One class of complex fluids that exhibits distinct rheological states are soft glassy materials such as colloidal gels and clay dispersions, which can be well characterized by the soft glassy rheology (SGR) model. We first solve the model equations for the time-dependent, weakly nonlinear response of the SGR model. With this analytical solution, we show that the weak nonlinearities measured via medium amplitude parallel superposition (MAPS) rheology can be used to anticipate the rheological aging transitions in the linear response of soft glassy materials. This is a rheological version of a technique called structural health monitoring used widely in civil and aerospace engineering. We design and train artificial neural networks (ANNs) that are capable of quickly inferring the parameters of the SGR model from the results of sequential MAPS experiments. The combination of these data-rich experiments and machine learning tools to provide a surrogate for computationally expensive viscoelastic constitutive equations allows for rapid experimental characterization of the rheological state of soft glassy materials. We apply this technique to an aging dispersion of Laponite ® clay particles approaching the gel point and demonstrate that a trained ANN can provide real-time detection of transitions in the nonlinear response well in advance of incipient changes in the linear viscoelastic response of the system.
Lennon, Kyle R. (ORCID:0000000212515461)↗
Resonant nonlinear refraction of 4 – 5 - μ m light in CO and C O 2 gas
The resonant nonlinear refraction of 4–5-μm light in CO and CO 2 gas at a peak intensity of 15MW/cm 2 was demonstrated using time- and frequency-resolved measurements of self-focusing and self-defocusing. The nonlinearity of these molecular gases exhibits intensity-dependent sign reversals and a <4-ns response time. A change from self-focusing to self-defocusing or vice versa was observed to occur for Rabi frequencies that are comparable to the collisional linewidth. A density matrix model for the nonlinear susceptibility of a strongly driven two-level system provides a qualitative explanation for these results.
74 ATOMIC AND MOLECULAR PHYSICS↗
Continuous-time probabilistic models for longitudinal electronic health records
Analysis of longitudinal Electronic Health Record (EHR) data is an important goal for precision medicine. Difficulty in applying Machine Learning (ML) methods, either predictive or unsupervised, stems in part from the heterogeneity and irregular sampling of EHR data. Here, we present an unsupervised probabilistic model that captures nonlinear relationships between variables over continuous-time. This method works with arbitrary sampling patterns and captures the joint probability distribution between variable measurements and the time intervals between them. Inference algorithms are derived that can be used to evaluate the likelihood of future using under a trained model. As an example, we consider data from the United States Veterans Health Administration (VHA) in the areas of diabetes and depression. Likelihood ratio maps are produced showing the likelihood of risk for moderate-severe vs minimal depression as measured by the Patient Health Questionnaire-9 (PHQ-9).
59 BASIC BIOLOGICAL SCIENCES↗
Physics of turbulence spreading and explicit nonlocality
In this paper, we systematically derive a model for turbulence spreading from the basic kinetic equation. The model contains explicit nonlocal nonlinear diffusion and nonlocal growth. When the nonlocality scale parameter δ b (banana width) vanishes, this model reduces to the usual turbulence spreading model. We elucidate the mechanisms of nonlinear saturation and nonlocal growth. Results show that nonlocal effects, especially the nonlocal growth, thicken the turbulence spreading front and increase the speed of front propagation. More turbulence intensity penetrates the stable region when δ b increases. The penetration depth Δ p is proportional to $ \delta_b/L_T $, therefore the fraction of turbulence in the unstable region scales as 1 – δ b* . Lastly, the transport scales the same way.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders
Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.
97 MATHEMATICS AND COMPUTING↗
DRIPS: A framework for dimension reduction and interpolation in parameter space
Reduced-order models are often used to describe the behavior of complex systems, whose simulation with a full model is too expensive, or to extract salient features from the full model’s output. We introduce a new model-reduction framework DRIPS (dimension reduction and interpolation in parameter space) that combines the offline local model reduction with the online parameter interpolation of reduced-order bases (ROBs). The offline step of this framework relies on dynamic mode decomposition (DMD) to build a low-rank linear surrogate model, equipped with a local ROB, for quantities of interest derived from the training data generated by repeatedly solving the (nonlinear) high-fidelity model for multiple parameter points. The online step consists of the construction of a parametric reduced-order model for each target/test point in the parameter space, with the interpolation of ROBs done on a Grassman manifold and the interpolation of reduced-order operators done on a matrix manifold. The DMD component enables DRIPS to model (typically low-dimensional) quantities of interest directly, without having to access the (typically high-dimensional and possibly nonlinear) operators in a high-fidelity model that governs the dynamics of the underlying high-dimensional state variables, as required in projection-based reduced-order modeling. A series of numerical experiments suggests that DRIPS yields a model reduction, which is computationally more efficient than the commonly used projection-based proper orthogonal decomposition; it does so without requiring a prior knowledge of the governing equation for quantities of interest. Furthermore, for the nonlinear systems considered, DRIPS is more accurate than Gaussian-process interpolation (Kriging).
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
A Siamese CNN + KNN-Based Classification Framework for Non-intrusive Load Monitoring
Through the development of smart grids, programs such as demand side response, have been presented as auxiliary services to the real-time operation of distributed networks. In order to provide consumers information on their energy consumption, so that a modulation in consumption is possible, non-intrusive load monitoring has been introduced as an solution to this pattern recognition problem. Non-intrusive load monitoring enables the modeling of electrical loads connected to the low-voltage system, considering only a single measurement point. Presented state-of-the-art solutions though, consider availability of data as well as representation of all possible classes of the environment. This is of course a most conservative hypothesis, since in real-life applications availability of such data is much difficult, as well as the dynamic behavior of models is implicitly evolving in time. Here, a framework that uses neural Siamese networks with k-nearest neighbor clustering is presented toward non-intrusive load monitoring. Online learning feature is implemented, which relaxes the hypothesis of data requirements as well addresses the evolving nature of load profile. k-nearest clustering allows nonlinear characteristic space modelling. Test results using synthetics and real-life data show that the solution, besides obtaining a good generalizability in the classification, also obtained results with an accuracy of 95.77%.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Inverse Design of Photonic Surfaces via High throughput Femtosecond Laser Processing and Tandem Neural Networks
Abstract This work demonstrates a method to design photonic surfaces by combining femtosecond laser processing with the inverse design capabilities of tandem neural networks that directly link laser fabrication parameters to their resulting textured substrate optical properties. High throughput fabrication and characterization platforms are developed that generate a dataset comprising 35280 unique microtextured surfaces on stainless steel with corresponding measured spectral emissivities. The trained model utilizes the nonlinear one‐to‐many mapping between spectral emissivity and laser parameters. Consequently, it generates predominantly novel designs, which reproduce the full range of spectral emissivities (average root‐mean‐squared‐error < 2.5%) using only a compact region of laser parameter space 25 times smaller than what is represented in the training data. Finally, the inverse design model is experimentally validated on a thermophotovoltaic emitter design application. By synergizing laser‐matter interactions with neural network capabilities, the approach offers insights into accelerating the discovery of photonic surfaces, advancing energy harvesting technologies.
36 MATERIALS SCIENCE↗
Theory of edge localized mode suppression by static resonant magnetic perturbations in the DIII-D tokamak
According to a recent paper [Hu et al ., Phys. Plasmas 26, 120702 (2019)], mode penetration at the top of the pedestal is a necessary and sufficient condition for the suppression of edge localized modes (ELMs) by a resonant magnetic perturbation (RMPs) in an H-mode tokamak discharge. This paper employs asymptotic matching theory to model a particular DIII-D discharge in which ELMs were suppressed by an externally generated, static, n ¼ 2, RMP whose amplitude was modulated at a frequency of 1 Hz. It is demonstrated that the response of the plasma to the applied RMP, in the immediate vicinities of the rational (i.e., resonant) surfaces, is governed by nonlinear, rather than by linear, physics. This is the case because the magnetic island widths associated with driven reconnection exceed the linear layer widths, even in cases where driven reconnection is strongly suppressed by plasma rotation. The natural frequency at a given rational surface (i.e., the helical frequency at which the locally resonant component of the RMP would need to propagate in order to maximize driven reconnection) is found to be offset from the local E B frame in the ion diamagnetic direction. The size of the offset is mostly determined by neoclassical poloidal rotation. Finally, the predictions of a fully nonlinear plasma response model are found to be broadly consistent with the DIII-D experimental data.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Hydrogen from low-density polyethylene via nonthermal plasma: Effects of energy density and process parameters
Nonthermal plasma processes are promising for the modular valorization of plastic waste, especially into hydrogen and carbon materials, due to their high intensity, lack of reliance on catalysts or consumables, and suitability to be directly powered by electricity. We investigate the production of hydrogen from low-density polyethylene (LDPE) as a plastic waste model using streamer Dielectric Barrier Discharge (sDBD) plasma in nitrogen at atmospheric pressure. Here, we examine the effects of process energy density (energy input per unit of feedstock mass), feedstock mass, and plasma intensity (electric voltage) on plasma properties, hydrogen yield and energy efficiency via gas chromatography, optical emission spectroscopy, and electrical diagnostics, together with reactor-scale and nonlinear electric circuit modeling. The characteristic temperature of free electrons in the sDBD plasma is approximately 15000 K (1.3 eV), and that of gas species 10 times lower, demonstrating strong thermal non-equilibrium that can lead to molecular bond scission via charged species impact rather than direct heating. Experimental results show that higher energy density leads to greater hydrogen production and diminishing energy efficiency, and that higher plasma intensity and larger feedstock mass lead to greater hydrogen yield due to higher plasma temperatures and enhanced energy fluxes to the feedstock.
08 HYDROGEN↗
Observability Analysis of a Power System Stochastic Dynamic Model Using a Derivative-Free Approach
Serving as a prerequisite to power system dynamic state estimation, the observability analysis of a power system dynamic model has recently attracted the attention of many power engineers. However, because this model is typically nonlinear and large-scale, the analysis of its observability is a challenge to the traditional derivative-based methods. Indeed, the linear-approximation-based approach may provide unreliable results while the nonlinear-technique-based approach inevitably faces extremely complicated derivations. Furthermore, because power systems are intrinsically stochastic, the traditional deterministic approaches may lead to inaccurate observability analyses. In this work, facing these challenges, we propose a novel polynomial-chaos-based derivative-free observability analysis approach that not only is free of any linear approximations, but also accounts for the stochasticity of the dynamic model while bringing a low implementation complexity. Furthermore, this approach enables us to quantify the degree of observability of a stochastic model, what conventional deterministic methods cannot do. The excellent performance of the proposed method has been demonstrated by performing extensive simulations using a synchronous generator model with IEEE-DC1A exciter and the TGOV1 turbine governor.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Alignment tolerance analysis for divided-pulse nonlinear compression
We present an analytic model that describes the output pulse after Kerr-based spectral broadening with divided-pulse nonlinear compression that includes errors in unequal pulse division, birefringent plate retardance, and thermal drift. The model shows that alignment tolerances become impractically tight at high levels of nonlinearity and that the angle of incidence on the birefringent plates can be utilized as a compensator to loosen those tolerances. We present experimental verification of the model, which is expected to be a fast and flexible tool to design future divided-pulse nonlinear compression systems.
47 OTHER INSTRUMENTATION↗
Halo formation from Yukawa forces in the very early Universe
If long-range attractive forces exist and are stronger than gravity then cosmic halo formation can begin in the radiation-dominated era. We study a simple realization of this effect in a system where dark matter fermions have Yukawa interactions mediated by scalar particles, analogous to the Higgs boson in the standard model. We develop a self-consistent description of the system including exact background dynamics of the scalar field, and precise modeling of the fermion density fluctuations. For the latter, we provide accurate approximations for the linear growth as well as quantitative modeling of the nonlinear evolution using N-body simulations. We find that halo formation occurs exponentially fast and on scales substantially larger than simple estimates predict. Here, the final fate of these halos remains uncertain, but could be annihilation, dark stars, primordial black holes, or even the existence of galaxy-sized halos at matter-radiation equality. More generally, our results demonstrate the importance of mapping scalar-mediated interactions onto structure formation outcomes and constraints for beyond the standard model theories.
79 ASTRONOMY AND ASTROPHYSICS↗
BayFlux: A Bayesian method to quantify metabolic Fluxes and their uncertainty at the genome scale
Metabolic fluxes, the number of metabolites traversing each biochemical reaction in a cell per unit time, are crucial for assessing and understanding cell function. 13 C Metabolic Flux Analysis ( 13 C MFA) is considered to be the gold standard for measuring metabolic fluxes. 13 C MFA typically works by leveraging extracellular exchange fluxes as well as data from 13 C labeling experiments to calculate the flux profile which best fit the data for a small, central carbon, metabolic model. However, the nonlinear nature of the 13 C MFA fitting procedure means that several flux profiles fit the experimental data within the experimental error, and traditional optimization methods offer only a partial or skewed picture, especially in “non-gaussian” situations where multiple very distinct flux regions fit the data equally well. Here, we present a method for flux space sampling through Bayesian inference (BayFlux), that identifies the full distribution of fluxes compatible with experimental data for a comprehensive genome-scale model. This Bayesian approach allows us to accurately quantify uncertainty in calculated fluxes. We also find that, surprisingly, the genome-scale model of metabolism produces narrower flux distributions (reduced uncertainty) than the small core metabolic models traditionally used in 13 C MFA. The different results for some reactions when using genome-scale models vs core metabolic models advise caution in assuming strong inferences from 13 C MFA since the results may depend significantly on the completeness of the model used. Based on BayFlux, we developed and evaluated novel methods (P- 13 C MOMA and P- 13 C ROOM) to predict the biological results of a gene knockout, that improve on the traditional MOMA and ROOM methods by quantifying prediction uncertainty.
59 BASIC BIOLOGICAL SCIENCES↗
Reinforcement learning for online adaptation of model predictive controllers: Application to a selective catalytic reduction unit
Here we present a novel application of reinforcement learning (RL) for online dynamic tuning of model predictive controllers (MPC). Applying a state-action-reward-state-action (SARSA) algorithm for temporal difference learning with a control-specific reward function improves the error tracking performance of a standard MPC formulation. The proposed RL approach is also readily adaptable to other MPCs, or entirely different control approaches. Practical details for the implementation of the RL-MPC algorithm are also presented. The proposed algorithm is applied to a case study of controlling nitrogen oxide (NO x ) emissions in an industrial selective catalytic reduction (SCR) unit, a control problem characterized by significant nonlinearity and time delay. Along with an RL-MPC formulation for NOx control, another MPC is proposed to mitigate ammonia slip and decrease ammonia consumption in the SCR. Results showing the efficacy of the RL-MPC for NO x control through learning and implementation on the nonlinear SCR dynamic model are presented.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Applying deep learning methods to develop new models of molecular charge transfer, nonadiabatic dynamics, and nonlinear spectroscopy in the condensed phase
Photon- and field-induced charge transfer has central importance in the generation and storage of electricity, the novel properties of materials, photo-induced catalysis, and electro-optic activity (e.g., photovoltaic cells, fuel cells, and organic chromophores for use in optical fibers and light-emission diodes). These non-equilibrium electronic and chemical transformations are probed by ultrafast, nonlinear spectroscopies. Accurate simulations play a crucial role in our ability to understand, optimize, and control these transformations. This project applies modern deep learning and machine learning (ML) methods to dramatically improve models of electronic dynamics, electronic-nuclear dynamics, and spectroscopic measurements for improved simulations of chemistry in complex environments, far from equilibrium phenomena, and processes in extreme environments, such as materials exposed to strong or resonant fields. This project develops accurate neural net models that go beyond predictive capability to also provide new insight into the fundamental physics underlying electron and nuclear dynamics. To achieve its objectives, this project explores and develops customized versions of high-capacity deep learning algorithms/models. These techniques are developed with an emphasis on fundamental chemical insight, not just predictive accuracy, to assist the development of the next generation of quantum simulation methods.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗