SEARCH · Engineering Papers
Results for “nonlinear function”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Analytical model of low and high ablation regimes in carbon arcs
Graphite ablation by an electric arc or a laser/solar flux is widely used for the synthesis of carbon nanomaterials. Previously, it was observed in multiple arc experiments that the ablation rate is a strong nonlinear function of the arc current and it drastically increases at some threshold current. As such, we developed an analytical model explaining this transition in the rate of ablation by an electric arc or a laser/solar flux. The model not only explains the observations but can also accurately predict the experimentally observed ablation rates. The model takes into account redeposition of carbon back to the ablated surface, which is the key process responsible for the observed effects.
Data-based filtered dissipation rate modelling for multi-modal turbulent combustion: evaluating a priori model generalizability
Manifold-based models offer a computationally efficient alternative to directly transporting the thermochemical state in computational simulations of turbulent reacting flows, projecting the high-dimensional thermochemical state-space onto a low-dimensional manifold. Recent efforts have yielded a manifold-based model applicable to multi-modal combustion, enabling reconstruction of the thermochemical state from solutions to two-dimensional manifold equations in mixture fraction and generalized progress variable that are parameterised by three scalar dissipation rates. In coarse-grained simulations such as Large Eddy Simulation (LES), closure of the multi-modal manifold equations and subfilter variances/covariance requires closure of three filtered scalar dissipation rates. Here, the present work adopts a data-based approach, providing closure for the three filtered scalar dissipation rates via deep neural networks (DNNs). High-fidelity datasets corresponding to an autoigniting n-dodecane jet flame and a bluff body swirl-stabilized confined lifted spray flame of two aviation fuels (Jet-A and C1) with different ignition propensities are leveraged to generate training data that spans a diverse range of thermodynamic conditions and combustion modes, including low- and high-temperature ignition regimes in addition to premixed and nonpremixed behaviour. A final DNN model is trained to enforce inherent physical constraints by learning nonlinear functional transformations of the three filtered scalar dissipation rates. The generalizability of this constrained DNN model is demonstrated a priori via conditional statistics evaluated on the lifted spray flame with C1–a configuration that had not been included in the training data. Excellent DNN agreement with conditional DNS statistics is observed, and integrated gradients are computed to identify the most sensitive input variables. The similarity of the marginal PDFs of the most informative input variables and outputs across configurations are quantified via the Wasserstein metric, demonstrating that data-based models may successfully generalize to unseen parametric conditions so long as the most informative input variables share similar distributions across training and testing datasets.
Adaptive machine learning for time-varying systems: low dimensional latent space tuning
Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map combinations of accelerator parameters and images which are 2D projections of the 6D phase space distributions of charged particle beams as they are transported between various particle accelerator locations. Despite their strengths, applying ML to time-varying systems, or systems with shifting distributions, is an open problem, especially for large systems for which collecting new data for re-training is impractical or interrupts operations. Particle accelerators are one example of large time-varying systems for which collecting detailed training data requires lengthy dedicated beam measurements which may no longer be available during regular operations. We present a novel method of adaptive ML for time-varying systems. Our approach is to map very high (N ≈ 100k) dimensional inputs (a combination of scalar parameters and images) into the low dimensional (N ≈ 2) latent space at the output of the encoder section of an encoder-decoder CNN. We then actively tune the low dimensional latent space-based representation of complex system dynamics by the addition of an adaptively tuned feedback vector directly before the decoder sections builds back up to our image-based high-dimensional phase space density representations. This method allows us to learn correlations within and to quickly tune the characteristics of incredibly large parameter space systems and to track their evolution in real time based on feedback without massive new data sets for re-training. We demonstrate that our method can accurately predict and track the phase space of charged particle beams at various locations in a particle accelerator by adaptively adjusting in real-time while the unknown input beam distribution of the accelerator is changing in shape, charge, and offset and while the RF system of the accelerator itself is also changing in an unpredictable way. For FACET-II we demonstrate that such an approach has the potential to use transverse deflecting cavity and energy spread spectrum beam measurements to accurately predict 2D projections of the 6D phase space of the electron beam at the plasma wakefield acceleration interaction point where such diagnostics are unavailable.
Random permutations fix a worst case for cyclic coordinate descent
Abstract Variants of the coordinate descent approach for minimizing a nonlinear function are distinguished in part by the order in which coordinates are considered for relaxation. Three common orderings are cyclic (CCD), in which we cycle through the components of $x$ in order; randomized (RCD), in which the component to update is selected randomly and independently at each iteration; and random-permutations cyclic (RPCD), which differs from CCD only in that a random permutation is applied to the variables at the start of each cycle. Known convergence guarantees are weaker for CCD and RPCD than for RCD, though in most practical cases, computational performance is similar among all these variants. There is a certain type of quadratic function for which CCD is significantly slower than for RCD; a recent paper by Sun & Ye (2016, Worst-case complexity of cyclic coordinate descent: $O(n^2)$ gap with randomized version. Technical Report. Stanford, CA: Department of Management Science and Engineering, Stanford University. arXiv:1604.07130) has explored the poor behavior of CCD on functions of this type. The RPCD approach performs well on these functions, even better than RCD in a certain regime. This paper explains the good behavior of RPCD with a tight analysis.
Photon Frequency Conversion in High-Q Superconducting Resonators: Axion Electrodynamics, QED, and Nonlinear Meissner Radiation
High-Q superconducting resonators have been proposed and developed as detectors of light-by-light scattering mediated by the hypothesized axion or virtual electron–positron pairs in quantum electrodynamics: the Euler–Heisenberg (EH) interaction. Photon frequency and mode conversion is central to the scheme for detecting such rare events. Superconducting resonators are nonlinear devices. The Meissner screening currents that confine the electromagnetic fields to the vacuum region of a superconducting RF cavity are nonlinear functions of the EM field at the vacuum–superconducting interface, and as a result can generate source currents and frequency conversion of microwave photons in the cavity. In this report we consider photon frequency and mode conversion in superconducting resonators with high quality factors from Meissner currents in single- and dual-cavity setups proposed for axion and QED searches based on light-by-light scattering. In a single cavity with two pump modes, photon frequency conversion by the Meissner screening current dominates photon generation by the EH interaction for cavities with Q≲1012. The Meissner currents also generate background photons that limit the operation of the resonator for axion detection in three-mode, single-cavity setups. We also consider the leakage of photons from pump modes into the signal mode for both axion- and EH-mediated light-by-light scattering. Photon frequency conversion by the EH interaction can compete with Meissner and leakage radiation in ultra-high-Q cavities that are beyond the current state of the art. Meissner radiation and leakage backgrounds can be suppressed in dual-cavity setups with appropriate choices for pump and spectator modes, as well as the single-cavity setup proposed for heterodyne detection of galactic axion dark matter.
Integrability technique for fluid flow induced deformation of a boundary hair
The deformation of a dense carpet of hair due to Stokes flow in a channel can be described by a nonlinear integrodifferential equation for the shape of a single hair, which possesses several solutions for a given choice of parameters. Although it was posed in a previous study and it bears a resemblance to the pendulum problem from mechanics, this equation has not been analytically solved until now. Despite the presence on an integral with a nonlinear functional dependence on the dependent variable, the system is integrable. We compare the analytically obtained solution to a finite-difference numerical approach, identify the physically realizable solution branch, and briefly study the solution structure through a conserved energylike quantity. Time-dependent fluid-structure interactions are a rich and complex subject to investigate, and we argue that the solution discussed herein can be used as a basis for understanding these systems.
A blind algorithm for recovering articulator positions from acoustics
MIMICRI is a signal-processing algorithm that has been shown to blindly infer and invert memoryless nonlinear functions of unobservable bandlimited signals, such as the mapping from the unobservable positions of the speech articulators to observable speech sounds. We review results of using MIMICRI on toy problems and on human speech data. We note that MIMICRI requires that the user specify two parameters: the dimensionality and pass-band of the unobservable signals. We show how to use cross-validation to help estimate the passband. An unexpected consequence of this work is that it helps separate signals with overlapping frequency bands.
Electron Dynamics Within a MITL Containing a Load
In this paper, we derive the vacuum electric fields within specific cylindrically symmetric magnetically insulated transmission lines (MITLs) in the limit of an infinite speed of light for an arbitrary time-dependent current. We focus our attention on two types of MITLs: the radial MITL and a spherically curved MITL. We then simulate the motion of charged particles, such as electrons, present in these MITLs due to the vacuum fields. In general, the motion of charged particles due to the vacuum fields is highly nonlinear since the fields are nonlinear functions of spatial coordinates and depend on an arbitrary time-dependent current drive. Using guiding center theory, however, one can describe the gross particle kinetics using a combination of $\textbf {E} \times \textbf {B}$ and $\nabla B$ drifts. In addition, we compare our approximate inner MITL field models and particle kinetics with those from a fully electromagnetic simulation code. We find that the agreement between the approximate model and the electromagnetic simulations is excellent.
Approximating Trajectory Constraints With Machine Learning – Microgrid Islanding With Frequency Constraints
Here, we introduce deep earning aided constraint encoding to tackle the frequency-constraint microgrid scheduling problem. The nonlinear function between system operating condition and frequency nadir is approximated by using a neural network, which admits an exact mixed-integer formulation (MIP). This formulation is then integrated with the scheduling problem to encode the frequency constraint. With the stronger representation power of the neural network, the resulting commands can ensure adequate frequency response in a realistic setting in addition to islanding success. The proposed method is validated on a modified 33-node system. Successful islanding with a secure response is simulated under the scheduled commands using a detailed three-phase model in Simulink. The advantages of our model are particularly remarkable when the inertia emulation functions from wind turbine generators are considered.
Improving Trustworthiness of Data-Driven Power Grid Contingency Analysis With Bayesian Residual Graph Neural Networks
The evolving energy landscape requires novel tools to efficiently perform contingency analysis and reliability assessment of power grids, potentially in real-time. The high computational cost of traditional power flow solvers limits their applicability in practice. Machine learning (ML) surrogates such as deep neural networks (NNs) accelerate power flow solvers computations, enabling high-order contingency analysis and real-time decision-making by learning highly nonlinear functions and integrating grid topology via graph architectures. However, (graph) NNs lack predictive power away from training data and do not provide predictive confidence estimates. Here, we present a Bayesian residual graph NN that integrates knowledge from low-fidelity data via residual training and embeds granular quantification of uncertainties, improving trustworthiness critical for high-consequence decision-making. Applying Bayesian concepts to NNs is challenging due to the high-dimensionality of both the parameter space, complicating derivation of a meaningful prior, and the output space in large grid systems, requiring enhanced techniques to assess the predicted high-dimensional uncertainties. Our contributions include: (1) Deriving a prior for fully connected and graph NNs that leverages low-fidelity data to guide mean predictions and appropriately control prior predictive uncertainty. (2) Integrating this prior within an ensembling with anchoring scheme for efficient approximate posterior inference. (3) Deriving enhanced metrics to assess accuracy of both the mean and uncertainty predictions in high dimensions, appropriately accounting for correlations propagated through graph layers. The resulting Bayesian residual graph NN is tested on a contingency analysis task for 14-bus and 118-bus grids.
Image-based spectral distortion correction for photon-counting x-ray detectors
Purpose: To investigate the feasibility of using an image-based method to correct for distortions induced by various artifacts in the x-ray spectrum recorded with photon-counting detectors for their application in breast computed tomography (CT). Methods: The polyenergetic incident spectrum was simulated with the tungsten anode spectral model using the interpolating polynomials (TASMIP) code and carefully calibrated to match the x-ray tube in this study. Experiments were performed on a Cadmium-Zinc-Telluride (CZT) photon-counting detector with five energy thresholds. Energy bins were adjusted to evenly distribute the recorded counts above the noise floor. BR12 phantoms of various thicknesses were used for calibration. A nonlinear function was selected to fit the count correlation between the simulated and the measured spectra in the calibration process. To evaluate the proposed spectral distortion correction method, an empirical fitting derived from the calibration process was applied on the raw images recorded for polymethyl methacrylate (PMMA) phantoms of 8.7, 48.8, and 100.0 mm. Both the corrected counts and the effective attenuation coefficient were compared to the simulated values for each of the five energy bins. The feasibility of applying the proposed method to quantitative material decomposition was tested using a dual-energy imaging technique with a three-material phantom that consisted of water, lipid, and protein. The performance of the spectral distortion correction method was quantified using the relative root-mean-square (RMS) error with respect to the expected values from simulations or areal analysis of the decomposition phantom. Results: The implementation of the proposed method reduced the relative RMS error of the output counts in the five energy bins with respect to the simulated incident counts from 23.0%, 33.0%, and 54.0% to 1.2%, 1.8%, and 7.7% for 8.7, 48.8, and 100.0 mm PMMA phantoms, respectively. The accuracy of the effective attenuation coefficient of PMMA estimate was also improved with the proposed spectral distortion correction. Finally, the relative RMS error of water, lipid, and protein decompositions in dual-energy imaging was significantly reduced from 53.4% to 6.8% after correction was applied. Conclusions: The study demonstrated that dramatic distortions in the recorded raw image yielded from a photon-counting detector could be expected, which presents great challenges for applying the quantitative material decomposition method in spectral CT. The proposed semi-empirical correction method can effectively reduce these errors caused by various artifacts, including pulse pileup and charge sharing effects. Furthermore, rather than detector-specific simulation packages, the method requires a relatively simple calibration process and knowledge about the incident spectrum. Therefore, it may be used as a generalized procedure for the spectral distortion correction of different photon-counting detectors in clinical breast CT systems.
On the Calculation of the Debye Temperature and Crystal–Liquid Phase Transition Temperature of a Binary Substitution Alloy
A method of estimating the interatomic pair interaction potential parameters for a binary substitution alloy with consideration for the deviation of its lattice parameter from the Vegard law is proposed. This method is used as a basis to calculate the Debye temperature and Grüneisen parameters of a SiGe alloy. It is shown that all these function nonlinearly variate with a change in the germanium concentration. Based on this technique and Lindemann's melting criterion, a method for calculating the liquidus and solidus temperatures of a disordered substitution alloy is proposed. The method is tested on the SiGe alloy and demonstrates good agreement with experimental data. It is shown that when the size of a nanocrystal of a solid substitution solution decreases, the difference between the liquidus and solidus temperatures decreases the more, the more noticeably the nanocrystal shape is deflected from the most energetically optimal shape.
BEAM (Battery Ensemble ANN Modeler) [SWR-19-69]
Dynamic losses of batteries can be a nonlinear function of the operational state of the battery. This package trains an Ensemble of Artificial Neural Networks on battery operational data to model the dynamic losses as a function of the operational state of charge and the active power set point. The package can also be used to return the dynamic battery losses which will be incurred as the battery operates if fed some operational profile.
sf-24-103
pyzag is a library for efficiently training generic models defined with a recursive nonlinear function. We developed it primarily to provide an efficient means to train NEML2 models it can be used to train other, more general types of models.
Lagrangian and Eulerian Supersaturation Statistics in Turbulent Cloudy Rayleigh–Bénard Convection: Applications for LES Subgrid Modeling
Abstract Turbulent fluctuations of scalar and velocity fields are critical for cloud microphysical processes, e.g., droplet activation and size distribution evolution, and can therefore influence cloud radiative forcing and precipitation formation. Lagrangian and Eulerian water vapor, temperature, and supersaturation statistics are investigated in direct numerical simulations (DNS) of turbulent Rayleigh–Bénard convection in the Pi Convection Cloud Chamber to provide a foundation for parameterizing subgrid-scale fluctuations in atmospheric models. A subgrid model for water vapor and temperature variances and covariance and supersaturation variance is proposed, valid for both clear and cloudy conditions. Evaluation of phase change contributions through an a priori test using DNS data shows good performance of the model. Supersaturation is a nonlinear function of temperature and water vapor, and relative external fluxes of water vapor and heat (e.g., during entrainment-mixing and phase change) influence turbulent supersaturation fluctuations. Although supersaturation has autocorrelation and structure functions similar to the independent scalars (temperature and water vapor), the autocorrelation time scale of supersaturation differs. Relative scalar fluxes in DNS without cloud make supersaturation PDFs less skewed than the adiabatic case, where they are highly negatively skewed. However, droplet condensation changes the PDF shape response: it becomes positively skewed for the adiabatic case and negatively skewed when the sidewall relative fluxes are large. Condensation also increases correlations between water vapor and temperature in the presence of relative scalar fluxes but decreases correlations for the adiabatic case. These changes in correlation suppress supersaturation variability for the nonadiabatic cases and increase it for the adiabatic case. Implications of this work for subgrid microphysics modeling using a Lagrangian stochastic scheme are also discussed.
WSBP/NWBP small-world neural network and its performance for wind power forecasting
A small-world neural network has stronger generalization ability with high transfer efficiency than that of the regular neural networks. This paper presents two novel small-world neural networks, the Watts-Strogatz small-world based on a BP neural network (WSBP) and a Newman-Watts small-world neural network based on a BP neural network (NWBP), related to previous research of complex networks. The algorithms are developed separately by adopting WS and NW small-world networks as their topological structures, and their derivation and convergence criterion are progressively discussed. After that, the proposed models are subsequently tested by two typical nonlinear functions which confirm their significant improvement over the regular BP networks and other algorithms. Finally, a wind power prediction system is advanced to verify their generalization abilities, and show that the models are practically feasible and effective with improved accuracy and acceptable forecasting errors caused by wind fluctuation and randomness with a time scale up to 24 h.
Fully implicit particle-in-cell algorithms for kinetic simulation of plasmas [Slides]
We have demonstrated, for the first time, a fully implicit, fully nonlinear electrostatic PIC formulation that features: (1) Exact charge conservation (via a novel particle mover strategy). (2) Exact energy conservation (no particle self-heating or self-cooling). (3) Adaptive particle orbit integrator to control errors in momentum conservation. The approach has been shown to be free of CFL and finite-grid numerical instabilities. As a result, the method is able to take time steps many times larger than explicit, and resolutions many times coarser. Central to our implementation is the concept of particle enslavement. We have generalized formulation to use spatial adaptivity via mapped coordinates. he method has much potential for efficiency gains vs. explicit in long-time-scale applications, with the CPU speedup scaling as $(kΛ_D)-^{(d+1)}/N_{FE}$. Minimize the number of nonlinear function evaluations $N_{FE}$ for given $Δt$, $Δx \Rightarrow$ preconditioning! We have formulated and implemented a very efficient moment-based preconditioner. We have ported the algorithm to GPU architectures. We have generalized the algorithm to non-radiative electromagnetic regimes (Darwin model), where, in addition to charge and energy, we also conserve canonical momenta.