Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Functional approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗

Monte Carlo Tree Search Methods for the Earth-Observing Satellite Scheduling Problem

This work explores on-board planning for the single spacecraft, multiple ground station Earth-observing satellite scheduling problem through artificial neural network function approximation of state–action value estimates generated by Monte Carlo tree search (MCTS). An extensive hyperparameter search is conducted for MCTS on the basis of performance, safety, and downlink opportunity utilization to determine the best hyperparameter combination for data generation. A hyperparameter search is also conducted on neural network architectures. The learned behavior of each network is explored, and each network architecture’s robustness to orbits and epochs outside of the training distributions is investigated. Furthermore, each algorithm is compared with a genetic algorithm, which serves to provide a baseline for optimality. MCTS is shown to compute near-optimal solutions in comparison to the genetic algorithm. The state–action value networks are shown to match or exceed the performance of MCTS in six orders of magnitude less execution time, showing promise for execution on board spacecraft.

Adam P. Herrmann↗

Comparison of Multivariate Time Series Prediction Techniques for Emulating Noah-LSM Soil Moisture Outputs

Land surface models are crucial tools for many earth science applications including numerical weather prediction, water resource and crop monitoring, and climatological analysis. Given a set of atmospheric forcings, seasonal data, and static parameters, models like Noah-LSM solve for land surface quantities including skin temperature, sensible heat flux, and soil moisture. While these calculations are theoretically robust, they are often computationally expensive. Since artificial neural networks (ANNs) are universal function approximators, they can learn to emulate the output of a deterministic numerical model given a time series of input forcings, with the learned ANN having substantially shorter execution time. The ANN could efficiently parameterize other models, generate ensembles, and provide first-guess inputs for retrievals. As such, with the goal of developing a model that efficiently mimics the output of Noah-LSM given NLDAS2 forcings on a region covering much of the central US, we examine and compare several neural network architectures for the multi-horizon multivariate time series forecasting problem. Recent literature includes a diverse set of approaches including autoregressive architectures like LSTM and GRU, parametric and non-parametric statistical predictors (ForecastNet and MQRNN), self-attention (LSTM-attention-LSTM), and temporal convovlution (DeepTCN). We implement several of these models for the Noah-LSM prediction task, highlighting the features and challenges for each and providing practical insight on the training process.

Mitchell Dodson↗

Magnetic chaos healing in hte helical reversed-field pinch: indications from the volume-preserving field line tracing code NEMATO

The emergence of a self-organized reversed-field pinch (RFP) helical regime, first shown by 3D MHD numerical simulations, has been highlighted in the RFX-mod experiment at high current operation (IP above 1 MA). In fact, a quasi-stationary helical configuration spontaneously appears, characterized by strong internal electron transport barriers. In such regime electron temperature and density become, to a very good approximation, functions of the helical flux coordinate related to the dominant helical magnetic component. In addition, this regime is diagnosed to be associated with the topological transition to a single-helical-axis (SHAx) state, achieved after the expulsion of the separatrix of the dominant mode's magnetic island. The SHAx state is theoretically predicted to be resilient to the magnetic chaos induced by secondary modes. In this paper, we present initial results of the volume-preserving field line tracing code nemato [Finn J M and Chacon L 2005 Phys. Plasmas 12 054503] applied to study the magnetic topology resulting from 3D MHD simulations of the RFP. First, a successful 2D verification test of the code is shown, then, initial application to a systematic study of chaos healing in the helical RFP is discussed. The separatrix disappearance is confirmed to play an essential role for chaos healing. The triggering effect of a reversed magnetic shear for the formation of ordered surfaces within magnetic chaos is also diagnosed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Surrogate modeling with surfpack.

Surfpack is a library of multidimensional function approximation methods useful for efficient surrogate-based sensitivity/uncertainty analysis or calibration/optimization. I will survey current Surfpack meta-modeling capabilities for continuous variables and describe recent progress generalizing to both continuous and categorical factors, including relevant test problems and analysis comparisons.

99 GENERAL AND MISCELLANEOUS↗

nmrfit

Nmrfit reads the output from a nuclear magnetic resonance (NMR) experiment and, through a number of intuitive API calls, produces a least-squares fit of Voigt-function approximations via particle swarm optimization.

Source record↗

A Fresh Math Perspective Opens New Possibilities for Computational Chemistry

By reformulating the TDDFT problem as a matrix function approximation, making use of a special transformation and taking advantage of the underlying symmetry with respect to a non-Euclidean metric, Yang and his colleagues were able to apply the Lanczos algorithm and a Kernal Polynomial Method (KPM) to approximate the absorption spectrum of several molecules. Both of these algorithms require relatively low-memory compared to non-symmetrical alternatives, which is the key to the computational savings.

Vu, Linda↗

Determination of Optimal Operating Schemes for a Multi-Reservoir System Under Environmental Constraints

In strati ed reservoirs, both dam tailwater discharge and thermal plant intake water quality and temperature can be highly dependent on structure depth. A two- dimensional laterally-averaged model allows for better prediction of water quality over time at specfi c depths. Because high- fidelity models are typically too computationally expensive for direct inclusion within optimization algorithms, water quality is incorporated using one dimensional models are simple flow requirements. Water quality predictions can be incorporated within the optimization process through using surrogate modeling methods, in this application artificial neural network (ANN) models. ANNs are flexible machine learning tools for function approximation composed of a structure of neurons assembled within a multi-layer architecture. They are capable of handling large amounts of training data and modeling nonlinear dynamic systems, making ANNs a well-suited method for this application. This report illustrates the development of ANN models to emulate the hydrodynamic and water quality modeling capabilities of the high- fidelity, two-dimensional CE-QUAL-W2 (W2) model, as well as a linked riverine reservoir system optimization process which accounts for energy generation, water balance and hydraulics, and compliance point water quality. A process for hourly hydropower generation planning is demonstrated on a pair of reservoirs linked in series. The two reservoirs are U.S. Army Corps of Engineers projects with hydropower capabilities on the Cumberland River near Nashville, Tennessee, USA.

13 HYDRO ENERGY↗

Computational Math Problems for a Clean Energy Future

Cutting edge computational mathematics are ubiquitous in renewable energy research. Problems in resilient and reliable electric grid operations, infrastructure planning, wind farm yaw control, and more demand sophisticated and scalable computational tools that enable the transition of renewable energy technologies from proof of concept to deployment into our energy system. The mission of the Computational Science Center at NREL is to lead the lab's efforts to solve energy challenges using high-performance computing (HPC), computational science, applied mathematics, scientific data management, visualization, and informatics. In this poster, we provide a short overview of three areas of computational mathematics research at NREL: wind power scenario generation for stochastic grid operations and infrastructure planning, improved rational function approximations for electromagnetic transients codes, and wind farm yaw control using a combination of the Alternating Direction Method of Multipliers (ADMM) and reinforcement learning (RL). Increasing penetrations of renewable energy into power grids motivate the investigation of new approaches to characterizing uncertainty for five-minute economic dispatch problems. Similarly, as the penetration of distributed energy resources on power grids increases, it becomes important to revisit our methods of modelling transient phenomena, i.e. electromagnetic transients programs. Finally, the combination of ADMM and RL for wind farm yaw control presented here can potentially increase the efficiency of the deployed distributed controllers by orders of magnitude.

ADMM↗

Kravchuk functions for the finite oscillator approximation

Kravchuk orthogonal functions - Kravchuk polynomials multiplied by the square root of the weight function - simplify the inversion algorithm for the analysis of discrete, finite signals in harmonic oscillator components. They can be regarded as the best approximation set. As the number of sampling points increases, the Kravchuk expansion becomes the standard oscillator expansion.

Atakishiyev, Natig M.↗

First-principles calculation of correlated electron materials based on Gutzwiller wave function beyond Gutzwiller approximation

We introduce a plan that is under the framework of Gutzwiller wave function but goes beyond the commonly adopted Gutzwiller approximation to improve the accuracy and flexibility in treating the correlation effects. Detailed formalism is described for a dimer which is straightforwardly generalized later to more complicated periodic bulk systems. The accuracy of the approach is shown by evaluating the potential energy curves of spin-singlet N 2 dimer, spin-triplet O 2 dimer, and one-dimensional hydrogen chain. The computational workload of the approach can be easily handled by efficient parallel computing.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Robust validation of approximate 1-matrix functionals with few-electron harmonium atoms

A simple comparison between the exact and approximate correlation components U of the electron-electron repulsion energy of several states of few-electron harmonium atoms with varying confinement strengths provides a stringent validation tool for 1-matrix functionals. The robustness of this tool is clearly demonstrated in a survey of 14 known functionals, which reveals their substandard performance within different electron correlation regimes. Unlike spot-testing that employs dissociation curves of diatomic molecules or more extensive benchmarking against experimental atomization energies of molecules comprising some standard set, the present approach not only uncovers the flaws and patent failures of the functionals but, even more importantly, also allows for pinpointing their root causes. Since the approximate values of U are computed at exact 1-densities, the testing requires minimal programming and thus is particularly suitable for rapid screening of new functionals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Approximation of periodic functions in the classes H{sub q}{sup {Omega}} by linear methods

The following result is proved: if approximations in the norm of L{sub {infinity}} (of H{sub 1}) of functions in the classes H{sub {infinity}}{sup {Omega}} (in H{sub 1}{sup {Omega}}, respectively) by some linear operators have the same order of magnitude as the best approximations, then the set of norms of these operators is unbounded. Also Bernstein's and the Jackson-Nikol'skii inequalities are proved for trigonometric polynomials with spectra in the sets Q(N) (in {Gamma}(N,{Omega})). Bibliography: 15 titles.

97 MATHEMATICS AND COMPUTING↗

Gedanken densities and exact constraints in density functional theory

Approximations to the exact density functional for the exchange-correlation energy of a many-electron ground state can be constructed by satisfying constraints that are universal, i.e., valid for all electron densities. Gedanken densities are designed for the purpose of this construction, but need not be realistic. The uniform electron gas is an old gedanken density. Here, we propose a spherical two-electron gedanken density in which the dimensionless density gradient can be an arbitrary positive constant wherever the density is non-zero. The Lieb-Oxford lower bound on the exchange energy can be satisfied within a generalized gradient approximation (GGA) by bounding its enhancement factor or simplest GGA exchange-energy density. This enhancement-factor bound is well known to be sufficient, but our gedanken density shows that it is also necessary. The conventional exact exchange-energy density satisfies no such local bound, but energy densities are not unique, and the simplest GGA exchange-energy density is not an approximation to it. We further derive a strongly and optimally tightened bound on the exchange enhancement factor of a two-electron density, which is satisfied by the local density approximation but is violated by all published GGA's or meta-GGA’s. Finally, some consequences of the non-uniform density-scaling behavior for the asymptotics of the exchange enhancement factor of a GGA or meta-GGA are given.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploring the limit of accuracy for density functionals based on the generalized gradient approximation: Local, global hybrid, and range-separated hybrid functionals with and without dispersion corrections

The limit of accuracy for semi-empirical generalized gradient approximation (GGA) density functionals is explored by parameterizing a variety of local, global hybrid, and range-separated hybrid functionals. The training methodology employed differs from conventional approaches in 2 main ways: (1) Instead of uniformly truncating the exchange, same-spin correlation, and opposite-spin correlation functional inhomogeneity correction factors, all possible fits up to fourth order are considered, and (2) Instead of selecting the optimal functionals based solely on their training set performance, the fits are validated on an independent test set and ranked based on their overall performance on the training and test sets. The 3 different methods of accounting for exchange are trained both with and without dispersion corrections (DFT-D2 and VV10), resulting in a total of 491 508 candidate functionals. For each of the 9 functional classes considered, the results illustrate the trade-off between improved training set performance and diminished transferability. Since all 491 508 functionals are uniformly trained and tested, this methodology allows the relative strengths of each type of functional to be consistently compared and contrasted. The range-separated hybrid GGA functional paired with the VV10 nonlocal correlation functional emerges as the most accurate form for the present training and test sets, which span thermochemical energy differences, reaction barriers, and intermolecular interactions involving lighter main group elements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Anti-symmetric barron functions and their approximation with sums of determinants

A fundamental problem in quantum physics is to encode functions that are completely anti-symmetric under permutations of identical particles. The architecture of neural network models for the electron wave function typically comprises an equivariant component followed by a summation of determinants. The recently introduced Generic Antisymmetric (GA) block is designed to enhance the expressivity of such neural wave functions, and it was found that the 2-layer GA block achieved more accurate energies than the corresponding single-determinant FermiNet architecure, suggesting its promise as a way to improve the expressivity of neural wave functions. In this paper we show how the function expressed by the 2-layer GA block can be decomposed into a sum of determinants. We formalize this result by defining the antisymmetric Barron space as a generalized version of the 2-layer GA block and providing an appromation theorem for this function class. This result can be viewed as a negative result showing that the 2-layer GA block is not more expressive than using multiple determinants.

Abrahamsen, Nilin↗