Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Benchmarking Adaptive Variational Quantum Eigensolvers

By design, the variational quantum eigensolver (VQE) strives to recover the lowest-energy eigenvalue of a given Hamiltonian by preparing quantum states guided by the variational principle. In practice, the prepared quantum state is indirectly assessed by the value of the associated energy. Novel adaptive derivative-assembled pseudo-trotter (ADAPT) ansatz approaches and recent formal advances now establish a clear connection between the theory of quantum chemistry and the quantum state ansatz used to solve the electronic structure problem. Here we benchmark the accuracy of VQE and ADAPT-VQE to calculate the electronic ground states and potential energy curves for a few selected diatomic molecules, namely H 2 , NaH, and KH. Using numerical simulation, we find both methods provide good estimates of the energy and ground state, but only ADAPT-VQE proves to be robust to particularities in optimization methods. Another relevant finding is that gradient-based optimization is overall more economical and delivers superior performance than analogous simulations carried out with gradient-free optimizers. The results also identify small errors in the prepared state fidelity which show an increasing trend with molecular size.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series: Supporting Data

This dataset consists of soil temperature time series that were used to estimate soil thermal diffusivity and its uncertainty trough the probabilistic modelling approach developed and presented in the article named "Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series" and published in Earth Surface Dynamics. There are two compressed (.zip) files that contains synthetic (Synthetic_soiltemp_Teller.zip) and field (Field_soiltemp_Teller.zip) data. There is one MATLAB file that requires MATLAB to execute but any text editor can open it. The Synthetic_soiltemp_Teller.zip file includes 5 comma-delimited data files (.csv) each of which contains soil temperature time series generated through forward modeling (i.e., heat-conduction process in a heterogeneous medium using an explicit finite difference method) to mimic various types of temperature gradients, trend and fluctuations. These synthetic soil temperatures were used to investigate the impact of different environmental conditions on the uncertainty of thermal diffusivity estimates. The Field_soiltemp_Teller.zip file contains 28 comma-delimited data files (.csv) out of which (a) 27 files includes soil temperature time series recorded from 27 temperature probes located in a site along Teller Road about 40 km northwest of Nome, Alaska (64.72°N, 165.94°W), (b) one includes the name and coordinates of the 27 probes. These field soil temperatures were used to infer soil thermal diffusivity at numerous locations and depths in a discontinuous permafrost environment, and to evaluate the links between the estimated soil thermal diffusivity values and soil physical properties. The comma-delimited data files (.csv) of the synthetic and field soil temperature time series includes date and time (UTC) in the first column and soil temperature from 5 cm below the ground surface to 1.05 m depth (with 5 or 10 cm spacing between sensors) in the other columns. The measurements were acquired every 15 minutes. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Data-Driven PMU Noise Emulation Framework using Gradient-Penalty-Based Wasserstein GAN

Availability of phasor measurement unit (PMUs) data has led to research on data-driven algorithms for event monitoring, control and ensuring stability of the grid. Unavailability of infrequent critical event field PMU data with component failures is driving the need to generate realistic synthetic PMU data for research. The synthetic data from power system simulation software often neglect noise profiles of received phasors, thus creating some discrepancies between real PMU data and synthetic ones. To address this issue, this work presents an initial study on the noise characteristics of PMUs, as well as presenting models for recreating their unique noise signatures. The proposed method, utilizing the Wasserstein generative adversarial network with gradient penalty (WGAN-GP) architecture, provides an excellent benchmark for matching the noise distribution. One can use a well-learned GAN model to draw noise signatures from a distribution that seemingly mirrors the real PMU noise distribution, while also being able to be detached from the PMU data once the training is done. Based on the observed results and employed data-driven methodology, it is expected that the proposed methods can be adapted to replicate the behavior of other sensors, providing research and other applications with a tool for data synthesis and sensor characterization.

PMU↗
DOE OSTI2024

A Semi‐Mechanistic Model for Partitioning Evapotranspiration Reveals Transpiration Dominates the Water Flux in Drylands

Abstract Popular evapotranspiration (ET) partitioning methods make assumptions that might not be well‐suited to dryland ecosystems, such as high sensitivity of plant water‐use efficiency (WUE) to vapor pressure deficit (VPD). Our objectives were to (a) create an ET partitioning model that can produce fine‐scale estimates of transpiration (T) in drylands, and (b) use this approach to evaluate how climate controls T and WUE across ecosystem types and timescales along a dryland aridity gradient. We developed a novel, semi‐mechanistic ET partitioning method using a Bayesian approach that constrains abiotic evaporation using process‐based models, and loosely constrains time‐varying WUE within an autoregressive framework. We used this method to estimate daily T and weekly WUE across seven dryland ecosystem types and found that T dominates ET across the aridity gradient. Then, we applied cross‐wavelet coherence analysis to evaluate the temporal coherence between focal response variables (WUE and T/ET) and environmental variables. At yearly scales, we found that WUE at less arid, higher elevation sites was primarily limited by atmospheric moisture demand, and WUE at more arid, lower elevation sites was primarily limited by moisture supply. At sub‐yearly timescales, WUE and VPD were sporadically correlated. Hence, ecosystem‐scale dryland WUE is not always sensitive to changes in VPD at short timescales, despite this being a common assumption in many ET partitioning models. This new ET partitioning method can be used in dryland ecosystems to better understand how climate influences physically and biologically driven water fluxes.

Environmental Sciences & Ecology↗
DOE OSTI2024

Small-correlated-against-large estimator for the lensing of the cosmic microwave background

Weak gravitational lensing of the cosmic microwave background (CMB) carries imprints of the physics operating at redshifts much lower than that of recombination and serves as an important probe of cosmological structure formation, dark matter physics, and the mass of neutrinos. Reconstruction of the CMB lensing deflection field through use of quadratic estimators has proven successful with existing data but is known to be sub-optimal on small angular scales ($\ell > 3000$) for experiments with low noise levels. Future experiments will provide better observations in this regime, but these techniques will remain statistically limited by their approximations. We show that correlations between fluctuations of the large-scale temperature gradient power of the CMB sourced by $\ell < 2000$, and fluctuations of the local small-scale temperature power reveal a lensing signal which is prominent in even the real-space pixel statistics across a CMB temperature map. We present the development of the Small Correlated Against Large Estimator (SCALE), a novel estimator for the CMB lensing spectrum which offers promising complementary analysis alongside other reconstruction techniques in this regime. The SCALE method computes correlations between both the large/small-scale temperature gradient power in harmonic space, and it is able to quantitatively recover unbiased statistics of the CMB lensing field without the need for map-level reconstruction. SCALE can outperform quadratic estimator signal-to-noise by a factor of up to 1.5 in current and upcoming experiments for CMB lensing power spectra $C_{6000 < L < 8000}^{\phi\phi}$.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

The evolution of composition and morphology during the initial growth of electrodeposited Ni-Fe films: Comparison between the potentiostatic mode and the pulse-reverse potential mode

The anomalous codeposition of Ni-Fe tends to develop a composition gradient zone along the growth direction within the near-substrate region. Although it has been shown that such a composition gradient can be mitigated by the pulsed deposition method, a fundamental understanding of this behavior based on the anomalous codeposition mechanism has not been achieved yet. In this work, the evolution of the composition and the morphology during the (pulsed) electrodeposition of Ni-Fe films was reported. Further, a theory based on the Fe deposition mechanism originally described by Bockris, Drazic, and Despic was proposed and described in detail, which was used to rationalize not only the occurrence and the decline of the composition gradient, but also the opposite signs of the composition gradient observed under the potentiostatic mode and the pulse-reverse potential mode.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Multirobot Collaborative Pursuit Target Robot by Improved MADDPG

Policy formulation is one of the main problems in multirobot systems, especially in multirobot pursuit-evasion scenarios, where both sparse rewards and random environment changes bring great difficulties to find better strategy. Existing multirobot decision-making methods mostly use environmental rewards to promote robots to complete the target task that cannot achieve good results. This paper proposes a multirobot pursuit method based on improved multiagent deep deterministic policy gradient (MADDPG), which solves the problem of sparse rewards in multirobot pursuit-evasion scenarios by combining the intrinsic reward and the external environment. The state similarity module based on the threshold constraint is as a part of the intrinsic reward signal output by the intrinsic curiosity module, which is used to balance overexploration and insufficient exploration, so that the agent can use the intrinsic reward more effectively to learn better strategies. The simulation experiment results show that the proposed method can improve the reward value of robots and the success rate of the pursuit task significantly. The intuitive change is obviously reflected in the real-time distance between the pursuer and the escapee, the pursuer using the improved algorithm for training can get closer to the escapee more quickly, and the average following distance also decreases.

Zhou, Xiao↗
DOE OSTI2024

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗
DOE OSTI2023

An inexact semismooth Newton method with application to adaptive randomized sketching for dynamic optimization

In many applications, one can only access the inexact gradients and inexact hessian times vector products. Thus it is essential to consider algorithms that can handle such inexact quantities with a guaranteed convergence to solution. An inexact adaptive and provably convergent semismooth Newton method is considered to solve constrained optimization problems. In particular, dynamic optimization problems, which are known to be highly expensive, are the focus. A memory efficient semismooth Newton algorithm is introduced for these problems. The source of efficiency and inexactness is the randomized matrix sketching. Further, applications to optimization problems constrained by partial differential equations are also considered.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. The use of the Finnish Horseshoe as a sparsity-promoting prior for free model parameters also enables the discovery of parsimonious representations for the latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator–prey systems, systems biology and a 50-dimensional human motion dynamical system. This article is part of the theme issue ‘Data-driven prediction in dynamical systems’.

Science & Technology - Other Topics↗
DOE OSTI2021

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

A Gradient Based Subgrid-Scale Parameterization for Ocean Mesoscale Eddies

Mesoscale eddies play an important role in transport of heat and biogeochemical tracers in the global ocean circulation. Resolving these energetic eddies, however, is challenging in ocean general circulation models (OGCM) because it requires a horizontal grid spacing of ≲1/8° that is computationally expensive. As a result, we are required to parameterize mesoscale eddy effects on large-scale ocean flows. In this work, we introduce a new subgrid-scale (SGS) model that is developed based on a Taylor series expansion of resolved variables to parameterize subgrid mesoscale eddy transports and momentum fluxes in OGCM. We have performed an a priori study to evaluate the performance of our new gradient model using high-resolution ocean simulations. Our results show that the gradient model well predicts the actual SGS thickness fluxes in the zonal and meridional directions in coarse-resolution simulations with the grid spacing ≳1/4°. The unresolved kinetic energy at the ocean surface is also skillfully estimated. More importantly, unlike current mesoscale eddy parameterizations, which are mainly developed based on an assumption of flat bottom ocean, our new SGS model can capture the structure of unresolved standing meanders at the ocean surface. We have also developed a dynamic procedure for setting in non-dimensional parameters in our new parameterization through a non-ad hoc and tuning-free method. Overall, this work suggests that implementing the gradient model in OGCM can improve the model accuracy with an affordable computational cost in eddy-permitting and non-eddying simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Turbulence model reduction by deep learning

A defining problem of turbulence theory is to produce a predictive model for turbulent fluxes. These have profound implications for virtually all aspects of the turbulence dynamics. In magnetic confinement devices, drift-wave turbulence produces anomalous fluxes via cross-correlations between fluctuations. In this work, we introduce an alternative, data-driven method for parametrizing these fluxes. The method uses deep supervised learning to infer a reduced mean-field model from a set of numerical simulations. We apply the method to a simple drift-wave turbulence system and find a significant new effect which couples the particle flux to the local gradient of vorticity. Notably, here, this effect is much stronger than the oft-invoked shear suppression effect. We also recover the result via a simple calculation. The vorticity gradient effect tends to modulate the density profile. In addition, our method recovers a model for spontaneous zonal flow generation by negative viscosity, stabilized by nonlinear and hyperviscous terms. We highlight the important role of symmetry to implementation of the new method.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Advances in Kriging-Based Autonomous X-Ray Scattering Experiments

Autonomous experimentation is an emerging paradigm for scientific discovery, wherein measurement instruments are augmented with decision-making algorithms, allowing them to autonomously explore parameter spaces of interest. We have recently demonstrated a generalized approach to autonomous experimental control, based on generating a surrogate model to interpolate experimental data, and a corresponding uncertainty model, which are computed using a Gaussian process regression known as ordinary Kriging (OK). We demonstrated the successful application of this method to exploring materials science problems using x-ray scattering measurements at a synchrotron beamline. Here, we report several improvements to this methodology that overcome limitations of traditional Kriging methods. The variogram underlying OK is global and thus insensitive to local data variation. We augment the Kriging variance with model-based measures, for instance providing local sensitivity by including the gradient of the surrogate model. As with most statistical regression methods, OK minimizes the number of measurements required to achieve a particular model quality. However, in practice this may not be the most stringent experimental constraint; e.g. the goal may instead be to minimize experiment duration or material usage. We define an adaptive cost function, allowing the autonomous method to balance information gain against measured experimental cost. We provide synthetic and experimental demonstrations, validating that this improved algorithm yields more efficient autonomous data collection.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A consistent and conservative Phase-Field method for multiphase incompressible flows

In the present study, a consistent and conservative Phase-Field method, including both the model and scheme, is developed for multiphase flows with an arbitrary number of immiscible and incompressible fluid phases. The consistency of mass conservation and the consistency of mass and momentum transport are implemented to address the issue of physically coupling the Phase-Field equation, which locates different phases, to the hydrodynamics. These two consistency conditions, as illustrated, provide the “optimal” coupling because (i) the new momentum equation resulting from them is Galilean invariant and implies the kinetic energy conservation, regardless of the details of the Phase-Field equation, and (ii) failures of satisfying the second law of thermodynamics or the consistency of reduction of the multiphase flow model only result from the same failures of the Phase-Field equation but are not due to the new momentum equation. Physical interpretation of the consistency conditions and their formulations are first provided, and general formulations that are obtained from the consistency conditions and independent of the interpretation of the velocity are summarized. Then, the present consistent and conservative multiphase flow model is completed by selecting a reduction consistent Phase-Field equation. Several novel techniques are developed to inherit the physical properties of the multiphase flows after discretization, including the gradient-based phase selection procedure, the momentum conservative method for the surface force, and the general theorems to preserve the consistency conditions on the discrete level. Equipped with those novel techniques, a consistent and conservative scheme for the present multiphase flow model is developed and analyzed. The scheme satisfies the consistency conditions, conserves the mass and momentum, and assures the summation of the volume fractions to be unity, on the fully discrete level and for an arbitrary number of phases. All those properties are numerically validated. Finally, numerical applications demonstrate that the present model and scheme are robust and effective in studying complicated multiphase dynamics, especially for those with large-density ratios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An Improved Model For Determining Salinity Recharge Time for Deep Borehole Disposal - 20405

In a previous publication (K. P. Travis, D. Burley and F. G. F. Gibb, WM2017 Conference, Phoenix Arizona paper no. 17480) we introduced a numerical model to estimate the time it would take for a pressure perturbation to subside following its creation from the construction of a deep geological borehole in water-saturated rock. The model was based on the notion of a point source of momentum - a solution of the time-dependent pressure-diffusion equation. Using the model, we estimated that it would take on the order of 10 k years for physical equilibrium to become re-established following the sinking of a 5 km borehole in granite. The significance of such a model is that it places an upper bound on the lifetime required of a borehole sealing system - a necessary input to a borehole post-closure safety case assessment. No engineered sealing system has ever been devised which is capable of retaining its sealing properties for 10 half-lives of long-lived radioisotopes in spent fuel or high-level waste. One of the key advantages of disposing of nuclear waste via Deep Borehole Disposal (DBD) is the natural sealing provided by density stratified groundwater. Upon sinking of a borehole, and subsequent filling with fresh water, brine or drilling mud, this natural barrier may be temporarily damaged. Over time, fresh brine from the far-field will flow towards or away from the hole (driven by a pressure gradient) and will eventually re-establish the original salinity gradient. It follows that the engineered seals need last only as long as the time required for this salinity gradient to reset itself. One of the limitations of our previous model was the use of a static boundary condition on the borehole wall. The model used a boundary pressure which varied quadratically with depth (arising from differences between the pressure of a column of fresh water in the borehole and that of a column of brine in the host rock). However as brine replaces fresh water in the borehole (driven by a pressure gradient), the boundary function must change with time. We now introduce an improved model which takes this time dependent boundary condition into account. The model also takes into account the time taken for a mixture of brine and fresh water to re-establish chemical equilibrium through the process of diffusion. The paper contains the mathematical details of our new iterative model as well as results showing the time taken to reach steady state, and concentration profiles for the components of the brine-filled borehole as a function of time together with a discussion on the implications of the results for developing a post-closure safety assessment for DBD. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Efficient particle control in systems with large density gradients

Simulations of large density gradients present a number of challenges for direct Monte Carlo methods, since they lead to too few particles in dilute regions and prohibitively many in the dense regions. Here, we propose a particle control methodology that gives the user more control of the number of particles per cell by introducing a variable weight for each particle. The proposed scheme is based on the stochastic weighted particle method, requires only small modifications to DSMC, and exactly conserves mass, momentum, and energy. In validation tests of systems with density ratios of order 102-104, we observe 101-102 times less variance in the dilute region compared to a DSMC solution with the same number of system particles, while introducing a moderate additional computational cost.

DSMC↗
DOE OSTI2026

Mott vs Kondo: Influence of various density functional based methods on the Ce isostructural phase transition mechanism

The cerium iso-structural phase transition (γ–α) is dominated by f-electron localization changes that results in a magnetic ordering change and a volume collapse. Generally, these physics are difficult to capture with ab initio and first principles methods. However, previous works have shown various methods to be successful in predicting at least some of the physics of the γ to α phase transition. Therefore, here, we perform a broad survey of density functional based methods across three levels of theory and types of functions [GGA (generalized gradient approximation), MetaGGA, and hybrid functionals] and compare the results, focusing on hydrostatic compression across the phase boundary at zero kelvin. For the methods that best reproduce experimental results, we directly probe the predicted mechanisms and frame the results in the Mott/Kondo debate, assessing how the underlying methods and assumptions of different functionals can assess the physical drivers in the phase transition, providing insight into the governing processes of this unique phase transition.

36 MATERIALS SCIENCE↗