Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “computational costs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Distributed and communication-efficient solutions to linear equations with special sparse structure

In this paper we report two distributed and communication-efficient algorithms based on the multi-agent system are proposed to solve a system of linear equations with the Laplacian sparse system matrix. One algorithm is based on the gradient descent method in optimization. In this algorithm, the agents only share partial information instead of all of their collective state vectors to save significant communication. The other algorithm is obtained by approximating Newton’s method for a faster convergence rate. Although it requires twice as much communication as the first one, it is still communication-efficient given the low dimension of the information shared among agents. The convergence at a linear rate is proved for both algorithms, and a comprehensive comparison of their convergence rate, communication burden, and computation costs is also performed. The proposed algorithms can be applied to various systems to solve those problems that can be modeled as a system of linear equations with a Laplacian sparse system matrix. Simulation results with the electric power system illustrate their effectiveness.

42 ENGINEERING↗

Neural network ensembles and uncertainty estimation for predictions of inelastic mechanical deformation using a finite element method-neural network approach

The finite element method (FEM) is widely used to simulate a variety of physics phenomena. Approaches that integrate FEM with neural networks (NNs) are typically leveraged as an alternative to conducting expensive FEM simulations in order to reduce the computational cost without significantly sacrificing accuracy. However, these methods can produce biased predictions that deviate from those obtained with FEM, since these hybrid FEM-NN approaches rely on approximations trained using physically relevant quantities. In this work, an uncertainty estimation framework is introduced that leverages ensembles of Bayesian neural networks to produce diverse sets of predictions using a hybrid FEM-NN approach that approximates internal forces on a deforming solid body. The uncertainty estimator developed herein reliably infers upper bounds of bias/variance in the predictions for a wide range of interpolation and extrapolation cases using a three-element FEM-NN model of a bar undergoing plastic deformation. This proposed framework offers a powerful tool for assessing the reliability of physics-based surrogate models by establishing uncertainty estimates for predictions spanning a wide range of possible load cases.

42 ENGINEERING↗

Calculation of collisionless pitch-angle scattering of runaway electrons with synchrotron radiation via high-order guiding-centre equation

Recently, the collisionless pitch-angle scattering for relativistic runaway electrons (REs) in toroidal geometries such as tokamaks was discovered through a full orbit simulation approach (Liu et al., Nucl. Fusion, vol. 56, 2016, p. 064002), and it was then theoretically investigated that a new expression for the magnetic moment, including the second-order corrections, could essentially reproduce the so-called collisionless pitch-angle scattering process (Liu et al., Nucl. Fusion, vol. 58, 2018, p. 106018). In this paper, with synchrotron radiation, extensive numerical verification of the validity of the high-order guiding-centre theory is given for simulations involving REs by incorporating such an expression for the magnetic moment into our particle tracing code. A high-order guiding-centre simulation approach with synchrotron radiation (HGSA) is applied. Synchrotron radiation plays an essential role in the life cycle of REs. The energy of REs first increases and then becomes saturated until the electric field acceleration is balanced by the radiation dissipation. Unfortunately, the process cannot be simulated accurately with the standard guiding-centre model, i.e. the first-order guiding-centre model. Remarkably, it is found that the HGSA can effectively produce the fundamental process of REs. Since the time scale of the energy saturation of REs is close to seconds, the computational cost becomes significant. In order to save costs, it is necessary to estimate the time of energy saturation. An analytical estimate is derived for the time it takes for synchrotron drag to balance an accelerating electric field and the provided formula has been numerically verified. Finally, test calculations reveal that HGSA is favourable for exploiting the dynamics of REs in tokamak plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Mapping the space of quasisymmetric stellarators using optimized near-axis expansion

A method is demonstrated to rapidly calculate the shapes and properties of quasi-axisymmetric and quasi-helically symmetric stellarators. In this approach, optimization is applied to the equations of magnetohydrodynamic equilibrium and quasisymmetry, expanded in the small distance from the magnetic axis, as formulated by Garren & Boozer [ Phys. Fluids B, vol. 3, 1991, p. 2805]. Due to the reduction of the equations by the expansion, the computational cost is significantly reduced, to times of the order of 1 cpu second, enabling wide and high-resolution scans over parameter space. In contrast to traditional stellarator optimization, here, the cost function serves to maximize the volume in which the expansion is accurate. A key term in the cost function is $\| \boldsymbol {\nabla }\boldsymbol B \|$ , the norm of the magnetic field gradient, to maximize scale lengths in the field. Using this method, a database of $5\times 10^5$ optimized configurations is calculated and presented. Quasisymmetric configurations are observed to exist in continuous bands, varying in the ratio of the magnetic axis length to average major radius. Several qualitatively new types of configuration are found, including quasi-helically symmetric fields in which the number of field periods is two or more than six.

Landreman, Matt (ORCID:000000027233577X)↗

Spectrally accurate, reverse-mode differentiable bounce-averaging algorithm and its applications

We present a fast, spectrally (exponentially) accurate, automatically differentiable bounce-averaging algorithm that is used to simplify kinetic models. Using this algorithm, implemented in the DESC stellarator optimisation suite, we can perform efficient optimisation of many objectives to improve stellarator performance, such as the effective ripple 𝜖 eff metric for the neoclassical transport coefficient in the low collisionality regime and proxies for energetic particle confinement. For the first time, we optimise a finite-beta stellarator to directly reduce neoclassical ripple transport using reverse-mode differentiation. This ensures the computational cost of differentiation is independent of the number of controllable parameters.

fusion plasma↗

Understanding Adsorption and Reactions at Aqueous Oxide Interfaces with Neural Network Potential Molecular Dynamics

Chemical processes at metal oxide−water interfaces are of central importance in geochemistry, biology, and energy technologies. A better understanding of these processes would allow us to make a significant step toward optimizing and controlling them, which could in turn lead to broader impacts. Computational modeling is indispensable to accomplishing this task because complexity and disorder often make it difficult to extract atomistic information from experiments. Balancing computational cost and accuracy, simulation schemes based on efficient machine learning representations of the potential energy surface (PES) predicted by ab initio calculations have become increasingly popular over the past decade. In particular, several studies have demonstrated the ability of machine learning models to accurately reproduce the complex ab initio PESs of aqueous oxide interfaces, allowing simulations of systems and processes that are not accessible with ab initio methods. In this Account, we review our recent efforts to understand adsorption processes and reactions at aqueous oxide interfaces using deep potential molecular dynamics (DPMD), a simulation scheme employing deep neural networks (DNNs), which has proven to be quite successful in accurately describing many different systems in the condensed phase. After summarizing the DPMD methodology, we first review our work on the acid−base chemistry of oxide surfaces in contact with water, a fundamental characteristic that controls proton transfer and surface charge at the interface. We focus on the aqueous interface of rutile IrO 2 , an oxide material thus far considered the best catalyst for the oxygen evolution reaction (OER). We show that this interface is characterized by a large fraction of dissociated water and a strong Brønsted acidity of the surface sites, in good agreement with the experimentally measured value of the point of zero proton charge. In our second example, we investigate how the adsorption of organic species from ambient air or water affects the structure and wettability of the aqueous interfaces of TiO 2 , a prototypical photocatalytic material. This is a question that is relevant to understanding the UV-induced hydrophilicity of TiO 2 surfaces, a property at the basis of self-cleaning windows and related applications. Specifically focusing on formic and acetic acids, the two most common atmospheric organic acids, our simulations reveal that these acids control the wettability of TiO 2 largely through acid−base chemistry at the interface rather than chemisorption on the oxide surface, a finding that could help improve the design of self-cleaning surfaces and photocatalytic devices. Finally, we review our recent study of methanol at TiO 2 −water interfaces, a system whose interest is largely motivated by the role of methanol in enhancing photocatalytic hydrogen evolution on TiO 2 . Our simulations provide mechanistic insights into the coupled roles of the organic adsorbate and water at the TiO 2 interface, with implications for how methanol enhances the activity of H 2 evolution.

adsorption↗

Toward a First-Principles Framework for Predicting Collective Properties of Electrolytes

Conspectus Given the universal importance of electrolyte solutions, it is natural to expect that we have a nearly complete understanding of the fundamental properties of these solutions (e.g., the chemical potential) and that we can therefore explain, predict, and control the phenomena occurring in them. In fact, reality falls short of these expectations. But, recent advances in the simulation and modeling of electrolyte solutions indicate that it should soon be possible to make progress toward these goals. In this Account, we will discuss the use of first-principles interaction potentials based in quantum mechanics (QM) to enhance our understanding of electrolyte solutions. Specifically, we will focus on the use of quantum density functional theory (DFT) combined with molecular dynamics simulation (DFT-MD) as the foundation for our approach. The overarching concept is to understand and accurately reproduce the balance between local or short-ranged (SR) structural details and long-range (LR) correlations, allowing the prediction of the thermodynamics of both single ions in solution as well as the collective interactions characterized by activity/osmotic coefficients. In doing so, relevant collective motions and driving forces characterized by chemical potentials can be determined. Here, in this Account, we will make the case that understanding electrolyte solutions requires a faithful QM representation of the SR nature of the ion–ion, ion–water, and water–water interactions. However, the number of molecules that is required for collective behavior makes the direct application of high-level QM methods that contain the best SR physics untenable, making methods that balance accuracy and efficiency a practical goal. Alternatives such as continuum solvent models (CSMs) and empirically based classical molecular dynamics have been extensively employed to resolve this problem but without yet overcoming the fundamental issue of SR accuracy. We will demonstrate that accurately describing the SR interaction is imperative for predicting both intrinsic properties, namely, at infinite dilution, and collective properties of electrolyte solutions. DFT has played an important role in our understanding of condensed phase systems, e.g., bulk liquid water, the air–water interface, ions in bulk, and at the air–water interface. This approach holds huge promise to provide benchmark calculations of electrolyte solution properties that will allow for the development and improvement of more efficient methods, as well as an enhanced understanding of fundamental phenomena. However, the standard protocol using the generalized gradient approximation with van der Waals (vdW) correction requires improvement in order to achieve a high level of quantitative accuracy. Simply simulating with higher level DFT functionals may not be the best route considering the significant computational cost. Alternative methods of incorporating information from higher levels of QM should be explored; e.g., using force matching techniques on small clusters, where high level benchmark calculations are possible, to develop ideal correction terms to the DFT functional is a promising possibility. We argue that DFT with statistical mechanics is becoming an increasingly useful framework enabling the prediction of collective electrolyte properties.

Duignan, Timothy T.↗

Physically Informed Machine Learning Prediction of Electronic Density of States

The electronic structure of a material, such as its density of states (DOS), provides key insights into its physical and functional properties and serves as a valuable source of high-quality features for many materials screening and discovery workflows. Still, the computational cost of calculating the DOS, most commonly with density functional theory (DFT), becomes prohibitive for meeting high-fidelity or high-throughput requirements, necessitating a cheaper but sufficiently accurate surrogate. To fulfill this demand, we develop a general machine learning method based on graph neural networks for predicting the DOS purely from atomic positions, six orders of magnitude faster than DFT. This approach can effectively use large materials databases and be applied generally across the entire periodic table to materials classes of arbitrary compositional and structural diversity. We furthermore devise a highly adaptable scheme for physically informed learning which encourages the DOS prediction to favor physically reasonable solutions defined by any set of desired constraints. This functionality provides a means for ensuring that the predicted DOS is reliable enough to be used as an input to downstream materials screening workflows to predict more complex functional properties, which rely on accurate physical features.

36 MATERIALS SCIENCE↗

Site Suitability and Air Pollution Impacts of Composting Infrastructure for California’s Organic Waste Diversion Law

The emerging field of polaritonic chemistry explores the behavior of molecules under strong coupling with cavity modes. Despite recent developments in ab initio polaritonic methods for simulating polaritonic chemistry under electronic strong coupling, their capabilities are limited, especially in cases where the molecule also features strong electronic correlation. To bridge this gap, we have developed a novel method for cavity QED calculations utilizing the Density Matrix Renormalization Group (DMRG) algorithm in conjunction with the Pauli–Fierz Hamiltonian. Our approach is applied to investigate the effect of the cavity on the S0–S1 transition of n-oligoacenes, with n ranging from 2 to 5, encompassing 22 fully correlated π orbitals in the largest pentacene molecule. Our findings indicate that the influence of the cavity intensifies with larger acenes. Additionally, we demonstrate that, unlike the full determinantal representation, DMRG efficiently optimizes and eliminates excess photonic degrees of freedom, resulting in an asymptotically constant computational cost as the photonic basis increases.

54 ENVIRONMENTAL SCIENCES↗

Simulating Droplet-Resolved Haze and Cloud Chemistry Forming Secondary Organic Aerosols in Turbulent Conditions within Laboratory and Cloud Parcels

Most of our existing knowledge of cloud chemistry in regards to forming secondary organic aerosols (SOA) is based on measurements in bulk aqueous solutions. However, SOA reaction kinetics derived from bulk solution measurements might differ from the kinetics in actual cloud droplets, since turbulent mixing and ionic strengths, and ratio of surface area to volume in individual cloud droplets might vary substantially from bulk solutions in the real atmosphere. Three-dimensional models at various scales have been used to simulate aqueous chemistry. However, most of these models do not resolve turbulence down to the smallest length scales of 1 mm and do not simulate cloud chemistry in individual cloud droplets due to large computational costs. Here we incorporate the formation of isoprene epoxydiol SOA (IEPOX-SOA) in individual droplets within a one-dimensional explicit mixing parcel model (EMPM-Chem). We apply EMPM-Chem to simulate turbulence and droplet-resolved IEPOX-SOA formation using a configuration based on the Michigan Tech Pi chamber. We find that the dissolution of IEPOX gases is weighted more towards larger cloud droplets due to their large liquid water content (compared to smaller droplets), while the conversion of dissolved IEPOX to IEPOX-SOA is much greater within smaller deliquesced haze particles due to their higher acidity and ionic strengths compared to cloud droplets. We also find that as droplet residence times increase in the chamber, e.g., due to increasing ammonium bisulfate seed aerosol injection rates and/or increasing heights of the chamber, formation of IEPOX-SOA increases substantially. Thus, our EMPM-Chem model could be used to design future cloud chambers to maximize SOA production from cloud chemistry. We also apply the EMPM-Chem model to simulate how IEPOX-SOA formation evolves in individual cloud droplets within rising cloudy parcels in the atmosphere. We find that as subsaturated air is entrained into and turbulently mixed with the cloud parcel, evaporation causes a reduction in droplet sizes, which leads to corresponding increases in per droplet ionic strength and acidity. Increased droplet acidity in turn greatly accelerates the kinetics of IEPOX-SOA formation. In conclusion, our results provide key insights into single-cloud-droplet chemistry, suggesting that entrainment mixing may be an important process that increases SOA formation in the real atmosphere.

54 ENVIRONMENTAL SCIENCES↗

Transferring a Molecular Foundation Model for Polymer Property Predictions

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and material discovery. Self-supervised pretraining of transformer models requires large-scale data sets, which are often sparsely populated in topical areas such as polymer science. Further, state-of-the-art approaches for polymers conduct data augmentation to generate additional samples but unavoidably incur extra computational costs. In contrast, large-scale open-source data sets are available for small molecules and provide a potential solution to data scarcity through transfer learning. In this work, we show that using transformers pretrained on small molecules and fine-tuned on polymer properties achieves comparable accuracy to those trained on augmented polymer data sets for a series of benchmark prediction tasks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Including Physics-Informed Atomization Constraints in Neural Networks for Reactive Chemistry

Machine learning interatomic potentials (MLIPs) have emerged as powerful tools for investigating atomistic systems with high accuracy and a relatively low computational cost. However, a common and unaddressed challenge with many current neural network (NN) MLIP models is their limited ability to accurately predict the relative energies of systems containing isolated or nearly isolated atoms, which appear in various reactive processes. To address this limitation, we present a mathematical technique for modifying any existing atom-centered NN architecture to account for the energies of isolated atoms. The result produces a consistent prediction of the atomization energy (AE) of a system using minimal constraints on the model. Using this technique, we build a model architecture that we call hierarchically interacting particle neural network (HIP-NN)-AE, an AE-constrained version of the HIP-NN, as well as ANI-AE, the AE-constrained version of the accurate NN engine for molecular energies (ANI). Our results demonstrate AE consistency of AE-constrained models, which drastically improves the AE predictions for the models. We compare the AE-constrained approach to unconstrained models as well as models from the literature in other scenarios, such as bond dissociation energies, bond dissociation pathways, and extensibility tests. These results show that the constraints improve the model performance in some of these tasks and do not negatively affect the performance on any tasks. The AE constraint approach thus offers a robust solution to the challenges posed by isolated atoms in energy prediction tasks.

74 ATOMIC AND MOLECULAR PHYSICS↗

Incorporating Electronic Information into Machine Learning Potential Energy Surfaces via Approaching the Ground-State Electronic Energy as a Function of Atom-Based Electronic Populations

Machine learning (ML) approximations to density functional theory (DFT) potential energy surfaces (PESs) are showing great promise for reducing the computational cost of accurate molecular simulations, but at present, they are not applicable to varying electronic states, and in particular, they are not well suited for molecular systems in which the local electronic structure is sensitive to the medium to long-range electronic environment. With this issue as the focal point, we present a new machine learning approach called "BpopNN" for obtaining efficient approximations to DFT PESs. Conceptually, the methodology is based on approaching the true DFT energy as a function of electron populations on atoms; in practice, this is realized with available density functionals and constrained DFT (CDFT). Additionally, the new approach creates approximations to this function with neural networks. These approximations thereby incorporate electronic information naturally into a ML approach, and optimizing the model energy with respect to populations allows the electronic terms to self-consistently adapt to the environment, as in DFT. We confirm the effectiveness of this approach with a variety of calculations on LinHn clusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improved Fast Randomized Iteration Approach to Full Configuration Interaction

In this work, we present three modifications to our recently introduced fast randomized iteration method for full configuration interaction (FCI-FRI) and investigate their effects on the method’s performance for Ne, H 2 O, and N 2 . The initiator approximation, originally developed for full configuration interaction quantum Monte Carlo, significantly reduces statistical error in FCI-FRI when few samples are used in compression operations, enabling its application to larger chemical systems. The semistochastic extension, which involves exactly preserving a fixed subset of elements in each compression, improves statistical efficiency in some cases but reduces it in others. We also developed a new approach to sampling excitations that yields consistent improvements in statistical efficiency and reductions in computational cost. We discuss possible strategies based on our findings for improving the performance of stochastic quantum chemistry methods more generally.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spin Splitting Energy of Transition Metals: A New, More Affordable Wave Function Benchmark Method and Its Use to Test Density Functional Theory

Accurately predicting the spin splitting energy of chemical species is important for understanding their reactivity and magnetic properties, but it is very challenging, especially for molecules containing transition metals. One impediment to progress is the scarcity of accurate benchmark data. Here we report a set of calculations designed to yield reliable benchmarks for simple transition-metal complexes that can be used to test density functional methods that are affordable for large systems of more practical interest. Various wave function methods are tested against experiment for Fe 2+ , Fe 3+ , and Co 3+ , including CASSCF, CASPT2, CASPT3, MRCISD, MRCISD+Q, ACPF, AQCC, CCSD(T), and CASPT2/CCSD(T) and also a new method called CASPT2.5, which is performed by taking the average of the CASPT2 and CASPT3 energies. Furthermore, we find that MRCISD+Q, ACPF, and AQCC require smaller active spaces for good accuracy than are required by CASPT2 and CASPT3, and this aspect may be important for calculations on larger molecules; here we find that CASPT2.5 extrapolated to a complete basis set is the most suitable method—in terms of computational cost and in terms of accuracy on monatomic systems—and therefore we chose this method for molecular benchmarks. Then Kohn–Sham density functional calculations with 60 exchange-correlation functionals are tested for FeF 2 , FeCl 2 , and CoF 2 . We find that MN15-L, M06-SX, and revM06 have very good agreement with CASPT2.5 benchmarks in terms of both the spin splitting energy and the optimized geometry for each spin state. In addition, we recommend def2-TZVP as the most suitable basis set to perform density functional calculations for molecular spin splitting energies; extra polarization functions in the basis set do not help to increase the accuracy of the spin splitting energy in KS calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Investigating the Accuracy of Water Models through the Van Hove Correlation Function

In this study, we present molecular-simulation-based calculations of the Van Hove correlation function (VHF) of water using multiple modeling approaches: classical molecular dynamics with simple three-site nonpolarizable models, with a polarizable model, and with a reactive force field; density functional tight-binding molecular dynamics; and ab initio molecular dynamics. Due to the many orders of magnitude difference in the computational cost of these approaches, we investigate how small and short the simulations can be while still yielding sufficiently accurate and interpretable results for the VHF. We investigate the accuracy of the different models by comparing them to recently published inelastic X-ray scattering measurements of the VHF. We find that all of the models exhibit qualitative agreement with the experiments, and in some models and for some properties, the agreement is quantitative. This work lays the foundation for future simulation approaches to calculating the VHF for aqueous solutions in bulk and under nanoconfinement.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Electronic Structure Theory Calculations Using Modern Architectures: KNL vs Haswell

The time to solution and parallel efficiency of several commonly used electronic structure methods (Hartree–Fock, density functional theory, second order perturbation theory, resolution of the identity second order perturbation theory, coupled cluster) are evaluated on both the Intel Xeon Haswell and the Intel Xeon Phi Knights Landing (KNL) architectures. The Haswell completes the benchmark calculations with a faster time to solution than the KNL for all molecules and methods tested. While the Haswell exhibits an average speedup of at least 3.5 relative to the KNL for all nonthreaded computations, the KNL has a better parallel efficiency than the Haswell with increasing core counts. The architectures are further tested using a more computationally costly coupled cluster method on a transition state reaction. The Haswell appears to be the best choice to minimize the time to solution, though for very large systems and high levels of theory that require memory intensive processes the superior memory hierarchy and larger on node memory of the KNL can make it a better choice. These results are used to showcase aspects of novel architectures that will increase efficiency for quantum chemistry applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dipole Moment Calculations Using Multiconfiguration Pair-Density Functional Theory and Hybrid Multiconfiguration Pair-Density Functional Theory

The dipole moment is the molecular property that most directly indicates molecular polarity. The accuracy of computed dipole moments depends strongly on the quality of the calculated electron density, and the breakdown of single-reference methods for strongly correlated systems can lead to poor predictions of the dipole moments in those cases. Here, we derive the analytical expression for obtaining the electric dipole moment by multiconfiguration pair density functional theory (MCPDFT), and we assess the accuracy of MC-PDFT for predicting dipole moments at equilibrium and nonequilibrium geometries. We show that MC-PDFT dipole moment curves have reasonable behavior even for stretched geometries, and they significantly improve upon the CASSCF results by capturing more electron correlation. Herein, the analysis of a dataset consisting of 18 first-row transition metal diatomics and 6 main-group polyatomic molecules with multireference character suggests that MC-PDFT and its hybrid extension (HMC-PDFT) perform comparably to CASPT2 and MRCISD+Q methods and have a mean unsigned deviation of 0.2–0.3 D with respect to the best available dipole moment reference values. We explored the dependence of the predicted dipole moments upon the choice of the on-top density functional and active space, and we recommend the tPBE and hybrid tPBE0 on-top choices for the functionals combined with the moderate correlated participating orbital scheme for selecting the active space. With these choices, the mean unsigned deviations (in debyes) of the calculated equilibrium dipole moments from the best estimates are 0.77 for CASSCF, 0.29 for MC-PDFT, 0.24 for HMCPDFT, 0.28 for CASPT2, and 0.25 for MRCISD+Q. These results are encouraging because the computational cost of MC-PDFT or HMC-PDFT is largely reduced compared to the CASPT2 and MRCISD+Q methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗