Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variational methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

CONCURRENT, CONDENSED STEIN VARIATIONAL GRADIENT DESCENT FOR UNCERTAINTY QUANTIFICATION OF NEURAL NETWORKS

In this work, we propose a Stein variational gradient descent (SVGD) method to concurrently sparsify, train, and provide uncertainty quantification (UQ) of a complexly parameterized model, such as a neural network (NN). It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed concurrent, condensed SVGD (ccSVGD) method can provide UQ on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a mechanical response representation problem in solid mechanics.

42 ENGINEERING↗

Convergence of variational Monte Carlo simulation and scale-invariant pre-training

We provide theoretical convergence bounds for the variational Monte Carlo (VMC) method as applied to optimize neural network wave functions for the electronic structure problem. Here, we study both the energy minimization phase and the supervised pre-training phase that is commonly used prior to energy minimization. For the energy minimization phase, the standard algorithm is scale-invariant by design, and we provide a proof of convergence for this algorithm without modifications. The pre-training stage typically does not feature such scale-invariance. We propose using a scale-invariant loss for the pretraining phase and demonstrate empirically that it leads to faster pre-training.

97 MATHEMATICS AND COMPUTING↗

BUQEYE guide to projection-based emulators in nuclear physics

The BUQEYE collaboration (Bayesian Uncertainty Quantification: Errors in Your effective field theory) presents a pedagogical introduction to projection-based, reduced-order emulators for applications in low-energy nuclear physics. The term emulator refers here to a fast surrogate model capable of reliably approximating high-fidelity models. As the general tools employed by these emulators are not yet well-known in the nuclear physics community, we discuss variational and Galerkin projection methods, emphasize the benefits of offline-online decompositions, and explore how these concepts lead to emulators for bound and scattering systems that enable fast and accurate calculations using many different model parameter sets. We also point to future extensions and applications of these emulators for nuclear physics, guided by the mature field of model (order) reduction. All examples discussed here and more are available as interactive, open-source Python code so that practitioners can readily adapt projection-based emulators for their own work.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Facile Approach to High Precision Detection of Cell-to-Cell Variation for Li-ion Batteries

Abstract Over the past decade, it has been repeatedly demonstrated that homogeneity in electrochemical performance of lithium-ion cells plays a major role in determining the life and safety of lithium-ion battery modules or packs. Generally, the homogeneity of a battery pack is evaluated by characterizing the cells individually in terms of capacity, mass, impedance. Particularly, high quality electrochemical data heavily relies on the availability of high precision current source to minimize the discrepancy induced by the channel-to-channel variation. Here, a facile and precise measurement method is reported for screening cell-to-cell variations, in which voltage is the only indicator parameter independent of high precision current source. In detail, by connecting the cells in series (CiS), the measurement error of electrochemical data caused by stability and discrepancy of current sources among different charge/discharge equipment can be effectively avoided. The findings of this work showed that the cell-to-cell variations can be simply and sensitively detected with CiS configuration. For example, the relative standard deviation, which is the evaluation criterion of battery homogeneity, was 2.14% based on CiS while it was 0.43% based on individual measurements. The simple and precise CiS measurement is promising for evaluation of cell quality or module integration quality. In addition, this work can also provide a solid foundation for the development of detection algorithms for battery management systems to rapidly monitor battery homogeneity.

25 ENERGY STORAGE↗

Predicting variations of the least principal stress with depth: Application to unconventional oil and gas reservoirs using a log-based viscoelastic stress relaxation model

Knowledge of layer-to-layer variations of the least principal stress, S hmin , with depth is essential for optimization of multi-stage hydraulic fracturing in unconventional reservoirs. Utilizing a geomechanical model based on viscoelastic stress relaxation in relatively clay rich rocks, we present a new method for predicting continuous S hmin variations with depth. The method utilizes geophysical log data and S hmin measurements from routine diagnostic fracture injection tests (DFITs) at several depths for calibration. We consider a case study in the Wolfcamp formation in the Midland Basin, where both geophysical logs and values of S hmin from DFITs are available. We compute a continuous stress profile as a function of the well logs that fits all of the DFITs well. We utilized several machine learning technologies, such as bootstrap aggregation (or bagging), to improve the generalization of the model and demonstrate that the excellent fit between predicted and observed stress values is not the result of over-fitting the calibration points. The model is then validated by accurately predicting hold-out stress measurements from four wells within the study area and, without recalibration, accurately predicting stress as a function of depth in an offset pad about 6 miles away.

58 GEOSCIENCES↗

Multi-fidelity microstructure-induced uncertainty quantification by advanced Monte Carlo methods

Quantifying uncertainty associated with the microstructure variation of a material can be a computationally daunting task, especially when dealing with advanced constitutive models and fine mesh resolutions in the crystal plasticity finite element method (CPFEM). Numerous studies have been conducted regarding the sensitivity of material properties and performance to the mesh resolution and choice of constitutive model. However, a unified approach that accounts for various fidelity parameters, such as mesh resolutions, integration time-steps and constitutive models simultaneously is currently lacking. Further, this paper proposes a novel uncertainty quantification (UQ) approach for computing the properties and performance of homogenized materials using CPFEM, that exploits a hierarchy of approximations with different levels of fidelity. In particular, we illustrate how multi-level sampling methods, such as multi-level Monte Carlo (MLMC) and multi-index Monte Carlo (MIMC), can be applied to assess the impact of variations in the microstructure of polycrystalline materials on the predictions of homogenized materials properties. We show that by adaptively exploiting the fidelity hierarchy, we can significantly reduce the number of microstructures required to reach a certain prescribed accuracy. Finally, we show how our approach can be extended to a multi-fidelity framework, where we allow the underlying constitutive model to be chosen from either a phenomenological plasticity model or a dislocation-density-based model.

36 MATERIALS SCIENCE↗

Uranium Oxide Synthetic Pathway Discernment through Unsupervised Morphological Analysis

We present a novel unsupervised machine learning method for quantitative representation of scanning electron micrographs and its applications and performance for nuclear forensic analysis of uranium ore concentrates. The method uses a vector quantizing variational autoencoder followed by a histogram operation to encode a micrograph into a single dimensional representation, called the latent vector. The method requires no extant labeling of the data and can be applied over large datasets of micrographs with minimal human interaction. The representations generated are broadly descriptive of each micrograph and the microstructure of the material imaged. In the case of uranium ore concentrate analysis, the representations were amenable to processing reagent and ore concentrate species classification with accuracy of 81:8%, which is competitive with state-of-the-art supervised networks. The representations were also used to classify previously unseen processing routes, were able to classify imaging parameters such as magnification (to 76:0% accuracy), were able to classify fine grained process parameters such as calcining temperature (to 74:4% accuracy), and their informatic properties indicate that they are generally descriptive of the image represented. This method can be applied across microstructure analysis fields to perform quantitative analysis without the need for labor intensive and possibly biased human analysis.

Scanning Electron Microscopy, Vector Quantizing Va↗

Contrasting roles of rice root iron plaque in retention and plant uptake of silicon, phosphorus, arsenic, and selenium in diverse paddy soils

Abstract Background and aims Iron (Fe) plaque on rice roots is a mixture of Fe oxide and oxyhydroxide minerals thought to protect rice from high levels of arsenic (As) in flooded paddy soils. Silicon (Si), phosphorus (P), and selenium (Se) also exist as oxyanions in rice paddies, but the impacts of Fe plaque on uptake of these nutrients are unknown. Methods We used natural variation in paddy soil chemistry to test how Si, P, As, and Se move from porewater to plaque to plant via multiple techniques. In a pot study, we monitored Fe plaque deposition and porewater chemistry in 5 different soils over time and measured plaque/plant chemistry and Fe plaque mineralogy at harvest. We normalized oxyanion concentrations by Fe to determine the preferential retention on plaque or plant uptake. Results Low phosphorus availability increased root Fe-oxidizing activity, while Fe, Si, P, As, and Se concentrations in plaque were strongly correlated with porewater. Plaque did not appreciably retain Si and Se, and the oxyanions did not compete for adsorption sites on the Fe plaque. Conclusion Root Fe plaque seems to protect rice from As uptake, does not interfere with Si and Se uptake, and roots adapt to maintain P nutrition even with retention of porewater P on plaque.

Agriculture↗

Theory and numerics of subspace approximation of eigenvalue problems

Large-scale eigenvalue problems arise in various fields of science and engineering and demand computationally efficient solutions. In this study, we investigate the subspace approximation for parametric linear eigenvalue problems, aiming to mitigate the computational burden associated with high-fidelity systems. Furthermore, we provide general error estimates under non-simple eigenvalue conditions, establishing some theoretical foundations for understanding the convergence behavior of subspace approximations. Numerical examples, including problems with one-dimensional to three-dimensional spatial domain and one-dimensional to two-dimensional parameter domain, are presented to demonstrate the efficacy of reduced basis method in handling parametric variations in boundary conditions and coefficient fields to achieve significant computational savings while maintaining high accuracy, making them promising tools for practical applications in large-scale eigenvalue computations.

Eigenvalue problems↗

Quantum Simulation of Molecular Electronic States with a Transcorrelated Hamiltonian: Higher Accuracy with Fewer Qubits

Simulation of electronic structure is one of the most promising applications on noisy intermediate-scale quantum (NISQ) era devices. However, NISQ devices suffer from a number of challenges like limited qubit connectivity, short coherence times, and sizable gate error rates. Thus, desired quantum algorithms should require shallow circuit depths and low qubit counts to take advantage of these devices. Here, we attempt to reduce quantum resource requirements for molecular simulations on a quantum computer while maintaining the desired accuracy with the help of classical quantum chemical theories of canonical transformation and explicit correlation. In this work, compact ab initio Hamiltonians are generated classically, in the second quantized form, through an approximate similarity transformation of the Hamiltonian with (a) an explicitly correlated two-body unitary operator with generalized pair excitations that remove the Coulombic electron–electron singularities from the Hamiltonian and (b) a unitary one-body operator to efficiently capture the orbital relaxation effects required for accurate description of the excited states. The resulting transcorrelated Hamiltonians are able to describe both the ground and the excited states of molecular systems in a balanced manner. Using the variational quantum eigensolver (VQE) method based on the unitary coupled cluster with singles and doubles (UCCSD) ansatz and only a minimal basis set (ANO-RCC-MB), we demonstrate that the transcorrelated Hamiltonians can produce ground state energies comparable to the reference CCSD energies with the much larger cc-pVTZ basis set. This leads to a reduction in the number of required CNOT gates by more than 3 orders of magnitude for the chemical species studied in this work. Furthermore, using the quantum equation of motion (qEOM) formalism in conjunction with the transcorrelated Hamiltonian, we are able to reduce the deviations in the excitation energies from the reference EOM-CCSD/cc-pVTZ values by an order of magnitude. In conclusion, the transcorrelated Hamiltonians developed here are Hermitian and contain only one- and two-body interaction terms and thus can be easily combined with any quantum algorithm for accurate electronic structure simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Ab initio molecular dynamics on quantum computers

Ab initio molecular dynamics (AIMD) is a valuable technique for studying molecules and materials at finite temperatures where the nuclei evolve on potential energy surfaces obtained from accurate electronic structure calculations. In this work, we present an approach to running AIMD simulations on noisy intermediate-scale quantum (NISQ)-era quantum computers. The electronic energies are calculated on a quantum computer using the variational quantum eigensolver (VQE) method. Algorithms for computation of analytical gradients entirely on a quantum computer require quantum fault-tolerant hardware, which is beyond NISQ-era. Therefore, we compute the energy gradients numerically using finite differences, the Hellmann-Feynman theorem, and a correlated sampling technique. This method only requires additional classical calculations of electron integrals for each degree of freedom without any additional computations on a quantum computer beyond the initial VQE run. As a proof of concept, AIMD simulations are demonstrated for the H-2 molecule on IBM quantum devices. In addition, we demonstrate the validity of the method for larger molecules using full configuration interaction wave functions. As quantum hardware and noise mitigation techniques continue to improve, the method can be utilized for studying larger molecular systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Attaining the promise of plant gene editing at scale

Crop improvement relies heavily on genetic variation that arises spontaneously through mutation. Modern breeding methods are very adept at combining this genetic variation in ways that achieve remarkable improvements in plant performance. Novel traits have also been created through mutation breeding and transgenesis. The advent of gene editing, however, marks a turning point: With gene editing, synthetic variation will increasingly supplement and, in some cases, supplant the genetic variation that occurs naturally. We are still in the very early stages of realizing the opportunity provided by plant gene editing. At present, typically only one or a few genes are targeted for mutation at a time, and most mutations result in loss of gene function. New technological developments, however, promise to make it possible to perform gene editing at scale. RNA virus vectors, for example, can deliver gene-editing reagents to the germ line through infection and create hundreds to thousands of diverse mutations in the progeny of infected plants. With developmental regulators, edited somatic cells can be induced to form meristems that yield seed-producing shoots, thereby increasing throughput and shrinking timescales for creating edited plants. As these approaches are refined and others developed, they will allow for accelerated breeding, the domestication of orphan crops and the reengineering of metabolism in a more directed manner than has ever previously been possible.

59 BASIC BIOLOGICAL SCIENCES↗

Application of an efficient generator-coordinate subspace-selection algorithm to neutrinoless double- β decay

The generator coordinate method begins with the variational construction of a set of nonorthogonal mean-field states that span a subspace of the full many-body Hilbert space. These states are then often projected onto states with good quantum numbers to restore symmetries, leading to a set with members that can be similar to one another, and it is sometimes possible to reduce this set without greatly affecting results. Here, we propose a greedy algorithm that we call the energy-transition-orthogonality procedure (ENTROP) to select subsets of important states. As applied here, the approach selects on the basis of diagonal energy, orthogonality, and contribution to the matrix element that governs neutrinoless double-β decay. We present both shell-model and preliminary ab initio calculations of this matrix element for the decay of 76Ge, with quadrupole deformation parameters and the isoscalar pairing strength as generator coordinates. ENTROP converges quickly, reducing significantly the number of basis states needed for an accurate calculation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Negative thermal expansion in the Ruddlesden-Popper calcium titanates

Materials exhibiting negative thermal expansion (NTE) are important for the fabrication and operation of microelectronic devices and optical systems. In this paper, combining density-functional-theory calculations and the self-consistent quasiharmonic approximation method, we investigate the variation of the NTE mechanisms active in layered calcium titanate oxides. We find a NTE trend with layer number for the orthorhombic materials comprising the RP series, but the monoclinic polymorph is an outlier.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Numerical Simulations of Noisy Variational Quantum Eigensolver Ansatz Circuits

This is a case study of the variational quantum eigensolver (VQE) method using numerical simulations to test the influence of noise on the accuracy of the underlying circuit ansatz. We investigate a computational chemistry application of VQE to calculate the electronic ground state and its energy for Sodium Hydride (NaH), a prototypical two-electron problem. Using a one-parameter ansatz derived from unitary coupled cluster (UCC) theory, we simulate the effects of noise on the energy expectation value and variance with respect to the ansatz parameter. These numerical simulations provide insights into the accuracy of the prepared quantum state and the efficiency of the classical optimizer that iteratively refines the ansatz. We conduct a comparative study between analytical results derived for the UCC ansatz in the absence of noise and the noisy numerical simulation results obtained using an isotropic depolarizing noise model for each gate. We also compare the relative increase in noise on logically equivalent UCC ansatz circuits generated by randomized compiling. Notably, we observe that the intrinsic variance in the energy due to the simplicity of the ansatz itself compares with the noise induced by the bare circuit.

Gowrishankar, Meenambika↗

Characterization and differentiation of aluminum powders used in improvised explosive devices – Part 1: Proof of concept of the utility of particle micromorphometry

Abstract Aluminum (Al) powders are commonly used in improvised explosive devices as metallic fuels, a component of explosive mixtures. These powders can be obtained readily from industrial‐scale and consumer products, and produced using unsophisticated “kitchen chemistry” techniques. This research demonstrates the potential of automated particle micromorphometry for comparisons between known source and questioned Al powders recovered from IEDs, as well as for insight into the method of Al powder manufacture. Al powder samples were obtained from legitimate manufacturers, and 56 samples were produced “in‐house” from Al‐containing spray paints and ball‐milled Al foils. Transmitted light microscope images of Al powder particles were acquired using an automated stage with automated z‐focus; 17 size and shape parameters were measured for all particles. Approximately 37,000–2,500,000 particles/sample were analyzed using an open‐source statistical package with customized code. Dimensionality reduction was required for processing the large datasets: eight of the 17 measured variables were selected based on inspection of the correlation matrix. Data from four subsamples from each of the 56 samples produced using “in‐house” methods were analyzed using ANOVA to assess the within‐ and between‐sample variation. High within‐sample variation was noted; however, ANOVA and post‐hoc Tukey's honestly significant difference (HSD) tests demonstrated that the between‐sample variation was substantially larger than the within‐sample variation. Each sample could be differentiated from all other samples in the test set. Future experiments will focus on ways to reduce the within‐sample variation, and additional statistical and microanalytical methods to classify sources and confidently constrain the method of Al powder manufacture.

Baldaino, JenaMarie↗

Recent Hydrodynamic Modeling Enhancements in OpenFAST

To improve the hydrodynamic modeling capabilities of the offshore wind design and modeling tool OpenFAST, a restructuring of the HydroDyn hydrodynamics module was undertaken with several new features implemented. The generation of the wave field is now separated from HydroDyn into a new module called SeaState. Unlike previous versions of HydroDyn, which precomputed the wave kinematics at the undisplaced positions of the hydrodynamic nodes, the new SeaState module computes the complete time history of the wave field at the vertices of a user-defined wave grid. During the simulation, the wave kinematics at any point within the grid can be efficiently interpolated, allowing the strip-theory wave loads to be evaluated based on the wave kinematics at the displaced structure position. A phase correction was also implemented for the potential-flow wave-exciting loads to account for large structure displacements. Several wave-stretching methods were implemented for the strip-theory solution along with a wave-load redistribution method that ensures smooth variation of the nodal loads as the nodes of a discrete hydrodynamic mesh enter and exit the water. The load smoothing is included to avoid the excitation of unphysical high-frequency structural vibration during hydroelastic simulations. The MacCamy-Fuchs diffraction correction for the strip-theory solution and the capability to insert a constrained NewWave into extreme stochastic sea states with directional spreading were also added. The present article documents the formulations of the new improvements to HydroDyn with example applications and numerical results.

constrained wave↗