Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

CFD-based design optimization of ducted hydrokinetic turbines

Abstract Hydrokinetic turbines extract kinetic energy from moving water to generate renewable electricity, thus contributing to sustainable energy production and reducing reliance on fossil fuels. It has been hypothesized that a duct can accelerate and condition the fluid flow passing the turbine blades, improving the overall energy extraction efficiency. However, no substantial evidence has been provided so far for hydrokinetic turbines. To investigate this problem, we perform a CFD-based optimization study with a blade-resolved Reynolds-averaged Navier–Stokes (RANS) solver to explore the design of a ducted hydrokinetic turbine that maximizes the efficiency of energy extraction. A gradient-based optimization approach is utilized to effectively deal with the high-dimensional design space of the blade and duct geometry, with gradients being calculated through the adjoint method. The final design is re-evaluated through higher-fidelity unsteady RANS (URANS) simulations. Our optimized ducted turbine achieves an efficiency of about 54% over a range of operating conditions, higher than the typical 46% efficiency of unducted turbines.

13 HYDRO ENERGY↗

Detection of topological materials with machine learning

Databases compiled using ab initio and symmetry-based calculations now contain tens of thousands of topological insulators and topological semimetals. This makes the application of modern machine learning methods to topological materials possible. Using gradient boosted trees, we show how to construct a machine learning model which can predict the topology of a given existent material with an accuracy of 90%. Such predictions are orders of magnitude faster than actual ab initio calculations. In this work, we use machine learning models to probe how different material properties affect topological features. Notably, we observe that topology is mostly determined by the “coarse-grained” chemical composition and crystal symmetry and depends little on the particular positions of atoms in the crystal lattice. We identify the sources of our model's errors and we discuss approaches to overcome them.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Prospects for the expansion of standing wave ambient pressure photoemission spectroscopy to reactions at elevated temperatures

Standing wave ambient pressure photoemission spectroscopy (SWAPPS) is a promising method to investigate chemical and potential gradients across solid-vapor and solid-liquid interfaces under close-to-realistic environmental conditions, far away from high vacuum. Until now, these investigations have been performed only near room temperature, but for a wide range of interfacial processes, chief among them being heterogeneous catalysis, measurements at elevated temperatures are required. One concern in these investigations is the temperature stability of the multilayer mirrors, which generate the standing wave field. At elevated temperatures, degradation of the multilayer mirror due to, for example, interdiffusion between the adjacent layers, decreases the modulation of the standing wave field, thus rendering SWAPPS experiments much harder to perform. Here, we show that multilayer mirrors consisting of alternate B4C and W layers are stable at temperatures exceeding 600 °C and are, thus, promising candidates for future studies of surface and subsurface species in heterogeneous catalytic reactions using SWAPPS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic minibatch approach to the ptychographic iterative engine

The ptychographic iterative engine (PIE) is a widely used algorithm that enables phase retrieval at nanometer-scale resolution over a wide range of imaging experiment configurations. By analyzing diffraction intensities from multiple scanning locations where a probing wavefield interacts with a sample, the algorithm solves a difficult optimization problem with constraints derived from the experimental geometry as well as sample properties. The effectiveness at which this optimization problem is solved is highly dependent on the ordering in which we use the measured diffraction intensities in the algorithm, and random ordering is widely used due to the limited ability to escape from stagnation in poor-quality local solutions. In this study, we introduce an extension to the PIE algorithm that uses ideas popularized in recent machine learning training methods, in this case minibatch stochastic gradient descent. Our results demonstrate that these new techniques significantly improve the convergence properties of the PIE numerical optimization problem.

47 OTHER INSTRUMENTATION↗

Scalable Second Order Optimization for Machine Learning

Many machine learning (ML) training tasks are essentially optimization processes that would at first glance appear eminently parallelizable and scalable. However, effective acceleration of these tasks with scalable parallel hardware has proven to be elusive. While standard methods for machine learning, e.g., stochastic gradient descent (SGD) for DNNs, tend to be resource efficient, they appear to be fundamentally sequential in nature.

97 MATHEMATICS AND COMPUTING↗

Beyond Magic Barrels: Digital manufacturing for crystallization, process development and optimization of explosive materials: Part II Resveratrol Exemplar

This SAND report summarizes work supported by an Engineering Sciences Research Foundation (ESRF) Lab Directed Research and Development (LDRD) project entitled “Beyond Magic Barrels: Digital manufacturing for crystallization, process development and optimization of explosive materials.” This SAND report is written in two parts with Part 1 discusses recrystallization of our explosive exemplar and Part 2 summarizing our work with recrystallization of resveratrol. We have studied resveratrol recrystallization with a multiscale approach combining experiments, modeling and simulation. At the single crystal scale, microscopy experiments illuminate crystal time-dependent growth rates using advanced image analysis. Bench scale experiments were carried out to look at growth of multiple particles in a small reactor creating thousands of particles and analyzing the results with microscopy and μCT. For the modeling we combine kinetic Monte Carlo (kMC) models with subscale information from density functional theory (DFT) or molecular dynamics. This work is discussed in Part 1 and can also be found in a paper from the project discussing a coarse-grained kMC model specifically developed for resveratrol. For well-mixed systems, we have population balance equations (PBE) linked with species mass conservation forming a set of ordinary differential equations that can be solved quickly. For more complicated geometries, such as the vat crystallization used throughout the complex, a coupled computational fluid dynamic (CFD)/PBE method was developed to account for gradients in temperature and concentration and differences in crystallization rates throughout the domain. These simulations are more complex and require high performance computing. We present results for two cases: 5% seed fast cool with parameters fit to the well-mixed case and 5% seed slow cool using the same parameters. We show reasonable agreement with experiments though are particles are significantly larger than the experiments.

36 MATERIALS SCIENCE↗

Prairie Strips and Lower Land Use Intensity Increase Biodiversity and Ecosystem Services

Agricultural landscapes can be managed to protect biodiversity and maintain ecosystem services. One approach to achieve this is to restore native perennial vegetation within croplands. Where rowcrops have displaced prairie, as in the US Midwest, restoration of native perennial vegetation can align with crops in so called “prairie strips.” We tested the effect of prairie strips in addition to other management practices on a variety of taxa and on a suite of ecosystem services. To do so, we worked within a 33-year-old experiment that included treatments that varied methods of agricultural management across a gradient of land use intensity. In the two lowest intensity crop management treatments, we introduced prairie strips that occupied 5% of crop area. We addressed three questions: (1) What are the effects of newly established prairie strips on the spillover of biodiversity and ecosystem services into cropland? (2) How does time since prairie strip establishment affect biodiversity and ecosystem services? (3) What are the tradeoffs and synergies among biodiversity conservation, non-provisioning ecosystem services, and provisioning ecosystem services (crop yield) across a land use intensity gradient (which includes prairie strips)? Within prairie strip treatments, where sampling effort occurred within and at increasing distance from strips, dung beetle abundance, spider abundance and richness, active carbon, decomposition, and pollination decreased with distance from prairie strips, and this effect increased between the first and second year. Across the entire land use intensity gradient, treatments with prairie strips and reduced chemical inputs had higher butterfly abundance, spider abundance, and pollination services. In addition, soil organic carbon, butterfly richness, and spider richness increased with a decrease in land use intensity. Crop yield in one treatment with prairie strips was equal to that of the highest intensity management, even while including the area taken out of production. We found no effects of strips on ant biodiversity and greenhouse gas emissions (N 2 O and CH 4 ). Our results show that, even in early establishment, prairie strips and lower land use intensity can contribute to the conservation of biodiversity and ecosystem services without a disproportionate loss of crop yield.

54 ENVIRONMENTAL SCIENCES↗

kemmerl4/LTER_prairie_strip_2019-2020: Data for: Prairie strips and lower land use intensity increase biodiversity and ecosystem services

Agricultural landscapes can be managed to protect biodiversity and maintain ecosystem services. One approach to achieve this is to restore native perennial vegetation within croplands. Where rowcrops have displaced prairie, as in the US Midwest, restoration of native perennial vegetation can align with crops in so called “prairie strips.” We tested the effect of prairie strips in addition to other management practices on a variety of taxa and on a suite of ecosystem services. To do so, we worked within a 33-year-old experiment that included treatments that varied methods of agricultural management across a gradient of land use intensity. In the two lowest intensity crop management treatments, we introduced prairie strips that occupied 5% of crop area. We addressed three questions: (1) What are the effects of newly established prairie strips on the spillover of biodiversity and ecosystem services into cropland? (2) How does time since prairie strip establishment affect biodiversity and ecosystem services? (3) What are the tradeoffs and synergies among biodiversity conservation, non-provisioning ecosystem services, and provisioning ecosystem services (crop yield) across a land use intensity gradient (which includes prairie strips)? Within prairie strip treatments, where sampling effort occurred within and at increasing distance from strips, dung beetle abundance, spider abundance and richness, active carbon, decomposition, and pollination decreased with distance from prairie strips, and this effect increased between the first and second year. Across the entire land use intensity gradient, treatments with prairie strips and reduced chemical inputs had higher butterfly abundance, spider abundance, and pollination services. In addition, soil organic carbon, butterfly richness, and spider richness increased with a decrease in land use intensity. Crop yield in one treatment with prairie strips was equal to that of the highest intensity management, even while including the area taken out of production. We found no effects of strips on ant biodiversity and greenhouse gas emissions (N 2 O and CH 4 ). Our results show that, even in early establishment, prairie strips and lower land use intensity can contribute to the conservation of biodiversity and ecosystem services without a disproportionate loss of crop yield.

54 ENVIRONMENTAL SCIENCES↗

Analytic Gradients for Equation-of-Motion Coupled Cluster with Single, Double, and Perturbative Triple Excitations

Understanding the process of molecular photoexcitation is crucial in various fields, including drug development, materials science, photovoltaics, and more. The electronic vertical excitation energy is a critical property, for example in determining the singlet-triplet gap of chromophores. However, a full understanding of excited-state processes requires additional explorations of the excited-state potential energy surface and electronic properties, which is greatly aided by the availability of analytic energy gradients. Owing to its robust high accuracy over a wide range of chemical problems, equation-of-motion coupled-cluster with single and double excitations (EOM-CCSD) is a powerful method for predicting excited state properties, and the implementation of analytic gradients of many EOM-CCSD (excitation energies, ionization potentials, electron attachment energies, etc.) along with numerous successful applications high- lights the flexibility of the method. In specific cases where a higher level of accuracy is needed or in more complex electronic structures, the inclusion of triple excitations becomes essential, for example, in the EOM-CCSD* approach of Saeh and Stanton. In this work, we derive and implement for the first time the analytic gradients of EOMEE-CCSD*, which also provides a template for analytic gradients of related ex- cited state methods with perturbative triple excitations. Here, the capabilities of analytic EOMEE-CCSD* gradients are illustrated by several representative examples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Methods of particle manipulation and analysis

Methods described herein, in some embodiments, permit extraction of particle structural and/or surface charge data from gradient induced particle motion in channels. In one aspect, a method of manipulating particle motion comprises introducing a fluid into a channel, the fluid comprising particles, and driving particle accumulation to a preselected location in the channel by setting advective velocity of the fluid to offset diffusiophoretic mobility of the particles at the preselected location.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Methods of particle manipulation and analysis

Methods described herein, in some embodiments, permit extraction of particle structural and/or surface charge data from gradient induced particle motion in channels. In one aspect, a method of manipulating particle motion comprises introducing a fluid into a channel, the fluid comprising particles, and driving particle accumulation to a preselected location in the channel by setting advective velocity of the fluid to offset diffusiophoretic mobility of the particles at the preselected location.

Ault, Jesse↗

Gradient process parameter optimization in additive friction stir deposition of aluminum alloys

As one of the most novel additive manufacturing methods, currently selection and optimization of processing parameters in additive friction stir deposition (AFSD) have mainly relied on experiments and subsequent characterization of microstructural and mechanical properties. Such approaches are both time- and resource-consuming. Therefore, an ultrasound elastography enhanced gradient process parameter optimization method was applied in the present work to obtain a window of optimized processing parameters for AFSD processing of aluminum alloy by varying both rotational and linear deposition speeds. Further, the quality of AFSD processed layer was investigated for physical nature of surface, dynamic elastic modulus, and microstructural aspects in cross-sections of the deposited layer. The efficiency in exploring process parameters was significantly enhanced by implementing a high-throughput screening experimental design based on application of gradient process parameters and continuous ultrasound elastographs. In addition, the applied ultrasonic elastography technique assisted in evaluating the homogeneity in microstructure and mechanical properties of AFSD sample over the entire gradients of the process parameters. The techniques adopted in current work can be further extended to identify suitable parameters for AFSD fabrication of components with desired mechanical properties such as hardness, fatigue, etc.

36 MATERIALS SCIENCE↗

Hybrid eigensolvers for nuclear configuration interaction calculations

We examine and compare several iterative methods for solving large-scale eigenvalue problems arising from nuclear structure calculations. In particular, we discuss the possibility of using block Lanczos method, a Chebyshev filtering based subspace iterations and the residual minimization method accelerated by direct inversion of iterative subspace (RMM-DIIS) and describe how these algorithms compare with the standard Lanczos algorithm and the locally optimal block preconditioned conjugate gradient (LOBPCG) algorithm. Although the RMM-DIIS method does not exhibit rapid convergence when the initial approximations to the desired eigenvectors are not sufficiently accurate, it can be effectively combined with either the block Lanczos or the LOBPCG method to yield a hybrid eigensolver that has several desirable properties. We will describe a few practical issues that need to be addressed to make the hybrid solver efficient and robust.

97 MATHEMATICS AND COMPUTING↗

A Differentiable Hydrology Approach for Modeling With Time-Varying Parameters

In the analysis of observational data with mathematical models, it is often desirable to let one or more model parameters vary with time to account for changing environmental conditions or to offer more flexibility. A standard approach for dynamic models is to allow for the number of parameters to grow as a function of time, leading to a high-dimensional inference problem for long data records. We propose using Hamiltonian Monte Carlo, a gradient-based Markov chain Monte Carlo (MCMC) method, to perform Bayesian inference for time-varying parameters (TVP) in hydrology models. As derivatives of model error functions with regard to parameters are not available in closed form, we implemented the GR4J rainfall-runoff models in Theano/PyMC3, and Jax/NumPyro, allowing for the application of automatic differentiation techniques. A simulation experiment assessing the viability of these methods for recovering underlying temporal variation in parameters indicates that a discrete Gaussian random walk-based prior appears to be best suited across a range of scenarios while the continuous-time Gaussian process compares relatively poorly. In an analysis of 20 years of daily real-world streamflow records from the Model Parameter Estimation Experiment (MOPEX) hydrology data set with increasing data sparsity and at multiple temporal resolutions, we find that TVP inference with gradient-based MCMC is a flexible and reliable approach for analyzing hydrology models with dynamic parameter sets.

54 ENVIRONMENTAL SCIENCES↗

Nuclear–Electronic Orbital QM/MM Approach: Geometry Optimizations and Molecular Dynamics

Hybrid quantum mechanical/molecular mechanical (QM/MM) methods allow simulations of chemical reactions in atomistic solvent and heterogeneous environments such as proteins. Herein, the nuclear–electronic orbital (NEO) QM/MM approach is introduced to enable the quantization of specified nuclei, typically protons, in the QM region using a method such as NEO-density functional theory (NEO-DFT). This approach includes proton delocalization, polarization, anharmonicity, and zero-point energy in geometry optimizations and dynamics. Expressions for the energies and analytical gradients associated with the NEO-QM/MM method, as well as the previously developed polarizable continuum model (NEO-PCM), are provided. Geometry optimizations of small organic molecules hydrogen bonded to water in either dielectric continuum solvent or explicit atomistic solvent illustrate that aqueous solvation can strengthen hydrogen-bonding interactions for the systems studied, as indicated by shorter intermolecular distances at the hydrogen-bond interface. We then performed a real-time direct dynamics simulation of a phenol molecule in explicit water using the NEO-QM/MM method. Furthermore, these developments and initial examples provide the foundation for future studies of nuclear–electronic quantum dynamics in complex chemical and biological environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Efficient kinetic thermal inverse modeling for organic material decomposition

The prevalent use of organic materials in manufacturing is a fire safety concern, and motivates the need for predictive thermal decomposition models. A critical component of predictive modeling is numerical inference of kinetic parameters from bench scale data. Currently, an active area of computational pyrolysis research focuses on identifying efficient, robust methods for optimization. This paper demonstrates that kinetic parameter calibration problems can successfully be solved using classical gradient-based optimization. We explore calibration examples that exhibit characteristics of concern: high nonlinearity, high dimensionality, complicated schemes, overlapping reactions, noisy data, and poor initial guesses. The examples demonstrate that a simple, non-invasive change to the problem formulation can simultaneously avoid local minima, avoid computation of derivative matrices, achieve a computational efficiency speedup of 10x, and make optimization robust to perturbations of parameter components. Techniques from the mathematical optimization and inverse problem communities are employed. By re-examining gradient-based algorithms, we highlight opportunities to develop kinetic parameter calibration methods that should outperform current methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Detecting Anomalous Images in Astronomical Datasets

Abstract Environmental and instrumental conditions can cause anomalies in astronomical images, which can potentially bias all kinds of measurements if not excluded. Detection of the anomalous images is usually done by human eyes, which is slow and sometimes not accurate. This is an important issue in weak lensing studies, particularly in the era of large-scale galaxy surveys, in which image qualities are crucial for the success of galaxy shape measurements. In this work we present two automatic methods for detecting anomalous images in astronomical data sets. The anomalous features can be divided into two types: one is associated with the source images, and the other appears on the background. Our first method, called the entropy method, utilizes the randomness of the orientation distribution of the source shapes and the background gradients to quantify the likelihood of an exposure being anomalous. Our second method involves training a neural network (autoencoder) to detect anomalies. We evaluate the effectiveness of the entropy method on the Canada–France–Hawaii Telescope Lensing Survey (CFHTLenS) and Dark Energy Camera Legacy Survey (DECaLS DR3) data. In CFHTLenS, with 1171 exposures, the entropy method outperforms human inspection by detecting 12 of the 13 anomalous exposures found during human inspection and uncovering 10 new ones. In DECaLS DR3, with 17112 exposures, the entropy method detects a significant number of anomalous exposures while keeping a low false-positive rate. We find that although the neural network performs relatively well in detecting source anomalies, its current performance is not as good as the entropy method.

Astronomy & Astrophysics↗

A combined ensemble-volume average homogenization method for lattice structures with defects under dynamic and static loading

In the study of lattices structures, both experiments and numerical simulations are often conducted with small samples. Using combined ensemble and volume averaging, this work introduces a method to extract a macroscopic constitutive response of a lattice material from numerical simulations performed in periodic domains. The domain size needed to obtain statistically accurate results is investigated. Similar to molecular dynamics, the concept of the virial stress is introduced after homogenized equations are derived using the ensemble averaging method. Under static conditions, the virial stress is shown to agree with the volume averaged solid stress. Using the homogenization method, constitutive relations for this stress can be obtained from systems with uniform strains. Application of such obtained constitutive relations to more general cases results in an error proportional to the square of the ratio between the lattice length scale and the macroscopic length scale. Taking advantage of this property, numerical simulations are performed in systems with a uniform gradient of the average velocity. The volume average method is then used to accelerate convergence when studying lattices with defects. To avoid the artificial numerical time scale from the size of a representative volume element divided by the wave speed, a numerical scheme is developed to enforce a spatially uniform velocity gradient within the computational domain while allowing fluctuations of the velocity or displacement to develop naturally. To account for probability distribution of lattice defects, the stress is calculated as the ensemble-volume averaged value. For dynamic systems, energy dissipation properties are also studied.

36 MATERIALS SCIENCE↗