Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Revealing Defect-Seeded and Interfacial Generation Mechanisms of Photoinduced Coherent Phonons with 4D Ultrafast Electron Microscopy

Ultrafast photoexcitation of coherent phonons is driven by an impulsive, collective displacement of constituent atoms from their average equilibrium lattice positions [1]. Models describing the generation of coherent acoustic modes typically invoke the creation of an anisotropic strain profile arising from the relatively instantaneous absorption of an ultrafast laser pulse [2]. If the skin depth is shallow relative to the specimen thickness, a steep tensile strain gradient perpendicular to the surface ($\frac{∂ε}{∂z}$) results. Initial relaxation occurs via rapid contraction of the surface layers followed by subsequent coherent oscillations of the lattice and launch of a train of coherent elastic strain waves [i.e., coherent acoustic phonons (CAPs)]. Macroscopically, responses are generally well-described by constitutive relations as gleaned from data gathered using ultrasonic methods or ultrafast spectroscopies. Furthermore, at the atomic to nanoscale level, individual lattice discontinuities and their impact on CAP behaviors can be modeled using multiscale methods [3,4]. Further, average unit-cell level responses on ultrafast timescales can be probed using femtosecond electron and X-ray scattering [5,6].

Flannigan, David J. [University of Minnesota, Minn↗

Stellar Abundance Maps of the Milky Way Disk

To understand the formation of the Milky Way's prominent bar it is important to know whether stars in the bar differ in the chemical element composition of their birth material as compared to disk stars. This requires stellar abundance measurements for large samples across the Milky Way's body. Such samples, e.g., luminous red giant stars observed by the Sloan Digital Sky Survey's APOGEE survey, will inevitably span a range of stellar parameters; as a consequence, both modeling imperfections and stellar evolution may preclude consistent and precise estimates of their chemical composition at a level of purported bar signatures, which has left current analyses of a chemically distinct bar inconclusive. Here, we develop a new self-calibration approach to eliminate both modeling and astrophysical abundance systematics among red giant branch (RGB) stars of different luminosities (and hence surface gravity $\mathrm{log} g$). We apply our method to 48,853 luminous APOGEE Data Release 16 RGB stars to construct spatial abundance maps of 20 chemical elements near the Milky Way's mid-plane, covering galactocentric radii of 0 kpc < R GC < 20 kpc. Our results indicate that there are no abundance variations whose geometry matches that of the bar, and that the mean abundance gradients vary smoothly and monotonically with galactocentric radius. We confirm that the high-α disk is chemically homogeneous, without spatial gradients. Furthermore, we present the most precise [Fe/H] versus R GC gradient to date with a slope of – 0.057 ±0.001 dex kpc –1 out to approximately 15 kpc.

79 ASTRONOMY AND ASTROPHYSICS↗

Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model

This paper proposes a new method that combines checkpointing methods with error-controlled lossy compression for large-scale high-performance full-waveform inversion (FWI), an inverse problem commonly used in geophysical exploration. This combination can significantly reduce data movement, allowing a reduction in run time as well as peak memory. In the exascale computing era, frequent data transfer (e.g., memory bandwidth, PCIe bandwidth for GPUs, or network) is the performance bottleneck rather than the peak FLOPS of the processing unit. Like many other adjoint-based optimization problems, FWI is costly in terms of the number of floating-point operations, large memory footprint during backpropagation, and data transfer overheads. Past work for adjoint methods has developed checkpointing methods that reduce the peak memory requirements during backpropagation at the cost of additional floating-point computations. Combining this traditional checkpointing with error-controlled lossy compression, we explore the three-way tradeoff between memory, precision, and time to solution. We investigate how approximation errors introduced by lossy compression of the forward solution impact the objective function gradient and final inverted solution. Empirical results from these numerical experiments indicate that high lossy-compression rates (compression factors ranging up to 100) have a relatively minor impact on convergence rates and the quality of the final solution.

58 GEOSCIENCES↗

Evaluating proxies for the drivers of natural gas productivity using machine-learning models

We report the extensive development of unconventional reservoirs using horizontal drilling and multistage hydraulic fracturing has generated large volumes of reservoir characterization and production data. The analysis of this abundant data using statistical methods and advanced machine-learning (ML) techniques can provide data-driven insights into well performance. Most predictive modeling studies have focused on the impact that different well completion and stimulation strategies have on well production but have not fully exploited the available in situ rock property data to determine its role in reservoir productivity. We have used machine-learning techniques to rank rock mechanical properties, microseismic attributes, and stimulation parameters in the order of their significance for predicting natural gas production from an unconventional reservoir. The data for this study came from a hydraulically fractured well in the Marcellus Shale in Monongalia County, West Virginia. The data classes included measurements aggregated by well completion stage that included (1) gas production, (2) well-log-derived measurements including bulk density, elastic moduli, shear impedance, compressional impedance, brittleness, and gamma measurements, (3) microseismic attributes, (4) long-period long-duration (LPLD) event counts, (5) fracture counts, and (6) stimulation parameters that included the fluid injection volume and average pumping pressure. To identify observable proxies for the drivers of gas production, we evaluated five commonly used ML approaches including multivariate adaptive regression spline, Gaussian mixture model, random forest, gradient boosting, and neural network. We selected five variables including LPLD event count, seismogenic b-value, hydraulic diffusivity, cumulative moment, and fluid volume as the features most likely to impact gas productivity at the stage level in the study area. The data-driven selection of these parameters for their importance in determining gas production can help reservoir engineers design more effective hydraulic-fracture treatments in the Marcellus Shale and other similar unconventional reservoirs. Plain language summary: We use machine-learning methods and data-driven selection of reservoir parameters to rank and better understand their importance in determining gas production, which can help reservoir engineers design more effective hydraulic-fracture treatments in the Marcellus Shale and other similar unconventional reservoirs.

58 GEOSCIENCES↗

GAAF: Searching Activation Functions for Binary Neural Networks Through Genetic Algorithm

Binary neural networks (BNNs) show promising utilization in cost and power-restricted domains such as edge devices and mobile systems. This is due to its significantly less computation and storage demand, but at the cost of degraded performance. To close the accuracy gap, in this paper we propose to add a complementary activation function (AF) ahead of the sign based binarization, and rely on the genetic algorithm (GA) to automatically search for the ideal AFs. These AFs can help extract extra information from the input data in the forward pass, while allowing improved gradient approximation in the backward pass. Fifteen novel AFs are identified through our GA-based search, while most of them show improved performance (up to 2.54% on ImageNet) when testing on different datasets and network models. Interestingly, periodic functions are identified as a key component for most of the discovered AFs, which rarely exist in human designed AFs. Our method offers a novel approach for designing general and application-specific BNN architecture.

59 BASIC BIOLOGICAL SCIENCES↗

Numerical Investigation of Susceptor-Catalyst Design for Ethylene Generation in Radio Frequency Based Reactors

Ethylene is the most widely produced petrochemical component in the world. Whether reactors are heated directly or indirectly via steam, manufacturers use economies of scale to overcome inherent thermodynamic inefficiencies when burning fossil fuels. While allowing large-scale operations to use alternative sources of energy and raw materials, new methods of supplying energy to chemical reactor systems can reduce the energy waste produced by conventional processes. One viable method for effectively supplying energy to reactor systems is electromagnetic (EM) induction heating. Using the properties of radio frequency (RF) waves, heterogeneous catalysts can be precisely targeted for heating inside reactors. Site-selective heating can greatly lower the energy requirements of the process by supplying heat to reaction sites while reducing needless heat transfer elsewhere. In this study, a microscale model was used to help create guidelines for susceptors and catalysts to improve ethylene production. The oxidative dehydrogenation of ethane is investigated by utilizing several catalysts and potential catalyst/susceptor combinations, with heat provided by an EM susceptor. Having the susceptors and catalyst function separately results in higher gradients in both heat and mass transfer, which drives transport through the catalyst region, while still providing adequate heating for endothermic reactions. However, using a susceptive core with a catalyst covering produces the maximum ethylene concentration.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Comparison of Infectious Disease Forecasting Methods across Locations, Diseases, and Time

Accurate infectious disease forecasting can inform efforts to prevent outbreaks and mitigate adverse impacts. This study compares the performance of statistical, machine learning (ML), and deep learning (DL) approaches in forecasting infectious disease incidences across different countries and time intervals. We forecasted three diverse diseases: campylobacteriosis, typhoid, and Q-fever, using a wide variety of features (n = 46) from public datasets, e.g., landscape, climate, and socioeconomic factors. We compared autoregressive statistical models to two tree-based ML models (extreme gradient boosted trees [XGB] and random forest [RF]) and two DL models (multi-layer perceptron and encoder–decoder model). The disease models were trained on data from seven different countries at the region-level between 2009–2017. Forecasting performance of all models was assessed using mean absolute error, root mean square error, and Poisson deviance across Australia, Israel, and the United States for the months of January through August of 2018. The overall model results were compared across diseases as well as various data splits, including country, regions with highest and lowest cases, and the forecasted months out (i.e., nowcasting, short-term, and long-term forecasting). Overall, the XGB models performed the best for all diseases and, in general, tree-based ML models performed the best when looking at data splits. There were a few instances where the statistical or DL models had minutely smaller error metrics for specific subsets of typhoid, which is a disease with very low case counts. Feature importance per disease was measured by using four tree-based ML models (i.e., XGB and RF with and without region name as a feature). The most important feature groups included previous case counts, region name, population counts and density, mortality causes of neonatal to under 5 years of age, sanitation factors, and elevation. This study demonstrates the power of ML approaches to incorporate a wide range of factors to forecast various diseases, regardless of location, more accurately than traditional statistical approaches.

59 BASIC BIOLOGICAL SCIENCES↗

Calibration of elastoplastic constitutive model parameters from full-field data with automatic differentiation-based sensitivities

Here, we present a framework for calibration of parameters in elastoplastic constitutive models that is based on the use of automatic differentiation (AD). The model calibration problem is posed as a partial differential equation-constrained optimization problem where a finite element (FE) model of the coupled equilibrium equation and constitutive model evolution equations serves as the constraint. The objective function quantifies the mismatch between the displacement predicted by the FE model and full-field digital image correlation data, and the optimization problem is solved using gradient-based optimization algorithms. Forward and adjoint sensitivities are used to compute the gradient at considerably less cost than its calculation from finite difference approximations. Through the use of AD, we need only to write the constraints in terms of AD objects, where all of the derivatives required for the forward and inverse problems are obtained by appropriately seeding and evaluating these quantities. We present three numerical examples that verify the correctness of the gradient, demonstrate the AD approach's parallel computation capabilities via application to a large-scale FE model, and highlight the formulation's ease of extensibility to other classes of constitutive models.

42 ENGINEERING↗

Investigation of grain size and geometrically necessary dislocation density dependence of flow stress in Mg-4Al by using nanoindentation

Models for grain size dependence of flow stress typically ignore contributions from geometrically necessary dislocations (GNDs) in the grain boundary regions. Ashby had proposed the following equation for flow stress (τ) as a function of grain size (d) and effective plastic strain ($\bar{ε}$): $τ = τ_{0} + C'G\sqrt{^{b\bar{ε}}_{d}}$ using an unknown empirical coefficient, C’, In this study, the coefficient, C’, and equation for the grain size dependence of flow stress were investigated in Mg-4Al using nanoindentation. C’ ranges from 1.4 to 7.11 that is related to the hardness difference (∆H0) between the adjacent grains as $C' + 0.62\sqrt{ΔH_{0}}$. Ashby equation was used to predict uniaxial stress-strain curves in grain sizes of 55 µm, 187 µm, and 333 µm. The results showed lower flow stress and lower hardening rate compared to experimentally measured tensile stress-strain response. The discrepancy seems to be a result of hardening effect of SSDs. Here, we propose a modified Ashby equation that takes into account the hardening effect of SSDs and GNDs separately, resulting in a better agreement between calculated and experimentally measured values. This analysis demonstrates estimation of uniaxial stress-strain response using nanoindentation measurements that captures effects of grain size, and strain hardening from SSDs and GNDs. The combination of the revised equation and nanoindentation method will enable rapid exploration of stress-strain response of a diverse range of single-phase polycrystalline alloys.

36 MATERIALS SCIENCE↗

Verification of a fully implicit particle-in-cell method for the <!--${MathJax: TeX-AMS-MML_HTMLorMML}--> v &#x2225; -formalism of electromagnetic gyrokinetics in the XGC code

A fully implicit particle-in-cell method for handling the v ∥ -formalism of electromagnetic gyrokinetics has been implemented in XGC. By choosing the v ∥ -formalism, here we avoid introducing the nonphysical skin terms in Ampère's law, which are responsible for the well-known “cancellation problem” in the p ∥ -formalism. The v ∥ -formalism, however, is known to suffer from a numerical instability when explicit time integration schemes are used due to the appearance of a time derivative in the particle equations of motion from the inductive component of the electric field. Here, using the conventional δf scheme, we demonstrate that our implicitly discretized algorithm can provide numerically stable simulation results with accurate dispersive properties. We verify the algorithm using a test case for shear Alfvén wave propagation in addition to a case demonstrating the ion temperature gradient-kinetic ballooning mode (ITG-KBM) transition. The ITG-KBM transition case is compared to results obtained from other δf gyrokinetic codes/schemes, whose verification has already been archived in the literature.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Advances and challenges in CO2 foam technologies for enhanced oil recovery in carbonate reservoirs

Utilization of surfactants for generating foam has the potential for fluid-mobility control during CO2 flooding processes, leading to improved oil recovery. This manuscript is a review of the most important aspects for the design of CO2-foams with mobility control in carbonate reservoirs, including recent advances in novel surfactants and analytical techniques for analysis of surfactant adsorption on carbonate minerals and their thermal stability. Several key parameters and properties regarding foam transport in porous media are reviewed such as, the minimum pressure gradient required for foam generation, the effects of the partition coefficient of a CO2-soluble surfactant on foam transport in rock cores, visualization of foam flow by either microfluidic or PET/CT imaging processes in heterogeneous or fractured systems and the effect of oil on foam transport under reservoir conditions. Also are discussed the most recent advances of two major foam modeling methods, including the semi-empirical STARS foam model and the population balance model, as well as CO2 foam pilot tests and the factors governing their successes.

Jian, Guoqing↗

Predicting the formation of fractionally doped perovskite oxides by a function-confined machine learning method

Abstract Fractionally doped perovskites oxides (FDPOs) have demonstrated ubiquitous applications such as energy conversion, storage and harvesting, catalysis, sensor, superconductor, ferroelectric, piezoelectric, magnetic, and luminescence. Hence, an accurate, cost-effective, and easy-to-use methodology to discover new compositions is much needed. Here, we developed a function-confined machine learning methodology to discover new FDPOs with high prediction accuracy from limited experimental data. By focusing on a specific application, namely solar thermochemical hydrogen production, we collected 632 training data and defined 21 desirable features. Our gradient boosting classifier model achieved a high prediction accuracy of 95.4% and a high F1 score of 0.921. Furthermore, when verified on additional 36 experimental data from existing literature, the model showed a prediction accuracy of 94.4%. With the help of this machine learning approach, we identified and synthesized 11 new FDPO compositions, 7 of which are relevant for solar thermochemical hydrogen production. We believe this confined machine learning methodology can be used to discover, from limited data, FDPOs with other specific application purposes.

08 HYDROGEN↗

From Optimization to Sampling Through Gradient Flows

Optimization and sampling algorithms play a central role in science and engineering as they enable finding optimal predictions, policies, and recommendations, as well as expected and equilibrium states of complex systems. The notion of “optimality” is formalized by the choice of an objective function, while the notion of an “expected” state is specified by a probabilistic model for the distribution of states. Optimizing rugged objective functions and sampling multimodal distributions is computationally challenging, especially in high-dimensional problems. Here, for this reason, many optimization and sampling methods have been developed by researchers working in disparate fields such as Bayesian statistics, molecular dynamics, genetics, quantum chemistry, machine learning, weather forecasting, econometrics, and medical imaging.

Trillos, N. García↗

Evaluation of riverbed magnetic susceptibility for mapping biogeochemical hot spots in groundwater‐impacted rivers

Abstract Redox hot spots occurring as metal‐rich anoxic groundwater discharges through oxic wetland and river sediments commonly result in the formation of iron (Fe) oxide precipitates. These redox‐sensitive precipitates influence the release of nutrients and metals to surface water and can act as ‘contaminant sponges’ by absorbing toxic compounds. We explore the feasibility of a non‐invasive, high‐resolution magnetic susceptibility (MS) technique to efficiently map the spatial variations of magnetic Fe oxide precipitates in the shallow bed of three rivers impacted by anoxic groundwater discharge. Laboratory analyses on Mashpee River (MA, USA) sediments demonstrate the sensitivity of MS to sediment Fe concentrations. Field surveys in the Mashpee and Quashnet rivers (MA, USA) reveal several discrete high MS zones, which are associated with likely anoxic groundwater discharge as evaluated by riverbed temperature, vertical head gradient, and groundwater chemistry measurements. In the East River (CO, USA), widespread cobbles/rocks exhibit high background MS from geological ferrimagnetic minerals, thereby obscuring the relatively small enhancement of MS from groundwater induced Fe oxide precipitates. Our study suggests that, in settings with low geological sources of magnetic minerals such as lowland rivers and wetlands, MS may serve as a complementary tool to temperature methods for efficiently mapping Fe oxide accumulation zones due to anoxic groundwater discharges that may function as biogeochemical hot spots and water quality control points in gaining systems.

Wang, Chen↗

Application of unsupervised deep learning to image segmentation and in-situ contact angle measurements in a CO 2 -water-rock system

Rock surface wettability is a critical property that regulates multiphase flows in porous media, which can be quantified using the surface contact angle (CA). X-ray micro-computed tomography (μCT) provides an effective approach to in-situ measurements of surface CAs. However, the CA measurement accuracy depends significantly on the quality of CT image segmentation, which is the clustering of CT pixels into separate phases. Inspired by this, we developed a deep learning (DL)-based CA measurement workflow. Motivated by the recent tremendous progress in unsupervised learning techniques and aiming to avoid expensive manual data annotations, an unsupervised DL pipeline for CT image segmentation was proposed and implemented, which includes unsupervised model training and post-processing. The unsupervised model training was driven by a novel loss function constrained with feature similarity and spatial continuity and implemented by iterative forward and backward paths; the former clustered the pixel-wise feature vectors extracted by convolution neural networks, whereas the latter updated the parameters using gradient descent. An over-segmentation strategy was adopted for model training. The post-processing steps based on agglomerative hierarchical clustering (AHC) were implemented to further merge the over-segmented model output to the desired cluster number, which is intended to improve the efficiency of image segmentation. The developed unsupervised DL pipeline was compared with other commonly-used image segmentation methods using pixel-wise and physics-based evaluation metrics on a synthetic raw-image dataset, which had a known ground truth. The unsupervised DL pipeline showed the best performance. Next, the segmented images were input to an automatic CA measurement tool, and the results were validated by comparisons with manual measurements. The CA values from the manual and automatic measurements showed similar distributions and statistical properties. The automatic measurement demonstrated a wider spectrum because of the much larger number of measurement data points. The primary novelty of the unsupervised DL pipeline developed in this study lies in the novel loss function and the over-segmentation strategy associated with AHC post-processing. Finally, the workflow has been proven an efficient tool for pore-scale wettability characterization, which has a wide range of applications in fundamental studies of multiphase flows in natural porous media, which have critical implications to geological carbon sequestration, hydrocarbon energy recovery, and contaminant transport in groundwater.

42 ENGINEERING↗

Numerical simulation of evaporating wavy falling liquid films in laminar gas streams

Numerical simulations are performed to investigate the interfacial heat and mass transfer from evaporating wavy falling liquid films in interaction with laminar gas streams. The OpenFOAM solver has been used to conduct the simulations where the liquid-gas interface is resolved using the Volume of Fluid method of solving for three phases, i.e., liquid, vapor, and air. The configuration considered is a falling liquid (water) film on a heated vertical plate with a confined laminar moist air (gas) flow that is either (a) co-current or (b) counter-current to the downward liquid flow. The evaporation at the liquid-gas interface is driven by the interfacial gradient of the vapor mass fraction. Interfacial waves are triggered using a monochromatic forcing disturbance that leads to sinusoidal or solitary waves forming at the liquid-gas interface under respective forcing frequencies. Further, the numerical model is validated with the available experimental data. The results show nearly a 15% enhancement in time-averaged Sherwood number (Sh) due to film waviness (sinusoidal or solitary) at the lower volumetric gas flow rate, Q g = +50 (co-current) and Q g = -50 (counter-current). This enhancement in the Sh for both the waves further increases by 11% with Q g = +800 and 196% with Q g = -800. A closer examination of the mass transfer process over a wave demonstrates that with Q g = +50, the concentration of the gas side streamlines at the trough locations of the wave leads to higher values of Sh at these locations. However, with Q g = +800, although the overall Sh increases, vortices appear at the wave trough locations, leading to a corresponding decrease in the local Sh values. Correlations are proposed for predicting Sh under co-current and counter-current gas flow effects.

36 MATERIALS SCIENCE↗

Explaining an unusual electromigration behavior—A comprehensive experimental and theoretical analysis using finite element method

In metallic interconnects, it is generally assumed that electromigration (EM) failure location is independent of the applied electrical current and always occurs at the highest-current-density area. Our experiments show otherwise. We designed an Al interconnect that alters its failure location by only varying the applied current density. The failure occurs near the high for a current above 2 × 10 7 A/cm 2 , but at a location with 59% of the maximum for lower current densities. Thermoreflectance thermal imaging is employed to gather time-dependent high-resolution spatial temperature distributions of the Al interconnect during EM. More importantly, we propose a computationally inexpensive 2D finite element method that tracks EM evolution in time and matches well with the observations from different experimental conditions. A detailed analysis covering the major driving forces of EM is carried out to understand the complex physics behind EM. The atomic depletion rate contributed by each force is quantitatively studied. By examining the results from every tested experimental condition, the model reveals that the temperature gradient is the key reason causing atomic depletion near the failure location. Graphical illustrations and qualitative analysis are provided to intuitively show the key findings of our work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Understanding the chemical bonding of ground and excited states of HfO and HfB with correlated wavefunction theory and density functional approximations

Knowledge of the chemical bonding of HfO and HfB ground and low-lying electronic states provides essential insights into a range of catalysts and materials that contain Hf–O or Hf–B moieties. Here, we carry out high-level multi-reference configuration interaction theory and coupled cluster quantum chemical calculations on these systems. We compute full potential energy curves, excitation energies, ionization energies, electronic configurations, and spectroscopic parameters with large quadruple-ζ and quintuple-ζ quality correlation consistent basis sets. We also investigate equilibrium chemical bonding patterns and effects of correlating core electrons on property predictions. Differences in the ground state electron configuration of HfB(X 4 Σ - ) and HfO(X 1 Σ + ) lead to a significantly stronger bond in HfO than HfB, as judged by both dissociation energies and equilibrium bond distances. We extend our analysis to the chemical bonding patterns of the isovalent HfX (X = O, S, Se, Te, and Po) series and observe similar trends. We also note a linear trend between the decreasing value of the dissociation energy (D e ) from HfO to HfPo and the singlet–triplet energy gap (ΔE S–T ) of the molecule. Finally, we compare these benchmark results to those obtained using density functional theory (DFT) with 23 exchange–correlation functionals spanning multiple rungs of “Jacob’s ladder.” When comparing DFT errors to coupled cluster reference values on dissociation energies, excitation energies, and ionization energies of HfB and HfO, we observe semi-local generalized gradient approximations to significantly outperform more complex and high-cost functionals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗