Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradients”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Machine Learning Moment Closure Models for the Radiative Transfer Equation III: Enforcing Hyperbolicity and Physical Characteristic Speeds

This is the third paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation. In our previous work (Huang et al. in J Comput Phys 453:110941, 2022), we proposed an approach to learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, while the ML moment closure has better accuracy, it is not able to guarantee hyperbolicity and has issues with long time stability. In our second paper (Huang et al., in: Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures, 2021. arXiv:2105.14410), we identified a symmetrizer which leads to conditions that enforce that the gradient based ML closure is symmetrizable hyperbolic and stable over long time. The limitation of this approach is that in practice the highest moment can only be related to four, or fewer, lower moments. In this paper, we propose a new method to enforce the hyperbolicity of the ML closure model. Motivated by the observation that the coefficient matrix of the closure system is a lower Hessenberg matrix, we relate its eigenvalues to the roots of an associated polynomial. Here, we design two new neural network architectures based on this relation. The ML closure model resulting from the first neural network is weakly hyperbolic and guarantees the physical characteristic speeds, i.e., the eigenvalues are bounded by the speed of light. The second model is strictly hyperbolic and does not guarantee the boundedness of the eigenvalues. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, stability and generalizability of our hyperbolic ML closure model.

97 MATHEMATICS AND COMPUTING↗

Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization

Here, we consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling quasi-Newton method where we estimate the gradients using finite differences of stochastic function evaluations within a common random number framework. We develop modified versions of a norm test and an inner product quasi-Newton test to control the sample sizes used in the stochastic approximations and provide global convergence results to the neighborhood of a locally optimal solution. We present numerical experiments on simulation optimization problems to illustrate the performance of the proposed algorithm. When compared with classical zeroth-order stochastic gradient methods, we observe that our strategies of adapting the sample sizes significantly improve performance in terms of the number of stochastic function evaluations required.

97 MATHEMATICS AND COMPUTING↗

Seasonal variation of the surface cross-shelf exchange in the northern South China Sea: a Lagrangian perspective

Previous studies on cross-shelf exchange, predominantly adopted an Eulerian perspective, struggled to identify water sources and pathways. Using a high-resolution regional ocean modeling system (ROMS) and Lagrangian particle tracking, this study systematically investigates the seasonal variation and dynamics of surface cross-shelf exchange in the northern South China Sea (NSCS) from a Lagrangian perspective. Based on daily released 30-day drifter trajectories we identify the key pathways, source regions for surface cross-shelf exchange, revealing pronounced seasonal variability. Results show the surface cross-shelf exchange generally following monsoon-driven Ekman transport. However, local dynamics, especially topographic modulation, can outweigh the expected Ekman-driven transport, producing surface exchange patterns opposite to that predicted from the prevailing winds. Topographic effects vary across different scales. In the coastal waters of western Guangdong during winter, despite downwelling-favorable winds, the modulation of alongshore currents by island topography induces an eastward pressure gradient. This gradient, through geostrophic balance, drives offshore flows opposite to wind-driven Ekman onshore transport. Furthermore, the eastern widened shelf exhibits a distinct seasonal variation of cross-shelf exchange, with strong offshore transport (opposite to the direction of Ekman transport) in winter and exceedingly weak exchange in summer. Analysis of the underlying mechanisms reveals that this winter offshore transport is primarily attributed to geostrophic flows driven by surface pressure gradient that is jointly modulated by the Kuroshio intrusion and local widened shelf topography, and enhanced by cumulative submesoscale processes. In summer, a persistent and strong along-isobath jet acts as a dynamic barrier, effectively suppressing the exchange. These findings highlight the important role of topography in regulating surface material transport, and have important implications for predicting the advection and dispersion of plankton or oil spills over the continental shelf influenced by monsoon.

Hao, Dongliang↗

Error-mitigated data-driven circuit learning on noisy quantum hardware

Application-level benchmarks measure how well a quantum device performs meaningful calculations. In the case of parameterized circuit training, the computational task is the preparation of a target quantum state via optimization over a loss landscape. This is complicated by various sources of noise, fixed hardware connectivity, and generative modeling, the choice of target distribution. Gradient-based training has become a useful benchmarking task for noisy intermediate-scale quantum computers because of the additional requirement that the optimization step uses the quantum device to estimate the loss function gradient. In this work, we use gradient-based data-driven circuit learning to qualitatively evaluate the performance of several superconducting platform devices and present results that show how error mitigation can improve the training of quantum circuit Born machines with 28 tunable parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Subtleties in the trainability of quantum machine learning models

A new paradigm for data science has emerged, with quantum data, quantum models, and quantum computational devices. This field, called quantum machine learning (QML), aims to achieve a speedup over traditional machine learning for data analysis. However, its success usually hinges on efficiently training the parameters in quantum neural networks, and the field of QML is still lacking theoretical scaling results for their trainability. Some trainability results have been proven for a closely related field called variational quantum algorithms (VQAs). While both fields involve training a parametrized quantum circuit, there are crucial differences that make the results for one setting not readily applicable to the other. In this work, we bridge the two frameworks and show that gradient scaling results for VQAs can also be applied to study the gradient scaling of QML models. Our results indicate that features deemed detrimental for VQA trainability can also lead to issues such as barren plateaus in QML. Consequently, our work has implications for several QML proposals in the literature. In addition, we provide theoretical and numerical evidence that QML models exhibit further trainability issues not present in VQAs, arising from the use of a training dataset. We refer to these as dataset-induced barren plateaus. These results are most relevant when dealing with classical data, as here the choice of embedding scheme (i.e., the map between classical data and quantum states) can greatly affect the gradient scaling.

97 MATHEMATICS AND COMPUTING↗

Development of grain-scale slip activity and lattice rotation fields in Inconel 718

Using a combination of in-situ high-resolution digital image correlation (HR-DIC), Heaviside-DIC method (H-DIC), and crystal plasticity finite element (CPFE), we investigate the evolution of intragranular lattice rotations and slip activity during monotonic and cyclic loading in a high performance, polycrystalline face centered cubic material. The CPFE employs a quasi-3D model microstructure, which is a highly resolved mirror representation of the experimental in-situ test sample. In agreement, the measurements and calculations reveal that most grains, regardless of their size and lattice orientation, develop intragranular lattice rotation gradients that span the grain. For a small cluster of grains on the deformed material, we perform HR-DIC analysis of slip lines to demonstrate agreement in the active slip systems and changes in this local slip activity across the individual grains. The combined analysis reveals that deforming grains are divided into sub-granular regions of uniform lattice rotation and these regions are most often associated with only one or two active slip systems. The gradient lines that divide them correspond to changes in the predominant slip system. The model is used to examine the evolution of intragranular lattice rotation in a single fully reversed tension-compression cycle. The calculations indicate that intragranular gradients intensify during the reverse loading path as nearest neighboring regions appear to shed lattice rotation, increasing the lattice rotation in some regions, while shutting down rotation in neighboring regions. So these findings provide insight into the irreversible changes that develop within deforming grains at the scale of the grain, particularly the heterogeneous development of intragranular lattice rotation in early stages of deformation, which could serve as precursors to localization.

36 MATERIALS SCIENCE↗

Design of an additively manufactured functionally graded material of 316 stainless steel and Ti-6Al-4V with Ni-20Cr, Cr, and V intermediate compositions

This study presents a method for designing a computationally informed gradient pathway to fabricate a functionally graded material (FGM) with terminal alloys of 316 stainless steel (SS316) and Ti-6Al-4V via directed energy deposition additive manufacturing with powder feedstock. In this work, the grading is accomplished through the introduction of intermediate elements and alloys (Ni-20Cr, Cr, and V) to avoid the brittle Fe-Ti intermetallic phases that form in the direct liquid phase joining of Ti-alloys and stainless steels. Using a combination of equilibrium calculations and Scheil-Gulliver simulations, a compositional pathway was designed to avoid deleterious phases. FGM samples were fabricated and experimentally characterized to determine the viability of the pathway. A change in phases from fcc to bcc was predicted to occur within the Ni-20Cr/Cr gradient region, and this was validated through experimental characterization. No detrimental phases (intermetallic, Laves, or σ phases) formed along the gradient path, demonstrating a successful computationally-informed design and fabrication of an FGM from SS316 to Ti-6Al-4V.

36 MATERIALS SCIENCE↗

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

A general approach to seismic inversion with automatic differentiation

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient efficiently; however, its implementation can be time-consuming and difficult. We develop a general seismic inversion framework to calculate gradients using reverse-mode automatic differentiation. The central idea is that adjoint-state methods and reverse-mode automatic differentiation are mathematically equivalent. Here, the mapping between numerical PDE simulation and deep learning allows us to build a seismic inverse modeling library, ADSeismic, based on deep learning frameworks, which supports high performance reverse-mode automatic differentiation on CPUs and GPUs. We demonstrate the performance of ADSeismic on inverse problems related to velocity model estimation, rupture imaging, earthquake location, and source time function retrieval. ADSeismic has the potential to solve a wide variety of inverse modeling applications within a unified framework.

58 GEOSCIENCES↗

Automated path planning for functionally graded materials considering phase stability and solidification behavior: Application to the Mo-Nb-Ta-Ti system

Functionally graded materials have the potential to improve upon monolithic parts by locally tailoring compositions to surrounding environmental conditions. Difficulties arise when designing composition gradients as incompatible materials can result in detrimental phase formation and failure of the gradient joint. As many alloys are multi-component, designing a composition gradient free of detrimental phases is difficult due to the large composition space available to explore. A framework was developed that improves the path planning algorithm and surrogate models with adaptive sampling schemes specific to their problem definition. A cost function was created to minimize a property (such as cracking susceptibility) along a path. This framework was applied to the Mo-Nb-Ta-Ti system as a case study to showcase the efficiency in building the surrogate models and in iterating different optimal compositionally graded paths.

36 MATERIALS SCIENCE↗

Ion transport in composites of binary electrolyte and single ion conductor—A chronoamperometry study

Composite electrolytes for lithium batteries typically combine materials with very different mechanical properties and ionic transport mechanisms and the degree to which these two phases affect each other is not well understood. In this work we used numerical simulations and experiments to investigate the transport in composite electrolytes consisting of polyethylene oxide (PEO) with Lithium bis-triuoromethanesulfonimide (LiTFSI) and Li 1.3 Al 0.3 Ti 1.7 (PO 4 ) 3 (LATP) lithium ion conducting glass-ceramic particles. In particular we are interested in how the introduction of a single ion conductor (SIC) changes the salt concentration gradients in the polymer electrolyte (PE) under applied potential. To study this, we performed numerical simulations and chronoamperometry experiments in electrolytes with different arrangements of the SIC and PE phases, i.e. layers and particulate composites. The results show that the particulate composites have the highest concentration gradients and take the longest time to reach steady state current. Furthermore, the high concentration gradient can be exacerbated by a high SIC/PE interfacial resistance. Finally, the best arrangement appears to have a layer of SIC impenetrable to anions in the polymer phase within the electrolyte membrane.

25 ENERGY STORAGE↗

Propagation of elastic waves in a flexomagnetic solid

Flexomagnetism is the coupling between magnetism and strain gradients and is a technologically relevant phenomenon. We present a theory of elastic wave propagation in a linear elastic flexomagnetic material with microstructure and strain gradient elastic interactions. The expressions of frequency, phase velocity, and group velocity of longitudinal and transverse waves are derived and are shown to depend on the flexomagnetic coefficient and microstructure. We also show that the effect of flexomagnetism and microstructure can lead to some interesting phenomena in wave propagation, which are not observed in classical linear elasticity theory of waves. Specifically, in contrast to classical linear elastic materials, where wave propagation is non-dispersive, flexomagnetic materials with microstructure can exhibit both normal and abnormal dispersion. It is also noteworthy that, in flexomagnetic materials with gradient elasticity, the phase velocities of transverse waves can exceed those of longitudinal waves, which is atypical in classical elasticity. Furthermore, waves can also attenuate for a certain range of wavenumbers that depend on the flexomagnetic coefficient and microstructural parameters. Finally, we explore the possibility of waves exhibiting zero group velocity modes, where waves are non-propagating but have strong local energy confinement, negative group velocity modes, where the wave packet moves in the opposite direction to that of wave propagation, and the phenomenon of wave freezing, where a propagating wave stops in space without diffusing or spreading.

Ghosh, Swarnava [ORNL] (ORCID:0000000338005264)↗

Symbiotic niche mapping reveals functional specialization by two ectomycorrhizal fungi that expands the host plant niche

Mutualisms are ubiquitous in natural systems, but less is known about how these positive interactions influence species distributions compared with antagonistic interactions, such as competition and predation. The niche concept is one useful approach for thinking about factors that shape species ranges, which we apply here towards understanding how the nature of plant-mycorrhizal symbioses change across large environmental gradients. We used a continuous niche mapping approach to examine how two ectomycorrhizal fungi (Thelephora terrestris, Suillus pungens) impact pine seedling growth across a two-dimensional soil nitrogen (N) and phosphorus (P) gradient. We found that ectomycorrhizal fungi improved plant growth most in nutrient addition treatments with highly imbalanced N:P ratios, demonstrating that mycorrhizal benefits depend on interactions between niche axes. Nevertheless, T. terrestris (highN:lowP) and S. pungens (lowN:highP) benefited plants most at opposite ends of the resource ratio spectrum, consistent with niche partitioning and functional specialization. While ectomycorrhizal fungi are often thought of as being most beneficial for nitrogen uptake, our results suggest that members of the Thelephoraceae may specialize in improving plant P uptake. Ectomycorrhizal colonization by a single fungus increased plant niche volume (calculated as convex hull volumes of plant growth response surfaces across N and P gradients) compared to non-mycorrhizal control plants and shows the overall positive effects of mutualisms on plant niche volume. Despite plant host benefits in S. pungens and T. terrestris single species treatments, the presence of both fungi together decreased plant niche volume. The lack of functional complementarity, despite functional specialization, indicates that in some environments, either fungal competition or the cost of maintaining a suboptimal mycorrhizal partner can limit the benefits of a higher quality partner. The niche mapping approach we present has the potential to answer fundamental questions about the dimensions of functional diversity in ectomycorrhizal fungi and the distributions of mycorrhizal symbioses.

59 BASIC BIOLOGICAL SCIENCES↗

A robust spectral element implementation of the $k - τ$ RANS model in Nek5000/NekRS

The $k - ω$ Reynolds Averaged Navier Stokes (RANS) model is one of the industry standard approaches for modeling of turbulent flows. It performs better than the $k - ϵ$ model for low Reynolds number flows and is also more suitable for boundary layers with adverse pressure gradients. Major drawback of the model, however, is that the asymptotic value of $ω$ at the walls is singular, necessitating the use of a contrived “sufficiently” large value for $ω$ as the boundary condition for its transport equation. Here, this invariably leads to the solution being sensitive to near wall grid spacing. While an acceptable solution for low order (finite volume) methods, the excessive near wall gradients lead to persistent numerical stability issues in high order codes. To alleviate the problem, specifically in the context of the high order spectral element code Nek5000, a regularized $k - ω$ approach was formulated in our prior work (Tomboulides et al., 2018). The formulation, however, relies on the use of wall distance and its gradients for modeling the closure terms and can pose problems for simulations in complex geometries. This work presents a novel implementation of the $k - τ$ RANS model in Nek5000, where $τ = 1/ω$, eliminating the need for regularization, owing to the asymptotically bounded behavior of the source terms in the $τ$ transport equation, and also eliminating dependence on wall distance. Robustness and stability of the $k - τ$ model is ensured through implicit treatment of the source terms and their careful numerical implementation and demonstrated through several cases aimed at verification and validation. Studies include both canonical and engineering relevant problems, viz., turbulent channel flow, pipe flow, backward facing step, flow over NACA 0012 airfoil and flow in a T-junction. Results from the $k - τ$ model are shown to be consistent with regularized $k - ω$ model and also with the $k - ω$ SST model in OpenFOAM (for select studies). Comparison with experimental data is also shown, where available, to bolster validation efforts for the $k - τ$ model implementation through prediction of key turbulent quantities of interest.

Nek5000↗

High-throughput characterization of Ag–V–O nanostructured thin-film materials libraries for photoelectrochemical solar water splitting

Ag–V–O thin-film materials libraries, with both composition (Ag 22-77 V 23-78 O x ) and thickness (123–714 nm) gradients were fabricated using combinatorial reactive magnetron co-sputtering aiming on establishing relations between composition, structure, and functional properties. As-deposited libraries were annealed in air at 300 °C for 10 h. High-throughput characterization methods of composition, structure and functional properties were used to identify photoelectrochemically active regions. The phases AgV 6 O 15 , Ag 2 V 4 O 11 , AgVO 3 , and Ag 4 V 2 O 7 were observed throughout the composition gradient. The photoelectrochemical properties of Ag–V–O films are dependent on composition and morphology. An enhanced photocurrent density (~300–554 μA/cm 2 ) was obtained at 30 to 45 at.% Ag along the thickness gradient. Thin films of these compositions show a nanowire morphology, which is an important factor for the enhancement of photoelectrochemical performance. The photoelectrochemically active regions were further investigated by high-throughput synchrotron-X-ray diffraction and transmission electron microscopy (Ag 32 V 68 O x ) which confirmed the presence of Ag 2 V 4 O 11 as the dominating phase along with the minor phases AgV 6 O 15 and AgVO 3 . This enhanced photoactive region shows bandgap values of ~2.30 eV for the direct and ~1.87 eV for the indirect bandgap energies. Finally, the porous nanostructured films improve charge transport and are hence of interest for photoelectrochemical water splitting.

36 MATERIALS SCIENCE↗

Fundamental study of gas species transport in the oxygen electrode of solid oxide fuel and electrolysis cells

A fundamental analysis of multicomponent gas transport models was performed in application to the oxygen electrodes of solid oxide cells. It is common practice to neglect the effect of pressure gradients within oxygen electrodes, even though a net molar flux at the electrolyte surface implies that a pressure gradient must exist. The influence of both Darcy velocity and Knudsen flux are considered in the context of ordinary (Fickian) diffusion, the dusty gas model, and the binary friction model. Comparisons between the models and different sets of assumptions are made via parametric studies on operating load, oxygen partial pressure, microstructural properties, and electrode thickness. Results show that the pressure gradient will have a significant impact on the oxygen concentration distribution and therefore the concentration overpotential. In electrolysis mode, pressure increases up to 1 atm are predicted, indicating that pressure at the electrode/electrolyte interface could contribute to electrode delamination. Additionally, it is found that Darcy's law is insufficient for calculating the pressure distribution without accounting for the flux due to Knudsen diffusion. Additionally, it is found that for the range of properties typical of oxygen electrodes, there is a negligibly small difference between the dusty gas model and binary friction model from a practical standpoint.

08 HYDROGEN↗

Eulerian finite element implementations of a dislocation density-based continuum model

In Eulerian finite element simulations, the mesh moves relative to the material. After every change of position between the mesh and the material, the state variables are interpolated to the new mesh position, which is referred to as advection. Large strain crystal plasticity models are based on the multiplicative decomposition of the total deformation gradient. Further, the stress is evaluated as a function of the thermoelastic strain, temperature, and other state variables. Advection of tensor quantities, such as the strain, is coupled with possibly significant advection errors. In an effort to reduce the advection errors, we develop two rate forms of an established dislocation density-based continuum model. To that end, we replace the multiplicative decomposition of the deformation gradient with the additive decomposition of the velocity gradient, and define the stress rate instead of the total stress. The Eulerian implementation is compared with Lagrangian calculations, and two numerical examples with severe deformation levels are presented.

36 MATERIALS SCIENCE↗

An optimization method for chaotic turbulent flow

Evidence indicates that quantities-of-interest in some turbulent flows can be controlled despite the overall chaotic dynamics. It is typically thought that this is via relatively deterministic, larger-scale components of the turbulence. However, finding such controls, if they exist, is challenging because chaos causes sensitivity gradients to explode and the search space to become intractably non-convex. This challenge is analyzed, and a penalty method is introduced to cope with it. In the new approach, the time domain is broken into segments approximately matching the chaos time scales, so that the solution within each segment is both physical and relatively deterministic. The initial condition of each segment is included in an adjoint-based gradient optimization, which temporarily introduces artificial Δq discontinuities in the overall solution. The optimization then proceeds in stages with increasing penalization of Δq. The method is developed and illustrated for a logistic map, the Lorenz Equation, and an advection augmented Kuramoto–Sivashinsky Equation. These examples show how the Δq temporarily increases the search scale prior to the strong Δq → 0 penalization that recovers a physical solution. It is then applied to turbulent Kolmogorov flow, for which it also far outperforms a standard adjoint-based gradient search. Finally, the utility of such an optimized chaotic solution is discussed.

97 MATHEMATICS AND COMPUTING↗