Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Gradient-Based Novelty Detection Boosted by Self-Supervised Binary Classification

Novelty detection aims to automatically identify out-of-distribution (OOD) data, without any prior knowledge of them. It is a critical step in data monitoring, behavior analysis and other applications, helping enable continual learning in the field. Conventional methods of OOD detection perform multi-variate analysis on an ensemble of data or features, and usually resort to the supervision with OOD data to improve the accuracy. In reality, such supervision is impractical as one cannot anticipate the anomalous data. In this paper, we propose a novel, self-supervised approach that does not rely on any pre-defined OOD data: (1) The new method evaluates the Mahalanobis distance of the gradients between the in-distribution and OOD data. (2) It is assisted by a self-supervised binary classifier to guide the label selection to generate the gradients, and maximize the Mahalanobis distance. In the evaluation with multiple datasets, such as CIFAR-10, CIFAR-100, SVHN and TinyImageNet, the proposed approach consistently outperforms state-of-the-art supervised and unsupervised methods in the area under the receiver operating characteristic (AUROC) and area under the precision-recall curve (AUPR) metrics. We further demonstrate that this detector is able to accurately learn one OOD class in continual learning.

Sun, Jingbo↗
DOE OSTI2023

Protection Against Graph-Based False Data Injection Attacks on Power Systems

Graph signal processing (GSP) has emerged as a powerful tool for practical network applications, including power system monitoring. By representing power system voltages as smooth graph signals, recent research has focused on developing GSP-based methods for state estimation, attack detection, and topology identification. Included, efficient methods have been developed for detecting false data injection (FDI) attacks, which until now were perceived as non-smooth with respect to the graph Laplacian matrix. Consequently, these methods may not be effective against smooth FDI attacks. In this paper, we propose a graph FDI (GFDI) attack that minimizes the Laplacian-based graph total variation (TV) under practical constraints. In addition, we develop a low-complexity algorithm that solves the non-convex GDFI attack optimization problem using ell_1-norm relaxation, the projected gradient descent (PGD) algorithm, and the alternating direction method of multipliers (ADMM). We then propose a protection scheme that identifies the minimal set of measurements necessary to constrain the GFDI output to high graph TV, thereby enabling its detection by existing GSP-based detectors. Our numerical simulations on the IEEE-57 bus test case reveal the potential threat posed by well-designed GSP-based FDI attacks. Moreover, we demonstrate that integrating the proposed protection design with GSP-based detection can lead to significant hardware cost savings compared to previous designs of protection methods against FDI attacks.

Morgenstern, Gal↗
DOE OSTI2024

Random coordinate descent: A simple alternative for optimizing parameterized quantum circuits

Variational quantum algorithms rely on the optimization of parameterized quantum circuits in noisy settings. The commonly used back-propagation procedure in classical machine learning is not directly applicable in this setting due to the collapse of quantum states after measurements. Thus, gradient estimations constitute a significant overhead in a gradient-based optimization of such quantum circuits. This paper introduces a random coordinate descent algorithm as a practical and easy-to-implement alternative to the full gradient descent algorithm. This algorithm only requires one partial derivative at each iteration. Motivated by the behavior of measurement noise in the practical optimization of parameterized quantum circuits, this paper presents an optimization problem setting that is amenable to analysis. Under this setting, the random coordinate descent algorithm exhibits the same level of stochastic stability as the full gradient approach, making it as resilient to noise. The complexity of the random coordinate descent method is generally no worse than that of the gradient descent and can be much better for various quantum optimization problems with anisotropic Lipschitz constants. Theoretical analysis and extensive numerical experiments validate our findings. Published by the American Physical Society 2024

Ding, Zhiyan (ORCID:000000018863403X)↗
DOE OSTI2023

Macroscale property assessment and indentation characteristics of thick section friction stir welded AA 5083

The spatial gradients in microstructure have been proven to be effective in optimizing the performance of components, and several techniques have been developed to achieve this microstructure. Nevertheless, the local microstructural modification methods inevitably result in the formation of gradient microstructure leading to a variation in the property. Herein this work systematically investigates the effect of gradient microstructure formed during thick section friction stir weld Al5083 alloy on its mechanical properties. A novel macro-indentation technique, profilometer-based indentation plastometry (PIP), is utilized to capture the variation in the mechanical properties in the feedstock (rolled plate) and weld region. The feedstock exhibited a gradient microstructure owing to different stress states during rolling. Additionally, the stirring of the tool resulted in a complex material flow pattern producing a microstructure gradient in the weld region. The aspect ratio of the grains was identified as the primary factor causing variation in indentation response in the feedstock. In contrast, variation in the grain size in the weld region resulted in property variation. Overall, the stir zone has a lower yield strength (158±4MPa) than the base material (173±3MPa). In addition, microstructure heterogeneity in the stir zone resulted in lower elongation than the base material.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Simulating metagenomic stable isotope probing datasets with MetaSIPSim

DNA-stable isotope probing (DNA-SIP) links microorganisms to their in-situ function in diverse environmental samples. Combining DNA-SIP and metagenomics (metagenomic-SIP) allows us to link genomes from complex communities to their specific functions and improves the assembly and binning of these targeted genomes. However, empirical development of metagenomic-SIP methods is hindered by the complexity and cost of these studies. We developed a toolkit, ‘MetaSIPSim,’ to simulate sequencing read libraries for metagenomic-SIP experiments. MetaSIPSim is intended to generate datasets for method development and testing. To this end, we used MetaSIPSim generated data to demonstrate the advantages of metagenomic-SIP over a conventional shotgun metagenomic sequencing experiment. Through simulation we show that metagenomic-SIP improves the assembly and binning of isotopically labeled genomes relative to a conventional metagenomic approach. Improvements were dependent on experimental parameters and on sequencing depth. Community level G + C content impacted the assembly of labeled genomes and subsequent binning, where high community G + C generally reduced the benefits of metagenomic-SIP. Furthermore, when a high proportion of the community is isotopically labeled, the benefits of metagenomic-SIP decline. Finally, the choice of gradient fractions to sequence greatly influences method performance. Metagenomic-SIP is a valuable method for recovering isotopically labeled genomes from complex communities. We show that metagenomic-SIP performance depends on optimization of experimental parameters. MetaSIPSim allows for simulation of metagenomic-SIP datasets which facilitates the optimization and development of metagenomic-SIP experiments and analytical approaches for dealing with these data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Thermal dissipation sensors enter a new age: Navigating frontiers in transpiration and hydrologic function

Thermal dissipation (TD) sensors have been used extensively for a wide array of sap flow applications, and yet recently several limitations of this approach have been identified, including a tendency to underestimate absolute flows, especially in small stems with very high flows. However, when used properly, the TD method remains the most cost effective and reliable approach for determining relative flows in comparison studies. Major advantages of this method include the ability to replicate maximally within trees, across trees of different sizes, and across multiple species to capture the full range of natural variation in the study system. From early studies, such variation has been deemed a major challenge for representing stand-level dynamics. In a series of recent comparison studies, we determined mean sap flux density dynamics within and among groups of trees. These studies were conducted within temperate coniferous forest (n=46), temperate oak savanna (n=36), temperate pine forest (n=49), temperate bottomland hardwood forest (n=23), tropical premontane rainforest (n=43), semiarid subtropical shrubland (n=25), and tropical dry forest (n=15), with a total of 237 sensors. Two study sites were also equipped with eddy covariance systems for determination of stand-level evapotranspiration. Sites subject to high background thermal gradients used the transient thermal dissipation method. Comparisons varied between studies but tended to focus on relative flow differences between species, between wetter and drier microsites, between understory and overstory components, or between wetter and drier periods of the growing season. Except for the shrubland sites, study trees tended to be at least 15-cm diameter and frequently exceeded 50-cm diameter. Results of this cross-site comparison highlight the inherent variation in natural stands and the importance of using large sample sizes. The TD approach remains a valuable and preferred method for the future determination of water use in trees. However, sensor replication can fundamentally impact a study's outcomes and should be more carefully considered in study design. Customized error mitigation strategies are best to address the sources of variation most problematic for a particular study. In conclusion, the development of “smart” calibration approaches that correct for fundamental effects of radial variation inherent in thermal dissipation studies is discussed.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Adaptive Grid Redistribution for a 1D Model of Turbulence and Clouds

In global atmospheric models, resolving stratocumulus (Sc) in the vertical is computationally expensive. However, Sc appear only under special meteorological conditions. Therefore, there is motivation to refine the vertical grid levels adaptively. In order to facilitate the possibility of parallelization on graphical processing units, our grid adaptation method prescribes the number of vertical levels a priori. Then grid levels are relocated toward altitude ranges in need of refinement. Because the method relocates existing grid levels, rather than adding extra levels, there is a risk of creating regions with overly coarse grid spacing, that is, voids in the grid mesh. To prevent such voids from forming, a simple method is developed to impose a maximum grid spacing. To decide where to place enhanced resolution, the authors develop an empirical mesh refinement criterion. It refines grid spacing near the ground, near strong temperature gradients, and within clouds. Our grid adaptation method is implemented in a single-column model and evaluated on four test cases: decaying stratocumulus, developing shallow cumulus, a quasi-stationary stratocumulus deck, and the diurnal cycle of a dry boundary layer. In the stratocumulus cases, mesh refinement leads to improvements in both the time evolution of fields and their time averages. The other two cases show smaller differences.

Carstensen, Steffen [Univ. of Wisconsin, Milwaukee↗
DOE OSTI2020

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Residential heating, ventilation, and air conditioning (HVAC) has been considered as an important demand response resource. However, the optimization of residential HVAC control is no trivial task due to the complexity of the thermal dynamic models of buildings and uncertainty associated with both occupant-driven heat loads and weather forecasts. In this paper, we apply a novel model-free deep reinforcement learning (RL) method, known as the deep deterministic policy gradient (DDPG), to generate an optimal control strategy for a multi-zone residential HVAC system with the goal of minimizing energy consumption cost while maintaining the users’ comfort. Here, the applied deep RL-based method learns through continuous interaction with a simulated building environment and without referring to any prior model knowledge. Simulation results show that compared with the state-of-art deep Q network (DQN), the DDPG-based HVAC control strategy can reduce the energy consumption cost by 15% and reduce the comfort violation by 79%; and when compared with a rule-based HVAC control strategy, the comfort violation can be reduced by 98%. In addition, experiments with different building models and retail price models demonstrate that the well-trained DDPG-based HVAC control strategy has high generalization and adaptability to unseen environments, which indicates its practicability for real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Multi‐Material Gradient Printing Using Meniscus‐enabled Projection Stereolithography (MAPS)

Light‐based additive manufacturing methods are widely used to print high‐resolution 3D structures for applications in tissue engineering, soft robotics, photonics, and microfluidics, among others. Despite this progress, multi‐material printing with these methods remains challenging due to constraints associated with hardware modifications, control systems, cross‐contamination, waste, and resin properties. Here, a new printing platform coined Meniscus‐enabled Projection Stereolithography (MAPS) is reported, a vat‐free method that relies on generating and maintaining a resin meniscus between a crosslinked structure and bottom window to print lateral, vertical, discrete, or gradient multi‐material 3D structures with no waste and user‐defined mixing between layers. MAPS is compatible with a wide range of resins shown and can print complex multi‐material 3D structures without requiring specialized hardware, software, or complex washing protocols. MAPS's ability to print structures with microscale variations in mechanical stiffness, opacity, surface energy, cell densities, and magnetic properties provides a generic method to make advanced materials for a broad range of applications.

bioprinting↗
DOE OSTI2023

Accelerating gradient descent and Adam via fractional gradients

Here we propose a class of novel fractional-order optimization algorithms. We define a fractional-order gradient via the Caputo fractional derivatives that generalizes integer-order gradient. We refer it to as the Caputo fractional-based gradient, and develop an efficient implementation to compute it. A general class of fractional-order optimization methods is then obtained by replacing integer-order gradients with the Caputo fractional-based gradients. To give concrete algorithms, we consider gradient descent (GD) and Adam, and extend them to the Caputo fractional GD (CfGD) and the Caputo fractional Adam (CfAdam). We demonstrate the superiority of CfGD and CfAdam on several large scale optimization problems that arise from scientific machine learning applications, such as ill-conditioned least squares problem on real-world data and the training of neural networks involving non-convex objective functions. Numerical examples show that both CfGD and CfAdam result in acceleration over GD and Adam, respectively. We also derive error bounds of CfGD for quadratic functions, which further indicate that CfGD could mitigate the dependence on the condition number in the rate of convergence and results in significant acceleration over GD.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

DEVELOPMENT AND APPLICATION OF RISK ANALYSIS TOOLKIT FOR PLANT RESOURCE OPTIMIZATION

This paper presents the development of methods and tools that are being designed to optimize plant operations (e.g., maintenance/replacement schedules and optimal maintenance postures for plant components) in a manner that is more cost effective than current approaches and makes better use of available component health and cost data. These methods include both data- and model-based optimization methods. Model-based optimization methods directly include reliability and cost models to determine an optimal plant operational strategy. We consider gradient-based and evolutionary (based on genetic algorithms) optimization methods. The second class of methods target more specific use cases (e.g., project schedule optimization) and are not based on reliability models directly, but they require specific component reliability and cost data. This class of methods is based on variants of the knapsack problem with an aim to determine an optimal project schedule that maximizes the overall NPV. This paper also presents multi-objective methods designed to identify an optimal maintenance posture based on a Pareto frontier analysis. Rather than dictating the “right” tradeoff (i.e., identify the absolute best posture), we show how it is possible to perform a trade space exploration approach (i.e., identify value and costs of several postures and let the analysis account for desired value and cost metrics). This is performed by identifying maintenance postures that maximize value (e.g., system availability) and minimize operational costs, i.e., the Pareto frontier in a value-cost trade space. For all these methods we present detailed applicative examples that show their validity from a decision-making perspective.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Design of an additively manufactured functionally graded material of 316 stainless steel and Ti-6Al-4V with Ni-20Cr, Cr, and V intermediate compositions

This study presents a method for designing a computationally informed gradient pathway to fabricate a functionally graded material (FGM) with terminal alloys of 316 stainless steel (SS316) and Ti-6Al-4V via directed energy deposition additive manufacturing with powder feedstock. In this work, the grading is accomplished through the introduction of intermediate elements and alloys (Ni-20Cr, Cr, and V) to avoid the brittle Fe-Ti intermetallic phases that form in the direct liquid phase joining of Ti-alloys and stainless steels. Using a combination of equilibrium calculations and Scheil-Gulliver simulations, a compositional pathway was designed to avoid deleterious phases. FGM samples were fabricated and experimentally characterized to determine the viability of the pathway. A change in phases from fcc to bcc was predicted to occur within the Ni-20Cr/Cr gradient region, and this was validated through experimental characterization. No detrimental phases (intermetallic, Laves, or σ phases) formed along the gradient path, demonstrating a successful computationally-informed design and fabrication of an FGM from SS316 to Ti-6Al-4V.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Nonlinear sparse Bayesian learning for physics-based models

This paper addresses the issue of overfitting while calibrating unknown parameters of over-parameterized physics-based models with noisy and incomplete observations. Here, a semi-analytical Bayesian framework of nonlinear sparse Bayesian learning (NSBL) is proposed to identify sparsity among model parameters during Bayesian inversion. NSBL offers significant advantages over machine learning algorithm of sparse Bayesian learning (SBL) for physics-based models, such as 1) the likelihood function or the posterior parameter distribution is not required to be Gaussian, and 2) prior parameter knowledge is incorporated into sparse learning (i.e. not all parameters are treated as questionable). NSBL employs the concept of automatic relevance determination (ARD) to facilitate sparsity among questionable parameters through parameterized prior distributions. The analytical tractability of NSBL is enabled by employing Gaussian ARD priors and by building a Gaussian mixture-model approximation of the posterior parameter distribution that excludes the contribution of ARD priors. Subsequently, type-II maximum likelihood is executed using Newton's method whereby the evidence and its gradient and Hessian information are computed in a semi-analytical fashion. We show numerically and analytically that SBL is a special case of NSBL for linear regression models. Subsequently, a linear regression example involving multimodality in both parameter posterior pdf and model evidence is considered to demonstrate the performance of NSBL in cases where SBL is inapplicable. Next, NSBL is applied to identify sparsity among the damping coefficients of a mass-spring-damper model of a shear building frame. These numerical studies demonstrate the robustness and efficiency of NSBL in alleviating overfitting during Bayesian inversion of nonlinear physics-based models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Liquid-like solid-state diffusion of lithium ions in super-halide-rich argyrodite

The development of solid electrolytes with high ionic conductivity is essential for advancing safer, high-energy-density solid-state batteries, where lithium site distribution in the sublattice strongly affects ion transport. Here, we report a super-halide-rich argyrodite, Li 5.3 PS 4.3 Cl 1.7 , with remarkable room-temperature ionic conductivity (11.4 ± 0.7 mS cm -1 ) due to population of two additional interstitial lithium sites induced by vacancy redistribution. Prominent lithium density between lithium sites and elevated atomic displacement parameters indicate liquid-like diffusive behavior resembling sublattice melting. Combining electrochemical impedance spectroscopy, pulsed-field gradient NMR, and T 1 relaxation methods, we demonstrate that the augmented conductivity partly arises from a low energy barrier (0.08 eV) at the local scale, attributed to a three-site lithium distribution that drives correlated lithium dynamics. This work advances our understanding of the structure-dynamics interplay in super-halide-rich argyrodites, and highlighting their potential as solid-state battery electrolytes in cells with a coated single-crystal NMC82 cathode that achieve 170 mAh/g capacity at a 0.2 C rate .

25 ENERGY STORAGE↗
DOE OSTI2023

Machine Learning of Key Variables Impacting Extreme Precipitation in Various Regions of the Contiguous United States

Abstract Amplification in extreme precipitation intensity and frequency can cause severe flooding and impose significant social and economic consequences. Variations in extreme precipitation intensity, frequencies, and return periods can be attributed to many physical variables across spatial and temporal scales. Here we employ ensemble machine learning (ML) methods, namely random forest (RF), eXtreme Gradient Boosting (XGB), and artificial neural networks (ANN), to explore key contributing variables to monthly extreme precipitation intensity and frequency in six regions over the United States. We further establish emulators for return periods. Results show that the ML models for intensity perform better in regions with obvious seasonality (i.e., Northern Great Plains, Southern Great Plains, and West Coast) than the other three regions (Northeast, Southwest, and Rocky Mountains), while for frequency the models perform well for most regions. The Shapley additive explanation is used to help explain the relationships between extreme precipitation characteristics and identify top variables for RF and XGB. We find that latent heat flux, relative humidity, soil moisture, and large‐scale subsidence are key common variables across the regions for both monthly intensity and frequency, and their compound effects are non‐negligible. The developed ML models capture the probability and return period of extreme precipitation well for all regions and may be used for decision making (e.g., infrastructure planning and design).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Rethinking materials simulations: Blending direct numerical simulations with neural operators

Abstract Materials simulations based on direct numerical solvers are accurate but computationally expensive for predicting materials evolution across length- and time-scales, due to the complexity of the underlying evolution equations, the nature of multiscale spatiotemporal interactions, and the need to reach long-time integration. We develop a method that blends direct numerical solvers with neural operators to accelerate such simulations. This methodology is based on the integration of a community numerical solver with a U-Net neural operator, enhanced by a temporal-conditioning mechanism to enable accurate extrapolation and efficient time-to-solution predictions of the dynamics. We demonstrate the effectiveness of this hybrid framework on simulations of microstructure evolution via the phase-field method. Such simulations exhibit high spatial gradients and the co-evolution of different material phases with simultaneous slow and fast materials dynamics. We establish accurate extrapolation of the coupled solver with large speed-up compared to DNS depending on the hybrid strategy utilized. This methodology is generalizable to a broad range of materials simulations, from solid mechanics to fluid dynamics, geophysics, climate, and more.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Perfect Crystals: microgravity capillary counterdiffusion crystallization of human manganese superoxide dismutase for neutron crystallography

The NASA mission Perfect Crystals used the microgravity environment on the International Space Station (ISS) to grow crystals of human manganese superoxide dismutase (MnSOD)—an oxidoreductase critical for mitochondrial vitality and human health. The mission’s overarching aim is to perform neutron protein crystallography (NPC) on MnSOD to directly visualize proton positions and derive a chemical understanding of the concerted proton electron transfers performed by the enzyme. Large crystals that are perfect enough to diffract neutrons to sufficient resolution are essential for NPC. This combination, large and perfect, is hard to achieve on Earth due to gravity-induced convective mixing. Capillary counterdiffusion methods were developed that provided a gradient of conditions for crystal growth along with a built-in time delay that prevented premature crystallization before stowage on the ISS. Here, we report a highly successful and versatile crystallization system to grow a plethora of crystals for high-resolution NPC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗