Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Random coordinate descent: A simple alternative for optimizing parameterized quantum circuits

Variational quantum algorithms rely on the optimization of parameterized quantum circuits in noisy settings. The commonly used back-propagation procedure in classical machine learning is not directly applicable in this setting due to the collapse of quantum states after measurements. Thus, gradient estimations constitute a significant overhead in a gradient-based optimization of such quantum circuits. This paper introduces a random coordinate descent algorithm as a practical and easy-to-implement alternative to the full gradient descent algorithm. This algorithm only requires one partial derivative at each iteration. Motivated by the behavior of measurement noise in the practical optimization of parameterized quantum circuits, this paper presents an optimization problem setting that is amenable to analysis. Under this setting, the random coordinate descent algorithm exhibits the same level of stochastic stability as the full gradient approach, making it as resilient to noise. The complexity of the random coordinate descent method is generally no worse than that of the gradient descent and can be much better for various quantum optimization problems with anisotropic Lipschitz constants. Theoretical analysis and extensive numerical experiments validate our findings. Published by the American Physical Society 2024

Ding, Zhiyan (ORCID:000000018863403X)↗
NASA NTRS1990

Analysis and improved design considerations for airborne pulse Doppler radar signal processing in the detection of hazardous windshear

High resolution windspeed profile measurements are needed to provide reliable detection of hazardous low altitude windshear with an airborne pulse Doppler radar. The system phase noise in a Doppler weather radar may degrade the spectrum moment estimation quality and the clutter cancellation capability which are important in windshear detection. Also the bias due to weather return Doppler spectrum skewness may cause large errors in pulse pair spectral parameter estimates. These effects are analyzed for the improvement of an airborne Doppler weather radar signal processing design. A method is presented for the direct measurement of windspeed gradient using low pulse repetition frequency (PRF) radar. This spatial gradient is essential in obtaining the windshear hazard index. As an alternative, the modified Prony method is suggested as a spectrum mode estimator for both the clutter and weather signal. Estimation of Doppler spectrum modes may provide the desired windshear hazard information without the need of any preliminary processing requirement such as clutter filtering. The results obtained by processing a NASA simulation model output support consideration of mode identification as one component of a windshear detection algorithm.

Lee, Jonggil↗
NASA NTRS1990

A combined finite element-boundary integral formulation for solution of two-dimensional scattering problems via CGFFT

A new technique is presented for computing the scattering by 2-D structures of arbitrary composition. The proposed solution approach combines the usual finite element method with the boundary-integral equation to formulate a discrete system. This is subsequently solved via the conjugate gradient (CG) algorithm. A particular characteristic of the method is the use of rectangular boundaries to enclose the scatterer. Several of the resulting boundary integrals are therefore convolutions and may be evaluated via the fast Fourier transform (FFT) in the implementation of the CG algorithm. The solution approach offers the principal advantage of having O(N) memory demand and employs a 1-D FFT versus a 2-D FFT as required with a traditional implementation of the CGFFT algorithm. The speed of the proposed solution method is compared with that of the traditional CGFFT algorithm, and results for rectangular bodies are given and shown to be in excellent agreement with the moment method.

Collins, Jeffery D.↗
DOE OSTI2023

Macroscale property assessment and indentation characteristics of thick section friction stir welded AA 5083

The spatial gradients in microstructure have been proven to be effective in optimizing the performance of components, and several techniques have been developed to achieve this microstructure. Nevertheless, the local microstructural modification methods inevitably result in the formation of gradient microstructure leading to a variation in the property. Herein this work systematically investigates the effect of gradient microstructure formed during thick section friction stir weld Al5083 alloy on its mechanical properties. A novel macro-indentation technique, profilometer-based indentation plastometry (PIP), is utilized to capture the variation in the mechanical properties in the feedstock (rolled plate) and weld region. The feedstock exhibited a gradient microstructure owing to different stress states during rolling. Additionally, the stirring of the tool resulted in a complex material flow pattern producing a microstructure gradient in the weld region. The aspect ratio of the grains was identified as the primary factor causing variation in indentation response in the feedstock. In contrast, variation in the grain size in the weld region resulted in property variation. Overall, the stir zone has a lower yield strength (158±4MPa) than the base material (173±3MPa). In addition, microstructure heterogeneity in the stir zone resulted in lower elongation than the base material.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Simulating metagenomic stable isotope probing datasets with MetaSIPSim

DNA-stable isotope probing (DNA-SIP) links microorganisms to their in-situ function in diverse environmental samples. Combining DNA-SIP and metagenomics (metagenomic-SIP) allows us to link genomes from complex communities to their specific functions and improves the assembly and binning of these targeted genomes. However, empirical development of metagenomic-SIP methods is hindered by the complexity and cost of these studies. We developed a toolkit, ‘MetaSIPSim,’ to simulate sequencing read libraries for metagenomic-SIP experiments. MetaSIPSim is intended to generate datasets for method development and testing. To this end, we used MetaSIPSim generated data to demonstrate the advantages of metagenomic-SIP over a conventional shotgun metagenomic sequencing experiment. Through simulation we show that metagenomic-SIP improves the assembly and binning of isotopically labeled genomes relative to a conventional metagenomic approach. Improvements were dependent on experimental parameters and on sequencing depth. Community level G + C content impacted the assembly of labeled genomes and subsequent binning, where high community G + C generally reduced the benefits of metagenomic-SIP. Furthermore, when a high proportion of the community is isotopically labeled, the benefits of metagenomic-SIP decline. Finally, the choice of gradient fractions to sequence greatly influences method performance. Metagenomic-SIP is a valuable method for recovering isotopically labeled genomes from complex communities. We show that metagenomic-SIP performance depends on optimization of experimental parameters. MetaSIPSim allows for simulation of metagenomic-SIP datasets which facilitates the optimization and development of metagenomic-SIP experiments and analytical approaches for dealing with these data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Thermal dissipation sensors enter a new age: Navigating frontiers in transpiration and hydrologic function

Thermal dissipation (TD) sensors have been used extensively for a wide array of sap flow applications, and yet recently several limitations of this approach have been identified, including a tendency to underestimate absolute flows, especially in small stems with very high flows. However, when used properly, the TD method remains the most cost effective and reliable approach for determining relative flows in comparison studies. Major advantages of this method include the ability to replicate maximally within trees, across trees of different sizes, and across multiple species to capture the full range of natural variation in the study system. From early studies, such variation has been deemed a major challenge for representing stand-level dynamics. In a series of recent comparison studies, we determined mean sap flux density dynamics within and among groups of trees. These studies were conducted within temperate coniferous forest (n=46), temperate oak savanna (n=36), temperate pine forest (n=49), temperate bottomland hardwood forest (n=23), tropical premontane rainforest (n=43), semiarid subtropical shrubland (n=25), and tropical dry forest (n=15), with a total of 237 sensors. Two study sites were also equipped with eddy covariance systems for determination of stand-level evapotranspiration. Sites subject to high background thermal gradients used the transient thermal dissipation method. Comparisons varied between studies but tended to focus on relative flow differences between species, between wetter and drier microsites, between understory and overstory components, or between wetter and drier periods of the growing season. Except for the shrubland sites, study trees tended to be at least 15-cm diameter and frequently exceeded 50-cm diameter. Results of this cross-site comparison highlight the inherent variation in natural stands and the importance of using large sample sizes. The TD approach remains a valuable and preferred method for the future determination of water use in trees. However, sensor replication can fundamentally impact a study's outcomes and should be more carefully considered in study design. Customized error mitigation strategies are best to address the sources of variation most problematic for a particular study. In conclusion, the development of “smart” calibration approaches that correct for fundamental effects of radial variation inherent in thermal dissipation studies is discussed.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1987

Assimilation of scalar versus horizontal gradient information from the VAS into a mesoscale model

Comparisons are made between analyses and forecasts which incorporate VAS geopotential data as either scalar or horizontal gradient information for a case study on the AVE/VAS day of Mar. 6, 1982. On this day, incorporating the VAS information in analysis as a variational constraint on horizontal geopotential gradients significantly mitigated the effects of large data biases which made VAS assimilation by standard scalar methods very difficult. A subsequent forecast made from the gradient assimilation was superior to one made from the standard analysis and of comparable quality in geopotentials to a control forecast from synoptic data. Most impact was noted in the forecasts of vertical motion and precipitation in the gradient vs this control simulation.

Diak, George↗
DOE OSTI2025

Adaptive Grid Redistribution for a 1D Model of Turbulence and Clouds

In global atmospheric models, resolving stratocumulus (Sc) in the vertical is computationally expensive. However, Sc appear only under special meteorological conditions. Therefore, there is motivation to refine the vertical grid levels adaptively. In order to facilitate the possibility of parallelization on graphical processing units, our grid adaptation method prescribes the number of vertical levels a priori. Then grid levels are relocated toward altitude ranges in need of refinement. Because the method relocates existing grid levels, rather than adding extra levels, there is a risk of creating regions with overly coarse grid spacing, that is, voids in the grid mesh. To prevent such voids from forming, a simple method is developed to impose a maximum grid spacing. To decide where to place enhanced resolution, the authors develop an empirical mesh refinement criterion. It refines grid spacing near the ground, near strong temperature gradients, and within clouds. Our grid adaptation method is implemented in a single-column model and evaluated on four test cases: decaying stratocumulus, developing shallow cumulus, a quasi-stationary stratocumulus deck, and the diurnal cycle of a dry boundary layer. In the stratocumulus cases, mesh refinement leads to improvements in both the time evolution of fields and their time averages. The other two cases show smaller differences.

Carstensen, Steffen [Univ. of Wisconsin, Milwaukee↗
DOE OSTI2020

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Residential heating, ventilation, and air conditioning (HVAC) has been considered as an important demand response resource. However, the optimization of residential HVAC control is no trivial task due to the complexity of the thermal dynamic models of buildings and uncertainty associated with both occupant-driven heat loads and weather forecasts. In this paper, we apply a novel model-free deep reinforcement learning (RL) method, known as the deep deterministic policy gradient (DDPG), to generate an optimal control strategy for a multi-zone residential HVAC system with the goal of minimizing energy consumption cost while maintaining the users’ comfort. Here, the applied deep RL-based method learns through continuous interaction with a simulated building environment and without referring to any prior model knowledge. Simulation results show that compared with the state-of-art deep Q network (DQN), the DDPG-based HVAC control strategy can reduce the energy consumption cost by 15% and reduce the comfort violation by 79%; and when compared with a rule-based HVAC control strategy, the comfort violation can be reduced by 98%. In addition, experiments with different building models and retail price models demonstrate that the well-trained DDPG-based HVAC control strategy has high generalization and adaptability to unseen environments, which indicates its practicability for real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Multi‐Material Gradient Printing Using Meniscus‐enabled Projection Stereolithography (MAPS)

Light‐based additive manufacturing methods are widely used to print high‐resolution 3D structures for applications in tissue engineering, soft robotics, photonics, and microfluidics, among others. Despite this progress, multi‐material printing with these methods remains challenging due to constraints associated with hardware modifications, control systems, cross‐contamination, waste, and resin properties. Here, a new printing platform coined Meniscus‐enabled Projection Stereolithography (MAPS) is reported, a vat‐free method that relies on generating and maintaining a resin meniscus between a crosslinked structure and bottom window to print lateral, vertical, discrete, or gradient multi‐material 3D structures with no waste and user‐defined mixing between layers. MAPS is compatible with a wide range of resins shown and can print complex multi‐material 3D structures without requiring specialized hardware, software, or complex washing protocols. MAPS's ability to print structures with microscale variations in mechanical stiffness, opacity, surface energy, cell densities, and magnetic properties provides a generic method to make advanced materials for a broad range of applications.

bioprinting↗
DOE OSTI2023

Accelerating gradient descent and Adam via fractional gradients

Here we propose a class of novel fractional-order optimization algorithms. We define a fractional-order gradient via the Caputo fractional derivatives that generalizes integer-order gradient. We refer it to as the Caputo fractional-based gradient, and develop an efficient implementation to compute it. A general class of fractional-order optimization methods is then obtained by replacing integer-order gradients with the Caputo fractional-based gradients. To give concrete algorithms, we consider gradient descent (GD) and Adam, and extend them to the Caputo fractional GD (CfGD) and the Caputo fractional Adam (CfAdam). We demonstrate the superiority of CfGD and CfAdam on several large scale optimization problems that arise from scientific machine learning applications, such as ill-conditioned least squares problem on real-world data and the training of neural networks involving non-convex objective functions. Numerical examples show that both CfGD and CfAdam result in acceleration over GD and Adam, respectively. We also derive error bounds of CfGD for quadratic functions, which further indicate that CfGD could mitigate the dependence on the condition number in the rate of convergence and results in significant acceleration over GD.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

DEVELOPMENT AND APPLICATION OF RISK ANALYSIS TOOLKIT FOR PLANT RESOURCE OPTIMIZATION

This paper presents the development of methods and tools that are being designed to optimize plant operations (e.g., maintenance/replacement schedules and optimal maintenance postures for plant components) in a manner that is more cost effective than current approaches and makes better use of available component health and cost data. These methods include both data- and model-based optimization methods. Model-based optimization methods directly include reliability and cost models to determine an optimal plant operational strategy. We consider gradient-based and evolutionary (based on genetic algorithms) optimization methods. The second class of methods target more specific use cases (e.g., project schedule optimization) and are not based on reliability models directly, but they require specific component reliability and cost data. This class of methods is based on variants of the knapsack problem with an aim to determine an optimal project schedule that maximizes the overall NPV. This paper also presents multi-objective methods designed to identify an optimal maintenance posture based on a Pareto frontier analysis. Rather than dictating the “right” tradeoff (i.e., identify the absolute best posture), we show how it is possible to perform a trade space exploration approach (i.e., identify value and costs of several postures and let the analysis account for desired value and cost metrics). This is performed by identifying maintenance postures that maximize value (e.g., system availability) and minimize operational costs, i.e., the Pareto frontier in a value-cost trade space. For all these methods we present detailed applicative examples that show their validity from a decision-making perspective.

97 - MATHEMATICS AND COMPUTING↗
NASA NTRS1978

Inviscid, nonadiabatic flow fields over blunt, sonic corner bodies for outer planet entry conditions by a method of integral relations

An investigation has been made into the ability of a method of integral relations to calculate inviscid zero degree angle of attack, radiative heating distributions over blunt, sonic corner bodies for some representative outer planet entry conditions is investigated. Comparisons have been made with a more detailed numerical method, a time asymptotic technique, using the same equilibrium chemistry and radiation transport subroutines. An effort to produce a second order approximation (two-strip) method of integral relations code to aid in this investigation is also described and a modified two-strip routine is presented. Results indicate that the one-strip method of integral relations cannot be used to obtain accurate estimates of the radiative heating distribution because of its inability to resolve thermal gradients near the wall. The two-strip method can sometimes be used to improve these estimates; however, the two-strip method has only a small range of conditions over which it will yield significant improvement over the one-strip method.

Gnoffo, P. A.↗
NASA NTRS2018

Solution of Ordinary Differential Equations in Gradient-Based Multidisciplinary Design Optimization

A gradient-based approach to multidisciplinary design optimization enables efficient scalability to large numbers of design variables. However, the need for derivatives causes difficulties when integrating ordinary differential equations (ODEs) in models. To simplify this, we propose the use of the general linear methods framework, which unifies all Runge-Kutta and linear multistep methods. This approach enables rapid implementation of integration methods without the need to differentiate each one, even in a gradient-based optimization context. We also develop a new parallel time integration algorithm that enables vectorization across time steps. We present a set of benchmarking results using a stiff ODE, a non-stiff nonlinear ODE, and an orbital dynamics ODE, and compare integration methods. In a modular gradient-based multidisciplinary design optimization context, we find that the new parallel time integration algorithm with high-order implicit methods, especially Gauss-Legendre collocation, is the best choice for a broad range of problems.

Hwang, John T.↗
NASA NTRS2006

Single- and Multiple-Objective Optimization with Differential Evolution and Neural Networks

Genetic and evolutionary algorithms have been applied to solve numerous problems in engineering design where they have been used primarily as optimization procedures. These methods have an advantage over conventional gradient-based search procedures became they are capable of finding global optima of multi-modal functions and searching design spaces with disjoint feasible regions. They are also robust in the presence of noisy data. Another desirable feature of these methods is that they can efficiently use distributed and parallel computing resources since multiple function evaluations (flow simulations in aerodynamics design) can be performed simultaneously and independently on ultiple processors. For these reasons genetic and evolutionary algorithms are being used more frequently in design optimization. Examples include airfoil and wing design and compressor and turbine airfoil design. They are also finding increasing use in multiple-objective and multidisciplinary optimization. This lecture will focus on an evolutionary method that is a relatively new member to the general class of evolutionary methods called differential evolution (DE). This method is easy to use and program and it requires relatively few user-specified constants. These constants are easily determined for a wide class of problems. Fine-tuning the constants will off course yield the solution to the optimization problem at hand more rapidly. DE can be efficiently implemented on parallel computers and can be used for continuous, discrete and mixed discrete/continuous optimization problems. It does not require the objective function to be continuous and is noise tolerant. DE and applications to single and multiple-objective optimization will be included in the presentation and lecture notes. A method for aerodynamic design optimization that is based on neural networks will also be included as a part of this lecture. The method offers advantages over traditional optimization methods. It is more flexible than other methods in dealing with design in the context of both steady and unsteady flows, partial and complete data sets, combined experimental and numerical data, inclusion of various constraints and rules of thumb, and other issues that characterize the aerodynamic design process. Neural networks provide a natural framework within which a succession of numerical solutions of increasing fidelity, incorporating more realistic flow physics, can be represented and utilized for optimization. Neural networks also offer an excellent framework for multiple-objective and multi-disciplinary design optimization. Simulation tools from various disciplines can be integrated within this framework and rapid trade-off studies involving one or many disciplines can be performed. The prospect of combining neural network based optimization methods and evolutionary algorithms to obtain a hybrid method with the best properties of both methods will be included in this presentation. Achieving solution diversity and accurate convergence to the exact Pareto front in multiple objective optimization usually requires a significant computational effort with evolutionary algorithms. In this lecture we will also explore the possibility of using neural networks to obtain estimates of the Pareto optimal front using non-dominated solutions generated by DE as training data. Neural network estimators have the potential advantage of reducing the number of function evaluations required to obtain solution accuracy and diversity, thus reducing cost to design.

Rai, Man Mohan↗
DOE OSTI2022

Design of an additively manufactured functionally graded material of 316 stainless steel and Ti-6Al-4V with Ni-20Cr, Cr, and V intermediate compositions

This study presents a method for designing a computationally informed gradient pathway to fabricate a functionally graded material (FGM) with terminal alloys of 316 stainless steel (SS316) and Ti-6Al-4V via directed energy deposition additive manufacturing with powder feedstock. In this work, the grading is accomplished through the introduction of intermediate elements and alloys (Ni-20Cr, Cr, and V) to avoid the brittle Fe-Ti intermetallic phases that form in the direct liquid phase joining of Ti-alloys and stainless steels. Using a combination of equilibrium calculations and Scheil-Gulliver simulations, a compositional pathway was designed to avoid deleterious phases. FGM samples were fabricated and experimentally characterized to determine the viability of the pathway. A change in phases from fcc to bcc was predicted to occur within the Ni-20Cr/Cr gradient region, and this was validated through experimental characterization. No detrimental phases (intermetallic, Laves, or σ phases) formed along the gradient path, demonstrating a successful computationally-informed design and fabrication of an FGM from SS316 to Ti-6Al-4V.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Nonlinear sparse Bayesian learning for physics-based models

This paper addresses the issue of overfitting while calibrating unknown parameters of over-parameterized physics-based models with noisy and incomplete observations. Here, a semi-analytical Bayesian framework of nonlinear sparse Bayesian learning (NSBL) is proposed to identify sparsity among model parameters during Bayesian inversion. NSBL offers significant advantages over machine learning algorithm of sparse Bayesian learning (SBL) for physics-based models, such as 1) the likelihood function or the posterior parameter distribution is not required to be Gaussian, and 2) prior parameter knowledge is incorporated into sparse learning (i.e. not all parameters are treated as questionable). NSBL employs the concept of automatic relevance determination (ARD) to facilitate sparsity among questionable parameters through parameterized prior distributions. The analytical tractability of NSBL is enabled by employing Gaussian ARD priors and by building a Gaussian mixture-model approximation of the posterior parameter distribution that excludes the contribution of ARD priors. Subsequently, type-II maximum likelihood is executed using Newton's method whereby the evidence and its gradient and Hessian information are computed in a semi-analytical fashion. We show numerically and analytically that SBL is a special case of NSBL for linear regression models. Subsequently, a linear regression example involving multimodality in both parameter posterior pdf and model evidence is considered to demonstrate the performance of NSBL in cases where SBL is inapplicable. Next, NSBL is applied to identify sparsity among the damping coefficients of a mass-spring-damper model of a shear building frame. These numerical studies demonstrate the robustness and efficiency of NSBL in alleviating overfitting during Bayesian inversion of nonlinear physics-based models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗