Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Seismic Monitoring at the Farnsworth CO2-EOR Field Using Time-Lapse Elastic-Waveform Inversion of 3D-3C VSP Data

During the Development Phase of the U.S. Southwest Regional Partnership on Carbon Sequestration, supercritical CO2 was continuously injected into the deep oil-bearing Morrow B formation of the Farnsworth Unit in Texas for Enhanced Oil Recovery (EOR). The project injected approximately 94 kilotons of CO2 to study geologic carbon storage during CO2-EOR. A three-dimensional (3D) surface seismic dataset was acquired in 2013 to characterize the subsurface structures of the Farnsworth site. Following this data acquisition, the baseline and three time-lapse three-dimensional three-component (3D-3C) vertical seismic profiling (VSP) data were acquired at a narrower surface area surrounding the CO2 injection and oil/gas production wells between 2014 and 2017 for monitoring CO2 injection and migration. With these VSP datasets, we inverted for subsurface velocity models to quantitatively monitor the CO2 plume within the Morrow B formation. We first built 1D initial P-wave (Vp) and S-wave (Vs) velocity models by upscaling the sonic logs. We improved the deep region of the Vp and Vs models by incorporating the deep part of a migration velocity model derived from the 3D surface seismic data. We improved the shallow region of 3D Vp and Vs models using 3D traveltime tomography of first arrivals of VSP downgoing waves. We further improved the 3D baseline velocity models using elastic-waveform inversion (EWI) of the 3D baseline VSP upgoing data. Our advanced EWI method employs alternative tomographic and conventional gradients and total-variation-based regularization to ensure the high-fidelity updates of the 3D baseline Vp and Vs models. We then sequentially applied our 3D EWI method to the three time-lapse datasets to invert for spatiotemporal changes of Vp and Vs in the reservoir. Our inversion results reveal the volumetric changes of the time-lapse Vp and Vs models and show the evolution of the CO2 plume from the CO2 injection well to the oil/gas production wells.

42 ENGINEERING↗
DOE OSTI2022

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Integrated path planning and control through proximal policy optimization for a marine current turbine

This paper presents an integrated path planning and tracking control framework for a marine current turbine (MCT), where the MCT is treated as an energy-harvesting autonomous underwater vehicle (AUV). Considering the ocean (space of action) is continuous, the proposed framework employs two modules to address path planning and path tracking enabled by the proximal policy optimization (PPO) algorithm, which is a policy gradient deep reinforcement learning (RL) method. Further, to enable fully autonomous operation in a stochastic oceanic environment, the proposed path planning seeks a primary objective of maximizing the harvested energy; then, the path tracking module is designed to minimize the tracking error and avoid collisions with static and dynamic obstacles. Using field-collected acoustic Doppler current profiler (ADCP) data, the performance of the proposed framework is evaluated. Comparative studies with baseline algorithms in three different scenarios of path planning, path tracking without an obstacle, and path tracking with collision avoidance verify the effectiveness of our proposed approach.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Exploration of the parameter space of quasisymmetric stellarator vacuum fields through adjoint optimisation

Optimising stellarators for quasisymmetry leads to strongly reduced collisional transport and energetic particle losses compared with unoptimised configurations. Although stellarators with precise quasisymmetry have been obtained in the past, it remains unclear how broad the parameter space is where good quasisymmetry may be achieved. We study the range of aspect ratios and rotational transform values for which stellarators with excellent quasisymmetry on the boundary can be obtained. A large number of Fourier harmonics is included in the boundary representation, which is made computationally tractable by the use of adjoint methods to enable fast gradient-based optimisation and by the direct optimisation of vacuum magnetic fields, which converge more robustly compared with solutions from magnetohydrostatics. Several novel configurations are presented, including stellarators with record levels of quasisymmetry on a surface, three field period quasiaxisymmetric stellarators with substantial magnetic shear, and compact quasisymmetric stellarators at low aspect ratios similar to tokamaks.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Current advances on Talbot–Lau x-ray imaging diagnostics for high energy density experiments (invited)

Talbot–Lau x-ray interferometry is a refraction-based diagnostic that can map electron density gradients through phase-contrast methods. The Talbot–Lau x-ray deflectometry (TXD) diagnostics have been deployed in several high energy density experiments. To improve diagnostic performance, a monochromatic TXD was implemented on the Multi-Tera Watt (MTW) laser using 8 keV multilayer mirrors (Δθ/θ = 4.5%-5.6%). Copper foil and wire targets were irradiated at 10 14 –10 15 W/cm 2 . Laser pulse length (~10 to 80 ps) and backlighter target configurations were explored in the context of Moiré fringe contrast and spatial resolution. Foil and wire targets delivered increased contrast <30%. The best spatial resolution (<6 μm) was measured for foils irradiated 80° from the surface. Further TXD diagnostic capability enhancement was achieved through the development of advanced data postprocessing tools. The Talbot Interferometry Analysis (TIA) code enabled x-ray refraction measurements from the MTW monochromatic TXD. Additionally, phase, attenuation, and dark-field maps of an ablating x-pinch load were retrieved through TXD. The images show a dense wire core of ~60 μm diameter surrounded by low-density material of ~40 μm thickness with an outer diameter ratio of ~2.3. Attenuation at 8 keV was measured at ~20% for the dense core and ~10% for the low-density material. Instrumental and experimental limitations for monochromatic TXD diagnostics are presented. Enhanced postprocessing capabilities enabled by TIA are demonstrated in the context of high-intensity laser and pulsed power experimental data analysis. Significant advances in TXD diagnostic capabilities are presented. Furthermore, these results inform future diagnostic technique upgrades that will improve the accuracy of plasma characterization through TXD.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Spatially resolved measurements of plasma ion velocity distributions in a dipole magnetic field

The equilibrium flows of a plasma discharge in a dipole magnetic field are a topic of interest in low temperature plasma physics. Experimentalists typically rely on probe-based and line-integrated diagnostic techniques in these environments to describe plasma behavior. Presented here are measurements of argon ion dynamics with laser induced fluorescence techniques to provide insight into plasma dynamics in dipole magnetic fields with nonperturbative, spatially localized measurements. Simulation results from a Lagrangian approach to track particle orbits are compared to measured density profiles and provide evidence to support the mechanism distinguishing experimental configurations is the initial approach of particles. Applying a negative DC bias to the magnet induces strong E×B flows around the magnet, even exceeding the ion acoustic speed as measured far from the magnet. A strong enough bias also produces two distinct ion populations and provides a method for controlling the density gradient on the equator.

McLaughlin, Jacob W. (ORCID:0000000152661888)↗
DOE OSTI2023

Sparse adaptive basis set methods for solution of the time dependent Schrodinger equation

Scalable numerical solutions to the time dependent Schrodinger equation remain an outstanding goal in theoretical chemistry. Here we present a method which utilises recent breakthroughs in signal processing to consistently adapt a dictionary of basis functions to the dynamics of the system. Further, we show that for two low-dimensional model problems the size of the basis set does not grow quickly with time and appears only weakly dependent on dimensionality. The generality of this finding remains to be seen. The method primarily uses energies and gradients of the potential, opening the possibility for its use in on-the-fly ab initio quantum wavepacket dynamics.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2022

Estimating cluster masses from SDSS multiband images with transfer learning

ABSTRACT The total masses of galaxy clusters characterize many aspects of astrophysics and the underlying cosmology. It is crucial to obtain reliable and accurate mass estimates for numerous galaxy clusters over a wide range of redshifts and mass scales. We present a transfer-learning approach to estimate cluster masses using the ugriz-band images in the SDSS Data Release 12. The target masses are derived from X-ray or SZ measurements that are only available for a small subset of the clusters. We designed a semisupervised deep learning model consisting of two convolutional neural networks. In the first network, a feature extractor is trained to classify the SDSS photometric bands. The second network takes the previously trained features as inputs to estimate their total masses. The training and testing processes in this work depend purely on real observational data. Our algorithm reaches a mean absolute error (MAE) of 0.232 dex on average and 0.214 dex for the best fold. The performance is comparable to that given by redMaPPer, 0.192 dex. We have further applied a joint integrated gradient and class activation mapping method to interpret such a two-step neural network. The performance of our algorithm is likely to improve as the size of training data set increases. This proof-of-concept experiment demonstrates the potential of deep learning in maximizing the scientific return of the current and future large cluster surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2021

Separation of Lanthanide Isotopes from Mixed Fission Product Samples

The measurement of radioactive fission products from nuclear events has important implications for nuclear data production, environmental monitoring, and nuclear forensics. In a previous paper, the authors reported the optimization of an intra-group lanthanide separation using LN extraction resin from Eichrom Technologies®, Inc. and a nitric acid gradient. In this work, the method was demonstrated for the separation and quantification of multiple short-lived fission product lanthanide isotopes from a fission product sample produced from the thermal irradiation of highly enriched uranium. The separations were performed in parallel in quadruplicate with reproducible results and high decontamination factors for 153 Sm, 156 Eu, and 161 Tb. Based on the results obtained here, the fission yields for 144 Ce, 153 Sm, 156 Eu, and 161 Tb are consistent with published fission yields. This work demonstrates the effectiveness of the separations for the intended application of short-lived lanthanide fission product analysis requiring high decontamination factors.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

Median bed-material sediment particle size across rivers in the contiguous US

Abstract. Bed-material sediment particle size data, particularly the median sediment particle size (D50), are critical for understanding and modeling riverine sediment transport. However, sediment particle size observations are primarily available at individual sites. Large-scale modeling and assessment of riverine sediment transport are limited by the lack of continuous regional maps of bed-material sediment particle size. We hence present a map of D50 over the contiguous US in a vector format that corresponds to approximately 2.7 million river segments (i.e., flowlines) in the National Hydrography Dataset Plus (NHDPlus) dataset. We develop the map in four steps: (1) collect and process the observed D50 data from 2577 U.S. Geological Survey stations or U.S. Army Corps of Engineers sampling locations; (2) collocate these data with the NHDPlus flowlines based on their geographic locations, resulting in 1691 flowlines with collocated D50 values; (3) develop a predictive model using the eXtreme Gradient Boosting (XGBoost) machine learning method based on the observed D50 data and the corresponding climate, hydrology, geology, and other attributes retrieved from the NHDPlus dataset; and (4) estimate the D50 values for flowlines without observations using the XGBoost predictive model. We expect this map to be useful for various purposes, such as research in large-scale river sediment transport using model- and data-driven approaches, teaching environmental and earth system sciences, planning and managing floodplain zones, etc. The map is available at https://doi.org/10.5281/zenodo.4921987 (Li et al., 2021a).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1969

Compressible Turbulent Boundary Layers

Compressibility of turbulent boundary layers - skin friction, heat transfer, flow velocity, temperature distribution, pressure gradients, and aerodynamic drag prediction methods

Source record↗
NASA NTRS1978

AAA gunnermodel based on observer theory

The Luenberger observer theory is used to develop a predictive model of a gunner's tracking response in antiaircraft artillery systems. This model is composed of an observer, a feedback controller and a remnant element. An important feature of the model is that the structure is simple, hence a computer simulation requires only a short execution time. A parameter identification program based on the least squares curve fitting method and the Gauss Newton gradient algorithm is developed to determine the parameter values of the gunner model. Thus, a systematic procedure exists for identifying model parameters for a given antiaircraft tracking task. Model predictions of tracking errors are compared with human tracking data obtained from manned simulation experiments. Model predictions are in excellent agreement with the empirical data for several flyby and maneuvering target trajectories.

Kou, R. S.↗
NASA NTRS1984

Power system applications of fiber optics

Power system applications of optical systems, primarily using fiber optics, are reviewed. The first section reviews fibers as components of communication systems. The second section deals with fiber sensors for power systems, reviewing the many ways light sources and fibers can be combined to make measurements. Methods of measuring electric field gradient are discussed. Optical data processing is the subject of the third section, which begins by reviewing some widely different examples and concludes by outlining some potential applications in power systems: fault location in transformers, optical switching for light fired thyristors and fault detection based on the inherent symmetry of most power apparatus. The fourth and final section is concerned with using optical fibers to transmit power to electric equipment in a high voltage situation, potentially replacing expensive high voltage low power transformers. JPL has designed small photodiodes specifically for this purpose, and fabricated and tested several samples. This work is described.

Kirkham, H.↗
NASA NTRS1986

Iterative methods for elliptic finite element equations on general meshes

Iterative methods for arbitrary mesh discretizations of elliptic partial differential equations are surveyed. The methods discussed are preconditioned conjugate gradients, algebraic multigrid, deflated conjugate gradients, an element-by-element techniques, and domain decomposition. Computational results are included.

Nicolaides, R. A.↗
NASA NTRS1990

Performance analysis of structured gradient algorithm

The structured gradient algorithm uses a structured estimate of the array correlation matrix (ACM) to estimate the gradient required for the constrained least-mean-square (LMS) algorithm. This structure reflects the structure of the exact array correlation matrix for an equispaced linear array and is obtained by spatial averaging of the elements of the noisy correlation matrix. In its standard form the LMS algorithm does not exploit the structure of the array correlation matrix. The gradient is estimated by multiplying the array output with the receiver outputs. An analysis of the two algorithms is presented to show that the covariance of the gradient estimated by the structured method is less sensitive to the look direction signal than that estimated by the standard method. The effect of the number of elements on the signal sensitivity of the two algorithms is studied.

Godara, Lal C.↗
NASA NTRS1993

Multicomponent Convection Induced by Fronts in the Chlorate-Sulfite Reaction

An application of a new method is presented for the measurement of the temperature profiles of chemical waves propagating through a solution. Using solutions of thermocolor materials, the temperature distribution caused by the heat released in the propagating chlorate oxidation of sulfite was visualized and recorded using digital image processing methods. After calibration, the temperature gradient was calculated from the gray scale value in a digitized image. Extensive multicomponent convection ('fingering') was induced by descending fronts. Only ascending fingers were observed because of the large thermal gradient that suppressed descending ones. The characteristics of the temperature profile were determined as a function of initial sulfite and chlorate concentration, and tube diameter. Unusual behavior was observed when the fronts propagated under conditions of continuously changing diameter in a conical vessel. Fingering occurred periodically in a front descending in a flask with an increasing diameter. However, when a front propagated down in flask whose diameter decreased, no multicomponent convection was observed.

Nagy, Istvan P.↗
NASA NTRS1996

Cascade Error Projection: A Learning Algorithm for Hardware Implementation

In this paper, we workout a detailed mathematical analysis for a new learning algorithm termed Cascade Error Projection (CEP) and a general learning frame work. This frame work can be used to obtain the cascade correlation learning algorithm by choosing a particular set of parameters. Furthermore, CEP learning algorithm is operated only on one layer, whereas the other set of weights can be calculated deterministically. In association with the dynamical stepsize change concept to convert the weight update from infinite space into a finite space, the relation between the current stepsize and the previous energy level is also given and the estimation procedure for optimal stepsize is used for validation of our proposed technique. The weight values of zero are used for starting the learning for every layer, and a single hidden unit is applied instead of using a pool of candidate hidden units similar to cascade correlation scheme. Therefore, simplicity in hardware implementation is also obtained. Furthermore, this analysis allows us to select from other methods (such as the conjugate gradient descent or the Newton's second order) one of which will be a good candidate for the learning technique. The choice of learning technique depends on the constraints of the problem (e.g., speed, performance, and hardware implementation); one technique may be more suitable than others. Moreover, for a discrete weight space, the theoretical analysis presents the capability of learning with limited weight quantization. Finally, 5- to 8-bit parity and chaotic time series prediction problems are investigated; the simulation results demonstrate that 4-bit or more weight quantization is sufficient for learning neural network using CEP. In addition, it is demonstrated that this technique is able to compensate for less bit weight resolution by incorporating additional hidden units. However, generation result may suffer somewhat with lower bit weight quantization.

Duong, Tuan A.↗