Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “nonparametric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Environmental sciences↗

Amplified Mesoscale and Submesoscale Variability and Increased Concentration of Precipitation under Global Warming over Western North America

Abstract Cold-season precipitation statistics in simulations from the storm-resolving WRF Model at 6-km and 1-h resolution over western North America are analyzed. Pseudo–global warming future simulations for the 2041–80 period, constrained by GCMs under the RCP8.5 scenario, are compared to the 1981–2020 historical simulation. The analysis focuses on the dynamical properties of precipitation time series at subdaily scales and on the morphology of storms. The statistical distribution of precipitation intensities in each pixel of the simulation domain is characterized through nonparametric statistical indicators: frequency of wet hours, mean wet-hour precipitation intensity, and Gini coefficient as a measure of the temporal concentration of the precipitation volume. Additionally, the temporal and spatial Fourier power spectra of precipitation time series and precipitation fields are analyzed. The half-power period (HPP) and half-power wavelength (HPW) are defined as spectral measures of the characteristic scales of precipitation’s temporal and spatial patterns. The results show statistically significant increases in the mean wet-hour precipitation intensity and in the Gini coefficient in 99% of the pixels, indicating that the seasonal precipitation volume becomes more concentrated within a smaller number of hours with higher precipitation intensity. The statistics of change in the frequency of wet hours are more contrasted across the simulation domain. The changes are also reflected in the power spectra, which show the spatial and temporal variability increasing proportionally more with finer spatial and temporal scales and the HPW and HPP decreasing. These projected changes are expected to have consequences, not only in terms of hydrologic impacts but also in terms of the predictability of precipitation patterns. Significance Statement The precipitation characteristics of winter storms over the western United States and southwestern Canada are analyzed in future climate simulations for the 2041–80 period. As compared to present-day climate, the most intense parts of the storms are projected to produce a higher rainfall volume, with increased concentration over smaller areas and shorter time intervals. The propensity of rainfall intensity to vary rapidly over time will be enhanced in the future according to the simulations. These model predictions imply an increased risk of rapid flooding in small basins. They also suggest that predicting several hours ahead the time and location at which a storm will produce maximum rainfall may become more challenging in the future.

Climate change↗

The scientific jigsaw puzzle: Fitting the pieces of the low-level radiation debate

Quantitative risk estimates from exposure to ionizing radiation are dominated by analysis of the one-time exposures received by the Japanese survivors at Hiroshima and Nagasaki. Three recent epidemiologic studies suggest that the risk from protracted exposure is no lower, and in fact may be higher, than from single exposures. There is near-universal acceptance that epidemiologic data demonstrates an excess risk of delayed cancer incidence above a dose of 0.1 sievert (Sv), which, for the average American, is equivalent to 40 years of unavoidable exposure from natural background radiation. Model fits, both parametric and nonparametric, to the atomic-bomb data support a linear no-threshold model, below 0.1 Sv. On the basis of biologic arguments, the scientific establishment in the United States and many other countries accepts this dose-model down to zero-dose, but there is spirited dissent. The dissent may be irrelevant for developed countries, given the increase in medical diagnostic radiation that has occurred in recent decades; a sizeable percentage of this population will receive cumulative doses from the medical profession in excess of 0.1 Sv, making talk of a threshold or other sublinear response below that dose moot for future releases from nuclear facilities or a dirty bomb. The risks from both medical diagnostic doses and nuclear accident doses can be computed using the linear dose-response model, with uncertainties assigned below 0.1 Sv in a way that captures alternative scientific hypotheses. Then, the important debate over low-level radiation exposures, namely planning for accident response and weighing benefits and risks of technologies, can proceed with less distraction. One of the biggest paradoxes in the low-level radiation debate is that an individual risk can be a minor concern, while the societal risk-the total delayed cancers in an exposed population-can be of major concern.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

VADER: A Tool for Criticality Safety Validation

The purpose of criticality safety is to prevent any inadvertent criticality from occurring during the handling or storage of fissile material. Calculations are frequently used to demonstrate that a sufficient subcritical margin exists. Validation is a key aspect of the evaluation process, establishing the suitability, accuracy, and associated uncertainty of the computational method and data to be used for the intended application. The validation process is performed by comparing the results of critical experiments with the calculated results from models of the experiments using the computational method to be validated. Laboratory critical experiments are controlled systems that achieve a k eff of approximately 1 in order to investigate the parameters at which such a critical condition is achieved. The validation parameters that are traditionally applied to safety analysis calculations are the bias and the bias uncertainty . The bias is the deviation of the average k eff of the validation suite from unity. The bias uncertainty accounts for the statistical uncertainty in the bias based on the standard deviation, sample size, and distribution of k eff values of the validation suite. The values of bias and bias uncertainty ensure that the systems predicted to be subcritical by the computational method will indeed be subcritical. The bias and bias uncertainty are often combined to determine an upper subcritical limit (USL) or computational margin that can then be applied to safety analysis calculations. Many methods have been developed by different organizations to calculate the bias and bias uncertainty for various types of criticality analyses. Each of these methods typically requires that the validity of various underpinning statistical assumptions be confirmed to demonstrate that the method is appropriate for the analysis of a given validation suite. An example of the validation decision making flow is shown in Fig.1. As shown in Fig. 1, the analyst performing the validation fits a trend line to the data and performs a test to determine if the trend was a statistically better representation of the data than if it were treated as an uncorrelated sample. If the trend line is a better representation of the data, then the analyst uses any one of a number of trending techniques to determine the bias and bias uncertainty. If a trend is not an appropriate representation of the data, then the analyst proceeds to perform a normality assessment for the data. If the normal assumption can be shown to be acceptable, then the analyst calculates the bias and bias uncertainty with the parametric technique. If the assumption of normality cannot be justified, then the nonparametric technique is used. Once the decision flow has been followed and the appropriate technique has been selected, the bias and bias uncertainty is typically combined with an administrative margin to determine a USL below which calculated values of k eff for safety analysis models can be considered subcritical. The calculations used in each decision are often performed with spreadsheets or with small programs available at various sites performing criticality analyses. Expertise in understanding and interpreting the results must be maintained to perform these calculations. This can often be an error-prone process. Oak Ridge National Laboratory (ORNL) is currently developing the Validation and Data Evaluation Resource (VADER) to simplify and automate the criticality safety validation process and to provide a software quality assurance pedigree to the calculational methods used. This paper discusses the use of the Fulcrum user interface with VADER, the anticipated initial capabilities of VADER to perform validation analyses, and the output from the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty quantification in ToxCast high throughput screening

High throughput screening (HTS) projects like the U.S. Environmental Protection Agency’s ToxCast program are required to address the large and rapidly increasing number of chemicals for which we have little to no toxicity measurements. Concentration-response parameters such as potency and efficacy are extracted from HTS data using nonlinear regression, and models and analyses built from these parameters are used to predict in vivo and in vitro toxicity of thousands of chemicals. How these predictions are impacted by uncertainties that stem from parameter estimation and propagated through the models and analyses has not been well explored. While data size and complexity makes uncertainty quantification computationally expensive for HTS datasets, continued advancements in computational resources have allowed these computational challenges to be met. This study uses nonparametric bootstrap resampling to calculate uncertainties in concentration-response parameters from a variety of HTS assays. Using the ToxCast estrogen receptor model for bioactivity as a case study, we highlight how these uncertainties can be propagated through models to quantify the uncertainty in model outputs. Uncertainty quantification in model outputs is used to identify potential false positives and false negatives and to determine the distribution of model values around semi-arbitrary activity cutoffs, increasing confidence in model predictions. At the individual chemical-assay level, curves with high variability are flagged for manual inspection or retesting, focusing subject-matter-expert time on results that need further input. This work improves the confidence of predictions made using HTS data, increasing the ability to use this data in risk assessment.

59 BASIC BIOLOGICAL SCIENCES↗

Quantile-specific heritability of plasma fibrinogen concentrations

Fibrinogen is a moderately heritable blood protein showing different genetic effects by sex, race, smoking status, pollution exposure, and disease status. These interactions may be explained in part by “quantile-dependent expressivity”, where the effect size of a genetic variant depends upon whether the phenotype (e.g. plasma fibrinogen concentration) is high or low relative to its distribution. Determine whether fibrinogen heritability (h 2 ) is quantile-specific, and whether quantile-specific h 2 could account for fibrinogen gene-environment interactions. Plasma fibrinogen concentrations from 5689 offspring-parent pairs and 1932 sibships from the Framingham Heart Study were analyzed. Quantile-specific heritability from offspring-parent (β OP , h 2 = 2β OP /(1+r spouse )) and full-sib regression slopes (β FS , h 2 = {(1+8r spouse β FS ) 0.05 –1}/(2r spouse )) were robustly estimated by quantile regression with nonparametric significance assigned from 1000 bootstrap samples. Quantile-specific h 2 (±SE) increased with increasing percentiles of the offspring’s age- and sex-adjusted fibrinogen distribution when estimated from β OP (P trend = 5.5x10 -6 ): 0.30±0.05 at the 10 th , 0.37±0.04 at the 25 th , 0.48±0.05 at the 50 th , 0.61±0.06 at the 75 th , and 0.65±0.08 at the 90 th percentile, and when estimated from β FS (P trend = 0.008): 0.28±0.04 at the 10 th , 0.31±0.04 at the 25 th , 0.36±0.03 at the 50 th , 0.41±0.05 at the 75 th , and 0.50±0.06 at the 90 th percentile. The larger genetic effect at higher average fibrinogen concentrations may contribute to fibrinogen’s greater heritability in women than men and in Blacks than Whites, and greater increase from smoking and air pollution for the FGB -455G>A A-allele. It may also explain greater fibrinogen differences between: 1) FGB -455G>A genotypes during acute phase reactions than usual conditions, 2) GTSM1 and IL-6 -572C>G genotypes in smokers than nonsmokers, 3) FGB -148C>T genotypes in untreated than treated diabetics, and LPL PvuII genotypes in macroalbuminuric than normoalbuminuric patients. Fibrinogen heritability is quantile specific, which may explain or contribute to its gene-environment interactions. The analyses do not disprove the traditional gene-environment interpretations of these examples, rather quantile-dependent expressivity provides an alternative explanation that warrants consideration.

59 BASIC BIOLOGICAL SCIENCES↗

Bioeconomy Survey Results Regarding Barriers to the United States Advanced Biofuel Industry

Although the 2005 Environmental Protection Act (EPAct) was enacted to bolster the emerging biofuel industry, 52% of advanced biofuel (AB) projects ended by 2015. However, there are no complete lists of internal and external barriers that can help to explain why these projects are failing. The goal of this study was to develop a list of barriers impeding advanced biofuel projects by conducting a survey of biofuel stakeholders. Based on a literature review and previous research, a list of 23 hypothesized internal and external barriers was elaborated. A survey was conducted to have industry stakeholders provide their perception on the list of hypothesized barriers. The perceptions of industry stakeholders were analyzed by dividing the sample in three different stakeholder groups: advanced biofuel industry members, government representatives, and a third category called others that included publishers, journalists, suppliers, and other related stakeholders to the industry. In addition, nonparametric statistical techniques were used to compare the perceptions of the groups. Here, the most significant results indicated that Technology issues was considered as an internal barrier for the three groups while Funding and Renewable Fuel Standards were perceived as external barriers by the three groups too. In addition, the rating of barriers was further analyzed only by AB industry stakeholders in order to uncover more details on the perception of barriers that might be preventing the AB industry to prosper.

09 BIOMASS FUELS↗

Strong correlation between stress drop and peak ground acceleration for recent M1–4 earthquakes in the San Francisco Bay Area

Theoretical and observational studies suggest that between-event variability in the median ground motions of larger ( M≥5 ) earthquakes is controlled primarily by the dynamic properties of the earthquake source, such as Brune-type stress drop. Analogous results remain equivocal for smaller events due to the lack of comprehensive and overlapping ground-motion and source-parameter datasets in this regime. Here in this paper, we investigate the relationship between peak ground acceleration (PGA) and dynamic stress drop for a new dataset of 5297 earthquakes that occurred in the San Francisco Bay area from 2002 through 2016. For each event, we measure PGA on horizontal-component channels of stations within 100 km and estimate stress drop from P-wave spectra recorded on vertical-component channels of the same stations. We then develop a nonparametric ground-motion prediction equation (GMPE) applicable for the moderate (M 1–4) earthquakes in our study region, using a mixed-effects generalization of the Random Forest algorithm. We use the Random Forest GMPE to model the joint influence of magnitude, distance, and near-site effects on observed PGA. We observe a strong correlation between dynamic stress drop and the residual PGA of each event, with the events with higher-than-expected PGA associated with higher values of stress drop. The strength of this correlation increases as a function of magnitude but remains significant even for smaller magnitude events with corner frequencies that approach the observable bandwidth of the acceleration records. Mainshock events are characterized by systematically higher stress drop and PGA than aftershocks of equivalent magnitude. Coherent local variations in the distribution of dynamic stress drop provide observational constraints to support the future development of nonergodic GMPEs that account for variations in median stress drop at different source locations.

58 GEOSCIENCES↗

Determining the significance of associations between two series of discrete events: bootstrap methods

We review and develop techniques to determine associations between series of discrete events. The bootstrap, a nonparametric statistical method, allows the determination of the significance of associations with minimal assumptions about the underlying processes. We find the key requirement for this method: one of the series must be widely spaced in time to guarantee the theoretical applicability of the bootstrap. If this condition is met, the calculated significance passes a reasonableness test. We conclude with some potential future extensions and caveats on the applicability of these methods. The techniques presented have been implemented in a Python-based software toolkit.

97 MATHEMATICS AND COMPUTING↗

Fracture Characterization in Enhanced Geothermal Systems by Wellbore and Reservoir Analysis

This report highlights the work that was done to characterize fractured geothermal reservoirs using production data. That includes methods that were developed to infer characteristic functions from production data and models that were designed to optimize reinjection scheduling into geothermal reservoirs, based on these characteristic functions. The characterization method provides a robust way of interpreting tracer and flow rate data from fractured reservoirs. The flow-rate data are used to infer the interwell connectivity, which describes how injected fluids are divided between producers in the reservoir. The tracer data are used to find the tracer kernel for each injector-producer connection. The tracer kernel describes the volume and dispersive properties of the interwell flow path. A combination of parametric and nonparametric regression methods were developed to estimate the tracer kernels for situations where data is collected at variable flow-rate or variable injected concentration conditions. The characteristic functions can be used to calibrate thermal transport models, which can in turn be used to predict the productivity of geothermal systems. This predictive model can be used to optimize injection scheduling in a geothermal reservoir, as is illustrated in this report.

15 GEOTHERMAL ENERGY↗

Radiological results for samples collected on paired glass- and cellulose-fiber filters at the Sandia complex, Tonopah Test Range, Nevada

Airborne particulates are collected at U.S. Department of Energy sites that exhibit radiological contamination on the soil surface to help assess the potential for wind to transport radionuclides from the contamination sites. Collecting these samples was originally accomplished by drawing air through a cellulose-fiber filter. These filters were replaced with glass-fiber filters in March 2011. Airborne particulates were collected side by side on the two filter materials between May 2013 and May 2014. Comparisons of the sample mass and the radioactivity determinations for the side-by-side samples were undertaken to determine if the change in the filter medium produced significant results. The differences in the results obtained using the two filter types were assessed visually by evaluating the time series and correlation plots and statistically by conducting a nonparametric matched-pair sign test. Generally, the glass-fiber filters collect larger samples of particulates and produce higher radioactivity values for the gross alpha, gross beta, and gamma spectroscopy analyses. However, the correlation between the radioanalytical results for the glass-fiber filters and the cellulose-fiber filters was not strong enough to generate a linear regression function to estimate the glass-fiber filter sample results from the cellulose-fiber filter sample results.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Gradient-based Optimization for Regression in the Functional Tensor-Train Format

We consider the task of low-multilinear-rank functional regression, i.e., learning a low-rank parametric representation of functions from scattered real-valued data. Our first contribution is the development and analysis of gradient-based optimization procedures, including stochastic gradient descent and quasi-Newton methods, for learning the parameters of a functional tensor-train (FT) that yields improved accuracy over standard alternating least squares methods. The functional tensor-train uses the tensor-train (TT) representation of low-rank arrays as an ansatz for a class of low-multilinear-rank functions. The FT is represented by a set of matrix-valued functions that contain a set of univariate functions, and the regression task is to learn the parameters of these univariate functions. Our second contribution demonstrates that using nonlinearly parameterized univariate functions, e.g., symmetric kernels with moving centers, within each core can outperform the standard approach of using a linear expansion of basis functions. Our final contributions are new rank adaptation and group-sparsity regularization procedures to minimize overfitting. We use several benchmark problems to demonstrate at least an order of magnitude lower accuracy with gradient-based optimization methods than ALS in the low-sample number regime. We also demonstrate an order of magnitude reduction in accuracy on a test problem resulting from nonlinear parameterizations over linear parameterizations. Finally we compare regression performance with 22 other nonparametric and parametric regression methods on 10 real-world data sets. We achieve top-five accuracy for seven of the data sets and best accuracy for two of the data sets. These rankings are the best amongst parametric models and competetive with the best non-parametric methods.

97 MATHEMATICS AND COMPUTING↗

GMLS-Nets: A Framework for Learning from Unstructured Data

Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a nonparametric technique for estimating linear bounded functionals from scattered data, and has recently been used in the literature for solving partial differential equations. By parameterizing the GMLS estimator, we obtain learning methods for operators with unstructured stencils. In GMLS-Nets the necessary calculations are local, readily parallelizable, and the estimator is supported by a rigorous approximation theory. We show how the framework may be used for unstructured physical data sets to perform functional regression to identify associated differential operators and to regress quantities of interest. The results suggest the architectures to be an attractive foundation for data-driven model development in scientific machine learning applications.

42 ENGINEERING↗

Thoughts on Analyzing Neutron Multiplicity Data

Bayesian methods offer many advantages for analyzing neutron multiplicity data. Ideally one would make nonparametric estimates of the the posterior distributions, the probabilities - given the data - for unknowns to take on particular values. Once one has the posterior, uncertainty quantification is very natural. We describe how different ways of formulating the statistical theory of fission chains are mathematically equivalent. When confronted with actual data and the burden of finite statistics, different methods of expressing the theory offer advantages for understanding the underlying source parameters from an information theory standpoint.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparative Analysis of Confidence Metrics for Nuclear Criticality Safety

Nuclear criticality safety standards provide guidance on the requirements and recommendations to establish confidence in computerized model results used to support operation with fissionable materials. By design, the guidance is not prescriptive, leaving the analysts free to determine how various sources of uncertainties are to be statistically aggregated. This report compares the analyses and key assumptions behind four notable methodologies documented in the nuclear criticality safety literature: the parametric, nonparametric, Whisper, and TSURFER methodologies. Because of the involved use of statistics entangled with heuristic recipes, the results of these methodologies are often difficult to interpret. Also, they are augmented by additional large administrative margins, eliminating the incentive to understand their differences. With the new resurgent wave of advanced nuclear systems focused on economizing operation—including advanced reactors, fuel cycles, and fuel concepts—there is a strong need to develop a clear understanding of uncertainties and their fusion methodologies to reduce uncertainties in a scientifically defensible manner. This report offers a deep dive into the various assumptions of the four noted methodologies, their adequacy, and their limitations, to provide guidance on developing confidence for the emergent nuclear systems. These systems are expected to be challenged by the scarcity of experimental data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗