SEARCH · Engineering Papers

Results for “probability distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

All sources NASA NTRS DOE OSTI

DOE OSTI2020

A catastrophic tropical drought kills hydraulically vulnerable tree species

Drought-related tree mortality is now a widespread phenomenon predicted to increase in magnitude with climate change. However, the patterns of which species and trees are most vulnerable to drought, and the underlying mechanisms have remained elusive, in part due to the lack of relevant data and difficulty of predicting the location of catastrophic drought years in advance. In this work, we used long-term demographic records and extensive databases of functional traits and distribution patterns to understand the responses of 20–53 species to an extreme drought in a seasonally dry tropical forest in Costa Rica, which occurred during the 2015 El Niño Southern Oscillation event. Overall, species-specific mortality rates during the drought ranged from 0% to 34%, and varied little as a function of tree size. By contrast, hydraulic safety margins correlated well with probability of mortality among species, while morphological or leaf economics spectrum traits did not. This firmly suggests hydraulic traits as targets for future research.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Accelerating template generation in resonant anomaly detection searches with optimal transport

We introduce Resonant Anomaly Detection with Optimal Transport (RAD-OT), a method for generating signal templates in resonant anomaly detection searches. RAD-OT leverages the fact that the samples from the conditional probability density of the target features vary approximately linearly along the optimal transport path connecting the resonant feature. This does not assume that the conditional density itself is linear with the resonant feature, allowing RAD-OT to efficiently capture multimodal relationships, changes in resolution, etc. By solving the optimal transport problem, RAD-OT can quickly build a template by interpolating between the background distributions in two sideband regions. We demonstrate the performance of RAD-OT using the LHC Olympics R&D dataset, where we find comparable sensitivity and improved stability with respect to deep learning-based approaches.

Automation↗

DOE OSTI2022

Inverse Modeling of Hydrologic Parameters in CLM4 via Generalized Polynomial Chaos in the Bayesian Framework

In this work, generalized polynomial chaos (gPC) expansion for land surface model parameter estimation is evaluated. We perform inverse modeling and compute the posterior distribution of the critical hydrological parameters that are subject to great uncertainty in the Community Land Model (CLM) for a given value of the output LH. The unknown parameters include those that have been identified as the most influential factors on the simulations of surface and subsurface runoff, latent and sensible heat fluxes, and soil moisture in CLM4.0. We set up the inversion problem in the Bayesian framework in two steps: (i) building a surrogate model expressing the input–output mapping, and (ii) performing inverse modeling and computing the posterior distributions of the input parameters using observation data for a given value of the output LH. The development of the surrogate model is carried out with a Bayesian procedure based on the variable selection methods that use gPC expansions. Our approach accounts for bases selection uncertainty and quantifies the importance of the gPC terms, and, hence, all of the input parameters, via the associated posterior probabilities.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Turn Your Half-Cut Cells for a Stronger Module

Here, we employ an existing model of crystalline silicon photovoltaic module cell fracture to explore the effect of cell size and orientation on their probability of fracture under module uniform loading. In addition, we also apply continuum damage mechanics to modify this model to consider the effect of cell fracture on the probability of subsequent cell fracture. We elucidate that cell fracture increases the probability of subsequent cell fracture and that rectangular modules containing half-cells aligned with the module's long orientation are much more robust against cell fracture than full-cell and half-cell short orientation modules.

14 SOLAR ENERGY↗

DOE OSTI2020

Evaluation of Foster Dam Juvenile Fish Passage, 2018 (Final Report)

This report presents the results of a fish passage study conducted by the Pacific Northwest National Laboratory (PNNL) for the U.S. Army Corps of Engineers Portland District (USACE) at Foster Dam (herein, Foster) during the spring (March–June) and fall (October–December) of 2018. The goal of this study was to provide biologists, engineers, resource managers, and regional decision-makers with information about passage of juvenile Chinook salmon and juvenile steelhead (or appropriate surrogates) through specific routes at Foster. The results of this study are intended to help facilitate decision-making regarding long-term measures for enhancing salmonid passage at Foster. Radio telemetry (RT) methods were instituted at low winter reservoir forebay elevation (low pool, 613 ft mean sea level (msl); spring 2018 and fall 2018) and high summer reservoir forebay elevation (high pool, 635 ft msl; late spring and early summer 2018) to accomplish the following objectives: I. Estimate the following passage metrics under typical operations (i.e., baseline conditions): a. Overall dam-passage survival and survival specific to each route of dam passage, calculated using two different methods: i. Cormack-Jolly-Seber (CJS) estimate: Probability of survival from dam passage to detection at the Primary Array, 19 river kilometers (rkm) downstream of Foster. ii. Virtual Release/Dead Fish Correction (ViRDCt) estimate: Corrects the bias that occurs from misidentifying fish that did not survive dam-passage as alive at the tailrace Egress Array, allowing an estimate of survival from dam passage to this array, 2.5 rkm downstream of Foster. b. Route distribution (passage proportions by route; also known as “passage efficiencies”). c. Efficiency metrics i. Dam-passage efficiency (DPE), the proportion of total fish passing the dam relative to the number of total fish detected in the near forebay of the dam and therefore available to pass. ii. Fish passage efficiency (FPE), the proportion of fish passing via a non-turbine route, relative to the number of total fish in the near forebay and available to pass. iii. Fish weir efficiency (FWE) and spill bay efficiency (SBE), the proportion of fish passing the weir or spill bays, respectively, relative to the total number of fish passing the dam. d. Reservoir residency time (time elapsed between release into reservoir and dam passage) and travel times through the system. II. Estimate efficiency and effectiveness of the new fish weir, compared to the turbines and the spillway. III. Under alternative operations, compare passage through each route (turbines, weir, spillway) using a block/treatment (on/off) design similar to the 2015 and 2016 studies. IV. Estimate efficiency of the new fish weir operating at a low level of discharge (< 500 cfs) and a high level of discharge (= 500 cfs), as well as dam passage survival at each weir discharge level. V. Evaluate survival and behavior of hatchery summer steelhead to wild surrogate winter steelhead for potential use of summer steelhead as a surrogate species winter steelhead. VI. Evaluate juvenile passage rates in the auxiliary water supply (AWS), forebay water supply (FWS), and hatchery water supply (HWS).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Ground Heat Flux Reconstruction Using Bayesian Uncertainty Quantification Machinery and Surrogate Modeling

Ground heat flux (G 0 ) is a key component of the land-surface energy balance of high-latitude regions. Despite its crucial role in controlling permafrost degradation due to global warming, G 0 is sparsely measured and not well represented in the outputs of global scale model simulation. In this study, an analytical heat transfer model is tested to reconstruct G 0 across seasons using soil temperature series from field measurements, Global Climate Model, and climate reanalysis outputs. The probability density functions of ground heat flux and of model parameters are inferred using available G 0 data (measured or modeled) for snow-free period as a reference. When observed G 0 is not available, a numerical model is applied using estimates of surface heat flux (dependent on parameters) as the top boundary condition. These estimates (and thus the corresponding parameters) are verified by comparing the distributions of simulated and measured soil temperature at several depths. Aided by state-of-the-art uncertainty quantification methods, the developed G 0 reconstruction approach provides novel means for assessing the probabilistic structure of the ground heat flux for regional permafrost change studies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

High-gradient performance of a prototype accelerator cavity for a 3 GeV proton radiography booster

This paper reports the design, fabrication, and results of the high-gradient conditioning and testing for a two-cell, π -mode, standing wave normal-conducting prototype booster cavity for the proposed 3 GeV proton linac upgrade at Los Alamos Neutron Science Center. Increasing the energy of proton beam from the existing 800 MeV to 3 GeV will improve resolution of the proton radiography by up to 10 times. The proposed energy boost can be achieved with a compact normal-conducting high-gradient radio-frequency (rf) linac section. The C-band section of the booster linac was designed with optimized-shaped copper accelerator cavities with distributed rf coupling. A short two-cell test prototype structure was designed for the frequency of 5.712 GHz, fabricated, and tested at the C-band Engineering Research Test Facility in New Mexico (CERF-NM) at Los Alamos National Laboratory. The maximum klystron power coupled into the test structure was 8.3 MW with 1 μ s pulse length and 100 Hz repetition rate. The breakdown probabilities were recorded as functions of the accelerating gradient and peak surface fields. Operation of the test cavity at accelerating gradients of up to 100 MV / m was demonstrated. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

DOE OSTI2020

Particle-number distribution in large fluctuations at the tip of branching random walks

Here, we investigate properties of the particle distribution near the tip of one-dimensional branching random walks at large times t , focusing on unusual realizations in which the rightmost lead particle is very far ahead of its expected position, but still within a distance smaller than the diffusion radius ~$\sqrt{t}$. Our approach consists in a study of the generating function $G_{Δx}(λ) = Σ_n$ ${λ^n}p_n(Δx)$ for the probabilities $p_n(Δx)$ of observing $\textit{n}$ particles in an interval of given size $Δ\textit{x}$ from the lead particle to its left, fixing the position of the latter. This generating function can be expressed with the help of functions solving the Fisher-Kolmogorov-Petrovsky-Piscounov (FKPP) equation with suitable initial conditions. In the infinite-time and large-$Δ\textit{x}$ limits, we find that the mean number of particles in the interval grows exponentially with $Δ\textit{x}$, and that the generating function obeys a nontrivial scaling law, depending on $Δ\textit{x}$ and λ through the combined variable $[Δx — f(λ)]^3 / Δx^2$, where $\textit{f}$(λ) ≡ – ln(1 – λ) – ln [– ln(1 – λ)]. From this property, one may conjecture that the growth of the typical particle number with the size of the interval is slower than exponential, but, surprisingly enough, only by a subleading factor at large Δ$\textit{x}$. The scaling we argue is consistent with results from a numerical integration of the FKPP equation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

Uncoordinated Spectrum Sharing in Millimeter Wave Networks Using Carrier Sensing

Here, we propose using Carrier Sensing (CS) for distributed interference management in millimeter-wave (mmWave) cellular networks where spectrum is shared by multiple operators that do not coordinate among themselves. In addition, even the base station sites can be shared by the operators. We describe important challenges in using traditional CS in this setting and propose enhanced CS protocols to address these challenges. Using stochastic geometry, we develop a general framework for downlink coverage probability analysis of our shared mmWave network in the presence of CS and derive the downlink coverage probability expressions for several CS protocols. Our work is the first to investigate and analyze (using stochastic geometry) CS for mmWave networks with spectrum and BS sites shared among non-coordinating operators. We evaluate the downlink coverage probability of our shared mmWave network using simulations as well as numerical examples based on our analysis. Our evaluations show that our proposed approach leads to an improvement in coverage probability, compared to the coverage probability with no CS, for higher values of signal-to-interference and noise ratio (SINR). Interestingly, our evaluations also reveal that for lower values of SINR, not using any CS is the best strategy in terms of the downlink coverage probability.

42 ENGINEERING↗

DOE OSTI2020

High-Resolution Comonomer Sequencing of Blocky Brominated Syndiotactic Polystyrene Copolymers Using 13C NMR Spectroscopy and Computer Simulations

This work demonstrates the first high-resolution comonomer sequencing of Blocky brominated syndiotactic polystyrene (sPS-co-sPS-Br) copolymers based on pentad assign- ments of the quaternary carbon region of the nuclear magnetic resonance spectrum. Copolymers containing p-bromostyrene (Br-Sty) units were prepared in matched sets using postpolymerization bromination methods carried out in the heterogeneous gel state (Blocky) and homogeneous solution state (Random). Quantitative information from the quaternary carbon spectra, heteronuclear multiple bond correlation spectroscopy, electronic structure calculations, and simulated statistically random copolymers was correlated to confirm the carbon resonance assignments for all 20 possible pentad comonomer sequences. Using the experimental pentad sequence prevalences, a computer code was developed to simulate chains with microstructures typical of each sample as a means to visually represent the copolymer blockiness with quantitative precision. Based on the microstructure and distribution of run lengths in these chains, the simulations revealed that the Blocky copolymers contain a high degree of blockiness. By comparing the run lengths in the simulated chains to the average number of styrene units in a crystalline segment of sPS (found by small-angle X-ray scattering), copolymer crystallizability was predicted. For the simulated Blocky B-21% (21 mol % Br-Sty) chain, the probability of randomly selecting a styrene unit in a crystallizable block was 25.8%, while that in the simulated Random R-18% was zero, in excellent agreement with the experimental crystallization behavior measured by differential scanning calorimetry. Additionally, these predictions confirmed that the simulated chains accurately represent the ensemble of chains in their respective copolymer samples. Furthermore, each simulated Blocky chain contained one or more long sPS blocks that paralleled the measured 38-40 styrene units spanning a crystalline segment within the sPS/CCl4 gel. This finding affirmed that the long sPS segments originated from the precise lamellar structure within the heterogeneous gel morphology (i.e., block length is correlated with lamellar thickness). Overall, the ability to tailor the copolymer microstructure through control of the semicrystalline gel morphology opens the door to synthesizing ordered copolymers by postpolymerization functionalization processes with unprecedented levels of compositional control.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

The eROSITA Final Equatorial-Depth Survey (eFEDS)

Here, we investigate the physical properties – such as the stellar mass (M * ), star-formation rate, infrared (IR) luminosity (L IR ), X-ray luminosity (L X ), and hydrogen column density (N H ) – of mid-IR (MIR) galaxies and active galactic nuclei (AGN) at z < 4 in the 140 deg 2 field observed by eROSITA on SRG using the Performance-and-Verification-Phase program named the eROSITA Final Equatorial Depth Survey (eFEDS). By cross-matching the WISE 22 μm (W4)-detected sample and the eFEDS X-ray point-source catalog, we find that 692 extragalactic objects are detected by eROSITA. We have compiled a multiwavelength dataset extending from X-ray to far-IR wavelengths. We have also performed (i) an X-ray spectral analysis, (ii) spectral-energy-distribution fitting using X-CIGALE, (iii) 2D image-decomposition analysis using Subaru Hyper Suprime-Cam images, and (iv) optical spectral fitting with QSFit to investigate the AGN and host-galaxy properties. For 7088 WISE 22 μm objects that are undetected by eROSITA, we have performed an X-ray stacking analysis to examine the typical physical properties of these X-ray faint and probably obscured objects. We find that (i) 82% of the eFEDS–W4 sources are classified as X-ray AGN with log L X > 42 erg s –1 ; (ii) 67 and 24% of the objects have log(L IR /L ⊙ ) > 12 and 13, respectively; (iii) the relationship between L X and the 6 μm luminosity is consistent with that reported in previous works; and (iv) the relationship between the Eddington ratio and N H for the eFEDS–W4 sample and a comparison with a model prediction from a galaxy-merger simulation indicates that approximately 5.0% of the eFEDS–W4 sources in our sample are likely to be in an AGN-feedback phase, in which strong radiation pressure from the AGN blows out the surrounding material from the nuclear region. Thanks to the wide area coverage of eFEDS, we have been able to constrain the ranges of the physical properties of the WISE 22 μm-selected sample of AGNs at z < 4, providing a benchmark for forthcoming studies on a complete census of MIR galaxies selected from the full-depth eROSITA all-sky survey.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

A collective elastic fluctuation mechanism for decoupling and stretched relaxation in glassy colloidal and molecular liquids

We propose a microscopic theory for the decoupling of self-diffusion and structural relaxation in glass-forming liquids within the Elastically Collective Nonlinear Langevin Equation (ECNLE) activated dynamics framework. Our central hypothesis is that the heterogeneity relevant to this problem is static fluctuations of local density on the scale of 3–4 particle diameters and how this changes local packing correlations. These fluctuations modify the degree of dynamical cage expansion that mechanistically couples intracage large amplitude hopping and longer range collective elasticity in ECNLE theory. Decoupling only emerges in the deeply supercooled regime where the strongly temperature dependent elastic barrier becomes non-negligible relative to its noncooperative local analog. The theory makes predictions for various aspects of the decoupling phenomenon, including apparent fractional power law Stokes-Einstein behavior, that appear to be consistent with experiments and simulations on hard sphere fluids and molecular liquids. Of central importance is a microscopic connection between the barrier fluctuation variance and most probable barrier height. Sensible results are also obtained for the nonexponential stretching of a generic relaxation time correlation function and its temperature evolution. Nonuniversality can arise from the relative importance of the local and collective barriers (related to fragility) and the precise magnitude of the length scale that defines the transition from local cage to elastic physics. Comparison is made with a traplike model based on a Gaussian distribution of barriers.

Xie, Shi-Jie (ORCID:0000000333174720)↗

DOE OSTI2022

Effect of void positioning on the detonation sensitivity of a heterogeneous energetic material

We show although it is well-established that voids profoundly influence the initiation and reaction behaviors of heterogeneous energetic materials such as polymer-bonded explosives (PBX) and propellants, there has been little study of how void location in different constituents in the microstructures of such materials affect the macroscale behavior. Here, we use three-dimensional (3D) mesoscale simulations to study how void placement within the reactive grains versus the polymer binder influences the shock-to-detonation transition (SDT) in a polymer-bonded explosive. The material studied here has a microstructure comprised of 75% PETN (pentaerythritol tetranitrate) grains and 25% HTPB (hydroxyl-terminated polybutadiene) polymer binder by volume. Porosities up to 10% in the form of spherical voids distributed in both the grains and polymer are considered. An Arrhenius reactive burn relation is used to model the chemical kinetics of the PETN grains under shock loading, thereby resolving the heterogeneous detonation behavior of the PBX. The influence of void location on the shock initiation sensitivity of the material is quantitatively ranked by comparing the predicted run distance to detonation (RDD) for each sample. The analysis includes inherent quantification of uncertainties arising from the stochastic variations in the microstructure morphologies and void distributions by using statistically equivalent microstructure sample sets (SEMSS), leading to probabilistic formulations for the RDD as a function of shock pressure. The calculations reveal that the location of voids in the composite microstructure significantly affects the RDD. Specifically, voids exclusively within the grains cause the PBX to be more sensitive (having shorter RDD) than voids in the polymer binder. Unique probabilistic relationships are derived to map the probability of observing RDD for each void location material case, allowing for prediction of initiation behavior anywhere in the shock pressure – RDD space. These findings agree with trends reported in the literature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Ordered Particle Packing in Dense TRISO/SiC Fuel Elements and Preliminary Assessment of Neutronic and Thermomechanical Characteristics

Detailed analysis of the particle distribution in Transformational Challenge Reactor fuel elements indicates that particle packing is not random; instead, it follows a relatively ordered structure near fuel element surfaces. Discrete particle neutronic simulations indicate that the core reactivity is not impacted when assuming homogenization of particles with the silicon carbide matrix. However, the neutronic power distribution resulting from the ordered packing structure indicates that the highest-power particles reside at the top and bottom of the fuel elements and nearest the YH 1.85 moderator rods. The power distribution results were applied to thermo-mechanical simulations using mesh-based power distributions. Previous results indicated high stress at the bottom of the fuel element, where packing is most ordered. Additionally, to reduce this stress concentration, additively manufactured protrusions were added to the bottom of a test fuel element to disrupt dense particle packing. These protrusions reduced the overall power peaking, but the thermomechanical simulations did not indicate a significant change in the fuel element’s maximum stress or failure probability.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Alaska's Rural Building Stock: a Validation Study Using ResStock and Field Data

The availability of accurate national data on demographics, building stock, and energy use is vital for modeling residential buildings and evaluating decarbonization strategies. However, rural and Indigenous populations, including those in rural Alaska, are typically underrepresented in these datasets. These communities face unique challenges due to their remote locations, severe weather conditions, and limited access to resources, resulting in high energy burden. This report examines how rural Alaskan communities are underrepresented in the ResStock housing model and highlights the need for improved data to address their unique housing and energy challenges. Thus, this report examines the representation of rural Alaskan communities within the national housing stock model, ResStock. A validation study was conducted, considering ResStock, Field Data and Aerial and 3D-view data collection (A3DDC) datasets. The validation process started by using the down selecting approach on the ResStock building stock dataset. For the purpose of this study, only the rural Alaska Boroughs and Census areas located in ASHRAE IECC Climate Zone 8 were considered to ensure a more accurate and fair comparison with the field data, which was collected in rural areas located in climate zone 8, specifically within the Nome Census area. While ResStock may accurately represent several characteristics of the building stock for rural Alaska, some differences between modeled, field data, and aerial and 3D-view data collection datasets were identified. The following building characteristics have a high impact on modeled energy consumption and demonstrated large differences: Revisit heating setpoints and consider a substantially higher setpoint distribution, it could potentially address "missing loads" if this is the case. Develop and include Toyo heating in future modeling for ResStock and EnergyPlus. Remove natural gas as a water heater fuel type outside of North Slope County. Foundation type updated to have more crawlspaces rather than basements. Infiltration rates need reexamination for a larger distribution toward higher infiltration rates. Include more vinyl and less brick in exterior wall type and revise wall color for greater proportion of light rather than dark color. Roof material revised from majority shingles to majority metal. Update number of occupants to higher number of occupant count. Building orientation represents a higher proportion of south facing buildings rather than relatively equal. The findings suggest that updating ResStock's probability logic could better represent rural Alaskan buildings. ResStock can be utilized to identify the best upgrades or energy efficiency and energy efficiency improvements, helping community leaders in making more informed decisions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Disaggregating Customer-Level Behind-the-Meter PV Generation Using Smart Meter Data and Solar Exemplars

Customer-level rooftop photovoltaic (PV) has been widely integrated into distribution systems. In most cases, PVs are installed behind-the-meter (BTM), and only the net demand is recorded. Therefore, the native demand and PV generation are unknown to utilities. Separating native demand and solar generation from net demand is critical for improving grid-edge observability. In this paper, a novel approach is proposed for disaggregating customer-level BTM PV generation using low-resolution but widely available hourly smart meter data. The proposed approach exploits the strong correlation between monthly nocturnal and diurnal native demands and the high similarity among PV generation profiles. First, a joint probability density function (PDF) of monthly nocturnal and diurnal native demands is constructed for customers without PVs, using Gaussian mixture modeling (GMM). Deviation from the constructed PDF is utilized to probabilistically assess the monthly solar generation of customers with PVs. Then, to identify hourly BTM solar generation for these customers, their estimated monthly solar generation is decomposed into an hourly timescale; to do this, we have proposed a maximum likelihood estimation (MLE)-based technique that utilizes hourly typical solar exemplars. Leveraging the strong monthly native demand correlation and high PV generation similarity enhances our approach's robustness against the volatility of customers’ hourly load and enables highly-accurate disaggregation. Furthermore, the proposed approach has been verified using real native demand and PV generation data.

14 SOLAR ENERGY↗

DOE OSTI2024

On the Statistical Mechanics of Mass Accommodation at Liquid–Vapor Interfaces

Here we propose a framework for describing the dynamics associated with the adsorption of small molecules to liquid-vapor interfaces using an intermediate resolution between traditional continuum theories that are bereft of molecular detail and molecular dynamics simulations that are replete with them. In particular, we develop an effective single particle equation of motion capable of describing the physical processes that determine thermal and mass accommodation probabilities. The effective equation is parametrized with quantities that vary through space away from the liquid-vapor interface. Of particular importance in describing the early time dynamics is the spatially dependent friction, for which we propose a numerical scheme to evaluate from molecular simulation. Taken together with potentials of mean force computable with importance sampling methods, we illustrate how to compute the mass accommodation coefficient and residence time distribution. Throughout, we highlight the case of ozone adsorption in aqueous solutions and its dependence on electrolyte composition.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Tensor decompositions for count data that leverage stochastic and deterministic optimization

There is growing interest to extend low-rank matrix decompositions to multi-way arrays, or tensors. One fundamental low-rank tensor decomposition is the canonical polyadic decomposition (CPD). The challenge of fitting a low-rank, nonnegative CPD model to Poisson-distributed count data is of particular interest. Several popular algorithms use local search methods to approximate the maximum likelihood estimator (MLE) of the Poisson CPD model. Here, this work presents two new algorithms that extend state-of-the-art local methods for Poisson CPD. Hybrid GCP-CPAPR combines Generalized Canonical Decomposition (GCP) with stochastic optimization and CP Alternating Poisson Regression (CPAPR), a deterministic algorithm, to increase the probability of converging to the MLE over either method used alone. Restarted CPAPR with SVDrop uses a heuristic based on the singular values of the CPD model unfoldings to identify convergence toward optimizers that are not the MLE and restarts within the feasible domain of the optimization problem, thus reducing overall computational cost when using a multi-start strategy. We provide empirical evidence that indicates our approaches outperform existing methods with respect to converging to the Poisson CPD MLE.

CPAPR↗