Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stratified”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Comparison of sleep parameters from wrist-worn ActiGraph and Actiwatch devices

Abstract Sleep and physical activity, two important health behaviors, are often studied independently using different accelerometer types and body locations. Understanding whether accelerometers designed for monitoring each behavior can provide similar sleep parameter estimates may help determine whether one device can be used to measure both behaviors. Three hundred and thirty one adults (70.7 ± 13.7 years) from the Baltimore Longitudinal Study of Aging wore the ActiGraph GT9X Link and the Actiwatch 2 simultaneously on the non-dominant wrist for 7.0 ± 1.6 nights. Total sleep time (TST), wake after sleep onset (WASO), sleep efficiency, number of wake bouts, mean wake bout length, and sleep fragmentation index (SFI) were extracted from ActiGraph using the Cole–Kripke algorithm and from Actiwatch using the software default algorithm. These parameters were compared using paired t-tests, Bland–Altman plots, and Deming regression models. Stratified analyses were performed by age, sex, and body mass index (BMI). Compared to the Actiwatch, the ActiGraph estimated comparable TST and sleep efficiency, but fewer wake bouts, longer WASO, longer wake bout length, and higher SFI (all p < .001). Both devices estimated similar 1-min and 1% differences between participants for TST and SFI (β = 0.99, 95% CI: 0.95, 1.03, and 0.91, 1.13, respectively), but not for other parameters. These differences varied by age, sex, and/or BMI. The ActiGraph and the Actiwatch provide comparable absolute and relative estimates of TST, but not other parameters. The discrepancies could result from device differences in movement collection and/or sleep scoring algorithms. Further comparison and calibration is required before these devices can be used interchangeably.

Liu, Fangyu (ORCID:0000000315541478)↗
DOE OSTI2024

Signature analysis of high-throughput transcriptomics screening data for mechanistic inference and chemical grouping

Abstract High-throughput transcriptomics (HTTr) uses gene expression profiling to characterize the biological activity of chemicals in in vitro cell-based test systems. As an extension of a previous study testing 44 chemicals, HTTr was used to screen an additional 1,751 unique chemicals from the EPA’s ToxCast collection in MCF7 cells using 8 concentrations and an exposure duration of 6 h. We hypothesized that concentration-response modeling of signature scores could be used to identify putative molecular targets and cluster chemicals with similar bioactivity. Clustering and enrichment analyses were conducted based on signature catalog annotations and ToxPrint chemotypes to facilitate molecular target prediction and grouping of chemicals with similar bioactivity profiles. Enrichment analysis based on signature catalog annotation identified known mechanisms of action (MeOAs) associated with well-studied chemicals and generated putative MeOAs for other active chemicals. Chemicals with predicted MeOAs included those targeting estrogen receptor (ER), glucocorticoid receptor (GR), retinoic acid receptor (RAR), the NRF2/KEAP/ARE pathway, AP-1 activation, and others. Using reference chemicals for ER modulation, the study demonstrated that HTTr in MCF7 cells was able to stratify chemicals in terms of agonist potency, distinguish ER agonists from antagonists, and cluster chemicals with similar activities as predicted by the ToxCast ER Pathway model. Uniform manifold approximation and projection (UMAP) embedding of signature-level results identified novel ER modulators with no ToxCast ER Pathway model predictions. Finally, UMAP combined with ToxPrint chemotype enrichment was used to explore the biological activity of structurally related chemicals. The study demonstrates that HTTr can be used to inform chemical risk assessment by determining in vitro points of departure, predicting chemicals’ MeOA and grouping chemicals with similar bioactivity profiles.

Toxicology↗
DOE OSTI2024

Generalizability of heat-related health risk associations observed in a large healthcare claims database of patients with commercial health insurance

Extreme ambient heat is unambiguously associated with higher risk of illness and death. The Optum Labs Data Warehouse (OLDW), a database of medical claims from US-based patients with commercial or Medicare Advantage health insurance, has been used to quantify heat-related health impacts. Whether results for the insured sub-population are generalizable to the broader population has to our knowledge not been documented. We sought to address this question, for the US population in California from 2012 to 2019. We examined changes in daily rates of emergency department (ED) encounters and in-patient hospitalization encounters for all-causes, heat-related outcomes, renal disease, mental/behavioral disorders, cardiovascular disease, and respiratory disease. OLDW was the source for health data for insured individuals in California, and health data for the broader population were gathered from the California Department of Health Care Access and Information (HCAI). We defined extreme heat exposure as any day in a group of 2 or more days with maximum temperatures exceeding the county-specific 97.5 th percentile and used a space-time-stratified case–crossover design to assess and compare the impacts of heat on health. Average incidence rates of medical encounters differed by dataset. However, rate ratios for ED encounters were similar across datasets for all causes (ratio of incidence rate ratios (rIRR) = 0.989; 95% confidence interval (CI) = 0.973, 1.011), heat-related causes (rIRR = 1.080; 95% CI = 0.999, 1.168), renal disease (rIRR = 0.963; 95% CI = 0.718, 1.292), and mental health disorders (rIRR = 1.098; 95% CI = 1.004, 1.201). Rate ratios for inpatient encounters were also similar. This work presents evidence that OLDW can continue to be a resource for estimating the health impacts of extreme heat.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Using Fourier-Plane Imaging Microscopy for Determining Transition-Dipole-Moment Orientations in Organic Light-Emitting Devices

Here, we use Fourier-plane imaging microscopy (FIM) to determine the transition-dipole-moment orientation in doped organic emissive thin films. The use of FIM enables precise, sensitive, and rapid measurement of dipole orientation in the emission layer of an organic light-emitting device (OLED). An optical model of a stratified birefringent multilayer is introduced for interpreting results obtained by FIM. Using the model, we determine the average orientation of transition-dipole-moment vectors of three phosphorescent dopant emitters. The dipole alignment measured by FIM quantitatively explains the difference in OLED efficiencies using these archetype dopant molecules. FIM provides a nondestructive tool to measure and ultimately improve the outcoupling efficiency of OLEDs and other light-emitting devices.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

Temperature evolution of the phonon dynamics in the Kitaev spin liquid

In this work, we present a study of the phonon dynamics in the honeycomb Kitaev spin model at finite temperatures. We show that the fractionalized spin excitations of the Kitaev spin liquid, the itinerant Majorana fermions, and static Z 2 fluxes have distinct effects on the phonon dynamics, which makes the phonon dynamics a promising tool for exploring the Kitaev spin liquid candidate materials. In particular, we focus on the signature of the fractionalized excitations in the thermodynamic behavior of the sound attenuation and the phonon Hall viscosity: the former describes the phonon decay into the fractionalized excitations, and the latter is the leading order time-reversal symmetry breaking effect on the acoustic phonon. We find that the angular dependence of the attenuation coefficient and its magnitude is modified by the thermal excitation of the Z 2 fluxes. The strength of this effect strongly depends on the relative magnitude of the sound velocity and the Fermi velocity characterizing the low-energy Majorana fermions. We also show that the Hall viscosity is strongly suppressed by the increase of the density of the Z 2 fluxes at finite temperatures. All these observations reflect the effects of the emergent disorder on the Majorana fermions introduced by the Z 2 fluxes. Our analysis is based on the complementary analytical calculations in the low-temperature zero-flux sector, and numerical calculations in the inhomogeneous flux sectors at intermediate and high temperatures with stratified Monte Carlo (strMC) method.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Ionization waves in low-current dc discharges in noble gases obtained with a hybrid kinetic-fluid model

A hybrid kinetic-fluid model is used to study ionization waves (striations) in a low-current plasma column of dc discharges in noble gases. Coupled solutions of a kinetic equation for electrons, a drift-diffusion equation for ions, and a Poisson equation for the electric field are obtained to clarify the nature of plasma stratification in the positive column. A simplified two-level excitation-ionization model is used for the conditions when the nonlinear effects due to stepwise ionization, gas heating, and Coulomb interactions among electrons are negligible. It is confirmed that the nonlocal effects are responsible for the formation of moving striations in dc discharges at low plasma densities and low values of pR (the product of gas pressure and tube radius). Here, the calculated properties of self-excited waves of S–, P–, and R types in neon and S type in argon agree with available experimental data. The reason for helium plasma stability to stratification is clarified. It is shown that sustaining stratified plasma is more efficient than striation-free plasma when the ionization rate is a nonlinear function of the electric field. However, the nonlinear dependence of the ionization rate on the electric field is not required for plasma stratification. Striations of S–, P–, and R types in neon exist with minimal or no ionization enhancement. Effects of the column length and plasma density on the wave properties are demonstrated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗
DOE OSTI2021

Mixture Model Framework for Traumatic Brain Injury Prognosis Using Heterogeneous Clinical and Outcome Data

Prognoses of Traumatic Brain Injury (TBI) outcomes are neither easily nor accurately determined from clinical indicators. This is due in part to the heterogeneity of damage inflicted to the brain, ultimately resulting in diverse and complex outcomes. Using a data-driven approach on many distinct data elements may be necessary to describe this large set of outcomes and thereby robustly depict the nuanced differences among TBI patients’ recovery. In this work, we develop a method for modeling large heterogeneous data types relevant to TBI. Our approach is geared toward the probabilistic representation of mixed continuous and discrete variables with missing values. The model is trained on a dataset encompassing a variety of data types, including demographics, blood-based biomarkers, and imaging findings. In addition, it includes a set of clinical outcome assessments at 3, 6, and 12 months post-injury. The model is used to stratify patients into distinct groups in an unsupervised learning setting. We use the model to infer outcomes using input data, and show that the collection of input data reduces uncertainty of outcomes over a baseline approach. In addition, we quantify the performance of a likelihood scoring technique that can be used to self-evaluate the extrapolation risk of prognosis on unseen patients.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

CONGO²: Scalable Online Anomaly Detection and Localization in Power Electronics Networks

Rapid and accurate detection and localization of electronic disturbances simultaneously are important for preventing its potential damages and determining potential remedies. Existing anomaly detection methods are severely limited by the low accuracy, the expensive computational cost and the need for highly trained personnel. There is an urgent need for a scalable online algorithm for in-field analysis of large-scale power electronics networks. Here in this paper, we propose a fast and accurate algorithm for anomaly detection and localization of power electronics networks: stratified colored-node graph (CONGO2). This algorithm hierarchically models the change of correlated waveforms and then correlated sensors using the colored-node graph. By aggregating the change of each sensor with its neighbors’ inputs, we can spontaneously identify and localize the anomaly that cannot be detected by data collected from a single sensor. As our proposed method only focuses on the changes within a short time frame, it is highly computational efficient and only needs small data storage. Thus, our method is ideal for online and reliable anomaly detection and localization of large-scale power electronic networks. Compared to existing anomaly detection methods, our method is entirely data-driven without training data, highly accurate and reliable for wide-spectrum anomalies detection, and more importantly, capable of both detection and localization. Thus, it is ideal for infield deployment for large-scale power electronic networks. As illustrated by a distributed energy resources (DERs) power grid with 37-node, our method can effectively detect and localize various cyber and physical attacks.

42 ENGINEERING↗
DOE OSTI2025

Novel CHI3L1 ‐Associated Angiogenic Phenotypes Define Glioma Microenvironments: Insights From Multi‐Omics Integration

ABSTRACT The CHI3L1 signaling pathway significantly influences glioma angiogenesis, but its role in the tumor microenvironment (TME) remains elusive. We propose a novelCHI3L1‐associated vascular phenotype classification for glioma through integrative analyses of multiple datasets with bulk and single‐cell transcriptome, genomics, digital pathology, and clinical data. We investigated the biological characteristics, genomic alterations, therapeutic vulnerabilities, and immune profiles within these phenotypes through a comprehensive multi‐omics approach. We constructed the vascular‐related risk (VR) score based onCHI3L1‐associated vascular signatures (CAVS) identified by machine learning algorithms. Utilizing unsupervised consensus clustering, gliomas were stratified into three distinct vascular phenotypes: Cluster A, marked by high vascularization and stromal activation with a relatively low levels of tumor‐infiltrating lymphocytes (TILs); Cluster B, characterized by moderate vascularization and stromal activity, coupled with a high density of TILs; and Cluster C, defined by low vascularization and sparse immune cell infiltration. We observed that the CAVS effectively indicated glioma‐associated angiogenesis and immune suppression by single‐cell RNA‐seq analysis. Moreover, the high‐VR‐score group exhibited enhanced angiogenic activity, reduced immune response, resistance to immunotherapy, and poorer clinical outcomes. The VR score independently predicted glioma prognosis and, combined with a nomogram, provided a robust clinical decision‐making tool. Potential drug prediction based on transcription factors for high‐risk patients was also performed. Our study reveals thatCHI3L1‐associated vascular phenotypes shape distinct immune landscapes in gliomas, offering insights for optimizing therapeutic strategies to improve patient outcomes.

Oncology↗
DOE OSTI2020

Sedimentation of ballasted cells-free EPS in meromictic Fayetteville Green Lake

Fayetteville Green Lake (FGL) is a recognized, extensively studied present-day model of the stratified Proterozoic Ocean. Nonetheless, biomass sedimentation in FGL remains hard to explain: Whilst virtually all sediment pigments belong to photosynthetic sulfur bacteria (PSB) from a chemocline, the isotopic carbon signature of the bulk biomass suggests its epilimnetic phytoplankton origin. Here we present experimental evidence that FGL Synechococci produce copious extracellular polysacchrides (EPS), which become impregnated with Ca, Mg and Na cations and are release to the environment as ballasted cell coverings. We propose that sedimentation of these cell-free EPS can constitute the bulk of pigment-less organic material in FGL sediment. Because increased availability of inorganic carbon (Ci) stimulates accumulation of ballasted EPS, we propose the universal role of cyanobacterial EPS in biomass sedimentation in the high-Ci Paleoproterozoic Ocean as well as in modern aquatic systems like FGL.

Kamennaya, Nina A.↗
DOE OSTI2023

Immune checkpoint analysis of T‐cell responses to pp65 and IE‐1 antigens in end‐stage lung diseases

Abstract Lung transplant (LTX) patients are at high risk of cytomegalovirus (CMV) infection, which is often associated with high mortality and morbidity. Reactivation of CMV causes cell injury due to the cytopathic effect of viral replication and triggering of T cell immunity. The aim of this study was to compare expression of immune checkpoints (ICs) (PD‐1, CTLA‐4, LAG‐3 and TIGIT) in CD4, CD8 and CD56 and activation markers CD137, CD154 and CD69 of end‐stage patients awaiting lung transplant. Eighteen pre‐LTX positive for anti‐CMV IgG titres and 18 healthy subjects were enrolled. IC and activation markers have been evaluated through flow cytometric analysis in HC and pre‐LTX patients. Reactive (QF+) and unreactive (QF−) patients were stratified according to QuantiFERON‐CMV assays. ICs' and activation markers' expression were determined before and after in vitro stimulation with pp‐65 and IE‐1 antigens. Lower expression of PD‐1 was observed in CD4 and CD8 cells of pre‐LTX patients than controls, whereas CTLA4 appeared upregulated in CD56 and CD8 cells. TIGIT is increased on the surface of CD4, CD8 and NK cells after peptide stimulation in QF‐negative patients and PD‐1 is only downregulated after stimulation in the QF‐positive patients. This study provides new evidence of immune dysregulation in patients with end‐stage lung disorders, particularly in relation to immune checkpoint cell biology. The change in QF+ mostly happens on cytotoxic cells NK and CD8, while the changes in QF− were observed in adaptive immune cells, including CD4 and CD8.

Bergantini, Laura↗
DOE OSTI2023

High-Fidelity Energy Deposition Ignition Model Coupled with Flame Propagation Models at Engine-like Flow Conditions

With the heightened pressure on car manufacturers to increase the efficiency and reduce the carbon emissions of their fleets, more challenging engine operation has become a viable option. Highly dilute, boosted, and stratified charge, among others, promise engine efficiency gains and emissions reductions. At such demanding engine conditions, the spark-ignition process is a key factor for the flame initiation propagation and the combustion event. From a computational standpoint, there exist multiple spark-ignition models that perform well under conventional conditions but are not truly predictive under strenuous engine operation modes, where the underlying physics needs to be expanded. In this paper, a hybrid Lagrangian-Eulerian spark-ignition (LESI) model is coupled with different turbulence models, grid sizes, and combustion models. The ignition model, previously developed, relies on coupling Eulerian energy deposition with a Lagrangian particle evolution of the spark channel, at every time-step. The spark channel is attached to the electrodes and allowed to elongate at a speed derived from the flow velocity. The LESI model is used to simulate spark ignition in a nonquiescent crossflow environment at engine-like conditions, using converge commercial computational fluid dynamics (CFD) solver. The results highlight the consistency, robustness, and versatility of the model in a range of engine-like setups, from typical with Reynolds-averaged Navier-Stokes (RANS) and a larger grid size to high fidelity with large-eddy simulation (LES) and a finer grid size. The flame kernel growth is then evaluated against Schlieren images from an optical constant volume ignition chamber with a focus on the performance of flame propagation models, such as G-equation and thickened flame model, versus the baseline well-stirred reactor model. Finally, future development details are discussed.

Advanced ignition modeling↗
DOE OSTI2020

Evaluating Transfer and Pumping of Slurries from Pulsed Jet Mixed Vessels

Due to gravity, solids in slurries will settle if density differences between the solids and liquid are positive (i.e., particle has a negative buoyant force) unless rheological properties and flow conditions are adequate to overcome the gravitational effects. The rate of settling depends on the force balance of the particle, which includes the surface forces associated with fluid rheology. Given the same fluid and solid properties, particles that are larger and denser tend to settle faster. When pumping slurry into a vessel at concentrations precluding hindered settling with insufficient mixing, particle and density distributions can result in preferential settling, creating stratification in the solids concentration within the vessel. For vessels with transfer line inlets located in the lower portion of the tank, the stratified solids concentration may be detrimental to the transfer system performance. Elevated concentrations of solids in the slurry entrained at the inlet to the transfer line can result in the effective viscosity or slurry bulk density exceeding the design limits of the pump. These conditions could result in plugging of the transfer line or onset of cavitation of the pumps because of excessive pressure drop. These conditions can be exacerbated with periodic inlet conditions existing at the transfer line inlet. Periodic conditions can result when vessel mixing is intermittent such as with pulsed jet mixers (PJM). The transfer line inlet conditions are impacted by the periodic nature of the PJM operations with respect to suspension of solids and their transport to the inlet of the transfer line. A scaling approach is presented, and corresponding test requirements are developed for assessing the prevention of plugging the pipeline. Line plugging mechanisms are addressed that do not include plugging due to steady-state high-density slurry entering the transfer line and reducing the net positive suction head available (NPSHA) at the pump inlet to below that required for pump operation. Items considered include the transition to reduced relative flow velocities, such that the critical pipe velocity for solids deposition, Ucd, is not maintained, and segregation of heavy solids during the transport. The recommended requirements to prevent plugging include: • Limits for viscosity and density for entrained slurry to prevent the pressure drop in the pipeline from exceeding pump capacity. • Limits for viscosity and density for entrained slurry to prevent the net positive suction head available (NPSHA) from falling below the net positive suction head required (NPSHR) for operating the pump. • Transfer line velocity and flow rate requirements to maintain solids in suspension, while avoiding line plugging that results from deposition of solids within the transfer line. This paper describes the development of the scaling and testing requirements to verify that proposed approaches for transfer and pump out are appropriately developed

periodic flow, mixing, pipeline plugging, scaling,↗
DOE OSTI2021

A Novel Freshwater to Marine Evolutionary Transition Revealed within Methylophilaceae Bacteria from the Arctic Ocean

Bacteria inhabiting polar oceans, particularly the Arctic Ocean, are less studied than those at lower latitudes. Discovering bacterial adaptations to Arctic Ocean conditions is essential for understanding responses to the accelerated environmental changes occurring in the North. The Methylophilaceae are emerging as a model for investigating the genomic basis of habitat adaptation, because related lineages are widely distributed across both freshwater and marine ecosystems. Here, we investigated Methylophilaceae diversity in the salinity-stratified surface waters of the Canada Basin, Arctic Ocean. In addition to a diversity of marine OM43 lineages, we report on the genomic characteristics and evolution of a previously undescribed Methylophilaceae clade (BS01) common to polar surface waters yet related to freshwater sediment Methylotenera species. BS01 is restricted to the lower-salinity surface waters, while OM43 is found throughout the halocline. An acidic proteome supports a marine lifestyle for BS01, but gene content shows increased metabolic versatility compared to OM43 and evidence for ongoing genome-streamlining. Phylogenetic reconstruction shows that BS01 colonized the pelagic ocean independently of OM43 via convergent evolution. Salinity adaptation and differences in one-carbon and nitrogen metabolism may play a role in niche differentiation between BS01 and OM43. In particular, urea utilization by BS01 is predicted to provide an ecological advantage over OM43 given the limited amount of inorganic nitrogen in the Canada Basin. These observations provide further evidence that the Arctic Ocean is inhabited by distinct bacterial groups and that at least one group (BS01) evolved via a freshwater to marine environmental transition.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Giant Virus Infection Signatures Are Modulated by Euphotic Zone Depth Strata and Iron Regimes of the Subantarctic Southern Ocean

Viruses can alter the abundance, evolution, and metabolism of microorganisms in the ocean, playing a key role in water column biogeochemistry and global carbon cycles. Large efforts to measure the contribution of eukaryotic microorganisms (e.g., protists) to the marine food web have been made, yet the in situ activities of the ecologically relevant viruses that infect these organisms are not well characterized. Viruses within the phylum Nucleocytoviricota (“giant viruses”) are known to infect a diverse range of ecologically relevant marine protists, yet how these viruses are influenced by environmental conditions remains under-characterized. By employing metatranscriptomic analyses of in situ microbial communities along a temporal and depthresolved gradient, we describe the diversity of giant viruses at the Southern Ocean Time Series (SOTS), a site within the subpolar Southern Ocean. Using a phylogeny-guided taxonomic assessment of detected giant virus genomes and metagenome-assembled genomes, we observed depth-dependent structuring of divergent giant virus families mirroring dynamic physicochemical gradients in the stratified euphotic zone. Analyses of transcribed metabolic genes from giant viruses suggest viral metabolic reprogramming of hosts from the surface to a 200-m depth. Lastly, using on-deck incubations reflecting a gradient of iron availability, we show that modulating iron regimes influences the activity of giant viruses in the field. Specifically, we show enhanced infection signatures of giant viruses under both iron-replete and iron-limited conditions. Collectively, these results expand our understanding of how the water column’s vertical biogeography and chemical surroundings affect an important group of viruses within the Southern Ocean

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Stochastic Gradients for Large-Scale Tensor Decomposition

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is a recently proposed version of tensor decomposition that allows for a variety of loss functions such as Bernoulli loss for binary data or Huber loss for robust estimation. Here, the stochastic gradient is formed from randomly sampled elements of the tensor and is efficient because it can be computed using the sparse matricized-tensor times Khatri--Rao product tensor kernel. For dense tensors, we simply use uniform sampling. For sparse tensors, we propose two types of stratified sampling that give precedence to sampling nonzeros. Numerical results demonstrate the advantages of the proposed approach and its scalability to large-scale problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

The Role of Data Filtering in Open Source Software Ranking and Selection

Faced with more than 100M open source projects, a more manageable small subset is needed for most empirical investigations. More than half of the research papers in leading venues investigated filtering projects by some measure of popularity with explicit or implicit arguments that unpopular projects are not of interest, may not even represent "real" software projects, or that less popular projects are not worthy of study. However, such filtering may have enormous effects on the results of the studies if and precisely because the sought-out response or prediction is in any way related to the filtering criteria.This paper exemplifies the impact of this common practice on research outcomes, specifically how filtering of software projects on GitHub based on inherent characteristics affects the assessment of their popularity. Using a dataset of over 100,000 repositories, we used multiple regression to model the number of stars -a commonly used proxy for popularity- based on factors such as the number of commits, the duration of the project, the number of authors and the number of core developers. Our control model included the entire dataset, while a second filtered model considered only projects with ten or more authors. The results indicated that while certain characteristics of the repository consistently predict popularity, the filtering process significantly alters the relationships between these characteristics and the response. We found that the number of commits exhibited a positive correlation with popularity in the control sample but showed a negative correlation in the filtered sample. These findings highlight the potential biases introduced by data filtering and emphasize the need for careful sample selection in empirical research of mining software repositories. We recommend that empirical work should either analyze complete datasets such as World of Code, or employ stratified random sampling from a complete dataset to ensure that filtering is not biasing the results.

Malviya Thakur, Addi↗