Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

Large-scale scientific workflows rely heavily on high-performance file transfers. These transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or data duplication. To have successful file transfers, methods such as predetermined thresholds and statistical analysis need to be done to determine abnormal patterns. Network administrators routinely monitor and analyze network data for diagnosing and alleviating these, making decisions based on their experience. However, as networks grow and become complex, monitoring large data files and quickly processing them, makes it improbable to identify errors and rectify these. Abnormal file transfers have been classified by simply setting alert thresholds, via tools such as PerfSonar and TCP statistics (Tstat). This paper investigates the feasibility of unsupervised feature extraction methods for identifying network anomaly patterns with three unsupervised classification methods—principal component analysis, autoencoder and isolation forest. Here, we collect file transfer statistics from two experiment sets—synthetic iPerf generated traffic and 1000 Genome workflow runs, with synthetically introduced anomalies. Our results show that while PCA and a simple autoencoder finds it difficult to detect clusters, the tree-variant isolation forest is able to identify anomalous packets by breaking down TCP traces into tree classes early.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Uncovering DNA-PKcs ancient phylogeny, unique sequence motifs and insights for human disease

DNA-dependent protein kinase catalytic subunit (DNA-PKcs) is a key member of the phosphatidylinositol-3 kinase-like (PIKK) family of protein kinases with critical roles in DNA-double strand break repair, transcription, metastasis, mitosis, RNA processing, and innate and adaptive immunity. The absence of DNA-PKcs from many model organisms has led to the assumption that DNA-PKcs is a vertebrate-specific PIKK. Here, we find that DNA-PKcs is widely distributed in invertebrates, fungi, plants, and protists, and that threonines 2609, 2638, and 2647 of the ABCDE cluster of phosphorylation sites are highly conserved amongst most Eukaryotes. Furthermore, we identify highly conserved amino acid sequence motifs and domains that are characteristic of DNA-PKcs relative to other PIKKs. These include residues in the Forehead domain and a novel motif we have termed YRPD, located in an α helix C-terminal to the ABCDE phosphorylation site loop. Combining sequence with biochemistry plus structural data on human DNA-PKcs unveils conserved sequence and conformational features with functional insights and implications. The defined generally progressive DNA-PKcs sequence diversification uncovers conserved functionality supported by Evolutionary Trace analysis, suggesting that for many organisms both functional sites and evolutionary pressures remain identical due to fundamental cell biology. The mining of cancer genomic data and germline mutations causing human inherited disease reveal that robust DNA-PKcs activity in tumors is detrimental to patient survival, whereas germline mutations compromising function are linked to severe immunodeficiency and neuronal degeneration. We anticipate that these collective results will enable ongoing DNA-PKcs functional analyses with biological and medical implications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Combining field and remote sensing data to estimate forest canopy damage and recovery following tropical cyclones across tropical regions

Abstract As tropical forests cycle the most water and carbon, it is crucial to understand the short- and long-term effects of intensifying cyclones on these ecosystems. Soil nutrient status has been shown to moderate forest cyclone responses using field litterfall measurements, but litterfall is one of the multiple cyclone impact metrtics, which may or may not be correlated with one another or with site nutrients. We used remotely sensed vegetation indices to quantify immediate damage and two-year recovery for 42 cases across nine tropical forests in Hawaii, Puerto Rico, Mexico, Australia, and Taiwan affected by 12 cyclones between 2004 and 2017. We tested whether changes in leaf area index (LAI) and enhanced vegetation index (EVI) correlated with changes in litterfall observations and how changes varied with total soil phosphorus (P) concentrations across regions. We compared cyclone-induced changes and recovery of LAI and EVI to litterfall observations compiled in a pantropical meta-analysis. We found large variation in changes in LAI and EVI across forests, with the greatest reductions in LAI (−77%) and EVI (−77%) in Mexico (Jalisco) and Puerto Rico, respectively. LAI ( r = −0.52) and EVI ( r = −0.60) changes correlated with those in litterfall across cases. Post-cyclone data showed recovery of LAI by four months, EVI by two months, and litterfall by ten months. We detected larger changes in LAI and EVI in forests with higher soil P, but these relationships were not significant when accounting for cyclone and site as random effects. Principal component analyses indicated a regional clustering of cases related to their contrasting cyclone regimes, with the frequency and intensity of cyclone events negatively correlated. Overall, remote sensing observations complement but do not substitute for ground observations that reveal cyclone damage and post-cyclone recovery in tropical forests, and soil phosphorus moderates some but not all metrics of stability in response to cyclones.

Bloom, Dellena E. (ORCID:0000000205981747)↗
DOE OSTI2022

Stringent σ8 constraints from small-scale galaxy clustering using a hybrid MCMC + emulator framework

ABSTRACT We present a novel simulation-based hybrid emulator approach that maximally derives cosmological and Halo Occupation Distribution (HOD) information from non-linear galaxy clustering, with sufficient precision for DESI Year 1 (Y1) analysis. Our hybrid approach first samples the HOD space on a fixed cosmological simulation grid to constrain the high-likelihood region of cosmology + HOD parameter space, and then constructs the emulator within this constrained region. This approach significantly reduces the parameter volume emulated over, thus achieving much smaller emulator errors with fixed number of training points. We demonstrate that this combined with state-of-the-art simulations result in tight emulator errors comparable to expected DESI Y1 LRG sample variance. We leverage the new abacussummit simulations and apply our hybrid approach to CMASS non-linear galaxy clustering data. We infer constraints on σ8 = 0.762 ± 0.024 and fσ8(zeff = 0.52) = 0.444 ± 0.016, the tightest among contemporary galaxy clustering studies. We also demonstrate that our fσ8 constraint is robust against secondary biases and other HOD model choices, a critical first step towards showcasing the robust cosmology information accessible in non-linear scales. We speculate that the additional statistical power of DESI Y1 should tighten the growth rate constraints by at least another 50–60 ${{\ \rm per\ cent}}$, significantly elucidating any potential tension with Planck. We also address the ‘lensing is low’ tension, which we find to be in the same direction as a potential tension in fσ8. We show that the combined effect of a lower fσ8 and environment-based bias accounts for approximately $50{{\ \rm per\ cent}}$ of the discrepancy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

One of These Things IS Like the Other: Pursuing a New Taxonomy of Industry for Improved Energy System Modeling

Industrial processes drive the exchange of materials, energy, and currency throughout the economy. These processes are powered by electricity and direct combustion, with variation in their operation even within the same industry. This heterogeneity makes it difficult for large models, including the National Energy Modeling System (US), to project their energy use while remaining tractable. Decarbonization and ensuing changes to the energy system require changes to industrial processes while offering opportunities for process innovation, but the extent and nature of changes are difficult to model with current classification schemes and corresponding data. The North American Industrial Classification (NAICS) is an economic taxonomy of industries, but its categories are less meaningful from an energy and material flow perspective. For example, a facility that makes steel from iron ore in a blast furnace/basic oxygen furnace is categorized under the same NAICS code as a facility that makes steel from scrap in an electric arc furnace despite the scale, use of recycled scrap versus iron ore, and energy use differences in the two facility types. Exploratory analysis is performed on a large dataset used for plant-level energy assessment in order to detect clusters that can aid in better modeling of industry for energy analysis in an evolving system with breakthrough technologies.

28 EE - Advanced Manufacturing Office (EE-5A)↗
DOE OSTI2020

Machine-Learning-Based Analysis of the Guy-Greenbrier, Arkansas Earthquakes: A Tale of Two Sequences

Here, we revisited the June 2010 to October 2011 Guy-Greenbrier earthquake sequence in central Arkansas using PhaseNet, a deep neural network trained to pick P and S arrival times. We applied PhaseNet to continuous waveform data and used phase association and hypocenter relocation to locate nearly 90,000 events. Our catalog suggests that the sequence consists of two adjacent earthquake sequences on the same fault and that the second sequence may be associated with the wastewater disposal well to the west of the Guy-Greenbrier Fault, rather than the wells to the north and the east that were previously implicated. We find that each sequence is composed of many small clusters that exhibit diffusion along the fault at shorter timescales. Our study demonstrates that machine-learning-based earthquake catalog development is now feasible and will yield new insights into earthquake behavior.

58 GEOSCIENCES↗
DOE OSTI2024

Cosmological constraints from the tomography of DES-Y3 galaxies with CMB lensing from ACT DR4

We present a measurement of the cross-correlation between the MagLim galaxies selected from the Dark Energy Survey (DES) first three years of observations (Y3) and cosmic microwave background (CMB) lensing from the Atacama Cosmology Telescope (ACT) Data Release 4 (DR4), reconstructed over ∼ 436 deg 2 of the sky. Our galaxy sample, which covers ∼ 4143 deg 2 , is divided into six redshift bins spanning the redshift range of 0.20 < z <1.05. We adopt a blinding procedure until passing all consistency and systematics tests. After imposing scale cuts for the cross-power spectrum measurement, we reject the null hypothesis of no correlation at 9.1σ. We constrain cosmological parameters from a joint analysis of galaxy and CMB lensing-galaxy power spectra considering a flat ΛCDM model, marginalized over 23 astrophysical and systematic nuisance parameters. We find the clustering amplitude S 8 ≡ σ 8 (Ω m /0.3) 0.5 = 0.75 +0.04 -0.05 . In addition, we constrain the linear growth of cosmic structure as a function of redshift. Our results are consistent with recent DES Y3 analyses and suggest a preference for a lower S 8 compared to results from measurements of CMB anisotropies by the Planck satellite, although at a mild level (< 2σ) of statistical significance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Machine learning to identify geologic factors associated with production in geothermal fields: a case-study using 3D geologic data, Brady geothermal field, Nevada

Abstract In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fluid-flow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fluid-flow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k -means clustering (NMF k ), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes.

58 GEOSCIENCES↗
DOE OSTI2023

DES-Y3 galaxies & ACT DR4 CMB lensing tomography

We present a measurement of the cross-correlation between the \maglim galaxies selected from the Dark Energy Survey (DES) first three years of observations (Y3) and cosmic microwave background (CMB) lensing from the Atacama Cosmology Telescope (ACT) Data Release 4 (DR4), reconstructed over $\sim 436$ $\sqdeg$ of the sky. Our galaxy sample, which covers $\sim 4143$ $\sqdeg$, is divided into six redshift bins spanning the redshift range of $0.20<z<1.05$. We adopt a blinding procedure until passing all consistency and systematics tests. After imposing scale cuts for the cross-power spectrum measurement, we reject the null hypothesis of no correlation at 9.1$\sigma$. We constrain cosmological parameters from a joint analysis of galaxy and CMB lensing-galaxy power spectra considering a flat \LCDM model, marginalized over 23 astrophysical and systematic nuisance parameters. We find the clustering amplitude $S_8\equiv \sigma_8 (\Omega_m/0.3)^{0.5} = 0.75^{+0.04}_{-0.05}$. In addition, we co nstrain the linear growth of cosmic structure as a function of redshift. Our results are consistent with recent DES Y3 analyses and suggest a preference for a lower $S_8$ compared to results from measurements of CMB anisotropies by the \textit{Planck} satellite, although at a mild level ($< 2 \sigma$) of statistical significance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

The Atacama Cosmology Telescope: High-resolution component-separated maps across one-third of the sky

Observations of the millimeter sky contain valuable information on a number of signals, including the blackbody cosmic microwave background (CMB), Galactic emissions, and the Compton-$y$ distortion due to the thermal Sunyaev-Zel'dovich (tSZ) effect. Extracting new insight into cosmological and astrophysical questions often requires combining multi-wavelength observations to spectrally isolate one component. In this work, we present a new arcminute-resolution Compton-$y$ map, which traces out the line-of-sight-integrated electron pressure, as well as maps of the CMB in intensity and E-mode polarization, across a third of the sky (around 13,000 sq.~deg.). We produce these through a joint analysis of data from the Atacama Cosmology Telescope (ACT) Data Release 4 and 6 at frequencies of roughly 93, 148, and 225 GHz, together with data from the \textit{Planck} satellite at frequencies between 30 GHz and 545 GHz. We present detailed verification of an internal linear combination pipeline implemented in a needlet frame that allows us to efficiently suppress Galactic contamination and account for spatial variations in the ACT instrument noise. These maps provide a significant advance, in noise levels and resolution, over the existing \textit{Planck} component-separated maps and will enable a host of science goals including studies of cluster and galaxy astrophysics, inferences of the cosmic velocity field, primordial non-Gaussianity searches, and gravitational lensing reconstruction of the CMB.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Leveraging Hydropower Multi-Sensor Data for Inference and Age-Informed Modeling

Increased demand of operational flexibility such as faster ramp up/down in generation, and more frequent start/stops are putting hydropower plants and their associated components in unprecedented stress. Consequently, these plants are at the high risk of extended and more frequent outage to accommodate unscheduled, and unexpected maintenance. Therefore, hydropower plants are in critical need of data driven and age-informed analysis for their regular and unscheduled operation. Yet not all hydropower plants are exhaustively equipped with sensors and/or measurement streams for their respective components – demanding solutions on how to detect, identify, and locate the cause of any event from the unobservable. Idaho National Laboratory (INL) analyzed the anonymized measurements and event records from the Hydropower Research Institute (HRI) to address this issue, as part of the Water Power Technologies Office (WPTO) funded one year multi-lab project. First, we investigated how time series of multiple sensor measurements can be leveraged to identify an event “root cause” as well as to develop an inference (i.e., estimate the unobservable) problem. INL also investigated how individual hydropower components’ reaction or response times vary across the pre-event, during event, and post-event conditions – enabling the hydropower dynamic models to be age-informed. Finally, the impact of clustering multi-sensor time series on short-term vibration prediction is analyzed. INL will present key findings from these analyses and recommend next steps for stakeholder adoption.

13 HYDRO ENERGY↗
DOE OSTI2021

Machine Learning to Identify Geologic Factors Associated with Production in Geothermal Fields: A Case-Study Using 3D Geologic Data from Brady Geothermal Field and NMFk

In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fuid-fow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fuid-fow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k-means clustering (NMFk), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes. This submission includes the published journal article detailing this work, the published 3D geologic map of the Brady Geothermal Area used as a basis to develop structural and geological variables that are hypothesized to control or effect permeability or connectivity, 3D well data, along which geologic data were sampled for PCA analyses, and associated metadata file. This work was done using the GeoThermalCloud framework, which is part of SmartTensors (both are linked below).

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

A New Member of the Milky Way’s Family Tree: Characterizing the Pontus Merger of Our Galaxy

We study the Pontus structure—a recently discovered merger that brought in ~7 globular clusters in the course of the hierarchical buildup of the Milky Way’s halo. Here, we analyze the stellar population of Pontus and examine (1) its phase-space distribution using the ESA/Gaia data set, (2) its metallicity and chemical abundances (i.e., [Fe/H], [ α /Fe], [Mg/Fe], and [Al/Fe]) using the spectroscopic catalog of APOGEE DR17, and (3) the color–magnitude diagram that shows interesting features, including a possibly double horizontal branch and a small population of blue stragglers. In sum, the Pontus stars show some unique properties that suggest they likely originated from the merging of an independent satellite galaxy; however, future analysis will shed more light on the true nature of this structure. This chemodynamical analysis of Pontus stars is another step forward in our bigger quest to characterize all the merging events of our Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Analysis of Real-World Preignition Data Using Neural Networks

Increasing adoption of downsized, boosted, spark-ignition engines has improved vehicle fuel economy, and continued improvement is desirable to reduce carbon emissions in the near-term. However, this strategy is limited by damaging preignition events which can cause hardware failure. Research to date has shed light on various contributing factors related to fuel and lubricant properties as well as calibration strategies, but the causal factors behind an individual preignition cycle remain elusive. If actionable precursors could be identified, mitigation through active control strategies would be possible. This paper uses artificial neural networks to search for identifiable precursors in the cylinder pressure data from a large real-world data set containing many preignition cycles. It is found that while follow-up preignition cycles in clusters can be readily predicted, the initial preignition cycle is not predictable based on features of the cylinder pressure. Further, this indicates that the alternating pattern of preignition cycles within clusters is influenced by the thermodynamic state as reflected in the pressure, but that the trigger for the initial preignition cycle is not thermodynamic in nature, but more likely tied to a critical threshold in the chemistry of the fuel/lubricant mixture in the upper crevice or other factors related to the presence of an ignition source.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Cosmological constraints from density-split clustering in the BOSS CMASS galaxy sample

We present a clustering analysis of the BOSS DR12 CMASS galaxy sample, combining measurements of the galaxy two-point correlation function and density-split clustering down to a scale of $1 \, h^{-1}\, \text{Mpc}$. Our theoretical framework is based on emulators trained on high-fidelity mock galaxy catalogues that forward model the cosmological dependence of the clustering statistics within an extended-ΛCDM framework, including redshift-space and Alcock–Paczynski distortions. Our base-ΛCDM analysis finds ω cdm = 0.1201 ± 0.0022, σ 8 = 0.792 ± 0.034, and n s = 0.970 ± 0.018, corresponding to fσ 8 = 0.462 ± 0.020 at z ≈ 0.525, which is in agreement with Planck 2018 predictions and various clustering studies in the literature. We test single-parameter extensions to base-ΛCDM, varying the running of the spectral index, the dark energy equation of state, and the density of mass-less relic neutrinos, finding no compelling evidence for deviations from the base model. We model the galaxy–halo connection using a halo occupation distribution framework, finding signatures of environment-based assembly bias in the data. We validate our pipeline against mock catalogues that match the clustering and selection properties of CMASS, showing that we can recover unbiased cosmological constraints even with a volume 84 times larger than the one used in this study.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Assessing complexity and dynamics in epidemics: geographical barriers and facilitators of foot-and-mouth disease dissemination

Introduction: Physical and non-physical processes that occur in nature may influence biological processes, such as dissemination of infectious diseases. However, such processes may be hard to detect when they are complex systems. Because complexity is a dynamic and non-linear interaction among numerous elements and structural levels in which specific effects are not necessarily linked to any one specific element, cause-effect connections are rarely or poorly observed. Methods: To test this hypothesis, the complex and dynamic properties of geo-biological data were explored with high-resolution epidemiological data collected in the 2001 Uruguayan foot-and-mouth disease (FMD) epizootic that mainly affected cattle. County-level data on cases, farm density, road density, river density, and the ratio of road (or river) length/county perimeter were analyzed with an open-ended procedure that identified geographical clustering in the first 11 epidemic weeks. Two questions were asked: (i) do geo-referenced epidemiologic data display complex properties? and (ii) can such properties facilitate or prevent disease dissemination? Results: Emergent patterns were detected when complex data structures were analyzed, which were not observed when variables were assessed individually. Complex properties–including data circularity–were demonstrated. The emergent patterns helped identify 11 counties as ‘disseminators’ or ‘facilitators’ (F) and 264 counties as ‘barriers’ (B) of epidemic spread. In the early epidemic phase, F and B counties differed in terms of road density and FMD case density. Focusing on non-biological, geographical data, a second analysis indicated that complex relationships may identify B-like counties even before epidemics occur. Discussion: Geographical barriers and/or promoters of disease dispersal may precede the introduction of emerging pathogens. If corroborated, the analysis of geo-referenced complexity may support anticipatory epidemiological policies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Uncovering Structure–Conductivity Relationships in Anion Exchange Membranes (AEMs) Using Interpretable Machine Learning

Anion exchange membranes (AEMs) play a vital role in the performance of water electrolyzers and fuel cells, yet their discovery and optimization remain challenging due to the complexity of structure–property relationships. In this study, we introduce a machine learning framework that leverages conditional graph neural networks (cGNNs) and descriptor-based models and a hybrid graph neural network (HGARE) to predict and interpret ionic conductivity. The descriptor-based pipeline employs principal component analysis (PCA), ablation, and SHAP analysis to identify factors governing anion conductivity, revealing electronic, topological, and compositional descriptors as key contributors. Beyond prediction, dimensionality reduction and clustering are performed by employing t-SNE and KMeans as well as SOM, which reveal distinct membranes clusters, some of which were enriched with high anion conductivity. Among graph-based approaches, the graph convolutional (GCN) achieved strong predictive performance, while the Hybrid Graph Autoencoder-Regressor Ensemble (HGARE) achieved the highest accuracy. Additionally, atom-level saliency maps from GCN provide spatial explanations for conductive behavior, revealing the importance of polarizable and flexible regions. This work contributes to the accelerated and data-driven design of high-performance AEMs.

Naghshnejad, Pegah [Department of Chemical Enginee↗
DOE OSTI2023

Demographic Information Incorporated Household Energy Consumption Analysis

The high energy consumption from residential buildings provides them large potential to participate in demand response programs. To design appropriate demand response programs for residential buildings, it is important for electric utilities to know the energy consumption characteristics for different types of households so that utilities can send requests to the groups with a higher possibility to successfully respond. In this paper, we develop a load model to generate synthetic load profiles for different types of households incorporating demographical information including Current Population Survey data set and American Time Use Survey data set. The details of each data set and the details of the load models are presented. The synthetic household load profiles are generated by the load model and clustered into different groups based on state, age, number of occupants, income level, and city of the household. The average energy consumption characteristics for different groups of households are analyzed and compared, which will help electric utilities issue demand response signals to appropriate households.

building loads↗