SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

Large-scale scientific workflows rely heavily on high-performance file transfers. These transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or data duplication. To have successful file transfers, methods such as predetermined thresholds and statistical analysis need to be done to determine abnormal patterns. Network administrators routinely monitor and analyze network data for diagnosing and alleviating these, making decisions based on their experience. However, as networks grow and become complex, monitoring large data files and quickly processing them, makes it improbable to identify errors and rectify these. Abnormal file transfers have been classified by simply setting alert thresholds, via tools such as PerfSonar and TCP statistics (Tstat). This paper investigates the feasibility of unsupervised feature extraction methods for identifying network anomaly patterns with three unsupervised classification methods—principal component analysis, autoencoder and isolation forest. Here, we collect file transfer statistics from two experiment sets—synthetic iPerf generated traffic and 1000 Genome workflow runs, with synthetically introduced anomalies. Our results show that while PCA and a simple autoencoder finds it difficult to detect clusters, the tree-variant isolation forest is able to identify anomalous packets by breaking down TCP traces into tree classes early.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Uncovering DNA-PKcs ancient phylogeny, unique sequence motifs and insights for human disease

DNA-dependent protein kinase catalytic subunit (DNA-PKcs) is a key member of the phosphatidylinositol-3 kinase-like (PIKK) family of protein kinases with critical roles in DNA-double strand break repair, transcription, metastasis, mitosis, RNA processing, and innate and adaptive immunity. The absence of DNA-PKcs from many model organisms has led to the assumption that DNA-PKcs is a vertebrate-specific PIKK. Here, we find that DNA-PKcs is widely distributed in invertebrates, fungi, plants, and protists, and that threonines 2609, 2638, and 2647 of the ABCDE cluster of phosphorylation sites are highly conserved amongst most Eukaryotes. Furthermore, we identify highly conserved amino acid sequence motifs and domains that are characteristic of DNA-PKcs relative to other PIKKs. These include residues in the Forehead domain and a novel motif we have termed YRPD, located in an α helix C-terminal to the ABCDE phosphorylation site loop. Combining sequence with biochemistry plus structural data on human DNA-PKcs unveils conserved sequence and conformational features with functional insights and implications. The defined generally progressive DNA-PKcs sequence diversification uncovers conserved functionality supported by Evolutionary Trace analysis, suggesting that for many organisms both functional sites and evolutionary pressures remain identical due to fundamental cell biology. The mining of cancer genomic data and germline mutations causing human inherited disease reveal that robust DNA-PKcs activity in tumors is detrimental to patient survival, whereas germline mutations compromising function are linked to severe immunodeficiency and neuronal degeneration. We anticipate that these collective results will enable ongoing DNA-PKcs functional analyses with biological and medical implications.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Combining field and remote sensing data to estimate forest canopy damage and recovery following tropical cyclones across tropical regions

Abstract As tropical forests cycle the most water and carbon, it is crucial to understand the short- and long-term effects of intensifying cyclones on these ecosystems. Soil nutrient status has been shown to moderate forest cyclone responses using field litterfall measurements, but litterfall is one of the multiple cyclone impact metrtics, which may or may not be correlated with one another or with site nutrients. We used remotely sensed vegetation indices to quantify immediate damage and two-year recovery for 42 cases across nine tropical forests in Hawaii, Puerto Rico, Mexico, Australia, and Taiwan affected by 12 cyclones between 2004 and 2017. We tested whether changes in leaf area index (LAI) and enhanced vegetation index (EVI) correlated with changes in litterfall observations and how changes varied with total soil phosphorus (P) concentrations across regions. We compared cyclone-induced changes and recovery of LAI and EVI to litterfall observations compiled in a pantropical meta-analysis. We found large variation in changes in LAI and EVI across forests, with the greatest reductions in LAI (−77%) and EVI (−77%) in Mexico (Jalisco) and Puerto Rico, respectively. LAI ( r = −0.52) and EVI ( r = −0.60) changes correlated with those in litterfall across cases. Post-cyclone data showed recovery of LAI by four months, EVI by two months, and litterfall by ten months. We detected larger changes in LAI and EVI in forests with higher soil P, but these relationships were not significant when accounting for cyclone and site as random effects. Principal component analyses indicated a regional clustering of cases related to their contrasting cyclone regimes, with the frequency and intensity of cyclone events negatively correlated. Overall, remote sensing observations complement but do not substitute for ground observations that reveal cyclone damage and post-cyclone recovery in tropical forests, and soil phosphorus moderates some but not all metrics of stability in response to cyclones.

Bloom, Dellena E. (ORCID:0000000205981747)↗

DOE OSTI2022

Stringent σ8 constraints from small-scale galaxy clustering using a hybrid MCMC + emulator framework

ABSTRACT We present a novel simulation-based hybrid emulator approach that maximally derives cosmological and Halo Occupation Distribution (HOD) information from non-linear galaxy clustering, with sufficient precision for DESI Year 1 (Y1) analysis. Our hybrid approach first samples the HOD space on a fixed cosmological simulation grid to constrain the high-likelihood region of cosmology + HOD parameter space, and then constructs the emulator within this constrained region. This approach significantly reduces the parameter volume emulated over, thus achieving much smaller emulator errors with fixed number of training points. We demonstrate that this combined with state-of-the-art simulations result in tight emulator errors comparable to expected DESI Y1 LRG sample variance. We leverage the new abacussummit simulations and apply our hybrid approach to CMASS non-linear galaxy clustering data. We infer constraints on σ8 = 0.762 ± 0.024 and fσ8(zeff = 0.52) = 0.444 ± 0.016, the tightest among contemporary galaxy clustering studies. We also demonstrate that our fσ8 constraint is robust against secondary biases and other HOD model choices, a critical first step towards showcasing the robust cosmology information accessible in non-linear scales. We speculate that the additional statistical power of DESI Y1 should tighten the growth rate constraints by at least another 50–60 ${{\ \rm per\ cent}}$, significantly elucidating any potential tension with Planck. We also address the ‘lensing is low’ tension, which we find to be in the same direction as a potential tension in fσ8. We show that the combined effect of a lower fσ8 and environment-based bias accounts for approximately $50{{\ \rm per\ cent}}$ of the discrepancy.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1976

Shuttle onboard IMU alignment methods

The current approach to the shuttle IMU alignment is based solely on the Apollo Deterministic Method. This method is simple, fast, reliable and provides an accurate estimate for the present cluster to mean of 1,950 transformation matrix. If four or more star sightings are available, the application of least squares analysis can be utilized. The least squares method offers the next level of sophistication to the IMU alignment solution. The least squares method studied shows that a more accurate estimate for the misalignment angles is computed, and the IMU drift rates are a free by-product of the analysis. Core storage requirements are considerably more; estimated 20 to 30 times the core required for the Apollo Deterministic Method. The least squares method offers an intermediate solution utilizing as much data that is available without a complete statistical analysis as in Kalman filtering.

Henderson, D. M.↗

NASA NTRS2023

Phytoplankton Diversity and Chemotaxonomy in Contrasting North Pacific Ecosystems

Background. Phytoplankton is the base of majority of ocean ecosystems. It is responsible for half of the global primary production, and different phytoplankton taxa have a unique role in global biogeochemical cycles. In addition, phytoplankton abundance and diversity are highly susceptible to climate induced changes, hence monitoring of phytoplankton and its diversity is important and necessary. Methods. Water samples for phytoplankton and photosynthetic pigment analyses were collected in boreal winter 2017, along transect in the North Pacific Subtropical Gyre (NPSG) and the California Current System (CCS). Phytoplankton community was analyzed using light and scanning electron microscopy and photosynthetic pigments by high-performance liquid chromatography. To describe distinct ecosystems, monthly average satellite data of MODIS Aqua Sea Surface temperature and Chlorophyll a concentration, as well as Apparent Visible Wavelength were used. Results. A total of 207 taxa have been determined, mostly comprised of coccolithophores (35.5%), diatoms (25.2%) and dinoflagellates (19.5%) while cryptophytes, phytoflagellates and silicoflagellates were included in the group ``others" (19.8%). Phytoplankton spatial distribution was distinct, indicating variable planktonic dispersal rates and specific adaptation to ecosystems. Dinoflagellates, and nano-scale coccolithophores dominated NPSG, while micro-scale diatoms, and cryptophytes prevailed in CCS. A clear split between CCS and NPSG is evident in dendogram visualising LINKTREE constrained binary divisive clustering analysis done on phytoplankton counts and pigment oncentrations. Of all pigments determined, alloxanthin, zeaxanthin, divinyl chlorophyll b and lutein have highest correlation to phytoplankton counts. Conclusion. Combining chemotaxonomy and microscopy is an optimal method to determine phytoplankton diversity on a large-scale transect. Distinct communities between the two contrasting ecosystems of North Pacific reveal phytoplankton groups specific adaptations to trophic state, and support the hypothesis of shift from microto nano-scale taxa due to sea surface temperatures rising, favoring stratification and oligotrophic conditions.

oceanography↗

DOE OSTI2021

One of These Things IS Like the Other: Pursuing a New Taxonomy of Industry for Improved Energy System Modeling

Industrial processes drive the exchange of materials, energy, and currency throughout the economy. These processes are powered by electricity and direct combustion, with variation in their operation even within the same industry. This heterogeneity makes it difficult for large models, including the National Energy Modeling System (US), to project their energy use while remaining tractable. Decarbonization and ensuing changes to the energy system require changes to industrial processes while offering opportunities for process innovation, but the extent and nature of changes are difficult to model with current classification schemes and corresponding data. The North American Industrial Classification (NAICS) is an economic taxonomy of industries, but its categories are less meaningful from an energy and material flow perspective. For example, a facility that makes steel from iron ore in a blast furnace/basic oxygen furnace is categorized under the same NAICS code as a facility that makes steel from scrap in an electric arc furnace despite the scale, use of recycled scrap versus iron ore, and energy use differences in the two facility types. Exploratory analysis is performed on a large dataset used for plant-level energy assessment in order to detect clusters that can aid in better modeling of industry for energy analysis in an evolving system with breakthrough technologies.

28 EE - Advanced Manufacturing Office (EE-5A)↗

DOE OSTI2020

Machine-Learning-Based Analysis of the Guy-Greenbrier, Arkansas Earthquakes: A Tale of Two Sequences

Here, we revisited the June 2010 to October 2011 Guy-Greenbrier earthquake sequence in central Arkansas using PhaseNet, a deep neural network trained to pick P and S arrival times. We applied PhaseNet to continuous waveform data and used phase association and hypocenter relocation to locate nearly 90,000 events. Our catalog suggests that the sequence consists of two adjacent earthquake sequences on the same fault and that the second sequence may be associated with the wastewater disposal well to the west of the Guy-Greenbrier Fault, rather than the wells to the north and the east that were previously implicated. We find that each sequence is composed of many small clusters that exhibit diffusion along the fault at shorter timescales. Our study demonstrates that machine-learning-based earthquake catalog development is now feasible and will yield new insights into earthquake behavior.

58 GEOSCIENCES↗

DOE OSTI2024

Cosmological constraints from the tomography of DES-Y3 galaxies with CMB lensing from ACT DR4

We present a measurement of the cross-correlation between the MagLim galaxies selected from the Dark Energy Survey (DES) first three years of observations (Y3) and cosmic microwave background (CMB) lensing from the Atacama Cosmology Telescope (ACT) Data Release 4 (DR4), reconstructed over ∼ 436 deg 2 of the sky. Our galaxy sample, which covers ∼ 4143 deg 2 , is divided into six redshift bins spanning the redshift range of 0.20 < z <1.05. We adopt a blinding procedure until passing all consistency and systematics tests. After imposing scale cuts for the cross-power spectrum measurement, we reject the null hypothesis of no correlation at 9.1σ. We constrain cosmological parameters from a joint analysis of galaxy and CMB lensing-galaxy power spectra considering a flat ΛCDM model, marginalized over 23 astrophysical and systematic nuisance parameters. We find the clustering amplitude S 8 ≡ σ 8 (Ω m /0.3) 0.5 = 0.75 +0.04 -0.05 . In addition, we constrain the linear growth of cosmic structure as a function of redshift. Our results are consistent with recent DES Y3 analyses and suggest a preference for a lower S 8 compared to results from measurements of CMB anisotropies by the Planck satellite, although at a mild level (< 2σ) of statistical significance.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Machine learning to identify geologic factors associated with production in geothermal fields: a case-study using 3D geologic data, Brady geothermal field, Nevada

Abstract In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fluid-flow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fluid-flow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k -means clustering (NMF k ), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes.

58 GEOSCIENCES↗

DOE OSTI2023

DES-Y3 galaxies & ACT DR4 CMB lensing tomography

We present a measurement of the cross-correlation between the \maglim galaxies selected from the Dark Energy Survey (DES) first three years of observations (Y3) and cosmic microwave background (CMB) lensing from the Atacama Cosmology Telescope (ACT) Data Release 4 (DR4), reconstructed over $\sim 436$ $\sqdeg$ of the sky. Our galaxy sample, which covers $\sim 4143$ $\sqdeg$, is divided into six redshift bins spanning the redshift range of $0.20<z<1.05$. We adopt a blinding procedure until passing all consistency and systematics tests. After imposing scale cuts for the cross-power spectrum measurement, we reject the null hypothesis of no correlation at 9.1$\sigma$. We constrain cosmological parameters from a joint analysis of galaxy and CMB lensing-galaxy power spectra considering a flat \LCDM model, marginalized over 23 astrophysical and systematic nuisance parameters. We find the clustering amplitude $S_8\equiv \sigma_8 (\Omega_m/0.3)^{0.5} = 0.75^{+0.04}_{-0.05}$. In addition, we co nstrain the linear growth of cosmic structure as a function of redshift. Our results are consistent with recent DES Y3 analyses and suggest a preference for a lower $S_8$ compared to results from measurements of CMB anisotropies by the \textit{Planck} satellite, although at a mild level ($< 2 \sigma$) of statistical significance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

The Atacama Cosmology Telescope: High-resolution component-separated maps across one-third of the sky

Observations of the millimeter sky contain valuable information on a number of signals, including the blackbody cosmic microwave background (CMB), Galactic emissions, and the Compton-$y$ distortion due to the thermal Sunyaev-Zel'dovich (tSZ) effect. Extracting new insight into cosmological and astrophysical questions often requires combining multi-wavelength observations to spectrally isolate one component. In this work, we present a new arcminute-resolution Compton-$y$ map, which traces out the line-of-sight-integrated electron pressure, as well as maps of the CMB in intensity and E-mode polarization, across a third of the sky (around 13,000 sq.~deg.). We produce these through a joint analysis of data from the Atacama Cosmology Telescope (ACT) Data Release 4 and 6 at frequencies of roughly 93, 148, and 225 GHz, together with data from the \textit{Planck} satellite at frequencies between 30 GHz and 545 GHz. We present detailed verification of an internal linear combination pipeline implemented in a needlet frame that allows us to efficiently suppress Galactic contamination and account for spatial variations in the ACT instrument noise. These maps provide a significant advance, in noise levels and resolution, over the existing \textit{Planck} component-separated maps and will enable a host of science goals including studies of cluster and galaxy astrophysics, inferences of the cosmic velocity field, primordial non-Gaussianity searches, and gravitational lensing reconstruction of the CMB.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Leveraging Hydropower Multi-Sensor Data for Inference and Age-Informed Modeling

Increased demand of operational flexibility such as faster ramp up/down in generation, and more frequent start/stops are putting hydropower plants and their associated components in unprecedented stress. Consequently, these plants are at the high risk of extended and more frequent outage to accommodate unscheduled, and unexpected maintenance. Therefore, hydropower plants are in critical need of data driven and age-informed analysis for their regular and unscheduled operation. Yet not all hydropower plants are exhaustively equipped with sensors and/or measurement streams for their respective components – demanding solutions on how to detect, identify, and locate the cause of any event from the unobservable. Idaho National Laboratory (INL) analyzed the anonymized measurements and event records from the Hydropower Research Institute (HRI) to address this issue, as part of the Water Power Technologies Office (WPTO) funded one year multi-lab project. First, we investigated how time series of multiple sensor measurements can be leveraged to identify an event “root cause” as well as to develop an inference (i.e., estimate the unobservable) problem. INL also investigated how individual hydropower components’ reaction or response times vary across the pre-event, during event, and post-event conditions – enabling the hydropower dynamic models to be age-informed. Finally, the impact of clustering multi-sensor time series on short-term vibration prediction is analyzed. INL will present key findings from these analyses and recommend next steps for stakeholder adoption.

13 HYDRO ENERGY↗

NASA NTRS1976

Space station systems analysis study. Part 1, volume 1: Executive study

Potential space station system options were examined for a permanent, manned, orbital space facility and to provide data to NASA program planners and decision makers for their use in future program planning. There were ten space station system objectives identified. These were categorized into five major objectives and five supporting objectives. The major objectives were to support the development of: (1) satellite power systems, (2) nuclear energy plants in space, (3) space processing, (4) earth services, and (5) space cosmological research and development. The five supporting objectives, to define space facilities which would be basic building blocks for future systems, were: (1) a multidiscipline science laboratory, (2) an orbital depot to maintain, fuel, and service orbital transfer vehicles, (3) cluster support systems to provide power and data processing for multiple orbital elements, (4) a sensor development facility, and (5) the facilities necessary to enhance man's living and working in space.

Source record↗

DOE OSTI2021

Machine Learning to Identify Geologic Factors Associated with Production in Geothermal Fields: A Case-Study Using 3D Geologic Data from Brady Geothermal Field and NMFk

In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fuid-fow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fuid-fow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k-means clustering (NMFk), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes. This submission includes the published journal article detailing this work, the published 3D geologic map of the Brady Geothermal Area used as a basis to develop structural and geological variables that are hypothesized to control or effect permeability or connectivity, 3D well data, along which geologic data were sampled for PCA analyses, and associated metadata file. This work was done using the GeoThermalCloud framework, which is part of SmartTensors (both are linked below).

15 GEOTHERMAL ENERGY↗

DOE OSTI2022

A New Member of the Milky Way’s Family Tree: Characterizing the Pontus Merger of Our Galaxy

We study the Pontus structure—a recently discovered merger that brought in ~7 globular clusters in the course of the hierarchical buildup of the Milky Way’s halo. Here, we analyze the stellar population of Pontus and examine (1) its phase-space distribution using the ESA/Gaia data set, (2) its metallicity and chemical abundances (i.e., [Fe/H], [ α /Fe], [Mg/Fe], and [Al/Fe]) using the spectroscopic catalog of APOGEE DR17, and (3) the color–magnitude diagram that shows interesting features, including a possibly double horizontal branch and a small population of blue stragglers. In sum, the Pontus stars show some unique properties that suggest they likely originated from the merging of an independent satellite galaxy; however, future analysis will shed more light on the true nature of this structure. This chemodynamical analysis of Pontus stars is another step forward in our bigger quest to characterize all the merging events of our Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2001

Hyperspectral Image Classification using a Self-Organizing Map

The use of hyperspectral data to determine the abundance of constituents in a certain portion of the Earth's surface relies on the capability of imaging spectrometers to provide a large amount of information at each pixel of a certain scene. Today, hyperspectral imaging sensors are capable of generating unprecedented volumes of radiometric data. The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), for example, routinely produces image cubes with 224 spectral bands. This undoubtedly opens a wide range of new possibilities, but the analysis of such a massive amount of information is not an easy task. In fact, most of the existing algorithms devoted to analyzing multispectral images are not applicable in the hyperspectral domain, because of the size and high dimensionality of the images. The application of neural networks to perform unsupervised classification of hyperspectral data has been tested by several authors and also by us in some previous work. We have also focused on analyzing the intrinsic capability of neural networks to parallelize the whole hyperspectral unmixing process. The results shown in this work indicate that neural network models are able to find clusters of closely related hyperspectral signatures, and thus can be used as a powerful tool to achieve the desired classification. The present work discusses the possibility of using a Self Organizing neural network to perform unsupervised classification of hyperspectral images. In sections 3 and 4, the topology of the proposed neural network and the training algorithm are respectively described. Section 5 provides the results we have obtained after applying the proposed methodology to real hyperspectral data, described in section 2. Different parameters in the learning stage have been modified in order to obtain a detailed description of their influence on the final results. Finally, in section 6 we provide the conclusions at which we have arrived.

Martinez, P.↗

NASA NTRS2004

Detecting the Sun in 2-Gyr Old Open Clusters

The aim of this observation was to take advantage of the large collecting area and sensitivity of the European Space Agency's XMM-Newton telescope to survey the X ray brightness of solar-mass stars in the 2 Gyr old NGC 752 cluster in order to chart out the dependence of coronal X ray emission of Sun like stars as a function of age. Dr. Simon's stated role as one of the co-investigators in the project was limited to assisting the project's European Principal Investigator with the analysis and interpretation of the X ray measurements, and to assist in summarizing the results for publication. The observation was executed successfully, and approximately 130 X ray sources were detected in the XMM field of view and subsequently measured to obtain X ray count rates. To date neither the measurements nor the raw data have been distributed by the European P.I. to the co-investigators, It is expected that the measurements will be distributed to the co-investigators by the end of 2004, and once that is done, the scientific analysis by Dr. Simon can then begin. At present, since the data and measurements have not been shared with the co-investigators, there are no results to report.

Simon, Theodore↗