Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

SPT-3G D1: Compton-$y$ maps using data from the SPT-3G and Planck surveys

We present thermal Sunyaev-Zel'dovich (tSZ) Compton-$y$ parameter maps constructed from two years (2019-2020) of observations with the South Pole Telescope (SPT) third-generation camera, SPT-3G, combined with data from the Planck satellite. Using a linear combination (LC) pipeline, we obtain a suite of reconstructions that explore different trade-offs between statistical sensitivity and suppression of astrophysical contaminants, including minimum-variance, CMB-deprojected, and CIB-deprojected $y$-maps. We validate these maps through different statistical techniques such as auto- and cross-power spectra with large-scale structure tracers as well as stacking on cluster locations. These tests are used to understand the balance between noise and astrophysical foreground residuals (such as the CIB) in combination with the recovery of the tSZ signal for different maps. For example, results from stacking at the location of clusters confirm the robustness of the recovered tSZ signal over the $\sim 1500\: {\rm deg}^2$ SPT-3G survey field used in this analysis. The high-resolution and low-noise maps produced here provide an important cosmological tool for future studies, including measurements of the Compton-$y$ map power spectrum, cross-correlations with other tracers of the large-scale structure, detailed modeling of cluster pressure profiles, and study of the thermodynamic state of the baryons in the Universe.

Maniyar, A. S. [Harvard-Smithsonian Ctr. Astrophys↗
DOE OSTI2022

Search for a heavy resonance decaying into a top quark and a W boson in the lepton+jets final state at $\sqrt{s}$ = 13 TeV

A search for a heavy resonance decaying into a top quark and a W boson in proton-proton collisions at $\sqrt{s}$ = 13 TeV is presented. The data analyzed were recorded with the CMS detector at the LHC and correspond to an integrated luminosity of 138 fb -1 . The top quark is reconstructed as a single jet and the W boson, from its decay into an electron or muon and the corresponding neutrino. A top quark tagging technique based on jet clustering with a variable distance parameter and simultaneous jet grooming is used to identify jets from the collimated top quark decay. The results are interpreted in the context of two benchmark models, where the heavy resonance is either an excited bottom quark b* or a vector-like quark B. A statistical combination with an earlier search by the CMS Collaboration in the all-hadronic final state is performed to place upper cross section limits on these two models. The new analysis extends the lower range of resonance mass probed from 1.4 down to 0.7 TeV. For left-handed, right-handed, and vector-like couplings, b* masses up to 3.0, 3.0, and 3.2 TeV are excluded at 95% confidence level, respectively. The observed upper limits represent the most stringent constraints on the b* model to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Data-driven evaluation of HVAC operation and savings in commercial buildings

Commercial buildings consumed 36% of electricity, or 1.35 trillion kWh, in the United States in 2017, and almost 30% of this energy was wasted. Much of this loss can be attributed to inefficient heating ventilation and air con­ditioning (HVAC) systems. By improving the operational conditions of HVAC, significant savings can be achieved. However, most buildings and building equipment do not use costly sub-meters to monitor and address performance issues, and on-site auditing can be expensive and insufficient. Alternatively in this study, we propose a data-driven method to identify savings opportunities using only whole building meter data and without setting foot in the building. For this purpose, we introduced two algorithms that virtually quantify the value of a thermostat setpoint setback and HVAC rescheduling. Additionally, we developed novel methods for detecting occupancy patterns and quantifying the baseload of the HVAC operation. Using a clustering algorithm, we identified those buildings for which HVAC savings was significant and further categorized the buildings based on their potential for savings. A population study of over 432 commercial buildings demonstrated a median percentage energy savings of 1.6% from a baseload reduction and 2.1% from HVAC rescheduling. Additionally, results indicate that retail buildings have the highest potential for savings among the building types studied.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Characterization of Fuel Cladding Chemical Interaction on a High Burnup U-10Zr Metallic Fuel via Electron Energy Loss Spectroscopy Enhanced by Machine Learning

Fuel cladding chemical interaction (FCCI) is one of the main performance limiting factors for metallic nuclear fuels. The interaction destabilizes the martensitic microstructure and deteriorates mechanical properties of HT-9 cladding. The detection of low atomic number elements (Z<10) and overlapping of elemental peaks can be problematic in interpreting energy dispersive X-ray spectroscopy (EDS) data. Electron energy loss spectroscopy (EELS) provides precise elemental edge energy values and can detect elements with a low atomic number. This work utilizes EELS to study the distribution of lanthanides and light elements at the interaction region. The sample was prepared from the FCCI region of a U-10Zr (wt.%) solid fuel with HT-9 cladding, irradiated to a burnup of 13.2 at.%. Processing the EELS data included three major steps: 1) enhance the signal to noise ratio by denoising the spectrum with principal component analysis (PCA) method, removing background and performing deconvolution; 2) identify chemical elements with core energy loss edges; 3) confirm different phases using a popular machine learning method, K-means. This work presents qualitative assessment of lanthanides and light elements like carbon (C) and oxygen (O) enhanced by the application of machine learning algorithms. By comparing with EDS elemental maps, EELS provides higher resolution chemical maps, reveals the distribution of carbon at the interaction region supporting the formation of zirconium carbide, a rind-like microstructure feature that was proposed to mitigate the chemical interaction. Furthermore, the plasmon peak map was also found to indicate an energy shift associated with the formation of phases/compounds. K-means clustering method was used on the processed electron energy loss (EEL) spectrum to automatically reveal different phases. The resulting clustered maps from K-means clustering align well with elemental maps confirming certain phases, especially Fe-Ce and Zr-C, in the FCCI region.

EELS↗
DOE OSTI2021

Probing the hadronic nature of the gamma-ray emission associated with Westerlund 2

ABSTRACT Star-forming regions have been proposed as potential Galactic cosmic ray accelerators for decades. Cosmic ray acceleration can be probed through observations of gamma-rays produced in inelastic proton–proton collisions at GeV and TeV energies. In this paper, we analyse more than 11 yr of Fermi–LAT data from the direction of Westerlund 2, one of the most massive and best-studied star-forming regions in our Galaxy. In particular, we investigate the characteristics of the bright pulsar PSR J1023–5746 that dominates the gamma-ray emission below a few GeV at the position of Westerlund 2 and the underlying extended source FGES J1023.3–5747. The analysis results in a clear identification of FGES J1023.3–5747 as the GeV counterpart of the TeV source HESS J1023-575, through its morphological and spectral properties. This identification provides new clues about the origin of the HESS J1023-575 gamma-ray emission, favouring a hadronic origin of the emission, powered by Westerlund 2, rather than a leptonic origin related to either the pulsar wind nebula associated with PSR J1023–5746 or the cluster itself. This result indirectly supports the hypothesis that star-forming regions can contribute to the cosmic ray sea observed in our Galaxy.

Mestre, Enrique↗
DOE OSTI2022

HFTS-2 (Final Report)

This report delves into the research program, identified tasks, various studies, observations, results, and conclusions under the Hydraulic Fracturing Test Site (HFTS-2) project. This test site is located in Loving County close to the Texas, New Mexico border. The program targeted the Wolfcamp formation in Delaware Basin. The aim of the project was to improve our understanding of hydraulic fracturing processes to not only optimize unconventional resource development in US Basins but to minimize environmental footprint as well. Various new diagnostic technologies were demonstrated at this site, including distributed acoustic microseismic, high resolution strain using Rayleigh frequency band (DSS-RFS), and in-fill proppant logging tool. Significant conclusions from this study include: 1) lateral and vertical fracture growth mapping as well as proppant transport behavior, 2) Use of DSS-RFS as a diagnostic tool to understand cluster level behavior, 3) Validation of proppant log, both at core scale as well as in-fill well implementation, and 4) New modeling tools to map far-field strain response using distributed strain sensing data. Specifically, far-field fracture distribution is influenced by linear fracture corridors defined by the stress-state as well as clustering behavior influenced by spatio-temporal effects. Depletion impacts on new stimulation was demonstrated and technically quantified. Significant vertical fracture height growth was observed. However, our understanding is limited by available gauge data availability. Numerical strain modeling techniques have been developed and demonstrated to help understand observed strain response behavior. Finally, proppant log has been further validated as a useful tool to map propped zones within the SRV. It has also shown very strong correlation with observed drawdown behavior at this test site. This report will detail many of these studies as well as technical results and conclusions from said studies. These include general subsurface characterization work, completion designs as implemented, studies looking at fracture geometry, high resolution microseismic study including source mechanisms, advanced DSS-RFS studies including drainage characterization, core characterization results, proppant analysis (core and in-fill child well), geochemistry, etc.

02 PETROLEUM↗
NASA NTRS1997

Visual Computing Environment

The Visual Computing Environment (VCE) is a NASA Lewis Research Center project to develop a framework for intercomponent and multidisciplinary computational simulations. Many current engineering analysis codes simulate various aspects of aircraft engine operation. For example, existing computational fluid dynamics (CFD) codes can model the airflow through individual engine components such as the inlet, compressor, combustor, turbine, or nozzle. Currently, these codes are run in isolation, making intercomponent and complete system simulations very difficult to perform. In addition, management and utilization of these engineering codes for coupled component simulations is a complex, laborious task, requiring substantial experience and effort. To facilitate multicomponent aircraft engine analysis, the CFD Research Corporation (CFDRC) is developing the VCE system. This system, which is part of NASA's Numerical Propulsion Simulation System (NPSS) program, can couple various engineering disciplines, such as CFD, structural analysis, and thermal analysis. The objectives of VCE are to (1) develop a visual computing environment for controlling the execution of individual simulation codes that are running in parallel and are distributed on heterogeneous host machines in a networked environment, (2) develop numerical coupling algorithms for interchanging boundary conditions between codes with arbitrary grid matching and different levels of dimensionality, (3) provide a graphical interface for simulation setup and control, and (4) provide tools for online visualization and plotting. VCE was designed to provide a distributed, object-oriented environment. Mechanisms are provided for creating and manipulating objects, such as grids, boundary conditions, and solution data. This environment includes parallel virtual machine (PVM) for distributed processing. Users can interactively select and couple any set of codes that have been modified to run in a parallel distributed fashion on a cluster of heterogeneous workstations. A scripting facility allows users to dictate the sequence of events that make up the particular simulation.

Lawrence, Charles↗
DOE OSTI2020

The role of building characteristics, demographics, and urban heat islands in shaping residential energy use

This study assesses the effects of residential building structure, socio-demographics, and ambient temperature conditions of a neighborhood to overall energy expenditures of a household. Using annual utility billing data, existing tax-lot records, temperature data, and U.S. Census demographic data, we ask two research questions: (1) What role do differences in neighborhood ambient heat, structural conditions and behavior play in helping to explain residential energy use? And (2) In what ways do energy expenditures spatially cluster in relation to urban heat islands? Using linear regression, spatial regression, and spatial clustering techniques, we evaluated the role of physical location of these households in relation to ambient temperatures. Significant positive relationships among energy expenditures and building size, average household size, White population, and population over 65 were observed; Significant negative relationships among energy expenditures and building density, renter population and population with a bachelor’s degree or higher were also observed. Negative relationships among morning and afternoon measures of heat, suggest that some areas spend less on energy use as a result of the neighborhood scale thermal environment. Spatial analysis of ambient temperature and energy expenditures show that energy use throughout the city is spatially clustered, with more affluent areas using more energy, regardless of whether heat islands are present. The results help to frame the role that increasing ambient temperatures in cities play in the spatial disparity in energy demand.

Residential Buildings, Energy Expenditure, Socio-d↗
DOE OSTI2025

Dark matter substructure or source model systematics? A case study of cluster lens Abell S1063

Mapping the small-scale structure of the universe through gravitational lensing is a promising tool for probing the particle nature of dark matter. Curved Arc Basis (CAB) has been proposed as a local lensing formalism in galaxy clusters, with the potential to detect low-mass dark matter substructure. In this work, we analyse the cluster lens Abell S1063 in search of dark matter substructure with the CAB formalism, using multiband imaging data from James Webb Space Telescope ( JWST ). We use two different source modelling methods: shapelets and pixel-based source reconstruction based on Delaunay triangulation. We find that source modelling systematics from shapelets result in a disagreement between CAB parameters measured from different filters. Source modelling with Delaunay significantly alleviates this systematic, as seen in the improvement in agreement across filters. We also find that inadequate complexity in source modelling can result in convincing spurious detections of dark matter substructure from strong gravitational lenses, as seen by our $\Delta \text{BIC} > 20$ measurement of a $M \sim 10^{10}$ ${\rm M}_{\odot }$ subhalo with shapelets, a spurious detection that is not reproduced with Delaunay source modelling. We demonstrate that multiband analysis with different JWST filters is key for disentangling source and lens model systematics from dark matter substructure detections.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Dark Energy Survey: Modeling strategy for multiprobe cluster cosmology and validation for the Full Six-year Dataset

We introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3x2pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (1) identification of modeling and parameterization choices and impact studies using simulated analyses with each possible model misspecification (2) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3x2pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy--galaxy lensing and cosmic shear two-point statistics) and the CL+3x2pt+BAO+SN (combination of CL+3x2pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Using X-ray spectrum imaging to quantify fission gas in high-burnup UO2 fuel

Analysis of fission gas bubbles (FGBs) in light-water reactor (LWR) fuel is needed to improve the understanding and predictive capability of fuel evolution under normal- and transient conditions. One of the most important parameters of a FGB is the pressure of the gas, primarily Xe, inside it. Bubble volume and location (inter- vs. intragranular) are important considerations as well. However, experimental analysis of such bubbles is challenging due to their small size and embedded nature, and usefulness of the data requires large numbers be analyzed. This paper proposes a method to measure the pressure of Xe bubbles using X-ray spectrum imaging (XSI) in scanning transmission electron microscopy (STEM). From X-ray generation and instrumental parameters, the number of Xe atoms yielding a given number of Xe L-series X-ray counts is estimated, and then from the estimated volume of the bubble the Xe density is estimated, which can then be converted to pressure via an equation-of-state. We apply the method to XSI datasets from high burnup (HBu) fuel from North Anna 1 reactor in as-irradiated and post-LOCA-test conditions and find Xe pressures in the FGBs clustered around 1 GPa.

Parish, Chad [ORNL] (ORCID:0000000312097439)↗
DOE OSTI2025

ICAT: The Interactive Corpus Analysis Tool

The Interactive Corpus Analysis Tool (ICAT) is a Python library for creating dashboards to explore textual datasets and build simple binary classification models to help filter through them and focus on entries of interest. This tool uses a form of interactive machine learning (IML), a paradigm of “machine teaching” (Simard et al., 2017) that sits at the intersection of the fields of human computer interaction (HCI), visual analytics, and machine learning. The intent of ICAT is to allow subject matter experts (SME) with limited to no experience in machine learning to benefit from an iterative human-in-the-loop (HITL) approach to building their own model without needing to understand the details of the underlying algorithm. This interactivity is achieved by allowing the user to create features, label data points, and visually manipulate a representation of the features to manually cluster and investigate data, while a model is trained on the fly based on these actions. ICAT is built on top of the Panel (Holoviz, 2018) library, using a combination of Vega, a custom IPyWidget using D3, and ipyvuetify, and is intended to be used inside of a Jupyter environment.

Martindale, Nathan [Oak Ridge National Laboratory ↗
NASA NTRS2005

New Directions in Space Operations Services in Support of Interplanetary Exploration

To gain access to the necessary operational processes and data in support of NASA's Lunar/Mars Exploration Initiative, new services, adequate levels of computing cycles and access to myriad forms of data must be provided to onboard spacecraft and ground based personnel/systems (earth, lunar and Martian) to enable interplanetary exploration by humans. These systems, cycles and access to vast amounts of development, test and operational data will be required to provide a new level of services not currently available to existing spacecraft, on board crews and other operational personnel. Although current voice, video and data systems in support of current space based operations has been adequate, new highly reliable and autonomous processes and services will be necessary for future space exploration activities. These services will range from the more mundane voice in LEO to voice in interplanetary travel which because of the high latencies will require new voice processes and standards. New services, like component failure predictions based on data mining of significant quantities of data, located at disparate locations, will be required. 3D or holographic representation of onboard components, systems or family members will greatly improve maintenance, operations and service restoration not to mention crew morale. Current operational systems and standards, like the Internet Protocol, will not able to provide the level of service required end to end from an end point on the Martian surface like a scientific instrument to a researcher at a university. Ground operations whether earth, lunar or Martian and in flight operations to the moon and especially to Mars will require significant autonomy that will require access to highly reliable processing capabilities, data storage based on network storage technologies. Significant processing cycles will be needed onboard but could be borrowed from other locations either ground based or onboard other spacecraft. Reliability will be a key factor with onboard and distributed backup processing an absolutely necessary requirement. Current cluster processing/Grid technologies may provide the basis for providing these services. An overview of existing services, future services that will be required and the technologies and standards required to be developed will be presented. The purpose of this paper will be to initiate a technological roadmap, albeit at a high level, of current voice, video, data and network technologies and standards (which show promise for adaptation or evolution) to what technologies and standards need to be redefined, adjusted or areas where new ones require development. The roadmap should begin the differentiation between non manned and manned processes/services where applicable. The paper will be based in part on the activities of the CCSDS Monitor and Control working group which is beginning the process of standardization of the these processes. Another element of the paper will be based on an analysis of current technologies supporting space flight processes and services at JSC, MSFC, GSFC and to a lesser extent at KSC. Work being accomplished in areas such as Grid computing, data mining and network storage at ARC, IBM and the University of Alabama at Huntsville will be researched and analyzed.

Bradford, Robert N.↗
NASA NTRS2013

Application of Statistically Derived CPAS Parachute Parameters

The Capsule Parachute Assembly System (CPAS) Analysis Team is responsible for determining parachute inflation parameters and dispersions that are ultimately used in verifying system requirements. A model memo is internally released semi-annually documenting parachute inflation and other key parameters reconstructed from flight test data. Dispersion probability distributions published in previous versions of the model memo were uniform because insufficient data were available for determination of statistical based distributions. Uniform distributions do not accurately represent the expected distributions since extreme parameter values are just as likely to occur as the nominal value. CPAS has taken incremental steps to move away from uniform distributions. Model Memo version 9 (MMv9) made the first use of non-uniform dispersions, but only for the reefing cutter timing, for which a large number of sample was available. In order to maximize the utility of the available flight test data, clusters of parachutes were reconstructed individually starting with Model Memo version 10. This allowed for statistical assessment for steady-state drag area (CDS) and parachute inflation parameters such as the canopy fill distance (n), profile shape exponent (expopen), over-inflation factor (C(sub k)), and ramp-down time (t(sub k)) distributions. Built-in MATLAB distributions were applied to the histograms, and parameters such as scale (sigma) and location (mu) were output. Engineering judgment was used to determine the "best fit" distribution based on the test data. Results include normal, log normal, and uniform (where available data remains insufficient) fits of nominal and failure (loss of parachute and skipped stage) cases for all CPAS parachutes. This paper discusses the uniform methodology that was previously used, the process and result of the statistical assessment, how the dispersions were incorporated into Monte Carlo analyses, and the application of the distributions in trajectory benchmark testing assessments with parachute inflation parameters, drag area, and reefing cutter timing used by CPAS.

Romero, Leah M.↗
NASA NTRS2013

ISSM: Ice Sheet System Model

In order to have the capability to use satellite data from its own missions to inform future sea-level rise projections, JPL needed a full-fledged ice-sheet/iceshelf flow model, capable of modeling the mass balance of Antarctica and Greenland into the near future. ISSM was developed with such a goal in mind, as a massively parallelized, multi-purpose finite-element framework dedicated to ice-sheet modeling. ISSM features unstructured meshes (Tria in 2D, and Penta in 3D) along with corresponding finite elements for both types of meshes. Each finite element can carry out diagnostic, prognostic, transient, thermal 3D, surface, and bed slope simulations. Anisotropic meshing enables adaptation of meshes to a certain metric, and the 2D Shelfy-Stream, 3D Blatter/Pattyn, and 3D Full-Stokes formulations capture the bulk of the ice-flow physics. These elements can be coupled together, based on the Arlequin method, so that on a large scale model such as Antarctica, each type of finite element is used in the most efficient manner. For each finite element referenced above, ISSM implements an adjoint. This adjoint can be used to carry out model inversions of unknown model parameters, typically ice rheology and basal drag at the ice/bedrock interface, using a metric such as the observed InSAR surface velocity. This data assimilation capability is crucial to allow spinning up of ice flow models using available satellite data. ISSM relies on the PETSc library for its vectors, matrices, and solvers. This allows ISSM to run efficiently on any parallel platform, whether shared or distrib- ISSM: Ice Sheet System Model NASA's Jet Propulsion Laboratory, Pasadena, California uted. It can run on the largest clusters, and is fully scalable. This allows ISSM to tackle models the size of continents. ISSM is embedded into MATLAB and Python, both open scientific platforms. This improves its outreach within the science community. It is entirely written in C/C++, which gives it flexibility in its design, and the power/speed that C/C++ allows. ISSM is svn (subversion) hosted, on a JPL repository, to facilitate its development and maintenance. ISSM can also model propagation of rifts using contact mechanics and mesh splitting, and can interface to the Dakota software. To carry out sensitivity analysis, mesh partitioning algorithms are available, based on the Scotch, Chaco, and Metis partitioners that ensure equal area mesh partitions can be done, which are then usable for sampling and local reliability methods.

Larour, Eric↗
DOE OSTI2020

Automated Coupling of Nanodroplet Sample Preparation with Liquid Chromatography–Mass Spectrometry for High-Throughput Single-Cell Proteomics

Single-cell proteomics can provide critical biological insight into the cellular heterogeneity that is masked by bulk-scale analysis. Here, we have developed a nanoPOTS (nanodroplet processing in one pot for trace samples) platform and demonstrated its broad applicability for single-cell proteomics. However, because of nanoliter-scale sample volumes, the nanoPOTS platform is not compatible with automated LC-MS systems, which significantly limits sample throughput and robustness. To address this challenge, we have developed a nanoPOTS autosampler allowing fully automated sample injection from nanowells to LC-MS systems. We also developed a sample drying, extraction, and loading workflow to enable reproducible and reliable sample injection. The sequential analysis of 20 samples containing 10 ng tryptic peptides demonstrated high reproducibility with correlation coefficients of >0.995 between any two samples. The nanoPOTS autosampler can provide analysis throughput of 9.6, 16, and 24 single cells per day using 120, 60, and 30 min LC gradients, respectively. As a demonstration for single-cell proteomics, the autosampler was first applied to profiling protein expression in single MCF10A cells using a label-free approach. At a throughput of 24 single cells per day, an average of 256 proteins was identified from each cell and the number was increased to 731 when the Match Between Runs algorithm of MaxQuant was used. Using a multiplexed isobaric labeling approach (TMT-11plex), ~77 single cells could be analyzed per day. We analyzed 152 cells from three acute myeloid leukemia cell lines, resulting in a total of 2558 identified proteins with 1465 proteins quantifiable (70% valid values) across the 152 cells. These data showed quantitative single-cell proteomics can cluster cells to distinct groups and reveal functionally distinct differences.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Dark energy survey: Modeling strategy for multiprobe cluster cosmology and validation for the full six-year dataset

Here, we introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3×2 pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (i) identification of modeling and parametrization choices and impact studies using simulated analyses with each possible model misspecification and (ii) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3×2 pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy–galaxy lensing and cosmic shear two-point statistics) and the CL+3×2 pt+BAO+SN (combination of CL+3×2 pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

On Performance Prediction of Big Data Transfer in High-performance Networks

Big data generated by large-scale scientific and industrial applications need to be transferred between different geographical locations for remote storage, processing, and analysis. High-speed dedicated connections provisioned in High-performance Networks (HPNs) are increasingly utilized to carry out such big data transfer. HPN management highly relies on an important capability of performance (mainly throughput) prediction to reserve sufficient bandwidth and meanwhile avoid over-provisioning that may result in unnecessary resource waste. This capability is critical to improving the resource (mainly bandwidth) utilization of dedicated connections and meeting various user requests for data transfer. Conventional methods conduct performance prediction by fitting prior observed transfer history with predefined loss functions, without considering unobservable latent factors such as competing loads on end hosts. Such latent factors also have a significant impact on the application-level data transfer performance, which may result in an inaccurate prediction model. In this paper, we first investigate the impact of latent factors and propose a clustering-based method to eliminate their negative impact on performance prediction. We then develop a robust machine learning-based performance predictor by: i) incorporating the proposed latent factor elimination method into data preprocessing, and ii) adopting a customized domain guided loss function. Extensive experimental results show that our predictor achieves significantly higher prediction accuracy than several other state-of-the-art methods.

Liu, Wuji↗