SEARCH · Engineering Papers

Results for “data dependencies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Computer Model Calibration with Time Series Data Using Deep Learning and Quantile Regression

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Efficient Parallelization of Irregular Applications on GPU Architectures

With the enlarging computation capacity of general Graphics Processing Units (GPUs), leveraging GPUs to accelerate parallel applications has become a critical topic in academia and industry. However, a wide range of irregular applications with the computation-/memory-intensive nature cannot easily achieve high GPU utilization. The challenges mainly involve the following aspects: first, data dependence leads to coarse-grained kernel and inefficient parallelism; second, heavy GPU memory usage may cause frequent memory evictions and extra overhead of I/O; third, specific computation patterns produce memory redundancies; last, workload balance and data reusability conjunctly benefit the overall performance, but there may exist a dynamic trade-off between them. Targeting these challenges, this dissertation proposes multiple optimizations to accelerate two real-world applications: many-body correlation functions to simulate nuclear physics in a large-scale scientific system; the other is the eALS-based matrix factorization recommendation system. To accelerate the calculations of many-body correlation functions, this dissertation presents three frameworks in GPU memory management and multi-GPU scheduling. Firstly, an optimized systematic GPU memory management framework, MemHC, utilizes a series of new memory reduction designs in GPU memory allocation, CPU/GPU communications, and GPU memory oversubscription. Secondly, an enhanced multi-GPU scheduling framework, MICCO, particularly by taking both data dimension (e.g., data reuse and data eviction) and computation dimension into account. MICCO designs a heuristic scheduling algorithm and a machine learning-based regression model to generate the optimal settings of a proposed new concept to manage the trade-off. Thirdly, a locality-aware multi-GPU scheduling framework. This scheduler leverages pipeline batch generation with a looking-ahead strategy by building local dependency graphs for memory transfer reduction and better data reuse, achieving up to 79.92% memory cost reduction and 1.67x speedup. To parallelize the eALS-based recommendation system, this dissertation proposes an efficient CPU/GPU heterogeneous recommendation system, HEALS. HEALS employs newly designed architecture-adaptive data formats to achieve load balance and good data locality on CPU and GPU. To mitigate the data dependence, HEALS presents a CPU/GPU collaboration model for both task parallelism and data parallelism with multiple kernel computation optimizations. In summary, this dissertation efficiently accelerates two typical irregular applications on GPUs by building four frameworks, including CPU/GPU collaboration, GPU memory management, and multi-GPU scheduling.

Wang, Qihan↗

DOE OSTI2024

Labeling sequential data from noisy annotations

Crowdsourcing algorithms often work under the assumption that the data samples are independent. Recent work has shown that data dependence, such as temporal correlations in sequential data, can be leveraged to improve the label quality. Existing methods that exploit this special structure rely on third-order statistics of the annotator outputs to ensure the identifiability of key latent parameters, which are costly to acquire. This work proposes an approach for integrating crowdsourced annotations under the Dawid-Skene/Hidden Markov Model (DS-HMM) for sequential data based on second-order statistics, which naturally enjoys a lower sample complexity. An effective algorithm is proposed to tackle the challenging optimization problem associated with the proposed estimator. Numerical experiments showcase the effectiveness of the data labeling paradigm.

Marrinan, Timothy P.↗

DOE OSTI2022

Milestone 1.2.10: Steady-state H 2 “roll over” point data for aluminum alloys 1100 and 6061

Extended (> 50 years) dry storage is being evaluated by the U.S. Department of Energy (DOE) for the disposition of ~ 18 metric tons of aluminum-clad spent nuclear fuel (ASNF). Transition of the current ASNF inventory into dry storage—using the standard DOE canister—necessitates a rigorous, predictive understanding of the long-term physical and chemical factors that may influence the integrity of the proposed storage canister, including radiolytic molecular hydrogen (H 2 ) generation. Current model predictions employ initial radiolytic yields of H 2 , the values of which change as the cladding’s H 2 -precursor inventory is depleted and H 2 itself becomes progressively more involved in radiolytic and surface dissociation processes. Consequently, the absorbed radiation dose that this steady-state H 2 yield corresponds to is essential for the evaluation and improvement of model predictions. Here, we report our findings on the long-term generation of H 2 from the gamma irradiation (≤ 36 MGy) of corroded AA1100 and AA6061 coupons in helium environments at ambient temperature and ~ 50% RH. Our findings show that AA1100 systems reached steady-state by ~ 36 MGy, while higher doses were necessary for AA6061 systems. This discrepancy was attributed to the AA6061 coupons developing a thicker corrosion layer that led to the trapping of H 2 and its precursors, and potentially additional chemistries, ultimately delaying the depletion of H 2 precursors and the system’s “roll over” point. Further, current model predictions—based on previous AA1100 data—do not show steady-state attainment until above 120 MGy, which is not the case for the AA1100 data collected here. Consequently, the new alloy dependent data presented here are important for the continued improvement of predictive computer models for evaluating the feasibility of extended storage of ASNF in helium backfilled canisters.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2026

Conus-Wide Mapping of Water Availability and Cost

Background: New demands for water can be satisfied through a variety of source options. In some basins surface and/or groundwater may be available through permitting with the state water management agency (termed unappropriated water), alternatively water might be purchased and transferred out of its current use to another (termed appropriated water), or non-traditional water sources can be captured and treated (e.g., wastewater). The relative availability and cost of each source are key factors in the development decision. Unfortunately, these measures are location dependent with no consistent or comparable set of data available for evaluating competing water sources. With the help of water managers, water availability was mapped for over 2500 watersheds throughout CONUS. These values are unique in that they account for institutional factors (i.e., water rights, compacts, treaties, instream flows) that locally limit water use. Five water sources were individually examined, including unappropriated surface water, unappropriated groundwater, appropriated water, municipal wastewater and brackish groundwater. Associated costs to acquire, convey and treat the water, as necessary, for each of the five sources were estimated. These metrics were developed to support regional water planning and policy analysis with initial application to electric transmission planning in the western US. Problem: These data were originally developed in 20141 and updated in 20182. New datasets on which these data depend have been published. As such, there is need to update the water availability and cost data. There is also need to map this same data to a county resolution and to publish the data in a more accessible place. Organization of the dataset: Data are organized according to five primary water sources: • Unappropriated fresh surface water • Unappropriated fresh groundwater • Appropriated water • Recycled wastewater, and • Brackish water

Tidwell, Vincent [Pacific Northwest National Labor↗

DOE OSTI2023

Voltage-dependent excitation dynamics in UV-absorbing organic photovoltaics with efficient charge transfer exciton emission

Intermolecular charge-transfer excitons play a central role in determining the performance of organic solar cells as their voltage-dependent formation, dissociation, and recombination dynamics contribute to photocurrent generation, radiative/nonradiative voltage losses, and photovoltaic fill factor. Here, we explore the properties of brightly-emitting wide energy gap (>2 eV) charge transfer excitons by measuring the voltage-dependent photoluminescence, photocurrent, and ultrafast pump–probe transient absorption spectra of organic solar cells employing five UV-absorbing donor molecules that differ only by the length of the oligophenylene or acene group at their core. We find that organic solar cells with a strong correlation between their voltage-dependent photocurrent and charge-transfer exciton photoluminescence have low photovoltaic fill factors as they require voltage to facilitate efficient charge-transfer exciton dissociation. In contrast, solar cells that are efficient can readily generate charges without an applied field and have a separate population of tightly-bound charge-transfer excitons that are responsible for emission. Furthermore, considering that the sum of all excitation loss rates (i.e., recombination and charge extraction) must be equal to the excitation generation rate in the steady state, these voltage-dependent data allow us to solve for the voltage-dependent fate of all excitations in the solar cells and estimate upper and lower bounds for geminate and non-geminate recombination, respectively.

14 SOLAR ENERGY↗

DOE OSTI2025

Quantifying uncertainty in regional-scale seismic moment tensors

We examine the ability of three different inversion methods: 1) first motion (FM) inversions, 2) amplitude inversions, and 3) full waveform (FW) time variable moment tensor (TVMT) inversions, to recover an accurate source mechanism for simulated data for an earthquake as well as an explosion. The ability of inversion methods, such as the ones described above, to recover accurate models representative of the data depends on both a priori information as well as the quality of data being inverted. Therefore, we examine the effect that station geometry, geologic model, and noise level has on the inversion and estimated source mechanism. We find that FM data can provide more robust solutions than amplitude data and are not as sensitive to inaccurate earth models, especially in low-noise cases, and overall FW inversions are the most accurate out of the methods examined, but can still be biased by inaccurate earth models.

58 GEOSCIENCES↗

DOE OSTI2026

Facilitating Data Collection of Maintenance Events to Populate the Hydrogen Component Reliability Database (HyCReD)

The Hydrogen Component Reliability Database (HyCReD) is a collaborative project between the National Renewable Energy Laboratory, the University of Maryland, and hydrogen stakeholders to improve safety and reliability for hydrogen facilities by implementing component reliability data taxonomies that support hydrogen infrastructure failure rate analysis. The project aims to quantify failure rates of hydrogen components through high-quality data collection and analysis on root causes and maintenance needed. HyCReD provides a common database for cataloging hydrogen component failures which exists for reliability research in many other mature industries [2]. The database fills a gap for the hydrogen community by providing a scientifically rigorous approach to quantitative risk assessment (QRA), prognostic health management (PHM), and reliability-centered maintenance (RCM) analysis. High level results will be aggregated and anonymized to protect company sensitive information; detailed results will be used to help address issues of hydrogen components. These advanced analytics will support accelerated deployment of hydrogen infrastructure by enabling better: design and safety of projects (safety codes and standards development), infrastructure reliability and cost (component failure rates, maintenance protocols), and component R&D needs (robust supply chain). A key to a successful HyCReD implementation is facilitating the ease of reporting and data quality in the database that can be used for analysis. Maintenance data was a previously identified gap in initial efforts to populate and validate the database taxonomies [3]. Collection of maintenance data will be instrumental in identifying failure modes and rates, identifying incipient component failures or reduced performance, cataloging best practices for maintenance routines and methods for prognostic health management, and quantifying the risk and effect of different failure modes. Several key priorities are identified for streamlined data collection to achieve quality and detailed failure data: Applicability, Ease of Use, Accessibility, and Information Security. The HyCReD team has now begun deployment of the database to several companies and groups that have signed non-disclosure agreements to facilitate the data collection of failures in industry hydrogen refueling station infrastructure. This paper will provide an update into the process of HyCReD deployment including the development of a coding guide for facility personnel to reference and ensure data quality and consistency from one station to another as well as implementation of contextually dependent data fields of system taxonomy and formatted entries to provide ease of use. The goal is to communicate the lessons learned from the roll-out to technicians and engineers in the field, and the addition of need for high level of security to protect all stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Accelerating Scientific Workflows on HPC Platforms with In Situ Processing

Scientific workflows drive most modern large-scale science breakthroughs by allowing scientists to define their computations as a set of jobs executed in a given order based on their data dependencies. Workflow management systems (WMSs) have become key to automating scientific workflows-executing computational jobs and orchestrating data transfers between those jobs running on complex high-performance computing (HPC) platforms. Traditionally, WMSs use files to communicate between jobs: a job writes out files that are read by other jobs. However, HPC machines face a growing gap between their storage and compute capabilities. To address that concern, the scientific community has adopted a new approach called in situ, which bypasses costly parallel filesystem I/O operations with faster in-memory or in-network communications. When using in situ approaches, communication and computations can be interleaved. In this work, we leverage the Decaf in situ dataflow framework to accelerate task-based scientific workflows managed by the Pegasus WMS, by replacing file communications with faster MPI messaging. We propose a new execution engine that uses Decaf to manage communications within a sub-workflow (i.e., set of jobs) to optimize inter-job communications. We consider two workflows in this study: (i) a synthetic workflow that benchmarks and compares file- and MPI-based communication; and (ii) a realistic bioinformatics workflow that computes mu-tational overlaps in the human genome. Experiments show that in situ communication can improve the bioinformatics workflow execution time by 22% to 30% compared with file communication. Our results motivate further opportunities and challenges for bridging traditional WMSs with in situ frameworks.

Decaf↗

DOE OSTI2024

Data Efficiency Assessment of Generative Adversarial Networks for Critical Heat Flux Synthetic Data Generation

This study investigates the application of generative artificial intelligence techniques, particularly conditional generative adversarial networks (cGAN), in real-world engineering contexts, with a specific focus on synthetic data generation for critical heat flux (CHF). Utilizing a dataset comprising more than 20,000 real experimental CHF measurements, we conduct a series of experiments to examine cGAN’s behavior. These experiments encompass varying sizes of the training dataset, training cGAN on data from diverse experimental sources to generate new data on unseen experimental setups, and assessing the impact of excluding various input features on cGAN’s data generation accuracy. Our findings underscore the pronounced data dependency of cGAN for reliable performance, with decreased efficacy observed with smaller training dataset sizes. Notably, cGAN exhibits varying performance when trained on data from different experiments, with superior predictive capabilities observed for certain experiment sources compared to others. For instance, when cGAN was trained on data from Smolin et al.’s experiments or Zenkevich et al., it exhibited relatively good performance in generating the data from Becker et al., Kirillov et al., and Alekseev et al. experiments. In contrast, when trained with Alekseev et al.’s data and tasked with generating other experimental setups, cGAN showed notably poor performance. In both scenarios, cGAN’s performance was inferior compared to training on samples from all experiments concurrently. A feature importance analysis highlights the significant influence of parameters such as mass flux and heated length on accurate CHF generation, while other parameters like diameter and pressure have less impact. Inlet temperature is identified as a moderating factor by cGAN.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Chapter 4 - Recent Advances in Identification of Differential Equations from Noisy Data: IDENT Review

Differential equations and numerical methods are extensively used to model various real-world phenomena in science and engineering. With modern developments, we aim to find the underlying differential equation from a single observation of time-dependent data. If we assume that the differential equation is a linear combination of various linear and nonlinear differential terms, then the identification problem can be formulated as solving a linear system. The goal then reduces to finding the optimal coefficient vector that best represents the time derivative of the given data. We review some recent works on the identification of differential equations. We find some common themes for the improved accuracy: (i) The formulation of linear system with proper denoising is important, (ii) how to utilize sparsity and model selection to find the correct coefficient support needs careful attention, and (iii) there are ways to improve the coefficient recovery. We present an overview and analysis of recent developments on the topic.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

As-Built Simulation of the High Flux Isotope Reactor

The Oak Ridge National Laboratory High Flux Isotope Reactor (HFIR) is an 85 MWt flux trap-type research reactor that supports key research missions, including isotope production, materials irradiation, and neutron scattering. The core consists of an inner and an outer fuel element containing 171 and 369 involute-shaped plates, respectively. The thin fuel plates consist of a U 3 O 8 -Al dispersion fuel (highly enriched), an aluminum-based filler, and aluminum cladding. The fuel meat thickness is varied across the width of the involute plate to reduce thermal flux peaks at the radial edges of the fuel elements. Some deviation from the designed fuel meat shaping is allowed during manufacturing. A homogeneity scan of each fuel plate checks for potential anomalies in the fuel distribution by scanning the surface of the plate and comparing the attenuation of the beam to calibration standards. While typical HFIR simulations use homogenized fuel regions, explicit models of the plates were developed under the Low-Enriched Uranium Conversion Program. These explicit models typically include one inner and one outer fuel plate with nominal fuel distributions, and then the plates are duplicated to fill the space of the corresponding fuel element. Therefore, data extracted from these simulations are limited to azimuthally averaged quantities. To determine the reactivity and physics impacts of an as-built outer fuel element and generate azimuthally dependent data in the element, 369 unique fuel plate models were generated and positioned. This model generates the three-dimensional (i.e., radial–axial–azimuthal) plate power profile, where the azimuthal profile is impacted by features within the adjacent control element region and beryllium reflector. For an as-built model of the outer fuel element, plate-specific homogeneity data, 235 U loading, enrichment, and channel thickness measurements were translated into the model, yielding a much more varied azimuthal power profile encompassed by uncertainty factors in analyses. These models were run with the ORNL-TN and Shift Monte Carlo tools, and they contained upwards of 500,000 cells and 100,000 unique tallies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2021

Quantitative modeling of carcinogenesis induced by single beams or mixtures of space radiations using targeted and non-targeted effects

Abstract Ionizing radiations encountered by astronauts on deep space missions produce biological damage by two main mechanisms: (1) Targeted effects (TE) due to direct traversals of cells by ionizing tracks. (2) Non-targeted effects (NTE) caused by release of signals from directly hit cells. The combination of these mechanisms generates non-linear dose response shapes, which need to be modeled quantitatively to predict health risks from space exploration. Here we used a TE + NTE model to analyze data on APC (1638N/+) mouse tumorigenesis induced by space-relevant doses of protons, 4 He, 12 C, 16 O, 28 Si or 56 Fe ions, or γ rays. A customized weighted Negative Binomial distribution was used to describe the radiation type- and dose-dependent data variability. This approach allowed detailed quantification of dose–response shapes, NTE- and TE-related model parameters, and radiation quality metrics (relative biological effectiveness, RBE, and radiation effects ratio, RER, relative to γ rays) for each radiation type. Based on the modeled responses for each radiation type, we predicted the tumor yield for a Mars-mission-relevant mixture of these radiations, using the recently-developed incremental effect additivity (IEA) synergy theory. The proposed modeling approach can enhance current knowledge about quantification of space radiation quality effects, dose response shapes, and ultimately the health risks for astronauts.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

Heavy-Ion-Induced Lung Tumors: Dose- & LET-Dependence

There is a limited published literature reporting dose-dependent data for in vivo tumorigenesis prevalence in different organs of various rodent models after exposure to low, single doses of charged particle beams. The goal of this study is to reduce uncertainties in estimating particle-radiation-induced risk of lung tumorigenesis for manned travel into deep space by improving our understanding of the high-LET-dependent dose-response from exposure to individual ion beams after low particle doses (0.03 - 0.80 Gy). Female CB6F1 mice were irradiated with low single doses of either oxygen, silicon, titanium, or iron ions at various energies to cover a range of dose-averaged LET values from 0.2 - 193 keV/µm, using 137Cs γ-rays as the reference radiation. Sham-treated controls were included in each individual experiment totally 398 animals across the 5 studies reported. Based on power calculations, between 40 - 156 mice were included in each of the treatment groups. Tumor prevalence at 16 months after radiation exposure was determined and compared to the age-matched, sham-treated animals. Results indicate that lung tumor prevalence is non-linear as a function of dose with suggestions of threshold doses depending on the LET of the beams. Histopathological evaluations of the tumors showed that the majority of tumors were benign bronchioloalveolar adenomas with occasional carcinomas or lymphosarcomas which may have resulted from metastases from other sites.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2026

Mono-mix strategy enables comparative proteomics of a cross-kingdom microbial symbiosis

Cross-kingdom microbial symbioses, such as those between algae and bacteria, are key players in biogeochemical cycles. The molecular changes during initiation and establishment of symbiosis are of great interest, but quantitatively monitoring such changes can be challenging, particularly when the microorganisms differ greatly in size or are intimately associated. Here, we analyze output from label-free, data-dependent acquisition (DDA) LC-MS/MS proteomics experiments investigating the well-studied interaction between the alga Chlamydomonas reinhardtii and the heterotrophic bacterium Mesorhizobium japonicum. We found that detection of bacterial proteins decreased in coculture by 50% proteome-wide due to the abundance of algal proteins. As a result, standard differential expression analysis led to numerous false-positive reports of significantly downregulated proteins, where it was not possible to distinguish meaningful biological responses to symbiosis from artifacts of the reduced protein detection in coculture relative to monoculture. We show that data normalization alone does not eliminate the impact of altered detection on differential expression analysis of the cross-kingdom symbiosis. We assessed two additional strategies to overcome this methodological artifact inherent to DDA proteomics. In the first, we combined algal and bacterial monocultures at a relative abundance that mimicked the coculture, creating a “mono-mix” control to which the coculture could be compared. This approach enabled comparable detection of bacterial proteins in the coculture and the monoculture control. In the second strategy, we enhanced detection of lowly abundant bacterial proteins by using sample fractionation upstream of LC-MS/MS analysis. When these simple approaches were combined, they allowed for meaningful comparisons of nearly 10,000 algal proteins and over 4,000 bacterial proteins in response to symbiosis by DDA. They successfully recovered expected changes in the bacterial proteome in response to algal coculture, including upregulation of sugar-binding proteins and transporters. They also revealed novel proteomic responses to coculture that guide hypotheses about algal-bacterial interactions.

Dupuis, Sunnyjoy [University of California, Berkel↗

DOE OSTI2021

The Stellar decomposition: A compact representation for simplicial complexes and beyond

Here, we introduce the Stellar decomposition, a model for efficient topological data structures over a broad range of simplicial and cell complexes. A Stellar decomposition of a complex is a collection of regions indexing the complex’s vertices and cells such that each region has sufficient information to locally reconstruct the star of its vertices, i.e., the cells incident in the region’s vertices. Stellar decompositions are general in that they can compactly represent and efficiently traverse arbitrary complexes with a manifold or non-manifold domain. They are scalable to complexes in high dimension and of large size, and they enable users to easily construct tailored application-dependent data structures using a fraction of the memory required by a corresponding global topological data structure on the complex. As a concrete realization of this model for spatially embedded complexes, we introduce the Stellar tree, which combines a nested spatial tree with a simple tuning parameter to control the number of vertices in a region. Stellar trees exploit the complex’s spatial locality by reordering vertex and cell indices according to the spatial decomposition and by compressing sequential ranges of indices. Stellar trees are competitive with state-of-the-art topological data structures for manifold simplicial complexes and offer significant improvements for cell complexes and non-manifold simplicial complexes. We conclude with a high-level description of several mesh processing and analysis applications that utilize Stellar trees to process large datasets.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Data-flow parallelism for high-energy and nuclear physics frameworks

The processing tasks of an event-processing workflow in high-energy and nuclear physics (HENP) can typically be represented as a directed acyclic graph formed according to the data flow—i.e. the data dependencies among algorithms executed as part of the workflow. With this representation, an HENP framework can optimally execute a workflow, exploiting the parallelism inherent among independent tasks. Despite such a natural description of a workflow, most HENP frameworks do not make use of technologies that provide concurrent execution of graph-based tasking structures. In this talk, we describe Fermilab efforts to adopt a graph-based technology (specifically Intel’s oneTBB flow graph) for meeting the framework needs of its experiments, notably DUNE. Building on the Meld project as presented at CHEP2023, we demonstrate that all common processing idioms supported by current frameworks can naturally be supported by oneTBB’s data-flow technology, optimally leveraging the concurrent capabilities of the machine. In addition, we discuss collaborative efforts between Fermilab and the Intel oneTBB development team, who is considering improvements to the flow-graph technology to better support HENP use cases.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Data-flow parallelism for high-energy and nuclear physics computing frameworks

The processing tasks of a scientific workflow in high-energy and nuclear physics (HENP) can typically be represented as a directed acyclic graph formed according to the data flow—i.e. the data dependencies among algorithms executed as part of the workflow. With this representation, an HENP computing framework can optimally execute a workflow, exploiting the parallelism inherent among independent tasks. Despite such a natural description of a workflow, most HENP frameworks do not make use of technologies that provide concurrent execution of graph-based tasking structures. In this session, we describe Fermilab efforts to adopt a graph-based technology (specifically Intel’s oneTBB flow graph) for meeting the framework needs of its experiments, notably DUNE. After introducing the physics DUNE intends to explore, we will show that all common processing idioms supported by current HENP frameworks can naturally be supported by oneTBB’s data-flow technology, optimally leveraging the concurrent capabilities of the machine. In addition, we discuss collaborative efforts between Fermilab and the Intel oneTBB development team, who is considering improvements to the flow-graph technology to better support HENP use cases.

43 PARTICLE ACCELERATORS↗