Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Library”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Modeling and Simulation of Fuel Burnup in Pebble Bed Reactors

Modeling and simulation of fuel burnup plays important roles in reactor design, operation, safety, and security as well as nuclear material control and accounting (MC&A) [1]. This task is uniquely challenging for pebble bed reactors (PBR) because the pebbles are continuously added and recycled into the reactor core, and their paths through the core are random. To address this problem, we present two simulation models in this paper. Brookhaven National Laboratory (BNL) developed a simple lattice model of a PBR in Serpent software to generate used pebble isotopic concentrations. The benefit of using Serpent software in this specific application is that it helps streamline the data generation process without having to use too many independent software codes in combination to achieve a simple task. For example, transport, burnup and zero power decay can be implemented in a single pass. Three-dimensional core models were developed using Serpent to simulate the burnup process of 5 subject pebbles starting from fresh till they reach nearly target burnup, with each pebble placed in one of the five artificially designated radial channels to capture the changing neutron spectra along the core radius. Equilibrium isotopic concentrations were assumed in all other pebbles in the core. To provide a verification for the Serpent isotope transmutation and decay results, Oak Ridge National Laboratory (ORNL) performed simple SCALE/ORIGEN calculations using the average neutron spectra calculated by Serpent for each of the 5 pebbles. The 252-group neutron spectra from Serpent were then used by ORIGEN to produce the one-group library for depletion and decay calculations. The isotopic concentrations of a few nuclides of interest and neutron and gamma source terms produced from the ORIGEN calculations were compared with the ones from the Serpent calculations. The model simulated in this work was based on the Pebble Bed Modular Reactor (PBMR)-400 design because many data needed for the simulation such as core power profiles, fuel and reflector temperatures, and equilibrium core composition are publicly available. In this paper, we will compare the results between these two approaches and benchmark the results against a set of well-established simulation results for PBMR-400.

Dim, Odera↗
DOE OSTI2023

Modeling and Simulation of Fuel Burnup in Pebble Bed Reactors

Modeling and simulation of fuel burnup plays important roles in reactor design, operation, safety, and security as well as nuclear material control and accounting (MC&A) [1]. This task is uniquely challenging for pebble bed reactors (PBR) because the pebbles are continuously added and recycled into the reactor core, and their paths through the core are random. To address this problem, we present two simulation models in this paper. Brookhaven National Laboratory (BNL) developed a simple lattice model of a PBR in Serpent software to generate used pebble isotopic concentrations. The benefit of using Serpent software in this specific application is that it helps streamline the data generation process without having to use too many independent software codes in combination to achieve a simple task. For example, transport, burnup and zero power decay can be implemented in a single pass. Three-dimensional core models were developed using Serpent to simulate the burnup process of five subject pebbles starting from fresh till they reach nearly target burnup, with each pebble placed in one of the five artificially designated radial channels to capture the changing neutron spectra along the core radius. Equilibrium isotopic concentrations were assumed in all other pebbles in the core. To provide a verification for the Serpent isotope transmutation and decay results, Oak Ridge National Laboratory (ORNL) performed simple SCALE/ORIGEN calculations using the average neutron spectra calculated by Serpent for each of the five pebbles. The 252-group neutron spectra from Serpent were then used by ORIGEN to produce the one-group library for depletion and decay calculations. The isotopic concentrations of a few nuclides of interest and neutron and gamma source terms produced from the ORIGEN calculations were compared with the ones from the Serpent calculations. The model simulated in this work was based on the Pebble Bed Modular Reactor (PBMR)-400 design because many data needed for the simulation such as core power profiles, fuel and reflector temperatures, and equilibrium core composition are publicly available. In this paper, we will compare the results between these two approaches and benchmark the results against a set of well-established simulation results for PBMR-400.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2023

End-to-end AI framework for interpretable prediction of molecular and crystal properties

We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference. The framework is based on state-of-the-art AI models including CGCNN, PhysNet, SchNet, MPNN, MPNN-transformer, and TorchMD-NET. We employ these AI models along with the benchmark QM9, hMOF, and MD17 datasets to showcase how the models can predict user-specified material properties within modern computing environments. We demonstrate transferable applications in the modeling of small molecules, inorganic crystals and nanoporous metal organic frameworks with a unified, standalone framework. We have deployed and tested this framework in the ThetaGPU supercomputer at the Argonne Leadership Computing Facility, and in the Delta supercomputer at the National Center for Supercomputing Applications to provide researchers with modern tools to conduct accelerated AI-driven discovery in leadership-class computing environments. We release these digital assets as open source scientific software in GitLab, and ready-to-use Jupyter notebooks in Google Colab.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Extending Supernova Spectral Templates for Next-generation Space Telescope Observations

Empirical models of supernova (SN) spectral energy distributions (SEDs) are widely used for SN survey simulations and photometric classifications. The existing library of SED models has excellent optical templates, but limited, poorly constrained coverage of ultraviolet (UV) and infrared (IR) wavelengths. However, both regimes are critical for the design and operation of future SN surveys, particularly at IR wavelengths that will be accessible with the James Webb Space Telescope and the Wide-Field Infrared Survey Telescope. We create a public repository of improved empirical SED templates using a sampling of Type Ia and core-collapse (CC) photometric light curves to extend the Type Ia parameterized SALT2 model and a set of SN Ib, SN Ic, and SN II SED templates into the UV and near-IR. We apply this new repository of extrapolated SN SED models to examine how future surveys can discriminate between CC and Type Ia SNe at UV and IR wavelengths, and present an open-source software package written in Python, SNSEDextend, that enables users to generate their own extrapolated SEDs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

LibERI—A portable and performant multi-GPU accelerated library for electron repulsion integrals via OpenMP offloading and standard language parallelism

A portable and performant graphics processing unit (GPU)-accelerated library for electron repulsion integral (ERI) evaluation, named LibERI, has been developed and implemented via directive-based (e.g., OpenMP and OpenACC) and standard language parallelism (e.g., Fortran DO CONCURRENT). Offloaded ERIs consist of integrals over low and high contraction s, p, and d functions using the rotated-axis and Rys quadrature methods. GPU codes are factorized based on previous developments with two layers of integral screening and quartet presorting. In this work, the density screening is moved to the GPU to enhance the computational efficacy for large molecular systems. Here, the L-shells in the Pople basis set are also separated into pure S and P shells to increase the ERI homogeneity and reduce atomic operations and the memory footprint. LibERI is compatible with any quantum chemistry drivers supporting the MolSSI Driver Interface. Benchmark calculations of LibERI interfaced with the GAMESS software package were carried out on various GPU architectures and molecular systems. The results show that the LibERI performance is comparable to other state-of-the-art GPU-accelerated codes (e.g., TeraChem and GMSHPC) and, in some cases, outperforms conventionally developed ERI CUDA kernels (e.g., QUICK) while fully maintaining portability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Production Operations Management System

The Production Operations Management System (POMS) is a set of software tools which allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs. POMS provides a web service interface that enables automated jobs submission on distributed resources according to customers’ requests and subsequent monitoring and recovery of failed submissions, debugging and record keeping. POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub, dCache, SAM, and FIFEmon, and in combination with them handles the creation and tracking of unique filenames for multistage campaigns. A flexible, interactive GUI interface exists as part of the system to visualize campaign stages, parallelization tracks and data flow. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign. Future releases of POMS will interface with Rucio for file movement.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Measuring residual stress in Ti-6Al-4V with HR-EBSD, using reference patterns from annealed material

In this study, elastic strain and residual stress values in an engineering material were determined by high-resolution EBSD (HR-EBSD) using reference patterns from annealed, recrystallized material. Specifically, rolled Ti-6Al-4V sheet was analyzed using HR EBSD in both an as-annealed and a strained state, the latter established via a static two-point bend fixture. The commercial software CrossCourt4 (CC4) was used to evaluate the relative intragranular strain tensor components of the alpha grains mapped by HR-EBSD. The intragranular reference patterns identified in each grain by the software were then replaced with similarly-oriented patterns from scans of the as-annealed, recrystallized material. The CC4 analysis was then repeated to provide calibrated strain and residual stress values. Elastic strains on the order of 10–3 were detected, with corresponding residual stress values on the order of 1 GPa. Subsequent analyses using high energy synchrotron x-ray diffraction showed good correlation with the elastic strains measured by HR-EBSD using the annealed reference patterns. Additionally, the maximum macroscopic stress analytically predicted for two-point bending was in agreement with the residual stress observed. Good repeatability of the methodology and insight into the state of individual grains were also observed. The findings provide encouraging evidence that accurate intragranular and long-range residual stress measurements of engineering significance can be made with HR-EBSD using a physical reference pattern library.

36 MATERIALS SCIENCE↗
DOE OSTI2022

NRAP-Open-IAM: NRAP Open Source Integrated Assessment Model

Note: This is the last version (a2.6.1) of NRAP-Open-IAM released during NRAP Phase II in 2022. The latest version of NRAP-Open-IAM is available here: https://edx.netl.doe.gov/dataset/phase-iii-nrap-open-iam NRAP-Open-IAM is an open-source software product that enables quantification of containment effectiveness and leakage risk at storage sites in the context of system uncertainties and variability. NRAP-Open-IAM represents the next-generation in a line of systems-based computational models developed for quantitative geological carbon storage (GCS) risk assessment. The model comprises a set of reduced-order and analytical models of various components of the GCS system, potential leakage pathways, receptors of concern including impact to groundwater resources and the atmosphere, a framework to support stochastic simulation, time stepping, uncertainty quantification, other analytical functionality for scenario and risk-performance evaluation, and a basic graphical user interface to support scenario development, data input simulation definition, and basic post-processing and results display. As the NRAP Open-IAM functionality continues to evolve, we continue to add to its capability to develop quantitative, probabilistic, and time-dependent profiles of the evolution of risk at a GCS site and evaluate the influence of uncertain parameters on uncertainty in predicted risk. It can be used to quantify the dynamics of reservoir saturation plume and pressure-affected area, for evaluation of the area of potential groundwater impact (i.e., Area of Review) and monitoring requirements to support cost and regulatory analysis, and for consideration of different post-injection site care and closure scenarios. This submission contains the current version of NRAP-Open-IAM available for evaluation and testing. To use the NRAP-Open-IAM, download the source code (https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/4c24a3da-3b40-4ffe-9892-c807ae9f8760) then open the NRAP-Open-IAM user's guide (https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/8b27335a-343c-4836-b8a3-3ad0bdc9e669) to read more about the tool. Installation instructions for Windows, Mac, and Linux can be found in the "installers" folder of the extracted NRAP-Open-IAM folder and describe setup of environment (e.g., Python libraries) needed for proper work of the tool. Test of installation can be done by running "python openiam_setup_tests.py" in the "setup" folder. The installation test also runs a test suite to see if the NRAP-Open-IAM has been installed correctly. To run the test suite separately, run "python iam_test.py" in the "test" folder. User's guide: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/8b27335a-343c-4836-b8a3-3ad0bdc9e669 Developer's guide: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/3bc6ee7d-609d-4eb6-80ba-fa6130ee0313 Reservoir simulation data used in some examples distributed with NRAP-Open-IAM: - Kimberlina: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/eb62cece-61b2-4037-9b6d-32407dde2ab8 - Kimberlina (compartmentalized): https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/366f9530-3b32-4b84-affe-ab2df1d9a8b5 - FutureGen 2.0: https://edx.netl.doe.gov/dataset/futuregen-2-0-1008-simulation-reservoir-lookup-table NRAP-Open-IAM GitLab repository: https://gitlab.com/NRAP/OpenIAM Related publications: - Bacon, D., Yonkofski, C., Brown, C., Demirkanli, D. and Whiting, J., 2019. Risk-based post injection site care and monitoring for commercial-scale carbon storage: Reevaluation of the FutureGen 2.0 site using NRAP-Open-IAM and DREAM. International Journal of Greenhouse Gas Control 90: 102784. - Bacon, D. Demirkanli, D., and White, S., 2020. Probabilistic risk-based Area of Review (AoR) determination for a deep-saline carbon storage site. International Journal of Greenhouse Gas Control 102: 103153. - Harp, D., Oldenburg, C., and Pawar, R., 2019. A metric for evaluating conformance robustness during geologic CO2 sequestration operations. International Journal of Greenhouse Gas Control 85: 100-108. - Lackey, G., Vasylkivska, V., Huerta, N., King, S., and Dilmore, R., 2019. Managing well leakage risks at a geologic carbon storage site with many wells, International Journal of Greenhouse Gas Control, 88 :182-194. - Vasylkivska, V., Dilmore, R., Lackey, G., Zhang, Y., King, S., Bacon, D., Chen, B., Mansoor, K., and Harp, D., 2021. NRAP-Open-IAM: A flexible open-source integrated assessment model for geologic carbon storage risk assessment and management, Environmental Modelling & Software, 143: 105114. Presentations: - Chen, B., Harp, D., and Pawar, R., A data assimilation approach (ES-MDA) coupling with NRAP-Open-IAM for quantifying uncertainty reduction in geological CO2 sequestration. AGUFM 2019: T44A-02. - Chen, B., and Harp, D., Improving risk analysis precision for geologic CO2 sequestration by quantifying the uncertainty reduction before and after acquiring monitoring data. 14th Greenhouse Gas Control Technologies Conference, Melbourne, Australia, 2018, pp. 21-26. - Harp, D., National Risk Assessment Partnership Task 2: Containment Assurance. No. LA-UR-19-28654, Los Alamos National Laboratory (LANL), Los Alamos, NM (United States), 2019. - Vasylkivska, V., King, S., Bacon, D., Harp, D., Chen, B., Mansoor, K., Onishi, T., Yang, Y., Zhang, Y., and Keating, E., NRAP-Open-IAM: An open-source integrated assessment model, poster, Mastering the Subsurface Through Technology Innovation, Partnerships and Collaboration: Carbon Storage and Oil and Natural Gas Technologies Review Meeting, Pittsburgh, PA, August 13-16, 2018. - Vasylkivska, V., Lackey, G., King, S., Wentworth, A., Huerta, N., Creason, C., DiGiulio, J., Yang, Y., and Dilmore, R., Long-term risk analysis of a geologic CO2 storage project during the post-injection period, SIAM Conference on Computational Science and Engineering, Spokane, WA, February 25-March 1, 2019. - Vasylkivska, V., Overview of the NRAP-Open-IAM tool for carbon storage (beta release), 2019 Annual NRAP Tool Users Meeting, Pittsburgh, PA, August 27, 2019. - Vasylkivska, V., Bacon, D., Chen, B., Dilmore, R., Harp, D., King, S., Lackey, G., Lindner, E., Liu, G., Mansoor, K. and Zhang, Y., NRAP-Open-IAM: A new, open-source code for integrated assessment of geologic carbon storage containment effectiveness and leakage risk, poster, American Geophysical Union Fall Meeting 2020 (virtual meeting), December 2020. - Vasylkivska, V., NRAP open-source integrated assessment model and relevant application, oral presentation, NRAP workshop "NRAP Tools for Geologic Carbon Storage Risk-Based Decision Making" held in conjunction with Groundwater Protection Council (GWPC) 2021 Annual Forum (virtual meeting), Salt Lake City, UT, September 2021. - Vasylkivska, V., NRAP-Open-IAM: open-source integrated assessment model, digital poster/demonstration, software demonstration session, 2022 Carbon Management Project Review Meeting, August 16, 2022

AoR↗
DOE OSTI2021

BISON: A Flexible Code for Advanced Simulation of the Performance of Multiple Nuclear Fuel Forms

BISON is a nuclear fuel performance application built using the Multiphysics Object-Oriented Simulation Environment (MOOSE) finite element library. One of its major goals is to have a great amount of flexibility in how it is used, including in the types of fuel it can analyze, the geometry of the fuel being modeled, the modeling approach employed, and the dimensionality and size of the models. Fuel forms that can be modeled include standard light water reactor fuel, emerging light water reactor fuels, tri-structural isotropic fuel particles, and metallic fuels. BISON is a platform for research in nuclear fuel performance modeling while simultaneously serving as a tool for the analysis of nuclear fuel designs. Recent research in BISON includes techniques such as the extended finite element method for fuel cracking, exploration of high-burnup light water reactor fuel behavior, swelling behavior of metallic fuels, and central void formation in mixed-oxide fuel. BISON includes integrated documentation for each of its capabilities, follows rigorous software quality assurance procedures, and has a growing set of rigorous verification and validation tests.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

MatLib-1.1: Nuclear Material Properties Library: Developed under NQA-1-2017

The U.S. Nuclear Regulatory Commission (NRC) uses the computer code Fuel Analysis under Steady-state and Transients (FAST) to model steady-state and transient fuel behavior to support regulatory decisions. FAST relies on a material properties library (MatLib) that contains the thermal and mechanical properties of the nuclear materials and coolants of interest to support the US commercial nuclear industry. MatLib contains properties for a variety of nuclear fuels, cladding and other structural materials, gases, and coolants. In this document, material property correlations for the materials contained within MatLib are presented and discussed. When available, comparisons are made between the material property correlations and available data. Additionally, uncertainties are quantified on the material properties, which is then used by the NRC to support uncertainty quantification for best-estimate plus uncertainty safety evaluation reviews. This document describes MatLib-1.1, which was updated from MatLib-1.0 to include the addition of Lua functionality and code changes for integration with FAST. The results of MatLib did not change between MatLib-1.0 and MatLib-1.1; however, the source code changes warranted incrementing the minor numbering of the software version number. This document is one of a series of documents on FAST; the other documents detail the models used by FAST as well as its integral assessment to experiments and commercial data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

CLMM : a LSST-DESC cluster weak lensing mass modeling library for cosmology

ABSTRACT We present the v1.0 release of CLMM, an open source python library for the estimation of the weak lensing masses of clusters of galaxies. CLMM is designed as a stand-alone toolkit of building blocks to enable end-to-end analysis pipeline validation for upcoming cluster cosmology analyses such as the ones that will be performed by the Vera C. Rubin Legacy Survey of Space and Time-Dark Energy Science Collaboration (LSST-DESC). Its purpose is to serve as a flexible, easy-to-install, and easy-to-use interface for both weak lensing simulators and observers and can be applied to real and mock data to study the systematics affecting weak lensing mass reconstruction. At the core of CLMM are routines to model the weak lensing shear signal given the underlying mass distribution of galaxy clusters and a set of data operations to prepare the corresponding data vectors. The theoretical predictions rely on existing software, used as backends in the code, that have been thoroughly tested and cross-checked. Combined theoretical predictions and data can be used to constrain the mass distribution of galaxy clusters as demonstrated in a suite of example Jupyter Notebooks shipped with the software and also available in the extensive online documentation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Analysis of Automated Fault Detection and Diagnosis Records as an Indicator of HVAC Fault Prevalence: Methodology and Preliminary Results

Faults in commercial buildings can cause energy waste and other performance problems such as reduced occupant comfort, reduced equipment longevity, and increased noise. However, it is currently unknown how commonly faults occur in different equipment types. A method has been developed to estimate the prevalence of faults in air handling units, air terminal units, and rooftop units. This method includes two types of data. The first is data from several automated fault detection and diagnostics (AFDD) software technologies. This type of data provides a large sample that represents a wide range of building types, geographical locations, and equipment types. It includes fault diagnoses from thousands of buildings around the United States, as well as anonymized metadata describing the building and equipment characteristics. The number of fault records is in the order of 107. However, despite the size and richness of the data sample, this data contains some degree of inaccuracy, i.e., false positive and false negative findings. Therefore, the study includes a second type of data, coming from manual inspection of buildings that have had the same AFDD methods applied to them (from the commercial AFDD offerings). Since the field tests are conducted in buildings with AFDD-generated fault prevalence data, they can be combined with the larger sample size to provide insight into the potential biases or lower sensitivity of the AFDD data. Once a library of fault prevalence data is built, it will be studied to provide further insight into the drivers of fault prevalence, for example, whether prevalence is correlated with building type, geographical location (which is tied to climate and to utility rates), building size, etc. This paper describes the methods developed for this study and illustrates them with preliminary data. It discusses some of the challenges of harmonizing disparate outputs from multiple AFDD vendors, application of a unifying fault taxonomy, and fault prevalence metrics.

Ebrahimi Fakhar, Amir↗
DOE OSTI2022

evSeq: Cost-Effective Amplicon Sequencing of Every Variant in a Protein Library

Widespread availability of protein sequence-fitness data would revolutionize both our biochemical understanding of proteins and our ability to engineer them. Unfortunately, even though thousands of protein variants are generated and evaluated for fitness during a typical protein engineering campaign, most are never sequenced, leaving a wealth of potential sequence-fitness information untapped. Primarily, this is because sequencing is unnecessary for many protein engineering strategies; the added cost and effort of sequencing is thus unjustified. It also results from the fact that, even though many lower cost sequencing strategies have been developed, they often require at least some sequencing or computational resources, both of which can be barriers to access. In this work, we present every variant sequencing (evSeq), a method and collection of tools/standardized components for sequencing a variable region within every variant gene produced during a protein engineering campaign at a cost of cents per variant. evSeq was designed to democratize low-cost sequencing for protein engineers and, indeed, anyone interested in engineering biological systems. Execution of its wet-lab component is simple, requires no sequencing experience to perform, relies only on resources and services typically available to biology labs, and slots neatly into existing protein engineering workflows. Analysis of evSeq data is likewise made simple by its accompanying software (found at github.com/fhalab/evSeq, documentation at fhalab.github.io/evSeq), which can be run on a personal laptop and was designed to be accessible to users with no computational experience. Here, low-cost and easy to use, evSeq makes collection of extensive protein variant sequence-fitness data practical.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Toward performance-portable PETSc for GPU-based exascale systems

The Portable Extensible Toolkit for Scientific computation (PETSc) library delivers scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization. The PETSc design for performance portability addresses fundamental GPU accelerator challenges and stresses flexibility and extensibility by separating the programming model used by the application from that used by the library, and it enables application developers to use their preferred programming model, such as Kokkos, RAJA, SYCL, HIP, CUDA, or OpenCL, on upcoming exascale systems. Furthermore, a blueprint for using GPUs from PETSc-based codes is provided, and case studies emphasize the flexibility and high performance achieved on current GPU-based systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

dCache: The Storage System of Choice for Data-Intensive Applications

The ever-increasing volumes of data produced by modern scientific facilities like EuXFEL and LHC put significant stress on data management infrastructure operated by laboratories and research centers. The challenges to be addressed span the entire data life cycle, from ingest and efficient data analysis to long-term preservation, typically involving large tape libraries. dCache, a storage system developed in collaboration between the Deutsches Elektronen-Synchrotron (DESY), Fermi National Accelerator Laboratory, and Nordic e-Infrastructure Collaboration (NeIC), is designed to manage a large number of disk servers and to facilitate transparent data migration to and from archival storage. Its multifaceted approach offers a unified method to support a variety of scientific use cases with the same storage infrastructure, including high-throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters, and long-term data preservation on tertiary storage. Initially developed for high energy physics (HEP) experiments, dCache is now used by various scientific communities, including astrophysics, biomedical research, and life sciences, each having specific requirements. This paper presents architecture, deployment strategies, performance and scalability enhancements, and recent advancements in dCache addressing the needs of scientific communities. Finally, we touch on the development and release process, ensuring the software’s high quality.

DCache↗
DOE OSTI2018

sympl (v. 0.4.0) and climt (v. 0.15.3) – towards a flexible framework for building model hierarchies in Python

sympl (System for Modelling Planets) andclimt (Climate Modelling and Diagnostics Toolkit) are anattempt to rethink climate modelling frameworks from the ground up. The aimis to use expressive data structures available in the scientific Pythonecosystem along with best practices in software design to allow scientists toeasily and reliably combine model components to represent the climate systemat a desired level of complexity and to enable users to fully understandwhat the model is doing. sympl is a framework which formulates the model in terms of astate that gets evolved forward in time or modified within a specifictime by well-defined components. sympl's design facilitates buildingmodels that are self-documenting, are highly interoperable, and providefine-grained control over model components and behaviour. symplcomponents contain all relevant information about the input they expect andoutput that they provide. Components are designed to be easily interchanged,even when they rely on different units or array configurations.sympl provides basic functions and objects which could be used inany type of Earth system model. climt is an Earth system modelling toolkit that contains scientificcomponents built using sympl base objects. These include both purePython components and wrapped Fortran libraries. climt providesfunctionality requiring model-specific assumptions, such as stateinitialization and grid configuration. climt's programming interfacedesigned to be easy to use and thus appealing to a wide audience. Model building, configuration and execution are performed through a Pythonscript (or Jupyter Notebook), enabling researchers to build an end-to-endPython-based pipeline along with popular Python data analysis andvisualization tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Accelerating Random Forest Classification on GPU and FPGA

Random Forests (RFs) are a commonly used machine learning method for classification and regression tasks spanning a variety of application domains, including bioinformatics, business analytics, and software optimization. While prior work has focused primarily on improving performance of the training of RFs, many applications, such as malware identification, cancer prediction, and banking fraud detection, require fast RF classification. In this work, we accelerate RF classification on GPU and FPGA. In order to provide efficient support for large datasets, we propose a hierarchical memory layout suitable to the GPU/FPGA memory hierarchy. We design three RF classification code variants based on that layout, and we investigate GPU- and FPGA-specific considerations for these kernels. Our experimental evaluation, performed on an Nvidia Xp GPU and on a Xilinx Alveo U250 FPGA accelerator card using publicly available datasets on the scale of millions of samples and tens of features, covers various aspects. First, we evaluate the performance benefits of our hierarchical data structure over the standard compressed sparse row (CSR) format. Second, we compare our GPU implementation with cuML, a machine learning library targeting Nvidia GPUs. Third, we explore the performance/accuracy tradeoff resulting from the use of different tree depths in the RF. Finally, we perform a comparative performance analysis of our GPU and FPGA implementations. Our evaluation shows that for high accuracy targets, our GPU implementation yields 5-9x speedup over CSR, and up to a 2x speedup over cuML.

FPGA, Xilinx FPGA, GPU, Random Forest classificati↗
DOE OSTI2020

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗