Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Mathematical programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Language Independent Static Analysis (LISA)

Software is becoming increasingly important in nearly every aspect of global society and therefore in nearly every aspect of national security as well. While there have been major advancements in recent years in formally proving properties of program source code during development, such approaches are still in the minority among development teams, and the vast majority of code in this software explosion is produced without such properties. In these cases, the source code must be analyzed in order to establish whether the properties of interest hold. Because of the volume of software being produced, automated approaches to software analysis are necessary to meet the need. However, this software boom is not occurring in just one language. There are a wide range of languages of interest in national security spaces, including well-known languages such as C, C++, Python, Java, Javascript, and many more. But recent years have produced a wide range of new languages, including Nim, (2008), Go (2009), Rust (2010), Dart (2011), Kotlin (2011), Elixir (2011), Red (2011), Julia (2012), Typescript (2012), Swift (2014), Hack (2014), Crystal (2014), Ballerina (2017) and more. Historically, automated software analyses are implemented as tools that intermingle both the analysis question at hand with target language dependencies throughout their code, making re-use of components for different analysis questions or different target languages impractical. This project seeks to explore how mission-relevant, static software analyses can be designed and constructed in a language-independent fashion, dramatically increasing the reusability of software analysis investments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

CONNECT Neutronics Initial Report

This report represents the first status update from the Creation of Next-generation Nuclear Energy Computational Technology (CONNECT) effort within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program and is intended to satisfy the reporting requirements of the following milestones: • M3MS-24OR0101321: Assess needs, requirements and opportunities for high-fidelity neutronics and transport as used in DOE-NE program. • M3MS-24AN0101301: Generate a community report on the needs, requirements, and opportunities for high-fidelity neutronics and transport as used in DOE-NE programs and industry. • M3MS-24OR0202433: Implement and assess numerical strategies leveraging Monte Carlo neutron transport on GPUs for production analysis. In particular, Sections 1, 2, and 3 detail the assessment of the current state of practice and the landscape of the broader advanced computing world to meet the objectives of M3MS-24OR0101321 and M3MS-24AN0101301, while Sections 4 and 5 describe new work during FY24 to extend current GPU Monte Carlo capabilities in areas relevant to active NEAMS development to satisfy M3MS-24OR0202433. Section 6 offers some thoughts about the potential future impact of Monte Carlo neutronics on NEAMS and the nuclear industry.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

A Performance Portable, Fully Implicit Landau Collision Operator with Batched Linear Solvers

Modern accelerators use hierarchical parallel programming models that enable massive multithreading within a processing element (PE), with multiple PEs per device driven by traditional processes. Batching is a technique for exposing PE-level parallelism in algorithms that have traditionally run on MPI processes or multiple threads within a single process. Opportunities for batching arise in, for example, kinetic discretizations of magnetized plasmas where collisions are advanced in velocity space at each spatial point independently. This paper builds on previous work on a high-performance, fully nonlinear, Landau collision operator by batching the linear solver, as well as batching the spatial point problems and adding new support for multiple grids for multiscale, multispecies problems. An anisotropic relaxation verification test that agrees well with previously published results and analytical models is presented. The performance results from NVIDIA A100 and AMD MI250X nodes are presented with hardware utilization analysis for each architecture. Finally, the entire implicit Landau operator time advance is implemented in Kokkos for performance portability, running entirely on the device and is available in the PETSc numerical library.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Multiscale modeling for high burnup structure formation and associated pulverization

This report summarizes the lower length scale modeling work performed in the fiscal year 2023 under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program to capture the microstrutural evolution and associated pulverization criteria in the high burnup regions. This year, the resolution mechanisms within the cluster dynamics code has been updated and it influence on the bubble growth in HBS regions at the mesoscale is studied. To improve the accuracy of phase-field models of fission gas bubble growth, a new Helmholtz free energy for high-density Xe gas is derived from a virial equation of state. Two previously used strategies for representing net vacancy production in phase-field models of fission gas bubble growth are compared with each other and with analytical models of bubble growth. The vacancy source only model is found to be more convenient to parameterize realistically compared with the vacancy source+sink model. Furthermore, the phase-field-fracture simulation have been performed using MD- informed failure stress values and realistic HBS structure obtained from the phase-field simulations. We also present the uncertainty bands on prediction of the critical stress to account for the effect of the lower length scale variabilities on the failure criteria at the mesoscale. It is observed that pulverization may occur in partially restructured regions with restructuring fraction as low as 17%. In light of this, an update to the BISON’s pulverization criteria is recommended.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Development of a Computational Framework for Multiphysics Multiphase Species Tracking using NEAMS Tools

This report implements a high-fidelity multiphysics modeling framework using the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program tools to track isotopic species in Molten Salt Reactors (MSRs), with a specific focus on the 91-depletion chain within the Molten Salt Reactor Experiment (MSRE). The model integrates neutronics, thermal-hydraulics, depletion, and thermochemistry to simulate the production, transport, and phase transitions of isotopes under steady-state and transient conditions. The main findings reveal that isotopes such as bromine-91 largely remain in the liquid phase, while others, including krypton-91and yttrium-91, transition to the gas phase, significantly influencing the reactor’s radiological source term. The study also shows that during transients, like a reactivity insertion transient, rapid void formation and the expansion of the liquid-gas interface led to substantial transfers of dissolved isotopes into the gas phase, altering isotope distribution and largely increasing the source term in the off-gas system. Additionally, the research highlights that short-lived isotopes dominate the initial off-gas response during transients, while longer-lived isotopes determine the equilibrium state, underscoring the necessity of dynamic simulations for accurate species tracking and reactor safety analysis. The developed methodology will be applied in the future to the tracking of a larger number of species and introduce other species tracking mechanisms, such as deposition and plating.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

SAM Enhancements for Air-Ingress Event Modeling in HTGRs

The SAM code is under development and supported by DOE-NE’s Nuclear Energy Advanced Modeling and Simulation program as a modern system-level modeling and simulation tool for advanced non-light water reactor safety analyses. These advanced reactor concepts incorporate novel and improved approaches to achieve safety and economic feasibility. This report summarizes recent efforts and progress in addressing the code capability gaps in SAM for the modeling of the air-ingress phenomenon in High-Temperature Gas-Cooled Reactors (HTGRs). The capability enhancements implemented to the code include: a multi-component flow model to capture the air-helium mixture during air ingress, a 0-D graphite oxidation model to capture the reaction of graphite with oxygen in the air, and an isentropic critical flow model to more accurately predict the de-pressurization of the reactor system due to a small break in the primary loop. Verification cases and demonstrations are provided to showcase these capabilities in SAM. Existing gaps in the code’s capability are also identified.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

SIRIUS: Science-Driven Data Management for Multi-Tiered Storage

The data sets being generated by large applications on very large-scale systems are increasing in both size and complexity. At the same time, there are new ways available to store and access these data sets. The goal in this project is to develop software that applications can use to make use of new and existing storage technologies in more sophisticated ways. One challenge in scientific data management is handling ‘hot’ vs ‘cold’ data. Data that is hot is data that is needed (or will be needed soon) in order for the program to continue progressing, while cold data is either output (and so will not be need further during the life of the program) or will not be needed until significantly later in the program’s run. Hot data should be stored in a way that allows fast access. On most systems, economic factors lead to an inverse relationship between storage performance and storage capacity and so fast access storage is limited. This makes it important to correctly place hot and cold data and avoid cold data unnecessarily consuming precious resources. In this reporting period, we addressed this challenge in various ways and at various levels. Data management frameworks offer only limited control to applications in how data is stored. We have added software capabilities for seamlessly moving data between layers of the storage technology using promote and demote functions to existing software frameworks. This gives direct control to applications in deciding what priority data receives. Additionally, we integrated different storage layer management frameworks in order to allow data to be exchanged and moved between storage layers in a consistent way across the application. Further, applications are not always able to directly decide what storage level makes sense for a given piece of data without an understanding of the underlying storage technologies. Data storage frameworks are often positioned to make these sorts of decisions in service of the application. We have added machine-learning based capabilities to data staging frameworks in order to make intelligent decisions about where data should be stored given learning about patterns in previous usage of similar data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Software Validation Work With The ZPPR-15 Data

The analysis activities for fast reactors involve using many different pieces of software that are relied upon for their predictive capabilities. For this software to be considered reliable, documented proof that the predictions of the software are accurate is required. In this manuscript, the validation work that covers some of the Argonne software used in fast reactor design activities is discussed and displayed. This validation work includes neutron and gamma flux distributions, reaction rate distributions, and reactivity worth. In an ideal world, a reactor development program would have access to a comprehensive set of experimental facilities to help inform the design aspects of the reactor itself. While thermal-hydraulics experiments, and to a limited degree mechanical experiments, can be carried out today for validation needs, neutronics related experimental facilities are rather impractical because of the lack of experimental facilities. Given the desired time table for construction of new reactors, the reconstitution or creation of new neutronic experimental facilities is untenable and thus those reactor development programs must rely upon any available experimental measurements that are qualitatively similar to the design. While a methodology has been proposed to assess the similarity between the past experimental measurements and the reactor itself, that aspect is beyond the scope of this manuscript. In this manuscript, the focus is entirely placed on the analysis results for a series of experiments carried out at the ZPPR facility in Idaho in the mid-1980s. In this regard, this manuscript only shows the validation of the stated neutronics software for specific loadings of the ZPPR reactor. Because of the fuel form, its proposed enrichment, and the material content of the reactor core, the ZPPR-15 experiments were identified as potential validation data for the reactor. The ZPPR-15 experiments were intended as mockups of a 330 MWe Integral Fast Reactor program which was a follow on program to the Clinch River Breeder Reactor. In the ZPPR-15 series of experiments, measurements of the neutron spectrum, control rod worth, sodium void worth, foil reaction rate distributions, Doppler worth of heated samples, gamma dose, and axial expansion worth were all carried out and published. In many cases, these reactivity coefficients are good candidates to validate the reactivity coefficient calculation scheme used by the analysis software and included in the safety analysis activities of fast reactor development projects today. This manuscript discusses the modeling methodology and accuracy of the calculated experimental results using the LANL software MCNP and the ANL software package ARC (Argonne Reactor Codes). As will be shown, for many of the experimental measurements, the two software packages are found to be good predictive analysis tools for those experiments. In other cases, problems with the analysis methodology or underlying cross section data are exposed which indicates where predictive analysis is not as reliable. Finally, in some of the measurements the conclusion is reached that the experimental measurement cannot be reproduced with the analysis software as it is simply too difficult.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Correlation Between Weather Alerts and Grid Component Failures for Grid Alert

Weather events cause most grid failures. Often, we even get notifications on our phones to take cover or be prepared for an imminent event. If electric grid utilities had a similar warning that also included probable scenarios and the equipment involved, they could prepare and minimize the effects. Recent research at Idaho National Laboratory into electric grid risk analysis methods resulted in a tool that allows for the development of the most likely scenarios given failure probabilities of grid components. INL has a project with the U.S. Department of Energy’s Cybersecurity, Energy Security, and Emergency Response (CESER) program to develop a Grid Alert application that receives messages from the existing emergency alert system, filters and determines components possibly affected by the emergency event, calculates probable scenarios uses MASTERRI and then notifies the utility if there is significant risk. Historical failure data of elements that comprise the U.S. electric grid have been compiled by utilities and organizations such as the international regulatory body North American Electric Reliability Corporation (NERC). Nominal failure rates are obtained from this data. To make this tool possible, estimated failure rates are needed for different component types given the alert type, severity, and location. Historic weather-related grid element failures are correlated with historic weather events from Integrated Public Alert & Warning System (IPAWS). These correlated events and failures are used along with Bayesian updates from the historical norms to provide a modified failure rate for grid elements in the alert areas and calculate probable scenarios. This discusses the Grid Alert project plan but focuses on the data gathered and process used in determining failure rates for possible grid failure scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Integration of Data Analytics with Plant System Health Program

This report summarizes the R&D activities of the Plant Health Management (PHM) project during fiscal year 2020 (FY20). This project focuses on the development of methods that integrate component health data and propagate such information at the system level to evaluate system sources of risk. This project development lives in cooperation with the Risk Informed Asset Management (RIAM) project. The RIAM project, in fact, uses the reliability models and data generated by the PHM project to optimize plant operations (e.g., maintenance/replacement schedule, optimal maintenance posture). This year’s activities for the PHM project focused mainly on the development of two classes of models. The first one includes a series of component reliability models which include aging, testing and maintenance. The second class includes a series of system reliability models which focus on the secondary side of exiting U.S. reactors. These models are based on fault tree logic structures such that they can be used by existing plant PRA software. We also started to focus on the management of health data and we tackled this issue in two directions. The first one focuses on the integration of monitor data with simulation models to assess component health. This approach is moving from a classical data based to a model+data based approach with the goal of improving higher component health information. The second direction focuses on linking equipment reliability data (e.g., maintenance/failure reports, component monitoring data) directly to system reliability models using a safety margin based language rather than a probability based language. The main advantage of a safety margin based language is that it can provide to system engineers more tangible information on system/component health and how it propagates to the system level.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Advanced Long-Term Environmental Monitoring Systems (ALTEMIS) Artificial Intelligence Data Management Plan

Across the Department of Energy’s Environmental and Legacy Management sites, complex groundwater plumes exist that will require long-term monitoring to ensure remedial actions that have been put in place remain effective decades into the future. The current monitoring paradigm predominantly consists of groundwater well sampling, whereby samples are collected, concentrations analyzed, and plume anomalies are detected after they have occurred. The Advanced Long Term Environmental Monitoring Systems (ALTEMIS) program is a multi-lab, multi-institution team of researchers that is deploying spatially integrative technologies (i.e., real-time in situ sensor networks), coupled with artificial intelligence and machine learning, to establish a more proactive monitoring paradigm. Within this approach, plume anomalies can be predicted, and corrective actions can be established prior to the occurrence, offering a more cost-effective and robust approach to long-term monitoring. The team has deployed a variety of different in situ sensing technologies at the Savannah River Site’s F-Area Hazardous Waste Management Facility around the F-Area Seepage Basins, which are unlined basins that received 7 billion liters of acidic low-level radioactive waste from the 1950s until the late 1980s. The technologies and techniques that the team is deploying are intended to ensure that the remedial actions that have been taken by the site remain effective decades into the future. Foundational to this approach is a robust, integrated data management and analysis plan to ensure accurate and timely reporting from the variety of sensor systems that are in place. This report will outline the data management plan that has been implemented by the ALTEMIS team at the Savannah River Site and will serve as a blueprint as the technology is translated to new sites across the DOE Complex.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

INTEGRATION OF FLEX EQUIPMENT AND OPERATOR ACTIONS IN PLANT FORCE-ON-FORCE MODELS WITH DYNAMIC RISK ASSESSMENT

The overall operation and maintenance cost to protect nuclear power plants accounts for approximately 7% of the total cost of power generation, with labor accounting for half of this cost. In the current research, from interaction with utilities and other stakeholders, it was determined that physical security forces account for nearly 20% of the entire workforce at several nuclear power plants. Labor costs continue to rise in the U.S., so any measures to reduce the cost of operating a nuclear power plant will need to include a reduction in labor. The physical security pathway within the DOE’s Light Water Reactor Sustainability program aims to lower the cost of physical security through directed research into modeling and simulation, application of advanced sensors or deployment of advanced weapons. This report presents a modeling and simulation framework for integrating Diverse and Flexible Mitigation Capability (FLEX) portable equipment performance with Force on Force models of a plant’s physical security posture. The generic framework is described in detail, followed by a case study of modeling an adversarial attack aimed at causing a radiological release by sabotaging the plant’s power supply and its ultimate heat sink capabilities at a hypothetical nuclear power plant. Two different FLEX deployment strategies, series and parallel, are modeled with distinct timelines. The results of the adversarial attack modeled in a commercial Force on Force tool are integrated with the FLEX deployment model in INL’s dynamic modeling tool EMRALD. Monte Carlo simulation is used to model the distribution of the timeline in FLEX deployment strategies. The results demonstrate that, even in the extreme case of a successful adversarial attack, deployment of FLEX equipment can result in a significantly high likelihood of preventing radiological release. The modeling and simulation framework integrating FLEX equipment with Force on Force models enables the nuclear power plants to credit FLEX portable equipment in the plant security posture, resulting in an efficient and optimized physical security.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Risk-informed Graded Approach for Reliability and Performance Assessment of Machine Learning and Artificial Intelligence for Advanced Condition Monitoring Techniques

With the shift away from time-based maintenance and toward condition-based maintenance, and to reduce overall maintenance costs, there has been an upsurge in the usage and development of advanced condition monitoring (ACM) techniques for real-time monitoring of nuclear power plant (NPP) components. ACM is particularly useful in the development of digital twins, which are designed to predict the failure or degradation of plant components. Successful implementation of ACM requires an assessment to inform the development of a risk-informed approach to evaluate the use of ACM to meet Nuclear Regulatory Committee (NRC) regulations for in-service testing (IST) programs. This includes the monitoring and diagnostics of reactor components and systems in current, new, and advanced reactors. A key component in ACM is the usage of machine learning (ML) and artificial intelligence (AI) algorithms that can employ real-time data from instrumentation and sensors to detect and predict reactor component degradations. Such predictive capabilities enable early detection of component degradation so as to help plant personnel plan and execute necessary maintenance. For successful implementation of ML/AI in ACM such that regulatory requirements are met, a risk-informed graded approach is needed to assess the reliability and performance of ML/AI for ACM. The American Society for Mechanical Engineers (ASME) developed their Operations and Maintenance (O&M) Code to provide guidance on safe, reliable O&M of NPPs. The IST section of the O&M Code specifically establishes requirements for IST and examination to gauge operational readiness of components in water-cooled NPPs. This paper presents a state-of-the-art review of how reliability and risk assessment can be integrated with ACM to assess component performance by non-nuclear industries. This is followed by different methodologies and approaches for conducting performance and reliability assessments so as to meet IST requirements for NPP components.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Relaxations of the steady optimal gas flow problem for a non-Ideal gas

Natural gas ranks second in U.S. primary energy consumption. Because most production sites are remote, gas must be transported through pipeline networks equipped with compressors, valves, and other components. For both economic efficiency and system reliability, it is desirable to operate these networks optimally. The governing physics across pipeline components entails nonlinear, non-convex equality and inequality constraints, and the most general steady-flow operations problem is a Mixed-Integer Nonlinear Program (MINLP).This work focuses on one such steady-flow problem-the Optimal Gas Flow (OGF) for a natural gas pipeline network-which minimizes production cost subject to the steady-flow physics. For day-to-day operations, the ability to quickly compute a globally optimal solution and a strong lower bound for varying demand profiles is crucial. A promising strategy is to build tight relaxations of the OGF’s nonlinear constraints. However, many nonlinearities arising from non-ideal equations of state either lack relaxations or have relaxations that do not scale to realistic network sizes. We address this gap by combining recent advances in polyhedral relaxations for univariate functions to construct tight, computationally efficient relaxations of the OGF with a non-ideal equation of state. These relaxations solve within seconds on a standard laptop. In conclusion, we demonstrate their quality through extensive numerical experiments on very large-scale test networks from the literature and find that the proposed approach proves optimality in 92% of tested instances.

03 NATURAL GAS↗
DOE OSTI2020

Methods and Experiences for Developing Abstractions for Data-intensive, Scientific Applications

Developing software for scientific applications that require the integration of diverse types of computing, instruments, and data present challenges that are distinct from commercial software. These applications require scale, and the need to integrate various programming and computational models with evolving and heterogeneous infrastructure. Pervasive and effective abstractions for distributed infrastructures are thus critical; however, the process of developing abstractions for scientific applications and infrastructures is not well understood. While theory-based approaches for system development are suited for well-defined, closed environments, they have severe limitations for designing abstractions for scientific systems and applications. The design science research (DSR) method provides the basis for designing practical systems that can handle real-world complexities at all levels. In contrast to theory-centric approaches, DSR emphasizes both practical relevance and knowledge creation by building and rigorously evaluating all artifacts. In this work, we show how DSR provides a well-defined framework for developing abstractions and middleware systems for distributed systems. Specifically, we address the critical problem of distributed resource management on heterogeneous infrastructure over a dynamic range of scales, a challenge that currently limits many scientific applications. We use the pilot-abstraction, a widely used resource management abstraction for high-performance, high throughput, big data, and streaming applications, as a case study for evaluating the DSR activities. For this purpose, we analyze the research process and artifacts produced during the design and evaluation of the pilot-abstraction. We find DSR provides a concise framework for iteratively designing and evaluating systems. Finally, we capture our experiences and formulate different lessons learned.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Exploring Explicit Uncertainty for Binary Analysis (EUBA)

Reverse engineering (RE) analysts struggle to address critical questions about the safety of binary code accurately and promptly, and their supporting program analysis tools are simply wrong sometimes. The analysis tools have to approximate in order to provide any information at all, but this means that they introduce uncertainty into their results. And those uncertainties chain from analysis to analysis. We hypothesize that exposing sources, impacts, and control of uncertainty to human binary analysts will allow the analysts to approach their hardest problems with high-powered analytic techniques that they know when to trust. Combining expertise in binary analysis algorithms, human cognition, uncertainty quantification, verification and validation, and visualization, we pursue research that should benefit binary software analysis efforts across the board. We find a strong analogy between RE and exploratory data analysis (EDA); we begin to characterize sources and types of uncertainty found in practice in RE (both in the process and in supporting analyses); we explore a domain-specific focus on uncertainty in pointer analysis, showing that more precise models do help analysts answer small information flow questions faster and more accurately; and we test a general population with domain-general sudoku problems, showing that adding "knobs" to an analysis does not significantly slow down performance. This document describes our explorations in uncertainty in binary analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Shorter function summaries for finite state machine-based high consequence systems using logic synthesis and tautologies (Final Report LDRD 24-1302)

Computer programs are often viewed as collections of functions – each function has parameters (inputs) and computes a return value, and each has potential side effects that modify program state (outputs). In this research, a Sandia symbolic execution tool designed to support “human-in-the-loop” analysis was modified to automatically create “function summaries,” and a new tool, “diaboolical,” was created to support enhancing readability of the summary using a novel approach to bit-vector simplification that leverages logic synthesis and tautologies. For this effort, students at Auburn University created several finite state machines (FSMs) to serve as exemplars for high-consequence systems. Function summaries for each of the machines were obtained, and then portions of the summaries were simplified using both diaboolical and the simplification procedure of a popular SMT solver. A comparison of the results shows that diaboolical can often produce smaller function summaries, with expression length improvements over the unsimplified function summaries ranging from 0% to 90% for diaboolical and 0% to 65% for the SMT solver, though diaboolical had a significantly greater cost in time. Diaboolical was evaluated against a collection of “arbitrary” C-code as well as FSM exemplars, and for both datasets it achieved an approximately 10% improvement in expression length compared to simplifications that could be obtained using existing techniques. Function summaries can assist assurance efforts that evaluate existing systems and their executable code. A smaller function summary is likely easier for humans to understand and could thus increase the ability and efficacy of assurance practices centered around the analysis of executable artifacts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Profiling the BLAST bioinformatics application for load balancing on high-performance computing clusters

Abstract Background The Basic Local Alignment Search Tool (BLAST) is a suite of commonly used algorithms for identifying matches between biological sequences. The user supplies a database file and query file of sequences for BLAST to find identical sequences between the two. The typical millions of database and query sequences make BLAST computationally challenging but also well suited for parallelization on high-performance computing clusters. The efficacy of parallelization depends on the data partitioning, where the optimal data partitioning relies on an accurate performance model. In previous studies, a BLAST job was sped up by 27 times by partitioning the database and query among thousands of processor nodes. However, the optimality of the partitioning method was not studied. Unlike BLAST performance models proposed in the literature that usually have problem size and hardware configuration as the only variables, the execution time of a BLAST job is a function of database size, query size, and hardware capability. In this work, the nucleotide BLAST application BLASTN was profiled using three methods: shell-level profiling with the Unix “time” command, code-level profiling with the built-in “profiler” module, and system-level profiling with the Unix “gprof” program. The runtimes were measured for six node types, using six different database files and 15 query files, on a heterogeneous HPC cluster with 500+ nodes. The empirical measurement data were fitted with quadratic functions to develop performance models that were used to guide the data parallelization for BLASTN jobs. Results Profiling results showed that BLASTN contains more than 34,500 different functions, but a single function, RunMTBySplitDB, takes 99.12% of the total runtime. Among its 53 child functions, five core functions were identified to make up 92.12% of the overall BLASTN runtime. Based on the performance models, static load balancing algorithms can be applied to the BLASTN input data to minimize the runtime of the longest job on an HPC cluster. Four test cases being run on homogeneous and heterogeneous clusters were tested. Experiment results showed that the runtime can be reduced by 81% on a homogeneous cluster and by 20% on a heterogeneous cluster by re-distributing the workload. Discussion Optimal data partitioning can improve BLASTN’s overall runtime 5.4-fold in comparison with dividing the database and query into the same number of fragments. The proposed methodology can be used in the other applications in the BLAST+ suite or any other application as long as source code is available.

59 BASIC BIOLOGICAL SCIENCES↗