Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Efficient DNA sequence compression with neural networks

Abstract Background The increasing production of genomic data has led to an intensified need for models that can cope efficiently with the lossless compression of DNA sequences. Important applications include long-term storage and compression-based data analysis. In the literature, only a few recent articles propose the use of neural networks for DNA sequence compression. However, they fall short when compared with specific DNA compression tools, such as GeCo2. This limitation is due to the absence of models specifically designed for DNA sequences. In this work, we combine the power of neural networks with specific DNA models. For this purpose, we created GeCo3, a new genomic sequence compressor that uses neural networks for mixing multiple context and substitution-tolerant context models. Findings We benchmark GeCo3 as a reference-free DNA compressor in 5 datasets, including a balanced and comprehensive dataset of DNA sequences, the Y-chromosome and human mitogenome, 2 compilations of archaeal and virus genomes, 4 whole genomes, and 2 collections of FASTQ data of a human virome and ancient DNA. GeCo3 achieves a solid improvement in compression over the previous version (GeCo2) of $2.4\%$, $7.1\%$, $6.1\%$, $5.8\%$, and $6.0\%$, respectively. To test its performance as a reference-based DNA compressor, we benchmark GeCo3 in 4 datasets constituted by the pairwise compression of the chromosomes of the genomes of several primates. GeCo3 improves the compression in $12.4\%$, $11.7\%$, $10.8\%$, and $10.1\%$ over the state of the art. The cost of this compression improvement is some additional computational time (1.7–3 times slower than GeCo2). The RAM use is constant, and the tool scales efficiently, independently of the sequence size. Overall, these values outperform the state of the art. Conclusions GeCo3 is a genomic sequence compressor with a neural network mixing approach that provides additional gains over top specific genomic compressors. The proposed mixing method is portable, requiring only the probabilities of the models as inputs, providing easy adaptation to other data compressors or compression-based data analysis tools. GeCo3 is released under GPLv3 and is available for free download at https://github.com/cobilab/geco3.

Silva, Milton↗

Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Integral Experiment Execution (CED-3b Report)

This report documents the experimental configurations and measurements for IER-518: Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Experiments. These measurements involved a series of subcritical configurations at the Sandia Critical Experiments (SCX) facility at Sandia National Laboratories (SNL). The purpose of these measurements was to produce time tagged neutron count data of configurations that exceed a subcritical multiplication of 20, which is the high end of the fundamental physics benchmarks currently available in the International Criticality Safety Benchmark Evaluation Project Handbook (ICSBEP). These measurements leverage experimental configurations 1 and detector systems 2 from previously accepted ICSBEP benchmark evaluations, allowing evaluations of these measurements to be performed at greatly reduced cost.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmark Calculation for the Watts Bar Unit 1 Cycles 1-3 Using the SCALE 6.3/Polaris–PARCS v3.4.2 Code Package

Benchmark calculations for the Watts Bar Unit 1 cycles 1–3 were performed to validate the SCALE 6.3/Polaris–PARCS v3.4.2 with the ENDF/B-VII.1 56-group library by comparing the simulated results with the measured data. The benchmark results are used in evaluating uncertainties of the SCALE/Polaris–PARCS code package for pressurized water reactor physics analysis for key nuclear parameters such as reactivity, control bank worth, temperature coefficients, and pin and assembly power peaking factors. This report details plant and fuel design specifications and input data for SCALE/Polaris, GenPMAXS, and PARCS. Additional details are provided for the input and output files produced for the benchmark calculations. The benchmark results were summarized such that they can be used in evaluating uncertainties for key nuclear parameters with other benchmark results.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Modeling Enhancements, Cross-Section Generation Updates, and Benchmarking with Shift

This technical report documents the modeling enhancements, cross-section generation updates, and bench marking with the Shift Monte Carlo code performed under the US Department of Energy Nuclear Energy Advanced Modeling and Simulation Program in FY 2024. The work performed included several modeling enhancements, such as integration of cross-section generation in Titan and the ability to produce microscopic multigroup cross sections with Shift. Benchmarking of the cross sections produced by Shift and the two-step workflow with Griffin was performed for three problems: the Advanced Breeder Test Reactor, a generic pebble bed reactor, and a TRISO heat pipe microreactor. Comparisons of results from these benchmark problems were done with Serpent, OpenMC, and Griffin. These enhancements provide a robust foundation for applying Shift for both reference and two-step neutronics analysis for advanced reactor simulation.

97 MATHEMATICS AND COMPUTING↗

Optimization with the OpenACC-to-FPGA framework on the Arria 10 and Stratix 10 FPGAs

The reconfigurable computing paradigm with field programmable gate arrays (FPGAs) has received renewed interest in the high-performance computing field due to FPGAs’ unique combination of performance and energy efficiency. However, difficulties in programming and optimizing FPGAs have prevented them from being widely accepted as general-purpose computing devices. In accelerator-based heterogeneous computing, portability across diverse heterogeneous devices is also an important issue, but the unique architectural features in FPGAs make this difficult to achieve. To address these issues, a directive-based, high-level FPGA programming and optimization framework was previously developed. In this work, developed optimizations were combined holistically using the directive-based approach to show that each individual benchmark requires a unique set of optimizations to maximize performance. We perform this exploration on Intel Arria 10 and Stratix 10 FPGAs. We also explored the relationships between performance, resource usages, and compilation times, and investigated implications for performance portability. Finally, we present an initial evaluation of a real-world proxy application, LULESH.

97 MATHEMATICS AND COMPUTING↗

In-Depth Optimization with the OpenACC-to-FPGA Framework on an Arria 10 FPGA

The reconfigurable computing paradigm that uses field programmable gate arrays (FPGAs) has received renewed interest in the high-performance computing field due to FPGAs' unique combination of performance and energy efficiency. However, difficulties in programming and optimizing FPGAs have prevented them from being widely accepted as general-purpose computing devices. In accelerator-based heterogeneous computing, portability across diverse heterogeneous devices is also an important issue, but the unique architectural features in FPGAs make this difficult to achieve. To address these issues, a directive-based, high-level FPGA programming and optimization framework was previously developed. In this work, developed optimizations were combined holistically using the directive-based approach to show that each individual benchmark requires a unique set of optimizations to maximize performance. The relationships between FPGA resource usages and runtime performance were also explored.

Lambert, Jacob↗

Improving the performance of medical imaging applications using SYCL

As opposed to the Open Computing Language (OpenCL) programming model, in which host and device codes are generally written in different programming languages, SYCL can combine host and device codes for an application in a type-safe way to improve development productivity and performance portability. Hence, this report shows the experimental results of applying the SYCL programming model to medical imaging applications for a study on performance portability and programming productivity between OpenCL and SYCL. Rodinia is a widely used open-source benchmark suite for heterogeneous computing. We choose two medical imaging applications (Heart Wall and Particle Filter) in the benchmark suite, migrate the OpenCL implementations of the applications to the SYCL implementations, and evaluate their performance and productivity on Intel® microprocessors that contain a central processing unit (CPU) and an integrated graphics processing unit (GPU). The maturing SYCL compilers, which are based on a conformant implementation of the SYCL 1.2.1 Khronos specification, have been actively optimized for Intel® computing platforms. The experimental results are promising in terms of the raw performance and productivity. Although the SYCL implementation of the Heart Wall application does not execute successfully on a CPU, the SYCL implementations of the application can achieve comparable or better performance than the OpenCL implementation on Intel® integrated GPUs. For the Particle Filter application, the performance difference between the SYCL and OpenCL implementations is comparable on the GPUs for most cases, but the SYCL implementations are on average 4X faster than the OpenCL implementations on Intel® Xeon® CPUs. For programming productivity, we arguably use lines of code as a way to measure programming productivity in software. The SYCL programs reduce the lines of code of the OpenCL programs by 52% and 38% for the Heart Wall and Particle Filter, respectively. The results indicate that SYCL is a promising programming model for heterogeneous computing with the maturing compilers. We organize the remainder of the report as follows. Section II introduces the SYCL programming model, compares the major differences between an OpenCL program and a SYCL program, and describes the characteristics of the two applications. Section III describes the SYCL programming model in more details, and shows the SYCL implementation of a kernel function in the Particle Filter application as an example. In Section IV, we evaluate the performance of the applications on the CPUs and GPUs. Section V concludes the report.

59 BASIC BIOLOGICAL SCIENCES↗

Scientific machine learning benchmarks

Deep learning has transformed the use of machine learning technologies for the analysis of large experimental datasets. In science, such datasets are typically generated by large-scale experimental facilities, and machine learning focuses on the identification of patterns, trends and anomalies to extract meaningful scientific insights from the data. In upcoming experimental facilities, such as the Extreme Photonics Application Centre (EPAC) in the UK or the international Square Kilometre Array (SKA), the rate of data generation and the scale of data volumes will increasingly require the use of more automated data analysis. Furthermore, at present, identifying the most appropriate machine learning algorithm for the analysis of any given scientific dataset is a challenge due to the potential applicability of many different machine learning frameworks, computer architectures and machine learning models. Historically, for modelling and simulation on high-performance computing systems, these issues have been addressed through benchmarking computer applications, algorithms and architectures. Extending such a benchmarking approach and identifying metrics for the application of machine learning methods to open, curated scientific datasets is a new challenge for both scientists and computer scientists. Here, we introduce the concept of machine learning benchmarks for science and review existing approaches. As an example, we describe the SciMLBench suite of scientific machine learning benchmarks.

42 ENGINEERING↗

Monte Carlo neutronics benchmarks on nuclear fuel depletion: A review

Monte Carlo (MC) neutronics codes are used widely for academic and industrial needs. Several schemes of coupling MC neutronics code with isotope generation and depletion code exist, which are used for performing nuclear fuel depletion simulations. These simulations can estimate the inventory of isotopes in neutron irradiated nuclear reactor fuel. However, the accuracy of these simulations shall be validated through experiments. MC codes are seldom validated by isotopic benchmarks compared to criticality benchmarks. This work compiles and analyzes the fuel depletion benchmarks and validations used to analyze the performance of MC-based fuel depletion neutronics codes. Analyses of these benchmarks and validations showed that the computed concentrations of 133 Cs, 135 Cs, 137 Cs, 148 Nd, 239 Pu, 240 Pu, and 241 Pu in the irradiated fuel by the depletion codes agreed with the measured values within 10% error. However, the computed concentrations of 125 Sb, 242 Cm, 243 Cm, 244 Cm, 245 Cm, and 246 Cm had errors more than 15% compared to the measured values. As a result, Ventina depletion code showed the most accurate predictions for the greatest number of isotope concentrations compared to ORIGEN2 and CINDER90.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A general spatial-temporal framework for short-term building temperature forecasting at arbitrary locations with crowdsourcing weather data

Weather forecasting has been a critical component to predict and control building energy consumption for better building energy management. Without accessibility to other data sources, the onsite observed temperatures or the airport temperatures are used in forecast models. In this paper, we present a novel approach by utilizing the crowdsourcing weather data from neighboring personal weather stations (PWS) to improve the weather forecast accuracy around buildings using a general spatial-temporal modeling framework. The final forecast is based on the ensemble of local forecasts for the target location using neighboring PWSs. Our approach is distinguished from existing literature in various aspects. First, we leverage the crowdsourcing weather data from PWS in addition to public data sources. In this way, the data is at much finer time resolution (e.g., at 5-minute frequency) and spatial resolution (e.g., arbitrary location vs grid). Second, our proposed model incorporates spatial-temporal correlation information of weather variables between the target building and a set of neighboring PWSs so that underlying correlations can be effectively captured to improve forecasting performance. Here, we demonstrate the performance of the proposed framework by comparing to the benchmark models on temperature forecasting for a building located at an arbitrary location at San Antonio, Texas, USA. In general, the proposed model framework equipped with machine learning technique such as Random Forest can improve forecasting by 50% compares with persistent model and has 90% chance to outperform airport forecast in short-term forecasting. In a real-time setting, the proposed model framework can provide more accurate temperature forecasting results compared with using airport temperature forecast for most forecast horizon. Moreover, we analyze the sensitivity of model parameters to gain insights on how crowdsourcing data from the neighboring personal weather stations impacts forecasting performance. Finally, we implement our model in other cities such as Syracuse and Chicago to test the model's performance in different landforms and climate types.

54 ENVIRONMENTAL SCIENCES↗

Status of the KRUSTY Benchmark Modeling and Uncertainty Analysis

The U.S. National Aeronautics and Space Administration’s (NASA) desire for a small nuclear reactor for space applications led to a prototype assembly, Kilopower Reactor Using Stirling Technology (KRUSTY). The KRUSTY experiments included four phases: component critical, cold critical, warm critical, and high temperature. The KRUSTY benchmark described in this paper includes five configurations from the component critical experiments that were performed at the National Criticality Experiments Research Center (NCERC) beginning in November 2017. Preliminary results have been reported. The benchmark is now nearing completion (although it is still preliminary until formally accepted by the International Criticality Safety Benchmark Evaluation Project [ICSBEP] working group). In this paper, we present the updated benchmark and its uncertainties. These results were computed using MCNP6.2 ® with ENDF/B-VIII.0 cross sections.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Energy Intensity Baselining and Tracking Guidance

Each company joining the U.S. Department of Energy’s (DOE’s) Better Buildings, Better Plants Program (Better Plants) commits to establishing an energy consumption and energy intensity (EI) baseline and to tracking its energy performance over a 10-year period against that baseline. The baseline must reflect a company’s energy consumption over a 12-month period, covering all its U.S.-based operations. Energy consumption is calculated by fuel type in terms of primary energy (also known as source energy). EI is broadly defined as the amount of energy consumed per unit of output produced. For this guidance document and for the program, the term energy performance represents an evaluation of a facility’s capacity to use energy efficiently. Metrics used to assess a facility’s energy performance can include EI, energy consumption, improvements in EI, etc. Establishing an energy baseline and tracking system is a critical first step in effectively managing energy use. Developing a baseline can help a company understand energy use within the corporation and give it a point of comparison to evaluate future efforts to improve energy performance. It can also support efforts to validate a company’s energy management activities, improve comparative analyses when using benchmarks, and help in predicting future energy needs. In addition, a company that normalizes its performance data can determine highly defensible measures of energy savings generated through implemented energy efficiency projects. Establishing a baseline and tracking energy performance is also a requirement for ISO 50001 certification. Although basic energy data can be collected through utility bills, most manufacturers will have to perform additional analyses to develop accurate and robust energy baselines and tracking systems. Energy is consumed in many ways within the manufacturing sector and can come from multiple sources. Energy is sometimes generated and sold to other parties or captured and reused on-site. External events can exert a significant impact on a facility or company’s energy use independent of any purposeful efforts to improve energy efficiency. Operational changes, such as production shifts—which may be inevitable for some companies over the 10-year period covered by the program—can also make a big difference in energy use. Since Better Plants asks companies to account for all their U.S.-based operations, mergers, acquisitions, and divestitures can also have significant implications for a company’s energy metrics. This document aims to demystify the sometimes complex baselining process. It devotes special attention to the task of normalizing and adjusting energy consumption to account for external factors, such as weather and production changes. A key recommendation is that companies use regression analysis to normalize their energy consumption data whenever possible. Regression analysis is a statistical technique that estimates the dependence of a variable (i.e., energy use in the context of Better Plants) on one or more independent variables such as ambient temperature, while controlling for the influence of other variables at the same time. A properly developed regression analysis can provide a reliable estimate of energy savings resulting from energy improvement strategies and projects by accounting for the effects of variables such as annual production levels and weather. DOE has developed a companion Energy Performance Indicator software tool (EnPI) to simplify the baselining process. This tool can run regression models, calculate changes in EI at the facility level, and automatically compile facility-level data into a corporate-wide metric. Note that although the relevant equations used to calculate EI are provided in this document, the EnPI tool will automatically perform most calculations for the user. Additionally, Better Plants Partners (Partners) can call on their Technical Account Manager (TAM) to help them establish a baseline and assist with the necessary calculations to track progress.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Initial Delayed Critical Configuration of SHEBA I and Subcritical Measurements by Californium Source-Driven Noise Analysis

In September 1980, the initial delayed critical configuration of the Solution High-Energy Burst Assembly (SHEBA I) was assembled, and the US Department of Energy’s Oak Ridge National Laboratory (ORNL) staff performed near critical and subcritical measurements using the californium source-driven noise analysis (CSDNA) method at the Los Alamos National Laboratory (LANL) Critical Experiments Facility. An unreflected 56 cm outside diameter stainless-steel cylindrical tank was partially filled with uranyl fluoride solution (235U enrichment was 4.95 wt %) until delayed criticality was achieved. Then, measurements were performed for various fuel solution heights from delayed critical to 60% of the height required for delayed criticality. The stainless-steel tank had an inside diameter of 54.6 cm and a height of 105 cm and was partially (20–36.5 cm) filled with an aqueous solution of uranyl fluoride (with a density of 2.162 g/cm 3 ). The density of the uranium in solution was 1.042 g/cm 3 , and the solution had a H/U atomic ratio of 20.43. The tank had a 6.35 mm wall thickness and an axial reentrant tube with an inside diameter of 6.02 cm and wall thickness of 0.165 cm. The tank was essentially unreflected on the top and sides because it was in a thin metal shed. The reactivity of the near–delayed critical configuration was −10.4 cents, which corresponds to a k eff value of 0.99922. In addition to the CSDNA measurements, the prompt neutron decay constants were determined from break frequency noise analysis (BNFA) measurements. The subcritical neutron multiplication factors from CSDNA and BFNA compared extremely well. These data can be used as the basis of International Nuclear Criticality Safety Evaluation benchmark for the near-critical configuration, and the k eff values at various subcritical configurations can be used as subcritical benchmarks. Furthermore, the measured prompt neutron decay constants can be used as reactor physics benchmarks. This report documents the experimental information for the measurements performed so that, at a later date, researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Criticality Safety Benchmark Evaluation Program (ICSBEP) or Nuclear Energy Agency benchmarks. The measured prompt neutron decay constants can be used as the basis of a benchmark for the International Reactor Physics Evaluation Program (IRPhEP). The data from these measurements are available from the ORNL Records Management Services Department, and the logbook is available from ICSBEP at Idaho National Laboratory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Benchmarking Smart Thermostats

Our goal is to compute a set of key performance indicators for commercially available smart thermostats using building energy simulation. If successful, the resulting tool will enable EPA ENERGY STAR and other rating/incentive programs to objectively evaluate new thermostat products.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

Partnership Center for High-Fidelity Boundary Plasma Simulation (Final Report)

Within the Partnership Center for High-Fidelity Boundary Plasma Simulation (HBPS), work at UT-Austin was aimed at improved verification, validation, and uncertainty quantification (VVUQ) for edge plasma simulations and on performing gyrokinetics simulations of pedestal instabilities and turbulence in order to expand foundational understanding of pedestal transport. Regarding VVUQ, the accomplishments can be summarized as follows. First, it was shown that the Moment Preserving Constrained Resampling technique, when applied periodically in particle-in-cell simulations in the XGC code, can dramatically improve the accuracy of the simulation at essentially equivalent computational cost. Second, a technique for estimating model correlations, which are required to solve the model selection and sample allocation problem in multifidelity UQ techniques, without sampling the highest fidelity, most computationally expensive model, was developed and demonstrated. Third, previously developed methods for estimating statistical and discretization errors were applied to numerical methods relevant to edge plasma simulations, namely in particle-in-cell-based approaches, and shown to work. Finally, benchmark studies for comparing gyrokinetic codes were developed and performed, leading to reasonable agreement between four commonly used codes. Regarding physics studies, gyrokinetic simulations to investigate microtearing modes in the DIII-D pedestal were performed using the GENE code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Compare predictions of transient fission gas release by empirical and mechanistic models to experiments in high burnup UO 2 fuel

Understanding and predicting fuel performance at high burnup require improving our understanding of transient fission gas release. High-burnup operations enable new mechanisms of fission gas release, which affect fuel performance. The Nuclear Regulatory Commission has recently published its interpretation of existing fuel fragmentation, relocation, and dispersal data in a research information letter. There, transient fission gas release was identified as one of the main factors that contributes to fuel fragmentation, relocation, and dispersal, and therefore limits fuel extension to high burnup. However, transient fission gas release is a complex phenomenon that cannot be fully described by simple empirical descriptions. This report summarizes the development of a mechanistic model for high-burnup transient fission gas release in the fuel performance code BISON. This research was supported by the Nuclear Energy Advanced Modeling and Simulation program during fiscal year 2023 to improve our understanding of high-burnup transient fission gas release and ability to predict it as a function of operation history. To support the development of a mechanistic transient fission gas release model, the existing Simple Integrated Fission Gas Release and Swelling (Sifgrs) model in BISON has been completely refactored to make it more modular and extensible. This effort supports the model's application to high-burnup conditions, its extension to other fuel forms, and the continuous improvement of its current features. Once refactoring was completed, models for high-burnup structure formation, fission gas transfer from non-restructured fuel to high-burnup structure, high-burnup structure intragranular and intergranular fission gas behavior, high-burnup structure bubble evolution, fuel pulverization, and the resulting transient fission gas release were tested and implemented in the Simple Integrated Fission Gas Release and Swelling (Sifgrs) model or tightly coupled to it. The new mechanistic model was then compared to an empirical model developed in parallel by a Nuclear Energy University Program project using a Studsvik high-burnup loss-of-coolant-accident assessment case. Finally, the report details the preliminary BISON results for a benchmark activity organized by the Nuclear Energy Agency to evaluate fuel performance codes' predictive capabilities for burst fission gas release. This work represents an important step toward a mechanistic understanding of fission gas release in high-burnup conditions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Improving Seasonal Forecast Using Probabilistic Deep Learning

The path toward realizing the potential of seasonal forecasting and its socioeconomic benefits relies on improving general circulation model (GCM) based dynamical forecast systems. To improve dynamical seasonal forecasts, it is crucial to set up forecast benchmarks, and clarify forecast limitations posed by model initialization errors, formulation deficiencies, and internal climate variability. With huge costs in generating large forecast ensembles, and limited observations for forecast verification, the seasonal forecast benchmarking and diagnosing task proves challenging. Here, we develop a probabilistic deep learning-based statistical forecast methodology, drawing on a wealth of climate simulations to enhance seasonal forecast capability and forecast diagnosis. By explicitly modeling the internal climate variability and GCM formulation differences, the proposed Conditional Generative Forecasting (CGF) methodology enables bypassing crucial barriers in dynamical forecast, and offers a top-down viewpoint to examine how complicated GCMs encode the seasonal predictability information. We apply the CGF methodology for global seasonal forecast of precipitation and 2 m air temperature, based on a unique data set consisting 52,201 years of climate simulation. Results show that the CGF methodology can faithfully represent the seasonal predictability information encoded in GCMs. We successfully apply this learned relationship in real-world seasonal forecast, achieving competitive performance compared to dynamical forecasts. Using this CGF as benchmark, we reveal the impact of insufficient forecast spread sampling that limits the skill of the considered dynamical forecast system. Finally, we introduce different strategies for composing ensembles using the CGF methodology, highlighting the potential for leveraging the strengths of multiple GCMs to achieve advantgeous seasonal forecast.

54 ENVIRONMENTAL SCIENCES↗