Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗
DOE OSTI2025

DeepBench: A simulation package for physical benchmarking data

We introduce **DeepBench**, a python library that generates simple simulated image data from first principles, such as basic geometric shapes and astronomical objects. These data are highly valuable for developing (calibration, testing, and benchmarking) statistical and machine learning models because they make it possible to connect the final data product to physically interpretable inputs. This software includes tools to curate and store the datasets to maximize reproducibility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

High-Resolution Simulations of Geological CO 2 Injection: Application to the SPE11 Benchmark

Geological carbon sequestration (GCS) will play a critical role in decarbonization and in facilitating the transition to clean energy systems. Because CO 2 is highly mobile, ensuring its safe and permanent injection into subsurface geological formations involves monitoring over larger spatial domains and longer time periods than is typical for hydrocarbon reservoirs. This can benefit from simulation tools capable of modeling key CO 2 trapping mechanisms, particularly those optimized for speed and scalability on high-performance computing systems. Using isothermal versions of the SPE11B and SPE11C benchmark cases, we conduct a mesh refinement study simulating CO 2 injection into kilometer-scale rock formations at centimeter resolution with the GEOS open-source simulation framework. We focus on how mesh refinement improves the accuracy of convective mixing in both 2D and 3D simulations. The computational costs associated with achieving a converged solution highlight the need for predictive upscaling techniques. A systematic performance scaling analysis—including both central processing unit (CPU) and graphics processing unit (GPU) architectures—complements the “Results” section.

Geosciences↗
DOE OSTI2016

East Bay Area Benchmark Study

This report is a benchmarking studying for the Sandia Create Project provided by Cornerstone Project Management, Inc.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2016

The Benchmark Extensible Tractable Testbed Engineering Resource (BETTER)

The Benchmark Extensible Tractable Testbed Engineering Resource (BETTER) is proposed as a family of modular test bodies that are intended to support engineering capability development by helping to identify weaknesses and needs. Weapon systems, subassemblies, and components are often complex and difficult to test and analyze, resulting in low confidence and high uncertainties in experimental and simulated results. The complexities make it difficult to distinguish between inherent uncertainties and errors due to insufficient capabilities. BETTER test bodies will first use simplified geometries and materials such that testing, data collection, modeling and simulation can be accomplished with high confidence and low uncertainty. Modifications and combinations of simple and well-characterized BETTER test bodies can then be used to increase complexity in order to reproduce relevant mechanics and identify weaknesses. BETTER can provide both immediate and long-term improvements in testing and simulation capabilities. This document presents the motivation, concept, benefits and examples for BETTER.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2016

U.S. Solar Photovoltaic System Cost Benchmark: Q1 2016

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems built in the first quarter of 2016 (Q1 2016). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗
DOE OSTI2016

Engine Benchmarking - Final CRADA Report

Detailed benchmarking of the powertrains of three light-duty vehicles was performed. Results were presented and provided to CRADA partners. The vehicles included a MY2011 Audi A4, a MY2012 Mini Cooper and a MY2014 Nissan Versa.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2017

Benchmarking transition energies and emission strengths for X-ray astrophysics with measurements at the Livermore EBITs

K-shell transitions in astrophysically abundant metals and L-shell transitions in Fe group elements show characteristic signatures in the soft X-ray spectrum in the energy range 0.1–10 keV. These signatures have great diagnostic value for plasma parameters such as electron and ion temperatures and densities, and can thus help understand the physics controlling the energetic processes in astrophysical sources. This diagnostic power increases with advances in spectral resolution and effective area of the employed X-ray observatories. However, to make optimal use of the diagnostic potential – whether through global spectral modeling or through diagnostics from local modeling of individual lines – the underlying atomic physics has to be complete and well known. With the next generation of soft X-ray observatories featuring micro-calorimeters such as the SXS on Astro- H/Hitomi and the X-IFU on Athena, broadband high-resolution spectroscopy with large effective area will become more commonly available in the next decade. With these spectrometers, the accuracy of the plasma parameters derived from spectral modeling will be limited by the uncertainty of the reference atomic data rather than by instrumental factors, as is sometimes already the case for the high-resolution grating observations with Chandra-HETG and XMM-Newton-RGS. To take full advantage of the measured spectra, assessment of the accuracy of and improvements to the available atomic reference data are therefore important. Dedicated measurements in the laboratory are essential to benchmark the theoretical calculations providing the bulk of the reference data used in astrophysics. Experiments at the Lawrence Livermore National Laboratory electron beam ion traps (EBIT-I and SuperEBIT) have a long history of providing this service. In this work, I present new measurements of transition energies and absolute electron impact excitation cross sections geared towards currently open atomic physics data needs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2017

Benchmarking of DFLAW Solid Secondary Wastes and Processes with UK/Europe Counterparts

This report provides information and background on UK solid wastes and waste processes that are similar to those which will be generated by the Direct-Feed Low Activity Waste (DFLAW) facilities at Hanford. The aim is to further improve the design case for stabilizing and immobilizing of solid secondary wastes, establish international benchmarking and review possibilities for innovation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

BIGHORN Computational Fluid Dynamics Theory, Methodology, and Code Verification & Validation Benchmark Problems

This document presents the theoretical background for a hybrid finite-element / finite-volume fluid flow solver, namely BIGHORN, based on the Multiphysics Object Oriented Simulation Environment (MOOSE) computational framework developed at the Idaho National Laboratory (INL). An overview of the numerical methods used in BIGHORN are discussed and followed by a presentation of the formulation details. The document begins with the governing equations for the compressible fluid flow, with an outline of the requisite constitutive relations. A second-order finite volume method used for solving the compressible fluid flow problems is presented next. A Pressure-Corrected Implicit Continuous-fluid Eulerian (PCICE) formulation for time integration is also presented. The multi-fluid formulation is being developed. Although multi-fluid is not fully-developed, BIGHORN has been designed to handle multi-fluid problems. Due to the flexibility in the underlying MOOSE framework, BIGHORN is quite extensible, and can accommodate both multi-species and multi-phase formulations. This document also presents a suite of verification & validation benchmark test problems for BIGHORN. The intent for this suite of problems is to provide baseline comparison data that demonstrates the performance of the BIGHORN solution methods on problems that vary in complexity from laminar to turbulent flows. Wherever possible, some form of solution verification has been attempted to identify sensitivities in the solution methods, and suggest best practices when using BIGHORN.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

L2 Milestone: Neutron Capture Cross Sections from Surrogate (p, d) Measurements: Determination of the Unknown 87 Y(n, g) Cross Section and Assessment of the Method Via the 90 Zr(n, g) Benchmark Case: Theory Report

Cross sections for compound-nuclear reactions involving unstable targets are important for many applications, but can often not be measured directly. Here we describe a method for extracting cross sections for neutron-capture on unstable isotopes from indirect (surrogate) measurements. The surrogate reaction, which produces the compound nucleus of interest, has to be described and the decay of the nucleus has to be modeled. We outline the approach for one-neutron pickup and report on the determination of the 90 Zr(n, γ ) reaction from surrogate 92 Zr(p,d) data, which is compared to the directly-measured capture cross section and thus provides a benchmark for the method. We then apply the method to determine the 87 Y(n, γ ) cross section, which has not been measured directly. The work was carried out in the context of an LLNL L2 Milestone. This report addresses the theory aspects of the milestone. A complementary document summarizes the experimental efforts [1].

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

Evaluation of U.S. Building Energy Benchmarking and Transparency Programs: Attributes, Impacts, and Best Practices

In the last decade, a new policy area has emerged to boost energy efficiency in buildings that focuses on the simple action of measuring energy use as compared to buildings of similar type and size, and making that data publicly available. These efforts, referred to as benchmarking and transparency (B&T) policies, seek to unlock new energy efficiency opportunities in the country’s existing buildings by promoting data-driven decision-making and creating stronger market signals. This report focuses on the 24 state and local jurisdictions that (as of December 31, 2016) require owners of privately owned commercial buildings, multifamily buildings, or both to comply with a B&T policy. The report provides a summary of U.S. B&T policy design and implementation characteristics, reports results and impacts for jurisdictions with B&T policies, and discusses opportunities for increasing the efficacy of B&T policies, as well as suggested areas for further research. Among the findings, all but one of the B&T policy evaluation studies reviewed indicate some reduction (from 1.6% to 14%) in energy use, energy costs, or energy intensity over the two- to four-year period of the analyses. More specifically, most of the studies reviewed indicate 3% to 8% reductions in gross energy consumption or energy use intensity over a two- to four-year period of B&T policy implementation. Two additional evaluation studies indicate that there is a causal relationship between B&T policies and energy savings or energy cost savings. These documented impacts should be reviewed with some caution. While consistently showing energy savings benefits associated with B&T policies, these savings estimates should be considered preliminary because of the limited period of analyses and inconsistencies in analysis methods for the various studies. A nationally standardized method for data collection, reporting, and evaluation of B&T policies—developed with an advisory group of state and local jurisdictions, energy efficiency and evaluation experts, building owner and real estate associations, and other stakeholders—could improve the consistency and quality of B&T impact studies, providing policymakers and others with a more complete understanding of the present and future impacts of these policies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2017

Deploy Nalu/Kokkos algorithmic infrastructure with performance benchmarking.

The former Nalu interior heterogeneous algorithm design, which was originally designed to manage matrix assembly operations over all elemental topology types, has been modified to operate over homogeneous collections of mesh entities. This newly templated kernel design allows for removal of workset variable resize operations that were formerly required at each loop over a Sierra ToolKit (STK) bucket (nominally, 512 entities in size). Extensive usage of the Standard Template Library (STL) std::vector has been removed in favor of intrinsic Kokkos memory views. In this milestone effort, the transition to Kokkos as the underlying infrastructure to support performance and portability on many-core architectures has been deployed for key matrix algorithmic kernels. A unit-test driven design effort has developed a homogeneous entity algorithm that employs a team-based thread parallelism construct. The STK Single Instruction Multiple Data (SIMD) infrastructure is used to interleave data for improved vectorization. The collective algorithm design, which allows for concurrent threading and SIMD management, has been deployed for the core low-Mach element- based algorithm. Several tests to ascertain SIMD performance on Intel KNL and Haswell architectures have been carried out. The performance test matrix includes evaluation of both low- and higher-order methods. The higher-order low-Mach methodology builds on polynomial promotion of the core low-order control volume nite element method (CVFEM). Performance testing of the Kokkos-view/SIMD design indicates low-order matrix assembly kernel speed-up ranging between two and four times depending on mesh loading and node count. Better speedups are observed for higher-order meshes (currently only P=2 has been tested) especially on KNL. The increased workload per element on higher-order meshes bene ts from the wide SIMD width on KNL machines. Combining multiple threads with SIMD on KNL achieves a 4.6x speedup over the baseline, with assembly timings faster than that observed on Haswell architecture. The computational workload of higher-order meshes, therefore, seems ideally suited for the many-core architecture and justi es further exploration of higher-order on NGP platforms. A Trilinos/Tpetra-based multi-threaded GMRES preconditioned by symmetric Gauss Seidel (SGS) represents the core solver infrastructure for the low-Mach advection/diffusion implicit solves. The threaded solver stack has been tested on small problems on NREL's Peregrine system using the newly developed and deployed Kokkos-view/SIMD kernels. fforts are underway to deploy the Tpetra-based solver stack on NERSC Cori system to benchmark its performance at scale on KNL machines.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Development of a LOCA Experimental Benchmark for BISON - Milestone L2:FMC.P15.08

Since 2013 CASL has been planning and working towards a PWR LOCA Challenge Problem. Since BISON is the CASL fuel rod simulation platform, it plays a central role in that activity. The goal of the FY-17 CASL milestone reported here was to develop an Experimental Benchmark for LOCA analysis using BISON. Activities encompassed both code development and validation. This report provides a current snapshot of BISON’s capability for LOCA behavior including: 1) a summary of code extensions to facilitate accident analysis, 2) a series of separate effects tests, and 3) initial code validation to complex integral rod LOCA behavior. Conclusions from each of these main activities are summarized below. The key material and behavior models required to address transient high-temperature phenomena occurring during LOCAs in a standard PWR have now been implemented in BISON. These apply specifically to UO2 fuel, Zircaloy cladding and water coolant. During FY-17 important new capability to address axial UO2 fuel relocation (for 1.5D geometry) and account for oxidation energy deposition in cladding, were included. Planned future development efforts include extending the axial fuel relocation model from 1.5D to 2D/3D and improving BISON’s fission gas release model to include transient gas release associated with the high burnup structure (HBS) in high burnup fuel. Additionally, investigation of potential anisotropic creep behavior in Zircaloy cladding is planned, assuming sufficient experimental data are available to support this effort. A substantial number of separate effects validation cases (42 tests from 3 experimental series) have been completed to compare BISON predictions to measured ballooning and burst behavior for Zircaloy cladding. Such experiments include a wide variety of pressures, temperatures and loading rates. In general, BISON predictions of burst temperature, pressure and burst time are very reasonable. For one experimental series, however, involving both very high temperatures and strain rates, BISON systematically over-predicts the cladding hoop strain. Investigation of this discrepancy is an important and planned activity. With another experiment an effort was made to investigate 3D cladding response due to an azimuthal temperature variation. Results indicated 3D effects are potentially important in fuel rod analysis during LOCAs and will be further investigated in the future. BISON validation to a series of integral fuel rod experiments has also been completed. These experiments involve all fuel and cladding phenomena relevant to LOCA conditions, and can include complexities associated with irradiated fuel relative to fresh fuel. Such experiments also generally include complex thermal-hydraulic boundary conditions. Four experiments (6 rods) have been considered to date including simulated fuel (ZrO2) and both fresh and high-burnup UO2. Test rods ranged from rodlets to full length commercial PWR fuel rods. As with the separate effects experiments, BISON predictions of burst temperature, pressure and burst time are generally very reasonable. Comparisons to cladding peak strain and rod outer diameter axial profiles are less satisfactory, and identify material models and possibly modeling approximations (e.g., 2D-RZ vs 3D geometries) requiring additional investigation. Validation of BISON for integral rod LOCA behavior is by no means complete, with additional cases planned.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2018

AGR-1 Depletion Benchmark

The AGR-1 TRISO particle irradiation test was the first Advanced Gas Reactor test irradiated in the Advanced Test Reactor (ATR) at the Idaho National Laboratory. The TRISO particle fuel was 350 μm diameter uranium oxy-carbide (UCO) kernels enriched to 19.75 wt% U-235. The particles were embedded in cylindrical graphite compacts, placed in test capsules, and irradiated over a period of three years or 13 ATR power cycles. The fuel compacts achieved burnups approaching 20% FIMA and accumulated fast fluence up to 4.25E+25 n/m 2 (E n >0.18 MeV). This report describes the AGR-1 test train, capsules, compacts, and TRISO particle fuel in sufficient detail for a physics analyst to model the AGR-1 experiment as part of a larger ATR neutron transport model and perform a depletion calculation. The intent of the data herein is to define a practical numerical TRISO particle depletion benchmark problem for the AGR 1 irradiation test.

42 ENGINEERING↗
DOE OSTI2018

2018 U.S. Utility-Scale Photovoltaics-Plus-Energy Storage System Costs Benchmark

Market growth for utility-scale photovoltaic (PV) systems has been rapid for several years. Today, with the cost reductions of energy storage technologies, the combining PV and energy storage has become feasible and beneficial, especially for the areas that have only PV standalone systems and need to shift the peak load to meet electricity demand in the evening. Overall, utility-scale PV plus energy storage systems can provide dispatchable energy and reliable capacity. This study details cost factors, including labor costs, material costs, overhead, and permitting costs using a system-level bottom-up cost modeling approach. We use this model to benchmark PV-plus-storage installation system cost and identify the cost difference for AC- and DC-coupled systems and duration variation. Finally, we assess the cost reduction opportunities of colocating PV systems with energy storage systems in order to indicate the possible economic impacts of the PV-plus-storage configuration and help future research and development (R&D) effects in the context of U.S. energy storage policymaking.

14 SOLAR ENERGY↗
DOE OSTI2018

U.S. Solar Photovoltaic System Cost Benchmark: Q1 2018

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems built in the first quarter of 2018 (Q1 2018). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗