Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

An Inventory of AI-ready Benchmark Data for US Fires, Heatwaves, and Droughts

Extreme weather events, including fires, heatwaves, and droughts, have significant impacts on earth, environmental, and energy systems. Mechanistic and predictive understanding, as well as probabilistic risk assessment of these extreme weather events, are crucial for detecting, planning for, and responding to these extremes. Records of extreme weather events provide an important data source for understanding present and future extremes, but the existing data needs preprocessing before it can be used for analysis. Moreover, there are many nonstandard metrics defining the levels of severity or impacts of extremes. In this study, we compile a comprehensive benchmark data inventory of extreme weather events, including fires, heatwaves, and droughts. The dataset covers the period from 2001 to 2020 with a daily temporal resolution and a spatial resolution of 0.5°×0.5° (~55km×55km) over the continental United States (CONUS), and a spatial resolution of 1km × 1km over the Pacific Northwest (PNW) region, together with the co-located and relevant meteorological variables. By exploring and summarizing the spatial and temporal patterns of these extremes in various forms of marginal, conditional, and joint probability distributions, we gain a better understanding of the characteristics of climate extremes. The resulting AI/ML-ready data products can be readily applied to ML-based research, fostering and encouraging AI/ML research in the field of extreme weather. This study can contribute significantly to the advancement of extreme weather research, aiding researchers, policymakers, and practitioners in developing improved preparedness and response strategies to protect communities and ecosystems from the adverse impacts of extreme weather events.

54 ENVIRONMENTAL SCIENCES↗

Validation of New MCNP6.3 Features for Critical and Subcritical Benchmark Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites was introduced. Here, we look at new optional features of the MCNP6.3 code. Then, Fission-matrix-based options with Convergence and population testing and Automated acceleration of the fission source and Doppler Broadening Resonance Correction and HDF5 Particle Track Output (PTRAC) and Validation benchmarks: criticality, Rossi-α, and subcritical multiplication. All the new MCNP6.3 options give statistically equivalent results and should be considered for default usage in criticality and subcritical multiplication calculation work. Discussed are two separate papers at the upcoming 2023 International Conference on Nuclear Criticality Safety (ICNC 2023) that give more details on the results presented here.

97 MATHEMATICS AND COMPUTING↗

Using Likwid and Byfl to Benchmark Hardware Performance [Poster]

Benchmark Study conducted focusing on CPU and program performance analysis. Performance data gathered using 2 different programs and comparisons made based on performance. After comparisons are made, conclusions can be drawn and improvements are made upon hardware and software.

97 MATHEMATICS AND COMPUTING↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Benchmark Analysis for the Optical Dilatometry Method Using Silicon Carbide Temperature Monitors

The main objective of this project was to conduct a benchmark analysis for the optical dilatometry method by using NSUF’s SiC temperature monitors: two (2) SiC temperature monitors provided by NSUF’s BSU-8242 experiment and two (2) SiC temperature monitors provided by NSUF’s GE-Hitachi experiment. Per the BSU-8242 experiment, KGT-3597 and KGT-3591 had a design temperature of 400°C and an exposure of 3 dpa. Per the GE-Hitachi experiment, KGT-3341 and KGT-3336 had a design temperature of 290°C +/- 50°C and an exposure of 0.5–1 dpa. The KGT-3336 SiC monitor was split into two pieces during the decontamination process, making the dilatometry method the only way to analyze both those pieces. The BSU-8242 monitors revealed peak irradiation temperatures under the design temperature, and the GE-Hitachi monitors revealed peak irradiation temperatures within the design temperature range. The optical dilatometry method measured the peak irradiation temperature of BSU-8242 KGT-3597 to be 330°C, while the resistivity method measured the peak irradiation temperature of BSU-8242 KGT-3591 to be 320°C +/- 20°C. The optical dilatometry method measured the peak irradiation temperatures of the pieces of GE-Hitachi KGT-3336 to be 260°C (for the larger piece) and 220°C (for the smaller piece), while the resistivity method measured the peak irradiation temperature of GE-Hitachi KGT-3341 to be 300°C, with an accuracy range of -50°C to +20°C. Both methods of SiC temperature monitor analysis produced very similar peak irradiation temperatures for each pair of SiC passive monitors from the two experiments, BSU-8242 and GE-Hitachi. The results show dilatometry method to be a reliable and less time-intensive process for determining irradiation temperatures from passive SiC thermometry.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Godiva 4 CAAS Shielding Benchmark: Pre CED-3A Overview [Slides]

Thiis presentation shows the character of an integral experiment. It covers the question why Godiva 4? Additionally, this presentation touches on the IER 498 benchmark quantity, activities facilitated by IER 498, proposed CED-2 test matrix, and what happened during the IER 498’s gap year.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

LLNL IPD Tasks: ICSBEP and Pulsed Spheres Benchmark [Slides]

This lecture presented benchmark of the blank and polyethylene spheres at SINBAD in April 2023. In responding to comments about the building, we uncovered a large amount of additional detailed information about the building and experimental set up. We incorporated this new information into an even higher fidelity model and are working on uncertainty analysis at a low level. Scheduled to present at SINBAD meeting in April 2024.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Benchmarking Advanced Water Splitting Technologies: Best Practices in Materials Characterization

The high-level project goal is to create a comprehensive Best Practices benchmarking framework at the materials, component, device and systems levels for advanced water splitting technologies. All advanced water splitting pathways covered under the HydroGEN Energy Materials Network (EMN) Consortium, which include advanced high and low temperature electrolysis of water, photoelectrochemical (PEC) water splitting and solar thermochemical hydrogen (STCH) need these best practices to advance materials discovery. These practices will also aid the H2@Scale DOE initiative to accomplish their goals of large-scale H2 production.

08 HYDROGEN↗

The Structural Evaluation Test Unit (SETU) Benchmark Problem Statement

A series of extensively instrumented tests was performed on the Structural Evaluation Test Unit in the early 1990s. The purpose of these tests was to determine the response of a minimally designed cask to impacts that were more severe than the design basis impact. This test series provides an excellent opportunity for benchmarking explicit dynamic finite element analysis programs for behaviors that may be experienced by casks during regulatory and extra-regulatory impact events. This report provides the parameters of the test unit, the locations of instrumentation, the locations of inspection points, and the parameters of the four tests that were conducted. A companion report provides the results of the tests.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Electrocatalyst Engineering and Device Benchmarking for Low Temperature CO2 Electrolysis

This oral presentation is for an invited talk in Division of Energy and Fuels, Symposium: "CO2 Conversion and Utilization-II: Electrochemical CO2 Conversion to Fuels and Valuable Chemicals" at ACS Spring 2025 (March 23-27, 2025) in San Diego, CA. The presentation will primarily discuss the crucial role of electrocatalyst design in the CO2 conversion to sustainable, carbon-neutral gas and liquid products. Some preliminary benchmarking studies of off-the-shelf electrocatalysts will be also shown in different device configurations to achieve good selectivity at industrially relevant current densities.

CO2 electrochemical reduction↗

Increased Fidelity and Associated Computational cost of Detailed Integral Experiment Benchmarks [Slides]

It does not seem like the system is significantly more sensitive to diameters of components near the center of the core. Intuitively it is, but was not detectable with simulations run to a Monte Carlo k eff uncertainty of 0.00002. The system is more sensitive to heights of components near the center of the core. Most (if not all) Zeus style benchmarks have perturbed core component heights individually.

42 ENGINEERING↗

Benchmark Gap Assessment for the Manufacturing of High-Assay Low-Enriched Uranium Fuels

This document develops basic critical conditions for spheres—moderated and unmoderated, as well as reflected and unreflected—in consideration of nuclear criticality safety of a potential fuel production facility producing high-assay low-enriched uranium (HALEU) fuel of several different types like tristructural-isotropic (TRISO), uranium metal and alloys, oxide and non-metallic forms. In addition to spherical arrangements, TRISO particle manufacturing process–specific equipment is modeled as it would be for the criticality safety analysis. The objective is to develop representative systems that can then be used for comparison with existing benchmarks. SCALE/TSUNAMI is used to assess the similarity index between these systems to assess validation gaps for possible fuel production applications of proposed advanced reactors. Several different fuel types were evaluated, including TRISO, uranium metal, uranium molybdenum, uranium zirconium, uranium dioxide, uranium nitride, uranium hydride, U-ZrH, and uranium chloride. This selection of fuel types covers a breadth of proposed reactor types, as well as intermediate steps in the production and fabrication of the fuel

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Benchmarking the Use of BPM Quadrupole Moments to Measure Emittance

For the PIP-II program, transverse emittance in the Fermilab Booster must remain well controlled at higher bunch intensities. 4-plate beam position monitors (BPMs) have a small but measurable quadrupole moment, making it possible to infer transverse emittance. By compositing many BPMs together, it becomes possible to improve the quality of the quadrupole signal. The Fermilab Booster BPM system has been used to measure these quadrupole moments in the past year and derive emittances from them. Recent benchmarks show that the derived BPM emittances show similar emittance evolution and value to IPM and Multiwire data. This approach can both supplement and complement existing non-intercepting emittance monitors in accelerators.

Balcewicz, Michael A. [Fermilab] (ORCID:0009000557↗

Benchmarking a Defeatured Geant4 NIF Model with HTOAD and HNED Neutron Data

This study benchmarks a simplified Geant4 NIF Target Chamber (TC) model against foil measurements in two instruments: the HTOAD and HNED Snout. The number of product atoms per source neutron per gram ( N 0 /n/g ) is compared across multiple locations and material configurations. The model reproduces high energy threshold reactions dominated by 14 MeV neutrons to within a few percent, depending on location. Discrepancies occur where scattering and moderation are significant for low energy threshold reactions. The defeatured Geant4 model achieves comparable statistical precision with ∼400 times less CPU time than a full fidelity TC model in MCNP. The results can be produced locally on a laptop without the need for high performance computing. Low energy biasing can be improved by preserving room return pathways and implementing IRDFF cross section evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Open Benchmark of One Million High-Fidelity Cislunar Trajectories

Cislunar space spans from geosynchronous altitudes to beyond the Moon and will underpin future exploration, science, and security operations. We describe and release an open dataset of one million numerically propagated cislunar trajectories generated with the open-source Space Situational Awareness Python package (SSAPy). The model includes high-degree Earth/Moon gravity, solar gravity, and Earth/Sun radiation pressure; other planetary gravities are omitted by design for computational efficiency. Initial conditions uniformly sample commonly used osculating-element ranges, and each trajectory is propagated for up to six years under a single, fixed start epoch. The dataset is intended as a reusable benchmark for method development (e.g., space domain awareness, navigation, and machine-learning pipelines), a reference library for statistical studies of orbit families, and a starting point for community-driven extensions (e.g., alternative epochs). We report empirically observed stability trends (e.g., a band near ~5 GEO and persistence of some co-orbital classes including L4/L5 librators) as dataset descriptors rather than new dynamical results. The chief contribution is the scale, fidelity, organization (CSV/HDF5 with full state time series and metadata), and open availability, which together lower the barrier to comparative and data-driven studies in the cislunar regime.

79 ASTRONOMY AND ASTROPHYSICS↗