Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “criticality benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A multi-scale time-series dataset with benchmark for machine learning in decarbonized energy grids

The electric grid is a key enabling infrastructure for the ambitious transition towards carbon neutrality as we grapple with climate change. With deepening penetration of renewable resources, the reliable operation of the electric grid becomes increasingly challenging. In this paper, we present PSML, a first-of-its-kind open-access multi-scale time-series dataset, to aid in the development of data-driven machine learning (ML)-based approaches towards reliable operation of future electric grids. The dataset is synthesized from a joint transmission and distribution electric grid to capture the increasingly important interactions and uncertainties of the grid dynamics, containing power, voltage and current measurements over multiple spatio-temporal scales. Using PSML, we provide state-of-the-art ML benchmarks on three challenging use cases of critical importance to achieve: (i) early detection, accurate classification and localization of dynamic disturbances; (ii) robust hierarchical forecasting of load and renewable energy; and (iii) realistic synthetic generation of physical-law-constrained measurements. We envision that this dataset will provide use-inspired ML research in safety-critical systems, while simultaneously enabling ML researchers to contribute towards decarbonization of energy sectors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Direct visualization of polaron formation in the thermoelectric SnSe

SnSe is a layered material that currently holds the record for bulk thermoelectric efficiency. The primary determinant of this high efficiency is thought to be the anomalously low thermal conductivity resulting from strong anharmonic coupling within the phonon system. Here we show that the nature of the carrier system in SnSe is also determined by strong coupling to phonons by directly visualizing polaron formation in the material. We employ ultrafast electron diffraction and diffuse scattering to track the response of phonons in both momentum and time to the photodoping of free carriers across the bandgap, observing the bimodal and anisotropic lattice distortions that drive carrier localization. Relatively large (18.7 Å), quasi-one-dimensional (1D) polarons are formed on the 300-fs timescale with smaller (4.2 Å) 3D polarons taking an order of magnitude longer (4 ps) to form. This difference appears to be a consequence of the profoundly anisotropic electron–phonon coupling in SnSe, with strong Fröhlich coupling only to zone-center polar optical phonons. These results demonstrate a high density of polarons in SnSe at optimal doping levels. Strong electron-phonon coupling is critical to the thermoelectric performance of this benchmark material and, potentially, high performance thermoelectrics more generally.

36 MATERIALS SCIENCE↗
NASA NTRS2020

Results of the KRUSTY Warm Critical Experiments

The Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototypic nuclear-powered test of a 5-kW(thermal) Kilopower space reactor. This paper presents results from the KRUSTY warm critical experiments, which were completed prior to the final system test. The first set of criticals comprised cold or zero-power criticals; i.e., the core was not heated by fission power. These were followed by three warm criticals, where fission power heated the core to 200°C, 300°C, and 450°C, respectively. These criticals provided the data, confidence, and regulatory framework that were needed to proceed with the KRUSTY nuclear system test. The criticals also provided valuable data for the benchmarking of codes applicable to all nuclear systems. Finally, a comparison of KRUSTY results to pretest predictions is provided, and overall, the models matched the experimental results very closely.

David I. Poston↗
DOE OSTI2024

Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods

The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Updates to the n+ 63,65 Cu Evaluations in the Resolved Resonance Region [Slides]

This presentation discusses the motivation and background of the n+ 63,65 Cu Evaluations in the Resolved Resonance Region which is to study the interaction of neutrons with copper as it is important in nuclear applications since critical assembly configurations include metallic copper as reflector. In support to the U.S. Department of Energy (DOE) Nuclear Criticality Safety Program (NCSP), measurements and related evaluations of 63,65 Cu isotopes were selected to improve the agreement with the benchmarks and to assess the importance of the angular distribution data for reactor calculations. Previous and current evaluation work is supported by an experimental campaign initiated before 2010, the 63,65 Cu R-matrix analysis generated resonance parameters up to 300 keV. However, due to outstanding issues in the benchmark performance, ENDF/B-VIII.0 library released a truncated set of resonance parameters up to 100 keV. The goal of this work is to generate an updated set of resonance parameters in the 100-300 keV range to improve the benchmark performance of 63,65 Cu isotopes. In conclusion, R-matrix analysis to update 63,65 Cu evaluations was performed to simultaneously improve benchmark performance and extend the RRR to 300 keV. The benchmark calculations suggest the increased capture cross sections are beneficial, however, further investigation of the measured capture data is needed to understand the large normalization scaling factor needed to improve the reactivity. Also, the copper-reflected benchmarks indicate the need to further investigate angular distributions and extension of RRR to 300 keV is aided well by level statistics considerations. Work to refine the fit of individual resonances is ongoing.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2026

A curated benchmark for cofolding models on kinase conformational states

Abstract Protein kinases are critical drug targets, requiring therapeutics that can modulate their active and inactive conformational states. While cofolding models can generate global folds directly from kinase sequences and ligand SMILES strings, these models have not yet been tested on their ability to recover ligand-induced-fit conformational states of the kinase proteins. Here, we introduce KinConfBench, a curated benchmark of 2225 high-quality human kinase chains to evaluate the ability of four state-of-the-art cofolding models—Boltz-2, Chai-1, Protenix, and RoseTTAFold-All-Atom—to recover both canonical and rare conformational states. We show that geometric success metrics of a ligand pose in the active site do not correlate strongly with the correct kinase conformational state, motivating a new set of dynamical benchmarks for assessing cofolding models. While all four cofolding models achieve ~60–80% prediction accuracy for kinase conformational classification, they exhibit severe mode collapse when performing multiple inferences, show negligible structural diversity in sampling induced-fit motions, and display a prevalent “apo-drift” in which most cofolding models predominantly predict the kinase to be in its ligand-free state. Our results highlight that capturing ligand-induced protein conformational diversity, not just geometric fit, is critical for next-generation structure-based drug discovery.

Sun, Kunyang↗
DOE OSTI2021

An Analytic Benchmark for Neutron Boltzmann Transport with Downscattering—Part I: Flux and Eigenvalue Solutions

Computing in the energy dimension is one of the greatest challenges confronting present-day deterministic neutron transport solvers. Accurately resolving the neutron flux as neutrons downscatter across resonances in the nuclear cross sections currently requires considerable computing power and suffers from approximation errors. Flux uncertainty resulting from the uncertainty of the resonance structure is the single-largest cause of reactivity uncertainty. Any additional reference solution for the critical neutron downscattering problem with resonance phenomena would be a boon to verification and validation of neutronics codes. This paper establishes a benchmark to verify the accuracy of neutron transport criticality solvers along the energy dimension. For the first time, the analytic solution of the flux amplitude is derived in the particular case of an infinite homogeneous medium with isotropic scattering in the center of mass and an arbitrary number of no-threshold, neutral particle reaction resonances (e.g., radiative capture, fission, and resonance scattering). Furthermore, original analytic expressions are established to quantify the discrepancy between the ψ k (E) and ψ α (E) flux amplitudes, respective solutions of the multiplication factor k, or the exponential time-evolution frequency α eigenproblems. The physical study of these relations led to analysis of their first-order relative difference near the criticality condition α=0. Finally, numerical solutions are provided to a benchmark problem constituted of the first resonance of 239 Pu, the 6.67-eV resonance of 238 U, and a scattering isotope with a flat cross section, allowing for the computational verification of the energy resolution of current neutron transport criticality codes. Through these novel results, this analytic benchmark can serve as a reference to verify the energy resolution and sensitivity analysis of neutron transport criticality calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

The Surface-Topography Challenge: A Multi-Laboratory Benchmark Study to Advance the Characterization of Topography

Surface performance is critically influenced by topography in virtually all real-world applications. The current standard practice is to describe topography using one of a few industry-standard parameters. The most commonly reported number is Ra, the average absolute deviation of the height from the mean line (at some, not necessarily known or specified, lateral length scale). However, other parameters, particularly those that are scale-dependent, influence surface and interfacial properties; for example the local surface slope is critical for visual appearance, friction, and wear. The present Surface-Topography Challenge was launched to raise awareness for the need of a multi-scale description, but also to assess the reliability of different metrology techniques. In the resulting international collaborative effort, 153 scientists and engineers from 64 research groups and companies across 20 countries characterized statistically equivalent samples from two different surfaces: a “rough” and a “smooth” surface. The results of the 2088 measurements constitute the most comprehensive surface description ever compiled. We find wide disagreement across measurements and techniques when the lateral scale of the measurement is ignored. Consensus is established through scale-dependent parameters while removing data that violates an established resolution criterion and deviates from the majority measurements at each length scale. Our findings suggest best practices for characterizing and specifying topography. The public release of the accumulated data and presented analyses enables global reuse for further scientific investigation and benchmarking.

42 ENGINEERING↗
DOE OSTI2025

Benchmark Gap Assessment for the Manufacturing of High-Assay Low-Enriched Uranium Fuels

This document develops basic critical conditions for spheres—moderated and unmoderated, as well as reflected and unreflected—in consideration of nuclear criticality safety of a potential fuel production facility producing high-assay low-enriched uranium (HALEU) fuel of several different types like tristructural-isotropic (TRISO), uranium metal and alloys, oxide and non-metallic forms. In addition to spherical arrangements, TRISO particle manufacturing process–specific equipment is modeled as it would be for the criticality safety analysis. The objective is to develop representative systems that can then be used for comparison with existing benchmarks. SCALE/TSUNAMI is used to assess the similarity index between these systems to assess validation gaps for possible fuel production applications of proposed advanced reactors. Several different fuel types were evaluated, including TRISO, uranium metal, uranium molybdenum, uranium zirconium, uranium dioxide, uranium nitride, uranium hydride, U-ZrH, and uranium chloride. This selection of fuel types covers a breadth of proposed reactor types, as well as intermediate steps in the production and fabrication of the fuel

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Nuclear Software Validation for 7% Enriched UO 2 Fuel Lattices

This analysis performs validation for the Virtual Environment for Reaction Application’s (VERA’s) neutronics codes MPACT and Shift against measured data from the Seven Percent Critical Experiment (7uPCX) at Sandia National Laboratory. The benchmarking supports the future application of VERA for analysis of high-assay low-enriched uranium (HALEU) fuel in commercial pressurized water reactors (PWRs). VERA demonstrates very good agreement with measured data, and the deterministic code MPACT also agrees very well with higher-fidelity stochastic methods KENO-VI and Shift in both total neutron flux and fission rate distribution comparisons. Despite some significant differences between the 7uPCX and existing commercial PWRs that challenge the neutron cross section data and transport solver methods used by MPACT, all of the results are excellent. The agreement increases the confidence in the applicability and accuracy of VERA for reactor analysis of HALEU fuels in commercial reactors.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Coupling SCALE with DAKOTA for Axial Burnup Profiles Assessment in Burnup Credit

This paper presents a computational study that demonstrates the application of the SCALE code system in conjunction with the Design Analysis Kit for Optimization and Terascale Applications (DAKOTA) for the analysis of key factors influencing the evaluation of burnup credit (BUC) in pressurized water reactors (PWRs). The primary objective of this analysis is to characterize the model by utilizing parameterization, uncertainty quantification, and optimization studies. Using this approach, we can comprehensively assess the system and conduct informed predictive studies. This study highlights the effectiveness of the SCALE code system integrated within the DAKOTA framework in terms of efficiency and capability. With the coupling of the burnup code ORIGAMI with the CSAS or TSUNAMI-3D sequence embedded in a DAKOTA analysis, we can characterize the factors that influence the k eff of PWR 17x17 spent nuclear fuel (SNF) in the GBC-32 computational benchmark cask for the assessment of BUC in criticality safety analysis. The coupling methodology used in this study is not exclusive to BUC analysis. However, the choice to apply this methodology to the BUC problem is particularly significant because of the diverse range of aspects it encompasses in nuclear criticality safety analyses. This problem presents a unique opportunity to explore and address multiple facets of such analyses related to BUC and illustrates the capability of the SCALE code system with DAKOTA. This analysis makes use of historical reference data for the axial burnup profile, where the entire space within the bounds is considered. Both SCALE and DAKOTA are currently integrated in the Nuclear Energy Advanced Modeling Simulation (NEAMS) Workbench code system, which has a user-friendly graphical interface that simplifies the setup of simulations and configuration of input parameters as well as the visualization of simulation results.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

h5bench: A unified benchmark suite for evaluating HDF5 I/O performance on pre‐exascale platforms

Summary Parallel I/O is a critical technique for moving data between compute and storage subsystems of supercomputers. With massive amounts of data produced or consumed by compute nodes, high‐performant parallel I/O is essential. I/O benchmarks play an important role in this process; however, there is a scarcity of I/O benchmarks representative of current workloads on HPC systems. Toward creating representative I/O kernels from real‐world applications, we have created h5bench , a set of I/O kernels that exercise hierarchical data format version 5 (HDF5) I/O on parallel file systems in numerous dimensions. Our focus on HDF5 is due to the parallel I/O library's heavy usage in various scientific applications running on supercomputing systems. The various tests benchmarked in the h5bench suite include I/O operations (read and write), data locality (arrays of basic data types and arrays of structures), array dimensionality (one‐dimensional arrays, two‐dimensional meshes, three‐dimensional cubes), I/O modes (synchronous and asynchronous). In this paper, we present the observed performance of h5bench executed along several of these dimensions on existing supercomputers (Cori and Summit) and pre‐exascale platforms (Perlmutter, Theta, and Polaris). h5bench measurements can be used to identify performance bottlenecks and their root causes and evaluate I/O optimizations. As the I/O patterns of h5bench are diverse and capture the I/O behaviors of various HPC applications, this study will be helpful to the broader supercomputing and I/O community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Enhancing nuclear data validation analysis by using machine learning

In this work, we demonstrate how machine learning (ML) techniques can be used as an auxiliary tool for nuclear data validation analysis. The output of the ML analysis can inform evaluators and validators on the quality, or lack thereof, of specific nuclear data and benchmark experiments with respect to simulating these experimental benchmark values. To this end, measured and simulated effective neutron multiplication factors, k eff , of 875 selected ICSBEP critical assemblies and the latter's sensitivities with respect to nuclear data as well as benchmarks' features (e.g., material nuclide, core geometry) are used as input for a random forest (RF) regression model. The RF is used to encode the complex inter-dependencies between thousands of nuclear data features (i.e., sensitivity profiles and aspects describing the measurements) and 875 simulated and experimental k eff values in order to understand what nuclear data features are most informative for predicting bias. The complexity of relationships and high-dimensional space is difficult-to-impossible to search fully using simply expert judgment. As a first proof-of-concept—step, it is demonstrated that this technique is able to correctly trace large discrepancies between simulated and experimental k eff back to fabricated shortcomings in nuclear data that were perturbed to simulated k eff values. In a second, real-case scenario, step, the RF algorithm is used to validate the ENDF/B-VIII.0 library in comparison to ENDF/B-VII.1 nuclear data. One case is showcased where the chosen ML algorithms highlighted nuclear data (the 19 F(n,inl) cross section from 0.4–0.9 MeV) that are shown to be problematic by comparing them to associated differential experimental data and nuclear data from other libraries. In addition to that, it is shown that the RF results point towards poor benchmark experiments and associated underestimated uncertainties (e.g., the PU-SOL-THERM-028 series). However, using the RF algorithm for validating nuclear data with respect to k eff is currently limited to pinpointing groups of questionable nuclear data due to the inherent correlations between features introduced by the nuclear data themselves and how k eff is simulated. Due to this, we recommend that the ML methods presented be used to augment—rather than replace—the expert knowledge of evaluators and validators.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Scrutinizing Variables for Checkpoint Using Automatic Differentiation

Checkpoint/Restart (C/R) saves the running state of the programs periodically, which consumes considerable time and system resources. We observe that not every piece of data is involved in the computation in typical HPC applications; such unused data should be excluded from checkpointing for better storage and compute efficiency. We propose a systematic approach that leverages automatic differentiation (AD) to scrutinize every element within variables (e.g., arrays) necessary for checkpointing. This allows us to identify critical and uncritical elements and eliminate uncritical elements from checkpointing. Specifically, we inspect every single element within a variable necessary for checkpointing with an AD tool to determine whether the element has an impact on the application output or not. We validate our approach with all benchmarks from the NPB suite. We visualize the distribution of critical and uncritical elements within a variable with respect to its binary impact (yes or no) on the application output.

Huang, Xin [Kobe University]↗