Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “criticality benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Analysis of SCALE Criticality and Sensitivity Calculations for Reflected HEU Cylinders [Slides]

The SCALE code package offers multiple nuclear data libraries supporting Monte Carlo transport, with sensitivity and uncertainty methods derived from MC transport solutions. Several libraries are multigroup, which introduce bias differing by system. Previous work has shown poor S/U results in several reflector materials: ICSBEP benchmark HMF-084 was selected to analyze biases and S/U method applicability to a variety of reflectors. Prior and ongoing work found inaccuracies in CSAS and TSUNAMI results, which were further investigated utilizing the HEU-MET-FAST-084 ICSBEP critical benchmark, chosen for its geometrical simplicity and variety of reflector materials. Perturbation of reflector thickness across various reflector materials allowed for an assortment of materials is to be tested swiftly for each sequence and method. Observation was an increasing bias of MG $k_{eff}$ relative to CE, in both direction and magnitude. IFP produced extremely reliable results. >85% of CLUTCH cases were found satisfactory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Integral Experiment Execution (CED-3b Report)

This report documents the experimental configurations and measurements for IER-518: Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Experiments. These measurements involved a series of subcritical configurations at the Sandia Critical Experiments (SCX) facility at Sandia National Laboratories (SNL). The purpose of these measurements was to produce time tagged neutron count data of configurations that exceed a subcritical multiplication of 20, which is the high end of the fundamental physics benchmarks currently available in the International Criticality Safety Benchmark Evaluation Project Handbook (ICSBEP). These measurements leverage experimental configurations 1 and detector systems 2 from previously accepted ICSBEP benchmark evaluations, allowing evaluations of these measurements to be performed at greatly reduced cost.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRSDate not supplied

Composite Progressive Delamination Analysis of Thin Ply Buckling

The NASA Advanced Composites Project is a multi-year consortium of government, industry and academia to develop and validate technology that will reduce development and certification of advanced composite materials for aircraft structures. One of its tasks is to simulate and predict composite damage progression accurately through high fidelity finite element models. It included a subtask to verify an approach based on the Virtual Crack Closure Technology (VCCT) as well as Floating Node Method (FNM). This paper discusses predicted damage onset and growth in a thin-ply buckling problem. Sensitivity of the simulations to various initial crack length is studied. The compressive load-displacement curves are plotted and the crack growth critical load is predicted. Overall, the crack progression follows simulation benchmarks well. However, the critical-load overshoot phenomenon is observed in both VCCT and FNM, suggesting further investigation may be worth pursuing.

damage progression↗
DOE OSTI2023

Future of the MUSiC Experiment Data

The Measurements of Uranium Subcritical and Critical (MUSiC) experiment was a highly enriched uranium (HEU) experiment performed at the National Criticality Experiments Research Center (NCERC) executed between December 2020 and April 2021. The experiment intended to measure criticality and reactor kinetics parameters in a bare HEU system. The experiment concurrently measured radiation signatures from the system while utilizing different neutron source types. This was an attempt to benchmark both detectors and analysis techniques against one another for identical measurements. The experiment consisted of the Rocky Flats HEU hemi-shells constructed into ten configurations spanning between deeply subcritical (about 14 kgs) to supercritical (about 60 kgs). Two of the ten configurations were supercritical and the other eight were subcritical. The two supercritical configurations, often referred to as the critical configurations, were documented into an International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmark evaluation and submitted to the technical review group (TRG). The subcritical configurations of the MUSiC experiment were examined using three different detection systems. The systems include: the NoMAD He-3 neutron detector which consists of 15 He-3 tubes surrounded by a polyethylene matrix, a liquid scintillator system called the Rossi-α Measurement Rapid Organic Discriminating Detector (RAM-RODD), and a trans-stilbene organic scintillator array (OSCAR) provided by the University of Michigan. The NoMAD and RAM-RODD data are planned to be evaluated in two separate ICSBEP evaluations utilizing neutron noise methods such as Feynman Variance-to-Mean, Rossi-α and the pulsed neutron source method. Each of the subcritical configurations were examined using three different source types including: a Cf-252 source in the center, with only the intrinsic neutron source in the HEU, and with an external D-T neutron generator.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Benchmarking Variables for Checkpointing in HPC Applications

Checkpoint/Restart (C/R) is a widely used fault tolerance mechanism in converged systems of cloud, edge, and HPC. However, users often rely on their experience to determine which variables to checkpoint, as there is currently no benchmark that can provide a reference. This can result in checkpointing redundant or even incorrect variables. To address this issue, we propose a benchmark suite that includes critical variables for checkpointing, which have been manually identified, and a method for identifying those critical variables, with 20 representative HPC applications. Our method involves analyzing data dependency between variables to identify critical variables analytically. We verify the identified variables' correctness with a widely used C/R library FTI by an ablation study. With our benchmark suite and data dependency analysis, HPC practitioners now have a reference for identifying checkpointing variables and better knowledge of what kind of variables to checkpoint.

Fu, Xiang↗
DOE OSTI2023

Outcomes of WPEC SG47 on "Use of Shielding Integral Benchmark Archive and Database for Nuclear Data Validation"

The Working Party on International Nuclear Data Evaluation Co-operation Subgroup 47 (WPECSG47) entitled "Use of Shielding Integral Benchmark Archive and Database for Nuclear Data Validation" was organised from 2019 and 2022 with the objectives to promote more systematic and wider use of shielding benchmark experiments in nuclear data (ND) and transport code validation and development, to provide feedback on the Shielding Integral Benchmark Archive and Database (SINBAD), and to promote its further development in coordination with the Expert Group on Physics of Reactor Systems (EGPRS). Altogether 9 meetings, the large majority (8) held remotely, were organised during the past 3 years to discuss the experience on the use of SINBAD, evaluation of new benchmarks and improvements to be contributed to the database which was severely neglected and lacking maintenance over the past ← 10+ years. Several proposals for new or updated benchmark evaluation were presented and discussed, such as FNG copper, LLNL pulsed spheres, CIAE iron sphere, KFK 1977 gamma measurements, Rez Fe sphere, ASPIS, ORNL Oxygen broomstick, TIARA and others. Complementing the database with new features was also discussed, for example providing the nuclear data sensitivity profiles more systematically would facilitate and better guide the use of data. Information on the geometry, (radiation source) and materials available in CAD format is expected to allow an easier and less error prone reference for computational model preparation and a potential input to CAD based workflows. Inputs for various transport codes and other benchmark data from participants have been shared via the NEA GitLab which could hopefully in the future evolve and form a bases for critically checked and validated benchmark data. Future development of SINBAD will be monitored by EGPRS and the newly created SINBAD Task Force.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Delayed Critical and Subcritical Experiments with Polyethylene Moderated Unreflected Thin 15 in. Diameter HEU Metal Plates

The thin ~15 in. diameter highly enriched uranium (HEU) metal plates were assembled to delayed criticality at the Oak Ridge Critical Experiments Facility (ORCEF) in 1969 with various thicknesses of polyethylene (varying from 1/16 to 2$\frac{3}{8}$ inches) between uranium metal plates. The average 235 U enrichment was 93.27 wt. %. These unreflected critical configurations contained 4$\frac{2}{3}$ to 20$\frac{5}{6}$ thin 15 in. diameter HEU metal plates (on loan from Los Alamos National Laboratory [LANL] and shipped to Oak Ridge National Laboratory [ORNL] on June 3, 1969). Depending on the thickness of polyethylene, the enriched uranium masses varying from 28,053 to 135,148 grams. Fractional plate sections consisted of the appropriate number of 60° pie sections. In addition to the measurement at delayed criticality, subcritical measurements were also performed by the inverse kinetic rod drop method. Prompt neutron decay constant measurements were also performed by the Rossi alpha and randomly pulsed neutron method using a time-tagged spontaneous fission californium neutron source; these are briefly reported here. At the time of these measurements in 1969, the thin HEU metal plates were in near-pristine condition with extremely little oxidation, allowing better descriptions of the uranium plates than the use of these plates in a heavily oxidized and deteriorated condition in recent reflected benchmark experiments at the LANL facility at the Nevada Test Site with these same thin highly enriched uranium metal plates. This report documents the experimental information for the measurements performed so that later researchers can perform the required uncertainty and calculational analyses and documentation to use these data for an International Nuclear Criticality Safety Benchmark Evaluation Program (ICSBEP) or a Nuclear Energy Agency (NEA) benchmark. Data from the experiments described should be acceptable for use as criticality safety benchmark experiments for the ICSBEP and the NEA nuclear criticality safety benchmark program once the uncertainty analysis on the measured neutron multiplication factors is completed. Additional data—such as the dimensional inspection reports, uranium isotopic information, and other relevant particulars—should be retrieved from the Y-12 Plant or LANL and incorporated in the final ICSBEP benchmark. Based on previous ICSBEP benchmarks with this enriched uranium metal at ORCEF, the uncertainties in $k_{eff}$ could be as low as ± 0.0002 for some configurations. Other experiments with smaller-diameter than 15 in. diameter HEU metal plates have been benchmarked in HEU-METFAST-001. The prompt neutron time decay measurements could be the basis for an International Reactor Physics Benchmark Program. Preparation of the present report is part of an effort at ORNL to document more than 15 undocumented critical and subcritical experiments enumerated in ORNL/TM-2019/18 and performed by ORNL at ORCEF and other US Department of Energy critical experiments facilities using more than 500 operational days of critical facility time. This work for this report publication was supported by the Nuclear Criticality, Radiation Transport and Safety NCSP Program at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗
DOE OSTI2025

BuildingQA: A Benchmark for Natural Language Question Answering over Building Knowledge Graphs

Graph-based representations of building metadata using ontologies like Brick are vital for smart building applications, but querying them remains a challenge for practitioners. Knowledge Graph Question Answering (KGQA) systems, meant to retrieve answers from natural language questions, traditionally require large-scale training data, making them ill-suited for the specialized and data-scarce building domain. The advent of Large Language Models (LLMs) offers a paradigm shift, enabling zero-shot natural language querying without building/domain-specific training. Yet, there is no standardized benchmark for building-specific KGQA which can guide and validate research in this area. To address this gap, our work makes three primary contributions. First, we introduce the BuildingQA Benchmark Dataset, constructed through a multi-stage process of collecting practitioner data, augmenting it with LLMs for linguistic diversity, and curating a final set of 188 questions across 4 buildings. Second, we characterize the benchmark's complexity and ambiguity, introducing a novel method to quantify its "lexical gap" and providing a four-stage diagnostic framework for analyzing how systems fail. Third, we benchmark zero-shot LLM-powered KGQA systems to establish baseline performance and analyze their failure modes. Our evaluation reveals that top-performing systems achieve a maximum F1 score of only 0.38. This result does not indicate a failure of these powerful systems, but rather underscores the unique challenges posed by our benchmark. It demonstrates a critical performance gap, showing that current methods successful on general KGs struggle with the specific lexical and structural nuances of the building domain. BuildingQA1 thus provides the benchmark dataset and foundational analysis needed to drive the development of novel, domain-aware methods required to unlock the use of semantic data in buildings.

Mulayim, Ozan Baris↗
DOE OSTI2024

Flattop-HEU Benchmark Reevaluation Summary

The Flattop critical assembly was first constructed in the 1950’s at Los Alamos National Laboratory as a follow-on to the Topsy experiment. Flattop is composed of a sphere of special nuclear material (SNM) surrounded by a thick spherical reflector made of natural uranium (NU). Two SNM cores currently exist: a highly-enriched-uranium (HEU) core and a plutonium core. The reflector is composed of three parts: a stationary hemisphere and two movable quarter spheres. For fine reactivity control, there are three control rods of NU that are inserted into the stationary hemisphere from underneath the assembly. The final components that allow for reactivity adjustment are the glory hole pieces, mass adjustment buttons, and hemispherical caps. These pieces can be loaded in various configurations to change the available reactivity loaded in the system.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Benched: Upgrading and Updating the Los Alamos Benchmark Suite for the 21st Century [Slides]

The presentation begins by stating that most organizations make choices to handle specific things when preparing input files for validation, such as which elemental abundance data to use, how to decompose specific elements, and setting calculation precision. It also discusses the consequences, which include differing calculation results between different organizations for the same case, even when using the same code. This is illustrated by the intercomparison exercise and input files that are prepared by one organization and are not necessarily correct for another. The presentation explains that the Los Alamos Benchmark Suite is a centralized repository of high-quality benchmark models currently under development at LANL. The objectives of the new repository are to remain up to date with the latest ICSBEP revision, to have a formal review and revision process, to (eventually) be an open-source repository, and to provide new tools for improved input and output file generation and review.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Uniformly Ordered Binary Decision Algorithm for Benchmark Experiment Correlations in Whisper Validation

When performing a validation exercise for determining the upper subcritical limit of a nuclear criticality safety application, an analyst should select and perform a statistical analysis on a population of benchmark experiments that are neutronically similar to the application. The size of this population should be sufficiently large such that the statistical analysis has a high degree of confidence that the bias plus bias uncertainty (calculational margin) has been accurately quantified. A complication arises because many benchmark experiments share common components, leading to correlations in their measured effective multiplication factors. Correlations between benchmark experiments within the population reduces its predictive power. This motivates the need for methods that consider benchmark experiment correlations and ensure adequate statistical significance of results. The Whisper code is a statistical analysis pack- age that incorporates nuclear data sensitivity coefficients from MCNP to assess benchmark experiment similarity and then performs an extreme-value analysis to estimate the bias plus bias uncertainty. The original methodology in Whisper does not consider the effect of benchmark experiment correlations when making this estimation, and this summary proposes the uniformly ordered binary decision algorithm to address this shortcoming. The original methodology in Whisper computes similarity coefficients ck for an application compared to all benchmark experiments in its library and develops weighting factors for a selected population proportional to the ck values. The methodology can be interpreted as statistically emulating a validation exercise for a particular application where the weighting factors may be viewed as the likelihood that an analyst would include a particular benchmark experiment within the population. The effective sample size of the population is the expected or mean number of benchmark experiments in the population. The uniformly ordered binary decision algorithm identifies clusters of correlated benchmark experiments within the population and then computes adjusted weighting factors based on the magnitude of the correlation coefficients within the cluster to compute a reduced effective sample size accounting for the lower information content because of correlations. Benchmark experiments within the cluster are ordered randomly with equal probability and probabilistic decisions are made as to whether a benchmark. experiment within the cluster should treated as redundant with a previous one; if two redundant benchmark experiments are included, then the conservative worst case bias plus bias uncertainty is used and the pair is counted as a single benchmark experiment in the population. Results are provided for HEU solutions in a research version of the Whisper software using benchmark experiment correlations provided by DICE, the Database for the International Criticality Safety Benchmark Evaluation Project (ICSBEP). These show that there can be a significant increase in the bias plus bias uncertainty because the effective sample size is reduced, and therefore the algorithm, needing to meet sample size requirements, expands the benchmark experiment population by accepting less similar benchmark experiments that would have otherwise not been included.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

FY21 Progress of the Oak Ridge Health Physics Research Reactor CAAS Benchmark Evaluation [Slides]

The FY21 version of the evaluation, focusing on element 57 dose at 3 meters, was presented at the ICSBEP Technical Review Group meeting in October 2021 and was not accepted for 2022 publication in the handbook. The main issue was identified and replacement of the element 57 neutron dose benchmark metric by neutron fluence (closer to what was measured) is required. A subgroup was formed, confident for the updated neutron fluence evaluation to be accepted in the ICSBEP handbook. The updated evaluation will be presented again at the 2022 ICSBEP TRG for publication in the 2023 handbook.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

A consensus-based ensemble approach to improve transcriptome assembly

Systems-level analyses, such as differential gene expression analysis, co-expression analysis, and metabolic pathway reconstruction, depend on the accuracy of the transcriptome. Multiple tools exist to perform transcriptome assembly from RNAseq data. However, assembling high quality transcriptomes is still not a trivial problem. This is especially the case for non-model organisms where adequate reference genomes are often not available. Different methods produce different transcriptome models and there is no easy way to determine which are more accurate. Furthermore, having alternative-splicing events exacerbates such difficult assembly problems. While benchmarking transcriptome assemblies is critical, this is also not trivial due to the general lack of true reference transcriptomes. In this study, we first provide a pipeline to generate a set of the simulated benchmark transcriptome and corresponding RNAseq data. Using the simulated benchmarking datasets, we compared the performance of various transcriptome assembly approaches including both de novo and genome-guided methods. The results showed that the assembly performance deteriorates significantly when alternative transcripts (isoforms) exist or for genome-guided methods when the reference is not available from the same genome. To improve the transcriptome assembly performance, leveraging the overlapping predictions between different assemblies, we present a new consensus-based ensemble transcriptome assembly approach, ConSemble. Without using a reference genome, ConSemble using four de novo assemblers achieved an accuracy up to twice as high as any de novo assemblers we compared. When a reference genome is available, ConSemble using four genome-guided assemblies removed many incorrectly assembled contigs with minimal impact on correctly assembled contigs, achieving higher precision and accuracy than individual genome-guided methods. Furthermore, ConSemble using de novo assemblers matched or exceeded the best performing genome-guided assemblers even when the transcriptomes included isoforms. We thus demonstrated that the ConSemble consensus strategy both for de novo and genome-guided assemblers can improve transcriptome assembly. The RNAseq simulation pipeline, the benchmark transcriptome datasets, and the script to perform the ConSemble assembly are all freely available from: http://bioinfolab.unl.edu/emlab/consemble/.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Verification and validation testing and tools: comparison between MCNP code versions and nuclear data libraries [Slides]

This presentation discusses the primary goal of software testing which is to test the code for correctness. It also discusses the results for individual suites and the role of validation and verification also referred to in the presentation as V&V. In summation, the V&V framework enables easy comparison between calculations performed with different code versions and/or nuclear data libraries. This entire framework will be distributed with the upcoming MCNP6.3 release. V&V test suites shown and several that were not (Criticality, LAQGSM, Lockwood) will be distributed in the new framework.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗