Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Plutonium Production Reactor Progression Problems: Magnox Neutronics Benchmarks

The goal of this document is to provide a set of comprehensive benchmarking neutronics problems for gas-cooled, graphite-moderated reactors. The problems are designed to be representative problems that increase in complexity to test performance of various codes. For the simulation of the benchmarking problems, the Shift Monte Carlo code and MPACT deterministic code are chosen because of their state-of-the-art capabilities, which are optimized for various reactor designs. Because these codes have been developed primarily for light water reactor applications, their application to graphite-moderated, gas-cooled reactors has not been extensively explored. This report attempts to evaluate benchmarks for a Magnox-style reactor, one that is graphite-moderated and gas-cooled. Parameters that are calculated and presented in this benchmark include the eigenvalue, peaking factors, and isotope concentrations. Results show good agreement between Shift and MPACT, and demonstrate the capability of MPACT to model graphite-moderated systems well.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Benchmark Specifications for Select Experiments Conducted at the Kansas State University Gallium Thermal-hydraulic Experiment Facility

The Department of Energy (DOE) – Nuclear Energy University Programs (NEUP) supported the creation and operation of the Gallium Thermal-hydraulic Experiment (GaTE) facility at Kansas State University (KSU) as part of a larger effort to understand thermal stratification behavior in liquid-metal-cooled reactors. GaTE was designed to simulate transients in a reactor plenum that are known to cause thermal stratification. High-reliability and high-resolution measurements describing stratification behavior in the coolant were collected for use as experimental benchmarks in validation efforts for computational models. The results of these tests contribute to a greater understanding of thermal stratification behavior of liquid metal under various configurations and operating conditions. This report provides a complete description of the benchmark problem, including all necessary details and description of a set of four forced flow and four natural circulation tests and measured data for comparison with model results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Benchmark Data Set of Crystalline Organic Semiconductors

This work reports a Benchmark Data set of Crystalline Organic Semiconductors to test calculations of the structural and electronic properties of these materials in the solid state. The data set contains 67 crystals consisting of mostly rigid molecules with a single dominant conformer, covering the majority of known structural types. The experimental crystal structure is available for the entire data set, whereas zero-temperature unit cell volume can be reliably estimated for a subset of 28 crystals. Using this subset, we benchmark r 2 SCAN-D3 and PBE-D3 density functionals. Then, for the entire data set, we benchmark approximate density functional theory (DFT) methods, including GFN1-xTB and DFTB3(3ob-3-1), with various dispersion corrections against r 2 SCAN-D3. Our results show that r 2 SCAN-D3 geometries are accurate within a few percent, which is comparable to the statistical uncertainty of experimental data at a fixed temperature, but the unit cell volume is systematically underestimated by 2% on average. The several times faster PBE-D3 provides an unbiased estimate of the volume for all systems except for molecules with highly polar bonds, for which the volume is substantially overestimated in correlation with the underestimation of atomic charges. Considered approximate DFT methods are orders of magnitude faster and provide qualitatively correct but overcompressed crystal structures unless the dispersion corrections are fitted by unit cell volume.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Attention-Augmented Parametric Kernel Graph Neural Network (APKGNN) for Node Classification

We present a new graph neural network, the Attention-based Parametric-Kernel augmented Graph Neural Network (APKGNN), developed for node classification tasks. Despite extensive work on modeling multi-faceted relationships between connected nodes of a graph, the effect of attention on edge features mapped to relationships has not yet been analyzed through learning representation. This study derives such an attention vector by first calculating node features corresponding to endpoints of an edge and then aggregating these with extracted local intrinsic patches of a given graph to generate augmented local patch vectors. This process uses a parametric kernel based on Gaussian mixture models (GMMs) to embed local neighborhoods of the graph in local patches. The patch vectors then convolve with the above node features to produce an updated node representation. We show that this new learning representation (APKGNN) achieves higher node classification accuracy on tasks - both standard benchmarks (Cora, PubMed, Citeseer) and new experimental short text corpora where nodes correspond to text documents and words. This implementation of the GNN convolution layer outperforms state-of-the-art (SOTA) algorithms, achieving higher training, validation, and test accuracy by a significant margin on three standard benchmark data sets under both SOTA experimental settings and those for new testbeds.

Bose, Avishek↗
DOE OSTI2024

Status of SAS4A/SASSYS-1 Software Development and Application (FY2024)

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analysis of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. With its origin as SAS1A in the late 1960s, the SAS series of codes has been under continuous use and development for over fifty years. It has been identified as a critical element of safety analysis capabilities for the U.S. Department of Energy and is utilized within industry to perform the transient safety analyses required to support the licensing of Liquid Metal-cooled Fast Reactors (LMFRs). This report summarizes the code development and update activities carried out during FY2024. In FY2024, programmatic activities focused on key improvements to software useability, such as enhanced user interfaces for reactivity feedback modeling, improvements in stability/useability of the Code Manual, and improvements to the acceptance testing infrastructure, including automation of acceptance testing and generation of the Acceptance Testing Report. To support end user applications, an open training was held, a semi-public forum was maintained, and a practical benchmarking and validation matrix was developed which allowed limitations of existing testing capabilities to be assessed. The existing fuel models were also enhanced with improved modeling capabilities and testing for the oxide and annular fuel models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Updates and Validation for the n+ 63,65 Cu Cross Sections [Abstract]

The neutron induced total, elastic, and capture cross sections of 63,65 Cu isotopes were selected for evaluation in the resolved and unresolved resonance energy ranges by the National Criticality Safety Program to resolve discrepancies related to benchmark performance. This is especially evident for the series of ZEUS benchmarks in which copper is used as a reflector. Because copper is also used as structural material in both fission and fusion reactors, the need to address benchmark discrepancies linked to nuclear data deficiencies is a task of primary importance. The aim of this work is to describe the steps of evaluation work towards a consistent improvement of the benchmark performance. The R-matrix analysis with the SAMMY code focused on the 63 Cu(n,γ) reaction channel between 100-300 keV coupled to unresolved resonance region parameters up to 650 keV to fit average cross section data from a recent experiment. Due to the high sensitivity of many benchmarks to elastic scattering angular distribution data, especially for the 65 Cu isotope, the impact of these data was tested by generating Legendre coefficients from both resonance parameters and the Hauser-Feshbach model. Guided by the findings of Shaw et al., the performance of the current evaluation for 65 Cu was compared to that of ENDF/B-VII.1 and ENDF/B-VIII.0 by testing the reactivity coefficients corresponding to the validation suite of experimental criticality benchmarks for thermal, intermediate, and fast systems taken from the International Criticality Safety Benchmark Experiments Project Handbook. The benchmark performance is especially sensitive to 63 Cu(n,γ) and 65 Cu elastic scattering for neutron energies in the 100–500 keV region, whereas 100 keV is the upper limit of the resolved resonance region in the ENDF/B-VIII.0 evaluations for 63,65 Cu. The results highlight the need to handle the transition from the resolved resonance region to the high energy region carefully.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2026

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗
DOE OSTI2022

Noisy intermediate-scale quantum algorithms

A universal fault-tolerant quantum computer that can efficiently solve problems such as integer factorization and unstructured database search requires millions of qubits with low error rates and long coherence times. While the experimental advancement toward realizing such devices will potentially take decades of research, noisy intermediate-scale quantum (NISQ) computers already exist. These computers are composed of hundreds of noisy qubits, i.e., qubits that are not error corrected, and therefore perform imperfect operations within a limited coherence time. In the search for achieving quantum advantage with these devices, algorithms have been proposed for applications in various disciplines spanning physics, machine learning, quantum chemistry, and combinatorial optimization. The overarching goal of such algorithms is to leverage the limited available resources to perform classically challenging tasks. In this review, a thorough summary of NISQ computational paradigms and algorithms is provided. The key structure of these algorithms and their limitations and advantages are discussed. Finally, a comprehensive overview of various benchmarking and software tools useful for programming and testing NISQ devices is additionally provided.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Delayed Critical and Subcritical Experiments with Polyethylene Moderated Unreflected Thin 15 in. Diameter HEU Metal Plates

The thin ~15 in. diameter highly enriched uranium (HEU) metal plates were assembled to delayed criticality at the Oak Ridge Critical Experiments Facility (ORCEF) in 1969 with various thicknesses of polyethylene (varying from 1/16 to 2$\frac{3}{8}$ inches) between uranium metal plates. The average 235 U enrichment was 93.27 wt. %. These unreflected critical configurations contained 4$\frac{2}{3}$ to 20$\frac{5}{6}$ thin 15 in. diameter HEU metal plates (on loan from Los Alamos National Laboratory [LANL] and shipped to Oak Ridge National Laboratory [ORNL] on June 3, 1969). Depending on the thickness of polyethylene, the enriched uranium masses varying from 28,053 to 135,148 grams. Fractional plate sections consisted of the appropriate number of 60° pie sections. In addition to the measurement at delayed criticality, subcritical measurements were also performed by the inverse kinetic rod drop method. Prompt neutron decay constant measurements were also performed by the Rossi alpha and randomly pulsed neutron method using a time-tagged spontaneous fission californium neutron source; these are briefly reported here. At the time of these measurements in 1969, the thin HEU metal plates were in near-pristine condition with extremely little oxidation, allowing better descriptions of the uranium plates than the use of these plates in a heavily oxidized and deteriorated condition in recent reflected benchmark experiments at the LANL facility at the Nevada Test Site with these same thin highly enriched uranium metal plates. This report documents the experimental information for the measurements performed so that later researchers can perform the required uncertainty and calculational analyses and documentation to use these data for an International Nuclear Criticality Safety Benchmark Evaluation Program (ICSBEP) or a Nuclear Energy Agency (NEA) benchmark. Data from the experiments described should be acceptable for use as criticality safety benchmark experiments for the ICSBEP and the NEA nuclear criticality safety benchmark program once the uncertainty analysis on the measured neutron multiplication factors is completed. Additional data—such as the dimensional inspection reports, uranium isotopic information, and other relevant particulars—should be retrieved from the Y-12 Plant or LANL and incorporated in the final ICSBEP benchmark. Based on previous ICSBEP benchmarks with this enriched uranium metal at ORCEF, the uncertainties in $k_{eff}$ could be as low as ± 0.0002 for some configurations. Other experiments with smaller-diameter than 15 in. diameter HEU metal plates have been benchmarked in HEU-METFAST-001. The prompt neutron time decay measurements could be the basis for an International Reactor Physics Benchmark Program. Preparation of the present report is part of an effort at ORNL to document more than 15 undocumented critical and subcritical experiments enumerated in ORNL/TM-2019/18 and performed by ORNL at ORCEF and other US Department of Energy critical experiments facilities using more than 500 operational days of critical facility time. This work for this report publication was supported by the Nuclear Criticality, Radiation Transport and Safety NCSP Program at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Final Report on Aerosol Pretreatment Technology Performance and Benchmarking

Solvent-based post-combustion CO 2 capture (PCC) technology remains one of the leading methods to combat global CO 2 emissions produced from large-scale coal-fired power production. Advanced solventbased PCC technology has made significant improvements in design and performance that reduce capital and operating costs to enable its commercial use. Key to low cost, manageable logistics, and environmentally safe operation of solvent-based PCC technology are minimal solvent losses from the process through the treated gas stream exiting PCC plant absorbers. High flue gas aerosol particle concentrations (>10 5 particles/cm 3 ) for particles in the range of 70-200 nm have been shown to cause significant amine solvent losses for solvent-based PCC processes through several mechanisms including absorption of solvent and water into growing aerosol particles. Flue gas aerosol pretreatment technology is the only realistic and economically attractive method to reduce very high aerosol particle concentrations (>10 7 particles/cm 3 ) to enable solvent-based PCC for existing power plants lacking sufficient particle removal systems, such as baghouses. The overall goal of this project was to design, construct, independently test, and evaluate three flue gas aerosol pretreatment technologies identified to significantly reduce high aerosol particle concentrations (>10 7 particles/cm 3 ) in the 70-200 nm particle size range: (1) a novel, high-velocity water injection spray concept developed by RWE and tested by Linde, (2) an innovative electrostatic precipitator (ESP) device with optimized operating conditions developed by Washington University in St. Louis (WUSTL), and (3) a non-regenerative sorbent-based filter technology developed by InnoSepra for SO x and NO x removal from coal-fired power plant flue gas. Each technology has been validated with tests on 500-1000 scfm of actual coal-fired flue gas and evaluated in terms of particle removal efficiency (%), cost competitiveness, and environmental impact. Aerosol measurements were performed upstream and downstream of each aerosol reduction unit during independent testing of each technology using advanced instrumentation and analytical methods provided by WUSTL. To perform aerosol measurements, isokinetic probes were inserted into flanged pipes attached to the flue gas piping, and a small suction pump was used to sample gas containing aerosol particles. Aerosol particle number concentrations (# particles/cm 3 ) and size distributions were then measured using a scanning mobility particle sizer (SMPS, TSI Inc.) for very fine particles (<1,000 nm) and a particle counter manufactured by GRIMM for particles larger than 1,000 nm. This report summarizes the aerosol removal performance results from pilot scale testing of each technology. Performance results have been benchmarked against pre-defined targets and other flue gas aerosol pretreatment technologies with documented performance. Linde Gas North America LLC has been the prime contractor to DOE responsible for overall project management and provided the design for the high-velocity water spray-based aerosol removal technology based on a design concept developed by the German utility company RWE.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2022

Simulation of the High Temperature Test Facility (HTTF) Core Using the 2D Ring Model with SAM

A two-dimensional ring model is developed with SAM to model the core of the High Temperature Test Facility (HTTF) at the system level. The ring model simplifies the complex structure of the HTTF core by converting the hexagonal rows of heaters and flow channels into layers of concentric annular rings. The ring model is first compared against a 3D-1D model where the solid structures are fully resolved in three dimensions while the fluid structures are modeled as one-dimensional flows. Comparison between the 3D-1D and the ring models shows that the latter can predict major parameters reasonably well under steady-state normal operating condition, but the heater temperatures are underpredicted. Adjustment is made to the effective thermal conductivity of the ceramic core of the ring model to improve the heater temperature predictions. Furthermore, the ring model is also used to simulate a transient Pressurized Conduction Cooldown (PCC) condition and is benchmarked with the experimental data from the HTTF Test PG-27. Good agreement is obtained between the experimental data and the predictions by the ring model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Validation of New MCNP6.3 Features for Critical and Subcritical Benchmark Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites was introduced. Here, we look at new optional features of the MCNP6.3 code. Then, Fission-matrix-based options with Convergence and population testing and Automated acceleration of the fission source and Doppler Broadening Resonance Correction and HDF5 Particle Track Output (PTRAC) and Validation benchmarks: criticality, Rossi-α, and subcritical multiplication. All the new MCNP6.3 options give statistically equivalent results and should be considered for default usage in criticality and subcritical multiplication calculation work. Discussed are two separate papers at the upcoming 2023 International Conference on Nuclear Criticality Safety (ICNC 2023) that give more details on the results presented here.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Benchmarking noise extrapolation with the OpenPulse control framework

Distilling precise estimates from noisy intermediate scale quantum (NISQ) data has recently attracted considerable attention Kandala et al., Nature (London) 567, 491 (2019). In order to augment digital qubit metrics, such as gate fidelity, we discuss analog error mitigability, i.e., the ability to accurately distill precise observable estimates, as a hybrid quantum classical computing benchmarking task. Specifically, using Rabi oscillations as a test program, we characterize single qubit error rates on IBM's Poughkeepsie superconducting quantum hardware, incorporate control-mediated noise dependence into a generalized rescaling protocol, and analyze how noise characteristics influence Richardson extrapolation-based error mitigation. Finally, our results identify regions in the space of Hamiltonian control fields and circuit depth which are most amenable to reliable noise extrapolation, as well as shed light on how low-level hardware characterization can be used as a predictive tool for uncertainty quantification in error-mitigated NISQ computations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

CISME report on experiments with HMX powder, PBX 9501 prills, and heated PBX 9501

The ability to predict post-ignition explosive response is relevant to explosives safety, particularly weapons assembly/disassembly operations that must operate under a sufficiently conservative safety basis to meet risk mitigation criteria for inadvertent nuclear detonation (IND). In particular, hazard determinations hinge on whether the PBX 9501 main charge can ultimately attain detonation from an initial, non-shock, ignition stimulus. The CISME experiment uses a spherical explosive charge, which is thermally ignited in the center using a fiber-delivered infrared laser pulse. This ignition mechanism - i.e. a localized thermal hotspot - is representative of the ignition-causing insults typical in accident scenarios, including low-velocity impact, drop, skid, and punch events. In fiscal year 2018 CISME experiments were conducted with pristine PBX 9501 spheres, confined and unconfined. Sub-detonative, low-violence reactions were observed. Here we report experiments conducted since 2018. The explosive charge was varied: experiments were conducted with room temperature pour-density HMX powder and prills of PBX 9501, and heated, thermally damaged PBX 9501. Experiments were conducted in a confined configuration, with two 4 mm-thick stainless-steel hemispherical shells bolted around the sphere. Detonation, via DDT (deflagration-to-detonation transition) was observed in the 3-inch diameter powdered HMX and the 6-inch diameter heated and thermally-damaged PBX 9501 tests. No transition to DDT was observed in smaller diameters for those configurations, and no DDT was observed for pour-density prills of PBX 9501 of any diameter. The original test series demonstrated that the response of pristine, undamaged PBX 9501 to a central ignition is relatively benign. This new test series shows that increased porosity, lack of polymer binders and thermal damage can greatly increase the violence of the post-ignition response, up to and including detonation. These results bridge the explosive response of PBX 9501 from sub-detonative through detonation as a function of diameter and provide valuable test cases for modeling efforts that strive to capture the DDT threshold. By exploring explosive response in a more representative 3D geometry, we can also benchmark these new results to more plentiful DDT datasets generated from testing in 1D tube confinement (the historical test configuration)–the configuration upon which almost all DDT models were developed.

42 ENGINEERING↗
DOE OSTI2026

Assessing the accuracy of time-fraction and ductility exhaustion approaches for creep-fatigue damage prediction through feature-test validation

Determining creep-fatigue damage formation is critical for elevated temperature components integrity. This study evaluates creep-fatigue assessments with emphasis on differences between creep damage models. Evaluated are the time-fraction model and the classical and stress-modified ductility exhaustion creep damage models. This work extends the domain of stress-modified ductility exhaustion models by introducing and validating such formalism to Ni-based alloys. The fidelity of the assessments was benchmarked against uniaxial creep-fatigue and multiaxial feature tests of Alloy 617. For uniaxial specimens, best estimate predictions rank ductility exhaustion as the most accurate and precise and time-fraction as markedly conservative. For feature tests, ductility exhaustion predictions are within < 4.0 times difference, whereas time-fraction underpredicts life by factors of 7–14. The observations suggest ductility exhaustion models as alternative to time-fraction models in design codes for situations requiring characterization of the design margin. Further work in employing such models to assess other relevant phenomena (e.g., stress relaxation cracking) is discussed.

creep-fatigue↗
DOE OSTI2021

2D radial-azimuthal particle-in-cell benchmark for E × B discharges

In this paper we propose a representative simulation test-case of E × B discharges accounting for plasma wall interactions with the presence of both the electron cyclotron drift instability and the modified-two-stream-instability. Seven independently developed particle-in-cell (PIC) codes have simulated this benchmark case, with the same specified conditions. The characteristics of the different codes and computing times are given. Here, results show that both instabilities were captured in a similar fashion and good agreement between the different PIC codes is reported as main plasma parameters were closely related within a 5% interval. The number of macroparticles per cell was also varied and statistical convergence was reached. Detailed outputs are given in the supplementary data, to be used by other similar groups in the perspective of code verification.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Coupling of Pronghorn and RELAP-7 for a Pebble Bed Reactor

High temperature gas cooled reactors (HTGR) are a candidate for timely Gen-IV reactor technology deployment because of high technology readiness and walk-away safety. Among HTGRs, pebble bed reactors (PBRs) have attractive features such as low excess reactivity and online refueling. Pebble bed reactors pose unique challenges to analysts and reactor designers such as continuous burnup distribution depending on pebble motion and recirculation, radiative heat transfer across a variety of gas-filled gaps, and long design basis transients such as pressurized and depressurized loss of forced circulation. Modeling and simulation is essential for both the PBR’s safety case and design process. In order to verify and validate the new generation codes the Nuclear Energy Agency (NEA) Data bank provide a set of benchmarks data together with solutions calculated by the participants using the state of the art codes of that time. An important milestone to test the new PBR simulation codes is the OECD NEA PBMR-400 benchmark which includes thermal hydraulic and neutron kinetic standalone exercises as well as coupled exercises and transients scenarios. In this work, the reactor multiphysics code MAMMOTH and the thermal hydraulics code Pronghorn, both developed by the Idaho National Laboratory (INL) within the multiphysics object-oriented simulation environment (MOOSE), have been used to solve Phase 1 exercises 1 and 2 of the PBMR-400 benchmark. The steady state results are in agreement with the other participants’ solutions demonstrating the adequacy of MAMMOTH and Pronghorn for simulating PBRs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗