Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Critical Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Safety, codes and standards for hydrogen installations. Metrics development and benchmarking

Automakers and fuel providers have made public commitments to commercialize light duty fuel cell electric vehicles and fueling infrastructure in select US regions beginning in 2014. The development, implementation, and advancement of meaningful codes and standards is critical to enable the effective deployment of clean and efficient fuel cell and hydrogen solutions in the energy technology marketplace. Metrics pertaining to the development and implementation of safety knowledge, codes, and standards are important to communicate progress and inform future R&D investments. This document describes the development and benchmarking of metrics specific to the development of hydrogen specific codes relevant for hydrogen refueling stations. These metrics will be most useful as the hydrogen fuel market transitions from pre-commercial to early-commercial phases. The target regions in California will serve as benchmarking case studies to quantify the success of past investments in research and development supporting safety codes and standards R&D.

08 HYDROGEN↗
DOE OSTI2022

IER-501 CED-3b: Experiment Execution Summary for the Pulsed-Neutron Die-Away Experimental Testbed for Thermal Scattering Law Benchmarks (PNDA)

This report summarizes the experiments performed for IER-501, a testbed for pulsed-neutron die-away (PNDA) experiments at Lawrence Livermore National Laboratory (LLNL). The PNDA experiments were conducted in two separate two-day campaigns: one campaign for high-density polyethylene and another for Lucite. All experiments were performed at LLNL. They will become high-quality benchmarks that serve to optimize and validate thermal neutron scattering laws (TSLs), which are high-priority nuclear data for the Department of Energy’s Nuclear Criticality Safety Program (NCSP). The report presents the PNDA design and its equipment, and it documents the experimental die-away curves. It presents the characterization measurements that have been performed to-date. Importantly, mass spectrometry measurements to determine sample impurities were not yet completed. These will be included in the final benchmark. The report gives the fitted decay constants for the die-away curves of each target sample. It also provides the data for the die-away curves in the appendices. The HDPE experiments examined twelve targets of varying size. The Lucite measurements included ten targets of varying size.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2018

Surpassing 10% Efficiency Benchmark for Nonfullerene Organic Solar Cells by Scalable Coating in Air from Single Nonhalogenated Solvent

Here, the commercialization of nonfullerene organic solar cells (OSCs) relies critically on the response under typical operating conditions (for instance, temperature, humidity) and the ability of scale-up. Despite the rapid increase in power conversion efficiency (PCE) of spin-coated devices fabricated in a protective atmosphere, the device efficiencies of printed nonfullerene OSC devices by blade-coating are still lower than 6%. This slow progress significantly limits the practical printing of high-performance nonfullerene OSCs. Here, a new and stable nonfullerene combination was introduced by pairing a commercially available nonfluorinated acceptor IT-M with the polymeric donor FTAZ. Over 12%-efficiency can be achieved in spincoated FTAZ:IT-M devices using a single halogen-free solvent. More importantly, chlorinefree, in air blade-coating of FTAZ:IT-M is able to yield a PCE of nearly 11%, despite a humidity of ≈50%. X-ray scattering results reveal that large π-π coherence lengths, high degree of faceon orientation with respect to the substrate, and small domain spacings of ≈20 nm are closely correlated with such high device performance. Our material system and approach yields the highest reported performance for nonfullerene OSC devices by a coating technique approximating scalable fabrication methods and holds great promise for the development of low-cost, low-toxicity, and high-efficiency OSCs by high-throughput production.

14 SOLAR ENERGY↗
DOE OSTI2016

Preliminary Results for the OECD/NEA Time Dependent Benchmark using Rattlesnake, Rattlesnake-IQS and TDKENO

One goal of the MAMMOTH M&S project is to validate the analysis capabilities within MAMMOTH. Historical data has shown limited value for validation of full three-dimensional (3D) multi-physics methods. Initial analysis considered the TREAT startup minimum critical core and one of the startup transient tests. At present, validation is focusing on measurements taken during the M8CAL test calibration series. These exercises will valuable in preliminary assessment of the ability of MAMMOTH to perform coupled multi-physics calculations; calculations performed to date are being used to validate the neutron transport solver Rattlesnake\cite{Rattlesnake} and the fuels performance code BISON. Other validation projects outside of TREAT are available for single-physics benchmarking. Because the transient solution capability of Rattlesnake is one of the key attributes that makes it unique for TREAT transient simulations, validation of the transient solution of Rattlesnake using other time dependent kinetics benchmarks has considerable value. The Nuclear Energy Agency (NEA) of the Organization for Economic Cooperation and Development (OECD) has recently developed a computational benchmark for transient simulations. This benchmark considered both two-dimensional (2D) and 3D configurations for a total number of 26 different transients. All are negative reactivity insertions, typically returning to the critical state after some time.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Sensitivity Studies, Gap Analysis, and Benchmark Experiment Optimization for Reactor Applications

In regards to nuclear data, some reactor applications may lack validation experiments, which reduces confidence in predicted results. This is especially true for emerging advanced reactor, micro reactor, and Accelerator Driven System (ADS) designs. This work presents an approach to design new criticality experiments that have similar k eff cross section sensitivities to an application of interest. This process involves simulations to generate cross-section sensitivities to a parameter of interest (such as k eff ), a gap analysis to determine which existing benchmarks are most similar to the application, and an experiment optimization. This work focuses on cross-section sensitives and gap analysis for three examples relevant to the reactor physics community including a Travelling Wave Reactor (TWR) type-design, Kilopower (a space reactor design), and a lead-bismuth eutectic cooled accelerator-driven system (ADS) to transmute minor actinides.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗
DOE OSTI2019

Big Ten MCNP6 Unstructured Mesh Benchmark

The purpose of this report is to document a benchmarking effort for the MCNP6 Unstructured Mesh (UM) geometry description method applied to a large and fairly complex critical assembly, Big Ten. A secondary goal of this effort is to provide a set of best practices for modeling a critical assembly with the MCNP UM method. Specification of geometry using UM requires creating a mesh from a solid geometry model and there are some important considerations when using this method for criticality problems. These considerations will be discussed along with suggested practices for correctly modeling these types of problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Using Whisper-1.1 to Guide Improvements to Nuclear Data Evaluations [Slides]

This presentation covers the use of Whisper-1.1 to guide improvements to nuclear data evaluations. This presentation provides a brief overview on what Whisper-1.1 is. Additionally covered is the benchmark selection: using benchmark and application correlations (ck) computed using nuclear data sensitivity profiles and covariance data. Next the presentation touches on compute bias and bias uncertainty based on selected benchmarks using Extreme Value Theory Finally the presentation shows the additional margin for nuclear data uncertainty estimated by GLLS.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Sensitivity Analysis of H 2 O Pulsed Neutron Die Away Experiments to the H-H 2 O Thermal Scattering Law

Lawrence Livermore National Laboratory is conducting new Pulsed-Neutron Die-Away (PNDA) benchmark experiments to validate neutron thermal scattering laws (TSLs). TSLs are important data for modeling thermal fission reactors, criticality safety scenarios, and radiation protection and detection, i.e. any application with thermal neutrons. These simulations require high-quality nuclear data, with confidence in their quality established through validation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2016

Improved Gamma Yield and Interaction Cross-Section Libraries of MC2-3

The MC{sup 2}-3 code developed by Argonne National Laboratory (ANL) has been widely used for multigroup cross section generation for fast reactor design and analysis. The neutron cross sections generated with MC{sup 2}-3 have been validated with various fast critical experiments. The gamma production data and interaction cross sections were also verified with the EBR-II benchmark problem. The current gamma calculation process is based on the 21-group gamma libraries generated with the NJOY code, which does not include the delayed gamma production and does not account for the self-shielding effect on the KERMA (Kinetic Energy Released in Material) factor. In order to improve gamma prediction accuracy, the gamma libraries of MC{sup 2}-3 have recently been extended from 21 to 94 groups, including delayed gamma data and kinetic energy release per reaction data. The latter is used to take into account the self-shielding effect on KERMA factors. Gamma transport calculation capabilities have also been added to MC{sup 2}-3. In this paper, we present the updated data and gamma transport capabilities along with the verification tests with ABTR and EBR-II benchmark problems. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2019

Benchmarking Mixed Mode Failure in Progressive Damage and Failure Analysis Methods

The verification and validation of progressive-damage-analysis finite element methods are difficult but critical tasks to undertake during their development. Verification exercises assess whether a predictive analysis tool produces results that are consistent with the fundamental concepts and assumptions of the tool under evaluation. Ideally, closed-form analytical solutions can be derived for which method verification results can be compared. Problems selected for computational tool verification are often simple and isolate individual features of the tool. In the case of progressive damage finite element methods, verifications should be performed to evaluate the ability of the model to predict the initiation of damage and its growth through the finite element mesh under a variety of conditions. Mabson et al. proposed a test case of a unidirectional, fiber-reinforced plate with a center crack subjected to tensile loads to evaluate matrix crack propagation predictions. The problem was modeled using the Abaqus Hashin continuum damage mechanics (CDM) model for fiber-reinforced composites. Different combinations of matrix strengths and element sizes were used in the simulations, and the results were compared to a closed-form solution based on linear elastic fracture mechanics (LEFM). It was determined that the Abaqus CDM model could predict the LEFM solution of Mode I cracks only when the finite element mesh density met specific requirements based on the material properties. This paper presents closed-form LEFM solutions for a center notch mixed mode (CNMM) verification problem. Parametric finite element analyses were developed using progressive damage analysis methods of both the Discrete Damage Mechanics (DDM) and CDM classes. The progressive damage analysis methods applied in the analyses of the CNMM problem include CompDam and the Floating Node Method. Analyses were conducted with various mode mixities and element sizes to verify that the damage models were working as intended and to identify any limits of applicability.

Leone, Frank↗
DOE OSTI2023

Verifying MCNP Models of the TEX High 240 Plutonium Benchmark

Computational modeling programs are invaluable tools that allow us to understand systems, safely develop new processes, and make reliable predictions about future designs. However, the effectiveness of these codes is limited by the degree to which their parameters match the real world. In the field of nuclear engineering, cross section data is one of these vital parameters. Accurate cross section data on important fissile and fissionable isotopes promotes the design of safer and more efficient fabrication, transportation, storage, and stockpiling of nuclear fuel. Unfortunately, there are knowledge gaps in data on key isotopes. In 2011, a multinational meeting hosted by the US Department of Energy Nuclear Criticality Safety Program ranked the priority of certain cross section data needs. In response, Lawrence Livermore National Lab (LLNL) designed the Thermal and Epithermal eXperiment (TEX) series of benchmark experiments. Benchmark experiments are used to validate current cross section data. They validate data by comparing the results of an actual experiment to the predicted results from a computational model. The data a benchmark applies to depends on the isotope and energy range the experiment’s neutron multiplication factor ( k eff ) is most sensitive to. The development and testing of the TEX High 240 Plutonium Benchmark will help validate 240 Pu cross section data. The configuration and materials of this benchmark are designed to be most sensitive to 240 Pu's intermediate energy range (from 0.625 ev to 100 keV ). MCNP® models of the assembly have been developed by LLNL and the results have been written in the final design report. In order for the discrepancies between benchmark models and experiments to be attributed to cross section inaccuracies, the accuracy of the models needs to be verified. The goal of this project is to verify of the results of LLNL's modeling by creating a new set of MCNP models and comparing the results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2016

A Solid of Revolution Time Study using COG11.1 and MCNP6.1

The performance of two continuous energy Monte Carlo transport codes, COG11.1 and MCNP6.1, has been compared for the {sup 239}Pu Jezebel Benchmark using cross sections based on the ENDF/B-VII.1 evaluated nuclear data library. The purpose of this study is to determine the length of time it takes each code to complete a series of criticality calculations, using two different methods to model a solid of revolution. A solid of revolution is essential in many fields of engineering and mathematics, and has been a standard feature in computer-aided design and manufacturing since the 1970's. In the field of criticality safety, a solid of revolution can be used to reproduce and simplify complex engineering drawings and systems that would otherwise require excessive use of geometric primitives and computational resources to achieve a comparable level of fidelity. There are two basic methods to model a solid of revolution: Method 1 (COG) specifies a set of x-y pairs or polar coordinates and rotate the curve about the x-axis. Method 2 (COG and MCNP) creates a set of end-to-end conical frustums and/or cylinders. Method 1 is only available in COG and can be implemented using one surface and sector specification. Method 2 can be implemented in both COG and MCNP. This time study was initially conceived as a result of criticality safety analysis performed for a complex system with a high degree of rotational symmetry. Each COG input deck typically took 1-2 days to run in serial mode. COG input decks were then converted to MCNP format and run on the same computer cluster. Instead of expected 1-2 day runtimes, it took MCNP6.1 more than one week to complete each run. Since MCNP typically runs faster than many codes, these lengthy runtimes were considered unusual. This study attempts to investigate the runtime discrepancy between the two codes. The methods and benchmark in this time study were selected to provide a consistent, generalized approach to modeling an arbitrary solid of revolution. While there are many different ways to model the {sup 239}Pu Jezebel Benchmark, the focus of this study is on investigating the practical difference between the two basic methods to model a surface of revolution. Throughout this study, the only code that maintains reasonably low runtimes is COG11.1 (Method 1). Based on the observed performance of each code and method, it is likely that the divergent runtimes are the result of tracking particles across planes that lie between conical frustums, as opposed to defining the object boundary as a single surface. Slight fluctuations in graphed results were also observed, due to random sampling and CPU loading. This was confirmed by re-running input decks and comparing average runtimes to a preliminary curve fit. From the perspective of a criticality safety analyst, the results of this study are expected to contribute towards understanding one of the practical trade-offs between codes and methods as they apply to real-world analysis. Ultimately, it's about choosing the right tool for the job.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

BACKFLIP: Identification of Materials and Changes Upon Aging of Emerging Fluoropolymer-Free and Industry-Benchmark PV Backsheets

Extending lifetimes of photovoltaic (PV) modules and decreasing manufacturing and decommissioning costs are motivating research of novel PV module backsheet materials. Backsheet integrity is critical to the safety and performance of a PV module, however, the polymeric materials are often vulnerable to environmental degradation. The long-term durability of emerging polyolefin (PO) materials is being examined to inform regarding the possible replacement of laminated backsheets containing polyethylene terephthalate (PET) cores and fluoropolymer protective inner/outer layers. This study compares traditional PET-based backsheets with novel, co-extruded, and recyclable PO-based backsheets after being subjected to hygrometric and UV photolytic accelerated weathering. A large set of characterization methods will compare physical, chemical, structural, mechanical, and insulating properties of these backsheets and the resulting mini-module (MiMo) PV performances. The study of chemical composition, glass- and phase-transition temperatures, degree of crystallinity, and crystalline structure are described here.

mini-module↗
DOE OSTI2022

Glassy Carbon Substrate Oxidation Effects on Electrode Stability for Oxygen Evolution Reaction Catalysis Stability Benchmarking

Employing benchmarking metrics to capture the activity and stability of electrocatalysts for the oxygen evolution reaction (OER) in acid is a critical practice that enables meaningful comparison of catalyst material candidates reported throughout the literature. In this work, we find that ubiquitously used glassy carbon electrode substrates oxidize under typical OER operating conditions, forming a pacified, electrically insulating, and oxygen-rich surface layer that causes drastic loss of current density over the course of extended chronoamperometric stability tests at an anodic potential of 1.7 VRHE. We show that the experimentally observed stability of glassy carbon-based electrodes is approximately two orders of magnitude lower than that expected solely from dissolution-based catalyst intrinsic stability of Ir-based catalysts. We additionally find that glassy carbon-based electrode stability measured by chronoamperometric holds is greatly impacted by catalyst loading, with high catalyst loadings improving the stability of the overall electrode via a protective effect on the glassy carbon substrate. Altogether, our investigation highlights that glassy carbon is not electrochemically inert under OER conditions on the timescale of common stability tests, which can cause electrodes to exhibit performance losses that do not reflect the intrinsic stability of the actual catalyst material being investigated. In light of our findings, we underscore the usefulness of metrics, such as the S-number, to reflect intrinsic catalyst material stability.

25 ENERGY STORAGE↗
DOE OSTI2026

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Overcoming Barriers in Electrochemical Toluene Hydrogenation for Efficient Hydrogen Storage by Pt 3 Au Alloy Catalysts

Hydrogen storage and transportation are essential for the hydrogen economy, and liquid organic hydrogen carriers (LOHCs), such as a toluene/methylcyclohexane (TOL/MCH) system, offer significant advantages in terms of safety and efficiency. However, the electrochemical reduction of TOL to MCH (TER) faces challenges from competing with the hydrogen evolution reaction (HER) and catalyst instability. Here, in this study, Pt 3 Au is introduced as a highly effective catalyst for TER. Through density functional theory screening, we identified distinctive properties of Pt 3 Au, including enhanced binding to the TER intermediates and effective HER suppression. Experimental validation confirmed these computational predictions, with Pt 3 Au achieving the highest reported Faradaic efficiency (98%) in proton exchange membrane systems. Moreover, long-term testing demonstrated that Pt 3 Au maintained Faradaic efficiencies of >90% over 9 h, highlighting its robustness and operational stability. By integrating computational modeling and experimental evaluation, this work addresses key limitations in LOHC catalysis. Pt 3 Au establishes a benchmark for selective and stable TER performance, paving the way for advanced hydrogen storage technologies. These findings emphasize the critical role of rational catalyst design in overcoming the challenges associated with scalable and efficient hydrogen storage solutions.

LOHC↗
DOE OSTI2016

SU-F-T-144: Analytical Closed Form Approximation for Carbon Ion Bragg Curves in Water

Purpose: Semi-empirical modeling is a powerful computational method in radiation dosimetry. A set of approximations exist for proton ion depth dose distribution (DDD) in water. However, the modeling is more complicated for carbon ions due to fragmentation. This study addresses this by providing and evaluating a new methodology for DDD modeling of carbon ions in water. Methods: The FLUKA, Monte Carlo (MC) general-purpose transport code was used for simulation of carbon DDDs for energies of 100–400 MeV in water as reference data model benchmarking. Based on Thomas Bortfeld’s closed form equation approximating proton Bragg Curves as a basis, we derived the critical constants for a beam of Carbon ions by applying models of radiation transport by Lee et. al. and Geiger to our simulated Carbon curves. We hypothesized that including a new exponential (κ) residual distance parameter to Bortfeld’s fluence reduction relation would improve DDD modeling for carbon ions. We are introducing an additional term to be added to Bortfeld’s equation to describe fragmentation tail. This term accounts for the pre-peak dose from nuclear fragments (NF). In the post peak region, the NF transport will be treated as new beams utilizing the Glauber model for interaction cross sections and the Abrasion- Ablation fragmentation model. Results: The carbon beam specific constants in the developed model were determined to be : p= 1.75, β=0.008 cm-1, γ=0.6, α=0.0007 cm MeV, σmono=0.08, and the new exponential parameter κ=0.55. This produced a close match for the plateau part of the curve (max deviation 6.37%). Conclusion: The derived semi-empirical model provides an accurate approximation of the MC simulated clinical carbon DDDs. This is the first direct semi-empirical simulation for the dosimetry of therapeutic carbon ions. The accurate modeling of the NF tail in the carbon DDD will provide key insight into distal edge dose deposition formation.

07 ISOTOPE AND RADIATION SOURCES↗