Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

Understanding Portability of Automotive Workload: A Case Study with the Points-to-Image Kernel in SYCL on Heterogeneous Computing Platforms

SYCL is a promising programming model for heterogenous computing across vendors’ devices. In this paper, we study whether SYCL can be applied to an automotive workload and its portability on heterogeneous computing platforms. We explain the automotive benchmark, describe our implementations and optimizations of the benchmark, and evaluate the performance of the benchmarks using SYCL and other programming models on heterogeneous computing devices. The study also allows us to have a better understanding of portability of the benchmark across these platforms.

Jin, Zheming↗

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗

Measuring differential particle correlations in relativistic nuclear collisions

This study explores the transverse momentum ( p T ) dependencies of symmetric and asymmetric correlations (SC and ASC) with one and two particles of interest in Au + Au collisions at 200 GeV. Leveraging a multiphase transport (AMPT) model, the investigation delves into the sensitivity of these correlations to the final state effects, providing valuable insights into their potential for constraining the final state effects' p T dependencies. The HIJING model is employed as a benchmark for nonflow correlations, shedding light on their impact on interpreting SC and ASC data. Moreover, the study points out that differential SC and ASC with one and two particles of interest (POIs) typically incorporate contributions from event-plane angle fluctuations. Consequently, this work highlights the significance of SC and ASC with one and two POIs as valuable tools for investigating the p T nature of the final state effects and advocates for comprehensive experimental measurements across various beam energies and system sizes to enhance understanding and provide additional constraints for theoretical models. Published by the American Physical Society 2024

Physics↗

Development and application of hybrid AIMD/cDFT simulations for atomic-to-mesoscale chemistry

Many important chemical processes involve reactivity and dynamics in complex solutions. Gaining a fundamental understanding of these reaction mechanisms is a challenging goal that requires advanced computational and experimental approaches. However, important techniques such as molecular simulation have limitations in terms of scales of time, length, and system complexity. Furthermore, among the currently available solvation models, there are very few designed to describe the interaction between the molecular scale and the mesoscale. To help address this challenge, here, we establish a novel hybrid approach that couples first-principles plane-wave density functional theory with classical density functional theory (cDFT). In this approach, a region of interest described by ab initio molecular dynamics (AIMD) interacts with the surrounding medium described using cDFT to arrive at a self-consistent ground state. cDFT is a robust but efficient mesoscopic approach to accurate thermodynamics of bulk electrolyte solutions over a wide concentration range (up to 2M concentrations). Benchmarking against commonly used continuum models of solvation, such as SMD, as well as experiments, demonstrates that our hybrid AIMD–cDFT method is able to produce reasonable solvation energies for a variety of molecules and ions. With this model, we also examined the solvent effects on a prototype S N 2 reaction of the nucleophilic attack of a chloride ion on methyl chloride in the solution. The resulting reaction pathway profile and the solution phase barrier agree well with experiment, showing that our AIMD/cDFT hybrid approach can provide insight into the specific role of the solvent on the reaction coordinate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling the Transient Reactor Test Loop in TRACE for PWR Critical Heat Flux Benchmarking

Understanding transient critical heat flux (CHF) resulting from a Reactivity Insertion Accident (RIA) in nuclear systems is an extremely undeveloped field. Though many experiments have been done for CHF, remarkably few have been done for rods at PWR operating temperature and pressure (300 deg. C, 2200 psia) with a short time constant ramp in power. This leads to many concerns regarding understanding how RIA scenarios develop and evolve in commercial nuclear reactors. With a limited understanding of the phenomenology governing transient CHF, there is little hope in being able to accurately model these scenarios using today's thermal hydraulic codes. The Accident Tolerant Fuels (ATF) Program established by the Department of Energy (DOE) is seeking out new fuel and cladding systems that can be used to reduce the probability and consequences of severe accidents. To better understand this phenomenon, the DOE is restarting the Transient Reactor Test (TREAT) Facility at the Idaho National Laboratory (INL). TREAT will be able to provide representative neutronic boundary conditions for testing coupled thermal hydraulics on the Transient Water Environment Recirculating Loop (TWERL) to study transient CHF with the best representation possible. To support this task, Oregon State University (OSU) is designing and building a representative flow loop that will be able to mimic the conditions of TWERL (sans the neutronic boundary conditions) to create a benchmark study for existing lumped parameter thermal-hydraulic codes such as RELAP5 and TRACE. This flow loop, the Transient Reactor Test Facility (TRTL), will support the ATF program by providing much needed NQA-1 data for transient CHF at operating temperature and pressure.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Critical adjustment of land mitigation pathways for assessing countries' climate progress

Collective progress towards the Paris Agreement’s temperature targets will be assessed by the Agreement’s Global Stocktake process. Global emission pathways by Integrated Assessment Models (IAMs) are a likely benchmark against which aggregated countries’ greenhouse gas mitigation pledges will be assessed. However, this approach requires comparability, which is currently hampered by a 5 GtCO2yr-1 mismatch between the estimated global land anthropogenic flux of IAMs and countries’ GHG inventories (GHGIs) for 2005-2015. We show that this gap is mostly the result of differences in how the anthropogenic forest sink is defined. Countries define managed forest more broadly than IAMs, and on this larger area typically consider anthropogenic also fluxes due to human-induced environmental change, which IAMs do not include their pathways. Using five IAMs and a dynamic global vegetation model (DGVM), we present and apply a novel method that adjusts IAM results to the countries’ definition, closing the gap with GHGIs at global and regional scale. When expressed in a way compatible with GHGIs, adjusted 1.5°C and well-below 2°C pathways have a cumulative CO2 balance until carbon neutrality that is 110–176 GtCO2 lower than the original IAMs pathways. The use of these country-compatible emission pathways under the Global Stocktake would therefore be essential for an accurate assessment of the collective progress towards the Paris Agreement’s climate goals.

Grassi, Giacomo↗

Nuclear Structure Studies at the Limits of Stability

On the quest for a predictive model of atomic nuclei, the properties of rare isotopes have emerged as critical observables that benchmark extrapolations, identify missing physics ingredients in models, or that enable discovery science. Formerly NSCL and now FRIB facilitate world-leading experiments due to the availability of fast, stopped, and reaccelerated rare-isotope beams in conjunction with unique instruments. DOE-SC NP Award DE-SC0020451 supported from 2019 to 2023 MSU’s nuclear structure and reactions program that tackles compelling questions in the field with complementary techniques, probing single-particle and collective degrees of freedom in relevant regions of the nuclear chart and enabled developments that positioned the PIs and their research groups for first FRIB science.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Laser Lightcraft Performance

The purpose of this study is to establish the technical ground for modeling the physics of laser powered pulse detonation phenomenon. The principle of the laser power propulsion is that when high-powered laser is focused at a small area near the surface of a thruster, the intense energy causes the electrical breakdown of the working fluid (e.g. air) and forming high speed plasma (known as the inverse Bremsstrahlung, IB, effect). The intense heat and high pressure created in the plasma consequently causes the surrounding to heat up and expand until the thrust producing shock waves are formed. This complex process of gas ionization, increase in radiation absorption and the forming of plasma and shock waves will be investigated in the development of the present numerical model. In the first phase of this study, laser light focusing, radiation absorption and shock wave propagation over the entire pulsed cycle are modeled. The model geometry and test conditions of known benchmark experiments such as those in Myrabo's experiment will be employed in the numerical model validation simulations. The calculated performance data will be compared to the test data.

Chen, Yen-Sen↗

XAL-Based Applications and Online Models for LCLS

XAL, a high-level accelerator application framework originally developed at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory, has been adopted by the Linac Coherent Light Source (LCLS) project. The work includes proper relational database schema modification to better suit XAL configuration data requirement, addition of new device types for LCLS online modeling purpose, longitudinal coordinate system change to better represent the LCLS electron beam rather than proton or ion beam in the original SNS XAL design, intensively benchmark with MAD and present SLC modeling system for the online model, and various new features to the XAL framework. Storing online model data in a relational database and providing universal access methods for other applications is also described here.

43 PARTICLE ACCELERATORS↗

Validated Reactive Force Field Quantifies MXene Interfacial Properties, Mechanics, and Thermal Transport

MXenes combine rich surface chemistry, mechanical strength, and high conductivity for a multitude of emerging applications. Predictive modeling supports accelerated materials designs and has been limited by the absence of validated and transferable force fields. Here, we introduce an interpretable, reactive INTERFACE force field (IFF and IFF-R) for Ti 3 C 2 T x MXenes that is trained based on chemical knowledge and achieves quantitative agreement with experiments across lattice parameters (<0.5%), density (<0.2%), liquid contact angles, Raman spectra, and the in-plane elastic modulus (∼320 GPa). The models cover surface terminations from hydroxyl (−OH) to fluorine (−F) groups and are extensible to other chemistries. We introduce pH-resolved surface chemistry and identify dopamine adsorption mechanisms at MXene–aqueous interfaces supported by QCM-D and UV–Vis experiments. The data reveal coplanar and perpendicular binding modes and concentration-dependent multilayer assembly. We predict previously inaccessible properties, including termination-dependent cleavage energies, interlayer shear moduli and dynamic shear failure, nanoindentation and brittle fracture, anisotropic in-plane and out-of-plane thermal conductivities, including the role of defects. Agreement with available experimental data is consistently close and exceeds DFT accuracy across the benchmark properties examined. The IFF/IFF-R model is compatible with CHARMM, AMBER, OPLS, and CVFF force fields for simulations of MXenes with diverse surface terminations, electrolyte interfaces, biointerfaces, and polymer composites without additional parameters. Parameter sets, 3D models, and analysis scripts are provided for community use. The validated, reactive, and transferable IFF framework facilitates predictive design of MXene-based films, membranes, sensing interfaces, and composites.

MXene↗

Code Benchmark of Depressurized Conduction Cooldown Transient in the High Temperature Test Facility

This paper presents results from modeling of a depressurized conduction cooldown (DCC) transient at the High Temperature Test Facility (HTTF) as part of the OECD-NEA Thermal Hydraulics Code Validation Benchmark for High-Temperature Gas-Cooled Reactors using HTTF Data . This paper briefly describes the benchmark and the models being used. It then presents a comparison of steady state and transient results based on the Problem 2 Exercise 1A and 1B definitions. We compare block and helium temperature distributions, mass flow distribution, and energy balance in steady state. All models show comparable mass flow distributions and energy balances. The temperatures within the core and outer regions are comparable in all models too, but inner reflector temperatures can vary significantly. Despite that, we find that the models are in good agreement for the full-power steady state. In the DCC, we look at block temperature at the core midplane and RCCS water exit temperature. The INL and ANL models are found to be in excellent agreement with one another on block temperature over time, while the agreement when the KAERI and NRG models are added into consideration is good. Differences in the transient heat removal from the RCCS cause the differences in block temperature over time in these models. The CNL models show similar trends to the INL, ANL, KAERI, and NRG models, but the temperatures are high because the volumes used in calculating the average temperature include the heater rods in the CNL models only. The HUN-REN model shows results that suggest significantly lower heat removal in the RCCS which merit further investigation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Trapped gyro-Landau-fluid transport modeling of DIII-D hybrid discharges

Previous work has summarized the physics and first results of benchmarking the trapped gyro-Landau-fluid (TGLF) model for turbulent transport driven by trapped ion and electron modes, ion and electron temperature gradient (ETG) modes, and electromagnetic kinetic ballooning modes including the effects of shaped geometry. Recently, an improved collision model was implemented which provides a more accurate fit to a transport database of nonlinear collisional GYRO[J. Candy and R. E. Waltz, J. Comput. Phys. 186, 545 (2003)] simulations of long wavelength driftwave turbulence. The impact of the new collision model on TGLF modeling results was unknown. Using the improved TGLF model we obtain excellent agreement with the ion and electron temperature profiles from 30 DIII-D [A. Mahdavi and J. L. Luxon, Fusion Sci. Technol. 48, 2 (2005)] hybrid discharges. The transport results show that the electron energy transport tends to be dominated by short wavelength ETG modes in cases where the ion energy transport approaches neoclassical levels. The hybrid regime has significant energy confinement improvement from ExB velocity shear which is well predicted by TGLF. Weak magnetic shear and low safety factor are also shown to enhance the hybrid regime energy confinement. In high normalized {beta} hybrids, we find that finite {beta} effects noticably reduce the predicted electron energy transport and improve agreement with the measured electron temperature profiles.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Benchmark studies of thermal jet mixing in SFRs using a two-jet model

To guide the modeling, simulations and design of Sodium Fast Reactors (SFRs), we explore and compare the predictive capabilities of two numerical solvers COMSOL and OpenFOAM in the thermal jet mixing of two buoyant jets typical of the outlet flow from a SFR tube bundle. This process will help optimize on-going experimental efforts at obtaining high resolution data for V and V of CFD codes as anticipated in next generation nuclear systems. Using the k-{epsilon} turbulence models of both codes as reference, their ability to simulate the turbulence behavior in similar environments was first validated for single jet experimental data reported in literature. This study investigates the thermal mixing of two parallel jets having a temperature difference (hot-to-cold) {Delta}T{sub hc}= 5 deg. C, 10 deg. C and velocity ratios U{sub c}/U{sub h} = 0.5, 1. Results of the computed turbulent quantities due to convective mixing and the variations in flow field along the axial position are presented. In addition, this study also evaluates the effect of spacing ratio between jets in predicting the flow field and jet behavior in near and far fields. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

ZPR-3 Assembly 6F : A spherical assembly of highly enriched uranium, depleted uranium, aluminum and steel with an average {sup 235}U enrichment of 47 atom %.

Over a period of 30 years, more than a hundred Zero Power Reactor (ZPR) critical assemblies were constructed at Argonne National Laboratory. The ZPR facilities, ZPR-3, ZPR-6, ZPR-9 and ZPPR, were all fast critical assembly facilities. The ZPR critical assemblies were constructed to support fast reactor development, but data from some of these assemblies are also well suited for nuclear data validation and to form the basis for criticality safety benchmarks. A number of the Argonne ZPR/ZPPR critical assemblies have been evaluated as ICSBEP and IRPhEP benchmarks. Of the three classes of ZPR assemblies, engineering mockups, engineering benchmarks and physics benchmarks, the last group tends to be most useful for criticality safety. Because physics benchmarks were designed to test fast reactor physics data and methods, they were as simple as possible in geometry and composition. The principal fissile species was {sup 235}U or {sup 239}Pu. Fuel enrichments ranged from 9% to 95%. Often there were only one or two main core diluent materials, such as aluminum, graphite, iron, sodium or stainless steel. The cores were reflected (and insulated from room return effects) by one or two layers of materials such as depleted uranium, lead or stainless steel. Despite their more complex nature, a small number of assemblies from the other two classes would make useful criticality safety benchmarks because they have features related to criticality safety issues, such as reflection by soil-like material. ZPR-3 Assembly 6 consisted of six phases, A through F. In each phase a critical configuration was constructed to simulate a very simple shape such as a slab, cylinder or sphere that could be analyzed with the limited analytical tools available in the 1950s. In each case the configuration consisted of a core region of metal plates surrounded by a thick depleted uranium metal reflector. The average compositions of the core configurations were essentially identical in phases A - F. ZPR-3 Assembly 6F (ZPR-3/6F), the final phase of the Assembly 6 program, simulated a spherical core with a thick depleted uranium reflector. ZPR-3/6F was designed as a fast reactor physics benchmark experiment with an average core {sup 235}U enrichment of approximately 47 at.%. Approximately 81.4% of the total fissions in this assembly occur above 100 keV, approximately 18.6% occur below 100 keV, and essentially none below 0.625 eV - thus the classification as a 'fast' assembly. This assembly is Fast Reactor Benchmark No. 7 in the Cross Section Evaluation Working Group (CSEWG) Benchmark Specifications and has historically been used as a data validation benchmark assembly. Loading of ZPR-3/6F began in late December 1956, and the experimental measurements were performed in January 1957. The core consisted of highly enriched uranium (HEU) plates, depleted uranium plates, perforated aluminum plates and stainless steel plates loaded into aluminum drawers, which were inserted into the central square stainless steel tubes of a 31 x 31 matrix on a split table machine. The core unit cell consisted of three columns of 0.125 in.-wide (3.175 mm) HEU plates, three columns of 0.125 in.-wide depleted uranium plates, nine columns of 0.125 in.-wide perforated aluminum plates and one column of stainless steel plates. The maximum length of each column of core material in a drawer was 9 in. (228.6 mm). Because of the goal to produce an approximately spherical core, core fuel and diluent column lengths generally varied between adjacent drawers and frequently within an individual drawer. The axial reflector consisted of depleted uranium plates and blocks loaded in the available space in the front (core) drawers, with the remainder loaded into back drawers behind the front drawers. The radial reflector consisted of blocks of depleted uranium loaded directly into the matrix tubes. The assembly geometry approximated a reflected sphere as closely as the square matrix tubes, the drawers and the shapes of fuel and diluent plates allowed. According to the logbook and loading records for ZPR-3/6F, the reference critical configuration was loading 5 which was critical on January 4, 1957. The subsequent loadings were very similar but were less clean for criticality because there were modifications made to accommodate reactor physics measurements other than criticality. Accordingly, ZPR-3/6F loading 5 was selected as the only configuration for this benchmark. As documented below, it was determined to be acceptable as a criticality safety benchmark experiment. A very accurate transformation to a simplified model is needed to make any ZPR assembly a practical criticality-safety benchmark. There is simply too much geometric detail in an exact (as-built) model of a ZPR assembly. This is especially true of ZPR-3/6F because of the complex core loading required to approximate a sphere with rectangular plates in a square matrix.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Iso-Energy-Efficiency: An Approach to Power Constrained Parallel Computation

Future large scale high performance supercomputer systems require high energy efficiency to achieve exaflops computational power and beyond. Despite the need to understand energy efficiency in high-performance systems, there are few techniques to evaluate energy efficiency at scale. In this paper, we propose a system level iso-energy-efficiency model to analyze, evaluate and predict energy-performance of data intensive parallel applications with various execution patterns running on large scale power-aware clusters. Our analytical model can help users explore the effects of machine and application dependent characteristics on system energy efficiency and isolate efficient ways to scale system parameters (e.g. processor count, CPU power/frequency, workload size and network bandwidth) to balance energy use and performance. We derive our iso-energy-efficiency model and apply it to the NAS Parallel Benchmarks on two power-aware clusters. Our results indicate that the model accurately predicts total system energy consumption within 5% error on average for parallel applications with various execution and communication patterns. We demonstrate effective use of the model for various application contexts and in scalability decision-making.

Song, Shuaiwen↗

Combustion chamber analysis code

A three-dimensional, time dependent, Favre averaged, finite volume Navier-Stokes code has been developed to model compressible and incompressible flows (with and without chemical reactions) in liquid rocket engines. The code has a non-staggered formulation with generalized body-fitted-coordinates (BFC) capability. Higher order differencing methodologies such as MUSCL and Osher-Chakravarthy schemes are available. Turbulent flows can be modeled using any of the five turbulent models present in the code. A two-phase, two-liquid, Lagrangian spray model has been incorporated into the code. Chemical equilibrium and finite rate reaction models are available to model chemically reacting flows. The discrete ordinate method is used to model effects of thermal radiation. The code has been validated extensively against benchmark experimental data and has been applied to model flows in several propulsion system components of the SSME and the STME.

Przekwas, A. J.↗