Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Validation Experiments of Incipient Turbulent Separation over an Axisymmetric Afterbody

Historically, the flow physics involved with most turbulent separated flows have presented fundamental challenges in validation between experimental and numerical approaches. As recognized by the CFD Vision 2030 study commissioned by NASA, validation of Reynolds-averaged Navier-Stokes (RANS) models and other scale-resolving methods for turbulent separated flow requires the support of advanced, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, a new test platform, referred to as the NASA Axisymmetric Afterbody, was designed to obtain detailed information of the flow field over a smooth body, undergoing adverse pressure gradient induced separation for a fixed Reynolds number, Re = 180,000. The parametric body offers a range of flow states from fully attached,incipient separation, to fully separated flow based on variable afterbody geometries. In an initial effort to evaluate RANS turbulence model capabilities, the present configuration of the axisymmetric model features a mild adverse pressure gradient over the contoured boattail section, inducing incipient turbulent separation. Experiments include steady pressure measurements to serve as preliminary comparisons to simulation studies, which examine the effect of variable grid domains and RANS turbulence models, in an effort to understand and evaluate the critical variability between solutions for the present configuration. Results indicate potential discrepancies may be due to the effect of the square tunnel test section walls, relatively large blockage ratio, and inconsistent reference parameters. Ongoing work will focus on the experimental campaigns to obtain surface flow visualizations and high-resolution, off-body flow field measurements using Stereoscopic Particle Image Velocimetry (SPIV) and Laser Doppler Velocimetry (LDV) techniques to provide a detailed benchmark dataset to aid turbulence modelers.

axisymmetric afterbody↗
NASA NTRSDate not supplied

Comprehensive 3D Multiphysics Model on Electrochemical Recovery of O 2 from Metabolic CO 2 at the International Space Station (ISS)

The International Space Station (ISS) is presently equipped with an elaborate, heavy, and high-power consuming system that recovers approximately 50% of O 2 from metabolic CO 2 as part of the atmospheric revitalization (AR) at the ISS habitat. Future long-duration missions will require a sustainable and efficient system capable of yielding a minimum of 75% O 2 recovery to reach the self-sufficiency required for long space missions beyond earth’s low orbit. A Macrofluidic Electrochemical Reactor (MFECR) technology development effort is currently underway at NASA Marshall Space Flight Center (MSFC) to not only increase significantly current O 2 recovery efficiency, improving self-sufficiency on AR at the ISS habitat and future long missions, but also reduce the complexity of the system. The authors have developed and deployed a comprehensive 3D multiphysics model that thoroughly replicates the actual configuration and fluid/material domains of the MFECR. The coupled physics in this multiphysics model include multicomponent-multiphase electrochemical-driven reactions, non-ideal mass transport mechanism, free and porous flow, heat transfer, CO 2 solubility on alkaline electrolyte, water condensation on porous medium, and DC electrical current generation along with Joule heating effect. This model is aimed to conduct quantitive benchmark on three different MFECR’s layouts, one without serpentine paths (plain) and two with serpentines leading to four and twelve paths respectively. Once experimental data is generated via a test matrix of 200 tests, the model will be validated to conduct MFECR’s process optimization and revalidate the quantitive benchmark on three different MFECR’s layouts.

Jesus A. Dominguez↗
DOE OSTI2023

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

We evaluate AI-assisted generative capabilities on fundamental numerical kernels in high-performance computing (HPC), including AXPY, GEMV, GEMM, SpMV, Jacobi Stencil, and CG. We test the generated kernel codes for a variety of language-supported programming models, including (1) C++ (e.g., OpenMP [including offload], OpenACC, Kokkos, SyCL, CUDA, and HIP), (2) Fortran (e.g., OpenMP [including offload] and OpenACC), (3) Python (e.g., numpy, Numba, cuPy, and pyCUDA), and (4) Julia (e.g., Threads, CUDA.jl, AMDGPU.jl, and KernelAbstractions.jl). We use the GitHub Copilot capabilities powered by the GPT-based OpenAI Codex available in Visual Studio Code as of April 2023 to generate a vast amount of implementations given simple + + prompt variants. To quantify and compare the results, we propose a proficiency metric around the initial 10 suggestions given for each prompt. Results suggest that the OpenAI Codex outputs for C++ correlate with the adoption and maturity of programming models. For example, OpenMP and CUDA score really high, whereas HIP is still lacking. We found that prompts from either a targeted language such as Fortran or the more general purpose Python can benefit from adding code keywords, while Julia prompts perform acceptably well for its mature programming models (e.g., Threads and CUDA.jl). We expect for these benchmarks to provide a point of reference for each programming model's community. Overall, understanding the convergence of large language models, AI, and HPC is crucial due to its rapidly evolving nature and how it is redefining human-computer interactions.

Godoy, William↗
DOE OSTI2023

Understanding Portability of Automotive Workload: A Case Study with the Points-to-Image Kernel in SYCL on Heterogeneous Computing Platforms

SYCL is a promising programming model for heterogenous computing across vendors’ devices. In this paper, we study whether SYCL can be applied to an automotive workload and its portability on heterogeneous computing platforms. We explain the automotive benchmark, describe our implementations and optimizations of the benchmark, and evaluate the performance of the benchmarks using SYCL and other programming models on heterogeneous computing devices. The study also allows us to have a better understanding of portability of the benchmark across these platforms.

Jin, Zheming↗
DOE OSTI2026

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗
DOE OSTI2024

Measuring differential particle correlations in relativistic nuclear collisions

This study explores the transverse momentum ( p T ) dependencies of symmetric and asymmetric correlations (SC and ASC) with one and two particles of interest in Au + Au collisions at 200 GeV. Leveraging a multiphase transport (AMPT) model, the investigation delves into the sensitivity of these correlations to the final state effects, providing valuable insights into their potential for constraining the final state effects' p T dependencies. The HIJING model is employed as a benchmark for nonflow correlations, shedding light on their impact on interpreting SC and ASC data. Moreover, the study points out that differential SC and ASC with one and two particles of interest (POIs) typically incorporate contributions from event-plane angle fluctuations. Consequently, this work highlights the significance of SC and ASC with one and two POIs as valuable tools for investigating the p T nature of the final state effects and advocates for comprehensive experimental measurements across various beam energies and system sizes to enhance understanding and provide additional constraints for theoretical models. Published by the American Physical Society 2024

Physics↗
DOE OSTI2024

Development and application of hybrid AIMD/cDFT simulations for atomic-to-mesoscale chemistry

Many important chemical processes involve reactivity and dynamics in complex solutions. Gaining a fundamental understanding of these reaction mechanisms is a challenging goal that requires advanced computational and experimental approaches. However, important techniques such as molecular simulation have limitations in terms of scales of time, length, and system complexity. Furthermore, among the currently available solvation models, there are very few designed to describe the interaction between the molecular scale and the mesoscale. To help address this challenge, here, we establish a novel hybrid approach that couples first-principles plane-wave density functional theory with classical density functional theory (cDFT). In this approach, a region of interest described by ab initio molecular dynamics (AIMD) interacts with the surrounding medium described using cDFT to arrive at a self-consistent ground state. cDFT is a robust but efficient mesoscopic approach to accurate thermodynamics of bulk electrolyte solutions over a wide concentration range (up to 2M concentrations). Benchmarking against commonly used continuum models of solvation, such as SMD, as well as experiments, demonstrates that our hybrid AIMD–cDFT method is able to produce reasonable solvation energies for a variety of molecules and ions. With this model, we also examined the solvent effects on a prototype S N 2 reaction of the nucleophilic attack of a chloride ion on methyl chloride in the solution. The resulting reaction pathway profile and the solution phase barrier agree well with experiment, showing that our AIMD/cDFT hybrid approach can provide insight into the specific role of the solvent on the reaction coordinate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Critical adjustment of land mitigation pathways for assessing countries' climate progress

Collective progress towards the Paris Agreement’s temperature targets will be assessed by the Agreement’s Global Stocktake process. Global emission pathways by Integrated Assessment Models (IAMs) are a likely benchmark against which aggregated countries’ greenhouse gas mitigation pledges will be assessed. However, this approach requires comparability, which is currently hampered by a 5 GtCO2yr-1 mismatch between the estimated global land anthropogenic flux of IAMs and countries’ GHG inventories (GHGIs) for 2005-2015. We show that this gap is mostly the result of differences in how the anthropogenic forest sink is defined. Countries define managed forest more broadly than IAMs, and on this larger area typically consider anthropogenic also fluxes due to human-induced environmental change, which IAMs do not include their pathways. Using five IAMs and a dynamic global vegetation model (DGVM), we present and apply a novel method that adjusts IAM results to the countries’ definition, closing the gap with GHGIs at global and regional scale. When expressed in a way compatible with GHGIs, adjusted 1.5°C and well-below 2°C pathways have a cumulative CO2 balance until carbon neutrality that is 110–176 GtCO2 lower than the original IAMs pathways. The use of these country-compatible emission pathways under the Global Stocktake would therefore be essential for an accurate assessment of the collective progress towards the Paris Agreement’s climate goals.

Grassi, Giacomo↗
DOE OSTI2024

Nuclear Structure Studies at the Limits of Stability

On the quest for a predictive model of atomic nuclei, the properties of rare isotopes have emerged as critical observables that benchmark extrapolations, identify missing physics ingredients in models, or that enable discovery science. Formerly NSCL and now FRIB facilitate world-leading experiments due to the availability of fast, stopped, and reaccelerated rare-isotope beams in conjunction with unique instruments. DOE-SC NP Award DE-SC0020451 supported from 2019 to 2023 MSU’s nuclear structure and reactions program that tackles compelling questions in the field with complementary techniques, probing single-particle and collective degrees of freedom in relevant regions of the nuclear chart and enabled developments that positioned the PIs and their research groups for first FRIB science.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2000

Laser Lightcraft Performance

The purpose of this study is to establish the technical ground for modeling the physics of laser powered pulse detonation phenomenon. The principle of the laser power propulsion is that when high-powered laser is focused at a small area near the surface of a thruster, the intense energy causes the electrical breakdown of the working fluid (e.g. air) and forming high speed plasma (known as the inverse Bremsstrahlung, IB, effect). The intense heat and high pressure created in the plasma consequently causes the surrounding to heat up and expand until the thrust producing shock waves are formed. This complex process of gas ionization, increase in radiation absorption and the forming of plasma and shock waves will be investigated in the development of the present numerical model. In the first phase of this study, laser light focusing, radiation absorption and shock wave propagation over the entire pulsed cycle are modeled. The model geometry and test conditions of known benchmark experiments such as those in Myrabo's experiment will be employed in the numerical model validation simulations. The calculated performance data will be compared to the test data.

Chen, Yen-Sen↗
DOE OSTI2026

Validated Reactive Force Field Quantifies MXene Interfacial Properties, Mechanics, and Thermal Transport

MXenes combine rich surface chemistry, mechanical strength, and high conductivity for a multitude of emerging applications. Predictive modeling supports accelerated materials designs and has been limited by the absence of validated and transferable force fields. Here, we introduce an interpretable, reactive INTERFACE force field (IFF and IFF-R) for Ti 3 C 2 T x MXenes that is trained based on chemical knowledge and achieves quantitative agreement with experiments across lattice parameters (<0.5%), density (<0.2%), liquid contact angles, Raman spectra, and the in-plane elastic modulus (∼320 GPa). The models cover surface terminations from hydroxyl (−OH) to fluorine (−F) groups and are extensible to other chemistries. We introduce pH-resolved surface chemistry and identify dopamine adsorption mechanisms at MXene–aqueous interfaces supported by QCM-D and UV–Vis experiments. The data reveal coplanar and perpendicular binding modes and concentration-dependent multilayer assembly. We predict previously inaccessible properties, including termination-dependent cleavage energies, interlayer shear moduli and dynamic shear failure, nanoindentation and brittle fracture, anisotropic in-plane and out-of-plane thermal conductivities, including the role of defects. Agreement with available experimental data is consistently close and exceeds DFT accuracy across the benchmark properties examined. The IFF/IFF-R model is compatible with CHARMM, AMBER, OPLS, and CVFF force fields for simulations of MXenes with diverse surface terminations, electrolyte interfaces, biointerfaces, and polymer composites without additional parameters. Parameter sets, 3D models, and analysis scripts are provided for community use. The validated, reactive, and transferable IFF framework facilitates predictive design of MXene-based films, membranes, sensing interfaces, and composites.

MXene↗
DOE OSTI2024

Code Benchmark of Depressurized Conduction Cooldown Transient in the High Temperature Test Facility

This paper presents results from modeling of a depressurized conduction cooldown (DCC) transient at the High Temperature Test Facility (HTTF) as part of the OECD-NEA Thermal Hydraulics Code Validation Benchmark for High-Temperature Gas-Cooled Reactors using HTTF Data . This paper briefly describes the benchmark and the models being used. It then presents a comparison of steady state and transient results based on the Problem 2 Exercise 1A and 1B definitions. We compare block and helium temperature distributions, mass flow distribution, and energy balance in steady state. All models show comparable mass flow distributions and energy balances. The temperatures within the core and outer regions are comparable in all models too, but inner reflector temperatures can vary significantly. Despite that, we find that the models are in good agreement for the full-power steady state. In the DCC, we look at block temperature at the core midplane and RCCS water exit temperature. The INL and ANL models are found to be in excellent agreement with one another on block temperature over time, while the agreement when the KAERI and NRG models are added into consideration is good. Differences in the transient heat removal from the RCCS cause the differences in block temperature over time in these models. The CNL models show similar trends to the INL, ANL, KAERI, and NRG models, but the temperatures are high because the volumes used in calculating the average temperature include the heater rods in the CNL models only. The HUN-REN model shows results that suggest significantly lower heat removal in the RCCS which merit further investigation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1993

Combustion chamber analysis code

A three-dimensional, time dependent, Favre averaged, finite volume Navier-Stokes code has been developed to model compressible and incompressible flows (with and without chemical reactions) in liquid rocket engines. The code has a non-staggered formulation with generalized body-fitted-coordinates (BFC) capability. Higher order differencing methodologies such as MUSCL and Osher-Chakravarthy schemes are available. Turbulent flows can be modeled using any of the five turbulent models present in the code. A two-phase, two-liquid, Lagrangian spray model has been incorporated into the code. Chemical equilibrium and finite rate reaction models are available to model chemically reacting flows. The discrete ordinate method is used to model effects of thermal radiation. The code has been validated extensively against benchmark experimental data and has been applied to model flows in several propulsion system components of the SSME and the STME.

Przekwas, A. J.↗
DOE OSTI2022

Benchmark Specifications for Select Experiments Conducted at the Kansas State University Gallium Thermal-hydraulic Experiment Facility

The Department of Energy (DOE) – Nuclear Energy University Programs (NEUP) supported the creation and operation of the Gallium Thermal-hydraulic Experiment (GaTE) facility at Kansas State University (KSU) as part of a larger effort to understand thermal stratification behavior in liquid-metal-cooled reactors. GaTE was designed to simulate transients in a reactor plenum that are known to cause thermal stratification. High-reliability and high-resolution measurements describing stratification behavior in the coolant were collected for use as experimental benchmarks in validation efforts for computational models. The results of these tests contribute to a greater understanding of thermal stratification behavior of liquid metal under various configurations and operating conditions. This report provides a complete description of the benchmark problem, including all necessary details and description of a set of four forced flow and four natural circulation tests and measured data for comparison with model results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Comparative studies of 2HDMs under the Higgs boson precision measurements

We perform comparative studies for four types of the two Higgs Doublet Models (2HDMs) under the precision measurements of the Standard Model (SM) Higgs observables at the proposed Higgs factories. We explore the discovery potential based on the hypothetical deviations in the precision data for the 2HDMs up to one-loop level. We find 5σ observability from the χ2 fitting in a significant theory parameter space at future Higgs factories. For the Type-I 2HDM, regions with cos(β - α) ≲ -0.1 or cos(β - α) ≳ 0.08 are discoverable at more than 5σ level. For the other three types of 2HDMs, the 5σ region is even bigger: | cos(β - α)| ≳ 0.02 for tan β ~ 1. At small and large values of tan β, the region in cos(β - α) is further tightened. We examine the extent to which the different 2HDM theories may be distinguishable from one to the other at the 95% Confidence Level with four benchmark points as case studies. We show that a large part of the parameter space of the other types of 2HDMs can be distinguished from the benchmark points of the target model. The impacts of loop corrections are found to be significant in certain parameter regions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Multigroup Examination of Nickel-Reflected HEU System

Critical configurations of HEU-MET-FAST-003 (HMF-003) from the International Criticality Safety Benchmark Evaluation Project Handbook were modeled for addition into the Verified, Archived Library of Inputs and Data maintained at Oak Ridge National Laboratory. HMF-003 contains models of a highly enriched uranium sphere with a spherical metal reflector of natural uranium, tungsten carbide, or nickel. For these simple models, good agreement is expected between the k eff calculated with continuous-energy (CE) and multigroup (MG) transport. However, using the CSAS5 sequence of the SCALE 6.2.4 package, the 8 in. thick nickel reflector model resulted in a difference of around 1.2 % Δ k . Results presented a clear indication of poor performance for the SCALE 252-group based on ENDF/B-VII.1 cross section library for this model. The bias was investigated over a range of nickel thickness and then compared with other MG libraries available in SCALE 6.2.4. As the nickel thickness increases, the MG k eff deviates from the CE result, confirming a performance issue with the MG calculation. Additionally, the reactions were compared between the two libraries to help determine the cause of k eff bias. Finally, additional MG libraries within SCALE 6.3 and based on ENDF/B-VII.1 and ENDF/B-VIII were reviewed. The 302-group and 1597-group result in significant improvements compared with the 252-group library. Nickel cross sections were modified from ENDF/B-VII.1 to ENDF/B-VIII. For the ENDF/B-VIII library, the deviation between the CE libraries and MG libraries is less pronounced than for ENDF/VII.1, except for the 1597-group. This examination clearly indicates the importance of validating calculations with applicable benchmark experiments and caution when using MG libraries.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Performance-Aligned LLMs for Generating Fast HPC Code

Optimizing scientific software is a difficult task because codebases are often large and complex, and performance can depend upon several factors including the algorithm, its implementation, and hardware among others. Causes of poor performance can originate from disparate sources and be difficult to diagnose. Recent years have seen a multitude of work that use large language models (LLMs) to assist in software development tasks. However, these tools are trained to model the distribution of code as text, and are not specifically designed to understand performance aspects of code. In this work, we introduce a reinforcement learning based methodology to align the outputs of code LLMs with performance. This allows us to build upon the current code modeling capabilities of LLMs and extend them to generate better performing code. Here, we demonstrate that our fine-tuned model improves the expected speedup of generated code over base models for a set of benchmark tasks from 0.9 to 1.6 for serial code and 1.9 to 4.5 for OpenMP parallel code.

Computer science↗