Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Enhancing ChatPORT with CUDA-to-SYCL Kernel Translation Capability

Large Language Models (LLMs) have shown strong capabilities in general code translation. However, code translation involving parallel programming models remains largely unexplored. This work enhances the capabilities of code LLMs in CUDA-to-SYCL kernel translation with parameter-efficient fine-tuning. The resultant fine-tuned LLM, called ChatPORT, is an effort to provide high-fidelity translations from one programming model to another. We describe the preparation of datasets from heterogeneous computing benchmarks for model fine-tuning and testing, the parameter-efficient fine-tuning of 19 open-source code models ranging in size from 0.5 to 34 billion parameters and evaluate the correctness rates of the SYCL kernels by the fine-tuned models. The experimental results show that most code models fail to translate CUDA codes to SYCL correctly. However, fine-tuning these models using a small set of CUDA and SYCL kernels can enhance the capabilities of these models in kernel translation. Depending on the sizes of the models, the correctness rate ranges from 19.9% to 81.7% for a test dataset of 62 CUDA kernels.

Jin, Zheming [ORNL] (ORCID:000000027197780X)↗

Characterization and Modeling of Grain Boundary Chemistry Evolution in Ferritic Steels under Irradiation

Ferritic/martensitic (FM) steels such as HT-9, T-91 and NF12 with chromium concentrations in the range of 9-12 at.% Cr and high Cr ferritic steels (oxide dispersion strengthened steels with 12-18% Cr) are receiving increasing attention for advanced nuclear applications, e.g. cladding and duct materials for sodium fast reactors, pressure vessels in Generation IV reactors and first wall structures in fusion reactors, thanks to their advantages over austenitic alloys. Predicting the behavior of these alloys under radiation is an essential step towards the use of these alloys. Several radiation-induced phenomena need to be taken into account, including phase separation, solute clustering, and radiation-induced segregation or depletion (RIS) to point defect sinks. RIS at grain boundaries has raised significant interest because of its role in irradiation assisted stress corrosion cracking (IASCC) and corrosion of structural materials. Numerous observations of RIS have been reported on austenitic stainless steels where it is generally found that Cr depletes at grain boundaries, consistently with Cr atoms being oversized in the fcc Fe matrix. While FM and ferritic steels are also subject to RIS at grain boundaries, unlike austenitic steels, the behavior of Cr is less clear with significant scatter and no clear dependency on irradiation condition or alloy type. In addition to the lack of conclusive experimental evidence regarding RIS in F-M alloys, there have been relatively few efforts at modeling RIS behavior in these alloys. The need for predictability of materials behavior and mitigation routes for IASCC requires elucidating the origin of the variable Cr behavior. A systematic detailed high-resolution structural and chemical characterization approach was applied to ion-implanted and neutron-irradiated model Fe-Cr alloys containing from 3 to 18 at.% Cr. Atom probe tomography analyses of the microstructures revealed slight Cr clustering and segregation to dislocations and grain boundaries in the ion-irradiated alloys. More significant segregation was observed in the neutron irradiated alloys. For the more concentrated alloys, irradiation did not affect existing Cr segregation to grain boundaries and segregation to dislocation loops was not observed perhaps due to a change in the dislocation loop structure with increasing Cr concentration. Precipitation of α’ was observed in the neutron irradiated alloys containing over 9 at.% Cr. However ion irradiation appears to suppress the precipitation process. Initial low dose ion irradiation experiments strongly suggest a cascade recoil effect. The systematic analysis of grain boundary orientation on Cr segregation was significantly challenged by carbon contamination during ion irradiation or by existing carbon and therefore carbide formation at grain boundaries (sensitization). The combination of the proposed systematic experimental approach with atomistic modeling of diffusion processes directly addresses the programmatic need for developing and benchmarking predictive models for material degradation taking into account atomistic kinetics parameters

36 MATERIALS SCIENCE↗

Mathematical Basis and Test Cases for Colloid-Facilitated Radionuclide Transport Modeling in GDSA-PFLOTRAN

This report provides documentation of the mathematical basis for a colloid-facilitated radionuclide transport modeling capability that can be incorporated into GDSA-PFLOTRAN. It also provides numerous test cases against which the modeling capability can be benchmarked once the model is implemented numerically in GDSA-PFLOTRAN. The test cases were run using a 1-D numerical model developed by the author, and the inputs and outputs from the 1-D model are provided in an electronic spreadsheet supplement to this report so that all cases can be reproduced in GDSA-PFLOTRAN, and the outputs can be directly compared with the 1-D model. The cases include examples of all potential scenarios in which colloid-facilitated transport could result in the accelerated transport of a radionuclide relative to its transport in the absence of colloids. Although it cannot be claimed that all the model features that are described in the mathematical basis were rigorously exercised in the test cases, the goal was to test the features that matter the most for colloid-facilitated transport; i.e., slow desorption of radionuclides from colloids, slow filtration of colloids, and equilibrium radionuclide partitioning to colloids that is strongly favored over partitioning to immobile surfaces, resulting in a substantial fraction of radionuclide mass being associated with mobile colloids.

54 ENVIRONMENTAL SCIENCES↗

Eddy Current Flow Meter Measurements and Modeling Validation

The goal of the eddy current flow meter (ECFM) is to monitor velocities and temperatures of conductive liquid metals. The ECFM can also detect voids in two-phase liquid metal flows. Measurement of these flows can greatly improve the accuracy of the empirical formulas used for fluid dynamics near the reactor core and aid in mapping any non-uniformities in fluid flow such as estimates of temperature and phase. While the eventual goal is to develop the ECFM for the liquid sodium surrounding the Versatile Test Reactor (VTR) core, this report focuses on modeling and experimental validation of ECFM for a moving solid test rod and for liquid mercury in the Target Test Facility (TTF) flow loop to better understand and further develop ECFM measurement capabilities by validating model predictions with benchmark experiments. Eventually the models could be used to design and optimize future ECFMs for specific applications such as monitoring flow within the VTR pool.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Impacts of droughts and extreme-temperature events on gross primary production and ecosystem respiration: a systematic assessment across ecosystems and climate zones

Extreme climatic events, such as droughts and heat stress, induce anomalies in ecosystem–atmosphere CO 2 fluxes, such as gross primary production (GPP) and ecosystem respiration (R eco ), and, hence, can change the net ecosystem carbon balance. However, despite our increasing understanding of the underlying mechanisms, the magnitudes of the impacts of different types of extremes on GPP and R eco within and between ecosystems remain poorly predicted. Here we aim to identify the major factors controlling the amplitude of extreme-event impacts on GPP, R eco , and the resulting net ecosystem production (NEP). We focus on the impacts of heat and drought and their combination. We identified hydrometeorological extreme events in consistently downscaled water availability and temperature measurements over a 30-year time period. We then used FLUXNET eddy covariance flux measurements to estimate the CO 2 flux anomalies during these extreme events across dominant vegetation types and climate zones. Overall, our results indicate that short-term heat extremes increased respiration more strongly than they downregulated GPP, resulting in a moderate reduction in the ecosystem's carbon sink potential. In the absence of heat stress, droughts tended to have smaller and similarly dampening effects on both GPP and R eco and, hence, often resulted in neutral NEP responses. The combination of drought and heat typically led to a strong decrease in GPP, whereas heat and drought impacts on respiration partially offset each other. Taken together, compound heat and drought events led to the strongest C sink reduction compared to any single-factor extreme. A key insight of this paper, however, is that duration matters most: for heat stress during droughts, the magnitude of impacts systematically increased with duration, whereas under heat stress without drought, the response of R eco over time turned from an initial increase to a downregulation after about 2 weeks. This confirms earlier theories that not only the magnitude but also the duration of an extreme event determines its impact. Our study corroborates the results of several local site-level case studies but as a novelty generalizes these findings on the global scale. Specifically, we find that the different response functions of the two antipodal land–atmosphere fluxes GPP and R eco can also result in increasing NEP during certain extreme conditions. Apparently counterintuitive findings of this kind bear great potential for scrutinizing the mechanisms implemented in state-of-the-art terrestrial biosphere models and provide a benchmark for future model development and testing.

54 ENVIRONMENTAL SCIENCES↗

Building Energy Analysis of Manufactured and Multifamily Housing Types in Juneau, Alaska

This report details the results of building energy modeling analysis evaluating the potential energy savings, economic outcomes, and grid-level electricity reduction associated with cold climate air source heat pump (ccASHP) adoption across multifamily and manufactured housing (MMFH) building typologies in the City and Borough of Juneau (CBJ). Three building archetypes were evaluated: multifamily 4-plex apartments, multifamily 8-plex apartments, and manufactured housing units. Building energy models were developed using OpenStudio-HPXML and calibrated to actual utility consumption data and local meteorological data from the Juneau International Airport weather station using an automated calibration tool following the BPI-2400-S-2015 v.2 standard for model calibration. Occupant behaviors present the greatest variability in successful calibrations. Calibrated models were benchmarked against a baseline electric resistance heating condition, with the selected ccASHP modeled as the retrofit condition and typical meteorological year weather data for all results generation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Benchmarking of Probabilistic Fracture Mechanics Models in Grizzly

In 2020, as part of contract/task order 31310019N0006/31310020F0060, the Nuclear Regulatory Commission tasked Idaho National Laboratory (INL) with benchmarking the MOOSE/GRIZZLY code against the NRC’s Fracture Analysis of Vessels - Oak Ridge (FAVOR), version 16.1 code. Both codes can predict large light-water reactor vessel integrity deterministically and probabilistically. In fact, such predictions are the primary purpose of the FAVOR code, and are a main focus of the GRIZZLY code, although GRIZZLY is capable of modeling a wider range of geometries and problems. The vessel integrity modeling capabilities of the GRIZZLY code are still under development and being gradually expanded, and the capability to model vessel fracture by crack growth has not yet been integrated into GRIZZLY (although it does exist in pre-release versions). Thus, the present benchmark study focused on comparing predictions for the conditional probability of crack growth initiation (CPI) between GRIZZLY and FAVOR v16.1. The present benchmarking study expands on a previous study completed in 2020, which focused on single plate regions, various flaw types, and full vessel studies. The previous study was limited in scope and revealed some relatively large discrepancies, particularly in the case of weld regions. In the present study, detailed investigations into the sources of discrepancies between GRIZZLY and FAVOR were performed, with a focus on weld regions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

One pion production in neutrino reactions: Including nonresonant background

We investigate neutrino-induced one pion production on nucleons. The elementary neutrino-nucleon cross section is calculated as the sum of the leading Delta pole diagram and several background diagrams obtained within the nonlinear sigma model. This approach does not introduce any new adjustable parameters, which allows unambiguous predictions for the observables. Considering electroproduction experiments as benchmark, the model is shown to be applicable up to pion-nucleon invariant mass W<1.4 GeV and provides a good accuracy. With respect to the total one pion cross section, the model predicts the background at the level of 10% for the p{pi}{sup +}, 30% for p{pi}{sup 0}, and 50% for n{pi}{sup +} final states. The results are compared with experimental data for various differential cross sections. Distributions with respect to muon-nucleon and muon-pion invariant masses are presented for the first time. The model describes the data quite well, with the discrepancies being of the same order as those between different data sets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Benchmark problems for numerical implementations of phase field models

Here, we present the first set of benchmark problems for phase field models that are being developed by the Center for Hierarchical Materials Design (CHiMaD) and the National Institute of Standards and Technology (NIST). While many scientific research areas use a limited set of well-established software, the growing phase field community continues to develop a wide variety of codes and lacks benchmark problems to consistently evaluate the numerical performance of new implementations. Phase field modeling has become significantly more popular as computational power has increased and is now becoming mainstream, driving the need for benchmark problems to validate and verify new implementations. We follow the example set by the micromagnetics community to develop an evolving set of benchmark problems that test the usability, computational resources, numerical capabilities and physical scope of phase field simulation codes. In this paper, we propose two benchmark problems that cover the physics of solute diffusion and growth and coarsening of a second phase via a simple spinodal decomposition model and a more complex Ostwald ripening model. We demonstrate the utility of benchmark problems by comparing the results of simulations performed with two different adaptive time stepping techniques, and we discuss the needs of future benchmark problems. The development of benchmark problems will enable the results of quantitative phase field models to be confidently incorporated into integrated computational materials science and engineering (ICME), an important goal of the Materials Genome Initiative.

36 MATERIALS SCIENCE↗

A comprehensive dataset for the accelerated development and benchmarking of solar forecasting methods

We describe and release a comprehensive solar irradiance, imaging, and forecasting dataset. Our goal with this release is to provide standardized solar and meteorological datasets to the research community for the accelerated development and benchmarking of forecasting methods. The data consist of three years (2014–2016) of quality-controlled, 1-min resolution global horizontal irradiance and direct normal irradiance ground measurements in California. In addition, we provide overlapping data from commonly used exogenous variables, including sky images, satellite imagery, and Numerical Weather Prediction forecasts. We also include sample codes of baseline models for benchmarking of more elaborated models.

Remote sensing↗

Mixed-Oxide (MOX) Fuel Performance Benchmarks

Within the framework of the OECD/NEA Expert Group on Reactor-based Plutonium disposition (TFRPD), a fuel modeling code benchmarks for MOX fuel was initiated. This paper summarizes the calculation results provided by the contributors for the first two fuel performance benchmark problems. A limited sensitivity study of the effect of the rod power uncertainty on code predictions of fuel centerline temperature and fuel pin pressure also was performed and is included in the paper.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Mutual optical intensity propagation through non-ideal two-dimensional mirrors

The mutual optical intensity (MOI) model is a partially coherent radiation propagation tool that can sequentially simulate beamline optics and provide beam intensity, local degree of coherence and phase distribution at any location along a beamline. This paper extends the MOI model to non-ideal twodimensional (2D) optical systems, such as ellipsoidal and toroidal mirrors with 2D figure errors. Simulation results show that one can tune the trade-off between calculation efficiency and accuracy by varying the number of wavefront elements. The focal spot size of an ellipsoidal mirror calculated with 100 $\times$ 100 elements gives less than 0.4% deviation from that with 250 $\times$ 250 elements, and the computation speed is nearly two orders of magnitude faster. Effects of figure errors on 2D focusing are also demonstrated for a non-ideal ellipsoidal mirror and by comparing the toroidal and ellipsoidal mirrors. Finally, the MOI model is benchmarked against the multi-electron Synchrotron Radiation Workshop (SRW) code showing the model’s high accuracy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Project Arrangement NP-06 Feasibility study of the applicability for future advanced Pu direct monitoring technology for Pu solutions with FP at reprocessing plants - Gamma-ray Analysis

This report summarizes the efforts to investigate the gamma-ray radiation signatures present in High Active Liquid (HAL) to determine the feasibility of developing advanced plutonium monitoring technology for plutonium to improve safeguards verification measurements and nuclear material accountancy at the Tokai Reprocessing Plant. This includes the development of MCNP models of a waste tank and ion chamber and using experimental results to benchmark the model. With this model the expected dose rate and gamma radiation signatures could be determined for various volumes of liquid waste in the tank.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A Programming Model Performance Study Using the NAS Parallel Benchmarks

Harnessing the power of multicore platforms is challenging due to the additional levels of parallelism present. In this paper we use the NAS Parallel Benchmarks to study three programming models, MPI, OpenMP and PGAS to understand their performance and memory usage characteristics on current multicore architectures. To understand these characteristics we use the Integrated Performance Monitoring tool and other ways to measure communication versus computation time, as well as the fraction of the run time spent in OpenMP. The benchmarks are run on two different Cray XT5 systems and an Infiniband cluster. Our results show that in general the three programming models exhibit very similar performance characteristics. In a few cases, OpenMP is significantly faster because it explicitly avoids communication. For these particular cases, we were able to re-write the UPC versions and achieve equal performance to OpenMP. Using OpenMP was also the most advantageous in terms of memory usage. Also we compare performance differences between the two Cray systems, which have quad-core and hex-core processors. We show that at scale the performance is almost always slower on the hex-core system because of increased contention for network resources.

Shan, Hongzhang↗

A programming model performance study using the NAS parallel benchmarks

Harnessing the power of multicore platforms is challenging due to the additional levels of parallelism present. In this paper we use the NAS Parallel Benchmarks to study three programming models, MPI, OpenMP and PGAS to understand their performance and memory usage characteristics on current multicore architectures. To understand these characteristics we use the Integrated Performance Monitoring tool and other ways to measure communication versus computation time, as well as the fraction of the run time spent in OpenMP. The benchmarks are run on two different Cray XT5 systems and an Infiniband cluster. Our results show that in general the three programming models exhibit very similar performance characteristics. In a few cases, OpenMP is significantly faster because it explicitly avoids communication. For these particular cases, we were able to re-write the UPC versions and achieve equal performance to OpenMP. Using OpenMP was also the most advantageous in terms of memory usage. Also we compare performance differences between the two Cray systems, which have quad-core and hex-core processors.We show that at scale the performance is almost always slower on the hex-core system because of increased contention for network resources.

97 MATHEMATICS AND COMPUTING↗

Surrogate model evaluation and building energy benchmarking for commercial buildings

Building energy consumption benchmarking involves challenges associated with various energy patterns for different building types; heating, ventilating, and air-conditioning (HVAC) system types; and climates. Given significant variation in energy use patterns, accurate prediction of long-term energy use using surrogate models remains challenging. Multiple linear regression (MLR) is commonly used for building energy benchmarking because of its simple structure; however, it lacks accuracy compared to other black-box models. Although many studies have compared surrogate models and offer guidance on model selection based on metrics, they do not provide detailed analysis on improving the surrogate model accuracy. In this paper, we implement a surrogate model using polynomial ridge regression (i.e., MLR with interaction terms combined with ridge regularization) for small office and retail strip mall buildings across six HVAC system types and all climate zones, for electricity and natural gas in baseline and proposed scenarios. A simulation workflow is developed using OpenStudio TM /EnergyPlus TM to generate simulation data using measures over a wide range of efficiency inputs. Enhancements based on statistical insights are used for improving the model accuracy using filters, input transformations, and change points. Surrogate models achieved average coefficient of variation of the root mean squared error (CVRMSE) values of 2.17, 1.06, 2.05, and 3.26 for proposed electricity, proposed natural gas, baseline electricity, and baseline natural gas, respectively, with enhancements reducing CVRMSE by an average of 14.9% across all combinations. We provide model interpretation via Shapley additive explanations to determine which input variables most influence energy consumption and provide supportive arguments for enhancements.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Numerical simulation of parametric resonance in point absorbers using a simplified model

Abstract Parametric resonance is a non‐linear phenomenon in which a system can oscillate at a frequency different from its exciting frequency. Some wave energy converters are prone to this phenomenon, which is usually detrimental to their performance. Here, a computationally efficient way of simulating parametric resonance in point absorbers is presented. The model is based on linear potential theory, so the wave forces are evaluated at the mean position of the body. However, the first‐order variation of the body's centres of gravity and buoyancy is taken into account. This gives essentially the same result as a more rigorous approach of keeping terms in the equation of motion up to second order in the body motions. The only difference from a linear model is the presence of non‐zero off‐diagonal elements in the mass matrix. The model is benchmarked against state‐of‐the‐art non‐linear Froude–Krylov and computational fluid dynamics models for free decay, regular wave, and focused wave group cases. It is shown that the simplified model is able to simulate parametric resonance in pitch to a reasonable accuracy even though no non‐linear wave forces are included. The simulation speed on a standard computer is up to two orders of magnitude faster than real time.

16 TIDAL AND WAVE POWER↗

Auxiliary field Quantum Monte Carlo for dilute neutrons on the lattice

We employ constrained path Auxiliary Field Quantum Monte Carlo (AFQMC) in the pursuit of studying physical nuclear systems using a lattice formalism. Since AFQMC has been widely used in the study of condensed-matter systems such as the Hubbard model, we benchmark our method against published results for both one- and two-dimensional Hubbard model calculations. We then turn our attention to cold atomic and nuclear systems. We use an onsite contact interaction that can be tuned in order to reproduce the known scattering length and effective range of a given interaction. Developing this machinery allows us to extend our calculations to study nuclear systems within a lattice formalism. In conclusion, we perform initial calculations for a range of nuclear systems from two- to few-body neutron systems.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗