Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Bayesian Monte Carlo Evaluation Framework for Cross Sections Nuclear Data and Integral Benchmark Experiments

The new Bayesian Monte Carlo (MC) evaluation framework described in this abstract has been conceived as an attempt to improve nuclear data evaluations of differential crosssection data by removing the following two approximations conventionally employed for nuclear data evaluations: all probability density functions (PDFs) of all data and model parameters, both prior and posterior, are assumed to be normal (i.e., Gaussian) PDFs, and all uncertainties and covariances are propagated using a linear approximation. With these approximations removed, the Bayesian MC (BMC) framework could be used to account for nonlinear effects and would enable improved evaluations of differential cross sections and IBE data that are presently performed based on the assumptions itemized above. The BMC would also improve upon the uniform sampling of IBE parameters from within ranges defined by their evaluated uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

LLM Benchmarking with LLaMA2: Evaluating Code Development Performance Across Multiple Programming Languages

The rapid evolution of large language models (LLMs) has opened new possibilities for automating various tasks in software development. This paper evaluates the capabilities of the LLaMA 2-70B model in automating these tasks for scientific applications written in commonly used programming languages. Using representative test problems, we assess the model's capacity to generate code, documentation, and unit tests, as well as its ability to translate existing code between commonly used programming languages. Our comprehensive analysis evaluates the compilation, runtime behavior, and correctness of the generated and translated code. Additionally, we assess the quality of automatically generated code, documentation, and unit tests. Here, our results indicate that while LLaMA 2-70B frequently generates syntactically correct and functional code for simpler numerical tasks, it encounters substantial difficulties with more complex, parallelized, or distributed computations, requiring considerable manual corrections. We identify key limitations and suggest areas for future improvements to better leverage AI-driven automation in scientific computing workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A Big Problem for Small Earthquakes: Benchmarking Routine Magnitudes and Conversion Relationships with Coda Envelope-Derived Mw in Southern Kansas and Northern Oklahoma

Earthquake magnitudes are widely relied upon measures of earthquake size. Although moment magnitude (M w ) has become the established standard for moderate and large earthquakes, difficulty in reliably measuring seismic moments for small (generally M w <4) earthquakes has meant that magnitudes for these events remain plagued by a patchwork of inconsistent measurement scales. Because of this, magnitudes of small earthquakes and statistics derived from them can be biased. Furthermore, because small earthquakes are much more numerous than large ones, many applications, such as seismic hazard modeling, depend critically on analysis of events characterized by magnitudes other than M w . Therefore, to assess this problem, we apply coda envelope analysis to reliably determine moment magnitudes for a case study of small earthquakes from northern Oklahoma and southern Kansas. Not surprisingly, we find significant differences among M L , m bLg , and M w for M ~2–4 earthquakes examined here. More troublingly, we find that relations designed to convert other magnitudes to M w , which are relied upon for important applications such as seismic hazard analysis, often increase rather than decrease this bias for our dataset. In our case study, we find that converted magnitudes can result in a systematic bias sometimes exceeding 0.5 magnitude units, a difference that typically corresponds to a factor of ~3 in seismicity rate. Moreover, we find a correspondingly large bias in Gutenberg–Richter b-values, controlled primarily by inaccurate magnitude scaling in the conversion relationships. Although this study focuses on a relatively small geographic area, we can expect that similar issues exist with varying severity in other regions. Therefore, magnitudes of small earthquakes and their associated statistics, including seismicity rates and b-values, should be treated with caution.

58 GEOSCIENCES↗
DOE OSTI2021

Hardware-In-the-Loop Benchmarking Setup for Phasor Based Control Validation

Phasor Based Control is a novel approach to controlling Distributed Energy Resources that aims at relieving various constraints that arise in the distribution grid. It is a two-layer control system with a supervisory control that coordinates distributed controllers to reach voltage phasor targets. The distributed controllers use local synchrophasor measurements and operate as feedback controllers. This control method is currently under development with several algorithms being under consideration for both the central and ditributed components. In this paper, we present the experimental setup that was prepared to prototype a hardware implementation and validate the control method in Hardware-In-the-Loop.

Baudette, Maxime↗
DOE OSTI2023

JetNet: A Python package for accessing open datasets and benchmarking machine learning methods in high energy physics

JetNet is a Python package that aims to increase accessibility and reproducibility for machinelearning (ML) research in high energy physics (HEP), primarily related to particle jets. Basedon the popular PyTorch ML framework, it provides easy-to-access and standardized interfacesfor multiple heterogeneous HEP datasets and implementations of evaluation metrics, lossfunctions, and more general utilities relevant to HEP.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An Analytic Benchmark for the Solution to the Isotopic Fission Spectrum Mixture Problem

In neutron transport calculations, it is common to specify material compositions in terms of constituent isotopes. Material compositions may be described by isotope number densities and associated microscopic cross sections. For general reaction cross sections, the macroscopic cross sections of a composition are simply the summation of the sum of the products of isotope number densities and microscopic cross sections. A notable exception is the mixture of the neutron fission spectrum in fissile material. To demonstrate proper and improper mixture of the neutron fission spectrum, a zero-dimensional test problem is developed. Using the test problem, it is demonstrated that the improper mixing of the fission spectrum results in an eigenvalue error of approximately 65 pcm. Though this may seem small, any error in such a simple calculation is unacceptable. In similar infinite-homogeneous test problems, eigenvalue errors of more than 300 pcm have been observed. It is also shown that the error due to fission spectrum mixing can be exaggerated for computer program verification purposes. It is concluded that the proper mixture of the neutron fission spectrum is essential for accurate neutron transport simulations. The effect of improper neutron fission spectrum mixture is demonstrated and quantified and this test problem may be used for verification purposes in the future.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

IER-519 CED-2: Final Design for Thermal/Epithermal eXperiments (TEX) with Absorbers to Provide Validation Benchmarks for Hanford Tank Farms

The Hanford tank farms contain 56 million gallons of waste across 177 tanks. The primary criticality safety concern for the waste is the plutonium inventory in waste solids – approximately 670 kg in total. Criticality safety analysis credits the absorption and dilution properties of the large quantities of other elements (aluminum, chromium, iron, manganese, nickel, silicon, sodium, and zirconium) present in the waste. Of these, iron and manganese are by far the most significant neutron absorbers, particularly for the waste compositions of highest criticality safety concern. The criticality safety analyses at the Hanford Waste Treatment and Vitrification Plant (WTP) and the Savannah River tank farms also credit iron and manganese as the primary neutron absorbers to demonstrate subcriticality.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Capital Costs for Dual-Use Photovoltaic Installations: 2020 Benchmark for Ground-Mounted PV Systems with Pollinator-Friendly Vegetation, Grazing, and Crops

This report analyzes the installed system cost of various multi-land use PV system configurations. We used PV system bottom-up cost model accounting for all system and project-development costs incurred during the installation to model the costs for conventional PV systems, PV systems co-located with sheep grazing, PV systems co-located with pollinator friendly fields and PV systems co-located with crops. We also conducted extensive sensitivity analysis around different PV system design parameters given the nascent stage of this industry.

14 SOLAR ENERGY↗
DOE OSTI2020

MELCOR 2.2 Benchmarks of Peach Bottom NUREG/CR 7155 Uncertainty Analysis

The U.S. Nuclear Regulatory Commission (NRC) performed a first-of-a-kind uncertainty analysis (UA) of the accident progression, radiological releases, and offsite consequences for the State-of- the-Art Reactor Consequence Analyses (SOARCA) of an unmitigated long-term station blackout (LTSBO) severe accident scenario at the Peach Bottom Atomic Power Station. The objective of the UA was to evaluate the robustness of the SOARCA deterministic "best estimate results and conclusions documented in NUREG-1935, and to develop insight into the overall sensitivity of the SOARCA results to uncertainty in key modeling inputs. The study was completed in 2015 and documented in NUREG/CR-7155. Since 2015, two other SOARCA UAs were completed for two pressurized water reactor (PWR) plants. The PWR UAs incrementally updated the approach and methodology, including using the latest release of the MELCOR 2.2 computer code. There were also advances made in the state-of-the-art modeling related to NRC efforts using the Peach Bottom model in NUREG-2206, which provided the technical basis for the containment protection and release reduction rulemaking for boiling water reactors with Mark I and Mark II containments. This report documents the input model changes from the NUREG/CR-7155 study and performs a small number of reference calculations to assess the changes of the new computer code and the model input updates. The objective of the work is to verify whether the updated Peach Bottom MELCOR model and updated version of MELCOR support the conclusions formed in the Peach Bottom SOARCA UA by performing these representative calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Floating Photovoltaic System Cost Benchmark: Q1 2021 Installations on Artificial Water Bodies

In this report, we conduct a bottom-up analysis of the installed costs for FPV systems deployed on artificial water bodies under average site conditions (wind load of about 40 m/s, snow load of 20 psf, water depth of 50 m, water level variation of 10 m, and swell height of 1 m). We estimate an installed system cost premium of $\$0.26$/WDC (25%) for 10-MWDC fixed-tilt FPV systems, compared with ground-mounted, fixed-tilt PV installed over bare ground. Higher structural costs related to the floats and anchoring system are the largest contributors to this premium. Currently, site investigation costs are also higher for FPV because of the additional effort needed to plan and design these more complex installations. Our preliminary sensitivity analysis shows that the installed cost of FPV systems is most sensitive to float costs, wind and snow loading, and module efficiency. FPV deployment is in an early stage, and additional experience, best practice development, and new configurations and technologies could help reduce the costs of FPV systems over time.

14 SOLAR ENERGY↗