Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Benchmarking Monte Carlo codes for the modelling of low-energy neutron production target reactions

The increasing adoption of accelerator-based neutron sources (ABNS) for applications including neutron capture therapy (NCT) research has highlighted the need for accurate simulation tools. Precise modelling of the neutron production target is crucial to ensure that simulated predictions of neutron beam characteristics used for subsequent beam shaping assembly design are reliable. This work presents a comprehensive benchmarking of four widely-used Monte Carlo codes - Geant4, PHITS, FLUKA (CERN), and MCNP - for modelling low-energy neutron production target reactions. Using their recommended physics models and cross-section libraries, we evaluate each code’s performance in simulating four beam-target reactions: 7 Li(p,n) 7 Be, 9 Be(p,n) 9 B, 9 Be(d,n) 10 B, and C(d,n)N. Predictions of neutron yield, angular distributions, and energy spectra are compared against available thick target experimental data. Results show varying levels of agreement between the codes depending on the reaction type, energy range, and beam characteristics. Geant4, MCNP and PHITS are the overall best performing codes for the simulation of total neutron yield and yield in the forward direction across most reactions. Across energies where experimental benchmarks exist, inter-code discrepancies in total and forward-directed yield are typically 10 to 30%, with larger deviations at near-threshold incident ion energies. PHITS provides the best overall reproduction of experimental spectra, particularly for the 9 Be(p,n) 9 B reaction. Additionally, PHITS demonstrates superior computational performance for most reactions. These findings provide valuable guidance for ABNS design, highlighting the strengths and limitations of each code for the simulation of low-energy neutron production reactions.

43 PARTICLE ACCELERATORS↗
NASA NTRS1998

Parameter Estimation of Actuators for Benchmark Active Control Technology (BACT) Wind Tunnel Model with Analysis of Wear and Aerodynamic Loading Effects

This report describes the development of transfer function models for the trailing-edge and upper and lower spoiler actuators of the Benchmark Active Control Technology (BACT) wind tunnel model for application to control system analysis and design. A simple nonlinear least-squares parameter estimation approach is applied to determine transfer function parameters from frequency response data. Unconstrained quasi-Newton minimization of weighted frequency response error was employed to estimate the transfer function parameters. An analysis of the behavior of the actuators over time to assess the effects of wear and aerodynamic load by using the transfer function models is also presented. The frequency responses indicate consistent actuator behavior throughout the wind tunnel test and only slight degradation in effectiveness due to aerodynamic hinge loading. The resulting actuator models have been used in design, analysis, and simulation of controllers for the BACT to successfully suppress flutter over a wide range of conditions.

Waszak, Martin R.↗
DOE OSTI2021

Leveraging observed soil heterotrophic respiration fluxes as a novel constraint on global-scale models

Microbially-explicit models may improve understanding and projections of carbon dynamics in response to future climate change, but their fidelity in simulating global-scale soil heterotrophic respiration (RH), a stringent test for soil biogeochemical models, has never been evaluated. We used statistical global RH products, as well as 7,821 daily site-scale RH measurements, to evaluate the spatio-temporal performance of one first-order decay model (CASA-CNP) and two microbially-explicit biogeochemical models (CORPSE and MIMICS) that were forced by two different climate datasets. CORPSE and MIMICS did not provide any measurable performance improvement; instead, the models were highly sensitive to the meteorological input data used to drive them. Spatial RH variability was generally well simulated except in the northern middle latitudes (~50°N) and arid regions; models captured the seasonal variability of RH well, but showed more divergence in tropic and arctic regions. Our results demonstrate that the next generation of biogeochemical models shows promise, but also needs to be improved for realistic spatio-temporal variability of RH. Finally, we emphasize the importance of net primary production, soil moisture, and soil temperature inputs, and that jointly evaluating soil models for their spatial (global scale) and temporal (site scale) performance provides crucial benchmarks for improving biogeochemical models.

Jian, Jinshi↗
DOE OSTI2025

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY↗
DOE OSTI2019

Inertial Effects During the Process of Supercritical CO 2 Displacing Brine in a Sandstone: Lattice Boltzmann Simulations Based on the Continuum-Surface-Force and Geometrical Wetting Models

Inertial effects during the process of supercritical CO 2 displacing brine in porous media may not be negligible according to recent studies. Capturing the inertial effects of the physical CO 2 -brine system imposes a requirement on the grid resolution and viscosity to surface tension ratio for pore-scale simulations, which some commonly used simulators may not be able to meet. To fulfill the parameter requirement, we combine the continuum-surface-force based color-gradient lattice Boltzmann (LB) multiphase model and the geometrical wetting model and extend the model to 3D under the multiple-relaxation-time framework. We validate the model via simple benchmarks which show significant improvement over the traditional models. Furthermore, we perform 3D drainage simulations in a heterogeneous micromodel where the simulation result agrees well with experimental data, while our previous work fails to reproduce certain displacement patterns in the experiment due to the use of a traditional LB model that cannot fulfill the parameter requirement. Finally, we perform high-fidelity 3D drainage simulations to study the inertial effects in a Bentheimer sandstone sample. These findings show that stronger inertial effects generally help develop more CO 2 flow pathways for the same capillary number which results in higher CO 2 saturation, consistent with the micromodel results. The phenomena can be found in both low and high capillary number cases, indicating that the inertial effects are not dependent on the mean velocity. In addition, the change of the invasion patterns is not proportional to the change of inertial effects, thus exhibiting threshold behavior.

58 GEOSCIENCES↗
DOE OSTI2023

Large Eddy Simulation of Convective Heat Transfer in a Random Pebble Bed Using the Spectral Element Method

The development of fluoride-cooled high-temperature reactors has drastically increased the demand for an in-depth understanding of the heat transfer (HT) in packed beds cooled by liquid salts. The complex flow fields and space-dependent porosity found in a pebble bed require a detailed understanding to ensure the proper cooling of the reactor core during normal and accident conditions. As detailed experimental data are complicated to obtain for these configurations, high-fidelity simulation such as large eddy simulation and direct numerical simulation (DNS) can be employed to create a high-resolution heat transfer numerical database that can assist in addressing industrial-driven issues associated with the heat transfer behavior of fluoride-cooled high-temperature reactors. In this paper, we performed a series of large eddy simulation using computational fluid dynamics (CFD) code NekRS to investigate the heat transfer for a bed of 1741 pebbles. Further, the characteristics of the flow, such as average, rms, and time series of velocity and temperature, have been analyzed. Porous media averages have also been performed. The simulation results show a good agreement between non-conjugate heat transfer and conjugate heat transfer. The generated data will be used to benchmark heat transfer modeling methods and local maxima/minima of heat transfer parameters. It will also be used for supporting convective heat transfer quantification for Kairos Power and benchmarking lower fidelity models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Final Design for Thermal/Epithermal eXperiments using High 240 Pu Content Plutonium/Aluminum Zero Power Research Reactor Plates with Polyethylene Moderator (IER 520 Final Design CED-2 Report)

The US Department of Energy Nuclear Criticality Safety Program (NCSP) convened a multinational Thermal Epithermal eXperiments (TEX) meeting in July of 2011 to discuss the data and experimental needs of criticality safety practitioners. The number one and two priority integral experiment data needs were for 239 Pu and 240 Pu, with special emphasis on cross section performance in the intermediate energy range (from 0.625 eV to 100 keV). LLNL measured five critical configurations with LANL for the plutonium test bed (IER-184) and published the experiments as International Criticality Safety Benchmark Evaluation Project evaluation PUMET-MIXED-002. Modeling of the benchmark configurations using ENDF/B-VIII.0 nuclear data showed significant overprediction of reactivity for configurations that had a large percentage of fissions in the intermediate energy regime. This report documents a variation on the TEX plutonium test bed to provide a test of 240 Pu cross sections, with sensitivity of the configuration to 240 Pu radiative capture and fission cross sections a priority for the design.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Particle Receiver Models for Systems Analysis

Particle receivers are gaining importance in the field of Concentrating Solar Power (CSP) due to the high temperature that particles can achieve without degradation. Several researchers are studying the potential of this technology by means of system analyses, which need simple and light models of the system. This study presents two simple models for the particle receiver. The simplest model is a correlation obtained by fitting the results calculated with a more complex receiver model simulated in CFD. The other model is a 1D model, which is benchmarked against the same CFD results. Although both models achieve high coefficient of determination, R2, when compared to CFD results, the 1D model seems to provide more accurate results (especially during sunsets and sunrises). Both models are integrated into a tecno-economic model developed in previous work. The LCOE obtained with the 1D model is between 7% and 10% greater than the one obtained with the correlation.

González-Portillo, Luis F. (ORCID:0000000348643825↗
NASA NTRS2018

Chemical Modeling of the Reactivity of Short-Lived Greenhouse Gases: A Model Inter-Comparison Prescribing a Well-Measured, Remote Troposphere

We develop a new protocol for merging in situ measurements with 3-D model simulations of atmospheric chemistry with the goal of integrating over the data to identify the most reactive air parcels in terms of tropospheric production and loss of the greenhouse gases ozone and methane. Presupposing that we can accurately measure atmospheric composition, we examine whether models constrained by such measurements agree on the chemical budgets for ozone and methane. In applying our technique to a synthetic data stream of 14,880 parcels along 180W, we are able to isolate the performance of the photochemical modules operating within their global chemistry-climate and chemistry-transport models, removing the effects of modules controlling tracer transport, emissions, and scavenging. Differences in reactivity across models are driven only by the chemical mechanism and the diurnal cycle of photolysis rates, which are driven in turn by temperature, water vapor, solar zenith angle, clouds, and possibly aerosols and overhead ozone, which are calculated in each model. We evaluate six global models and identify their differences and similarities in simulating the chemistry through a range of innovative diagnostics. All models agree that the more highly reactive parcels dominate the chemistry (e.g., the hottest 10% of parcels control 25-30% of the total reactivities), but do not fully agree on which parcels comprise the top 10%. Distinct differences in specific features occur, including the regions of maximum ozone production and methane loss, as well as in the relationship between photolysis and these reactivities. Unique, possibly aberrant, features are identified for each model, providing a benchmark for photochemical module development. Among the 6 models tested here, 3 are almost indistinguishable based on the inherent variability caused by clouds, and thus we identify 4, effectively distinct, chemical models. Based on this work, we suggest that water vapor differences in model simulations of past and future atmospheres may be a cause of the different evolution of tropospheric O3 and CH4, and lead to different chemistry-climate feedbacks across the models.

greenhouse gases↗
DOE OSTI2025

PickerXL, A Large Deep Learning Model to Measure Arrival Times from Noisy Seismic Signals

Precisely measuring seismic arrival times is a labor-intensive task but is critical for both earthquake monitoring and subsurface imaging. Recently published deep learning models have demonstrated superior performance compared to traditional automatic approaches for picking arrival times. Although existing deep learning models have shown promising results, further advancements are necessary as their performance is not yet satisfactory especially when applied to new regions and station networks. Increasing model size has led to improved performance in other machine learning applications. Here, we aimed to investigate whether enlarging deep learning models can increase performance on accepted benchmarks. We trained three models of varying sizes, small (1X), medium (4X), and large (16X), using globally distributed local and regional earthquake signals and background noise waveforms from a benchmark dataset, Stanford Earthquake Dataset. Our results indicate that the largest model (PickerXL) outperforms both the smaller models and Seisbench implementation of the PhaseNet model, which has the same number of parameters as our small model. The PickerXL model’s enhanced capacity to extract complex patterns from seismograms contributes to its superior arrival picking abilities compared to the smaller model.

Chai, Chengping [Oak Ridge National Laboratory (OR↗
DOE OSTI2025

A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models

We present a new atmospheric river (AR) analysis and benchmarking tool, namely Atmospheric River Metrics Package (ARMP). It includes a suite of new AR metrics that are designed for quick analysis of AR characteristics via statistics in gridded climate datasets such as model output and reanalysis. This package can be used for climate model evaluation in comparison with reanalysis and observational products. Integrated metrics such as mean bias and spatial pattern correlation are efficient for diagnosing systematic AR biases in climate models. For example, the package identifies the fact that, in CMIP5 and CMIP6 (Coupled Model Intercomparison Project Phases 5 and 6) models, AR tracks in the South Atlantic are positioned farther poleward compared to ERA5 reanalysis, while in the South Pacific, tracks are generally biased towards the Equator. For the landfalling AR peak season, we find that most climate models simulate a completely opposite seasonal cycle over western Africa. This tool can also be used for identifying and characterizing structural differences among different AR detectors (ARDTs). For example, ARs detected with the Mundhenk algorithm exhibit systematically larger size, width, and length compared to the TempestExtremes (TE) method. The AR metrics developed from this work can be routinely applied for model benchmarking and during the development cycle to trace performance evolution across model versions or generations and set objective targets for the improvement of models. They can also be used by operational centers to perform near-real-time climate and extreme event impact assessments as part of their forecast cycle.

58 GEOSCIENCES↗
DOE OSTI2023

Search for dark matter produced in association with a Higgs boson decaying to tau leptons at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search for dark matter produced in association with a Higgs boson in final states with two hadronically decaying τ-leptons and missing transverse momentum is presented. The analysis uses 139 fb -1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected by the ATLAS experiment at the Large Hadron Collider between 2015 and 2018. No evidence of physics beyond the Standard Model is found. The results are interpreted in terms of a 2HDM+a model featuring two scalar Higgs doublets and a pseudoscalar singlet field. Exclusion limits on the parameters of the model in selected benchmark scenarios are derived at 95% confidence level. Model-independent limits are also set on the visible cross-section for processes beyond the Standard Model producing missing transverse momentum in association with a Higgs boson decaying into τ-leptons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1998

HPF Implementation of NPB2.3

We present the HPF implementation of BT, SP, LU, FT, and MG of NPB2.3-serial benchmark set, The implementation is based on HPF performance model of the benchmark specific operations with distributed arrays. We present profiling and performance data on SGI origin 2000 and compare the results with NPB2.3. We discuss advantages and limitations of HPF and pghpf compiler.

Frumkin, Michael↗
NASA NTRS1998

HPF Implementation of NPB2.3

We present an HPF implementation of BT, SP, LU, FT, CG and MG of NP132.3-serial benchmark set. The implementation is based on HPF performance model of the benchmark specific primitive operations with distributed arrays. We present profiling and performance data on SGI Origin 2000 and compare the results with NPB2.3. We discuss an HPF limitation in organizing pipelined computations which results in memory and communication overhead in BT and SP.

Frumkin, Michael↗
NASA NTRS2006

A dynamic fault tree model of a propulsion system

We present a dynamic fault tree model of the benchmark propulsion system, and solve it using Galileo. Dynamic fault trees (DFT) extend traditional static fault trees with special gates to model spares and other sequence dependencies. Galileo solves DFT models using a judicious combination of automatically generated Markov and Binary Decision Diagram models. Galileo easily handles the complexities exhibited by the benchmark problem. In particular, Galileo is designed to model phased mission systems.

propulsion system↗
NASA NTRS1987

Validation of computational aeroelasticity

The topics are presented in viewgraph form and include the following: codes for computational aeroelasticity validation; the benchmark transonic flutter (BTF) model; BTF testing; the BTF model program; features of transonic flutter; characteristics of attached and separated flow for complete aircraft; and the benchmark aeroelastic model program.

Whitlow, Woodrow, Jr.↗
DOE OSTI2025

Exploring the hidden valley at MATHUSLA

Hidden valley models naturally predict numerous long-lived particles, the distinctive signatures of which would be compelling evidence for a hidden valley scenario. As these are typically low-energy particles, they pose a challenge in terms of passing energy triggers in traditional searches at the Large Hadron Collider. The MATHUSLA (MAssive Timing Hodoscope for Ultra-Stable neutraL pArticles) experiment is specifically designed for the purpose of detecting long-lived particles. It also has the capability of detecting lower energy particles relative to ATLAS and CMS. In this paper, we assess MATHUSLA's potential for effectively probing hidden valley models. As a benchmark, we assume the hidden valley sector communicates with Standard Model sectors via a heavy vector propagator that couples to Standard Model quarks as well as hidden valley quarks. We model the showering and hadronization in the hidden valley sector using PYTHIA and study the detector acceptance as a function of the hidden valley meson's lifetime. We find that MATHUSLA possesses significant capabilities to explore previously uncharted parameter space within hidden valley models.

Hidden sector↗
NASA NTRS2003

Tropospheric Wind Observations with Doppler Lidars

Simpson Weather Associates has continued its efforts on the tools which operate the DLSM's s line-of-sight output products file. Due to the long model run times which were revealed in last month's benchmark tests, four model options for the LSM's atmospheric inputs are now included in the LSM. The user can choose to either spatially and/or temporally interpolate the inputs or use inputs closest to the DWL shot. A problem in the terrain assignment from the GADS was corrected. A database conversion tool was added to convert DWL line-of-sight ASCII files into database format for the graphic display models. Efforts have continued in simulating DWL horizontal wind components using the DAO ficcm Nature Run. Experiments 2 and 3 (40 days worth) were completed and sent to the DAO for their use in bracketing OSSE experiments. In addition, in order to investigate differences in the way regional (MM5) and global scale (ECMWF T213) models treat features such as clouds and subgrid scale variability, a gridded Mesoscale Atmospheric Data Set (MADS) was created and ready to be incorporated into simulation experiments.

Source record↗