Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Benchmark testing of DIII-D neutral beam modeling with water flow calorimetry

Power loading on beamline components in the DIII-D neutral beam system is measured in this paper using water flow calorimetry. The results are used to benchmark beam transport models. Finally, anomalously high heat loads in the magnet region are investigated and a speculative hypothesis as to their origin is presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

PickerXL, A Large Deep Learning Model to Measure Arrival Times from Noisy Seismic Signals

Precisely measuring seismic arrival times is a labor-intensive task but is critical for both earthquake monitoring and subsurface imaging. Recently published deep learning models have demonstrated superior performance compared to traditional automatic approaches for picking arrival times. Although existing deep learning models have shown promising results, further advancements are necessary as their performance is not yet satisfactory especially when applied to new regions and station networks. Increasing model size has led to improved performance in other machine learning applications. Here, we aimed to investigate whether enlarging deep learning models can increase performance on accepted benchmarks. We trained three models of varying sizes, small (1X), medium (4X), and large (16X), using globally distributed local and regional earthquake signals and background noise waveforms from a benchmark dataset, Stanford Earthquake Dataset. Our results indicate that the largest model (PickerXL) outperforms both the smaller models and Seisbench implementation of the PhaseNet model, which has the same number of parameters as our small model. The PickerXL model’s enhanced capacity to extract complex patterns from seismograms contributes to its superior arrival picking abilities compared to the smaller model.

Chai, Chengping [Oak Ridge National Laboratory (OR↗

A critical evaluation of the upper ocean heat budget in the Climate Forecast System Reanalysis data for the south central equatorial Pacific

Coupled ocean-atmospheric models suffer from the common bias of a spurious rain belt south of the central equatorial Pacific throughout the year. Observational constraints on key processes responsible for this bias are scarce. The recently available reanalysis from a coupled model system for the National Centers for Environmental Prediction (NCEP) Climate Forecast System Reanalysis (CFSR) data is a potential benchmark for climate models in this region. Its suitability for model evaluation and validation, however, needs to be established. This paper examines the mixed layer heat budget and the ocean surface currents - key factors for the sea surface temperature control in the double Inter-Tropical Convergence Zone in the central Pacific - from 5{sup o}S to 10{sup o}S and 170{sup o}E to 150{sup o}W. Two independent approaches are used. The first approach is through comparison of CFSR data with collocated station observations from field experiments; the second is through the residual analysis of the heat budget of the mixed layer. We show that the CFSR overestimates the net surface flux in this region by 23 W m{sup -2}. The overestimated net surface flux is mainly due to an even larger overestimation of shortwave radiation by 44 W m{sup -2}, which is compensated by a surface latent heat flux overestimated by 14 W m{sup -2}. However, the quality of surface currents and the associated oceanic heat transport in CFSR are not compromised by the surface flux biases, and they agree with the best available estimates. The uncertainties of the observational data from field experiments are also briefly discussed in the present study.

54 ENVIRONMENTAL SCIENCES↗

A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models

We present a new atmospheric river (AR) analysis and benchmarking tool, namely Atmospheric River Metrics Package (ARMP). It includes a suite of new AR metrics that are designed for quick analysis of AR characteristics via statistics in gridded climate datasets such as model output and reanalysis. This package can be used for climate model evaluation in comparison with reanalysis and observational products. Integrated metrics such as mean bias and spatial pattern correlation are efficient for diagnosing systematic AR biases in climate models. For example, the package identifies the fact that, in CMIP5 and CMIP6 (Coupled Model Intercomparison Project Phases 5 and 6) models, AR tracks in the South Atlantic are positioned farther poleward compared to ERA5 reanalysis, while in the South Pacific, tracks are generally biased towards the Equator. For the landfalling AR peak season, we find that most climate models simulate a completely opposite seasonal cycle over western Africa. This tool can also be used for identifying and characterizing structural differences among different AR detectors (ARDTs). For example, ARs detected with the Mundhenk algorithm exhibit systematically larger size, width, and length compared to the TempestExtremes (TE) method. The AR metrics developed from this work can be routinely applied for model benchmarking and during the development cycle to trace performance evolution across model versions or generations and set objective targets for the improvement of models. They can also be used by operational centers to perform near-real-time climate and extreme event impact assessments as part of their forecast cycle.

58 GEOSCIENCES↗

Search for dark matter produced in association with a Higgs boson decaying to tau leptons at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search for dark matter produced in association with a Higgs boson in final states with two hadronically decaying τ-leptons and missing transverse momentum is presented. The analysis uses 139 fb -1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected by the ATLAS experiment at the Large Hadron Collider between 2015 and 2018. No evidence of physics beyond the Standard Model is found. The results are interpreted in terms of a 2HDM+a model featuring two scalar Higgs doublets and a pseudoscalar singlet field. Exclusion limits on the parameters of the model in selected benchmark scenarios are derived at 95% confidence level. Model-independent limits are also set on the visible cross-section for processes beyond the Standard Model producing missing transverse momentum in association with a Higgs boson decaying into τ-leptons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

HPF Implementation of NPB2.3

We present the HPF implementation of BT, SP, LU, FT, and MG of NPB2.3-serial benchmark set, The implementation is based on HPF performance model of the benchmark specific operations with distributed arrays. We present profiling and performance data on SGI origin 2000 and compare the results with NPB2.3. We discuss advantages and limitations of HPF and pghpf compiler.

Frumkin, Michael↗

HPF Implementation of NPB2.3

We present an HPF implementation of BT, SP, LU, FT, CG and MG of NP132.3-serial benchmark set. The implementation is based on HPF performance model of the benchmark specific primitive operations with distributed arrays. We present profiling and performance data on SGI Origin 2000 and compare the results with NPB2.3. We discuss an HPF limitation in organizing pipelined computations which results in memory and communication overhead in BT and SP.

Frumkin, Michael↗

National Security Science and Technology Initiative: Air Cargo Screening

The non-intrusive inspection (NII) of consolidated air cargo carried on commercial passenger aircraft continues to be a technically challenging, high-priority requirement of the Department of Homeland Security's Science and Technology Directorate (DHS S&T), the Transportation Security Agency and the Federal Aviation Administration. The goal of deploying a screening system that can reliably and cost-effectively detect explosive threats in consolidated cargo without adversely affecting the flow of commerce will require significant technical advances that will take years to develop. To address this critical National Security need, the Battelle Memorial Institute (Battelle), under a Cooperative Research and Development Agreement (CRADA) with four of its associated US Department of Energy (DOE) National Laboratories (Oak Ridge, Pacific Northwest, Idaho, and Brookhaven), conducted a research and development initiative focused on identifying, evaluating, and integrating technologies for screening consolidated air cargo for the presence of explosive threats. Battelle invested $8.5M of internal research and development funds during fiscal years 2007 through 2009. The primary results of this effort are described in this document and can be summarized as follows: (1) Completed a gap analysis that identified threat signatures and observables, candidate technologies for detection, their current state of development, and provided recommendations for improvements to meet air cargo screening requirements. (2) Defined a Commodity/Threat/Detection matrix that focuses modeling and experimental efforts, identifies technology gaps and game-changing opportunities, and provides a means of summarizing current and emerging capabilities. (3) Defined key properties (e.g., elemental composition, average density, effective atomic weight) for basic commodity and explosive benchmarks, developed virtual models of the physical distributions (pallets) of three commodity types and three explosive benchmarks combinations, and conducted modeling and simulation studies to begin populating the matrix of commodities, threats, and detection technologies. (4) Designed and fabricated basic (homogeneous) commodity test pallets and fabricated inert stimulants to support experiments and to validate modeling/simulation results. (5) Developed/expanded the team's capabilities to conduct full-scale imaging (neutron and x-ray) experiments of air cargo commodities and explosive benchmarks. (6) Conducted experiments to improve the collection of trace particles of explosives from a variety of surfaces representative of air cargo materials by means of mechanical (air/vibration/pressure), thermal, and electrostatic methods. Air cargo screening is a difficult challenge that will require significant investment in both research and development to find a suitable solution to ensure the safety of passengers without significantly hindering the flow of commodities. The initiative funded by Battelle has positioned this group to make major contributions in meeting the air cargo challenge by developing collaborations, developing laboratory test systems, improving knowledge of the challenges (both technical and business) for air cargo screening, and increasing the understanding of the capabilities for current inspection methods (x-ray radiography, x-ray backscatter, etc.) and potential future inspection methods (neutron radiography, fusion of detector modalities, advanced trace detection, etc.). Lastly, air cargo screening is still an issue that will benefit from collaboration between Department of Energy Laboratories and Battelle. On January 7, 2010, DHS Secretary Napolitano joined White House Press Secretary Robert Gibbs and Assistant to the President for Counterterrorism and Homeland Security John Brennan to announce several recommendations DHS has made to the President for improving the technology and procedures used to protect air travel from acts of terrorism. (This announcement followed the 25 Dec'09 Delta/Northwest Airlines Flight 253 terror attack.) Secretary Napolitano outlined five recommendations DHS will pursue to enhance the safety of the traveling public. One of the five recommendations, read as follows: 'Establish a partnership on aviation security between DHS and the Department of Energy and its National Laboratories in order to develop new and more effective technologies to deter and disrupt known threats and proactively anticipate and protect against new ways by which terrorists could seek to board an aircraft.' In conclusion, it appears very timely that Battelle and its DOE lab partners initiated a serious collaboration on the air cargo topic, and that we should continue to work toward future collaboration in response to the government's needs.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

A dynamic fault tree model of a propulsion system

We present a dynamic fault tree model of the benchmark propulsion system, and solve it using Galileo. Dynamic fault trees (DFT) extend traditional static fault trees with special gates to model spares and other sequence dependencies. Galileo solves DFT models using a judicious combination of automatically generated Markov and Binary Decision Diagram models. Galileo easily handles the complexities exhibited by the benchmark problem. In particular, Galileo is designed to model phased mission systems.

propulsion system↗

Rotationally invariant slave-boson and density matrix embedding theory: Unified framework and comparative study on the one-dimensional and two-dimensional Hubbard model [Rotationally invariant slave-boson and density matrix embedding theory: A unified framework and a comparative study on the 1D and 2D Hubbard Model]

We present detailed benchmark ground-state calculations of the one- and two-dimensional Hubbard model utilizing the cluster extensions of the rotationally invariant slave-boson mean-field theory and the density matrix embedding theory. Our analysis shows that the overall accuracy and the performance of these two methods are very similar. Furthermore, we propose a unified computational framework that allows us to implement both of these techniques on the same footing. In conclusion, this provides us with a different line of interpretation and paves the ways for developing systematically distinct generalizations of these complementary approaches.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Validation of computational aeroelasticity

The topics are presented in viewgraph form and include the following: codes for computational aeroelasticity validation; the benchmark transonic flutter (BTF) model; BTF testing; the BTF model program; features of transonic flutter; characteristics of attached and separated flow for complete aircraft; and the benchmark aeroelastic model program.

Whitlow, Woodrow, Jr.↗

Exploring the hidden valley at MATHUSLA

Hidden valley models naturally predict numerous long-lived particles, the distinctive signatures of which would be compelling evidence for a hidden valley scenario. As these are typically low-energy particles, they pose a challenge in terms of passing energy triggers in traditional searches at the Large Hadron Collider. The MATHUSLA (MAssive Timing Hodoscope for Ultra-Stable neutraL pArticles) experiment is specifically designed for the purpose of detecting long-lived particles. It also has the capability of detecting lower energy particles relative to ATLAS and CMS. In this paper, we assess MATHUSLA's potential for effectively probing hidden valley models. As a benchmark, we assume the hidden valley sector communicates with Standard Model sectors via a heavy vector propagator that couples to Standard Model quarks as well as hidden valley quarks. We model the showering and hadronization in the hidden valley sector using PYTHIA and study the detector acceptance as a function of the hidden valley meson's lifetime. We find that MATHUSLA possesses significant capabilities to explore previously uncharted parameter space within hidden valley models.

Hidden sector↗

Tropospheric Wind Observations with Doppler Lidars

Simpson Weather Associates has continued its efforts on the tools which operate the DLSM's s line-of-sight output products file. Due to the long model run times which were revealed in last month's benchmark tests, four model options for the LSM's atmospheric inputs are now included in the LSM. The user can choose to either spatially and/or temporally interpolate the inputs or use inputs closest to the DWL shot. A problem in the terrain assignment from the GADS was corrected. A database conversion tool was added to convert DWL line-of-sight ASCII files into database format for the graphic display models. Efforts have continued in simulating DWL horizontal wind components using the DAO ficcm Nature Run. Experiments 2 and 3 (40 days worth) were completed and sent to the DAO for their use in bracketing OSSE experiments. In addition, in order to investigate differences in the way regional (MM5) and global scale (ECMWF T213) models treat features such as clouds and subgrid scale variability, a gridded Mesoscale Atmospheric Data Set (MADS) was created and ready to be incorporated into simulation experiments.

Source record↗

Benchmark study of a new simplified DFN model for shearing of intersecting fractures and faults

It is challenging to quantitatively predict shearing of intersecting fractures/faults because of dynamic frictional contacts accompanied by possible nonlinear rock deformation. To address such challenges, a new conceptual model—the simplified DFN model—was proposed and validated by Hu et al. 46 to use major paths (MPs) to represent complicated DFNs for calculation of shearing. In this work, we conducted a benchmark study for three examples that involve different levels of complexity of intersecting fractures, and correspondingly different numbers of MPs. The codes and software that were used in the benchmark cover a range of continuum, discontinuum and hybrid numerical methods: NMM (LBNL), FLAC3D (LBNL), GBDEM (KIGAM), FRACOD (DynaFrax), and CASRock (CAS). The general consistency between DFN and MP cases as predicted by all the codes/software demonstrates that major paths can be used to simplify the geometry of DFNs in a wide range of software. Disagreement in results made by some software and potential future improvements are discussed. We show that (1) shearing of one or multiple major fractures can be reduced if there are multiple smaller intersecting fractures in that area, which is a useful basis for understanding and controlling induced seismicity and merits further analysis, and (2) the agreement achieved in the benchmark examples provide confidence that the simplified DFN model is a promising conceptual model that can be used for different types of numerical approaches and software for simplifying the analysis of the shearing of intersecting fractures and faults.

58 GEOSCIENCES↗

SU-F-T-172: A Method for Log File QA On An IBA Proteus System for Patient Specific Spot Scanning Quality Assurance

Purpose: The use of log files to perform patient specific quality assurance for both protons and IMRT has been established. Here, we extend that approach to a proprietary log file format and compare our results to measurements in phantom. Our goal was to generate a system that would permit gross errors to be found within 3 fractions until direct measurements. This approach could eventually replace direct measurements. Methods: Spot scanning protons pass through multi-wire ionization chambers which provide information about the charge, location, and size of each delivered spot. We have generated a program that calculates the dose in phantom from these log files and compares the measurements with the plan. The program has 3 different spot shape models: single Gaussian, double Gaussian and the ASTROID model. The program was benchmarked across different treatment sites for 23 patients and 74 fields. Results: The dose calculated from the log files were compared to those generate by the treatment planning system (Raystation). While the dual Gaussian model often gave better agreement, overall, the ASTROID model gave the most consistent results. Using a 5%–3 mm gamma with a 90% passing criteria and excluding doses below 20% of prescription all patient samples passed. However, the degree of agreement of the log file approach was slightly worse than that of the chamber array measurement approach. Operationally, this implies that if the beam passes the log file model, it should pass direct measurement. Conclusion: We have established and benchmarked a model for log file QA in an IBA proteus plus system. The choice of optimal spot model for a given class of patients may be affected by factors such as site, field size, and range shifter and will be investigated further.

60 APPLIED LIFE SCIENCES↗

System thermal-hydraulic modelling of the phénix dissymmetric test benchmark

Phénix is a French pool-type sodium-cooled prototype reactor; before the definitive shutdown, occurred in 2009, a final set of experimental tests are carried out in order to increase the knowledge on the operation and the safety aspect of the pool-type liquid metal-cooled reactors. One of the experiments was the Dissymmetric End-of-Life Test which was selected for the validation benchmark activity in the frame of SESAME project. The computer code validation plays a key role in the safety assessment of the innovative nuclear reactors and the Phénix dissymmetric test provides useful experimental data to verify the computer codes capability in the asymmetric thermal-hydraulic behaviour into a pool-type liquid metal-cooled reactor. This paper shows the comparison of the outcomes obtained with six different System Thermal-Hydraulic (STH) codes: RELAP5-3D©, SPECTRA, ATHLET, SAS4A/SASSYS-1, ASTEC-Na and CATHARE. The nodalization scheme of the reactor was individually achieved by the participants; during the development of the thermal-hydraulic model, the pool nodalization methodology had a special attention in order to investigate the capability of the STH codes to reproduce the dissymmetric effects which occur in each loop and into pools, caused by the azimuthal asymmetry of the boundary conditions. The modelling methodology of the participants is discussed and the main results are compared in this paper to obtain useful guide lines for the future modelling of innovative liquid metal pool-type reactors.

42 ENGINEERING↗

System Thermal-Hydraulic Modeling of the Phénix Dissymmetric Test Benchmark

Phénix is a French pool-type sodium-cooled prototype reactor; before the definitive shutdown, occurred in 2009, a final set of experimental tests are carried out in order to increase the knowledge on the operation and the safety aspect of the pool-type liquid metal-cooled reactors. One of the experiments was the Dissymmetric End-of-Life Test which was selected for the validation benchmark activity in the frame of SESAME project. The computer code validation plays a key role in the safety assessment of the innovative nuclear reactors and the Phénix dissymmetric test provides useful experimental data to verify the computer codes capability in the asymmetric thermal-hydraulic behaviour into a pool-type liquid metal-cooled reactor. This paper shows the comparison of the outcomes obtained with six different System Thermal-Hydraulic (STH) codes: RELAP5-3D©, SPECTRA, ATHLET, SAS4A/SASSYS-1, ASTEC-Na and CATHARE. The nodalization scheme of the reactor was individually achieved by the participants; during the development of the thermal-hydraulic model, the pool nodalization methodology had a special attention in order to investigate the capability of the STH codes to reproduce the dissymmetric effects which occurs in each loop and into pools, caused by the azimuthal asymmetry of the boundary conditions. The modelling methodology of the participants is discussed and the main results are compared in this paper to obtain useful guide lines for the future modelling of innovative liquid metal pool-type reactors.

Narcisi, V.↗

AGR 1 and 2 Isotopic Depletion Validation

This presentation includes work performed developing a computational benchmark for the AGR 1 and 2 experiments. These experiments involve irradiation of TRISO particle compact in the Advanced Test Reactor (ATR). Many post-irradiation measurements were made from these experiments, including isotopic concentrations of fission products. The benchmark involves a MCNP-ORIGEN coupled model of the ATR and AGR experiment capsules to calculate a comprehensive inventory of fission product and actinide concentrations in the compacts. This presentation describes the experiments, the measurements obtained, the benchmark model, and results of the model evaluation.

97 - MATHEMATICS AND COMPUTING↗