Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Results of a Multi-Institutional Benchmark Test for Cranial CT/MR Image Registration

Purpose: Variability in computed tomography/magnetic resonance imaging (CT/MR) cranial image registration was assessed using a benchmark case developed by the Quality Assurance Review Center to credential institutions for participation in Children's Oncology Group Protocol ACNS0221 for treatment of pediatric low-grade glioma. Methods and Materials: Two DICOM image sets, an MR and a CT of the same patient, were provided to each institution. A small target in the posterior occipital lobe was readily visible on two slices of the MR scan and not visible on the CT scan. Each institution registered the two scans using whatever software system and method it ordinarily uses for such a case. The target volume was then contoured on the two MR slices, and the coordinates of the center of the corresponding target in the CT coordinate system were reported. The average of all submissions was used to determine the true center of the target. Results: Results are reported from 51 submissions representing 45 institutions and 11 software systems. The average error in the position of the center of the target was 1.8 mm (1 standard deviation = 2.2 mm). The least variation in position was in the lateral direction. Manual registration gave significantly better results than did automatic registration (p = 0.02). Conclusion: When MR and CT scans of the head are registered with currently available software, there is inherent uncertainty of approximately 2 mm (1 standard deviation), which should be considered when defining planning target volumes and PRVs for organs at risk on registered image sets.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Parareal in time 3D numerical solver for the LWR Benchmark neutron diffusion transient model

In this paper we present a time-parallel algorithm for the 3D neutrons calculation of a transient model in a nuclear reactor core. The neutrons calculation consists in numerically solving the time dependent diffusion approximation equation, which is a simplified transport equation. The numerical resolution is done with finite elements method based on a tetrahedral meshing of the computational domain, representing the reactor core, and time discretization is achieved using a θ-scheme. The transient model presents moving control rods during the time of the reaction. Therefore, cross-sections (piecewise constants) are taken into account by interpolations with respect to the velocity of the control rods. The parallelism across the time is achieved by an adequate use of the parareal in time algorithm to the handled problem. This parallel method is a predictor corrector scheme that iteratively combines the use of two kinds of numerical propagators, one coarse and one fine. Our method is made efficient by means of a coarse solver defined with large time step and fixed position control rods model, while the fine propagator is assumed to be a high order numerical approximation of the full model. The parallel implementation of our method provides a good scalability of the algorithm. Numerical results show the efficiency of the parareal method on large light water reactor transient model corresponding to the Langenbuch–Maurer–Werner benchmark.

97 MATHEMATICS AND COMPUTING↗

Benchmarking of Solar Irradiance Nowcast Performance Derived from All-Sky Imagers

Fluctuations of the incoming solar irradiance impact the power generation from photovoltaic and concentrating solar thermal power plants. Accurate solar nowcasting becomes necessary to detect these sudden changes of generated power and to provide the desired information for optimal exploitation of solar systems. In the framework of the International Energy Agency's Photovoltaic Power Systems Program Task 16, a benchmarking exercise has been conducted relying on a bouquet of solar nowcasting methodologies by all-sky imagers (ASI). In this paper, four ASI systems nowcast the Global Horizontal Irradiance (GHI) with a time forecast ranging from 1 to 20 min during 28 days with variable cloud conditions spanning from September to November 2019 in southern Spain. All ASIs demonstrated their ability to accurately nowcast GHI, with RMSE ranging from 6.9% to 18.1%. Under cloudy conditions, all ASIs' nowcasts outperform the persistence models. Under clear skies, three ASIs are better than persistence. Discrepancies in the observed nowcasting performance become larger at increasing forecast horizons. The findings of this study highlight the feasibility of ASIs to reliably nowcast GHI at different sky conditions, time intervals and horizons. Such nowcasts can be used either to estimate solar power at distant times or detect sudden GHI fluctuations.

all-sky imagers↗

Is the assumption of normality or log-normality for continuous response data critical for benchmark dose estimation?

Continuous responses (e.g. body weight) are widely used in risk assessment for determining the benchmark dose (BMD) which is used to derive a U.S. EPA reference dose. One critical question that is not often addressed in dose–response assessments is whether to model the continuous data as normally or log-normally distributed. Additionally, if lognormality is assumed, and only summarized response data (i.e., mean ± standard deviation) are available as is usual in the peer-reviewed literature, the BMD can only be approximated. In this study, using the “hybrid” method and relative deviation approach, we first evaluate six representative continuous dose–response datasets reporting individual animal responses to investigate the impact on BMD/BMDL estimates of (1) the distribution assumption and (2) the use of summarized versus individual animal data when a log-normal distribution is assumed. We also conduct simulation studies evaluating model fits to various known distributions to investigate whether the distribution assumption has influence on BMD/BMDL estimates. Our results indicate that BMDs estimated using the hybrid method are more sensitive to the distribution assumption than counterpart BMDs estimated using the relative deviation approach. The choice of distribution assumption has limited impact on the BMD/BMDL estimates when the within dose-group variance is small, while the lognormality assumption is a better choice for relative deviation method when data are more skewed because of its appropriateness in describing the relationship between mean and standard deviation. Additionally, the results suggest that the use of summarized data versus individual response data to characterize log-normal distributions has minimal impact on BMD estimates. - Highlights: • We investigate to what extent the distribution assumption can affect BMD estimates. • Both real data analysis and simulation study are conducted. • BMDs estimated using hybrid method are more sensitive to distribution assumption. • Summarized continuous data are adequate for BMD estimation.

60 APPLIED LIFE SCIENCES↗

Price control regulation in North America: role of indexing and benchmarking

Price cap plans in regulation are designed to mimic competition. The authors present the index logic that underpins this rationale in North American plans and offer two statistical approaches - indexing and benchmarking - that play a role in determining industry and/or national productivity trends and economy and/or industry input price trends that are used to track the unit cost of the industry. (author)

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Measuring Distribution Performance? Benchmarking Warrants Your Attention

Identifying, designing, and measuring performance metrics is critical to securing customer value, but can be a difficult task. This article examines the use of benchmarks based on publicly available performance data to set challenging, yet fair, metrics and targets.

2017 customer value ranking↗

Using Electrochemistry to Benchmark, Understand, and Develop Noble Metal Nanoparticle Syntheses

The complex chemical nature of metal nanoparticle synthesis presents obstacles for the mechanistic understanding of nanoparticle growth and predictive synthesis design, despite significant progress in this area. Real-time characterization of the chemical processes that take place throughout nanoparticle growth will enable progress toward addressing outstanding challenges in metal nanoparticle synthesis, such as mitigating synthetic reproducibility issues, defining chemical mechanisms that direct nanoparticle growth, and designing synthetic conditions for previously unachievable combinations of nanoparticle shape and composition. In this Perspective, we present open-circuit potential (OCP) measurements as an in situ, real-time method for characterizing chemical changes during nanoparticle growth and discuss the method’s strengths in comparison to and in combination with other characterization techniques. We propose the use of OCP measurements as benchmarks for troubleshooting irreproducibility and streamlining synthetic optimization. Finally, we explore possibilities for using the increased parameter space accessible by electrodeposition to accelerate the development of shape-selective nanoparticle syntheses.

benchmarking↗

The Community Land Model Version 5: Description of New Features, Benchmarking, and Impact of Forcing Uncertainty

The Community Land Model (CLM) is the land component of the Community Earth System Model (CESM) and is used in several global and regional modeling systems. In this paper, we introduce model developments included in CLM version 5 (CLM5), which is the default land component for CESM2. We assess an ensemble of simulations, including prescribed and prognostic vegetation state, multiple forcing data sets, and CLM4, CLM4.5, and CLM5, against a range of metrics including from the International Land Model Benchmarking (ILAMBv2) package. CLM5 includes new and updated processes and parameterizations: (1) dynamic land units, (2) updated parameterizations and structure for hydrology and snow (spatially explicit soil depth, dry surface layer, revised groundwater scheme, revised canopy interception and canopy snow processes, updated fresh snow density, simple firn model, and Model for Scale Adaptive River Transport), (3) plant hydraulics and hydraulic redistribution, (4) revised nitrogen cycling (flexible leaf stoichiometry, leaf N optimization for photosynthesis, and carbon costs for plant nitrogen uptake), (5) global crop model with six crop types and time-evolving irrigated areas and fertilization rates, (6) updated urban building energy, (7) carbon isotopes, and (8) updated stomatal physiology. New optional features include demographically structured dynamic vegetation model (Functionally Assembled Terrestrial Ecosystem Simulator), ozone damage to plants, and fire trace gas emissions coupling to the atmosphere. Conclusive establishment of improvement or degradation of individual variables or metrics is challenged by forcing uncertainty, parametric uncertainty, and model structural complexity, but the multivariate metrics presented here suggest a general broad improvement from CLM4 to CLM5.

58 GEOSCIENCES↗

RESULTS OF THE 2008 UT MODELING BENCHMARK OBTAINED WITH 2 SEMI-ANALYTICAL MODELS: RESPONSES OF FLAT BOTTOM HOLES AT VARIOUS DEPTHS UNDER INTERFACES OF DIFFERENT CURVATURES

This paper presents the results of the 2008 UT modeling benchmark with the ultrasonic simulation code for predicting echo-responses from flaws integrated into the Civa software platform and with the code developed by M. Spies. UT configurations addressed are similar to 2007 ones, to better understand some responses obtained last year. Experimental results proposed concern the responses of flat bottom holes at different depths inside surface curved blocks inspected by an immersion probe in normal incidence. They investigate the influence of surface curvature upon the amplitude and shape of flaw responses. Comparison of the simulated and experimental results is discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmark studies among own and commercial beam tracking codes on fundamental conditions

In order to design accelerators or to analyze experimental data, commercially or noncommercially programs for tracking particles have been developed and used. However the reliabilities of those programs are not clear, especially if the beam quality is as high as that required for future applications. Therefore, for the purpose to study the reliabilities and to improve their accuracy, we planed to benchmark those programs. As a first step, the calculations were carried out in the both condition of free space and homogeneously accelerating-field by using three own codes and three commercial codes (MAGIC, PARMELA, and GPT)

43 PARTICLE ACCELERATORS↗

Benchmark calculations for dissipative dynamics of a system coupled to an anharmonic bath with the multiconfiguration time-dependent Hartree method

In this paper, we present benchmark results for dissipative dynamics of a harmonic oscillator coupled to an anharmonic bath of Morse oscillators. The microscopic Hamiltonian has been chosen so that the anharmonicity can be adjusted as a free parameter, and its effect can be isolated. This leads to a temperature dependent spectral density of the bath, which is studied for ohmic and lorentzian cases. Also, we compare numerically exact multiconfiguration time-dependent Hartree results with approximate solutions using continuous configuration time-dependent self-consistent field and local coherent state approximation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mixed quantum-classical simulations of charge transport in organic materials: Numerical benchmark of the Su-Schrieffer-Heeger model

The electron-phonon coupling is critical in determining the intrinsic charge carrier and exciton transport properties in organic materials. In this study, we consider a Su-Schrieffer-Heeger (SSH) model for molecular crystals, and perform numerical benchmark studies for different strategies of simulating the mixed quantum-classical dynamics. These methods, which differ in the selection of initial conditions and the representation used to solve the time evolution of the quantum carriers, are shown to yield similar equilibrium diffusion properties. A hybrid approach combining molecular dynamics simulations of nuclear motion and quantum-chemical calculations of the electronic Hamiltonian at each geometric configuration appears as an attractive strategy to model charge dynamics in large size systems ''on the fly,'' yet it relies on the assumption that the quantum carriers do not impact the nuclear dynamics. We find that such an approximation systematically results in overestimated charge-carrier mobilities, with the associated error being negligible when the room-temperature mobility exceeds {approx}4.8 cm{sup 2}/Vs ({approx}0.14 cm{sup 2}/Vs) in one-dimensional (two-dimensional) crystals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Atomic data for astrophysics. Calculations, benchmarking and distribution

Some recent R-matrix and distorted-wave calculations, done as part of the UK APAPNetwork, are presented. They are focused on some ions important for the EUV and the X-rays, in particular for the solar corona. A long-term and novel project to benchmark atomic data against laboratory and astrophysical data is summarised, highlighting new plasma diagnostics. The various ways in which the atomic data are made available to the various communities through e.g. the CHIANTI and the VAMDC EU framework are also presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

FEMAXI-V benchmarking study on peak temperature and fission gas release prediction of PWR rod fuel

The present paper reports a study of FEMAXI-V code and related report on code benchmarking. Capabilities of the FEMAXI-V code to predict the thermal and fission gas release have been tested on MOX fuels in LWRs which has been done in SCK{center_dot}CEN and Belgonucleaire by using PRIMO MOX rod BD8 irradiation experiment after V Sobolev as reported O. J. Ott. Base irradiation in the BR3 reactor, the BD8 rod was transported to CEA-Saclay for irradiation in the OSIRIS reactor (ramp power excursion). The irradiation device used for the PRIMO ramps was the ISABELLE 1 loop, installed on a movable structure of the core periphery. The power variations were obtained by inwards/backwards movements of the loop in the core water. The preconditioning phase for rod BD8 occurred at a peak power level of 189 W/cm with a hold time of 27 hours. The subsequent power excursion rate amounted to 77 W/ (cm.min), reaching a terminal peak power level of 395 W/cm that lasted for 20 hours.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Laser produced plasma sources for nanolithography—Recent integrated simulation and benchmarking

Photon sources for extreme ultraviolet lithography (EUVL) are still facing challenging problems to achieve high volume manufacturing in the semiconductor industry. The requirements for high EUV power, longer optical system and components lifetime, and efficient mechanisms for target delivery have narrowed investigators towards the development and optimization of dual-pulse laser sources with high repetition rate of small liquid tin droplets and the use of multi-layer mirror optical system for collecting EUV photons. We comprehensively simulated laser-produced plasma sources in full 3D configuration using 10–50 μm tin droplet targets as single droplets as well as, for the first time, distributed fragmented microdroplets with equivalent mass. The latter is to examine the effects of droplet fragmentation resulting from the first pulse and prior to the incident second main laser pulse. We studied the dependence of target mass and size, laser parameters, and dual pulse system configuration on EUV radiation output and on atomic and ionic debris generation. Our modeling and simulation included all phases of laser target evolution: from laser/droplet interaction, energy deposition, target vaporization, ionization, plasma hydrodynamic expansion, thermal and radiation energy redistribution, and EUV photons collection as well as detail mapping of photons source size and location. We also simulated and predicted the potential damage to the optical mirror collection system from plasma thermal and energetic debris and the requirements for mitigating systems to reduce debris fluence. The debris effect on mirror collection system is analyzed using our three-dimensional ITMC-DYN Monte Carlo package. Modeling results were benchmarked against our CMUXE laboratory experimental studies for the EUV photons production and for debris and ions generation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A benchmark concept for simulation in radiographic testing

The new standard ISO 17636–2:2013 “NDT of welds: Radiographic testing - Part 2: X- and gamma ray techniques with digital detectors” describes a complex procedure for film replacement by phosphor imaging plates and digital detector arrays. RT modeling software should consider these detector types, X-ray film, and the standard requirements for image quality. Practitioners expect the same visibility of image quality indicators (IQI) in the simulated radiographs as in the experimental exposures. The proposed benchmark test is based on the comparison of experimental radiographs taken at BAM with modeled ones of participants. The experimental setup and the determination of the equivalent penetrameter sensitivity (EPS) as described in the procedure of ASTM E 746 are used for quantitative evaluation of the achievable contrast sensitivity for step hole IQIs as considered in Annex B of ISO 17636–2. System classification data for Computed Radiography (CR) and film systems will be provided by BAM according to ISO 11699–1 for selected film systems and according to ASTM E 2446 for selected CR systems. The classification of films and digital detectors is based on the measurement of the dose response function, the basic spatial resolution (SR{sub b}) of the image, and the measured image noise, which depends on the detector efficiency, the quantum statistics, and the detector fixed pattern noise.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Results of the 2013 UT modeling benchmark obtained with models implemented in CIVA

The 2013 Ultrasonic Testing (UT) modeling benchmark concerns direct echoes from side drilled holes (SDH), flat bottom holes (FBH) and corner echoes from backwall breaking artificial notches inspected with a matrix phased array probe. This communication presents the results obtained with the models implemented in the CIVA software: the pencilmodel is used to compute the field radiated by the probe, the Kirchhoff approximation is applied to predict the response of FBH and notches and the SOV (Separation Of Variables) model is used for the SDH responses. The comparison between simulated and experimental results are presented and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A proposed benchmark for simulation in radiographic testing

The purpose of this benchmark study is to compare simulation results predicted by various models of radiographic testing, in particular those that are capable of separately predicting primary and scatter radiation for specimens of arbitrary geometry.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗