Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Performance Evaluation of Hierarchical Controls for Advanced Distribution Management System-Centered Grid Operations: Preprint

This paper presents a hardware-in-the-loop (HIL) platform to evaluate the performance of voltage regulation using an advanced distribution management system (ADMS) for grid operations to control legacy and grid-edge voltage control devices and coordinate with distributed energy management systems (DERMS) to manage high penetrations of photovoltaics (PV) on a utility distribution system. The HIL platform provides realistic laboratory testing, including accurate modeling (legacy devices, grid-edge devices, and PV) of the real-world distribution system from a utility partner, a real controller (ADMS), software controller DERMS, hardware grid-edge devices, and standard communications protocols. The test results show proper functionalities of the integrated platform and the performance of voltage regulation of the coordinated control systems. Based on laboratory testing, the utility can set up the same grid-automation system to manage DERs, legacy devices, and grid-edge devices to achieve their system-level control and operation objectives (e.g., voltage regulation), thus de-risking potential issues (e.g., instability) for field deployment.

ADMS↗

Performance evaluation of stand alone hybrid PV-wind generator

This paper presents the performance evaluation of standalone hybrid system on Photovoltaic (PV)-Wind generator at Faculty of Electrical Engineering (FKE), UTeM. The hybrid PV-Wind in UTeM system is combining wind turbine system with the solar system and the energy capacity of this hybrid system can generate up to charge the battery and supply the LED street lighting load. The purpose of this project is to evaluate the performance of PV-Wind hybrid generator. Solar radiation meter has been used to measure the solar radiation and anemometer has been used to measure the wind speed. The effectiveness of the PV-Wind system is based on the various data that has been collected and compared between them. The result shows that hybrid system has greater reliability. Based on the solar result, the correlation coefficient shows strong relationship between the two variables of radiation and current. The reading output current followed by fluctuate of solar radiation. However, the correlation coefficient is shows moderate relationship between the two variables of wind speed and voltage. Hence, the wind turbine system in FKE show does not operate consistently to produce energy source for this hybrid system compare to PV system. When the wind system does not fully operate due to inconsistent energy source, the other system which is PV will operate and supply the load for equilibrate the extra load demand.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Development and performance evaluation of active insulation systems using solid-state thermal switches

Traditional building envelopes have passive insulation systems that cannot respond to dynamic changes in the environment. An Active Insulation System (AIS) consists of Active Insulation Materials (AIMs) that dynamically vary the thermal conductivity of the insulation system. Several researchers have evaluated the impact of AIS on building thermal and energy performance by using simulation tools. Up to 70% savings in annual heating and cooling energy and significant reductions in peak demand have been predicted for some climates with wall systems employing AIS. However, materials and assembly development still need a cost-effective product that achieves the required performance. Here, in this study, we present the process of developing an AIS that we will install in a test hut for its performance evaluation. Minimum performance criteria of the AIS system are developed based on R-low/R-high ratio, required time and efficiency to switch states, and cost estimates. The following steps during this study are creating the concept to meet the requirements, predicting the performance via simulations, developing the experimental setup for bench-scale testing, and finally, constructing a full-scale wall assembly and monitoring the performance when exposed to environmental chamber tests. The selected approach uses off-the-shelf products to create an AIS that can switch R-value between 0.98 ft 2 ·°F·h/BTU (0.173 m 2 ·K/W) and 5.81 ft 2 ·°F·h/BTU (1.02 m 2 ·K/W) and have a switching time of less than one minute between R-high and R-low.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development and Performance Evaluation of of Active Insulation Systems using Solid-State Thermal Switches

Traditional building envelopes have passive insulation systems that cannot respond to dynamic changes in the environment. An Active Insulation System (AIS) consists of Active Insulation Materials (AIMs), which dynamically vary the thermal conductivity of the insulation system. Several researchers have evaluated the impact of AIS on building thermal and energy performance by using simulation tools. Up to 70% savings in annual heating and cooling energy and significant reductions in peak demand have been predicted for some climates with wall systems employing AIS. Sensitivity studies have provided requirements for the AIS properties and control schemes that can lead to those savings. However, materials and assembly development have not yet achieved a cost-effective product that achieves the required performance. In this study, we present the process to develop an AIS that we will install in a test hut for their performance evaluation. Minimum performance criteria of the AIS system are developed based on Rmin/Rmax ratio, required time and efficiency to switch states and cost estimate. The next step carried out during this study is creating the concept to meet the requirements, predicting the performance by simulations, developing the experimental setup for bench-scale testing, and finally, constructing a full-scale wall assembly and monitoring the performance when exposed to natural weather conditions. The selected approach uses off-the-shelf products to create a materials system that can switch R-value between R~=1 ft2·°F·h/BTU (0.18 m2·K/W) and R~=7 ft2·°F·h/BTU (1.23 m2·K/W and have a switching time of less than one minute between R-high and R-low.

Iffa, Emishaw↗

Performance evaluation approach for the supercritical helium cold circulators of ITER

The ITER project design foresees Supercritical Helium (SHe) forced flow cooling for the main cryogenic components, namely, the superconducting (SC) magnets and cryopumps (CP). Therefore, cold circulators have been selected to provide the required SHe mass flow rate to cope with specific operating conditions and technical requirements. Considering the availability impacts of such machines, it has been decided to perform evaluation tests of the cold circulators at operating conditions prior to the series production in order to minimize the project technical risks. A proposal has been conceptualized, evaluated and simulated to perform representative tests of the full scale SHe cold circulators. The objectives of the performance tests include the validation of normal operating condition, transient and off-design operating modes as well as the efficiency measurement. A suitable process and instrumentation diagram of the test valve box (TVB) has been developed to implement the tests at the required thermodynamic conditions. The conceptual engineering design of the TVB has been developed along with the required thermal analysis for the normal operating conditions to support the performance evaluation of the SHe cold circulator.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmark of numerical modeling approaches on the systematic performance evaluation of wave energy converters

Different numerical modeling methods have been developed and applied to evaluate a variety of performance indicators of wave energy converters (WECs), including the power performance, structural loads, levelized cost of energy, etc. Based on the modeling fidelity, the commonly used numerical modeling approaches can be classified as linear modeling, weakly nonlinear modeling and fully nonlinear modeling approaches. Each method differs in accuracy and computational efficiency, making them suitable for different stages of WEC design. However, the selection of modeling approach could significantly impact evaluation outcomes. For instance, simplified linear models may underestimate structural loads or overestimate energy production in some operational conditions, potentially leading to less cost-effective designs. Given the widespread utilization of these models, it is essential to understand the uncertainties brought by them in performance evaluations. This work is dedicated to benchmarking different linear-potential-flow-based numerical models for evaluating the systematic performance of WECs. Three representative numerical modeling approaches are considered in this work, including linear frequency-domain modeling, statistically linearized spectral-domain modeling and Cummins equation-based nonlinear time-domain modeling. A generic point absorber WEC is considered as the research reference in this work, and different sea sites are taken into account. The numerical models are utilized to predict critical performance indicators, including power performance, the annual energy production, the capacity factor, the levelized cost of energy and the PTO fatigue loads. By comparing the results, this work identifies the uncertainties associated with different modeling approaches in evaluating WEC performance.

Fatigue↗

Performance Evaluation of a Bedside Cardiac SPECT System

This paper reports on the initial performance evaluation of a bedside cardiac PET/SPECT system. The system was designed to move within a hospital to image critically-ill patients, for example, those in intensive care unit (ICU) or emergency room settings, who cannot easily be transported to a conventional SPECT or PET facility. The system uses two compact (25 cm times 25 cm) detectors with pixilated NaI crystals and position sensitive PMTs. The performance is evaluated for both 140 keV (Tc-99m) and 511 keV (F-18) emitters with the system operating in single photon counting (SPECT) mode. The imaging performance metrics for both 140 keV and 511 keV included intrinsic energy resolution, spatial resolution (intrinsic, system, and reconstructed SPECT), detection sensitivity, count rate capability, and uniformity. Results demonstrated an intrinsic energy resolution of 31% at 140 keV and 23% at 511 keV, a planar intrinsic spatial resolution of 5.6 mm full width half-maximum (FWHM) at 140 keV and 6.3 mm FWHM at 511 keV, and a sensitivity of 4.15 countsmiddotmuCi-1 ldr s-1 at 140 keV and 0.67 counts ldr muCi-1 ldr s-1 at 511 keV. To further the study, a SPECT acquisition using a dynamic cardiac phantom was performed, and the resulting reconstructed images are presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Gum-compliant uncertainty propagations for Pu and U concentration measurements using the 1st-prototype XOS/LANL hiRX instrument; an SRNL H-Canyon Test Bed performance evaluation project

An SRNL H-Canyon Test Bed performance evaluation project was completed jointly by SRNL and LANL on a prototype monochromatic energy dispersive x-ray fluorescence instrument, the hiRX. A series of uncertainty propagations were generated based upon plutonium and uranium measurements performed using the alpha-prototype hiRX instrument. Data reduction and uncertainty modeling provided in this report were performed by the SRNL authors. Observations and lessons learned from this evaluation were also used to predict the expected uncertainties that should be achievable at multiple plutonium and uranium concentration levels provided instrument hardware and software upgrades being recommended by LANL and SRNL are performed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-E-T-531: Performance Evaluation of Multithreaded Geant4 for Proton Therapy Dose Calculations in a High Performance Computing Facility

Purpose: To evaluate the efficiency of multithreaded Geant4 (Geant4-MT, version 10.0) for proton Monte Carlo dose calculations using a high performance computing facility. Methods: Geant4-MT was used to calculate 3D dose distributions in 1×1×1 mm3 voxels in a water phantom and patient's head with a 150 MeV proton beam covering approximately 5×5 cm2 in the water phantom. Three timestamps were measured on the fly to separately analyze the required time for initialization (which cannot be parallelized), processing time of individual threads, and completion time. Scalability of averaged processing time per thread was calculated as a function of thread number (1, 100, 150, and 200) for both 1M and 50 M histories. The total memory usage was recorded. Results: Simulations with 50 M histories were fastest with 100 threads, taking approximately 1.3 hours and 6 hours for the water phantom and the CT data, respectively with better than 1.0 % statistical uncertainty. The calculations show 1/N scalability in the event loops for both cases. The gains from parallel calculations started to decrease with 150 threads. The memory usage increases linearly with number of threads. No critical failures were observed during the simulations. Conclusion: Multithreading in Geant4-MT decreased simulation time in proton dose distribution calculations by a factor of 64 and 54 at a near optimal 100 threads for water phantom and patient's data respectively. Further simulations will be done to determine the efficiency at the optimal thread number. Considering the trend of computer architecture development, utilizing Geant4-MT for radiotherapy simulations is an excellent cost-effective alternative for a distributed batch queuing system. However, because the scalability depends highly on simulation details, i.e., the ratio of the processing time of one event versus waiting time to access for the shared event queue, a performance evaluation as described is recommended.

60 APPLIED LIFE SCIENCES↗

Performance Evaluation of Python Based Data Analytics Frameworks in Summit: Early Experiences

The explosion in the volumes of data generated from ever-larger simulation campaigns and experiments or observations necessitates competent tools for data wrangling and analysis). While the Oak Ridge Leadership Computing Facility (OLCF) provides a variety of tools to perform data wrangling and data analysis tasks, Python based tools often lack scalability, or the ability to fully exploit the computational capability of OLCF’s Summit supercomputer. NVIDIA RAPIDS and Dask offer a promising solution to accelerate and distribute data analytics workloads from personal computers to heterogeneous supercomputing systems. We discuss early performance evaluation results of RAPIDS and Dask on Summit to understand their capabilities, scalability, and limitations. Our evaluation includes a subset of RAPIDS libraries, i.e., cuDF, cuML, and cuGraph, and Chainer’s CuPy, and their multi-GPU variants when available.We also draw on the observed trends from the performance evaluation results to discuss best practices for maximizing performance.

Hernandez Arreguin, Benjamin↗

Performance Evaluation of Multi-Vendor Grid-Forming Inverters for Grid-Connected Operation Through Hardware Experimentation: Preprint

Existing real-world projects of GFM inverters that operate in parallel to power grids typically are sized between dozens and a few hundreds Megawatt (MW) scale according to a recent NERC GFM inverter white paper. These large systems are often difficult to evaluate prior to deployments because of their large size. The performance of smaller GFM inverters (dozens to a few hundreds MW) that operate parallel with power grids (distribution systems) is even less understood. There is an opportunity to better understand these systems through hardware testing under controlled laboratory conditions. Therefore, this paper presents the functional performance evaluation tests of multiple (three) commercial GFM inverters when they operate in parallel with the grid through hardware experiments. The goal of these tests is to explore the GFM inverters' functionalities and dynamic response when in parallel with power grids to eventually develop universal specifications for GFM inverters. Both steady state (changing the inverter's frequency and voltage droop) and transient (adding step change in grid's frequency/voltage) tests are performed for each GFM inverter with the same testing circuit and testing protocol. The experimental results indicate the bench-marked performance that: 1) the GFM inverters can be dispatched through frequency and voltage droop intercepts to output the target power when paralleled to the grid; 2) the GFM inverters automatically respond to system frequency and voltage events to output the needed power, however, the GFM inverters all show stability issues when absorbing reactive power from the grid.

grid-forming inverters↗

Noise Performance Evaluation of the Candidate Digitizers for the MAJORANA DEMONSTRATOR

The noise performance evaluation of the two digitizer cards being considered for the MAJORANA DEMONSTRATOR (MJD) is presented in this document. The procurement of the data acquisition electronics for the MJD is scheduled to happen this year. At the time of writing this document, there are two candidate digitizer electronic boards. One aspect that is being considered by the collaboration is the feasibility of using the MJD for dark matter searches. The feasibility of using the MJD for this application is going to be dictated by the ability of the demonstrator to reach sub-keV energy resolution. One of the potential sources of noise in the MJD is the data acquisition system. This document will is concluded with a recommendation for the final digitizer board by comparing the noise performance of the two electronics systems. Noise parameters such as the effective number of bits, input range linearity and signal to noise ratio are experimentally determined. The two digitizer cards feature different on-board digital signal processing and these features are compared. The experimental set-up was also used to identify sources of noise. This paper describes these sources of noise in the data acquisition system, along with mitigation strategies. Issues such as grounding and wiring scheme have an impact in the overall data acquisition system performance and are discussed in detail. As a conclusion, the suitability of each one of the cards to become the back bone of the data acquisition system of the MJD is discussed.

99 GENERAL AND MISCELLANEOUS↗

Improvement and performance evaluation of the perturbation source method for an exact Monte Carlo perturbation calculation in fixed source problems

This paper presents improvement and performance evaluation of the “perturbation source method”, which is one of the Monte Carlo perturbation techniques. The formerly proposed perturbation source method was first-order accurate, although it is known that the method can be easily extended to an exact perturbation method. A transport equation for calculating an exact flux difference caused by a perturbation is solved. A perturbation particle representing a flux difference is explicitly transported in the perturbed system, instead of in the unperturbed system. The source term of the transport equation is defined by the unperturbed flux and the cross section (or optical parameter) changes. The unperturbed flux is provided by an “on-the-fly” technique during the course of the ordinary fixed source calculation for the unperturbed system. A set of perturbation particle is started at the collision point in the perturbed region and tracked until death. For a perturbation in a smaller portion of the whole domain, the efficiency of the perturbation source method can be improved by using a virtual scattering coefficient or cross section in the perturbed region, forcing collisions. Performance is evaluated by comparing the proposed method to other Monte Carlo perturbation methods. Numerical tests performed for a particle transport in a two-dimensional geometry reveal that the perturbation source method is less effective than the correlated sampling method for a perturbation in a larger portion of the whole domain. However, for a perturbation in a smaller portion, the perturbation source method outperforms the correlated sampling method. The efficiency depends strongly on the adjustment of the new virtual scattering coefficient or cross section. - Highlights: • A Monte Carlo perturbation method known as “perturbation source method” is examined. • The method outperforms other perturbation methods when the perturbed region is small. • The efficiency depends on virtual scatterings added by a user-specified parameter.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Statistical scoring procedures applicable to laboratory performance evaluation

Two statistical scoring procedures based on p-values have been developed to evaluate the overall performance of analytical laboratories performing environmental measurements. The overall scores of bias and standing are used to determine how consistently a laboratory is able to measure the true (unknown) value correctly over time. The overall scores of precision and standing are used to determine how well a laboratory is able to reproduce its measurements in the long run. Criteria are established for qualitatively labeling measurements as Acceptable, Warning, and Not Acceptable and for identifying areas where laboratories should re-evaluate their measurement procedures. These statistical scoring procedures are applied to two real environmental data sets.

97 MATHEMATICS AND COMPUTING↗

SU-E-J-35: Clinical Performance Evaluation of a Phase II Proton CT Scanner

Purpose: To develop the methodology to evaluate the clinical performance of a Phase II Proton CT scanner Methods: Range errors on the order of 3%-5% constitute a major uncertainty in current charged particle treatment planning based on Hounsfield Unit (HU)-relative stopping power (RSP) calibration curves. Within our proton CT collaboration, we previously developed and built a Phase I proton CT scanner that provided a sensitive area of 9 cm (axial) × 18 cm (in-plane). This scanner served to get initial experience with this new treatment planning tool and to incorporate lessons learned into the next generation design. A Phase II scanner was recently completed and is now undergoing initial performance testing. It will increase the proton acquisition rate and provide a larger detection area of 9 cm x 36 cm. We are now designing a comprehensive evaluation program to test the image quality, imaging dose, and range uncertainty associated with this scanner. The testing will be performed along the lines of AAPM TG 66. Results: In our discussion of the evaluation protocol we identified the following priorities. The image quality of proton CT images, in particular spatial resolution and low-density contrast discrimination, will be evaluated with the Catphan600 phantom. Initial testing showed that the Catphan uniformity phantom did not provide sufficient uniformity; it was thus replaced by a cylindrical water phantom. The imaging dose will be tested with a Catphan dose module, and compared to a typical cone beam CT dose for comparable image quality. Lastly, we developed a dedicated dosimetry range phantom based on the CIRS pediatric head phantom HN715. Conclusion: A formal evaluation of proton CT as a new tool for proton treatment planning is an important task. The availability of the new Phase II proton CT scanner will allow us to perform this task. This research is supported by the National Institute of Biomedical Imaging and Bioengineering of the NIH under award number R01EB013118. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Performance evaluation of the R6R018 fuel plate using PLATE code

The paper presents results of performance evaluation of the R6R018 fuel plate using PLATE code. R6R018 is a U-7Mo dispersion type mini-plate with Al-3.5Si matrix irradiated in the RERTR-9B experiment. The design of this plate is prototypical of the planned LEONIDAS irradiation test. Therefore, a detailed performance analysis of this plate is important to confirm acceptable behavior in pile, and to provide baseline and justification for further analysis and testing. Specific results presented in the paper include fuel temperature history, growth of the interaction layer between the U-Mo and the matrix, swelling, growth of the corrosion layer, and degradation of thermal conductivity. The methodology of the analysis will be discussed including the newly developed capability to account for the formation of the interaction layer during fuel fabrication.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Strategic Performance Evaluation Measurement Plan (PEMP) Scorecard in QuickScore Training Tool (User Guide)

The Strategic Performance Evaluation Measurement Plan (PEMP) Scorecard, now housed in QuickScore, is an assurance and governance data scorecard which shows the health of the labs against the current fiscal year PEMP objectives. POC's for PEMP objective owners are requested to provide status of their PEMP objective, capture the top 6 cumulative accomplishments, top 6 issues, which include IFR issues and provide mitigation and or improvement action plans. Updated scorecards are used in OMR and BOM GS&S committee

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Performance Evaluation of Distributed Energy Resource Management Algorithm in Large Distribution Networks

This paper presents performance evaluation of hierarchical optimization and control for distributed energy resource management system (DERMS) in large distribution networks via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of a full-scale distribution system of 11,000 nodes, the DERMS software controller, and 90 power hardware photovoltaics (PVs) and battery inverters. The applied DERMS algorithm is designed based on a realtime optimal power flow algorithm and implemented with acceleration design that performs fast dispatch of simulated PVs and real physical hardware DER devices every 4 seconds.

DERMS↗