Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗

Measurement-based performance evaluation technique for high-performance computers

A measurement-based performance evaluation technique has been used to characterize the OS performance of Cedar, a hierarchical shared-memory multiprocessor system. Thirteen OS performance meters were used to capture the operating system activities for compute-bound workloads. Three representative applications from the Perfect Benchmark Suite were used to measure the OS performance in a dedicated system and in multiprogrammed workloads. It was found that 13-23 percent of the total execution time on a dedicated system was spent in executing OS-related activities. Under multiprogramming, 12-14 percent of the total execution time was used by the OS. The impact of multiprogramming on the operating system performance meters was also measured.

Sharma, S.↗

TRISO Fuel Performance Evaluation

TRISO Fuel Performance Evaluation outlining design and radionuclide source term, fuel performance during normal operation, fuel performance during core heatup accidents, other accident scenarios, and GenIV VHTR Fuel and Fuel Cycle PMB.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

An efficient technique for the performance evaluation of antenna arrays with noisy carrier reference

An efficient computational technique is developed to evaluate the performance of coherent receivers with noisy carrier reference and multiple antennas. The received signal is assumed to be uncoded residual carrier BPSK (binary phase shift keying), with a PLL (phase locked loop) used for extracting the carrier. Explicit relationships between the error probabilities and the various system parameters are given. Specific results are given for the performance gain of combined carrier referencing over baseband only combining when the channel alignment process is ideal. A simple asymptotic expression for the performance gain is determined when the number of antennas used is increased without bound. An example using a Block 3 Deep Space Network PLL illustrates the performance of each arraying structure. The technique used is applicable to the performance evaluation for other receivers having similar decision statistics.

Yan, T. Y.↗

Modeling Single-Crystal Battery Materials: From Fundamental Understanding to Performance Evaluation

The performance of rechargeable batteries is fundamentally influenced by the physicochemical properties and microstructural features of their key material components. Recent experimental advancements have highlighted the potential of single-crystal (SC) morphologies to address inherent limitations of polycrystalline (PC) electrodes and solid-state electrolytes, offering tunable charge transport kinetics and improved cell cycling performance. Here, this review examines how state-of-the-art computational modeling, from atomistic and mesoscale to continuum-level approaches, including machine learning methodologies, has been utilized to investigate the critical factors governing the electrochemical behavior of SC battery materials. We explore how predictive modeling can elucidate the processing–structure–property–performance relationships of SC cathodes, anodes, and solid-state electrolytes, with a focus on unique SC characteristics such as crystallographic anisotropy, size effects, and facet-dependent properties. Additionally, we identify limitations in commonly used modeling techniques and discuss strategies to address these challenges. By integrating high-fidelity simulations with experimental insights, this review aims to outline a clear path for the rational design and optimization of SC battery components, paving the way for accelerated advancements in energy storage technologies.

Materials science↗

Skylab program earth resources experiment package sensor performance evaluation, volume 1, (S190A)

The results of S190A sensor performance evaluation are summarized based on data presented by all contributors to the sensor performance evaluation interim reports. Techniques used in sensor performance evaluation are discussed. Topics discussed include: performance degradation identified during the Skylab missions, S190A and EREP system anomalies that affected S190A performance, and the performance achieved, in terms of pertinent S190A parameters. Additional analyses include final performance analyses completed after submittal of the SL4 interim sensor performance evaluation reports, including completion of detailed analyses of basic performance parameters initiated during the interim report periods and consolidation analyses to reduce independent mission data (SL2, SL3, and SL4) to determine overall performance realized during all three Skylab missions.

Kenney, G. P.↗

Performance Evaluation and Benchmarking of Next Intelligent Systems

Performance Evaluation and Benchmarking of Intelligent Systems presents research dedicated to the subject of performance evaluation and benchmarking of intelligent systems by drawing from the experiences and insights of leading experts gained both through theoretical development and practical implementation of intelligent systems in a variety of diverse application domains. This contributed volume offers a detailed and coherent picture of state-of-the-art, recent developments, and further research areas in intelligent systems. The chapters cover a broad range of applications, such as assistive robotics, planetary surveying, urban search and rescue, and line tracking for automotive assembly. Subsystems or components described in this book include human-robot interaction, multi-robot coordination, communications, perception, and mapping. Chapters are also devoted to simulation support and open source software for cognitive platforms, providing examples of the type of enabling underlying technologies that can help intelligent systems to propagate and increase in capabilities. Performance Evaluation and Benchmarking of Intelligent Systems serves as a professional reference for researchers and practitioners in the field. This book is also applicable to advanced courses for graduate level students and robotics professionals in a wide range of engineering and related disciplines including computer science, automotive, healthcare, manufacturing, and service robotics.

42 ENGINEERING↗

Skylab program earth resources experiment package. Volume 5: Sensor performance evaluation (S193 ALT)

The results are summarized of S193 altimeter sensor performance evaluation based on data presented to the sensor performance evaluation interim reports. The results of additional analyses of S193 altimeter performance are presented, and techniques used in sensor performance evaluation are described. Significant performance degradation identified during the Skylab missions and the performance achieved are described in terms of pertinent S193 altimeter parameters. The additional analyses include final performance analyses completed after submittal of the SL4 interim sensor performance evaluation reports, including completion of detailed analyses of basic performance parameters initiated during the interim report periods.

Kenney, G. P.↗

Performance evaluation of the USGS velocity model for the San Francisco Bay Area

In this study, we evaluated the performance of the United States Geological Survey velocity model developed for the San Francisco Bay Area (SFBA), version 21.1. The evaluation was performed through high-resolution three-dimensional physics-based ground motion simulations of seven small-magnitude earthquakes (ranging from magnitude 3.8 to 4.4) that occurred on the eastern side of the San Francisco Bay. The simulations were performed in the frequency range from 0 to 5 Hz with a minimum shear-wave velocity of 250 m/s, which allowed the capture of wave propagation effects of the near-surface soft materials that characterize local basins. Based on the direct comparison of Fourier amplitude spectra between recorded and simulated ground motions for more than 250 stations, we found that the velocity model generally performs well in the frequency range of 0.2–5 Hz. The median value of the Fourier amplitude residuals was found to be near zero for all seven earthquakes. The slight over-prediction of 0.2 log-natural units at frequencies above 3 Hz in our simulations was attributed to the potentially inaccurate representation of the source radiation pattern by a double-couple point source model, and simple representation of shallow small-scale underground structural complexity in the velocity model. Maps of spectral amplitude differences between the simulated and recorded data were used to identify areas responsible for systematic ground motion over-predictions or under-predictions. For example, while some sub-domains over soft sediments show over-prediction patterns, the block east of the Hayward fault is prone to exhibit patterns of under-prediction. These maps can be used to guide future refinements of the SFBA velocity model. Since our simulation methodology allows for the decoupling of the source and wave propagation effects, the ground motion data generated by our simulations can also be used to quantify the epistemic uncertainty due to the velocity model, in empirically based ground motion estimates for the SFBA.

58 GEOSCIENCES↗

SU-F-I-55: Performance Evaluation of Digital PET/CT: Medical Physics Basis for the Clinical Applications

Purpose: Replacement of conventional PMT-based detector with next generation digital photon counting (DPC) detector is a technology leap for PET imaging. This study evaluated the performance and characteristics of the DPC system and its stability within a 1 year time window following its installation focusing on the medical physics basis for clinical applications. Methods: A digital PET/CT scanner using 1:1 coupling of 23,040 crystal: detector elements was introduced and became operational at OSU. We tested and evaluated system performance and characteristics using NEMA NU2-2012. System stabilities in timing resolution, energy resolution, detector temperature and humidity (T&H) were monitored over 1-yr. Timing, energy and spatial resolution were characterized across clinically relevant count rate range. CQIE uniformity PET and NEMA IEC-Body PET with hot spheres varying with sizes and contrasts were performed. PET reconstructed in standard(4mm), High(2mm) and Ultra-High(1mm) definitions were evaluated. Results: NEMA results showed PET spatial resolution (mm-FWHM) from 4.01&4.14 at 1cm to 5.82&6.17 at 20cm in transverse & axial. 322±3ps timing and 11.0% energy resolution were measured. 5.7kcps/MBq system sensitivity with 24kcps/MBq effective sensitivity was obtained. The peak-NECR was ∼171kcps with the effective peak-NECR >650kcps@50kBq/mL. Scatter fraction was ∼30%, and the maximum trues was >900kcps. NEMA IQ demonstrated hot sphere contrast ranging from ∼62%±2%(10mm) to ∼88%±2%(22mm), cold sphere contrast of ∼86%±2%(28mm) and ∼89%±3%(37mm) and excellent uniformity. Monitoring 1-yr stability, it revealed ∼1% change in timing, ±0.4% change in energy resolution, and <10% variations in T&H. CQIE PET gave <3% SUV variances in axial. 60%–100% recovery coefficients across sphere sizes and contrast levels were achieved. Conclusion: Characteristics and stability of the next generation DPC PET detector system over an 1-yr time window was excellent and better than prior experiences. It demonstrated improved and robust system characteristics and performance in spatial resolution, sensitivity, timing and energy resolution, count rate and image quality. Michael Miller is an employee of Philips Healthcare.

60 APPLIED LIFE SCIENCES↗

Experimental Performance Evaluation of a Hyper-Branched Polymer Electrolyte for Rechargeable Li-Air Batteries

A hyper-branched polymer (HBP) electrolyte is synthesized for rechargeable lithium-air (Li-air) battery cell and experimentally evaluated its performance in actual battery cell environment. Several real-world battery cells were fabricated with synthesized HBP electrolyte, pure lithium metal as anode and an oxygen permeable air cathode to evaluate reproducibility of the rechargeable Li-air battery cell. The effect of various conditions such as various HBP based electrolytes, discharge current -0.1~0.5 mA, cathode preparation processes and carbon contents on the battery cell performance were experimentally evaluated using the fabricated battery cells under dry air condition. Detailed HBP electrolyte synthesis procedures and experimental performance evaluation of Li-air battery cell for various conditions are presented. The experimental results showed that different conditions and processes significantly affect the Li-air battery performance. Upon taking into account the effect of different conditions and processes, optimized HBP electrolyte materials, cathode process and conditions were determined. Several Li-air battery cells were fabricated with optimized conditions and optimized battery cell materials to determine the reproducibility and performance consistency. Experimental results showed that over 55–65 h of discharge occurred over 2.5 V terminal cell voltage with all three optimized Li-air battery cells. It implied that the optimized Li-air battery cells were reproducible and were able to hold charge over 2.5 V for more than 2 days. Experimental results of the Li-air battery cell with further refined optimized materials revealed that the battery cell can discharge more than 10 days (i.e., more than 250 h) at or above 2.0 V. The experimental results also showed that the Li-air battery discharge time got shorter as the discharge-charge cycle increases due to increase in internal resistances of battery cell materials. The experimental results confirmed that the lithium-air battery cell can be reproduced without loss of performance and can hold charge more than 10 days at or over 2.0 V. The investigation results obtained may usher a pathway to manufacture a long-life rechargeable Li-air battery cell in the near future.

25 ENERGY STORAGE↗

Development of an Automated Remedy Performance Evaluation Program - 13622

Performance monitoring is a vital element of groundwater remediation. Unfortunately, the enormous efforts and costs that are expended procuring, managing, processing and storing monitoring data are often not subject to correspondingly rigorous evaluation. This is despite the fact that many steps in the process are predictable and are repeated many times over the remedy life cycle. At the Department of Energy (DOE) Hanford Site, a program is underway to automate many of these steps - processing, formatting any analyzing large volumes of heterogeneous data associated with the operation of several groundwater pump-and-treat (P and T) and in-situ remedies. The Automated Remedy Performance Evaluation Program (ARPEP) was developed from a work-flow process designed to deliver (a) monthly data summaries and preliminary analysis, (b) quarterly performance assessments, and (c) annual roll-up analyses that detect changes in long-term monitoring datasets and support remedy optimization. The intent of the ARPEP is to provide detailed, systematic and traceable data summaries, depictions and analyses that can be used by project scientists to complete their evaluation of remedy performance. The ARPEP work-flow was formalized following extensive review of applicable guidance, regulation and industry standards. The ARPEP incorporates disparate data types collected over different frequencies, such as water levels and pumping rates recorded every minute, and groundwater sample results obtained on quarterly, annual or irregular intervals. The data are processed, reduced to frequencies suitable for assessment, and combined in various ways leading to performance indicators such as (a) pumped well capacities and system downtime that reflect operational performance; (b) hydraulic gradients and areas of hydraulic containment that reflect hydraulic performance; and (c) time-series (longitudinal) and geo-statistical (spatial) trend analyses that reflect progress toward attainment of Remedial Action Objectives (RAOs). The entire sequence of data processing and analysis is undertaken within the R programming environment, an open-source environment for statistical computing and graphics, and is summarized in a comprehensive PDF project report. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗