Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Evaluating the Performance of Unmanned Ground Vehicle Water Detection

Water detection is a critical perception requirement for unmanned ground vehicle (UGV) autonomous navigation over cross-country terrain. During the Robotics Collaborative Technology Alliances (RCTA) program, the Jet Propulsion Laboratory (JPL) developed a set of water detection algorithms that are used to detect, localize, and avoid water bodies large enough to be a hazard to a UGV. The JPL water detection software performs the detection and localization stages using a forward-looking stereo pair of color cameras. The 3D coordinates of water body surface points are then output to a UGV's autonomous mobility system, which is responsible for planning and executing safe paths. There are three primary methods for evaluating the performance of the water detection software. Evaluations can be performed in image space on the intermediate detection product, in map space on the final localized product, or during autonomous navigation to characterize the avoidance of a variety of water bodies. This paper describes a methodology for performing the first two types of water detection performance evaluations.

stereo vision↗

Evaluating the performance of a high resolution SLIM IM module integrated with an Agilent 6560 IM-QTOF MS

Integrate a combined Structures of Lossless Ion Manipulations (SLIM) module that incorporates both constant (not time-varying) field (CF) and oscillatory (time-varying) field (OF) IM separation stages into an Agilent 6560 IM-QTOF mass spectrometer system. Once the SLIM module has been integrated into the Agilent system, its performance will be evaluated using a variety of different samples.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Fabrication, evaluation, and performance of machined metal grazing incidence telescopes

The fabrication, evaluation, and performance of machined grazing incidence metal optics for applications ranging from telescopes with imaging of minutes of arc to those with imaging in the less-than-10-arcsec range are reviewed. Issues considered in the fabrication process include the choice of machining substrate, the choice of machine tool, the choice of method for removing tool marks, and the choice of a reflective surface. Means of evaluating the mirror performance include the FWHM and determination of noncircularity and surface roughness. Characteristics of previous and current grazing incidence metal mirrors are presented, with emphasis on the Einstein and Rosat optics.

Bowyer, Stuart↗

On evaluating the performability of degradable computing systems

If the performance of a computing system is 'degradable', performance and reliability issues must be dealt with simultaneously in the process of evaluating system effectiveness. For this purpose, a unified measure, called 'performability', is introduced and the foundations of performability modeling and evaluation are established. A critical step in the modeling process is the introduction of a 'capability function' which relates low-level system behavior to user-oriented performance levels. A hierarchical modeling scheme is used to formulate the capability function and capability is used, in turn, to evaluate performability. These techniques are then illustrated for a specific application: the performability evaluation of an aircraft computer in the environment of an air transport mission.

Meyer, J. F.↗

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

Image registration↗

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

image registration↗

Signal detection theory and methods for evaluating human performance in decision tasks

Signal Detection Theory (SDT) can be used to assess decision making performance in tasks that are not commonly thought of as perceptual. SDT takes into account both the sensitivity and biases in responding when explaining the detection of external events. In the standard SDT tasks, stimuli are selected in order to reveal the sensory capabilities of the observer. SDT can also be used to describe performance when decisions must be made as to the classification of easily and reliably sensed stimuli. Numbers are stimuli that are minimally affected by sensory processing and can belong to meaningful categories that overlap. Multiple studies have shown that the task of categorizing numbers from overlapping normal distributions produces performance predictable by SDT. These findings are particularly interesting in view of the similarity between the task of the categorizing numbers and that of determining the status of a mechanical system based on numerical values that represent sensor readings. Examples of the use of SDT to evaluate performance in decision tasks are reviewed. The methods and assumptions of SDT are shown to be effective in the measurement, evaluation, and prediction of human performance in such tasks.

Obrien, Kevin↗

Data Validation Package August 2015 Groundwater and Surface Water Sampling at the Tuba City, Arizona, Disposal Site November 2015

The groundwater compliance strategy for the Tuba City, Arizona, Disposal Site is defined in the 1999 Phase I Ground Water Compliance Action Plan for the Tuba City, Arizona, UMTRA Site. Samples are collected and analyzed on a semiannual basis to evaluate the performance of the Phase I remediation system. Sampling and analyses were conducted as specified in Sampling and Analysis Plan for U.S. Department of Energy Office of Legacy Management Sites (LMS/PRO/S04351, continually updated). U.S. Environmental Protection Agency (EPA) groundwater standards were exceeded in samples collected from monitoring wells and extraction wells as listed in Table 1. The data from this sampling event are generally consistent with previously obtained values and are acceptable for general use as qualified. Data anomalies are not significant with respect to the known nature and extent of contamination and progress of remedial action at the site. The data from this sampling event will be incorporated into the annual performance evaluation report that will present a comprehensive hydrologic summary and evaluation of groundwater remedial action performance at the Tuba City site through March 2016.

2015 Tuba City, AZ Groundwater and Surface Water S↗

Data Validation Package February 2016 Groundwater and Surface Water Sampling at the Tuba City, Arizona, Disposal Site April 2016

The groundwater compliance strategy for the Tuba City, Arizona, Disposal Site is defined in the 1999 Phase I Ground Water Compliance Action Plan for the Tuba City, Arizona, UMTRA Site. Samples are collected and analyzed on a semiannual basis to evaluate the performance of the Phase I remediation system. Sampling and analyses were conducted as specified in Sampling and Analysis Plan for U.S. Department of Energy Office of Legacy Management Sites (LMS/PRO/S04351, continually updated). U.S. Environmental Protection Agency (EPA) groundwater standards were exceeded in samples collected from monitoring wells as listed in Table 1. The data from this sampling event are generally consistent with previously obtained values and are acceptable for general use as qualified. Data anomalies are not significant with respect to the known nature and extent of contamination and progress of remedial action at the site. The data from this sampling event will be incorporated into the annual performance evaluation report that will present a comprehensive hydrologic summary and evaluation of groundwater remedial action performance at the Tuba City site through March 2016.

2016 Tuba City↗

Collected notes from the Benchmarks and Metrics Workshop

In recent years there has been a proliferation of proposals in the artificial intelligence (AI) literature for integrated agent architectures. Each architecture offers an approach to the general problem of constructing an integrated agent. Unfortunately, the ways in which one architecture might be considered better than another are not always clear. There has been a growing realization that many of the positive and negative aspects of an architecture become apparent only when experimental evaluation is performed and that to progress as a discipline, we must develop rigorous experimental methods. In addition to the intrinsic intellectual interest of experimentation, rigorous performance evaluation of systems is also a crucial practical concern to our research sponsors. DARPA, NASA, and AFOSR (among others) are actively searching for better ways of experimentally evaluating alternative approaches to building intelligent agents. One tool for experimental evaluation involves testing systems on benchmark tasks in order to assess their relative performance. As part of a joint DARPA and NASA funded project, NASA-Ames and Teleos Research are carrying out a research effort to establish a set of benchmark tasks and evaluation metrics by which the performance of agent architectures may be determined. As part of this project, we held a workshop on Benchmarks and Metrics at the NASA Ames Research Center on June 25, 1990. The objective of the workshop was to foster early discussion on this important topic. We did not achieve a consensus, nor did we expect to. Collected here is some of the information that was exchanged at the workshop. Given here is an outline of the workshop, a list of the participants, notes taken on the white-board during open discussions, position papers/notes from some participants, and copies of slides used in the presentations.

Drummond, Mark E.↗

FPGA-based HPC accelerators: An evaluation on performance and energy efficiency

Hardware specialization is a promising direction for the future of digital computing. Reconfigurable technologies enable hardware specialization with modest non-recurring engineering cost, but their performance and energy efficiency compared to state-of-the-art processor architectures remain an open question. In this article, we use FPGAs to evaluate the benefits of building specialized hardware for numerical kernels found in scientific applications. In order to properly evaluate performance, we not only compare Intel Arria 10 and Xilinx U280 performance against Intel Xeon, Intel Xeon Phi, and NVIDIA V100 GPUs, but we also extend the Empirical Roofline Toolkit (ERT) to FPGAs in order to assess our results in terms of the Roofline model. We show design optimization and tuning techniques for peak FPGA performance at reasonable hardware usage and power consumption. As FPGA peak performance is known to be far less than that of a GPU, we also benchmark the energy efficiency of each platform for the scientific kernels comparing against microbenchmark and technological limits. Results show that while FPGAs struggle to compete in absolute terms with GPUs on memory- and compute-intensive kernels, they require far less power and can deliver nearly the same energy efficiency.

97 MATHEMATICS AND COMPUTING↗

Fundamental Materials Issues for Thermochemical H 2 O and CO 2 Splitting: Final Report (FY08)

Hydrogen and carbon monoxide may be produced using solar-thermal energy in two-stage reactions of water and carbon dioxide, respectively, over certain metal oxide materials. The most active materials observed experimentally for these processes are complex mixtures of ferrite and zirconia based solids, and it is not clear how far the ferrites, the zirconia, or a solid solution between the two participate in the change of oxidation state during the cycling. Identification of the key phases in the redox material that enable splitting is of paramount importance to developing a working model of the materials. A three-pronged approach was adopted here: computer modeling to determine thermodynamically favorable materials compositions, bench reactor testing to evaluate materials’ performance, and in-situ characterization of reactive materials to follow phase changes and identify the phases active for splitting. For the characterization and performance evaluation thrusts, cobalt ferrites were prepared by co-precipitation followed by annealing at 1400 °C. An in-situ X-ray diffraction capability was developed and tested, allowing phase monitoring in real time during thermochemical redox cycling. Key observations made for an un-supported cobalt ferrite include: 1) ferrite phases partially reduce to wustite upon heating to 1400 °C in helium; 2) exposing the material to air at 1100 °C causes immediate re-oxidation; 3) the re-oxidized material may be thermally reduced at 1400 °C under inert; 4) exposure of a reduced material to CO 2 results in gradual re-oxidation at 1100 °C, but minimization of background O 2 -levels is essential; 5) even after several redox cycles, the lattice parameters of the ferrites remain constant, indicating that irreversible phase separation does not occur, at least over the first five cycles; 6) substituting chemical (hydrogen) reduction for thermal reduction resulted in formation of a CoFe metallic alloy. Materials were also evaluated for their CO 2 -splitting performance in bench reactor systems utilizing chemical reduction in place of thermal reduction. These tests lead to the following general conclusions: 1) despite over-reduction of the cobalt ferrite phase to CoFe alloy on chemical reduction, splitting of CO 2 still occurs; 2) the kinetics of chemical reduction follow the sequence: un-supported < ZrO 2 -supported < yttria-stabilized ZrO 2 (YSZ)-supported ferrite; 3) ferrite/YSZ re-oxidizes faster than ferrite/ZrO 2 under CO 2 in the range 400 – 700 °C. The temperature and pressure regimes in which the thermal reduction and water-splitting steps are thermodynamically favorable in terms of the enthalpy and entropy of oxide reduction, were determined. These metrics represent a useful design goal for any proposed water-splitting cycle. Applying this theoretical framework to available thermodynamic data, it was shown that none of the 105 binary oxide redox couples that were screened possess both energetically favorable reduction and oxidation steps. However, several driving forces, including low pressure and a large positive solid-state entropy of reduction of the oxide, have the potential to enable thermodynamically-favored two-step cycles.

36 MATERIALS SCIENCE↗

Project Startup: Evaluating the Performance of Hydraulic Hybrid Refuse Vehicles

The Fleet Test and Evaluation Team at the National Renewable Energy Laboratory (NREL) is evaluating the in-service performance of 10 next-generation hydraulic hybrid refuse vehicles (HHVs), 8 previous-generation HHVs, and 8 comparable conventional diesel vehicles operated by Miami-Dade County's Public Works and Waste Management Department in southern Florida. The HHVs under study - Autocar E3 refuse trucks equipped with Parker Hannifin's RunWise Advanced Series Hybrid Drive systems - can recover as much as 70 percent of the energy typically lost during braking and reuse it to power the vehicle. NREL's evaluation will assess the performance of this technology in commercial operation and help Miami-Dade County determine the ideal routes for maximizing the fuel-saving potential of its HHVs.

33 ADVANCED PROPULSION SYSTEMS↗

Enhanced Component Performance Study: Emergency Diesel Generators 1998–2014

This report presents an enhanced performance evaluation of emergency diesel generators (EDGs) at U.S. commercial nuclear power plants. This report evaluates component performance over time using (1) Institute of Nuclear Power Operations (INPO) Consolidated Events Database (ICES) data from 1998 through 2014 and (2) maintenance unavailability (UA) performance data from Mitigating Systems Performance Index (MSPI) Basis Document data from 2002 through 2014. The objective is to show estimates of current failure probabilities and rates related to EDGs, trend these data on an annual basis, determine if the current data are consistent with the probability distributions currently recommended for use in NRC probabilistic risk assessments, show how the reliability data differ for different EDG manufacturers and for EDGs with different ratings; and summarize the subcomponents, causes, detection methods, and recovery associated with each EDG failure mode. Engineering analyses were performed with respect to time period and failure mode without regard to the actual number of EDGs at each plant. The factors analyzed are: sub-component, failure cause, detection method, recovery, manufacturer, and EDG rating. Six trends with varying degrees of statistical significance were identified in the data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Performance and scalability evaluation of the Ceph parallel file system. In: PDSW '13 Proceedings of the 8th Parallel Data Storage Workshop

Ceph is an emerging open-source parallel distributed file and storage system. By design, Ceph leverages unreliable commodity storage and network hardware, and provides reliability and fault-tolerance via controlled object placement and data replication. This paper presents our file and block I/O performance and scalability evaluation of Ceph for scientific high-performance computing (HPC) environments. Our work makes two unique contributions. First, our evaluation is performed under a realistic setup for a large-scale capability HPC environment using a commercial high-end storage system. Second, our path of investigation, tuning efforts, and findings made direct contributions to Ceph's development and improved code quality, scalability, and performance. These changes should benefit both Ceph and the HPC community at large.

Wang, Feiyi↗