Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance measurement”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Exploratory study on performance measures as indicators of IS effectiveness

The Information Systems Directorate at JSC/NASA has undertaken the reevaluation of its performance measures process and measures. Under the direction of a quality approach it is essential to identify an external perspective of how well an organization is performing. This study was conducted with two major objectives: (1) survey and summarize the academic literature on performance measures as indicators of information systems (IS) effectiveness; and (2) survey organizations for their experience in measuring for IS effectiveness. Four approaches to measuring the effectiveness of IS performance were identified: (1) listen to the customer for the things they need; (2) align with corporate goals; (3) benchmark against well-respected organizations; and (4) ask yourself what critical factors lead to success. The list of known methods for soliciting customer feedback are as follows: (1) executive visit; (2) survey, interview, and focus group; (3) complaints and compliments; and (4) service level agreements. A common set of characteristics that satisfy customers was identified from the literature. The list includes elements such as the following: accuracy, timeliness, relevance, understandability, reliability, and completeness. Future research in this topic area should prove beneficial to determine the metrics for external validity.

Bishop, Peter C.↗

Score-P: A Joint Performance Measurement Run-Time Infrastructure for Periscope, Scalasca, TAU, and Vampir.

This paper gives an overview about the Score-P performance measurement infrastructure which is being jointly developed by leading HPC performance tools groups. It motivates the advantages of the joint undertaking from both the developer and the user perspectives, and presents the design and components of the newly developed Score-P performance measurement infrastructure. Furthermore, it contains first evaluation results in comparison with existing performance tools and presents an outlook to the long-term cooperative development of the new system.

Application Execution↗

Functional specification of the Performance Measurement (PM) module

The design of the Performance Measurement Module is described with emphasis on what the PM Module would do, and what it would look like to the user. The PM Module as described could take several man-years to develop. An evolutionary approach to the implementation of the PM Module is presented which would provide an operational baseline PM Module within a few months.

Berliner, J. E.↗

Multipurpose Rotating Rake Arrays for Integrated Inlet and Fan Stage Performance Measurement

Low-pressure-ratio fan stage performance measurement requires precise measurement of conditions upstream and downstream of the fan stage. This presentation will discuss the rotating rake arrays used for the recent Boundary Layer Ingesting Inlet-Distortion-Tolerant Fan experiment in the NASA Glenn 8 by 6 foot wind tunnel. To achieve precise measurements, simulations of the rake sampling from pre-test CFD (Computerized Fluid Dynamics) solutions were used to optimize the number and locations of rake instruments.

performanc↗

Performance measurements for the PET/CT Discovery-600 using NEMA NU 2-2007 standards

Purpose: The aim of this study was to assess the performance measurements of the new PET/CT system Discovery-600 (D-600, GEMS, Milwaukee, WI). Methods: Performance measures were obtained with the National Electrical Manufacturers Association (NEMA) NU 2-2007 procedures. Results: The transverse (axial) spatial resolution FWHMs were 4.9 (5.6) mm and 5.6 (6.4) mm at 1 and 10 cm off axis, respectively. The sensitivity (average at 0 and 10 cm) was 9.6 cps/kBq. The scatter fraction was 36.6% (low energy threshold: 425 keV). The NEC peak rate (k=1) was 75.2 kcps at 12.9 kBq/cc. The hot contrasts for 10, 13, 17, and 22 mm spheres were 41%, 51%, 62%, and 73% and the cold contrasts for 28 and 37 mm spheres were 68% and 72%. Conclusions: The Discovery-600 has good performance for the NEMA NU 2-2007 parameters, particularly in improved sensitivity compared to the scanners of the same Discovery family, D-ST and D-STE.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Test procedures and performance measures sensitive to automobile steering dynamics

A maneuver complex and related performance measures used to evaluate driver/vehicle system responses as effected by variations in the directional response characteristics of passenger cars are described. The complex consists of normal and emergency maneuvers (including random and discrete disturbances) which, taken as a whole, represent all classes of steering functions and all modes of driver response behavior. Measures of driver/vehicle system response and performance in regulation tasks included direct describing function measurements and rms yaw velocity. In transient maneuvers, measures such as steering activity and cone strikes were used.

Klein, R. H.↗

Performance measures for transform data coding.

This paper develops performance criteria for evaluating transform data coding schemes under computational constraints. Computational constraints that conform with the proposed basis-restricted model give rise to suboptimal coding efficiency characterized by a rate-distortion relation R(D) similar in form to the theoretical rate-distortion function. Numerical examples of this performance measure are presented for Fourier, Walsh, Haar, and Karhunen-Loeve transforms.

Pearl, J.↗

Efficient parametric analysis of performance measures for communication networks

Efficient techniques for estimating performance measures in communication networks in a steady-state or transient setting are developed. These techniques may be used in a simulation environment or in connection with real-time observations. For Markov chain models, the recently proposed standard clock approach is extended, and a class of real-time algorithms for simultaneously generating multiple sample paths under different parameter sets is presented. Attention is focused on the link crash time estimation problem, where a 'crash' is defined as the first time a buffer overflows, given some initial conditions. An algorithm for estimating crash times under various traffic shocks is derived, where all estimates are obtained in parallel to an actual network's normal operation. An algorithm for crash time estimation of a G/D/1 link model is also derived using a different (perturbation-analysis-based) approach. Finally, extensive simulation results are provided to validate the proposed algorithms and compare them to brute-force simulation.

Cassandras, Christos G.↗

Toward adaptive decision support for assessing infrastructure system resilience using hidden performance measures

The understanding of resilience is an emerging topic within the study of risks affecting distributed transportation infrastructure systems. Although recent studies have explored the quantification of system resilience, there has been limited research aimed at understanding the role of multiple performance measures, geographies, and modeling uncertainties within the assessment of resilience and associated decision-making. Under real-world conditions, there is an increased burden on analysts for translating observed system data (from human and electronic sensor observations) into the estimation of system performance that may not be directly observable. This paper addresses these issues using a scenario-based risk modeling approach to understand: 1) resilience of complex systems, often in cases of hidden (not readily observable) measures of performance, 2) resilience sensitivity to modeling uncertainties in event and system characteristics, and 3) resilience sensitivity to the measurement of performance across multiple dimensions. The methods in this paper integrate uncertainty-driven risk and probabilistic modeling within a multi-state Markov approach. This study contributes to the state-of-the-art by developing methodologies for assessing community perceptions of infrastructure system resilience using observable factors and inferring possibly hidden performance measures for facilitating adaptive decision-support. The methods are demonstrated with hypothetical spatiotemporal data for the Washington, District of Columbia and Baltimore, Maryland urban regions in the United States against evacuation-causing and shelter-in-place disruptive scenarios across multiple system performance dimensions. The analysis results may be useful for risk managers, supply chain analysts, emergency decision-makers, and the general public.

Infrastructure System Resilience, Risk Management,↗

Continuous performance measurement in flight systems

The desired response of many man machine control systems can be formulated as a solution to an optimal control synthesis problem where the cost index is given and the resulting optimal trajectories correspond to the desired trajectories of the man machine system. Optimal control synthesis provides the reference criteria and the significance of error information required for performance measurement. The synthesis procedure described provides a continuous performance measure (CPM) which is independent of the mechanism generating the control action. Therefore, the technique provides a meaningful method for online evaluation of man's control capability in terms of total man machine performance.

Connelly, E. M.↗

Ways for regulators to use performance measures

The core challenge for regulators is to determine what constitutes a well-performing utility. The question of what is considered acceptable performance needs to be addressed by regulators if they are to exploit fully the information contained in performance measures for regulatory actions such as prudence determination, further inquiry, and rate setting. (author)

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Network Performance Measurements for NASA's Earth Observation System

NASA's Earth Observation System (EOS) Project studies all aspects of planet Earth from space, including climate change, and ocean, ice, land, and vegetation characteristics. It consists of about 20 satellite missions over a period of about a decade. Extensive collaboration is used, both with other US. agencies (e.g., National Oceanic and Atmospheric Administration (NOA), United States Geological Survey (USGS), Department of Defense (DoD), and international agencies (e.g., European Space Agency (ESA), Japan Aerospace Exploration Agency (JAXA)), to improve cost effectiveness and obtain otherwise unavailable data. Scientific researchers are located at research institutions worldwide, primarily government research facilities and research universities. The EOS project makes extensive use of networks to support data acquisition, data production, and data distribution. Many of these functions impose requirements on the networks, including throughput and availability. In order to verify that these requirements are being met, and be pro-active in recognizing problems, NASA conducts on-going performance measurements. The purpose of this paper is to examine techniques used by NASA to measure the performance of the networks used by EOSDIS (EOS Data and Information System) and to indicate how this performance information is used.

Loiacono, Joe↗

Detecting Anomalies from End-to-End Internet Performance Measurements (PingER) Using Cluster Based Local Outlier Factor

PingER (Ping End-to-End Reporting) is a worldwide end-to-end Internet performance measurement framework. It was developed by the SLAC National Accelerator Laboratory, Stanford, USA and running from the last 20 years. It has more than 700 monitoring agents and remote sites which monitor the performance of Internet links around 170 countries of the world. At present, the size of the compressed PingER data set is about 60 GB comprising of 100,000 flat files. The data is publicly available for valuable Internet performance analyses. However, the data sets suffer from missing values and anomalies due to congestion, bottleneck links, queuing overflow, network software misconfiguration, hardware failure, cable cuts, and social upheavals. Therefore, the objective of this paper is to detect such performance drops or spikes labeled as anomalies or outliers for the PingER data set. In the proposed approach, the raw text files of the data set are transformed into a PingER dimensional model. The missing values are imputed using the k-NN algorithm. The data is partitioned into similar instances using the k-means clustering algorithm. Afterward, clustering is integrated with the Local Outlier Factor (LOF) using the Cluster Based Local Outlier Factor (CBLOF) algorithm to detect the anomalies or outliers from the PingER data. Lastly, anomalies are further analyzed to identify the time frame and location of the hosts generating the major percentage of the anomalies in the PingER data set ranging from 1998 to 2016.

97 MATHEMATICS AND COMPUTING↗

Subsurface Biogeochemical Research FY11 Second Quarter Performance Measure

The Subsurface Biogeochemical Research (SBR) Long Term Measure for 2011 under the Performance Assessment Rating Tool (PART) measure is to "Refine subsurface transport models by developing computational methods to link important processes impacting contaminant transport at smaller scales to the field scale." The second quarter performance measure is to "Provide a report on computational methods linking genome-enabled understanding of microbial metabolism with reactive transport models to describe processes impacting contaminant transport in the subsurface." Microorganisms such as bacteria are by definition small (typically on the order of a micron in size), and their behavior is controlled by their local biogeochemical environment (typically within a single pore or a biofilm on a grain surface, on the order of tens of microns in size). However, their metabolic activity exerts strong influence on the transport and fate of groundwater contaminants of significant concern at DOE sites, in contaminant plumes with spatial extents of meters to kilometers. This report describes progress and key findings from research aimed at integrating models of microbial metabolism based on genomic information (small scale) with models of contaminant fate and transport in aquifers (field scale).

54 ENVIRONMENTAL SCIENCES↗