Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗
NASA NTRS2000

Performance Monitoring of Distributed Data Processing Systems

Test and checkout systems are essential components in ensuring safety and reliability of aircraft and related systems for space missions. A variety of systems, developed over several years, are in use at the NASA/KSC. Many of these systems are configured as distributed data processing systems with the functionality spread over several multiprocessor nodes interconnected through networks. To be cost-effective, a system should take the least amount of resource and perform a given testing task in the least amount of time. There are two aspects of performance evaluation: monitoring and benchmarking. While monitoring is valuable to system administrators in operating and maintaining, benchmarking is important in designing and upgrading computer-based systems. These two aspects of performance evaluation are the foci of this project. This paper first discusses various issues related to software, hardware, and hybrid performance monitoring as applicable to distributed systems, and specifically to the TCMS (Test Control and Monitoring System). Next, a comparison of several probing instructions are made to show that the hybrid monitoring technique developed by the NIST (National Institutes for Standards and Technology) is the least intrusive and takes only one-fourth of the time taken by software monitoring probes. In the rest of the paper, issues related to benchmarking a distributed system have been discussed and finally a prescription for developing a micro-benchmark for the TCMS has been provided.

Ojha, Anand K.↗
NASA NTRS1976

U1108 performance model

A model of Univac 1108 work flow has been developed to assist in performance evaluation studies and configuration planning. Workload profiles and system configurations are parameterized for ease of experimental modification. Outputs include capacity estimates and performance evaluation functions. The U1108 system is conceptualized as a service network; classical queueing theory is used to evaluate network dynamics.

Trachta, G.↗
NASA NTRS1992

Development of a test protocol for evaluating EVA glove performance

Testing gloved hand performance involves work from several disciplines. Evaluations performed in the course of reenabling a disabled hand, designing a robotic end effector or master controller, or hard-suit design have all yielded relevant information, and, in most cases, produced performance test methods. Most times, these test methods have been primarily oriented toward their parent discipline. For space operations, a comparative test which would provide a way to quantify pressure glove and end effector performance would be useful in dividing tasks between humans and robots. Such a test would have to rely heavily on sensored measurement, as opposed to questionnaires, to produce relevant data. However, at some point human preference would have to be taken into account. This paper presents a methodology for evaluating gloved hand performance which attempts to respond to these issues. Glove testing of a prototype glove design using this method is described.

Hinman, Elaine M.↗
NASA NTRS2009

On Applying the Prognostic Performance Metrics

Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.

Saxena, Abhinav↗
NASA NTRS1992

Aerocapture and aeromaneuvering at Mars

This paper presents the results of a guidance analysis study for aerocapture and aeromaneuvering at Mars. A 4-state, near-optimal, hybrid guidance algorithm is derived for applications throughout the paper. It is based on the critical assumption that Loh's function remains constant between successive guidance updates. Besides the guidance algorithm, the paper presents a performance evaluation of guidance derived from estimated or 'navigated' spacecraft state, provided by an onboard navigation subsystem for real-time applications on Mars. For the performance evaluation, the spacecraft state is augmented by such parameters as the reference atmospheric density and scale-height, the banking angle and angle of attack for spacecraft control and the accelerometer measurement model errors. Finally, the paper examines also, the influence of random uncertainties in atmospheric density on aeroassisted maneuvers, by a Monte Carlo type of simulation.

Vijayaraghavan, A.↗
NASA NTRS1980

Solar energy system performance evaluation-seasonal report for Elcam San Diego, San Diego, California

The solar energy system, Elcam San Diego, was designed to supply domestic hot water heating for a single family residence located in Encinitas, California. System description, performance assessment, operating energy, energy savings, maintenance, and conclusions are presented. The system is a 'Sunspot' two tank cascade type, where solar energy is supplied to either a 66 gallon preheat tank (solar storage) or a 40 gallon domestic hot water tank. Water is pumped directly from one of the two tanks, through the 65 square feet collector array and back into the same tank. Freeze protection is provided by automatically circulating hot water from the hot water tank through the collectors and exposed plumbing when freezing conditions exist. Auxiliary energy is supplied by natural gas. Analysis is based on instrumented system data monitored and collected for one full season of operation.

Source record↗
NASA NTRS2008

Study of the Correlation between the Performances of Lunar Vehicle Wheels Predicted by the Nepean Wheeled Vehicle Performance Model and Test Data

This paper describes the results of a study of the correlation between the performances of wheels for lunar vehicles predicted using the Nepean wheeled vehicle performance model (NWVPM), developed under the auspices of Vehicle Systems Development Corporation, Ottawa, Canada, and the corresponding test data presented in Performance evaluation of wheels for lunar vehicles , Technical Report M-70-2, prepared for George C. Marshall Space Flight Center, National Aeronautics and Space Administration (NASA), USA, by the US Army Engineer Waterways Experiment Station (WES). The NWVPM was originally developed for design and performance evaluation of terrestrial off-road wheeled vehicles. The purpose of this study is to assess the potential of the NWVPM for evaluating wheel candidates for the new generation of extra-terrestrial vehicles. Two versions of a wire-mesh wheel and a hoop-spring wheel, which were considered as candidates for lunar roving vehicles for the NASA Apollo program in the late 1960s, together with a pneumatic wheel were examined in this study. The tractive performances of these wheels and of a 464 test vehicle with the pneumatic wheels on air-dry sand were predicted using the NWVPM and compared with the corresponding test data obtained under Earth s gravity and previously documented in the above-named report. While test data on wheel or vehicle performances obtained under Earth s gravity may not necessarily be representative of those on extra-terrestrial bodies, because of the differences in gravity and in environmental conditions, such as atmospheric pressure, it is still a valid approach to use test data obtained under Earth s gravity to evaluate the predictive capability of the NWVPM and its potential applications to predicting wheel or wheeled rover performances on extra-terrestrial bodies. Results of this study show that, using the ratio (P20/W) of the drawbar pull to normal load at 20 per cent slip as a performance indicator, there is a reasonable correlation between the predictions and experimental data. This indicates that the NWVPM has the potential as an engineering tool for evaluating wheel candidates for a future generation of extra-terrestrial vehicles, provided that appropriate input data are available.

Wong, J. Y.↗
NASA NTRS1975

Modular biowaste monitoring system

The objective of the Modular Biowaste Monitoring System Program was to generate and evaluate hardware for supporting shuttle life science experimental and diagnostic programs. An initial conceptual design effort established requirements and defined an overall modular system for the collection, measurement, sampling and storage of urine and feces biowastes. This conceptual design effort was followed by the design, fabrication and performance evaluation of a flight prototype model urine collection, volume measurement and sampling capability. No operational or performance deficiencies were uncovered as a result of the performance evaluation tests.

Fogal, G. L.↗
NASA NTRS2007

Evaluating Model Performance of an Ensemble-based Chemical Data Assimilation System During INTEX-B Field Mission

We present a global chemical data assimilation system using a global atmosphere model, the Community Atmosphere Model (CAM3) with simplified chemistry and the Data Assimilation Research Testbed (DART) assimilation package. DART is a community software facility for assimilation studies using the ensemble Kalman filter approach. Here, we apply the assimilation system to constrain global tropospheric carbon monoxide (CO) by assimilating meteorological observations of temperature and horizontal wind velocity and satellite CO retrievals from the Measurement of Pollution in the Troposphere (MOPITT) satellite instrument. We verify the system performance using independent CO observations taken on board the NSFINCAR C-130 and NASA DC-8 aircrafts during the April 2006 part of the Intercontinental Chemical Transport Experiment (INTEX-B). Our evaluations show that MOPITT data assimilation provides significant improvements in terms of capturing the observed CO variability relative to no MOPITT assimilation (i.e. the correlation improves from 0.62 to 0.71, significant at 99% confidence). The assimilation provides evidence of median CO loading of about 150 ppbv at 700 hPa over the NE Pacific during April 2006. This is marginally higher than the modeled CO with no MOPITT assimilation (-140 ppbv). Our ensemble-based estimates of model uncertainty also show model overprediction over the source region (i.e. China) and underprediction over the NE Pacific, suggesting model errors that cannot be readily explained by emissions alone. These results have important implications for improving regional chemical forecasts and for inverse modeling of CO sources and further demonstrate the utility of the assimilation system in comparing non-coincident measurements, e.g. comparing satellite retrievals of CO with in-situ aircraft measurements. The work described above also brought to light several short-comings of the data assimilation approach for CO profiles. Because of the limited vertical resolution of the measurement, the retrievals at different altitudes are correlated which can lead to problems with numerical error and overall efficiency. This has resulted in a manuscript that is about to be submitted to JGR:

Arellano, A. F., Jr.↗
NASA NTRS1980

Next generation communications satellites: Multiple access and network studies

Following an overview of issues involved in the choice of promising system architectures for efficient communication with multiple small inexpensive Earth stations serving hetergeneous user populations, performance evaluation via analysis and simulation for six SS/TDMA (satellite-switched/time-division multiple access) system architectures is discussed. These configurations are chosen to exemplify the essential alternatives available in system design. Although the performance evaluation analyses are of fairly general applicability, whenever possible they are considered in the context of NASA's 30/20 GHz studies. Packet switched systems are considered, with the assumption that only a part of transponder capacit is devoted to packets, the integration of circuit and packet switched traffic being reserved for further study. Three types of station access are distinguished: fixed (FA), demand (DA), and random access (RA). Similarly, switching in the satellite can be assigned on a fixed (FS) or demand (DS) basis, or replaced by a buffered store-and-forward system (SF) onboard the satellite. Since not all access/switching combinations are practical, six systems are analyzed in detail: three FS SYSTEMS, FA/FS, DA/ES, RA/FS; one DS system, DA/DS; and two SF systems, FA/SF, DA/SF. Results are presented primarily in terms of delay-throughput characteristics.

Stern, T. E.↗
NASA NTRS1971

An inventory of aeronautical ground research facilities. Volume 2: Air breathing engine test facilities

The inventory covers free jet and direct connect altitude cells, sea level static thrust stands, sea level test cells with ram air, and propulsion wind tunnels. Free jet altitude cells and propulsion wind tunnels are used for evaluation of complete inlet-engine-exhaust nozzle propulsion systems under simulated flight conditions. These facilities are similar in principal of operation and differ primarily in test section concept. The propulsion wind tunnel provides a closed test section and restrains the flow around the test specimen while the free jet is allowed to expand freely. A chamber of large diameter about the free jet is provided in which desired operating pressure levels may be maintained. Sea level test cells with ram air provide controlled, conditioned air directly to the engine face for performance evaluation at low altitude flight conditions. Direct connect altitude cells provide a means of performance evaluation at simulated conditions of Mach number and altitude with air supplied to the flight altitude conditions. Sea level static thrust stands simply provide an instrumented engine mounting for measuring thrust at zero airspeed. While all of these facilities are used for integrated engine testing, a few provide engine component test capability.

Pirrello, C. J.↗
NASA NTRSDate not supplied

Evaluating the Performance of GPM IMERG Products for Extreme Precipitation Estimation in Volta River Basin of Ghana

The Volta River basin in West Africa, covering a substantial area of Ghana, faces significant water management challenges due to highly variable rainfall and limited availability of high temporal resolution rain gauges. This study, developed under the 2024 Global Precipitation Measurement (GPM) Mission mentorship program, evaluates precipitation in the Volta River basin using high-resolution satellite-derived data from the Integrated Multi-satellite Retrievals for GPM (IMERG). In the absence of sub-daily rainfall data, comparisons were made between daily, monthly, and seasonal precipitation from local gauges and IMERG V06 and V07 (early and final) runs. Results indicated a very weak correlation between daily precipitation estimates from IMERG and gauge data, but a significantly improved correlation for monthly and seasonal estimates. Additionally, IMERG data were used to identify heavy rainfall events and drought periods, which were compared to known occurrences in the region. By addressing these objectives, this study contributes to more accurate extreme precipitation estimation in the Volta River basin, thereby enhancing disaster risk management and climate resilience in Ghana.

Jessica Sutton↗
NASA NTRS1998

FPGA Based Reconfigurable ATM Switch Test Bed

Various issues associated with "FPGA Based Reconfigurable ATM Switch Test Bed" are presented in viewgraph form. Specific topics include: 1) Network performance evaluation; 2) traditional approaches; 3) software simulation; 4) hardware emulation; 5) test bed highlights; 6) design environment; 7) test bed architecture; 8) abstract sheared-memory switch; 9) detailed switch diagram; 10) traffic generator; 11) data collection circuit and user interface; 12) initial results; and 13) the following conclusions: Advances in FPGA make hardware emulation feasible for performance evaluation, hardware emulation can provide several orders of magnitude speed-up over software simulation; due to the complexity of hardware synthesis process, development in emulation is much more difficult than simulation and requires knowledge in both networks and digital design.

Chu, Pong P.↗
NASA NTRS1993

Quasi-optical grids with thin rectangular patch/aperture elements

Theoretical analysis is presented for an efficient and accurate performance evaluation of quasi-optical grids comprised of thin rectangular patch/aperture elements with/without a dielectric substrate/superstrate. The convergence rate of this efficient technique is improved by an order of magnitude with the approximate edge conditions incorporated in the basis functions of the integral equation solution. Also presented are the interesting applications of this efficient analytical technique to the design and performance evaluation of the coupling grids and beam splitters in the optical systems as well as thermal protection sunshields used in the communication systems of satellites and spacecrafts.

Wu, Te-Kao↗
NASA NTRS2020

Evaluation of Performance, Fatigue and Workload during Real-time, Reactive Telerobotic Mission Control Operations

Telerobotic operations involve a user operating a robot from a different location from where the activity is taking place. It can be difficult for humans to maintain performance when faced with physiological stressors, such as fatigue or illness. Operations require vigilance for extended periods, raising safety concerns surrounding operator’s fatigue and workload. Every hour of wakefulness increases the drive to sleep, causing decreased reaction time (RT), increased lapses in attention (RT > 500 ms), and decreased memory capability. The NASA Task Load Index (NASA-TLX) was created to evaluate the multiple attributes surrounding workload (e.g., mental and physical demands). The upcoming Volatiles Investigating Polar Exploration Rover (VIPER) mission involves remotely controlling a lunar vehicle from an Earth-based mission control station. The goal of VIPER is to excavate the moon for volatiles (water) deep in the surface near the South Pole for a 100-day, continuous operation.

Fatigue↗
NASA NTRS2011

Evaluating the Performance of Single and Double Moment Microphysics Schemes During a Synoptic-Scale Snowfall Event

Increases in computing resources have allowed for the utilization of high-resolution weather forecast models capable of resolving cloud microphysical and precipitation processes among varying numbers of hydrometeor categories. Several microphysics schemes are currently available within the Weather Research and Forecasting (WRF) model, ranging from single-moment predictions of precipitation content to double-moment predictions that include a prediction of particle number concentrations. Each scheme incorporates several assumptions related to the size distribution, shape, and fall speed relationships of ice crystals in order to simulate cold-cloud processes and resulting precipitation. Field campaign data offer a means of evaluating the assumptions present within each scheme. The Canadian CloudSat/CALIPSO Validation Project (C3VP) represented collaboration among the CloudSat, CALIPSO, and NASA Global Precipitation Measurement mission communities, to observe cold season precipitation processes relevant to forecast model evaluation and the eventual development of satellite retrievals of cloud properties and precipitation rates. During the C3VP campaign, widespread snowfall occurred on 22 January 2007, sampled by aircraft and surface instrumentation that provided particle size distributions, ice water content, and fall speed estimations along with traditional surface measurements of temperature and precipitation. In this study, four single-moment and two double-moment microphysics schemes were utilized to generate hypothetical WRF forecasts of the event, with C3VP data used in evaluation of their varying assumptions. Schemes that incorporate flexibility in size distribution parameters and density assumptions are shown to be preferable to fixed constants, and that a double-moment representation of the snow category may be beneficial when representing the effects of aggregation. These results may guide forecast centers in optimal configurations of their forecast models for winter weather and identify best practices present within these various schemes.

Molthan, Andrew L.↗