Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Selecting Tasks for Evaluating Human Performance as a Function of Gravity

A challenge in understanding human performance as a function of gravity is determining which tasks to research. Initial studies began with treadmill walking, which was easy to quantify and control. However, with the development of pressurized rovers, it is less important to optimize human performance for ambulation as rovers will likely perform gross translation for them. Future crews are likely to spend much of their extravehicular activity (EVA) performing geology, construction and maintenance type tasks, for which it is difficult to measure steady-state-workloads. To evaluate human performance in reduced gravity, we have collected metabolic, biomechanical and subjective data for different tasks at varied gravity levels. Methods: Ten subjects completed 5 different tasks including weight transfer, shoveling, treadmill walking, treadmill running and treadmill incline walking. All tasks were performed shirt-sleeved at 1-g, 3/8-g and 1/6-g. Off-loaded conditions were achieved via the Active Response Gravity Offload System. Treadmill tasks were performed for 3 minutes with reported oxygen consumption (VO2) averaged over the last 2 minutes. Shoveling was performed for 3 minutes with metabolic cost reported as ml O2 consumed per kg material shoveled. Weight transfer reports metabolic cost as liters O2 consumed to complete the task. Statistical analysis was performed via repeated measures ANOVA. Results: Statistically significant metabolic differences were noted between all 3 gravity levels for treadmill running and incline walking. For the other 3 tasks, there were significant differences between 1-g and each reduced gravity, but not between 1/6-g and 3/8-g. For weight transfer, significant differences were seen between gravities in both trial-average VO2 and time-to-completion with noted differences in strategy for task completion. Conclusion: To determine if gravity has a metabolic effect on human performance, this research may indicate that tasks should be selected that require the subject to work vertically against the force of gravity.

Norcross, J. R.↗
NASA NTRS2004

Evaluation of Performance of Five Parallel Biological Water Proce

The objective of the work entitled Molecular Characterization of Eubacteria in a Biological Water Processor was to gain an understanding of the microbial diversity and species stability of the consortia that inhabit an anoxic bioreactor and to correlate those factors with functional performance, mechanical reliability, and stability. The evaluation was divided into four studies. During Study 1, replicate biological water processor (BWP) systems were operated to evaluate variability in the microbial diversity over time as a function of the initial consortia used for inoculation of the BWP reactors. Study 2 was designed to investigate the impact of an inoculum source on BWP performance. Study 3 was a modification of Study 2 where the impact of inoculum on BWP performance from inoculation until steady state operations was monitored. In Study 4, the reactors were divided into three different operational periods, based on the operational periods of the integrated water recovery test at the Johnson Space Center (JSC) in 2001.

Vega, Leticia M.↗
DOE OSTI2022

Sim-Situ: A Framework for the Faithful Simulation of in situ Processing

The amount of data generated by numerical simulations in various scientific domains led to a fundamental redesign of how the analysis and visualization of simulation outputs are performed. The throughput and capacity of storage subsystems have not evolved as fast as the computing power in extreme-scale supercomputers, making the classical post-hoc approach highly inefficient. In situ processing has then emerged as a solution in which simulation and data analysis/visualization are intertwined for better performance and greater interactivity.Determining the best allocation, i.e., how many resources to allocate to simulation and analysis respectively, mapping, i.e., where and at which frequency to run the analysis/visualization, and data transfer mode is a complex task whose performance assessment is crucial to the efficient execution of in situ processing. However, such a performance evaluation of different strategies usually relies either on directly running them on the targeted execution environments, which can rapidly become extremely time- and resource-consuming, or on resorting to simplified models of the components of an in situ application, which can lack of realism. In both cases, the validity of the performance evaluation is limited.In this paper, we present Sim-Situ, a simulation-based framework for the faithful performance evaluation of in situ processing strategies. We designed Sim-Situ to reflect the typical features of in situ processing systems. Thanks to its modular design, Sim-situ has the necessary flexibility to easily and faithfully evaluate the behavior and performance of various allocation, mapping, and data transfer strategies. We illustrate the simulation capabilities of Sim-Situ on a Molecular Dynamics use case. We study the impact of different strategies on performance and show how users can leverage Sim-Situ to determine interesting tradeoffs when adding analysis/visualization components to their application.

Honoré, Valentin↗
NASA NTRS1998

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

DeMaio, Joe↗
NASA NTRS1975

Management systems research study

The development of a Monte Carlo simulation of procurement activities at the NASA Ames Research Center is described. Data cover: simulation of the procurement cycle, construction of a performance evaluation model, examination of employee development, procedures and review of evaluation criteria for divisional and individual performance evaluation. Determination of the influences and apparent impact of contract type and structure and development of a management control system for planning and controlling manpower requirements.

Bruno, A. V.↗
NASA NTRS1996

ACTS Multibeam Antenna On-Orbit Performance

The Advanced Communications Technology Satellite (ACTS) launched in September 1993 introduces several new technologies including a multibeam antenna (MBA) operating at Ka-band. The MBA with fixed and rapidly reconfigurable spot beams serves users equipped with small aperture terminals within the coverage area. The antenna produces spot beams with approximately 0.3 degrees beamwidth and gains of approximately 50 dBi. A number of MBA performance evaluations have been performed since the ACTS launch. These evaluations were designed to assess MBA performance (e.g., beam pointing stability, beam shape, gain, etc.) in the space environment. The on-orbit measurements found systematic environmental perturbation to the MBA beam pointing. These perturbations were found to be imposed by satellite attitude control system, antenna and spacecraft mechanical alignments, on-orbit thermal effects, etc. As a result, the footprint coverage of the MBA may not exactly cover the intended service area at all times. This report describes the space environment effects on the ACTS MBA performance as a function of time of the day and time of the year and compensation approaches for these effects.

Acosta, R.↗
NASA NTRS2003

Simulating the ARES Aircraft in the Mars Environment

NASA Langley proposed the Aerial Regional-scale Environmental Survey (ARES) of Mars science mission in response to the NASA Office of Space Science 2002 Mars Scout Opportunity. The science-driven mission proposal began with trade studies and determined that a rocket powered aircraft was the best suited platform to complete the ARES science objectives. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The aircraft was initially modeled using the aero, propulsion, and flight control system components of other aircraft models. As the proposed aircraft design evolved, the borrowed components were replaced with new models. This allowed performance evaluations to be performed as the design was maturing. Basic autopilot features were also developed for the ARES aircraft model. Altitude hold and track hold modes allowed different mission scenarios to be evaluated for both science merit and aircraft performance. Platform stability and data rate requirements were identified for each of the instruments and the aircraft performance was evaluated against those requirements. The results of the simulation evaluations indicate that the ARES design and mission profiles are sound and meet the science objectives.

Kenney, P. Sean↗
DOE OSTI2025

Analytical and Performance-Based Evaluation Alternatives to Full-Scope, High-Fidelity Testbeds

One consequence the design and operational differences of advanced reactors is that integrated system validation (ISV) using full-scope, high-fidelity testbed might not be cost-justified or practical. The absence of traditional ISV may pose an issue for the conduct of safety evaluations since it may leave regulators without the information derived from this performance-based testing. The purpose of this research is to identify analytical and performance-based test and evaluation methods that are alternatives to full-scope, high-fidelity testbeds that have traditionally been used for ISV. We developed a method to test validation based on a multi-stage validation (MSV) framework. MSV is an approach to meeting validation objectives through incremental, successive validation activities beginning in the early stages of the design process and continuing through the later stages. MSV doesn't rely solely on late stage validation, rather it accommodates the use of a broad spectrum of analytical and performance-based information and a diversity of testbeds. In addition, MSV embraces the use of information from other types of evaluations and analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

PRACtical LLM Evaluation using Performance, Response, and Context

This project produced practical methods for evaluating Large Language Models (LLMs) based only on characteristics of LLM responses and without ground truth. Further development of these methods will enable the ability to rapidly identify and mitigate different failure types and supports the appropriate use of LLMs in mission applications.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Eighth Goddard Conference on Mass Storage Systems and Technologies in Cooperation with the Seventeenth IEEE Symposium on Mass Storage Systems

This document contains copies of those technical papers received in time for publication prior to the Eighth Goddard Conference on Mass Storage Systems and Technologies which is being held in cooperation with the Seventeenth IEEE Symposium on Mass Storage Systems at the University of Maryland University College Inn and Conference Center March 27-30, 2000. As one of an ongoing series, this Conference continues to provide a forum for discussion of issues relevant to the management of large volumes of data. The Conference encourages all interested organizations to discuss long term mass storage requirements and experiences in fielding solutions. Emphasis is on current and future practical solutions addressing issues in data management, storage systems and media, data acquisition, long term retention of data, and data distribution. This year's discussion topics include architecture, future of current technology, new technology with a special emphasis on holographic storage, performance, standards, site reports, vendor solutions. Tutorials will be available on stability of optical media, disk subsystem performance evaluation, I/O and storage tuning, functionality and performance evaluation of file systems for storage area networks.

Kobler, Benjamin↗
NASA NTRS2008

PrismTech Data Distribution Service Java API Evaluation

My internship duties with Launch Control Systems required me to start performance testing of an Object Management Group's (OMG) Data Distribution Service (DDS) specification implementation by PrismTech Limited through the Java programming language application programming interface (API). DDS is a networking middleware for Real-Time Data Distribution. The performance testing involves latency, redundant publishers, extended duration, redundant failover, and read performance. Time constraints allowed only for a data throughput test. I have designed the testing applications to perform all performance tests when time is allowed. Performance evaluation data such as megabits per second and central processing unit (CPU) time consumption were not easily attainable through the Java programming language; they required new methods and classes created in the test applications. Evaluation of this product showed the rate that data can be sent across the network. Performance rates are better on Linux platforms than AIX and Sun platforms. Compared to previous C++ programming language API, the performance evaluation also shows the language differences for the implementation. The Java API of the DDS has a lower throughput performance than the C++ API.

Riggs, Cortney↗
NASA NTRS1990

Evaluating scheduling algorithms for traffic with heterogeneous performance objectives

Two types of network traffic are considered: traffic with deadlines, for which the most important performance objective is based on loss rate, and packets without deadlines, for which the most important performance objective is based on mean delay. An optimal scheduling algorithm is presented to minimize weighted loss rate and weighted mean delay in the queues that form at the switches and at the network access points of a packet-switched network, where weights reflect the relative importance of packets. Although not practical for implementation, the algorithm is intended as a standard for the comparison of the performance of other scheduling algorithms. The algorithm is more general and lower computational complexity than previously published algorithms, enabling performance evaluation of some important scenarios that could not previously have been considered. Using the optimal performance results of this algorithm, the performance of the first-come-first-served, static priority, and earliest deadline first scheduling algorithms is evaluated. The results suggest that network efficiency could be improved by using a more sophisticated heuristic scheduling algorithm rather than one of the aforementioned algorithms.

Peha, Jon M.↗
DOE OSTI2025

Establishing a silica gel zone in well annulus and evaluating its performance in blocking vertical water flow

Wells are often constructed for monitoring purposes with relatively long screen lengths (e.g., >10 m). Vertical water flows can occur within the artificial or natural filterpack annulus that surrounds the screened interval, bypassing packer assemblies installed inside the wellbore. Attempts to isolate discrete vertical zones during groundwater sampling are unsuccessful when annular flow occurs and lead to remedy decisions based on biased or incorrect interpretations. Blocking vertical annular water flow and contaminant transport will help obtain more accurate concentrations of contaminants from sampling in targeted depth intervals. The application of silica gels formed from the injected colloidal silica CS suspensions is a novel approach to minimize or prevent movement of vertical movement of groundwater in the surrounding filterpack annulus. In this work, we tested the feasibility of injecting CS suspensions to target locations and developed a modified CS formulation that is injectable and prevents gravity sinking. We studied the distribution and penetration of silica gel at laboratory scale in mock well annulus with surrounding formations. We evaluated the performance of the silica gel in blocking vertical water flow in the annulus and in minimizing chemical transport through the gel zone. CS suspension formulations have been defined that are ready for injection, stay in target locations, and form gel within desired time frames. Injection of CS suspensions achieved uniform distribution in a well annulus filter pack, fully occupied the annulus pore space, and penetrated the formation surrounding the filter packer with a sufficient distance to create a hydraulic annular seal when the injection was applied at a sufficient rate. The depth of penetration into the formation was dependent on the permeability contrast between the filter pack and the surrounding formation. Silica gel that formed in the annulus blocked vertical water flow and stopped the chemical transport through the gel zone. In conclusion, this research reveals that using CS suspension injection and sequential gelation (CS-GEL) is a promising technology for blocking vertical water flow and chemical transport through the filter pack in targeted zones within the annulus of long-screened well systems.

Colloidal silica suspension↗
DOE OSTI2020

Performance Portability Evaluation of OpenCL Benchmarks across Intel and NVIDIA Platforms

We evaluate the capabilities of vendor-provided OpenCL implementations for performance portability across multiple computing platforms. The Rodinia benchmark suite is used for this evaluation. We apply the metric defined by Pennycook et al., and we use roofline efficiency from the Roofline performance model as the "performance efficiency" in the metric's definition. We found that the delivered performance portability is similar for several benchmarks, even if the roofline-based performance efficiencies across platforms are very different among the benchmarks. To help distinguish between these instances, we extend the metric by adding the standard deviation of the performance efficiencies for each benchmark. We argue that the standard deviation gives additional insight into performance portability assessment since it adds the performance variability across platforms. Additionally, we discuss the challenges to measure performance portability associated with algorithms and system software. In terms of algorithms, we need to carefully construct the benchmarks and appropriately use the concurrency available on a platform. In terms of system software, we depend on the vendor performance tools to support the desired programming model and runtime to be able to measure the metrics of interest.

GPU↗
NASA NTRS2019

A Tactical Scheduler for Surface Metering Under Minimum Departure Interval Restrictions

Minimum Departure Interval (MDI) and Miles-In-Trail (MIT) are common traffic management tools. They both require minimum separation between departures to meet specific traffic conditions. The MDI restriction is a time separation requirement between departures, usually on the same Standard Instrument Departure (SID), whereas the MIT restriction is a distance separation requirement between aircraft, including but not limited to departure flights, to meet specific criteria associated with flight path or destination. At Incheon International Airport (IATA code: ICN) in South Korea, MDIs are imposed on 92% of departure flights. They involve specific criteria including not only having identical SID, but also satisfying other conditions, imposed on the flight path and destination. To address complicated MDI constraints, Korea Aerospace Research Institute (KARI) has been developing and improving a tactical scheduler for surface metering at ICN to provide appropriate target times for pushbacks and takeoffs for departure flights under MDIs. This paper describes the MDI requirements at ICN, the development of a heuristic scheduling algorithm to work with the MDI restrictions, and the performance evaluation of the algorithm through fast-time simulations. The performance evaluation results indicate that the proposed heuristic algorithm can provide the surface metering schedules that comply with the MDI restrictions without significant performance degradation.

DMAN (Departure Management)↗
DOE OSTI2020

Calculation of Moisture-Dependent, Anisotropic Parameters Supporting the Hanford Site's Composite Analysis, Cumulative Impact Evaluation, and Performance Assessments

Variable, moisture (tension) dependent anisotropy (MDA) in unsaturated soils is an effective, large-scale (macroscopic) flow property that results from media heterogeneities at a smaller scale. The purpose of this environmental calculation file (ECF) is to document the variable MDA calculations using a script routine. The accuracy of the script calculations are cross-checked against results using other software. Appendices for this ECF are Appendix A, which documents supporting script use; Appendix B, which provides supporting spreadsheet calculations; and Appendix C, which provides supporting utility calculations. The work is in support of vadose zone flow and transport models used in performance assessment (PA), composite analysis (CA), and cumulative impact evaluation (CIE) at the Hanford Site.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1993

Optical Technologies for UV Remote Sensing Instruments

Over the last decade significant advances in technology have made possible development of instruments with substantially improved efficiency in the UV spectral region. In the area of optical coatings and materials, the importance of recent developments in chemical vapor deposited (CVD) silicon carbide (SiC) mirrors, SiC films, and multilayer coatings in the context of ultraviolet instrumentation design are discussed. For example, the development of chemically vapor deposited (CVD) silicon carbide (SiC) mirrors, with high ultraviolet (UV) reflectance and low scatter surfaces, provides the opportunity to extend higher spectral/spatial resolution capability into the 50-nm region. Optical coatings for normal incidence diffraction gratings are particularly important for the evolution of efficient extreme ultraviolet (EUV) spectrographs. SiC films are important for optimizing the spectrograph performance in the 90 nm spectral region. The performance evaluation of the flight optical components for the Solar Ultraviolet Measurements of Emitted Radiation (SUMER) instrument, a spectroscopic instrument to fly aboard the Solar and Heliospheric Observatory (SOHO) mission, designed to study dynamic processes, temperatures, and densities in the plasma of the upper atmosphere of the Sun in the wavelength range from 50 nm to 160 nm, is discussed. The optical components were evaluated for imaging and scatter in the UV. The performance evaluation of SOHO/CDS (Coronal Diagnostic Spectrometer) flight gratings tested for spectral resolution and scatter in the DGEF is reviewed and preliminary results on resolution and scatter testing of Space Telescope Imaging Spectrograph (STIS) technology development diffraction gratings are presented.

Keski-Kuha, R. A. M.↗