Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

SU-E-I-40: New Method for Measurement of Task-Specific, High-Resolution Detector System Performance

Purpose: Although generalized linear system analytic metrics such as GMTF and GDQE can evaluate performance of the whole imaging system including detector, scatter and focal-spot, a simplified task-specific measured metric may help to better compare detector systems. Methods: Low quantum-noise images of a neuro-vascular stent with a modified ANSI head phantom were obtained from the average of many exposures taken with the high-resolution Micro-Angiographic Fluoroscope (MAF) and with a Flat Panel Detector (FPD). The square of the Fourier Transform of each averaged image, equivalent to the measured product of the system GMTF and the object function in spatial-frequency space, was then divided by the normalized noise power spectra (NNPS) for each respective system to obtain a task-specific generalized signal-to-noise ratio. A generalized measured relative object detectability (GM-ROD) was obtained by taking the ratio of the integral of the resulting expressions for each detector system to give an overall metric that enables a realistic systems comparison for the given detection task. Results: The GM-ROD provides comparison of relative performance of detector systems from actual measurements of the object function as imaged by those detector systems. This metric includes noise correlations and spatial frequencies relevant to the specific object. Additionally, the integration bounds for the GM-ROD can be selected to emphasis the higher frequency band of each detector if high-resolution image details are to be evaluated. Examples of this new metric are discussed with a comparison of the MAF to the FPD for neuro-vascular interventional imaging. Conclusion: The GM-ROD is a new direct-measured task-specific metric that can provide clinically relevant comparison of the relative performance of imaging systems. Supported by NIH Grant: 2R01EB002873 and an equipment grant from Toshiba Medical Systems Corporation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2006

Development of Testing Methodologies to Evaluate Postflight Locomotor Performance

Crewmembers experience locomotor and postural instabilities during ambulation on Earth following their return from space flight. Gait training programs designed to facilitate recovery of locomotor function following a transition to a gravitational environment need to be accompanied by relevant assessment methodologies to evaluate their efficacy. The goal of this paper is to demonstrate the operational validity of two tests of locomotor function that were used to evaluate performance after long duration space flight missions on the International Space Station (ISS).

Mulavara, A. P.↗
NASA NTRS2005

Distributed Evaluation Functions for Fault Tolerant Multi-Rover Systems

The ability to evolve fault tolerant control strategies for large collections of agents is critical to the successful application of evolutionary strategies to domains where failures are common. Furthermore, while evolutionary algorithms have been highly successful in discovering single-agent control strategies, extending such algorithms to multiagent domains has proven to be difficult. In this paper we present a method for shaping evaluation functions for agents that provide control strategies that both are tolerant to different types of failures and lead to coordinated behavior in a multi-agent setting. This method neither relies of a centralized strategy (susceptible to single point of failures) nor a distributed strategy where each agent uses a system wide evaluation function (severe credit assignment problem). In a multi-rover problem, we show that agents using our agent-specific evaluation perform up to 500% better than agents using the system evaluation. In addition we show that agents are still able to maintain a high level of performance when up to 60% of the agents fail due to actuator, communication or controller faults.

Agogino, Adrian↗
NASA NTRS1973

Development of design information for molecular-sieve type regenerative CO2-removal systems

Experimental and analytic studies were conducted with molecular sieve sorbents to provide basic design information, and to develop a system design technique for regenerable CO2-removal systems for manned spacecraft. Single sorbate equilibrium data were obtained over a wide range of conditions for CO2, water, nitrogen, and oxygen on several molecular sieve and silica gel sorbents. The coadsorption of CO2 with water preloads, and with oxygen and nitrogen was experimentally evaluated. Mass-transfer, and some limited heat-transfer performance evaluations were accomplished under representative operating conditions, including the coadsorption of CO2 and water. CO2-removal system performance prediction capability was derived.

Wright, R. M.↗
NASA NTRS2023

Towards an Indian Land Data Assimilation System (ILDAS): A Coupled Hydrologic-Hydraulic System for Water Balance Assessments

Effective management of water resources requires reliable estimates of land surface states and fluxes, including water balance components. But most land surface models run in uncoupled mode and do not produce river discharge at catchment scales to be useful for water resources management applications. Such integrated systems are also rare over India where hydrometeorological extremes have wreaked havoc on the economy and people. So, an Indian Land Data Assimilation System (ILDAS) with a coupled land surface and a hydrodynamic model has been developed and driven by multiple meteorological forcings (0.1°, daily) to estimate land surface states, channel discharge, and floodplain inundation. ILDAS benefits from an integrated framework as well as the largest suite of observation records collected over India and has been used to produce a reanalysis product for 1981–2021 using four forcing datasets, namely, Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2), Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS), ECMWF’s ERA-5, and Indian Meteorological Department (IMD) gridded precipitation. We assessed the uncertainty and bias in these precipitation datasets and validated all major components of the terrestrial water balance, i.e., surface runoff, soil moisture, terrestrial water storage anomalies, evapotranspiration, and streamflow, against a combination of satellite and in situ observation datasets. Our assessment shows that ILDAS can represent the hydrological processes reasonably well over the Indian landmass with IMD precipitation showing the best relative performance. Evaluation against ESA-CCI soil moisture shows that MERRA-2 based estimates outperform the others, whereas ERA-5 performs best in simulating evapotranspiration when evaluated against MODIS ET. Evaluations against observed records show that CHIRPS-based estimates have the highest performance in reconstructing surface runoff and streamflow. Once operational, this system will be useful for supporting transboundary water management decision making in the region.

Indian Land Data Assimilation System (ILDAS)↗
DOE OSTI2025

Thermal Management for Planar Package Power Electronics (CRADA Final Report)

The National Renewable Energy Laboratory (NREL) and John Deere Electronic Solutions (JDES) collaborated to develop and evaluate computer models and simulations related to the thermal performance of semiconductor device packaging for an inverter of an off-road vehicle ("Semiconductor Packaging"). The objective of the research was for NREL and JDES to develop a two or three-dimensional computer-aided design model of the Semiconductor Packaging ("Computer Model") for thermal performance evaluation in a simulation. The project developed computer models of a Semiconductor Package of silicon-carbide semiconductor devices with appropriate thermal dissipation via one or more of the following thermal features: a double-sided planar cooling configuration, an air-cooled configuration, a liquid-cooled configuration for off-road inverter applications in a relevant simulated operating environment. It is noted that surface area and prototype product embodiment consisting of air-cooled and liquid-cooled configurations may and may not be in direct contact with power semiconductor chips. The idea was to explore and develop packaging and thermal management technology for power semiconductors that was most effective in the performance yet had least burden in overall product cost for a given application.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1972

Preliminary testing of a SNAP-19 TAGS RTG in support of the Pioneer F and G missions.

This paper presents the results of a preliminary performance evaluation of the SNAP-19 TAGS thermoelectric generator which was selected as the power source for the Pioneer Space Flight Mission. The performance of the SNAP-19 generator was evaluated at various input powers and fin-root temperatures. Results of this evaluation are analyzed and discussed. Tests were also performed to provide the Pioneer Flight Project Management with applicable data such as generator thermal dynamic behavior during launch and prior to deployment. These special tests measure generator performance as a function of fin-root temperature and the dynamic frequency response of the generator.

Stapfer, G.↗
DOE OSTI2026

L-VISP: LSTM Visualization for Interpretable Symptom Prediction in Patient Cohorts

Symptom modelling in head and neck cancer is challenged by the complexity of heterogeneous patient data, leading to an interest in deep learning approaches. Although Long Short-Term Memory Networks (LSTMs) have shown great results in patient risk prediction, their low interpretability requires data modellers to collaborate with clinical experts to validate the results. We present L-VISP, a human–machine solution that uses visual analytics for LSTM modelling in clinical research. L-VISP uses custom visual encodings to make multiple LSTM variants interpretable, supporting a full range of analysis, from understanding model operations and evaluating performance to interpreting results in a clinical context. We evaluate L-VISP with data modellers and a clinical oncologist and present the takeaways from this multidisciplinary collaboration.

LSTM modeling↗
NASA NTRS1972

Space Storable Propellant Performance Gas/Liquid Like-Doublet Injector Characterization

A 30-month applied research program was conducted, encompassing an analytical, design, and experimental effort to relate injector design parameters to simultaneous attainment of high performance and component (injector/thrust chamber) compatibility for gas/liquid space-storable propellants. The gas/liquid propellant combination selected for study was FLOX (82.6% F2)/ambient temperature gaseous methane. The injector pattern characterized was the like-(self)-impinging doublet. Program effort was apportioned into four basic technical tasks: injector and thrust chamber design, injector and thrust chamber fabrication, performance evaluation testing, and data evaluation and reporting. Analytical parametric combustion analyses and cold flow distribution and atomization experiments were conducted with injector segment models to support design of injector/thrust chamber combinations for hot fire evaluation. Hot fire tests were conducted to: (1) optimize performance of the injector core elements, and (2) provide design criteria for the outer zone elements so that injector/thrust chamber compatibility could be achieved with only minimal performance losses.

Falk, A. Y.↗
NASA NTRS1999

Test Results of a 200 W Class Hall Thruster

The performance of a 200 W class Hall thruster was evaluated. Performance measurements were taken at power levels between 90 W and 250 W. At the nominal 200 W design point, the measured thrust was 11.3 mN. and the specific impulse was 1170 s excluding cathode flow in the calculation. A laboratory model 3 mm diameter hollow cathode was used for all testing. The engine was operated on laboratory power supplies in addition to a breadboard power processing unit fabricated from commercially available DC to DC converters.

Jacobson, David↗
NASA NTRS2006

Truss Performance and Packaging Metrics

In the present paper a set of performance metrics are derived from first principals to assess the efficiency of competing space truss structural concepts in terms of mass, stiffness, and strength, for designs that are constrained by packaging. The use of these performance metrics provides unique insight into the primary drivers for lowering structural mass and packaging volume as well as enabling quantitative concept performance evaluation and comparison. To demonstrate the use of these performance metrics, data for existing structural concepts are plotted and discussed. Structural performance data is presented for various mechanical deployable concepts, for erectable structures, and for rigidizable structures.

Mikulas, Martin M.↗
NASA NTRS1990

An Occupational Performance Test Validation Program for Fire Fighters at the Kennedy Space Center

We evaluated performance of a modified Combat Task Test (CTT) and of standard fitness tests in 20 male subjects to assess the prediction of occupational performance standards for Kennedy Space Center fire fighters. The CTT consisted of stair-climbing, a chopping simulation, and a victim rescue simulation. Average CTT performance time was 3.61 +/- 0.25 min (SEM) and all CTT tasks required 93% to 97% maximal heart rate. By using scores from the standard fitness tests, a multiple linear regression model was fitted to each parameter: the stairclimb (r(exp 2) = .905, P less than .05), the chopping performance time (r(exp 2) = .582, P less than .05), the victim rescue time (r(exp 2) = .218, P = not significant), and the total performance time (r(exp 2) = .769, P less than .05). Treadmill time was the predominant variable, being the major predictor in two of four models. These results indicated that standardized fitness tests can predict performance on some CTT tasks and that test predictors were amenable to exercise training.

Schonfeld, Brian R.↗
DOE OSTI2020

In-Sodium Testing of a Prototype Thermoacoustic Power Sensor for Sodium-Cooled Fast Reactors

The ultimate goal of this project is to develop and demonstrate a thermoacoustic power sensor (TAPS) for Sodium-Cooled Fast Reactors (SFRs), with potential application also envisioned to other nuclear technologies such as Lead-Cooled Fast Reactors (LFRs), Molten Salt Reactors (MSRs), in addition to Light Water Reactors (LWRs). The project was led by Westinghouse Electric Company, LLC (Westinghouse) and carried out in collaboration with Argonne National Laboratory (ANL) and the University of Pittsburgh. A TAPS is a passive (self-powered), non-invasive (wireless) sensor envisioned for measuring key parameters, such as local temperature and neutron flux, in a nuclear reactor core. The sensor generates pressure waves (i.e., sound waves) with a frequency and amplitude dependent upon nuclear operating conditions (coolant temperature or power changes). The acoustic waves are able to travel through the core and associated structures, and reach to the sensor network placed outside and/or inside of the reactor vessel. These sensors require a very small amount of power which, during loss of power events, can be provided, for example, by harvesting gamma radiation energy, thus resulting in a monitoring system that can function both during normal operation and during loss of power events. Westinghouse and the University of Pittsburgh designed and fabricated TAPS prototypes for Argonne National Laboratory (ANL) to carry out in-sodium testing to evaluate the effects of sodium on the TAPS and the performance of the TAPS technique in sodium. Argonne received a TAPS prototype from Westinghouse, and the prototype was modified such that it can be installed into a test vessel and function in sodium at elevated temperature without potentially leaking. A water mockup test apparatus was constructed to validate proper working of the prototype. An instrumentation and control (I&C) system, running on the National Instruments (NI) LabView platform, was developed to: 1) operate both the water mockup test and the in-sodium test facility; and 2) process and analyze the received acoustic signals from an array of accelerometers and the Argonne sodium-submersible high-temperature acoustic sensor. The prototype was successfully tested in a water bath at different temperatures. Water mockup tests demonstrated that the TAPS prototype is working properly and its resonance frequency changes linearly with the coolant (water) temperature. A TAPS test apparatus was constructed and integrated with the upgraded Under-Sodium Viewing (USV) sodium test facility. The integrated USV-TAPS sodium test facility has been operational. The TAPS prototype and a high-temperature sodium-submersible acoustic sensor (SSAS) developed by Argonne were both installed inside the TAPS test vessel. Being operated within argon cover gas under ambient conditions, the TAPS prototype demonstrated that it was functioning properly with a resonance frequency at 1407.2 Hz, which was successfully detected by the accelerometers mounted on the external wall of the vessel and the high-temperature SSAS installed inside the vessel. After successfully transferring sodium into the vessel, in-sodium tests of the prototype were conducted. Tests of the TAPS prototype demonstrated that the resonance frequency of the TAPS changes linearly with respect to the temperature difference between the interior of the TAPS and bulk sodium. The early tests showed that the TAPS prototype could not establish a continuous and consistent resonance in sodium. The resonance diminished before the prototype reached its operating temperature. A signal postprocessor was added to the DAQ module latterly to isolate interferences, enhance signal conditioning, improve peak detection, and generate resonance frequency versus temperature plots. After testing in molten sodium and immersion at higher temperature for several weeks, the TAPS prototype was able to establish a continuous resonance. Performance evaluation of the TAPS prototype was then conducted in sodium. The tests included the investigation of 1) the effects of the temperature difference between the TAPS and bulk sodium, 2) the effects of sodium flowrate; and 3) the performance of the different sensor-receiver systems positioned inside or outside the vessel. Results of a test demonstrated that, with limited sodium circulation, a continuous and consistent resonance of the TAPS prototype was established occasionally. The tests also demonstrated that, because of the nature of detection principles and mounting methods, the high temperature SSAS is more affected by acoustic noise, while accelerometers are more affected by vibrations, in the test environment. It is unknown why the TAPS prototype only occasionally established a continuous and consistent resonance when the TAPS temperature reached its operating temperature in molten sodium, and why it ultimately failed to resonate at all. A failure modes assessment was conducted and a few potential causes of failure were identified. Different post in-sodium tests were conducted to obtain additional information potentially relevant to the cause of the failure. Nondestructive evaluation techniques are suggested to examine the internal integrity as well as the gas mixture of the prototype. If they prove inconclusive, the prototype should be cut open to conduct a thorough inspection of its internal integrity and determine the state of the gas mixture.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2014

A quality assurance framework for the fully automated and objective evaluation of image quality in cone-beam computed tomography

Purpose: Thousands of cone-beam computed tomography (CBCT) scanners for vascular, maxillofacial, neurological, and body imaging are in clinical use today, but there is no consensus on uniform acceptance and constancy testing for image quality (IQ) and dose yet. The authors developed a quality assurance (QA) framework for fully automated and time-efficient performance evaluation of these systems. In addition, the dependence of objective Fourier-based IQ metrics on direction and position in 3D volumes was investigated for CBCT. Methods: The authors designed a dedicated QA phantom 10 cm in length consisting of five compartments, each with a diameter of 10 cm, and an optional extension ring 16 cm in diameter. A homogeneous section of water-equivalent material allows measuring CT value accuracy, image noise and uniformity, and multidimensional global and local noise power spectra (NPS). For the quantitative determination of 3D high-contrast spatial resolution, the modulation transfer function (MTF) of centrally and peripherally positioned aluminum spheres was computed from edge profiles. Additional in-plane and axial resolution patterns were used to assess resolution qualitatively. The characterization of low-contrast detectability as well as CT value linearity and artifact behavior was tested by utilizing sections with soft-tissue-equivalent and metallic inserts. For an automated QA procedure, a phantom detection algorithm was implemented. All tests used in the dedicated QA program were initially verified in simulation studies and experimentally confirmed on a clinical dental CBCT system. Results: The automated IQ evaluation of volume data sets of the dental CBCT system was achieved with the proposed phantom requiring only one scan for the determination of all desired parameters. Typically, less than 5 min were needed for phantom set-up, scanning, and data analysis. Quantitative evaluation of system performance over time by comparison to previous examinations was also verified. The maximum percentage interscan variation of repeated measurements was less than 4% and 1.7% on average for all investigated quality criteria. The NPS-based image noise differed by less than 5% from the conventional standard deviation approach and spatially selective 10% MTF values were well comparable to subjective results obtained with 3D resolution pattern. Determining only transverse spatial resolution and global noise behavior in the central field of measurement turned out to be insufficient. Conclusions: The proposed framework transfers QA routines employed in conventional CT in an advanced version to CBCT for fully automated and time-efficient evaluation of technical equipment. With the modular phantom design, a routine as well as an expert version for assessing IQ is provided. The QA program can be used for arbitrary CT units to evaluate 3D imaging characteristics automatically.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2025

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗
NASA NTRS1978

SIMS prototype system 1 test results: Engineering analysis

The space and domestic water solar heating system designated SIMS Prototype Systems 1 was evaluated. The test system used 720 ft (gross) of Solar Energy Products Air Collectors, a Solar Control Corporation SAM 20 Air Handler with Model 75-175 control unit, a Jackson Solar Storage tank with Rho Sigma Mod 106 controller, and 20 tons of rack storage. The test data analysis performed evaluates the system performance and documents the suitability of SIMS Prototype System 1 hardware for field installation.

Source record↗