Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Pilot personality and crew coordination - Implications for training and selection

It is contended that past failures to find linkages between performance and personality were due to a combination of premature performance evaluation, inadequate statistical modeling, and/or the reliance on data gathered in contrived as opposed to realistic situations. The goal of the research presented is to isolate subgroups of pilots along performance-related personality dimensions and to document limits on the impact of crew coordination training between the groups. Three different profiles were identified through cluster analysis of personality scales that replicated across samples and predicted attitude change following training in crew coordination.

Chidester, Thomas R.↗
NASA NTRS2001

Geoscience Laser Altimeter System (GLAS) Instrument: Flight Loop Heat Pipe (LHP) Acceptance Thermal Vacuum Test

Two loop heat pipes (LHPs) are to be used for tight thermal control of the Geoscience Laser Altimeter System (GLAS) instrument, planned for flight in late 2001. The LHPs are charged with Propylene as a working fluid. One LHP will be used to transport 110 W from a laser to a radiator, the other will transport 160 W from electronic boxes to a separate radiator. The application includes a large amount of thermal mass in each LHP system and low initial startup powers. The initial design had some non-ideal flight design compromises, resulted in a less than ideal charge level for this design concept with a symmetrical secondary wick. This less than ideal charge was identified as the source of inadequate performance of the flight LHPs during the flight thermal vacuum test in October of 2000. We modified the compensation chamber design, re-built and charged the LHPs for a final LHP acceptance thermal vacuum test. This test performed March of 2001 was 100% successful. This is the last testing to be performed on the LHPs prior to instrument thermal vacuum test. This sensitivity to charge level was shown through varying the charge on a Development Model Loop Heat Pipe (DM LHP) and evaluating performance at various fill levels. At lower fills similar to the original charge in the flight units, the same poor performance was observed. When the flight units were re-designed and filled to the levels similar to the initial successful DM LHP test, the flight units also successfully fulfilled all requirements. This final flight Acceptance test assessed performance with respect to startup, low power operation, conductance, and control heater power, and steady state control. The results of the testing showed that both LHPs operated within specification. Startup on one of the LHPs was better than the other LHP because of the starter heater placement and a difference in evaporator design. These differences resulted in a variation in the achieved superheat prior to startup. The LHP with the lower superheat was sensitive to the thermal environment around the compensation chamber, while the LHP with the higher superheat (similar in design to DM LHP) was not. In response to the test results the placement of the starter heater will be optimized for the flight instrument testing for higher achieved superheat. This presentation discusses startup behavior, overall conductance of a radiator system, low power operation, high power operation, temperature control stability, and control heater power requirements as measured during this acceptance thermal vacuum test. A brief summary of 'lessons learned' will be included.

Baker, Charles↗
NASA NTRS2021

Probabilistic Processing of Asynchronous Geiger-Mode Avalanche Photodiode Arrays for Background Rate Measurements

A system-level performance evaluation of Geiger-mode avalanche photodiode (GmAPD) arrays requires accurate measurement and prediction of the background rate of the device due to dark counts and other spurious detection events. Since a GmAPD detector reports only a binary value and timestamp associated with an avalanche event, dark count rates are typically measured by averaging thousands of frames to support a statistically significant measurement. For both synchronous and asynchronous detector, the Poisson distributed background rates are referenced to the time each pixel is armed. Unlike for synchronous GmAPD imagers where all the pixels are armed to an array-wide arm signal, an asynchronous pixel operates independently from its neighboring pixels; requiring the background rates to be calculated using an interarrival histogram. For both types of imagers, the background rate is typically evaluated by fitting an exponential distribution to a fixed window within a measured histogram of time intervals between detection events However, if the statistics of the background rate are insufficient – whether that is due to low population sizes, saturation, or a large dynamic range of population size across the array, the pixel, or array-wide, performance metrics may report results with varying accuracy. This paper reports on an implementation of an algorithm that evaluates GmAPD background rates based on statistical metrics rather than fixed windows. The algorithm functions by determining the appropriate integration window within the interarrival time histogram based on a per-pixel count rate set by a predetermined tolerable measurement error. The implementation of the algorithm allows us to characterize GmAPD arrays with orders of magnitude spread in background rates across the detector using common statistical parameters.

Mumolo, J.↗
DOE OSTI2022

Proxy-Based Bayesian Inversion Of Poroelastic Simulations To Interpret Strain Tensor Data Measured During Well Testing

The long runtimes of 3D poroelastic numerical simulators makes it impractical to interpret deformation datasets using many inversion schemes. Recent advances in instrumentation have made it possible to measure the strain tensor during well testing, but the lack of robust inversion methods is limiting the ability to interpret these data. We have developed an inversion workflow that reduces the number of computations required to complete a Bayesian inversion using DREAMzs. The workflow trains a KNN model using output from the poroelastic simulator, and then uses the KNN model as a proxy for the simulator during inversion. The workflow also includes a strategy for ensuring the results from the proxy model converge to the results from the simulator, ensuring the accuracy of the final results. An idealized example configured to represent a well test in a deep aquifer is used to verify that the workflow correctly identifies parameters and characterizes noise. Field data measured using strainmeters during an injection test at an oil reservoir in Oklahoma are used to evaluate performance with a real dataset. The workflow identified 265 history matching solutions out of 1240 total simulation runs (21% acceptance ratio), and the results are used to characterize posterior parameter distribution and evaluate the prediction uncertainty. This approach makes it feasible to invert strain data measured during well testing and this has the potential to improve the characterization of aquifers and reservoirs.

Roudini, Soheil↗
NASA NTRS1989

Experience with advanced instrumentation in a hot section cascade

The Lewis Research Center gas turbine Hot Section Test Facility was developed to provide a real engine environment with known boundary conditions for the aerothermal performance evaluation and verification of computer design codes. This verification process requires experimental measurements in a hostile environment. The research instruments used in this facility are presented, and their characteristics and how they perform in this environment are discussed. The research instrumentation consisted of conventional pressure and temperature sensors, as well as thin-film thermocouples and heat flux gages. The hot gas temperature was measured by an aspirated temperature probe and by a dual-element, fast-response temperature probe. The data acquisition mode was both steady state and time dependent. These experiments were conducted over a wide range of gas Reynolds numbers, exit gas Mach numbers, and heat flux levels. This facility was capable of testing at temperatures up to 1600 K, and at pressures up to 18 atm. These corresponded to an airfoil exit Reynolds number range of 0.5 x 10(6) to 2.5 x 10(6) based on the airfoil chord of 5.55 cm. The results characterize the performance capability and the durability of the instrumentation. The challenge of making measurements in hostile environments is also discussed. The instruments exhibited more than adequate durability to achieve the measurement profile. About 70 percent of the thin-film thermocouples and the dual-element temperature probe survived several hundred thermal cycles and more than 35 hr at gas temperatures up to 1600 K. Within the experimental uncertainty, the steady-state and transient heat flux measurements were comparable and consistent over the range of Reynolds numbers tested.

Yeh, Frederick C.↗
NASA NTRS1953

Preliminary investigation of zirconium boride ceramals for gas-turbine blade applications

Zirconium boride ZrB2 ceramals were investigated for possible gas-turbine-blade application. Included in the study were thermal shock evaluations of disks, preliminary turbine-blade operation, and observations of oxidation resistance. Thermal shock disks of the following three compositions were studied: (a) 97.5 percent ZrB2 plus 2.5 percent B by weight; (b) 92.5 percent ZrB2 plus 7.5 percent B by weight; and (c) 100 percent ZrB2. Thermal shock disks were quenched from temperatures of 1800 degrees, 2000 degrees, 2200 degrees, and 2400 degrees F. The life of turbine blades containing 93 percent ZrB2 plus 7 percent B by weight was determined in gas-turbine tests. The blades were run at approximately 1600 degrees F and 15,000 to 26,000 rpm. The thermal shock resistance of the 97.5 percent ZrB2 plus 2.5 percent boron ceramals compares favorably with that of TiC plus Co and TiC plus Ni ceramals. Oxidation of the disks during the thermal shock evaluation was slight for the comparatively short time (8.3 hr) up through 2000 degrees F. Oxidation of a specimen was severe, however, after 100 hours at 2000 degrees F. The turbine blade performance evaluation of the 93 percent ZrB2 plus 7 percent B composition was preliminary in scope ; no conclusions can be drawn.

Hoffman, Charles A↗
NASA NTRS2001

Image Mission Attitude Support Experiences

The spin-stabilized Imager for Magnetopause to Aurora Global Exploration (IMAGE) is the National Aeronautics and Space Administration's (NASA's) first Medium-class Explorer Mission (MIDEX). IMAGE was launched into a highly elliptical polar orbit on March 25, 2000 from Vandenberg Air Force Base, California, aboard a Boeing Delta II 7326 launch vehicle. This paper presents some of the observations of the flight dynamics analyses during the launch and in-orbit checkout period through May 18, 2000. Three new algorithms - one algebraic and two differential correction - for computing the parameters of the coning motion of a spacecraft are described and evaluated using in-flight data from the autonomous star tracker (AST) on IMAGE. Other attitude aspects highlighted include support for active damping consequent upon the failure of the passive nutation damper, performance evaluation of the AST, evaluation of the Sun sensor and magnetometer using AST data, and magnetometer calibration.

Ottenstein, N.↗
DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Small to Full-Height Scale Comparisons of Cesium Ion Exchange Performance with Crystalline Silicotitanate

Crystalline silicotitanate (CST) ion exchanger is planned to be used to remove cesium (137Cs) from the aqueous phases of Hanford tank wastes in preparation for vitrification at the Waste Treatment and Immobilization Plant (WTP) Pretreatment Facility. Column scale up testing was conducted to evaluate performance of Cs exchange onto the CST. Batch contact testing was conducted to assess exchange kinetics of Cs exchange at four different CST PSDs. Column testing was conducted at three column sizes, small (2.5% full height), medium (12% full height), and full height, to assess Cs load performance behavior. Testing at the small scale was compared to actual Hanford tank waste testing to verify the validity of simulant tests to accurately represent full height column performance. A change in CST particle size was essential in scaling the small column dynamics up to full scale. Based on these results, a determination of intraparticle and film diffusion impacts on overall mass transfer coefficients will allow future modeling of the breakthrough performance at a range of process conditions.

Westesen, Amy M.↗
NASA NTRS1989

Uniform task level definitions for robotic system performance comparisons

A series of ten task levels of increasing difficulty was compiled for use in comparative performance evaluations of available and future robotics technology. Each level has a breakdown of ten additional levels of difficulty to provide a layering of 100 levels. It is assumed that each level of task performance must be achieved by the system before it can be appropriately considered for the next level.

Price, Charles↗
NASA NTRS2001

Autonomous System for MISSE Temperature Measurements

The Materials International Space Station Experiment (MISSE) is scheduled to be deployed during the summer of 2001. This experiment is a cooperative endeavor by NASA-LaRC, NASA-GRC, NASA MSFC, NASA-JSC, the Materials Laboratory at the Air Force Research Laboratory, and the Boeing Phantom Works. The objective of the experiment is to evaluate performance, stability, and long term survivability of materials and components planned for use by NASA and DOD on future LEO, synchronous orbit, and interplanetary space missions. Temperature is an important parameter in the evaluation of space environmental effects on materials.

Harvey, G. A.↗
NASA NTRS2002

Demonstration of Advanced C/SiC Cooled Ramp

Under a NASA contract, SPS is evaluating its C/SiC to metal brazing technique for the development of light, composite, actively cooled panels. The program first consisted of defining a system applicable to the X-33 nozzle ramp. SPS then performed evaluation tests for tube, composite, and braze material selection, and for the adaptation of braze process parameters to the parts geometry. SPS is presently manufacturing a 250x60 millimeter squared specimen, including 10 metallic tubes, which will be cycled in the NASA/GRC-CELL-22 test bed under engine representative conditions.

Bouquet, Clement↗
NASA NTRS2006

MISSE 1 and 2 Tray Temperature Measurements

The Materials International Space Station Experiment (MISSE 1 & 2) was deployed August 10,2001 and retrieved July 30,2005. This experiment is a co-operative endeavor by NASA-LaRC. NASA-GRC, NASA-MSFC, NASA-JSC, the Materials Laboratory at the Air Force Research Laboratory, and the Boeing Phantom Works. The objective of the experiment is to evaluate performance, stability, and long term survivability of materials and components planned for use by NASA and DOD on future LEO, synchronous orbit, and interplanetary space missions. Temperature is an important parameter in the evaluation of space environmental effects on materials. The MISSE 1 & 2 had autonomous temperature data loggers to measure the temperature of each of the four experiment trays. The MISSE tray-temperature data loggers have one external thermistor data channel, and a 12 bit digital converter. The MISSE experiment trays were exposed to the ISS space environment for nearly four times the nominal design lifetime for this experiment. Nevertheless, all of the data loggers provided useful temperature measurements of MISSE. The temperature measurement system has been discussed in a previous paper. This paper presents temperature measurements of MISSE payload experiment carriers (PECs) 1 and 2 experiment trays.

Harvey, Gale A.↗
NASA NTRSDate not supplied

From Simulation to Reality With Random Noise

The challenging environment of autonomous vehicle (AV) navigation necessitates certain functions be performed by deep neural networks. Optimizing these models involves collecting vast quantities of domain-specific training data and ensuring that the dataset is representative of expected conditions. High-fidelity simulation plays a vital role in making this process feasible, allowing a wide range of scenarios to be explored at low cost. However, learning from simulation introduces subtle biases into models, which can degrade real-world performance in unpredictable ways. This effect can be mitigated with learning schemes specialized to bridge distributional shifts (transfer learning). Given the complex nature of these methods, the underlying models, and their environments, meaningfully evaluating performance is notstraight forward. Many unrelated factors can effect an improvement in generalization accuracy, but a full ablation analysis is often difficult. To tease out signal from noise, it is necessary to understand how transfer learning performance is affected by noise itself. The goals of this paper are (i) to establish a domain randomization baseline for a simple classification transfer learning task and (ii) to validate the RRAV testbed as a platform for further research in sim-to-real learning. We generate imagery from a simulation of NASA Ames Research Center and train a small convolutional neural network (ConvNet) to classify position relative to a centerline. Further models are trained with different types of noise progressively added to the data. The models are deployed aboard the on-site test vehicle to test real-world performance. In our experiments, we find that such naive domain randomization raises sim-to-real accuracy from 64% to 79%, while training directly on real data yields an 89% accuracy ceiling. These results suggest that the isolated mechanism of domain randomization can significantly improve generalization.

simulation↗
DOE OSTI2023

DOE Advanced Gas Reactor Fuel Development and Qualification Program Overview

Slides discussing the DOE Advanced Gas Reactor Fuel Development and Qualification Program Overview to include focus on LEU UCO TRISO fuel in cylindrical compacts, with data for fuel qualification in support of reactor licensing and a path to establish a domestic commercial TRISO fuel fabrication capability. Timelines from 2004 through 2029. Major program highlights include: Developed fuel performance models based on past observed behavior, Study to understand differences between US and German (“good”) fuel, Developed and improved fuel fabrication and characterization methods, Fabricated lab-scale fuel (AGR-1) with very high quality; excellent in-pile and post-irradiation high-temperature fuel performance, Scale-up coating fabrication (AGR-2) with excellent in-pile performance, AGR-3/4 fuel fabrication and irradiation experiment to assess FP transport behavior, Scale-up matrix fabrication (AGR-5/6/7); & fuel performance evaluation in progress.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1993

Design and test of a small two stage counter-rotating turbine for rocket engine application

The aerodynamic design and rig test evaluation of a small counter-rotating turbine system is described. The technology represented by this turbine is being developed for application in an advanced upper stage rocket engine turbopump. This engine will employ an oxygen/hydrogen expander cycle and achieve high performance through efficient combustion, high combustion pressure, and high area ratio exhaust nozzle expansion. Engine performance goals require that the turbopump drive turbines achieve high efficiency at low gas flow rates. The low flow rates result in very small airfoil diameter, height and chord. The high efficiency and small size requirements present a challenging turbine design problem. The unconventional approach employed to meet this challenge is described, along with the detailed design process and resulting airfoil configurations. The method and results of full scale aerodynamic performance evaluation testing of both one and two stage configurations, as well as operation without the secondary stage stator are presented. The overall results of this effort illustrate that advanced aerodynamic design tools and hardware fabrication techniques have provided improved capability to produce small high performance turbines for advanced rocket engines.

Huber, F. W.↗
NASA NTRS1973

The performance of solar arrays in deep space

Spacecraft of the Mariner class have been used by the United States during the past 11 years for planetary exploration. During these missions, the solar array performance characteristics were carefully monitored, and the data were reduced and analyzed. In addition to the direct array telemetry itself, the five latest Mariners were also equipped with a special transducer to aid in evaluating performance and determining the cause of array degradation. This paper describes the performance results of the Mariner solar arrays and the intelligence returned from the special performance transducer carrier on the later flights.

Goldsmith, J. V.↗