Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Evaluating the performance of WRF urban schemes and PBL schemes over Dallas-Fort Worth during a dry summer and a wet summer

This study evaluated the Weather Research and Forecasting (WRF) model sensitivity to different planetary boundary layer (PBL) schemes (the YSU and MYJ schemes) and urban schemes including the bulk scheme (BULK), single-layer urban canopy model (UCM), multi-layer building environment parameterization (BEP) model, and multi-layer building energy model (BEM). Daily reinitialization simulations were conducted over Dallas-Fort Worth during a dry summer month (July 2011) and a wet summer month (July 2015) with weaker (stronger) daytime (nocturnal) UHI in 2011 than 2015. All urban schemes overestimated the urban daytime 2m temperature in both summers, but BEP and BEM still reproduced the daytime urban cool island in dry summer. All urban schemes reproduced the nocturnal urban heat island, with BEP producing the weakest one due to its unrealistic urban cooling. BULK and UCM overestimated the urban canopy wind speed, while BEP and BEM underestimated it. The urban schemes showed prominent impact on daytime PBL profiles. UCM+MYJ showed a superior performance than other configurations. The relatively large (small) aspect ratio between building height and road width in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy temperature. The relatively low (high) building height in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy wind speed. Improving urban schemes and providing realistic urban parameters were critical for improving urban canopy simulation.

54 ENVIRONMENTAL SCIENCES↗

Develop Advanced Nonlinear Signal Analysis Topographical Mapping System

During the development of the SSME, a hierarchy of advanced signal analysis techniques for mechanical signature analysis has been developed by NASA and AI Signal Research Inc. (ASRI) to improve the safety and reliability for Space Shuttle operations. These techniques can process and identify intelligent information hidden in a measured signal which is often unidentifiable using conventional signal analysis methods. Currently, due to the highly interactive processing requirements and the volume of dynamic data involved, detailed diagnostic analysis is being performed manually which requires immense man-hours with extensive human interface. To overcome this manual process, NASA implemented this program to develop an Advanced nonlinear signal Analysis Topographical Mapping System (ATMS) to provide automatic/unsupervised engine diagnostic capabilities. The ATMS will utilize a rule-based Clips expert system to supervise a hierarchy of diagnostic signature analysis techniques in the Advanced Signal Analysis Library (ASAL). ASAL will perform automatic signal processing, archiving, and anomaly detection/identification tasks in order to provide an intelligent and fully automated engine diagnostic capability. The ATMS has been successfully developed under this contract. In summary, the program objectives to design, develop, test and conduct performance evaluation for an automated engine diagnostic system have been successfully achieved. Software implementation of the entire ATMS system on MSFC's OISPS computer has been completed. The significance of the ATMS developed under this program is attributed to the fully automated coherence analysis capability for anomaly detection and identification which can greatly enhance the power and reliability of engine diagnostic evaluation. The results have demonstrated that ATMS can significantly save time and man-hours in performing engine test/flight data analysis and performance evaluation of large volumes of dynamic test data.

Jong, Jen-Yi↗

Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors

Statistical modeling and evaluation of the performance of obstacle detection systems for Unmanned Ground Vehicles (UGVs) is essential for the design, evaluation, and comparison of sensor systems. In this report, we address this issue for imaging range sensors by dividing the evaluation problem into two levels: quality of the range data itself and quality of the obstacle detection algorithms applied to the range data. We review existing models of the quality of range data from stereo vision and AM-CW LADAR, then use these to derive a new model for the quality of a simple obstacle detection algorithm. This model predicts the probability of detecting obstacles and the probability of false alarms, as a function of the size and distance of the obstacle, the resolution of the sensor, and the level of noise in the range data. We evaluate these models experimentally using range data from stereo image pairs of a gravel road with known obstacles at several distances. The results show that the approach is a promising tool for predicting and evaluating the performance of obstacle detection with imaging range sensors.

Matthies, Larry↗

LightMAT - Continuous fiber malleable thermoset composites with sub-1-minute dwell times; validation of impact performance and evaluation of the efficacy of the compression forming process (CRADA 409 Final Report)

In spite of carbon fiber composite materials’ significant impact on light-weighting, performance, and efficiency in the aerospace industry, adoption of these materials has been slow in high-volume industries such as automotive. Two major barriers to adoption are cost and cycle-time. Current approaches to thermoset composite part production are dependent on in-mold curing of thermosets which are not optimal for high volume, high throughput production due to limitations and inefficiencies associated with the in-mold cure itself. In addition, ancillary activities, such as transport and storage of shelf-life-limited uncured, or B-staged prepreg materials typically necessitate refrigerated transport and storage which significantly impacts the economic and energy costs associated with manufacturing. Furthermore, limited out-life means that trimmings cannot typically be used as they partially cure during initial production leading to high scrap rates (+20% is common). Finally, the need to cure in-mold drives cycle times to multiple minutes in the best cases, and 10’s of minutes to hours in most cases. Mallinda is developing polyimine malleable thermoset prepreg composite materials which have excellent mechanical properties (100 GPa tensile modulus, 2 GPA tensile strength, 2.4% elongation at break) and high operating temperatures (Tg>200°C). At scale, polyimine resins are commensurate in price with commodity epoxy resins. What distinguishes malleable thermoset prepreg from traditional thermoset prepreg materials, is that they are fully cured during Mallinda’s roll-to-roll production of prepreg laminate. This results in 5 key value-differentiating benefits. First, it simplifies manufacturing logistics by enabling ambient transportation and storage, and by significantly extending out-life and shelf-life almost indefinitely. Second, elimination of autoclave curing reduces the economic and energy costs to the customer. Third, scrap rates can be reduced as malleable thermoset prepreg materials are directly reusable. Fourth, the manufacturing consolidation step can be roughly 10x faster than traditional thermosets, because the resin is already cured. Parts can be made via compression forming by the application of heat and pressure to quickly vitrify and consolidate a multilayer part – easily leading to sub 3-minute cycle times (at lab scale we have demonstrated a 20 second dwell time, with room for further optimization). Finally, the closed-loop cradle-to-cradle solution-based recyclability of malleable thermoset composites can also contribute significantly to the future of sustainable lightweight materials. The focus of this project was the development, optimization and validation of malleable thermoset composite materials which exhibit manufacturing cycle times of 3-minute or less, high speed impact performance on par with incumbent technologies, and defect-free consolidation of 3 dimensional parts. Government funding is required on this project because Mallinda is a start-up company whose focus is the development and scale-up of the described technology for introduction to the transportation segment. Unlike incumbent industry players, Mallinda is bringing a completely new and highly relevant malleable thermoset technology to bear on the problem of high throughput composites. As a small business, Mallinda relies on a combination of government R&D funding and private capital to perform development work.

36 MATERIALS SCIENCE↗

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗

LiNi x Fe y Al z O 2 , a new cobalt-free layered cathode material for advanced Li-ion batteries

Recently, rapid fluctuations in cobalt prices have created a worsening supply chain constraint that has become a serious cause of concern amidst global battery manufacturers. To address this challenge, we report herein a new class of cobalt-free, nickel-rich layered cathode material termed the NFA class with general formula LiNi x Fe y Al z O 2 (x + y + z = 1). Using co-precipitation reaction in a continuous stirred tank reactor, we synthesized NFA(OH) 2 precursors with the constituent Ni, Fe and Al elements successfully incorporated. The obtained LiNFAO 2 cathode was characterized using X-Ray diffraction, Mössbauer spectroscopy and scanning electron microscopy. Electrochemical behavior was assessed using cyclic voltammetry, galvanostatic charge/discharge, electrochemical impedance spectroscopy and galvanostatic intermittent titration technique at various states of lithiation/delithiation. Electrochemical performance evaluations revealed that our cobalt-free material delivers high capacity of 190 mAh/g at 0.1C. Rate and cycling performance evaluations also indicated good rate capability and cycling stability with 88% capacity retention after 100 cycles at C/3. Using NFA cathodes, we also fabricated a 0.5Ah (C/3) cobalt-free Li-ion battery which demonstrated reasonable cycling stability with ~72% capacity retained after 200 cycles. Overall, our work demonstrates the immense potential of the cobalt-free NFA class cathodes as viable candidates towards development of next generation cost effective lithium ion batteries.

25 ENERGY STORAGE↗

PLATFORM for Product Launch

Pecan Street Inc. (PSI) and its partners set out in 2017 to validate the PLATFORM for Product Launch, a new model for improving the effectiveness of investments in clean energy technologies and accelerating market entry of disruptive technologies. In partnership with a newly formed Innovation Advisory Council, PSI recruited fourteen companies with new hardware-based technologies that enable or create clean energy opportunities. Pecan Street carried out product evaluations and conducted market research with stakeholders and target customers to develop recommendations on product optimization opportunities for all companies, and created third party performance evaluation reports that include environmental metrics, such as water and energy savings potential, to assist in creating investment confidence and to unlock additional sources of funding, such as impact investments. Pecan Street set-up the product testing environment, performed small-batch field testing, and provided a verified third-party performance report on the product of twelve companies. PSI Street and its partners leveraged the performance evaluations and insights from the newly formed PRI toolkit to raise over $1.5M across five companies, and garner interest for private sector adoption of the PLATFORM for Product Launch.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A lightweight method for evaluating in situ workflow efficiency

Performance evaluation is crucial to understanding the behavior of scientific workflows. In this study, we target an emerging type of workflow, called in situ workflows. These workflows tightly couple components such as simulation and analysis to improve overall workflow performance. To understand the tradeoffs of various configurable parameters for coupling these heterogeneous tasks, namely simulation stride, and component placement, separately monitoring each component is insufficient to gain insights into the entire workflow behavior. Through an analysis of the state-of-the-art research, we propose a lightweight metric, derived from a defined in situ step, for assessing resource usage efficiency of an in situ workflow execution. By applying this metric to a synthetic workflow, which is parameterized to emulate behaviors of a molecular dynamics simulation, we explore two possible scenarios (Idle Simulation and Idle Analyzer) for the characterization of in situ workflow execution. In addition to preliminary results from a recently published study [11], we further exploit the proposed metric to evaluate a practical in situ workflow with a real molecular dynamics application, i.e., GROMACS. Here, experimental results show that the in transit placement (analytics on dedicated nodes) sustains a higher frequency for performing in situ analysis compared to the helper-core configuration (analytics co-allocated with simulation).

97 MATHEMATICS AND COMPUTING↗

Performance Monitoring of Distributed Data Processing Systems

Test and checkout systems are essential components in ensuring safety and reliability of aircraft and related systems for space missions. A variety of systems, developed over several years, are in use at the NASA/KSC. Many of these systems are configured as distributed data processing systems with the functionality spread over several multiprocessor nodes interconnected through networks. To be cost-effective, a system should take the least amount of resource and perform a given testing task in the least amount of time. There are two aspects of performance evaluation: monitoring and benchmarking. While monitoring is valuable to system administrators in operating and maintaining, benchmarking is important in designing and upgrading computer-based systems. These two aspects of performance evaluation are the foci of this project. This paper first discusses various issues related to software, hardware, and hybrid performance monitoring as applicable to distributed systems, and specifically to the TCMS (Test Control and Monitoring System). Next, a comparison of several probing instructions are made to show that the hybrid monitoring technique developed by the NIST (National Institutes for Standards and Technology) is the least intrusive and takes only one-fourth of the time taken by software monitoring probes. In the rest of the paper, issues related to benchmarking a distributed system have been discussed and finally a prescription for developing a micro-benchmark for the TCMS has been provided.

Ojha, Anand K.↗

U1108 performance model

A model of Univac 1108 work flow has been developed to assist in performance evaluation studies and configuration planning. Workload profiles and system configurations are parameterized for ease of experimental modification. Outputs include capacity estimates and performance evaluation functions. The U1108 system is conceptualized as a service network; classical queueing theory is used to evaluate network dynamics.

Trachta, G.↗

Development of a test protocol for evaluating EVA glove performance

Testing gloved hand performance involves work from several disciplines. Evaluations performed in the course of reenabling a disabled hand, designing a robotic end effector or master controller, or hard-suit design have all yielded relevant information, and, in most cases, produced performance test methods. Most times, these test methods have been primarily oriented toward their parent discipline. For space operations, a comparative test which would provide a way to quantify pressure glove and end effector performance would be useful in dividing tasks between humans and robots. Such a test would have to rely heavily on sensored measurement, as opposed to questionnaires, to produce relevant data. However, at some point human preference would have to be taken into account. This paper presents a methodology for evaluating gloved hand performance which attempts to respond to these issues. Glove testing of a prototype glove design using this method is described.

Hinman, Elaine M.↗

On Applying the Prognostic Performance Metrics

Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.

Saxena, Abhinav↗

Numerical and experimental evaluation of mechanical performance of the multifunctional energy storage composites

This work presents numerical simulation methods to model the mechanical behavior of the multifunctional energy storage composites (MESCs), which consist of a stack of multiple thin battery layers reinforced with through-the-hole polymer rivets and embedded inside carbon fiber composite laminates. MESC has been demonstrated through earlier experiments on its exceptional behavior as a structural element as well as a battery. However, the inherent complex infrastructure of the MESC design has created significant challenges in simulation and modeling. A novel homogenization technique was adopted to characterize the multi-layer properties of battery material using physics-based constitutive equations combined with nonlinear deformation theories to handle the interface between the battery layers. Second, mechanical damage and failure modes among battery materials, polymer reinforcements, and carbon fiber-polymer interfaces were characterized through appropriate models and experiments. The model of MESCs has been implemented in a commercial finite element code in ABAQUS. A comparison of structural response and failure modes from numerical simulations and experimental tests are presented. The results of the study showed that the predictions of elastic and damage responses of MESCs at various loading conditions agreed well with the experimental data. © 2021

Materials Science↗

The effect of lighting environment on task performance in buildings – A review

The effects of indoor environmental conditions on human health, satisfaction, and performance have been the focal point of research for decades. This paper reviews and summarizes the impact of lighting environment on task performance, specifically for the built environment audience. Existing studies included a variety of performance tests on cognitive performance and perception, visual acuity and reaction, memory, reasoning, and labor productivity. Illuminance, luminance ratio and correlated color temperature were found to affect performance in different ways, reflecting the impact of experimental techniques, conditions, performance evaluation methods used and data analysis methods. These were reviewed and categorized, with discussion on limitations related to sample size, modeling approach, carryover effects and other factors affecting individual differences in performance, with recommendations for future improvement. Although no universal conclusions can be made, in general, task performance seems to improve with higher illuminances, contrast ratios in the range of 7–11:1 (while always making sure that glare will not occur in the space) and higher correlated color temperature, while spectral tuning in the red or blue wavelengths has also shown positive effects. To obtain more generic evidence, future studies should be more consistent in terms of experimental procedures and overall light conditions, and also consider the effects of vertical illuminance, daylight provision/control, and outside views on task performance. Finally, studying performance with multi-factorial designs in a human-centered optimized manner (such as deploying variable lighting scenarios optimized for various tasks) can lead to deeper understanding of lighting effects on task performance, and ultimately to improved lighting design and operation in buildings overall.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Aerocapture and aeromaneuvering at Mars

This paper presents the results of a guidance analysis study for aerocapture and aeromaneuvering at Mars. A 4-state, near-optimal, hybrid guidance algorithm is derived for applications throughout the paper. It is based on the critical assumption that Loh's function remains constant between successive guidance updates. Besides the guidance algorithm, the paper presents a performance evaluation of guidance derived from estimated or 'navigated' spacecraft state, provided by an onboard navigation subsystem for real-time applications on Mars. For the performance evaluation, the spacecraft state is augmented by such parameters as the reference atmospheric density and scale-height, the banking angle and angle of attack for spacecraft control and the accelerometer measurement model errors. Finally, the paper examines also, the influence of random uncertainties in atmospheric density on aeroassisted maneuvers, by a Monte Carlo type of simulation.

Vijayaraghavan, A.↗

Solar energy system performance evaluation-seasonal report for Elcam San Diego, San Diego, California

The solar energy system, Elcam San Diego, was designed to supply domestic hot water heating for a single family residence located in Encinitas, California. System description, performance assessment, operating energy, energy savings, maintenance, and conclusions are presented. The system is a 'Sunspot' two tank cascade type, where solar energy is supplied to either a 66 gallon preheat tank (solar storage) or a 40 gallon domestic hot water tank. Water is pumped directly from one of the two tanks, through the 65 square feet collector array and back into the same tank. Freeze protection is provided by automatically circulating hot water from the hot water tank through the collectors and exposed plumbing when freezing conditions exist. Auxiliary energy is supplied by natural gas. Analysis is based on instrumented system data monitored and collected for one full season of operation.

Source record↗

Study of the Correlation between the Performances of Lunar Vehicle Wheels Predicted by the Nepean Wheeled Vehicle Performance Model and Test Data

This paper describes the results of a study of the correlation between the performances of wheels for lunar vehicles predicted using the Nepean wheeled vehicle performance model (NWVPM), developed under the auspices of Vehicle Systems Development Corporation, Ottawa, Canada, and the corresponding test data presented in Performance evaluation of wheels for lunar vehicles , Technical Report M-70-2, prepared for George C. Marshall Space Flight Center, National Aeronautics and Space Administration (NASA), USA, by the US Army Engineer Waterways Experiment Station (WES). The NWVPM was originally developed for design and performance evaluation of terrestrial off-road wheeled vehicles. The purpose of this study is to assess the potential of the NWVPM for evaluating wheel candidates for the new generation of extra-terrestrial vehicles. Two versions of a wire-mesh wheel and a hoop-spring wheel, which were considered as candidates for lunar roving vehicles for the NASA Apollo program in the late 1960s, together with a pneumatic wheel were examined in this study. The tractive performances of these wheels and of a 464 test vehicle with the pneumatic wheels on air-dry sand were predicted using the NWVPM and compared with the corresponding test data obtained under Earth s gravity and previously documented in the above-named report. While test data on wheel or vehicle performances obtained under Earth s gravity may not necessarily be representative of those on extra-terrestrial bodies, because of the differences in gravity and in environmental conditions, such as atmospheric pressure, it is still a valid approach to use test data obtained under Earth s gravity to evaluate the predictive capability of the NWVPM and its potential applications to predicting wheel or wheeled rover performances on extra-terrestrial bodies. Results of this study show that, using the ratio (P20/W) of the drawbar pull to normal load at 20 per cent slip as a performance indicator, there is a reasonable correlation between the predictions and experimental data. This indicates that the NWVPM has the potential as an engineering tool for evaluating wheel candidates for a future generation of extra-terrestrial vehicles, provided that appropriate input data are available.

Wong, J. Y.↗

Evaluating the performance of a high resolution SLIM IM module integrated with an Agilent 6560 IM-QTOF MS - CRADA 413 (Final Report)

Developing new technologies that enhance our abilities to identify molecular signatures is important for the health of the public, the environment, and national security. Deploying these novel technologies requires multiple stages of validation and evaluation. This project focused on evaluating a technology developed at PNNL named Structures for Lossless Ion Manipulations (SLIM) in the context of a commercially available ion mobility mass spectrometer instrument from Agilent Technologies. There is a benefit to integrating the recently developed SLIM module into a real-world instrument platform. Data from the combined instrument will provide new standards for characterizing samples using ion mobility. These standards, related to both the drift time of ions and their resulting collisional cross sections (CCS) will be of value in characterizing samples from both humans and environmental samples, such as soil microbiomes. Because no previous instrument has been designed and implemented to simultaneously analyze the same sample in both constant and oscillating drift fields, the project will provide a new research capability that will support research in a wide variety of applications. The evaluation approach included measuring the resolving power, mass range, sensitivity, and accuracy of two SLIM variations (constant and oscillating fields). Although SLIM performed similarly to the commercial instrument in terms of sensitivity, mass range, and accuracy the resolving power of SLIM far exceeded that of the commercially-available instrument. This validation will provide critically useful data to our commercial partners which they can use to reach informed decisions on the advantages of the SLIM technology such as the outstanding performance and the low cost of manufacturing.

42 ENGINEERING↗