Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Evaluating performance of different generative adversarial networks for large-scale building power demand prediction

We report as an unsupervised-learning data-driven model, Generative Adversarial Networks (GANs) have recently attracted a lot of attention for various applications. There is potential to apply GANs for large-scale building power demand prediction, which is needed for power grid operation. However, there are many GAN variations and it is unclear which GAN is suitable for this application. To answer this question, this paper identifies five promising GANs (Original GAN, cGAN, SGAN, InfoGAN, and ACGAN) and evaluates their performance for predicting building power demand at a large scale. Physics-based building energy models are developed to generate training and reference data. A new evaluation indicator that combines accuracy and reproducibility is proposed to evaluate the performance of different GANs in predicting building power demand. The results show that SGAN and InfoGAN are not suitable because they cannot control the number of generated building samples for different building types. The prediction performance among the Original GAN, cGAN, and ACGAN can vary depending on training sample sizes and number of building types. If the training sample size is sufficiently large, Original GAN and cGAN can predict building power demand more accurately than ACGAN with the same number of samples. If training samples are limited, Original GAN provides better accuracy than cGAN and ACGAN. When the number of building types increase, the prediction accuracy increases for cGAN, decreases for ACGAN, and remains the same for Original GAN. As a result, cGAN and Original GAN are recommended for large-scale building power demand prediction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Thermal performance evaluation of the Solargenics solar collector at outdoor conditions

Test procedures used during the performance of an evaluation program are presented. The test program was conducted to obtain the following performance data and information on the solar collector. (1) thermal performance data under outdoor conditions; (2) structural behavior of collector under static conditions; (3) effects of long term exposure to material weathering elements. The solargenics is a liquid, single-glazed, flat plate collector. Approximate dimensions of each collector are 240 inches long, 36 inches wide, and 3.5 inches in depth.

Source record↗

Performance Evaluation of the NEXT Ion Engine

The performance test results of three NEXT ion engines are presented. These ion engines exhibited peak specific impulse and thrust efficiency ranges of 4060 4090 s and 0.68 0.69, respectively, at the full power point of the NEXT throttle table. The performance of the ion engines satisfied all project requirements. Beam flatness parameters were significantly improved over the NSTAR ion engine, which is expected to improve accelerator grid service life. The results of engine inlet pressure and temperature measurements are also presented. Maximum main plenum, cathode, and neutralizer pressures were 12,000 Pa, 3110 Pa, and 8540 Pa, respectively, at the full power point of the NEXT throttle table. Main plenum and cathode inlet pressures required about 6 hours to increase to steady-state, while the neutralizer required only about 0.5 hour. Steady-state engine operating temperature ranges throughout the power throttling range examined were 179 303 C for the discharge chamber magnet rings and 132 213 C for the ion optics mounting ring.

Soulas, George C.↗

Intermediate Scale Test Platform Conceptual Design and Hybrid Resin Performance Evaluation Recommendations

Recent laboratory evaluations demonstrated that further testing of alternative hybrid resins is warranted for their potential use as part of the 200 West Area (200W) pump-and-treat (P&T) remedy. 200W P&T has been treating technetium (Tc) since 2012 and uranium (U) since 2015 via two separate ion exchange (IX) treatment units: a single treatment train (i.e., a three-vessel system) for the removal of uranium utilizing a gel strong base anion (SBA) exchange resin, Dowex 21K; and two parallel treatment trains for the removal technetium using a gel SBA resin, Purolite® A532E. While these resins have been removing these contaminants effectively, new hybrid resins can provide additional benefits of further optimizing the IX treatment unit capacities and addressing additional treatment needs (e.g., Cr(VI)) by removing multiple contaminants simultaneously and/or through specific design configurations. Some of these resins also demonstrated some level of removal for I-129 which would be significant for expansion of the P&T into the 200 East Area. This document provides design recommendations for an intermediate scale test platform (ISTP) to evaluate alternative hybrid IX resin performance under conditions approaching field scale and using 200W P&T process groundwater. Results from the ISTP will provide the technical basis required to inform alternative IX resin selection in future 200W P&T facility operations where the treatment of multiple contaminants of concern may be required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

System-Level Performance Evaluation of ATD-1 Ground-Based Technologies

A series of large-scale human-in-the-loop simulations were conducted in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center to evaluate the system-level performance of NASA Air Traffic Management Technology Demonstration-1 (ATD-1) ground-based technologies. The ATD-1 ground-based technologies are the Traffic Management Advisor for Terminal Metering (TMA-TM) and Controller-Managed Spacing (CMS) tools. The simulations compared current operations to ATD-1 operations for peak-period arrivals to Phoenix Sky Harbor International Airport (PHX). Results indicate that controllers new to ATD-1 operations can increase the use of Performance-Based Navigation (PBN) in complex arrival flows without undue increases in workload.

Callantine, Todd J.↗

Performance evaluation of the JPL interim digital SAR processor

The performance of the Interim Digital SAR Processor (IDP) was evaluated. The IDP processor was originally developed for experimental processing of digital SEASAT SAR data. One phase of the system upgrade which features parallel processing in three peripheral array processors, automated estimation for Doppler parameters, and unsupervised image pixel location determination and registration was executed. The method to compensate for the target range curvature effect was improved. A four point interpolation scheme is implemented to replace the nearest neighbor scheme used in the original IDP. The processor still maintains its fast throughput speed. The current performance and capability of the processing modes now available on the IDP system are updated.

Wu, C.↗

Tissue-mimicking phantoms for performance evaluation of photoacoustic microscopy systems

Phantom-based performance test methods are critically needed to support development and clinical translation of emerging photoacoustic microscopy (PAM) devices. While phantoms have been recently developed for macroscopic photoacoustic imaging systems, there is an unmet need for well-characterized tissue-mimicking materials (TMMs) and phantoms suitable for evaluating PAM systems. Our objective was to develop and characterize a suitable dermis-mimicking TMM based on polyacrylamide hydrogels and demonstrate its utility for constructing image quality phantoms. TMM formulations were optically characterized over 400–1100 nm using integrating sphere spectrophotometry and acoustically characterized using a pulse through-transmission method over 8–24 MHz with highly confident extrapolation throughout the usable band of the PAM system. This TMM was used to construct a spatial resolution phantom containing gold nanoparticle point targets and a penetration depth phantom containing slanted tungsten filaments and blood-filled tubes. These phantoms were used to characterize performance of a custom-built PAM system. The TMM was found to be broadly tunable and specific formulations were identified to mimic human dermis at an optical wavelength of 570 nm and acoustic frequencies of 10–50 MHz. Imaging results showed that tungsten filaments yielded 1.1–4.2 times greater apparent maximum imaging depth than blood-filled tubes, which may overestimate real-world performance for vascular imaging applications. Nanoparticles were detectable only to depths of 120–200 µm, which may be due to the relatively weaker absorption of single nanoparticles vs. larger targets containing high concentration of hemoglobin. The developed TMMs and phantoms are useful tools to support PAM device characterization and optimization, streamline regulatory decision-making, and accelerate clinical translation.

Hsu, Hsun-Chia↗

Performance Evaluation of Particle Sampling Probes for Emission Measurements of Aircraft Jet Engines

Considerable attention has been recently received on the impact of aircraft-produced aerosols upon the global climate. Sampling particles directly from jet engines has been performed by different research groups in the U.S. and Europe. However, a large variation has been observed among published data on the conversion efficiency and emission indexes of jet engines. The variation results surely from the differences in test engine types, engine operation conditions, and environmental conditions. The other factor that could result in the observed variation is the performance of sampling probes used. Unfortunately, it is often neglected in the jet engine community. Particle losses during the sampling, transport, and dilution processes are often not discussed/considered in literatures. To address this issue, we evaluated the performance of one sampling probe by challenging it with monodisperse particles. A significant performance difference was observed on the sampling probe evaluated under different temperature conditions. Thermophoretic effect, nonisokinetic sampling and turbulence loss contribute to the loss of particles in sampling probes. The results of this study show that particle loss can be dramatic if the sampling probe is not well designed. Further, the result allows ones to recover the actual size distributions emitted from jet engines.

Lee, Poshin↗

Performance Evaluation of Low-Cost Condensers Immersed in the Water Tank of a Heat Pump Water Heater

This paper reports the effect of low-cost immersed condensers on the performance of a heat pump water heater (HPWH) that does not require a water-circulating pump. The proposed design is based on the immersion of an L-style condenser coil through an opening in the top of the water tank. The novel design aims to eliminate the need for the water-circulating pumps, thereby substantially improving efficiency and reducing costs and maintenance of the HPWH system. Comprehensive computational fluid dynamics (CFD) simulations and experimental tests were performed, and the results showed that the CFD simulations were close to the experimental data. Further results confirm that the L-style condenser can introduce buoyancy-driven flow and eliminate temperature stratification in the studied HPWH water tank, thereby improving the heat transfer coefficient and coefficient of performance of the HPWH. The testing results further showed that the L-style condenser enabled more than 53% higher coefficient of performance and 400% higher heat transfer coefficient compared with the straight vertical condenser, and achieved much faster water heating. Furthermore, the effects of immersed condensers with different circuits on the HPWH performance were evaluated and compared. All results indicate that the current energy-saving and inexpensive HPWH technology is technically valid, and the benefits of performance improvement and low cost are attractive in future HPWH design.

Gao, Zhiming [ORNL] (ORCID:0000000271397995)↗

Outdoor test for thermal performance evaluation of the Owens-Illinois Sunpack SEC-601 (air) solar collector

The test procedures used and the test results obtained during the performance of an evaluation test program on the Owens-Illinois Sunpak, model SEC-601, air solar collector under natural outdoor weather conditions are presented. All testing activities were performed on a single module. The test was performed and the data evaluated as applicable to outdoor testing of solar collectors.

Source record↗

An Application-Based Performance Evaluation of NASAs Nebula Cloud Computing Platform

The high performance computing (HPC) community has shown tremendous interest in exploring cloud computing as it promises high potential. In this paper, we examine the feasibility, performance, and scalability of production quality scientific and engineering applications of interest to NASA on NASA's cloud computing platform, called Nebula, hosted at Ames Research Center. This work represents the comprehensive evaluation of Nebula using NUTTCP, HPCC, NPB, I/O, and MPI function benchmarks as well as four applications representative of the NASA HPC workload. Specifically, we compare Nebula performance on some of these benchmarks and applications to that of NASA s Pleiades supercomputer, a traditional HPC system. We also investigate the impact of virtIO and jumbo frames on interconnect performance. Overall results indicate that on Nebula (i) virtIO and jumbo frames improve network bandwidth by a factor of 5x, (ii) there is a significant virtualization layer overhead of about 10% to 25%, (iii) write performance is lower by a factor of 25x, (iv) latency for short MPI messages is very high, and (v) overall performance is 15% to 48% lower than that on Pleiades for NASA HPC applications. We also comment on the usability of the cloud platform.

Saini, Subhash↗

Performance Evaluation of Adaptive Routing on Dragonfly-based Production Systems

Performance of applications in production environments can he sensitive to network congestion. Cray Aries supports adaptively routing each network packet independently based on the load or congestion encountered as a packet traverses the network. Software can dictate different routing policies, adjusting between minimal and non-minimal bias, for each posted message. We have extensively evaluated the sensitivity of the routing bias selection on application performance as well as whole system performance in both production and controlled conditions. We show that the default routing bias used in Aries-based systems is often sub-optimal and that using a higher bias towards minimal routes will not only reduce the congestion effects on the application but also will decrease the overall congestion on the network. This routing scheme results in not only improved mean performance (by up to 12%) of most production applications hut also reduced run-to-run variability. Our study prompted the two supercomputing facilities (ALCF and NERSC) to change the default routing mode on their Aries-based systems. We present the substantial improvement measured in the overall congestion management and interconnect performance in production after making this change.

Chunduri, Sudheer↗

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗

Space Shuttle UHF Communications Performance Evaluation

An extension boom is to be installed on the starboard side of the Space Shuttle Orbiter (SSO) payload bay for thermal tile inspection and repairing. As a result, the Space Shuttle payload bay Ultra High Frequency (UHF) antenna will be under the boom. This study is to evaluate the Space Shuttle UHF communication performance for antenna at a suitable new location. To insure the RF coverage performance at proposed new locations, the link margin between the UHF payload bay antenna and Extravehicular Activity (EVA) Astronauts at a range distance of 160 meters from the payload bay antenna was analyzed. The communication performance between Space Shuttle Orbiter and International Space Station (SSO-ISS) during rendezvous was also investigated. The multipath effects from payload bay structures surrounding the payload bay antenna were analyzed. The computer simulation tool based on the Geometrical Theory of Diffraction method (GTD) was used to compute the signal strengths. The total field strength was obtained by summing the direct fields from the antennas and the reflected and diffracted fields from the surrounding structures. The computed signal strengths were compared to the signal strength corresponding to the 0 dB link margin. Based on the results obtained in this study, RF coverage for SSO-EVA and SSO- ISS communication links was determined for the proposed payload bay antenna UHF locations. The RF radiation to the Orbiter Docking System (ODS) pyros, the payload bay avionics, and the Shuttle Remote Manipulator System (SRMS) from the new proposed UHF antenna location was also investigated to ensure the EMC/EMI compliances.

Hwu, Shian U.↗

Survey and Assessment of Crew Performance Evaluation Methods Applicable to Human Spacecraft Design

Space is an unforgiving environment where the actions of the crew play a critical role in their health and safety. Given the limited number of crewmembers typically onboard a spacecraft and the multitude of complex systems they must operate, the performance of each individual is of paramount importance. Spacecraft habitat layout and operations are two main drivers affecting crew performance efficiency. Having the capability to analyze and compare crew performance across various spacecraft configurations can help identify improvements early in the conceptual design process where changes are less costly to implement, ultimately reducing overall project costs and improving long-term operations of the system. Currently, there are few comprehensive methods readily available for evaluating crew integration within a spacecraft in the conceptual design phase. In order to address this shortcoming, the goal of this work was to analyze various specialized evaluation methods found in analogous industries that have potential application to human spacecraft design. A survey of more than 400 human performance evaluation methods was completed. Over twenty different attributes were identified for each method and a variety of analyses were conducted to characterize and evaluate their potential use for assessing human spacecraft design options. The analysis revealed a particular deficiency of quantitative evaluation methods that are applicable early in the systems engineering design phase. It also identified five existing methods that could be supplemented to achieve the needs of an early design evaluation method. Additional discussion describes potential issues that must be overcome when developing a method specific for use in human spacecraft evaluations.

crew performance↗