Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

French Modular Impoundment: Final Cost and Performance Evaluation

This report comprises the Final Cost and Performance Report for the Department of Energy Award # EE0007244, the French Modular Impoundment (aka the “French Dam”.) The French Dam is a system of applying precast modular construction to water control structures. The “French Dam” is a term used to cover the construction means/methods used to construct or rehabilitate dams, diversion structures, powerhouses, and other hydraulic structures which impound water and are covered under FDE’s existing IP (Patents # US8414223B2; US9103084B2.)

13 HYDRO ENERGY↗
DOE OSTI2014

SU-D-BRD-01: Cloud-Based Radiation Treatment Planning: Performance Evaluation of Dose Calculation and Plan Optimization

Purpose: To report the first experience on the development of a cloud-based treatment planning system and investigate the performance improvement of dose calculation and treatment plan optimization of the cloud computing platform. Methods: A cloud computing-based radiation treatment planning system (cc-TPS) was developed for clinical treatment planning. Three de-identified clinical head and neck, lung, and prostate cases were used to evaluate the cloud computing platform. The de-identified clinical data were encrypted with 256-bit Advanced Encryption Standard (AES) algorithm. VMAT and IMRT plans were generated for the three de-identified clinical cases to determine the quality of the treatment plans and computational efficiency. All plans generated from the cc-TPS were compared to those obtained with the PC-based TPS (pc-TPS). The performance evaluation of the cc-TPS was quantified as the speedup factors for Monte Carlo (MC) dose calculations and large-scale plan optimizations, as well as the performance ratios (PRs) of the amount of performance improvement compared to the pc-TPS. Results: Speedup factors were improved up to 14.0-fold dependent on the clinical cases and plan types. The computation times for VMAT and IMRT plans with the cc-TPS were reduced by 91.1% and 89.4%, respectively, on average of the clinical cases compared to those with pc-TPS. The PRs were mostly better for VMAT plans (1.0 ≤ PRs ≤ 10.6 for the head and neck case, 1.2 ≤ PRs ≤ 13.3 for lung case, and 1.0 ≤ PRs ≤ 10.3 for prostate cancer cases) than for IMRT plans. The isodose curves of plans on both cc-TPS and pc-TPS were identical for each of the clinical cases. Conclusion: A cloud-based treatment planning has been setup and our results demonstrate the computation efficiency of treatment planning with the cc-TPS can be dramatically improved while maintaining the same plan quality to that obtained with the pc-TPS. This work was supported in part by the National Cancer Institute (1R01 CA133474) and by Leading Foreign Research Institute Recruitment Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (MSIP) (Grant No.2009-00420)

60 APPLIED LIFE SCIENCES↗
NASA NTRS2012

An Application-Based Performance Evaluation of NASAs Nebula Cloud Computing Platform

The high performance computing (HPC) community has shown tremendous interest in exploring cloud computing as it promises high potential. In this paper, we examine the feasibility, performance, and scalability of production quality scientific and engineering applications of interest to NASA on NASA's cloud computing platform, called Nebula, hosted at Ames Research Center. This work represents the comprehensive evaluation of Nebula using NUTTCP, HPCC, NPB, I/O, and MPI function benchmarks as well as four applications representative of the NASA HPC workload. Specifically, we compare Nebula performance on some of these benchmarks and applications to that of NASA s Pleiades supercomputer, a traditional HPC system. We also investigate the impact of virtIO and jumbo frames on interconnect performance. Overall results indicate that on Nebula (i) virtIO and jumbo frames improve network bandwidth by a factor of 5x, (ii) there is a significant virtualization layer overhead of about 10% to 25%, (iii) write performance is lower by a factor of 25x, (iv) latency for short MPI messages is very high, and (v) overall performance is 15% to 48% lower than that on Pleiades for NASA HPC applications. We also comment on the usability of the cloud platform.

Saini, Subhash↗
DOE OSTI2021

Performance Evaluation of Adaptive Routing on Dragonfly-based Production Systems

Performance of applications in production environments can he sensitive to network congestion. Cray Aries supports adaptively routing each network packet independently based on the load or congestion encountered as a packet traverses the network. Software can dictate different routing policies, adjusting between minimal and non-minimal bias, for each posted message. We have extensively evaluated the sensitivity of the routing bias selection on application performance as well as whole system performance in both production and controlled conditions. We show that the default routing bias used in Aries-based systems is often sub-optimal and that using a higher bias towards minimal routes will not only reduce the congestion effects on the application but also will decrease the overall congestion on the network. This routing scheme results in not only improved mean performance (by up to 12%) of most production applications hut also reduced run-to-run variability. Our study prompted the two supercomputing facilities (ALCF and NERSC) to change the default routing mode on their Aries-based systems. We present the substantial improvement measured in the overall congestion management and interconnect performance in production after making this change.

Chunduri, Sudheer↗
DOE OSTI2024

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗
DOE OSTI2016

Synthesis and Performance Evaluations of SAPO-34 Membranes- Milestone Report for FCRD-MRWFD-2016-000263

This report describes the synthesis and evaluation of molecular sieve zeolite membranes to separate and concentrate tritiated water (HTO) from dilute HTO-bearing aqueous streams. Several silico alumino phosphate (SAPO-34) molecular sieve zeolite membranes were synthesized on tubular supports and characterized with gas and vapor permeation measurements. The pervaporation process performance was evaluated for the separation and concentration of tritiated water. Experiments were performed over a range of tritiated water concentration that correspond to the range anticipated in a nuclear fuel processing system that includes both acid and water streams recycling. The permeate was recovered under vacuum. The tritium concentration ranged from 0.5 to 1 mCi/mL which is about 0.1 mg/L or 0.1 ppm. The separation factors calculated from the measured tritium concentrations ranged from 0.83-0.98. The HTO concentration was three orders of magnitude lower than prior experiments performed with simulated feed containing HDO (>100 ppm) using deuterated water where high separation factors (>10) were obtained using SAPO membranes on alumina disk supports. Although the membrane performance characterization results for HTO were lower than expected, they can be explained on the basis of low feed volume and three orders of magnitude lower HTO concentration compared to HDO concentration in deuterated water. Several new approaches are proposed, such as tuning the diffusion coefficient of HTO, and optimization of membrane thickness that may help achieve preferential transport of tritium (HTO) resulting in a substantially more concentrated permeate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

Performance Evaluation of Darshan 3.0.0 on the Cray XC30

Abstract—Darshan is a lightweight I/O characterization tool used to gather and summarize salient I/O workload statistics from HPC applications. Darshan was designed to minimize any possible perturbations of an application’s performance, leading it to be enabled by default on a number of production HPC systems. For each file accessed by a given application, Darshan records the count and types of I/O operations performed, histograms of access sizes, cumulative timers on the amount of time spent doing I/O, and other statistical data. This type of data has proved invaluable in understanding and improving the I/O performance of HPC applications. Darshan 3.0.0 is the new modularized version of the traditional Darshan library and file format, allowing users to easily add more in-depth I/O characterization data to Darshan logs. In this work we perform an empirical evaluation of Darshan 3.0.0 to ensure that it continues to meet performance expectations for broad deployment. In particular, we evaluate the imposed overhead on instrumented I/O operations, time taken to shut down and generate corresponding Darshan log files, and resultant log file sizes for different workloads. These performance results are compared to results of Darshan 2.3.0 on the Edison XC30 system at NERSC to determine whether the new version is lightweight enough to run full-time on production HPC systems. Our evaluation shows that Darshan has limited impact on application I/O performance and can fully generate a corresponding log file for most application workloads in under two seconds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Performance Evaluation of the CHKED Multi-Elemental Analysis and Software

The Hybrid K-edge Densitometer (HKED) is a high precision safeguards assay system developed by Ottmar and Eberle [1] for quantification of the U and Pu concentrations of dissolver solutions in spent nuclear fuel reprocessing. The HKED measurement supplements traditional destructive assay methods such as Isotope Dilution Mass Spectrometry (IDMS) and is an essential component of the international safeguards program implementation at these facilities. The Canberra Hybrid K-Edge Densitometry (CHKED) software was recently developed by Canberra Industries to better address the changing composition of the nuclear fuel cycle by addition of a multi-elemental analysis capability to the K-Edge transmission measurement. Our evaluation of the CHKED software was performed at the request of the International Atomic Energy Agency (IAEA) to examine the functionality and performance of the CHKED software and algorithms and identify potential areas for improvement of the software. The reader is assumed to be familiar with the HKED technique and its current implementation in safeguards assay of U and Pu in the nuclear fuel cycle. The Canberra Hybrid K-Edge Densitometry CHKED software replicates functionality of the older VMSbased Hybrid K-Edge Densitometer (HKED) software and incorporates additional analysis algorithms and tools. When the traditional HKED analyses are selected, the CHKED software appears to faithfully reproduce the measurement results as reported by the older software. The CHKED software includes a Multi-elemental K-Edge (MEKED) analysis based in part on algorithms devised at Los Alamos National Laboratory. In principle, the MEKED analysis represents a significant advancement over the traditional HKED analysis, providing a capability to analyze the actinide concentrations from complex solutions, such as low U:Pu ratios (e.g., U:Pu = 1:1) including additional minor actinide components such as Np and Am. However, this MEKED analysis is somewhat limited by reliance on a region of interest (ROI) analysis of the spectrum, the need for extensive calibration measurements and a simplistic interpretation of the KED transmission spectrum. Finally, the MEKED algorithm set associated with the CHKED software (V1.0) acquired by Oak Ridge National Laboratory (ORNL) from Canberra Industries does not seem to be “finished” (e.g., the MEKED analysis seems to only determine measurement results for two actinides with while results for the minor actinides appear to be highly dependent on declaration values).

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
NASA NTRS2004

Space Shuttle UHF Communications Performance Evaluation

An extension boom is to be installed on the starboard side of the Space Shuttle Orbiter (SSO) payload bay for thermal tile inspection and repairing. As a result, the Space Shuttle payload bay Ultra High Frequency (UHF) antenna will be under the boom. This study is to evaluate the Space Shuttle UHF communication performance for antenna at a suitable new location. To insure the RF coverage performance at proposed new locations, the link margin between the UHF payload bay antenna and Extravehicular Activity (EVA) Astronauts at a range distance of 160 meters from the payload bay antenna was analyzed. The communication performance between Space Shuttle Orbiter and International Space Station (SSO-ISS) during rendezvous was also investigated. The multipath effects from payload bay structures surrounding the payload bay antenna were analyzed. The computer simulation tool based on the Geometrical Theory of Diffraction method (GTD) was used to compute the signal strengths. The total field strength was obtained by summing the direct fields from the antennas and the reflected and diffracted fields from the surrounding structures. The computed signal strengths were compared to the signal strength corresponding to the 0 dB link margin. Based on the results obtained in this study, RF coverage for SSO-EVA and SSO- ISS communication links was determined for the proposed payload bay antenna UHF locations. The RF radiation to the Orbiter Docking System (ODS) pyros, the payload bay avionics, and the Shuttle Remote Manipulator System (SRMS) from the new proposed UHF antenna location was also investigated to ensure the EMC/EMI compliances.

Hwu, Shian U.↗
NASA NTRS2015

Survey and Assessment of Crew Performance Evaluation Methods Applicable to Human Spacecraft Design

Space is an unforgiving environment where the actions of the crew play a critical role in their health and safety. Given the limited number of crewmembers typically onboard a spacecraft and the multitude of complex systems they must operate, the performance of each individual is of paramount importance. Spacecraft habitat layout and operations are two main drivers affecting crew performance efficiency. Having the capability to analyze and compare crew performance across various spacecraft configurations can help identify improvements early in the conceptual design process where changes are less costly to implement, ultimately reducing overall project costs and improving long-term operations of the system. Currently, there are few comprehensive methods readily available for evaluating crew integration within a spacecraft in the conceptual design phase. In order to address this shortcoming, the goal of this work was to analyze various specialized evaluation methods found in analogous industries that have potential application to human spacecraft design. A survey of more than 400 human performance evaluation methods was completed. Over twenty different attributes were identified for each method and a variety of analyses were conducted to characterize and evaluate their potential use for assessing human spacecraft design options. The analysis revealed a particular deficiency of quantitative evaluation methods that are applicable early in the systems engineering design phase. It also identified five existing methods that could be supplemented to achieve the needs of an early design evaluation method. Additional discussion describes potential issues that must be overcome when developing a method specific for use in human spacecraft evaluations.

crew performance↗
DOE OSTI2024

Performance evaluation of finned tube heat exchanger using curved wavy delta winglet vortex generators with circular perforations

Vortex generation is recognized as an effective passive approach to improve the heat transfer rate in fin and tube heat exchangers (FTHEs). The current study proposed innovative designs of curved wavy delta winglet vortex generators (CWDWVGs), both without and with circular perforations, to improve the heat transfer efficiency of FTHEs. There is potential to increase heat transfer performance further through various CWDWVG designs. Here, this study explores seven unique CWDWVG configurations, from 1-wave to 7-wave. A 3-D computational numerical model is utilized to evaluate the Thermo-hydraulic performance of FTHEs fitted with these different CWDWVG configurations across Reynolds numbers from 400 to 2000. This comparative analysis of the Thermo-hydraulic performance of FTHEs featuring four parallel circular tube layouts assesses configurations both with and without vortex generators (VGs) and various hole configurations. The evaluation of Thermo-hydraulic performance involves different parameters, including the London area goodness factor (LAGF), Colburn factor (j), friction factor (f), pressure drop (?P), and Nusselt number (Nu). Results demonstrate that the various CWDWVG configurations and the number of holes in them substantially affect the efficiency, as evaluated by the dimensionless Performance Evaluation Criteria (PEC). Notably, the 7-wave CWDWVGs surpassed other configurations, and integrating circular punched perforations further improved the thermal-hydraulic performance of FTHE. Specifically, the 7-wave CWDWVGs without holes demonstrated superior performance over other configurations, showing a significant increase in Nusselt number by 75.18% and 85.16% at Reynolds numbers of 2000 and 400, respectively, alongside an increase in pressure drop by 216.38% to 224.96%. Meanwhile, the 7-wave CWDWVGs with eight holes, in comparison to those without holes, exhibited a Nusselt number increase of 0.85%, a pressure drop decrease of 7.31%, and a reduction in the friction factor by 5.82%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2016

Evaluating performance of two-group interfacial area transport equation for vertical small and large diameter pipes

In the two-fluid transport model, the coupling of mass, momentum and energy transfer between phases is highly dependent on interfacial area transfer terms. Several research efforts in the past have been focused on the development of an interfacial area transport equation model (IATE), in order to eliminate the drawbacks of static flow regime maps currently used in best-estimate thermal-hydraulic system codes. The IATE attempts to model the dynamics that are involved in two phase flows by accounting for the different interaction mechanisms affecting bubble transport in the flow. The further development and validation of IATE models has been hindered by the lack of adequate experimental data in regions beyond the bubbly flow regime. At the Helmholtz-Zentrum Dresden-Rossendorf (HZDR) experiments utilizing wire mesh sensors have been performed over all flow regimes, establishing a database of high-resolution (in space and time) data. Two sets of data from small and large diameter pipes fitted with wire mesh sensors is utilized in this work. Analysis of flow conditions in the bubbly, churn turbulent and annular flow regimes is presented. The performance of the Fu-Ishii two-group model is evaluated against small diameter database. Results indicate good performance (< 10% error) for small group 1 bubbles, and poor performance for large group 2 bubbles. The Smith two-group large diameter IATE model is evaluated for the large diameter database. In low void-fraction regimes, the Smith model performs well. In high void-fraction regimes, there is poor group-wise interfacial area prediction - however the total interfacial area is erroneously predicted well as group-wise errors compensate each other. Overall, the study suggests that further efforts and re-evaluation of closure terms are needed in order to extend the range of validity of the IATE models. (authors)

42 ENGINEERING↗
NASA NTRS1996

Performance Evaluation of Communication Software Systems for Distributed Computing

In recent years there has been an increasing interest in object-oriented distributed computing since it is better quipped to deal with complex systems while providing extensibility, maintainability, and reusability. At the same time, several new high-speed network technologies have emerged for local and wide area networks. However, the performance of networking software is not improving as fast as the networking hardware and the workstation microprocessors. This paper gives an overview and evaluates the performance of the Common Object Request Broker Architecture (CORBA) standard in a distributed computing environment at NASA Ames Research Center. The environment consists of two testbeds of SGI workstations connected by four networks: Ethernet, FDDI, HiPPI, and ATM. The performance results for three communication software systems are presented, analyzed and compared. These systems are: BSD socket programming interface, IONA's Orbix, an implementation of the CORBA specification, and the PVM message passing library. The results show that high-level communication interfaces, such as CORBA and PVM, can achieve reasonable performance under certain conditions.

Fatoohi, Rod↗