Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Using Computational Storage Devices: OpenMP/MPI and Charliecloud [Slides]

Originally used Spark and HadoopFS. Collected interesting results, but this method had its issues: limited application, too much overhead to gauge CSDs’ raw performance. Solution? Rewrite our benchmarks without Spark using Serial Python and Serial & Parallel C++ (Combinations of OpenMP & OpenMPI). Compared to Spark and Python, C++ implementation is a lot faster. Caveat: an expert with Spark or Python would likely be able to improve the performance of those implementations. Computational power of our CSDs seem to be much lower than the host machine. Using all 4 cores of a single CSD, the job takes ~6.8x longer than using just one core on the host machine. Host also seems to scale better with increasing file size. Resulting Question: When, if ever, would it make sense to use CSDs for compute rather than a much-faster host?

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Robust LQR control for the benchmark problem

An examination is made of the performance of a linear quadratic regulator which is robust to parametric uncertainty. The controller, which feeds back all states, is based upon Petersen's approach. Simulations show, using the benchmark problem, that remarkable performance robustness can be achieved.

Douglas, Joel↗
DOE OSTI2021

Battle of the Defaults: Extracting Performance Characteristics of HDF5 under Production Load

Popular parallel I/O libraries, such as HDF5, provide tuning parameters to obtain superior performance. However, the selection of effective parameters on production systems is complex due to the interdependence of I/O software and file system layers. Hence, application developers typically use the default parameters and often experience poor I/O performance. This work conducts a benchmarking-based analysis on the HDF5 behaviors with a wide variety of I/O patterns to extract performance characteristics under the production workload. To make the analysis well controlled, we exercise I/O benchmarks on POSIX-IO, MPI-IO, and HDF5 using the same I/O patterns and in the same jobs. To address high performance variability in production environments, we repeat the benchmarks across I/O patterns, storage devices, and time intervals. Based on the results, we identified consistent HDF5 behaviors that appropriate configurations and operations on dataset layout and file-metadata placement can improve performance significantly. We apply our findings and evaluate the tuned I/O library on two supercomputers: Summit and Cori. The results show that our tuned parameters can achieve more than 10× I/O performance speedup than that with default parameters on both systems, suggesting the effectiveness, stability, and generality of our solution.

Xie, Bing↗
DOE OSTI2022

..beta..-Ketoadipic Acid Production in P. putida for Performance-Advantaged Nylons

Biomass derived chemicals can possess extended functionality, often in the form of heteroatoms like oxygen and nitrogen, that can enable performance advantaged properties in emergent materials. One illustrative example of this concept is ..beta..-ketoadipic acid (..beta..KA), a C6 dicarboxylic acid with a ketone in its backbone. ..beta..KA can be obtained via biological cultivation from aromatic compounds, sugars, and even waste plastics. When ..beta..KA is implemented into polymers, namely nylons, in place of adipic acid the overall material properties are increased. Specifically, the glass transition temperature (which is the measurement at which temperature a plastic softens) is increased by 69 degrees C and the water permeability is reduced by 20%. Molecular dynamic (MD) simulations reveal that the ..beta..-ketone in ..beta..KA leads to restricted movement across multiple backbone carbons when compared to adipic acid. Furthermore, MD simulations reveal that the ..beta..-ketone, when compared to no-ketone or an a-ketone, can lead to an increase in hydrogen bonding between neighboring chains. Both phenomena may help explain the molecular origin of the increases in polymer performance. Aside from performance advantages in thermomechanical performance, the production of ..beta..KA also is advantaged in its manufacturing. Although estimates for the minimum selling price (MSP) of ..beta..KA exceed adipic acid the manufacture of ..beta..KA would reduce supply chain energy and GHG emissions by >50% and >30% respectively. Further TEA analysis reveals that the MSP of ..beta..KA is primarily driven by the feedstock cost while the capital expenditures are driven largely by fermentation costs. Overall, the work presented within will be illustrative of how biomass derived molecules, namely ..beta..KA, can manifest performance advantages across multiple benchmarks and may enable a path to market for biomass-derived materials.

beta-ketoadipic acid↗
NASA NTRS1995

NAS Parallel Benchmarks Results

The NAS Parallel Benchmarks (NPB) were developed in 1991 at NASA Ames Research Center to study the performance of parallel supercomputers. The eight benchmark problems are specified in a pencil and paper fashion i.e. the complete details of the problem to be solved are given in a technical document, and except for a few restrictions, benchmarkers are free to select the language constructs and implementation techniques best suited for a particular system. In this paper, we present new NPB performance results for the following systems: (a) Parallel-Vector Processors: Cray C90, Cray T'90 and Fujitsu VPP500; (b) Highly Parallel Processors: Cray T3D, IBM SP2 and IBM SP-TN2 (Thin Nodes 2); (c) Symmetric Multiprocessing Processors: Convex Exemplar SPP1000, Cray J90, DEC Alpha Server 8400 5/300, and SGI Power Challenge XL. We also present sustained performance per dollar for Class B LU, SP and BT benchmarks. We also mention NAS future plans of NPB.

Subhash, Saini↗
NASA NTRS1995

NAS Parallel Benchmarks Results 3-95

The NAS Parallel Benchmarks (NPB) were developed in 1991 at NASA Ames Research Center to study the performance of parallel supercomputers. The eight benchmark problems are specified in a "pencil and paper" fashion, i.e., the complete details of the problem are given in a NAS technical document. Except for a few restrictions, benchmark implementors are free to select the language constructs and implementation techniques best suited for a particular system. In this paper, we present new NPB performance results for the following systems: (a) Parallel-Vector Processors: CRAY C90, CRAY T90 and Fujitsu VPP500; (b) Highly Parallel Processors: CRAY T3D, IBM SP2-WN (Wide Nodes), and IBM SP2-TN2 (Thin Nodes 2); and (c) Symmetric Multiprocessors: Convex Exemplar SPPIOOO, CRAY J90, DEC Alpha Server 8400 5/300, and SGI Power Challenge XL (75 MHz). We also present sustained performance per dollar for Class B LU, SP and BT benchmarks. We also mention future NAS plans for the NPB.

Saini, Subhash↗
DOE OSTI2020

Characterizing Output Bottlenecks of a Production Supercomputer: Analysis and Implications

This article studies the I/O write behaviors of the Titan supercomputer and its Lustre parallel file stores under production load. The results can inform the design, deployment, and configuration of file systems along with the design of I/O software in the application, operating system, and adaptive I/O libraries.We propose a statistical benchmarking methodology to measure write performance across I/O configurations, hardware settings, and system conditions. Moreover, we introduce two relative measures to quantify the write-performance behaviors of hardware components under production load. In addition to designing experiments and benchmarking on Titan, we verify the experimental results on one real application and one real application I/O kernel, XGC and HACC IO, respectively. These two are representative and widely used to address the typical I/O behaviors of applications.In summary, we find that Titan’s I/O system is variable across the machine at fine time scales. This variability has two major implications. First, stragglers lessen the benefit of coupled I/O parallelism (striping). Peak median output bandwidths are obtained with parallel writes to many independent files, with no striping or write sharing of files across clients (compute nodes). I/O parallelism is most effective when the application—or its I/O libraries—distributes the I/O load so that each target stores files for multiple clients and each client writes files on multiple targets in a balanced way with minimal contention. Second, our results suggest that the potential benefit of dynamic adaptation is limited. In particular, it is not fruitful to attempt to identify “good locations” in the machine or in the file system: component performance is driven by transient load conditions and past performance is not a useful predictor of future performance. For example, we do not observe diurnal load patterns that are predictable.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Shielding Benchmark Comparison - MCNP6.2

This report documents the calculations performed for a shielding code comparison between various Department of Energy (DOE) sites. These shielding calculations were performed using an experiment drawn from the International Handbook of Evaluated Criticality Safety Benchmark Experiments, published by the Organisation for Economic Cooperation and Development/Nuclear Energy Agency (OECD/NEA). The benchmark selected for comparison is ALARM-CF-AIR-LAB-001 (“Neutron Fields in the Three-Section Concrete Labyrinth from Cf-252 Source, Benchmark ALARM CF AIR LAB-001”). The Y-12 submission for this code comparison was performed with Monte Carlo N Particle (MCNP) Transport Code System, Version 6.2 and Automated Variance Reduction Generator (ADVANTG).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2002

Implementation of the NAS Parallel Benchmarks in Java

Several features make Java an attractive choice for High Performance Computing (HPC). In order to gauge the applicability of Java to Computational Fluid Dynamics (CFD), we have implemented the NAS (NASA Advanced Supercomputing) Parallel Benchmarks in Java. The performance and scalability of the benchmarks point out the areas where improvement in Java compiler technology and in Java thread implementation would position Java closer to Fortran in the competition for CFD applications.

Frumkin, Michael A.↗
NASA NTRS2023

Observational Constraints Reduce Model Spread but Not Uncertainty in Global Wetland Methane Emission Estimates

The recent rise in atmospheric methane (CH 4 ) concentrations accelerates climate change and offsets mitigation efforts. Although wetlands are the largest natural CH 4 source, estimates of global wetland CH 4 emissions vary widely among approaches taken by bottom-up (BU) process-based biogeochemical models and top-down (TD) atmospheric inversion methods. Here, we integrate in situ measurements, multi-model ensembles, and a machine learning upscaling product into the International Land Model Benchmarking system to examine the relationship between wetland CH 4 emission estimates and model performance. We find that using better-performing models identified by observational constraints reduces the spread of wetland CH 4 emission estimates by 62% and 39% for BU- and TD-based approaches, respectively. However, global BU and TD CH 4 emission estimate discrepancies increased by about 15% (from 31 to 36 TgCH 4 year −1 ) when the top 20% models were used, although we consider this result moderately uncertain given the unevenly distributed global observations. Our analyses demonstrate that model performance ranking is subject to benchmark selection due to large inter-site variability, highlighting the importance of expanding coverage of benchmark sites to diverse environmental conditions. We encourage future development of wetland CH 4 models to move beyond static benchmarking and focus on evaluating site-specific and ecosystem-specific variabilities inferred from observations.

Kuang-Yu Chang↗
DOE OSTI2023

TransPolymer: a Transformer-based language model for polymer property predictions

Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer models, equipped with self-attention mechanisms, have exhibited superior performance in natural language processing. However, such methods have not been investigated in polymer sciences. Herein, we report TransPolymer, a Transformer-based language model for polymer property prediction. Our proposed polymer tokenizer with chemical awareness enables learning representations from polymer sequences. Rigorous experiments on ten polymer property prediction benchmarks demonstrate the superior performance of TransPolymer. Moreover, we show that TransPolymer benefits from pretraining on large unlabeled dataset via Masked Language Modeling. Experimental results further manifest the important role of self-attention in modeling polymer sequences. We highlight this model as a promising computational tool for promoting rational polymer design and understanding structure-property relationships from a data science view.

36 MATERIALS SCIENCE↗
NASA NTRS1998

Charon Message-Passing Toolkit for Scientific Computations

The Charon toolkit for piecemeal development of high-efficiency parallel programs for scientific computing is described. The portable toolkit, callable from C and Fortran, provides flexible domain decompositions and high-level distributed constructs for easy translation of serial legacy code or design to distributed environments. Gradual tuning can subsequently be applied to obtain high performance, possibly by using explicit message passing. Charon also features general structured communications that support stencil-based computations with complex recurrences. Through the separation of partitioning and distribution, the toolkit can also be used for blocking of uni-processor code, and for debugging of parallel algorithms on serial machines. An elaborate review of recent parallelization aids is presented to highlight the need for a toolkit like Charon. Some performance results of parallelizing the NAS Parallel Benchmark SP program using Charon are given, showing good scalability. Some performance results of parallelizing the NAS Parallel Benchmark SP program using Charon are given, showing good scalability.

VanderWijngarrt, Rob F.↗
DOE OSTI2025

System Engineers and Decisions: It?s All about Knowledge

In order to guarantee that a system meets adequate levels of reliability and availability, system performances are continuously monitored and analyzed thanks to the technological advancements driving the Industry 4.0 revolution. An Industry 4.0 approach is typically based on advanced statistical, big data mining, machine learning, and internet-of-things methods designed to detect anomalies in the behavior of system, detect the most likely failure modes, and provide indications to system engineers on when maintenance activities should be performed before system performance are deemed unacceptable (which can be generated by diagnostic and prognostic methods). However, these analyses, which are designed to automatize and increase the efficacy of the system maintenance program, require large amount of data which can come in various forms: numeric, textual, images, sounds etc. Such data constitutes the historic knowledge benchmark to track system performances and support system engineer decisions. Here we claim that data is not sufficient to support this kind of analyses when applied to systems characterized by complex architectures and behaviors. Robust system engineer decisions require the ability to understand the system operational context that lies behind the observed data elements. In this respect, system models are in fact necessary to “put data in context” and capture relationships between data elements. Industry 4.0 methods require in fact contextual knowledge as a basis upon which hypotheses can be generated and assumptions tested. In our view, for complex systems, model-based system engineering (MBSE) models can afford this contextual knowledge, as they are typically used to describe systems architecture and dynamic behaviors. System knowledge is here intended as the blending of collected data and system architecture which takes the form of a “knowledge graph”. A knowledge graph is a database which consists of a large set of nodes (in our case an entity can be either a data or an MBSE element) which are linked to each other. The types of nodes and links follow a pre-defined topology, sometimes also refers as an ontology, that is designed to fit the actual decisions that needs to be performed. We show here how a knowledge graph can be defined to support system engineer maintenance decisions and how the same graph can be built based on system MBSE models and pre-processed data from numeric (through anomaly detections and diagnostic methods) and textual elements (through technical language processing TLP).

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Techno-Economic Implications of Electrical Machine Scaling for Wave Energy Converters

The sizing of an electrical machine for a Wave Energy Converter (WEC) can have a substantial impact on the overall sizing, cost, and rating of the device. An electrical generator is typically part of the power take-off system, which is the mechanism by which the energy absorbed by the prime mover is transformed into usable electrical energy. For practically all WECs, the rate of change of actuation is predominantly determined by the wave resource (i.e., the wave height and frequency), and devices will see a sinusoidal varying velocity according to the wave conditions. The same can then be said for both directly and indirectly coupled power take-offs with electrical generators. This techno-economic study investigates electrical machine scaling and associated cost implications through core machine design theory, manufacturer data, supporting literature, and the Reference Model Project sponsored by the U.S. Department of Energy. The Reference Model Project was a partnered effort to develop open-source marine energy point designs as reference models to benchmark marine energy technology performance and costs, methods for design and analysis of marine energy technologies, estimations for capital costs, operational costs, and levelized cost of energy. The results from this study show torque is directly related to (1) the physical size of the machine required to increase the air-gap sheer stresses, (2)the amount of active material, (3) the support structure, (4) bearing size and rating, and (5) offshore cable rating, all of which have a significant effect on overall system costs in terms of both capital and operational expenditures. This paper aims to be a critical benchmark in helping determine an "optimal" nameplate rating for wave energy devices and their associated power take-offs. With an optimized rating and sizing process, WEC costs can be reduced and overall performance can be improved.

cables↗
DOE OSTI2025

tether

Tether is a python module for benchmarking and assessing large language model (LLMs) performance at generic scientific tasks. The code generates benchmarks, uses the benchmark to prompt LLMs through automatic programming interfaces (APIs), and then logs the number of prompts an LLM correctly answers and presents the results as a completed benchmark.

Kaiser, Bryan [Los Alamos National Laboratory]↗
DOE OSTI2021

Construction, installation and operation of ProtoDUNE-SP

The single-phase liquid argon TPC at CERN (ProtoDUNE-SP) is an engineering prototype for the first module of the DUNE far detector. This prototype, which has dimensions of a cube of about 10 m edge, provides full validation of the use of the membrane tank technology for large dimension cryostats. Furthermore, the very high performance of the protoDUNE-SP TPC with more than 500 days of continuous and stable operation, demonstrated the reliability of the LAr detection technology at a scale never tested before. In this talk we will review the main characteristics and milestones of the construction and installation of protoDUNE-SP which provide a series of benchmarks for DUNE. The performance for several different detector working points will also be discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRSDate not supplied

Updated Numerical Analysis Benchmarks for Meteoroid Relevant Materials

Proposal for update of numerical analysis benchmark for meteoroid relevant materials. - Two recently performed shots are proposed to be numerical analysis benchmarks for numerical simulations of impacts of high-density meteoroids (Al 2 O 3 surrogate) and low-density meteoroids (Nylon surrogate). - A pair of general Whipple shields have been studied: - Bumper and rear walls are the same material and thickness between shields - Separation is 4.5 cm for Al 2 O 3 and 1.5 cm for Nylon - Information gathered includes high speed (1 MHz) shadowgraphs of debris cloud, bumper hole size and rear wall hole area.

Orbital Debris↗