Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Performance modeling & simulation of complex systems (A systems engineering design & analysis approach)

Modeling of the Multi-mission Image Processing System (MIPS) will be described as an example of the use of a modeling tool to design a distributed system that supports multiple application scenarios. This paper examines: (a) modeling tool selection, capabilities, and operation (namely NETWORK 2.5 by CACl), (b) pointers for building or constructing a model and how the MIPS model was developed, (c) the importance of benchmarking or testing the performance of equipment/subsystems being considered for incorporation the design/architecture, (d) the essential step of model validation and/or calibration using the benchmark results, (e) sample simulation results from the MIPS model, and (f) how modeling and simulation analysis affected the MIPS design process by having a supportive and informative impact.

Hall, Laverne↗

Spectroscopic Determination of the Physical Conditions in Hot, Optically Thin Sources

This annual report covers the period from Oct 1, 2000 to Sep 30, 2001. The Astrophysics Plasma Emission Code and Database (APEC/APED), developed in part under this grant, have been upgraded to Version 1.1 and are now beginning to be used outside our research group in applications to X-ray spectral data from Chandra and XMM-Newton. These models represent the best theoretical data currently available and are reasonably complete below about 30 angstroms. Stellar coronae are being used to benchmark the atomic data in APED as part of the Emission Line Project. Initial results suggest that the models for most of the strongest lines are in good agreement with the observations, including the H-like and He-like emission from dominant elements and the Fe L shell emission, both near 1 keV and in the extreme ultraviolet near 100 eV. At this point in time, we define 'good agreement' at the level of accuracy expected from the atomic physics, approximately 20-30%. In order to benchmark the spectral models beyond the canonical theoretical accuracy, we are working closely with the Chandra gratings calibration group to ensure that we are using the optimal calibration, primarily effective areas and line response functions.

Brickhouse, N.↗

Multi-Core Processor Memory Contention Benchmark Analysis Case Study

Multi-core processors dominate current mainframe, server, and high performance computing (HPC) systems. This paper provides synthetic kernel and natural benchmark results from an HPC system at the NASA Goddard Space Flight Center that illustrate the performance impacts of multi-core (dual- and quad-core) vs. single core processor systems. Analysis of processor design, application source code, and synthetic and natural test results all indicate that multi-core processors can suffer from significant memory subsystem contention compared to similar single-core processors.

Simon, Tyler↗

Exploring Cognitive States: Methods for Detecting Physiological Temporal Fingerprints

Cognitive state detection and its relationship to observable physiologically telemetry has been utilized for many human-machine and human-cybernetic applications. This paper aims at understanding and addressing if there are unique psychophysiological patterns over time, a ”physiological temporal fingerprint”, that is associated with specific cognitive states. This preliminary work involves commercial airline pilots completing experimental benchmark task inductions of three cognitive states: 1) Channelized Attention (CA); 2) High Workload (HW); and 3) Low Workload (LW). We approach this objective by modeling these "fingerprints" through the use of Hidden Markov Models and Entropy analysis to evaluate if the transitions over time are complex or rhythmic/predictable by nature. Our results indicate that cognitive states do have unique complexity of physiological sequences that are statistically different from other cognitive states. More specifically, CA has a significantly higher temporal psychophysiological complexity than HW and LW in EEG and ECG telemetry signals. With regards to respiration telemetry, CA has a lower temporal psychophysiological complexity than HW and LW. Through our preliminary work, addressing this unique underpinning can inform whether these underlying dynamics can be utilized to understand how humans transition between cognitive states and for improved detection of cognitive states.

Napoli, Nicholas J.↗

PALMO: An OVERFLOW Machine Learning Airfoil Performance Database

The OVERFLOW Machine Learning Airfoil Performance (PALMO) database has been created to enable robust modeling of airfoil performance in a variety of applications. The PALMO database uses OVERFLOW simulation data second-order accurate in time and fourth-order accurate in space with Spalart-Allmaras turbulence closure. The foundation of the in-development PALMO database is the airfoil base cube. Each base cube includes simulation data parametrized over a range of Mach numbers, Reynolds numbers, and angles-of-attack. This database includes the NACA 4-series airfoils, with parametrization in airfoil thickness and camber from an NACA 0006 to an NACA 4424. In total, 52,480 NACA 4-series OVERFLOW calculations were run on the NASA High-End Compute Capability (HECC) supercomputer. This provides high-order-accurate simulation data covering a wide range of aerospace design applications, which enables users to develop accurate airfoil performance look-up tables without additional high-performance computing. In addition to engineering design and analysis of aerospace vehicles, PALMO is well suited to be a benchmark dataset for the development and testing of machine learning methods in aerospace engineering. This work presents an example PALMO surrogate model that enables accurate airfoil performance predictions for any arbitrary combination of camber, thickness, Mach number, Reynolds number, and angle of attack within the bounds of the database. Airfoil performance tables predicted for an airfoil not used in training the model are used in three-dimensional OVERFLOW simulations to quantify the downstream accuracy on aggregate rotor performance metrics. For the NACA 3415 airfoil, which had no common thickness or camber with the training data, the surrogate predicted and CFD generated tables were within 2.1% of each other in the forward flight lift to drag metric. This suggests that performance tables generated for airfoils within the bounds of the PALMO database will yield aggregate rotor performance predictions on par with tables generated from directly running OVERFLOW airfoil calculations. The PALMO airfoil performance coefficients are available publicly.

Database↗

VERA Benchmarking Results for Watts Bar Nuclear Plant Unit 1 Cycles 1-12

The Consortium for Advanced Simulation of Light Water Reactors, the first US DOE Energy Innovation Hub, is developing and deploying a suite of directly coupled, high-fidelity physics methods known as VERA for performing engineering analyses of operating commercial nuclear power reactors. The centerpiece of VERA is the reactor core simulator, which employs the direct coupling of a 3D neutron transport code, a two-phase sub-channel thermal-hydraulic code, and a well-known isotopic depletion and decay code. Together these tools represent the most rigorous reactor simulator available today. Recently added capabilities include the depletion, shuffling, and discharge of fuel assemblies, enabling VERA to simulate multiple fuel cycles of operation. To demonstrate this capability, VERA has been used to simulate over 18 years of operation of TVA’s Watts Bar Nuclear Unit 1, and the results of these calculations have been used to quantify its performance in an industry-grade benchmarking activity. Comparisons are made with measured critical boron concentrations, control bank reactivity worths, isothermal temperature coefficients, and in-core neutron flux distributions. These results demonstrate that the advanced tools in VERA are capable for application to practical and common industrial problems.

Godfrey, Andrew T↗

Considerations on the Use of Custom Accelerators for Big Data Analytics

Accelerators, including Graphic Processing Units (GPUs) for gen- eral purpose computation, many-core designs with wide vector units (e.g., Intel Phi), have become a common component of many high performance clusters. The appearance of more stable and reliable tools tools that can automatically convert code written in high-level specifications with annotations (such as C or C++) to hardware de- scription languages (High-Level Synthesis - HLS), is also setting the stage for a broader use of reconfigurable devices (e.g., Field Pro- grammable Gate Arrays - FPGAs) in high performance system for the implementation of custom accelerators, helped by the fact that new processors include advanced cache-coherent interconnects for these components. In this chapter, we briefly survey the status of the use of accelerators in high performance systems targeted at big data analytics applications. We argue that, although the progress in the use of accelerators for this class of applications has been sig- nificant, differently from scientific simulations there still are gaps to close. This is particularly true for the ”irregular” behaviors exhibited by no-SQL, graph databases. We focus our attention on the limits of HLS tools for data analytics and graph methods, and discuss a new architectural template that better fits the requirement of this class of applications. We validate the new architectural templates by mod- ifying the Graph Engine for Multithreaded System (GEMS) frame- work to support accelerators generated with such a methodology, and testing with queries coming from the Lehigh University Benchmark (LUBM). The architectural template enables better supporting the task and memory level parallelism present in graph methods by sup- porting a new control model and a enhanced memory interface. We show that out solution allows generating parallel accelerators, pro- viding speed ups with respect to conventional HLS flows. We finally draw conclusions and present a perspective on the use of reconfig- urable devices and Design Automation tools for data analytics.

Data Analytics↗

‘Wasteaware’ benchmark indicators for integrated sustainable waste management in cities

Highlights: • Solid waste management (SWM) is a key utility service, but data is often lacking. • Measuring their SWM performance helps a city establish priorities for action. • The Wasteaware benchmark indicators: measure both technical and governance aspects. • Have been developed over 5 years and tested in more than 50 cities on 6 continents. • Enable consistent comparison between cities and countries and monitoring progress. - Abstract: This paper addresses a major problem in international solid waste management, which is twofold: a lack of data, and a lack of consistent data to allow comparison between cities. The paper presents an indicator set for integrated sustainable waste management (ISWM) in cities both North and South, to allow benchmarking of a city’s performance, comparing cities and monitoring developments over time. It builds on pioneering work for UN-Habitat’s solid waste management in the World’s cities. The comprehensive analytical framework of a city’s solid waste management system is divided into two overlapping ‘triangles’ – one comprising the three physical components, i.e. collection, recycling, and disposal, and the other comprising three governance aspects, i.e. inclusivity; financial sustainability; and sound institutions and proactive policies. The indicator set includes essential quantitative indicators as well as qualitative composite indicators. This updated and revised ‘Wasteaware’ set of ISWM benchmark indicators is the cumulative result of testing various prototypes in more than 50 cities around the world. This experience confirms the utility of indicators in allowing comprehensive performance measurement and comparison of both ‘hard’ physical components and ‘soft’ governance aspects; and in prioritising ‘next steps’ in developing a city’s solid waste management system, by identifying both local strengths that can be built on and weak points to be addressed. The Wasteaware ISWM indicators are applicable to a broad range of cities with very different levels of income and solid waste management practices. Their wide application as a standard methodology will help to fill the historical data gap.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Recent DIII-D progress toward validating models of tungsten erosion, re-deposition, and migration for application to next-step fusion devices

Abstract Fundamental mechanisms governing the erosion and prompt re-deposition of tungsten impurities in tokamak divertors are identified and analyzed to inform the lifetime of tungsten plasma-facing components in ITER and other future devices. Various experiments conducted at DIII-D to benchmark predictive models are presented, leveraging the DiMES removable sample exposure probe capability and the Metal Rings Campaign, in which toroidally symmetric rows of tungsten-coated tiles were installed in the DIII-D divertor. In tokamak divertors, the width of the electric sheath is of the order of the main ion Larmor radius, and a vast majority of sputtered tungsten impurities are typically ionized within the sheath. Therefore, W prompt redeposition is mainly governed by the ratio of the characteristic ionization mean-free path of neutral tungsten to the width of the sheath. In-situ monitoring of the prompt redeposition of tungsten impurities in divertors is demonstrated via the use of WII/WI line ratios and the ionizations/photon (S/XB) method in L-mode discharges. Even with this relatively limited set of emission measurements, net erosion measurements were found to be a consistent upper bound to an analytic scaling based on the ratio of the W ionization length, λ iz , and the width of the magnetic sheath rather than the ratio of λ iz and the W + gyro-radius. In the far-scrape-off layer (SOL) of the ITER divertor, however, it is calculated that the measurement of photon emissions associated with the ionization of tungsten impurities up to W 5 + may be required. Finally, W deposition patterns on DiMES collector probes, interpreted via DIVIMP-WallDYN modelling, reveal the key roles of progressive W erosion/re-deposition staps and E × B drifts in regulating long-range high-Z material migration.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Mathematical efficiency calibration with uncertain source geometries using smart optimization

The In Situ Object Counting Software (ISOCS), a mathematical method developed by CANBERRA, is a well established technique for computing High Purity Germanium (HPGe) detector efficiencies for a wide variety of source shapes and sizes. In the ISOCS method, the user needs to input the geometry related parameters such as: the source dimensions, matrix composition and density, along with the source-to-detector distance. In many applications, the source dimensions, the matrix material and density may not be well known. Under such circumstances, the efficiencies may not be very accurate since the modeled source geometry may not be very representative of the measured geometry. CANBERRA developed an efficiency optimization software known as 'Advanced ISOCS' that varies the not well known parameters within user specified intervals and determines the optimal efficiency shape and magnitude based on available benchmarks in the measured spectra. The benchmarks could be results from isotopic codes such as MGAU, MGA, IGA, or FRAM, activities from multi-line nuclides, and multiple counts of the same item taken in different geometries (from the side, bottom, top etc). The efficiency optimization is carried out using either a random search based on standard probability distributions, or using numerical techniques that carry out a more directed (referred to as 'smart' in this paper) search. Measurements were carried out using representative source geometries and radionuclide distributions. The radionuclide activities were determined using the optimum efficiency and compared against the true activities. The 'Advanced ISOCS' method has many applications among which are: Safeguards, Decommissioning and Decontamination, Non-Destructive Assay systems and Nuclear reactor outages maintenance. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

2-D Circulation Control Airfoil Benchmark Experiments Intended for CFD Code Validation

A current NASA Research Announcement (NRA) project being conducted by Georgia Tech Research Institute (GTRI) personnel and NASA collaborators includes the development of Circulation Control (CC) blown airfoils to improve subsonic aircraft high-lift and cruise performance. The emphasis of this program is the development of CC active flow control concepts for both high-lift augmentation, drag control, and cruise efficiency. A collaboration in this project includes work by NASA research engineers, whereas CFD validation and flow physics experimental research are part of NASA s systematic approach to developing design and optimization tools for CC applications to fixed-wing aircraft. The design space for CESTOL type aircraft is focusing on geometries that depend on advanced flow control technologies that include Circulation Control aerodynamics. The ability to consistently predict advanced aircraft performance requires improvements in design tools to include these advanced concepts. Validation of these tools will be based on experimental methods applied to complex flows that go beyond conventional aircraft modeling techniques. This paper focuses on recent/ongoing benchmark high-lift experiments and CFD efforts intended to provide 2-D CFD validation data sets related to NASA s Cruise Efficient Short Take Off and Landing (CESTOL) study. Both the experimental data and related CFD predictions are discussed.

Englar, Robert J.↗

Hierarchically Porous Multimetal‐Based Carbon Nanorod Hybrid as an Efficient Oxygen Catalyst for Rechargeable Zinc–Air Batteries

Abstract The lack of efficient strategies to address the intrinsic activity, site accessibility, and structural stability issues of metal‐carbon hybrid catalysts is restricting their real‐world implementation on the basis of rechargeable zinc–air batteries. Herein, a dual metal–organic frameworks (MOFs) pyrolysis strategy is developed to regulate the intrinsic activity and porous structure of the derived catalysts, where a Fe 2 Ni_MIL‐88@ZnCo_zeolitic imidazolate framework (ZIF), with a hierarchically porous structure, multifunctional components, and an integrated architecture, acts as an ideal precursor to obtain multimetal based porous nanorod (FeNiCo@NC‐P). Benefitting from the synergetic effect of the multimetal components, facilitated reactant accessibility, and the well‐retained integrated structure, the resultant FeNiCo@NC‐P catalyst exhibits an oxygen reduction reaction half‐wave potential of 0.84 V as well as an oxygen evolution reaction potential of 1.54 V at 10 mA cm –2 . Furthermore, the practical application of FeNiCo@NC‐P in the zinc–air battery displays a low voltage gap and long‐term durability (over 130 h at a current density of 10 mA cm –2 ), which outperforms the commercial noble metal benchmarks. This work not only affords a competitive bifunctional oxygen electrocatalyst for zinc–air batteries but also paves a new way to design and fabricate MOF‐derived materials with tunable catalytic properties.

Ren, Dezhang↗

Global optimization algorithms to compute thermodynamic equilibria in large complex systems with performance considerations

Several global optimization methods are reviewed that attempt to ensure that the integral Gibbs energy of a closed isothermal isobaric system is a global minimum to satisfy the necessary and sufficient conditions for thermodynamic equilibrium. In particular, the integral Gibbs energy function of a multicomponent system containing non-ideal phases may be highly non-linear and non-convex, which makes finding a global minimum a challenge. Consequently, a poor numerical approach may lead one to the false belief of equilibrium. Furthermore, confirming that one reaches a global minimum and that this is achieved with satisfactory computational performance becomes increasingly more challenging in systems containing many chemical elements and a correspondingly large number of species and phases. Several numerical methods that have been used for this specific purpose are reviewed with a benchmark study of three of the more promising methods using five case studies of varying complexity. A modification of the conventional Branch and Bound method is presented that is well suited to a wide array of thermodynamic applications, including complex phases with many constituents and sublattices, and ionic phases that must adhere to charge neutrality constraints. Also, a novel method is presented that efficiently solves the system of linear equations that exploits the unique structure of the Hessian matrix, which reduces the calculation from a O(N 3 ) operation to a O(N) operation. As a result, this combined approach demonstrates efficiency, reliability and capabilities that are favorable for integration of thermodynamic computations into multi-physics codes with inherent performance considerations.

97 MATHEMATICS AND COMPUTING↗

Self-assembly of aramid amphiphiles into ultra-stable nanoribbons and aligned nanoribbon threads

Small molecule self-assembly is an established route for producing high surface area nanostructures with readily customizable chemistries and precise molecular organization. However, these structures are fragile, exhibiting molecular exchange, migration, and rearrangement - among other dynamic instabilities - and ultimately disassociate upon drying. Here we show a small molecule platform, the aramid amphiphile (AA), that overcomes these dynamic instabilities by incorporating a Kevlar-inspired domain into the molecular structure. Strong, anisotropic interactions between AAs suppress molecular exchange and elicit spontaneous self-assembly in water to form nanoribbons with lengths of up to 20 microns. The nanoribbons have a Young’s modulus of 1.7 GPa and tensile strength of 1.9 GPa. Here, we exploit this stability to extend small molecule self-assembly to hierarchically ordered macroscopic materials outside of solvated environments. Through an aqueous shear alignment process, we organize AA nanoribbons into arbitrarily long flexible threads that support 200 times their weight when dried. Tensile tests of the threads provide a benchmark for Young’s moduli (between ~400 and 600 MPa) and extensibilities (between ~0.6 and 1.1%) that depend on the counterion chemistry in solution. This bottom-up approach to macroscopic materials could benefit solid-state applications, historically inaccessible by self-assembled nanomaterials.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Extending Skel to Support the Development and Optimization of Next Generation I/O Systems

As the memory and storage hierarchy get deeper and more complex, it is important to have new benchmarks and evaluation tools that allow us to explore the emerging middleware solutions to use this hierarchy. Skel is a tool aimed at automating and refining this process of studying HPC I/O performance. It works by generating application I/O kernel/benchmarks as determined by a domain-specific model. This paper provides some techniques for extending Skel to address new situations and to answer new research questions. For example, we document use cases as diverse as using Skel to troubleshoot I/O performance issues for remote users, refining an I/O system model, and facilitating the development and testing of a mechanism for runtime monitoring and performance analytics. We also discuss data oriented extensions to Skel to support the study of compression techniques for Exascale scientific data management.

97 MATHEMATICS AND COMPUTING↗

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

Review of machine learning and deep learning models for toxicity prediction

The ever-increasing number of chemicals has raised public concerns due to their adverse effects on human health and the environment. To protect public health and the environment, it is critical to assess the toxicity of these chemicals. Traditional in vitro and in vivo toxicity assays are complicated, costly, and time-consuming and may face ethical issues. These constraints raise the need for alternative methods for assessing the toxicity of chemicals. Recently, due to the advancement of machine learning algorithms and the increase in computational power, many toxicity prediction models have been developed using various machine learning and deep learning algorithms such as support vector machine, random forest, k-nearest neighbors, ensemble learning, and deep neural network. This review summarizes the machine learning- and deep learning-based toxicity prediction models developed in recent years. Support vector machine and random forest are the most popular machine learning algorithms, and hepatotoxicity, cardiotoxicity, and carcinogenicity are the frequently modeled toxicity endpoints in predictive toxicology. It is known that datasets impact model performance. The quality of datasets used in the development of toxicity prediction models using machine learning and deep learning is vital to the performance of the developed models. The different toxicity assignments for the same chemicals among different datasets of the same type of toxicity have been observed, indicating benchmarking datasets is needed for developing reliable toxicity prediction models using machine learning and deep learning algorithms. This review provides insights into current machine learning models in predictive toxicology, which are expected to promote the development and application of toxicity prediction models in the future.

Research & Experimental Medicine↗