Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

AMG2023

The AMG2023 benchmark solves two diffusion problems with a linear solver preconditioned with algebraic multigrid. The code only contains a driver, a Makefile, and a documentation file. It requires an installation of the open source software library hypre that needs to be downloaded elsewhere and is not included here. Its purpose is to benchmark linear solver performance on high performance computers.

Li, Ruipeng↗

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗

Deep-learning-aided forward optical coherence tomography endoscope for percutaneous nephrostomy guidance

Percutaneous renal access is the critical initial step in many medical settings. In order to obtain the best surgical outcome with minimum patient morbidity, an improved method for access to the renal calyx is needed. In our study, we built a forward-view optical coherence tomography (OCT) endoscopic system for percutaneous nephrostomy (PCN) guidance. Porcine kidneys were imaged in our experiment to demonstrate the feasibility of the imaging system. Three tissue types of porcine kidneys (renal cortex, medulla, and calyx) can be clearly distinguished due to the morphological and tissue differences from the OCT endoscopic images. To further improve the guidance efficacy and reduce the learning burden of the clinical doctors, a deep-learning-based computer aided diagnosis platform was developed to automatically classify the OCT images by the renal tissue types. Convolutional neural networks (CNN) were developed with labeled OCT images based on the ResNet34, MobileNetv2 and ResNet50 architectures. Nested cross-validation and testing was used to benchmark the classification performance with uncertainty quantification over 10 kidneys, which demonstrated robust performance over substantial biological variability among kidneys. ResNet50-based CNN models achieved an average classification accuracy of 82.6%±3.0%. The classification precisions were 79%±4% for cortex, 85%±6% for medulla, and 91%±5% for calyx and the classification recalls were 68%±11% for cortex, 91%±4% for medulla, and 89%±3% for calyx. Interpretation of the CNN predictions showed the discriminative characteristics in the OCT images of the three renal tissue types. The results validated the technical feasibility of using this novel imaging platform to automatically recognize the images of renal tissue structures ahead of the PCN needle in PCN surgery.

Wang, Chen↗

PickerXL, A Large Deep Learning Model to Measure Arrival Times from Noisy Seismic Signals

Precisely measuring seismic arrival times is a labor-intensive task but is critical for both earthquake monitoring and subsurface imaging. Recently published deep learning models have demonstrated superior performance compared to traditional automatic approaches for picking arrival times. Although existing deep learning models have shown promising results, further advancements are necessary as their performance is not yet satisfactory especially when applied to new regions and station networks. Increasing model size has led to improved performance in other machine learning applications. Here, we aimed to investigate whether enlarging deep learning models can increase performance on accepted benchmarks. We trained three models of varying sizes, small (1X), medium (4X), and large (16X), using globally distributed local and regional earthquake signals and background noise waveforms from a benchmark dataset, Stanford Earthquake Dataset. Our results indicate that the largest model (PickerXL) outperforms both the smaller models and Seisbench implementation of the PhaseNet model, which has the same number of parameters as our small model. The PickerXL model’s enhanced capacity to extract complex patterns from seismograms contributes to its superior arrival picking abilities compared to the smaller model.

Chai, Chengping [Oak Ridge National Laboratory (OR↗

Imperfection resonance crossing in the AGS Booster

Polarized helions are part of the spin physics program for the EIC, allowing collisions of polarized neutrons with polarized electrons. Helion imperfection resonances are 2.4 times closer than protons. Helions cross two intrinsic resonances (|Gγ| = 12 - ν γ and |Gγ| = 6 + ν γ ) and six imperfection resonances |Gγ| = 5, 6, 7, 8, 9, and 10) in the Booster as they are accelerated to extraction at |Gγ| = 10.5. In this same range of γ, protons cross two imperfection resonances (|Gγ| = 3, and 4) and are extracted from the Booster prior to crossing the |Gγ| = 0 + ν γ . Preliminary benchmarking simulations are performed using protons crossing the |Gγ| = 3 and 4 imperfection resonances, results of which are compared to experimental data. The settings used for protons are extrapolated to the helion case to show there is sufficient corrector strength to preserve polarization at each imperfection resonance up to extraction.

43 PARTICLE ACCELERATORS↗

Comparison of Tritium Dose Calculations from MACCS, UFOTRI, and ETMOD

Tritium exhibits unique environmental behavior because of its potential interactions with water and organic substances. Modeling the environmental consequences of tritium releases can be relatively complex and thus an evaluation of MACCS is needed to understand what updates, if any, are needed in MACCS to account for the behavior of tritium. We examine documented tritium releases and previous benchmarking assessments to perform a model intercomparison between MACCS and state-of-practice tritium-specific codes UFOTRI and ETMOD to quantify the difference between MACCS and state of practice models for assessing tritium consequences. Additionally, information to assist an analyst in judging whether a postulated tritium release is likely to lead to significant doses is provided.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimation

As machine learning (ML) is increasingly implemented in hardware to address real-time challenges in scientific applications, the development of advanced toolchains has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as hardware synthesis, are becoming limiting factors in the rapid iteration of designs. To mitigate these emerging constraints, multipleefforts have been undertaken to develop an ML-based surrogate model that estimates resource usage of synthesized ML accelerator architectures. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of over 680 000 fully connected and convolutional neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, and the average performance across a subset of the dataset. Additionally, we introduce GNN- and transformer-based surrogate models that predict latency and resources for ML accelerators. We present the architecture and performance of the models and find that the models generally predict latency and resources for the 75% percentile within several percent of the synthesized resources on the synthetic test dataset.

Hawks, Benjamin G. [Fermilab]↗

IACMI Project 4.7: Pultruded Textile Carbon Fiber for Spar Caps (Final Report)

The primary objective of this project was to demonstrate the potential to significantly reduce the cost of wind turbine blades with carbon fiber reinforced polymer (CFRP) structure. Applicability of textile carbon fibers (TCF) were evaluated for use in pultruded spar cap (SC) elements as a path to cost reduction for utility scale wind turbine blades. In earlier work for the Department of Energy (DOE) Wind Energy Technologies Office (WETO), a collaboration of Sandia National Laboratory (SNL), Oak Ridge National Laboratory (ORNL), and Montana State University has demonstrated potential for pultruded TCF to compete with infused fiberglass and commercially available carbon fiber pultruded sections for spar cap construction. In the design cases evaluated, the TCF sections fared well when compared on cost per unit composite stiffness and cost per unit composite compressive strength for those designs [1]. Both stiffness and compressive strength tend to be key factors in the design of blade composite Spar Cap which carry the bulk of the blade structural loads in bending. Spar Cap design tends to distribute largely symmetric tensile and compressive stresses to opposite sides of the spar structure, but since carbon fiber composite compressive strength is typically 20-50% lower than tensile strength, the compressive loading reaches failure levels well before the tensile loading. Stiffness is critical in containing the large tip deflection in high wind loading situations. However, materials and process development were very limited in the earlier study and the work in this project was expanded to make the comparative information more representative of what will be required in order to make further inroads towards implementation. Similar to that study, this project team confirmed that the primary materials of interest for pultruded spar cap elements should be thermoset (TS) resins reinforced by carbon fibers, utilizing as high a percentage of TCF as practical to benchmark cost and performance against commercial carbon fibers. To make the closest comparison possible and eliminate specific test article size, resin selection, and equipment/operational nuance effects, the team planned to pultrude sections with 100% commercially available carbon fiber (Panex 35 carbon fiber from Zoltek) as well as samples utilizing high fractions of TCF. The resin system chosen was based on formulations recommended by large wind industry supplier Hexion and consisted of Hexion resin RSL-4597, curing agent CCA-138, and internal mold release additive 117, along with common kaolin filler ASP400P from BASF. As commonly deployed in spar cap configurations, the team had a mold built to pultrude a rectangular spar cap element of 100mm width and 3mm thickness. The extremely limited number of samples produced for the earlier study were produced with a “generic” epoxy utilized for a variety of applications by the pultruder contracted to produce test articles for demonstration purposes. More importantly, those samples were produced at a fiber fraction only slightly over 50%. Based on feedback from our industrial advisory team for that project and strongly recommended by this project team, the consensus is that it is highly desirable to obtain fiber fractions of 65-68% for significant penetration in wind blade spar cap. Although this requirement has yet to be exhaustively confirmed in readily available information, this was established as a project goal and informally decided we needed to exceed 60% fiber fraction to gain serious industry consideration. Previous TCF pultrusion trials have been challenged by the lack of robust TCF packages, resulting in non-uniform tension across and between tows, as well as excess labor and waste for removal of interleaved paper. The non-uniform tension and associated intermingling of tows in textile acrylic fiber tows and associated difficulties created from broken filaments in carbon fiber conversion inhibit the ordered packing necessary to enhance fiber fraction elevation. (These “cross-overs” are not considered undesirable for textile applications and there is some sense that they might be advantageous for those applications). In addition to work that is ongoing at the acrylic fiber manufacturers to improve their formats, The Institute of Advanced Composites Manufacturing Innovation (IACMI) Project 6.12 (report PA16-0349-6.12-01) [2] has developed and demonstrated a more robust packaging and creeling approach that at least partially addresses these issues, thus improving control of the TCF feed into the pultrusion unit. It was hoped that these and other improvements currently being implemented would allow us to achieve fiber fractions at least approaching these fiber fraction targets. During this project, sections utilizing 100% commercially available carbon fiber reinforcement were produced as a baseline, as well as sections reinforced with about 94% TCF and the balance being commercially available fiber for comparison. The most important finding was that similar to results reported in the earlier WETO-funded project and results from tests of TCF reported at IACMI meetings, this work demonstrated that sections pultruded with TCF in an epoxy resin frequently utilized in actual spar cap production had stiffness and compressive strengths largely comparable to similar sections pultruded with a commercially available carbon fiber also frequently utilized in the wind industry. Although the amount of that data is limited, some of the tensile strength results were actually closer than would have been expected based on fiber strength results provided by the TCF and commercial fiber producers. The actual test data are reported and discussed in detail in Section 5. The pultruded sections dominated by TCF reinforcement were approximately 8-10% lower in fiber fraction than for the sections produced using commercial fiber alone, making direct comparison difficult. The COVID-19 project has provided significant insight into the current state-of-the-art with various TCF product forms. The data obtained in this project will guide the planned improvements at the precursor level, especially in attaining uniform tensioning and payout to facilitate enhanced fiber fractions and overall processability of the TCF composites. The project team is providing guidance to stakeholders concerning the attributes, needs, and potential demand for TCF in wind blade spar caps. Results achieved in this project are consistent with findings in the related work cited [1] and support this guidance and the high potential for this product type. TCF precursor-producing partners continue to express interest in enhancing their product forms and the team looks forward to working with these improved materials as they become available.

42 ENGINEERING↗

Update on Radiochemical Assessment of High Burnup Commercially Irradiated Fuel

This work documents an effort to collect burnup measurements on a high burnup rod, designated 6XV, and first cycle accident tolerant fuel (ATF) rod, designated 47I, to enable benchmarking of fuel performance codes and neutronics codes. In addition to measurements, Virtual Environment for Reactor Applications (VERA) full-core-depletion analysis was also performed for the rods that were experimentally analyzed to provide an opportunity for code validation. This effort focuses on collecting data from rods irradiated at Byron Generating Station and shipped to the Oak Ridge National Laboratory (ORNL) hot-cells. This data will also anchor non-destructive examination evaluations of burnup of the various fuel rods undergoing postirradiation examination (PIE) at ORNL. Previous PIE of these fuel rods provides some guidance on the burnup trend across the fuel. Axial gamma spectroscopy scans provide a measure of relative changes in burnup across a fuel pin. Mass spectrometry based burnup measurements performed for this work at specific axial locations in the fuel are fully quantitative. By combining the mass spectrometry data with the gamma scans it is possible to more quantitatively evaluate axial variations in burnup across the entire fuel pin [1]. The combined set of burnup evaluations will be made available to other organizations that have an interest in high burnup radiochemistry data for validation of neutronic simulations and source term evaluation such as the Nuclear Regulatory Commission (NRC).

Harp, Jason [Oak Ridge National Laboratory (ORNL),↗

GASNet-EX Memory Kinds: Support for Device Memory in PGAS Programming Models

There is an emerging need for adaptive, lightweight communication in irregular HPC applications at exascale, where GPU accelerators provide the majority of available compute cycles. To address this need, Lawrence Berkeley National Lab is developing a programming system to support distributed-memory HPC application development using the Partitioned Global Address Space (PGAS) model. This work includes two major components: UPC++ and GASNet-EX. UPC++ is a C++ template library providing Remote Memory Access (RMA) and Remote Procedure Call (RPC) communication interfaces. GASNet-EX is a portable, high-performance communication middleware library, used by the implementations of UPC++ and many other PGAS programming models. We describe recent advances in GASNet-EX to efficiently implement zero-copy Remote Memory Access (RMA) communication to and from memory on accelerator devices such as GPUs. We demonstrate performance improvements via benchmark results from UPC++ (on Summit) and the Legion programming system (on DGX-1), both using GASNet-EX for communication.

Hargrove, Paul H↗

Ps and Qs: Quantization-Aware Pruning for Efficient Low Latency Neural Network Inference

Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data throughput and reduced energy consumption. Two popular techniques for reducing computation in neural networks are pruning, removing insignificant synapses, and quantization, reducing the precision of the calculations. In this work, we explore the interplay between pruning and quantization during the training of neural networks for ultra low latency applications targeting high energy physics use cases. Techniques developed for this study have potential applications across many other domains. We study various configurations of pruning during quantization-aware training, which we term quantization-aware pruning, and the effect of techniques like regularization, batch normalization, and different pruning schemes on performance, computational complexity, and information content metrics. We find that quantization-aware pruning yields more computationally efficient models than either pruning or quantization alone for our task. Further, quantization-aware pruning typically performs similar to or better in terms of computational efficiency compared to other neural architecture search techniques like Bayesian optimization. Surprisingly, while networks with different training configurations can have similar performance for the benchmark application, the information content in the network can vary significantly, affecting its generalizability.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗

IoT Intrusion Detection Taxonomy, Reference Architecture, and Analyses

This paper surveys the deep learning (DL) approaches for intrusion-detection systems (IDSs) in Internet of Things (IoT) and the associated datasets toward identifying gaps, weaknesses, and a neutral reference architecture. A comparative study of IDSs is provided, with a review of anomaly-based IDSs on DL approaches, which include supervised, unsupervised, and hybrid methods. All techniques in these three categories have essentially been used in IoT environments. To date, only a few have been used in the anomaly-based IDS for IoT. For each of these anomaly-based IDSs, the implementation of the four categories of feature(s) extraction, classification, prediction, and regression were evaluated. We studied important performance metrics and benchmark detection rates, including the requisite efficiency of the various methods. Four machine learning algorithms were evaluated for classification purposes: Logistic Regression (LR), Support Vector Machine (SVM), Decision Tree (DT), and an Artificial Neural Network (ANN). Therefore, we compared each via the Receiver Operating Characteristic (ROC) curve. The study model exhibits promising outcomes for all classes of attacks. The scope of our analysis examines attacks targeting the IoT ecosystem using empirically based, simulation-generated datasets (namely the Bot-IoT and the IoTID20 datasets).

97 MATHEMATICS AND COMPUTING↗

Physically Motivated Deep Learning to Superresolve and Cross Calibrate Solar Magnetograms

Abstract Superresolution (SR) aims to increase the resolution of images by recovering detail. Compared to standard interpolation, deep learning-based approaches learn features and their relationships to leverage prior knowledge of what low-resolution patterns look like in higher resolution. Deep neural networks can also perform image cross-calibration by learning the systematic properties of the target images. While SR for natural images aims to create perceptually convincing results, SR of scientific data requires careful quantitative evaluation. In this work, we demonstrate that deep learning can increase the resolution and calibrate solar imagers belonging to different instrumental generations. We convert solar magnetic field images taken by the Michelson Doppler Imager (resolution ∼2″ pixel −1 ; space based) and the Global Oscillation Network Group (resolution ∼2.″5 pixel −1 ; ground based) to the characteristics of the Helioseismic and Magnetic Imager (resolution ∼0.″5 pixel −1 ; space based). We also establish a set of performance measurements to benchmark deep-learning-based SR and calibration for scientific applications.

Muñoz-Jaramillo, Andrés (ORCID:0000000247160840)↗

Recent Advances of PyROS: A Pyomo Solver for Nonconvex Two-Stage Robust Optimization in Process Systems Engineering

The document presents recent algorithmic and implementation advances of the two-stage robust optimization (RO) solver PyROS, and a benchmarking study which demonstrates the utility of PyROS for two-stage RO problems. The advances include extensions of the scope of PyROS to models with uncertain variable bounds, improvements to the initializations of the subproblems used by the underlying cutting set algorithm, and extensions of the uncertainty set interfaces. The benchmarking study is performed on a library of over 8,500 instances, with variations in the nonlinearities, degree-of-freedom partitioning, uncertainty sets, and polynomial decision rule approximations. An amine-based CO2 capture case study is presented to demonstrate the utility of PyROS for large-scale process models. Overall, the results highlight the effectiveness of PyROS for obtaining robust solutions to optimization problems with uncertain equality constraints.

Sherman, Jason↗

Comparison of UNL laser imaging and sizing system and a phase/Doppler system for analyzing sprays from a NASA nozzle

Aerosol spray characterization was done using a P/DPA and a laser imaging/video processing system on a NASA MOD-1 air-assist nozzle being evaluated for use in aircraft icing research. Benchmark tests were performed on monodispersed particles and on the NASA MOD-1 nozzle under identical laboratory operating conditions. The laser imaging/video processing system and the P/DPA showed agreement on calibration tests in monodispersed aerosol sprays of + or - 2.6 microns with a standard deviation of + or - 2.6 microns. Tests were performed on the NASA MOD-1 nozzle on the centerline and radially at one-half inch increments to the outer edge of the spray plume at a distance two feet (0.61 m) downstream from the exit of the nozzle. Comparative results at two operating conditions of the nozzle are presented for the two instruments. For the first case, the deviation in arithmetic mean diameters determined by the two instruments was in a range of 0.1 to 2.8 microns, and the deviation in Sauter mean diameters varied from 0 to 2.2 microns. Operating conditions in the second case were more severe which resulted in the arithmetic mean diameter deviating from 1.4 to 7.1 microns and the deviation in the Sauter mean diameters ranging from 0.4 to 6.7 microns.

Alexander, Dennis R.↗

NASA in-house Commercially Developed Space Facility (CDSF) study report. Volume 1: Concept configuration definition

The results of a NASA in-house team effort to develop a concept definition for a Commercially Developed Space Facility (CDSF) are presented. Science mission utilization definition scenarios are documented, the conceptual configuration definition system performance parameters qualified, benchmark operational scenarios developed, space shuttle interface descriptions provided, and development schedule activity was assessed with respect to the establishment of a proposed launch date.

Deryder, L. J.↗

An expert system for setting time steps in dynamic finite element programs

An expert system, ETUDES - Expert Time integration control Using Deep and Surface Knowledge System, which addresses the determination of the timestep for time integration of linear structural dynamic equations is described. This timestep may also be applicable for a moderately nonlinear simulation of the same structure. The program also determines whether an explicit or implicit method is most efficient for the particular simulation. A production rule programming system written in OPS5 is used for the implementation of this prototype expert system. Issues relating to the expert system architecture for this application, such as knowledge representation and structure, as well as domain knowledge are discussed. The prototype is evaluated by measuring its performance in various benchmark model problems.

Ramirez, Martin R.↗