Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Biomechanical Modeling Analysis of Loads Configuration for Squat Exercise

INTRODUCTION: Long duration space travel will expose astronauts to extended periods of reduced gravity. Since gravity is not present to assist loading, astronauts will use resistive and aerobic exercise regimes for the duration of the space flight to minimize loss of bone density, muscle mass and aerobic capacity that occurs during exposure to a reduced gravity environment. Unlike the International Space Station (ISS), the area available for an exercise device in the next generation of spacecraft for travel to the Moon or to Mars is limited and therefore compact resistance exercise device prototypes are being developed. The Advanced Resistive Exercise Device (ARED) currently on the ISS is being used as a benchmark for the functional performance of these new devices. Biomechanical data collection and computational modeling aid the device design process by quantifying the joint torques and the musculoskeletal forces that occur during exercises performed on the prototype devices. METHODS The computational models currently under development utilize the OpenSim [1] software platform, consisting of open source code for musculoskeletal modeling, using biomechanical input data from test subjects for estimation of muscle and joint loads. The OpenSim Full Body Model [2] is used for all analyses. The model incorporates simplified wrap surfaces, a new knee model and updated lower body muscle parameters derived from cadaver measurements and magnetic resonance imaging of young adults. The upper body uses torque actuators at the lumbar and extremity joints. The test subjects who volunteer for this study are instrumented with reflective markers for motion capture data collection while performing squat exercising on the Hybrid Ultimate Lifting Kit (HULK) prototype device (ZIN Technologies, Middleburg Heights, OH). Ground reaction force data is collected with force plates under the feet, and device loading is recorded through load cells internal to the HULK. Test variables include the applied device load and the dual cable long bar or single cable T-bar interface between the test subject and the device. Data is also obtained using free weights with the identical loading for a comparison to the resistively loaded exercise device trials. The data drives the OpenSim biomechanical model, which has been scaled to match the anthropometrics of the test subject, to calculate the body loads. RESULTS Lower body kinematics, joint moments, joint forces and muscle forces are obtained from the OpenSim biomechanical analysis of the squat exercises under different loading conditions. Preliminary results from the model for the loading conditions will be presented as will hypotheses developed for follow on work.

Human Factors Engineering↗
NASA NTRSDate not supplied

Adaptive Learning for Reliability Analysis using Support Vector Machines

A novel algorithm is presented for adaptive learning of an unknown function that separates two regions of a domain.In the context of reliability analysis these two regions represent the failure domain, where a set of constraints or requirements are violated, and a safe domain where they are satisfied. The Limit State Function (LSF) separates these two regions. Evaluating the constraints for a given parameter point requires the evaluation of a computational model that may well be expensive. For this reason we wish to construct a meta-model that can estimate the LSFas accurately as possible, using only a limited amount of training data. This work presents an adaptive strategy employing a Support Vector Machine (SVM) as a meta-model to provide a semi-algebraic approximation of the LSF.We describe an optimization process that is used to select informative parameter points to add to training data at each iteration to improve the accuracy of this approximation. A formulation is introduced for bounding the predictions of the meta-model; in this way we seek to incorporate this aspect of Gaussian Process Models (GPMs) within anSVM meta-model. Finally, we apply our algorithm to two benchmark test cases, demonstrating performance that is comparable with, if not superior, to a standard technique for reliability analysis that employs GPMs

Adaptive learning↗
NASA NTRS2022

Microstructure Segmentation with Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures, including VGG, Inception, and ResNet, were trained on over 100,000 labelled microscopy images from 54 classes. These pre-trained encoders were then embedded into multiple segmentation architectures including U-Net and DeepLabV3+ to evaluate segmentation performance on newly created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2 percent reduction in relative segmentation error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗
NASA NTRSDate not supplied

AssistTaxi: A Comprehensive Dataset for Taxiway Analysis and Autonomous Operations

The availability of high-quality datasets play a crucial role in advancing research and development especially, for safety critical and autonomous systems. This poster presents AssistTaxi, which is a comprehensive novel dataset which is a collection of images for runway and taxiway analysis. The dataset comprises of more than 300,000 frames of diverse and carefully collected data, gathered from Melbourne (MLB) and Grant-Valkaria (X59) general aviation airports. The importance of AssistTaxi lies in its potential to advance autonomous operations, enabling researchers and developers to train and evaluate algorithms for efficient and safe taxiing. Researchers can utilize AssistTaxi to benchmark their algorithms, assess performance, and explore novel approaches for runway and taxiway analysis. Additionally, the dataset serves as a valuable resource for validating and enhancing existing algorithms as well as facilitating innovation in autonomous operations for aviation. We also propose an initial approach to label the dataset using a contour based detection and line extraction technique.

Data Collection↗
DOE OSTI2020

Design and Operability of a Pressurized Oxy Combustion System

Fossil fuel powers more than two-thirds of the world’s electricity, a significant share of which is derived from coal power plants. Despite coal being an abundant and energy-rich fuel, the major halt to its progress is greenhouse gas emissions. Pressurized oxy-combustion cycles can achieve theoretically high thermal efficiencies along with a 90% carbon capture rate. Additionally, the high energy density allows smaller turbomachinery and save capital cost. Thus, the primary objective of this dissertation is to present the design and operability of a pressurized oxy-combustor system. The initial part of the dissertation investigates different thermodynamic cycles and presents a model that can be adapted for existing power plants. The thermodynamic model will be used in the later part to design the proposed combustor. The two cycles analyzed are ENEL and TIPS. This study focuses on qualitative analyses of the cycles using a commercially available software called Aspen Plus®. A detailed benchmark study has been performed to validate the modeling process. ENEL and TIPS cycles are designed in the software, adopting the same principles. Recirculation ratio and pressures are varied to find the efficiency range of the cycles. Power calculations are done to find overall and net efficiency for a fixed recirculation ratio. The efficiencies of the cycles are compared to select an optimum cycle. A recirculation ratio of 50% is selected for implementation. The comparison shows that ENEL is marginally efficient over TIPS, at the cost of a pressure difference of about 70bars. Technology Readiness Level analysis is performed to present the availability of the specialized equipment for the cycles. From the TRL analysis, it is seen that the cost and availability of high viii pressure equipment surmount the edge of TIPS over ENEL. Thus, ENEL is chosen as the better cycle for investigating a scaled experiment considering efficiency and viability. The later part of the dissertation focuses on developing the combustor's design for a pressurized oxy-combustion cycle. The proposed combustor is a powerhead-mounted design aimed to produce 1MW of thermal outputThe different aspects of the design of a down-fired pressurized swirl combustor are presented in this dissertation.

Chowdhury, Mehrin↗
DOE OSTI2023

Measurement of the pion charge exchange differential cross section on Argon with the ProtoDUNE-SP detector

The Deep Underground Neutrino Experiment (DUNE) utilizes Liquid Argon Time Projection Chamber (LArTPC) technology in its pursuit of uncovering the origins of matter. As a crucial prototype for the DUNE far detector (FD) module, ProtoDUNE-SP at CERN Neutrino Platform Facility employs a hadron test beam with a momentum range of 0.3 to 7 GeV/c to study the detector response to particles that could be produced in the neutrino interactions at the DUNE FD. Furthermore, ProtoDUNE-SP is dedicated to testing event reconstruction and performing detector calibration under controlled conditions. Neutral pion reconstruction performance is an important benchmark of the calorimetric and tracking capability of LArTPC, and understanding neutral pion in LArTPC is crucial to characterize backgrounds to oscillation measurements and rare searches. To improve neutral pion reconstruction in LArTPC, a kinematic fitting algorithm is developed, achieving a 12% resolution in neutral pion energy in ProtoDUNE-SP. This enhancement enables the first measurements of the pion-argon charge exchange differential cross-section. By comparing these results with the current model, valuable constraints can be made to improve generator simulations in the future DUNE experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics

In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

AGR 1 and 2 Isotopic Depletion Validation

This presentation includes work performed developing a computational benchmark for the AGR 1 and 2 experiments. These experiments involve irradiation of TRISO particle compact in the Advanced Test Reactor (ATR). Many post-irradiation measurements were made from these experiments, including isotopic concentrations of fission products. The benchmark involves a MCNP-ORIGEN coupled model of the ATR and AGR experiment capsules to calculate a comprehensive inventory of fission product and actinide concentrations in the compacts. This presentation describes the experiments, the measurements obtained, the benchmark model, and results of the model evaluation.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

Large language models (LLMs) achieve remarkable performance through ever-increasing parameter counts, but scaling incurs steep computational costs. To better understand LLM scaling, we study representational differences between LLMs and their smaller counterparts, with the goal of replicating the representational qualities of larger models in smaller models. We observe a geometric phenomenon which we term embedding condensation, where token embeddings collapse into a narrow cone-like subspace in some language models. Through systematic analyses across multiple Transformer families, we show that small models such as GPT2 and Qwen3-0.6B exhibit severe condensation, whereas larger models such as GPT2-x1 and Qwen3-32B are more resistant to this phenomenon. Additional observations show that embedding condensation is not reliably mitigated by knowledge distillation from larger models. To fight against it, we formulate a dispersion loss that explicitly encourages embedding dispersion during training. Experiments demonstrate that it mitigates condensation, recovers dispersion patterns seen in larger models, and yields performance gains across 10 benchmarks. We believe this work offers a principled path toward improving smaller Transformers without additional parameters.

Xiao, Xi [ORNL] (ORCID:0009000009316982)↗
DOE OSTI2024

Democratizing uncertainty quantification

Uncertainty Quantification (UQ) is vital to safety-critical model-based analyses, but the widespread adoption of sophisticated UQ methods is limited by technical complexity. In this paper, we introduce UM-Bridge (the UQ and Modeling Bridge), a high-level abstraction and software protocol that facilitates universal interoperability of UQ software with simulation codes. It breaks down the technical complexity of advanced UQ applications and enables separation of concerns between experts. UM-Bridge democratizes UQ by allowing effective interdisciplinary collaboration, accelerating the development of advanced UQ methods, and making it easy to perform UQ analyses from prototype to High Performance Computing (HPC) scale. In addition, we present a library of ready-to-run UQ benchmark problems, all easily accessible through UM-Bridge. These benchmarks support UQ methodology research, enabling reproducible performance comparisons. We demonstrate UM-Bridge with several scientific applications, harnessing HPC resources even using UQ codes not designed with HPC support.

Benchmarks↗
DOE OSTI2023

Improving materials property predictions for graph neural networks with minimal feature engineering *

Graph neural networks (GNNs) have been employed in materials research to predict physical and functional properties, and have achieved superior performance in several application domains over prior machine learning approaches. Recent studies incorporate features of increasing complexity such as Gaussian radial functions, plane wave functions, and angular terms to augment the neural network models, with the expectation that these features are critical for achieving a high performance. Here, we propose a GNN that adopts edge convolution where hidden edge features evolve during training and extensive attention mechanisms, and operates on simple graphs with atoms as nodes and distances between them as edges. As a result, the same model can be used for very different tasks as no other domain-specific features are used. With a model that uses no feature engineering, we achieve performance comparable with state-of-the-art models with elaborate features for formation energy and band gap prediction with standard benchmarks; we achieve even better performance when the dataset size increases. Although some domain-specific datasets still require hand-crafted features to achieve state-of-the-art results, our selected architecture choices greatly reduce the need for elaborate feature engineering and still maintain predictive power in comparison.

42 ENGINEERING↗
NASA NTRS1998

The mass storage testing laboratory at GSFC

Industry-wide benchmarks exist for measuring the performance of processors (SPECmarks), and of database systems (Transaction Processing Council). Despite storage having become the dominant item in computing and IT (Information Technology) budgets, no such common benchmark is available in the mass storage field. Vendors and consultants provide services and tools for capacity planning and sizing, but these do not account for the complete set of metrics needed in today's archives. The availability of automated tape libraries, high-capacity RAID systems, and high- bandwidth interconnectivity between processor and peripherals has led to demands for services which traditional file systems cannot provide. File Storage and Management Systems (FSMS), which began to be marketed in the late 80's, have helped to some extent with large tape libraries, but their use has introduced additional parameters affecting performance. The aim of the Mass Storage Test Laboratory (MSTL) at Goddard Space Flight Center is to develop a test suite that includes not only a comprehensive check list to document a mass storage environment but also benchmark code. Benchmark code is being tested which will provide measurements for both baseline systems, i.e. applications interacting with peripherals through the operating system services, and for combinations involving an FSMS. The benchmarks are written in C, and are easily portable. They are initially being aimed at the UNIX Open Systems world. Measurements are being made using a Sun Ultra 170 Sparc with 256MB memory running Solaris 2.5.1 with the following configuration: 4mm tape stacker on SCSI 2 Fast/Wide; 4GB disk device on SCSI 2 Fast/Wide; and Sony Petaserve on Fast/Wide differential SCSI 2.

Venkataraman, Ravi↗
DOE OSTI2022

Are Terrestrial Biosphere Models Fit for Simulating the Global Land Carbon Sink?

The Global Carbon Project estimates that the terrestrial biosphere has absorbed about one-third of anthropogenic CO 2 emissions during the 1959–2019 period. This sink-estimate is produced by an ensemble of terrestrial biosphere models and is consistent with the land uptake inferred from the residual of emissions and ocean uptake. The purpose of our study is to understand how well terrestrial biosphere models reproduce the processes that drive the terrestrial carbon sink. One challenge is to decide what level of agreement between model output and observation-based reference data is adequate considering that reference data are prone to uncertainties. To define such a level of agreement, we compute benchmark scores that quantify the similarity between independently derived reference data sets using multiple statistical metrics. Models are considered to perform well if their model scores reach benchmark scores. Our results show that reference data can differ considerably, causing benchmark scores to be low. Model scores are often of similar magnitude as benchmark scores, implying that model performance is reasonable given how different reference data are. While model performance is encouraging, ample potential for improvements remains, including a reduction in a positive leaf area index bias, improved representations of processes that govern soil organic carbon in high latitudes, and an assessment of causes that drive the inter-model spread of gross primary productivity in boreal regions and humid tropics. The success of future model development will increasingly depend on our capacity to reduce and account for observational uncertainties.

58 GEOSCIENCES↗
NASA NTRS2000

Implementation of NAS Parallel Benchmarks in Java

A number of features make Java an attractive but a debatable choice for High Performance Computing (HPC). In order to gauge the applicability of Java to the Computational Fluid Dynamics (CFD) we have implemented NAS Parallel Benchmarks in Java. The performance and scalability of the benchmarks point out the areas where improvement in Java compiler technology and in Java thread implementation would move Java closer to Fortran in the competition for CFD applications.

Frumkin, Michael↗
NASA NTRS2014

On-Orbit Radiometric Characterization of OLI (Landsat 8) for Applications in Aquatic Remote Sensing

Landsat-8 carries two separate sensors, namely the Operational Land Imager (OLI) and the Thermal Infrared Radiometer Suite (TIRS), that image the earth surface throughout the visible and thermal portions of the spectrum. Compared to Landsat heritage sensors, the OLI has enhanced features, which include its 12-bit radiometric resolution and the addition of a band centered at 443 nm. The dramatically improved data quality/quantity expands existing applications of Landsat imagery in aquatic sciences from the retrieval of bio-geochemical properties, such as near-surface concentrations of chlorophyll-a (CHL) and total suspended solids (TSS), to benthic mapping. This study offers analysis of OLI's absolute radiometric performance over bodies ofwater using benchmark observations, namely the top-of-atmosphere (TOA) ocean color observations and marine in situ radiometric measurements. Sensor-to-sensor comparisons are performed to derive gain factors (g1) from near-concurrent observations in TOA radiance and reflectance domains. The gains in the radiance domain were further validated/adjusted by determining a second set of gains (g2) via analysis of OLI-derived water-leaving radiance, i.e., L(sub w) (gamma), against in situ measurements made either at the Ocean Color AErosol RObotic NETwork (AERONETOC) sites or during field campaigns. The analyses yield the OLI calibration uncertainties that need to be accounted forwhen studying aquatic environments. Itwas found that, for the visible and near-infrared channels, the OLI radiometric responses, on average, are well in agreement (b 2 % discrepancies) with the TOA radiances estimated by ocean color satellites or those predicted by models based onmeasurements of aquatic and atmospheric properties. However, the TOA radiance at the new 443-nm band is found to be, on average, 3.4 % larger than the reference observations. The inter-sensor comparisons in the reflectance domain, however, indicated slightly different results with the OLI responses being low in the blue bands. To enhance the retrieval accuracy of aquatic-science products from OLI datasets, sets of temporally averaged gains (radiance and reflectance) are derived and recommended for use prior to the retrieval of in-water products.

Remote Sensing↗
DOE OSTI2022

Selected results from full-core hydrogen redistribution asymptotic analysis in YH-moderated heat-pipe cooled microreactor

Yttrium hydride is the main candidate for moderation of high temperature nuclear microreactors . This is due to its high thermal stability and relatively high hydrogen retention at temperatures exceeding 870 C. One of the main issues associated with the use of yttrium hydride is that, when exposed to temperature, stress, or concentration gradients, the hydrogen contained in the metallic matrix tends to redistribute and leak from the moderating elements, potentially leading to reactivity losses and power swings. This paper is focused on presenting selected results from the asymptotic hydrogen redistribution analysis performed on the Simplified Microreactor Benchmark Assessment (SiMBA) problem, a microreactor core conceptual design developed at INL. The analysis is based on full core analysis, relies uniquely on Bison to perform hydrogen redistribution calculations, and discusses the physical causes of the reactivity feedback. It was found that the feedback is negative, but it is one order of magnitude lower than the one found for the empire reactor unit-cell. This is due to the lower axial temperature gradient together with the effect of the reflector.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speed up job completion, better utilize the available hardware, and visibly reduce costs, especially when renting computers in the cloud. This was demonstrated in earlier studies on HEPCloud. However, the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and it shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. GlideinBenchmark, with the help of the GlideinWMS Factory, controls the benchmark execution. Finally, a scheduler like HEPCloud's Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗