Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Benchmarking the Lab Fellows Program

PNNL’s Fellows are recognized as having attained the institution’s highest level of scientific and technical achievement. These individuals are internationally recognized by their peers and have demonstrated innovation and leadership throughout their careers. PNNL’s Independent Oversight (IO) office led an assessment to benchmark how other research and development organizations identify, advance, recognize, and utilize their Fellows.

99 GENERAL AND MISCELLANEOUS↗

DAOS Benchmarks and Findings

We benchmark DAOS on a 127-node, 4,064-target pool using fio, IOR, IO500, and mdtest, comparing the DFS API against DFuse+POSIX. Single-client fio sweeps show larger block sizes and writes yield higher bandwidth, with similar random/sequential performance. Multi-node IOR (1–32 nodes, 6–48 tasks/node) shows bandwidth saturating around 32 tasks/node, with large transfer sizes hurting read throughput at high concurrency and write latency growing faster than read latency. An 8-node IO500 run shows DFS achieving ~5x higher bandwidth and ~190x higher IOPS than POSIX. We also detail operational issues: SCM target-filling under mdtest, intermittent NA_HOSTUNREACH errors, fio CPU-affinity failures, and a pool error storm resolved by recreation.

George, Rebecca [Thomas Jefferson National Acceler↗

Benchmarking DAOS Filesystem on Aurora

We benchmark the DAOS filesystem on Argonne's Aurora supercomputer (127 nodes, 4,064 targets) using fio, IOR, mdtest, and IO500 to characterize I/O and metadata performance across the DFS API and DFuse+POSIX. Single-client fio shows POSIX bandwidth saturating at 1–2 MiB I/O sizes, with write-heavy workloads outperforming reads. Multi-node IOR shows DFS bandwidth scaling well up to ~32 tasks/node, with write latency growing faster than read latency. An 8-node IO500 evaluation shows DFS achieving ~5x higher bandwidth and ~190x higher IOPS than POSIX. Results indicate DAOS is well-suited to read-heavy workloads like AI training data loading, given appropriately sized transfers and concurrency.

George, Rebecca [College of William and Mary, Will↗

Evaluation of Sandia NCS Benchmark Suite Updates

Description of impacts to Sandia NCS benchmark suite following implementation of ENDF/B-VIII.0 nuclear data library. Presentation accompaniment to paper and abstract submission with the same titles.

Morell-Pacheco, Andres Guillermo [Sandia National ↗

Classical Benchmarks for Variational Quantum Eigensolver Simulations of the Hubbard Model

Simulating the Hubbard model is of great interest to a wide range of applications within condensed matter physics, however its solution on classical computers remains challenging in dimensions larger than one. The relative simplicity of this model, embodied by the sparseness of the Hamiltonian matrix, allows for its efficient implementation on quantum computers, and for its approximate solution using variational algorithms such as the variational quantum eigensolver. While these algorithms have been shown to reproduce the qualitative features of the Hubbard model, their quantitative accuracy in terms of producing true ground state energies and other properties, and the dependence of this accuracy on the system size and interaction strength, the choice of variational ansatz, and the degree of spatial inhomogeneity in the model, remains unknown. Here we present a rigorous classical benchmarking study, demonstrating the potential impact of these factors on the accuracy of the variational solution of the Hubbard model on quantum hardware, for systems with up to 32 qubits. We find that even when using the most accurate wavefunction ansätze for the Hubbard model, the error in its ground state energy and wavefunction plateaus for larger lattices, while stronger electronic correlations magnify this issue. Concurrently, spatially inhomogeneous parameters and the presence of off-site Coulomb interactions only have a small effect on the accuracy of the computed ground state energies. Our study highlights the capabilities and limitations of current approaches for solving the Hubbard model on quantum hardware, and we discuss potential future avenues of research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Inventory of AI-ready Benchmark Data for US Fires, Heatwaves, and Droughts

Extreme weather events, including fires, heatwaves, and droughts, have significant impacts on earth, environmental, and energy systems. Mechanistic and predictive understanding, as well as probabilistic risk assessment of these extreme weather events, are crucial for detecting, planning for, and responding to these extremes. Records of extreme weather events provide an important data source for understanding present and future extremes, but the existing data needs preprocessing before it can be used for analysis. Moreover, there are many nonstandard metrics defining the levels of severity or impacts of extremes. In this study, we compile a comprehensive benchmark data inventory of extreme weather events, including fires, heatwaves, and droughts. The dataset covers the period from 2001 to 2020 with a daily temporal resolution and a spatial resolution of 0.5°×0.5° (~55km×55km) over the continental United States (CONUS), and a spatial resolution of 1km × 1km over the Pacific Northwest (PNW) region, together with the co-located and relevant meteorological variables. By exploring and summarizing the spatial and temporal patterns of these extremes in various forms of marginal, conditional, and joint probability distributions, we gain a better understanding of the characteristics of climate extremes. The resulting AI/ML-ready data products can be readily applied to ML-based research, fostering and encouraging AI/ML research in the field of extreme weather. This study can contribute significantly to the advancement of extreme weather research, aiding researchers, policymakers, and practitioners in developing improved preparedness and response strategies to protect communities and ecosystems from the adverse impacts of extreme weather events. Usage Notes We presented a long term (2001-2020) and comprehensive data inventory of historical extreme events with daily temporal resolution covering the separate spatial extents of CONUS (0.5°×0.5°) and PNW(1km×1km) for various applications and studies. The dataset with 0.5°×0.5° resolution for CONUS can be used to help build more accurate climate models for the entire CONUS, which can help in understanding long-term climate trends, including changes in the frequency and intensity of extreme events, predicting future extreme events as well as understanding the implications of extreme events on society and the environment. The data can also be applied for risk accessment of the extremes. For example, ML/AI models can be developed to predict wildfire risk or forecast HWs by analyzing historical weather data, and past fires or heateave , allowing for early warnings and risk mitigation strategies. Using this dataset, AI-driven risk assessment models can also be built to identify vulnerable energy and utilities infrastructure, imrpove grid resilience and suggest adaptations to withstand extreme weather events. The high-resolution 1km×1km dataset ove PNW are advantageous for real-time, localized and detailed applications. It can enhance the accuracy of early warning systems for extreme weather events, helping authorities and communities prepare for and respond to disasters more effectively. For example, ML models can be developed to provide localized HW predictions for specific neighborhoods or cities, enabling residents and local emergency services to take targeted actions; the assessment of drought severity in specific communities or watersheds within the PNW can help local authorities manage water resources more effectively.

Lin, Xinming↗

Benchmarking Adaptive Variational Quantum Eigensolvers

By design, the variational quantum eigensolver (VQE) strives to recover the lowest-energy eigenvalue of a given Hamiltonian by preparing quantum states guided by the variational principle. In practice, the prepared quantum state is indirectly assessed by the value of the associated energy. Novel adaptive derivative-assembled pseudo-trotter (ADAPT) ansatz approaches and recent formal advances now establish a clear connection between the theory of quantum chemistry and the quantum state ansatz used to solve the electronic structure problem. Here we benchmark the accuracy of VQE and ADAPT-VQE to calculate the electronic ground states and potential energy curves for a few selected diatomic molecules, namely H 2 , NaH, and KH. Using numerical simulation, we find both methods provide good estimates of the energy and ground state, but only ADAPT-VQE proves to be robust to particularities in optimization methods. Another relevant finding is that gradient-based optimization is overall more economical and delivers superior performance than analogous simulations carried out with gradient-free optimizers. The results also identify small errors in the prepared state fidelity which show an increasing trend with molecular size.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

On the Fidelity of Computational Models for the Flow of Milled Loblolly Pine: A Benchmark Study on Continuum-Mechanics Models and Discrete-Particle Models

The upstream of bioenergy industry has suffered from unreliable operations of granular biomass feedstocks in handling equipment. Computational modeling, including continuum-mechanics models and discrete-particle models, offers insightful understandings and predictive capabilities on the flow of milled biomass and can assist equipment design and optimization. This paper presents a benchmark study on the fidelity of the continuum and discrete modeling approaches for predicting granular biomass flow. We first introduce the constitutive law of the continuum-mechanics model and the contact law of the coarse-grained discrete-particle model, with model parameters calibrated against laboratory characterization tests of the milled loblolly pine. Three classical granular material flow systems (i.e., a lab-scale rotating drum, a pilot-scale hopper, and a full-scale inclined plane) are then simulated using the two models with the same initial and boundary conditions as the physical experiments. The close agreement of the numerical predictions with the experimental measurements on the hopper mass flow rate, the hopper critical outlet width, the material stopping thickness on the inclined plane, and the dynamic angle of repose, clearly indicates that the two methods can capture the critical flow behavior of granular biomass. The qualitative comparison shows that the continuum-mechanics model outperforms in parameterization of materials and wall friction, and large-scale systems, while the discrete-particle model is more preferred for discontinuous flow systems at smaller scales. Industry stakeholders can use these findings as guidance for choosing appropriate numerical tools to model biomass material flow in part of the optimization of material handling equipment in biorefineries.

Jin, Wencheng↗

Benchmarking Autonomous Scattering Experiments Illustrated on TAS

With the advancement of artificial intelligence and machine learning methods, autonomous approaches are recognized to have great potential for performing more efficient scattering experiments. In our view, it is crucial for such approaches to provide thorough evidence about respective performance improvements in order to increase acceptance within a scientific community. Therefore, we propose a benchmarking procedure designed as a cost-benefit analysis that is applicable to any scattering method sequentially collecting data during an experiment. For a given approach, the performance assessment is based on how much benefit, given a certain cost budget, it is able to acquire in predefined test cases. Different approaches thus get a chance for comparison and can make their advantages explicit and visible. Key components of the procedure, i.e., cost measures, benefit measures, and test cases, are made precise for the setting of three-axes spectrometry (TAS) as an illustration. Finally, we discuss neglected aspects and possible extensions for the TAS setting and comment on the procedure’s applicability to other scattering methods. A Python implementation of the procedure to simplify its utilization by interested researchers from the field is also provided.

36 MATERIALS SCIENCE↗

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗

Benchmarking numerical methods for impact and cratering applications

Large scale computational models are important for studying impact cratering events that are prevalent both on Earth and, more broadly, in this solar system. To address these problems, models must reliably account for both large length scales (e.g., kilometers) and relatively long time scales (hundreds of seconds). This work benchmarks two such approaches, a more traditional hydrodynamics approach and a finite-discrete element method (FDEM), for impact cratering applications. Both 2D and 3D results are discussed for two different impact velocities, 5 km/s and 20 km/s, striking normal to the target and, for 3D simulations, 45° from vertical. In addition, comparisons to previously published data are presented. Finally, differences in how these methods model damage are discussed. Ultimately, both approaches show successful modeling of several different impact scenarios.

58 GEOSCIENCES↗

Benchmarking a 9Cr-2WVTa Reduced Activation Ferritic Martensitic Steel Fabricated via Additive Manufacturing

Reduced activation ferritic (RAF) martensitic steels are promising candidates for the first wall of fusion reactors. However, current manufacturing capabilities call for these components to be made by welding wrought plates. This limits design freedom and necessitates the use of post-weld heat treatments (PWHT) in accordance with the boiler and pressure vessel code. Additive manufacturing (AM) can offer a unique solution to solve this challenge by leveraging the layer-wise deposition strategy to come up with temper bead deposition techniques to eliminate post-processing heat treatments (PPHT). However, it is necessary to benchmark the properties of RAF steels fabricated by AM with their wrought counterparts to identify the process-structure-property correlation, which is the goal of this study. The study demonstrates that while tensile properties at room temperature and high temperatures are satisfactory, the as fabricated and samples after PPHT have significant heterogeneity in tensile elongation. This has been attributed to the presence of discontinuities in the build. The as-fabricated samples have an average tensile strength of 1190 + 12 MPa and an average elongation of 15 + 5% at room temperature and 658 ± 20 MPa ultimate tensile strength (UTS) and 14 ± 7% at 600 °C. After the post-weld heat treatment, mechanical properties decrease to around 600–650 MPa and an elongation between 20–25% at room temperature to 300 MPa UTS and 25–28% elongation at 600 °C. The characterization of microstructures at various length scales demonstrates that the as-fabricated structure has a significant fraction of delta ferrite in a lath martensitic matrix. No precipitates could be identified in the as-fabricated structure. PPHT led to a decrease in the area fraction of delta ferrite and precipitation of M 23 C 6 and MX. Detailed characterization clearly demonstrates that the lack of precipitates in the as-fabricated structure could be due to the slow tempering response of the alloy. Finally, the needs to develop new alloys to achieve the objectives stated above are articulated.

36 MATERIALS SCIENCE↗