Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Reactive particle-tracking solutions to a benchmark problem on heavy metal cycling in lake sediments

Geochemical systems are known to exhibit highly variable spatiotemporal behavior. This may be observed both in non-smooth concentration curves in space for a single sampling time and also in variability between samples taken from the same location at different times. However, most models that are designed to simulate these systems provide only single-solution smooth curves and fail to capture the noise and variability seen in the data. We apply a recently developed reactive particle-tracking method to a system that displays highly complex geochemical behavior. When the method is made to most closely resemble a corresponding Eulerian method, in its unperturbed form, we see near-exact match between solutions of the two models. More importantly, we consider two approaches for perturbing the model and find that the spatially-perturbed condition is able to capture a greater degree of the variability present in the data. This method of perturbation is a task to which particle methods are uniquely suited and Eulerian models are not well-suited. Additionally, because of the nature of the algorithm, noisy spatial gradients can be highly resolved by a large number of mobile particles, and this incurs negligible computational cost, as compared to expensive chemistry calculations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The battery failure databank: Insights from an open-access database of thermal runaway behaviors of Li-ion cells and a resource for benchmarking risks

The thermal response of Li-ion cells can greatly vary for identical cell designs tested under identical conditions, the distribution of which is costly to fully characterize experimentally. The open-source Battery Failure Databank presented here contains robust, high-quality data from hundreds of abuse tests spanning numerous commercial cell designs and testing conditions. Data was gathered using a fractional thermal runaway calorimeter and contains the fractional breakdown of heat and mass that was ejected, as well as high-speed synchrotron radiography of the internal dynamic response of cells during thermal runaway. The distribution of thermal output, mass ejection, and internal response of commercial cells are compared for different abuse-test conditions, which when normalized on a per amp-hour basis show a strong positive correlation between heat output from cells, the fraction of mass ejected from the cells, their energy- and power-density. Ejected mass was shown to contain 10x more heat per gram than non-ejected mass. The causes of 'outlier' thermal and ejection responses i.e., extreme cases, are elucidated by high-speed radiography which showed how occurrences such as vent clogging can create more hazardous conditions. High-speed radiography also demonstrated how the time-resolved interplay of thermal runaway propagation and mass ejection influences the total heat generated.

25 ENERGY STORAGE↗
DOE OSTI2024

Fundamental benchmarking of the discharge properties of negative electrodes in lead acid batteries

The unprecedented scale of energy storage deployment needed to allow high penetration of intermittent renewable energy sources into the electrical grid places significant economic cost and performance targets on battery technologies. Lead batteries, owing to their highly abundant and inexpensive raw materials, can be considered an important solution to grid storage as long as they achieve high material utilization, fast recharge rates, and long cycle life. To address the limitations in material utilization, we need to revisit the electrochemical processes during the discharge step and answer the following question: what are the fundamental limits of the discharge reaction? In this work we discuss how well-defined lead metal surfaces with nanometer scale roughness allow us to resolve the accessible discharge capacity for both faradaic and non-faradaic processes as a function of electrolyte concentration and in the presence of traditional additives. The direct connection between PbSO 4 layer morphology and discharge rates gives us important insights on the mechanism of discharge as related to the dissolution and passivation events. In conclusion, this work sets the stage for reimagining the design of lead batteries with implications to grid storage applications.

25 ENERGY STORAGE↗
DOE OSTI2025

Benchmarking optimization methods for materials research: Gradient descent and Bayesian optimization for lithium-ion battery aging diagnostics

Accurate and efficient parameter estimation is essential for battery diagnostics and aging analysis. Here, in this study, we compare two optimization-based approaches—gradient descent and Bayesian optimization—for extracting parameters from differential voltage analysis in lithium-ion batteries. While these techniques are widely used, their relative strengths and limitations for this application are not well understood. The study evaluates the trade-offs between these methods in terms of result quality, computational cost, and reliability within this specific application. The diagnostic results from our battery data suggest adopting gradient descent as an initial method for rapid and efficient analysis, while employing more stable optimization techniques, such as Bayesian optimization, as a verification step to mitigate potential instability. Comparing the two methods provides information on algorithmic choice, while inspiring further discussions on selecting appropriate techniques for specific research tasks.

Zhao, Ziqing [Boston Univ., MA (United States)] (O↗
DOE OSTI2023

CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coarse-grained level, such as phases, steps or events, leaving out fine-grained interaction details about the surgical activity; yet those are needed for more helpful AI assistance in the operating room. Recognizing surgical actions as triplets of ‹ instrument, verb, target › combination delivers more comprehensive details about the activities taking place in surgical videos. This paper presents CholecTriplet2021: an endoscopic vision challenge organized at MICCAI 2021 for the recognition of surgical action triplets in laparoscopic videos. Here, the challenge granted private access to the large-scale CholecT50 dataset, which is annotated with action triplet information. In this paper, we present the challenge setup and the assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge. Here, a total of 4 baseline methods from the challenge organizers and 19 new deep learning algorithms from the competing teams are presented to recognize surgical action triplets directly from surgical videos, achieving mean average precision (mAP) ranging from 4.2% to 38.1%. This study also analyzes the significance of the results obtained by the presented approaches, performs a thorough methodological comparison between them, in-depth result analysis, and proposes a novel ensemble method for enhanced recognition. Our analysis shows that surgical workflow analysis is not yet solved, and also highlights interesting directions for future research on fine-grained surgical activity recognition which is of utmost importance for the development of AI in surgery.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Benchmark CO 2 separation achieved by highly fluorinated nanoporous molecular sieve membranes from nonporous precursor via in situ cross-linking

Molecular sieve membranes with rigid micropores and CO 2 -philic functionalities within the architectures are promising candidates in CO 2 separation. However, the development of ctieve approaches for their fabrication still remains a significant challenge. In this study, an in situ cross-linking strategy is developed for the preparation of nanoporous fluorinated moleffecular sieve membranes using commercially available dense and non-porous polystyrene (M PS ) as a precursor template. Based on the dehydrative Friedel-Crafts reactions with highly fluorinated benzylic alcohols, M PS membranes are cross-linked in situ upon exposure to Brønsted acid (CF 3 SO 3 H), affording fluorinated microporous polymeric membranes with surface areas up to 523 m 2 g –1 and the presence of micropores centered at 1.1–1.3 nm as well as ultra-micropores (~0.6 nm). The obtained modified membranes exhibit good ideal CO 2 permeability of 797 barrer and CO 2 /N 2 selectivity of 28.5. In addition, high fluorine content (up to 28.5 wt%) and good thermal stability made the cross-linked membranes promising candidates to produce fluorinated carbon molecular sieve membranes with improved textural properties, exhibiting surface areas up to 1020 m 2 g –1 and ultra-micropores of ~0.4 nm. These membranes achieve superior CO 2 /N 2 separation performances exceeding the Robeson upper bound limit (2008).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Edge-cloud computing performance benchmarking for IoT based machinery vibration monitoring

Advances in low cost and reliable sensing, connectivity (Internet of Things), computational power, and advanced analytics, are leading to a new wave of innovation in machinery status sensing and condition monitoring. Significant research efforts are directed towards cloud computing architectures. However, given the latency, bandwidth, cost, security, and privacy concerns, further supported by the ever-increasing capabilities of edge computing devices, there is a need to consider both edge and cloud computing together to make informed decisions based upon context and performance. In this work, we present an edge-cloud performance evaluation for IoT based machinery vibration monitoring, to foster deployment for the contexts considered.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Benchmarking the Performance of Neuromorphic and Spiking Neural Network Simulators

Software simulators play a critical role in the development of new algorithms and system architectures in any field of engineering. Neuromorphic computing, which has shown potential in building brain-inspired energy-efficient hardware, suffers a slow-down in the development cycle due to a lack of flexible and easy-to-use simulators of either neuromorphic hardware itself or of spiking neural networks (SNNs), the type of neural network computation executed on most neuromorphic systems. While there are several openly available neuromorphic or SNN simulation packages developed by a variety of research groups, they have mostly targeted computational neuroscience simulations, and only a few have targeted small-scale machine learning tasks with SNNs. Evaluations or comparisons of these simulators have often targeted computational neuroscience-style workloads. In this work, we seek to evaluate the performance of several publicly available SNN simulators with respect to non-computational neuroscience workloads, in terms of speed, flexibility, and scalability. We evaluate the performance of the NEST, Brian2, Brian2GeNN, BindsNET and Nengo packages under a common front-end neuromorphic framework. Our evaluation tasks include a variety of different network architectures and workload types to mimic the computation common in different algorithms, including feed-forward network inference, genetic algorithms, and reservoir computing. We also study the scalability of each of these simulators when running on different computing hardware, from single core CPU workstations to multi-node supercomputers. Our results show that the BindsNET simulator has the best speed and scalability for most of the SNN workloads (sparse, dense, and layered SNN architectures) on a single core CPU. However, when comparing the simulators leveraging the GPU capabilities, Brian2GeNN outperforms the others for these workloads in terms of scalability. NEST performs the best for small sparse networks and is also the most flexible simulator in terms of reconfiguration capability NEST shows a speedup of at least 2x compared to the other packages when running evolutionary algorithms for SNNs. The multi-node and multi-thread capabilities of NEST show at least 2x speedup compared to the rest of the simulators (single core CPU or GPU based simulators) for large and sparse networks. We conclude our work by providing a set of recommendations on the suitability of employing these simulators for different tasks and scales of operations. We also present the characteristics for a future generic ideal SNN simulator for different neuromorphic computing workloads.

97 MATHEMATICS AND COMPUTING↗