Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Benchmarking GEANT4 and PHITS for 14.8-MeV neutron transport in polyethylene and graphite materials

The feasibility of GEANT4 and PHITS with ENDF/B-VIII.0, JEFF-3.3 and JENDL-4.0 evaluated nuclear data libraries in 14.8-MeV neutron transport simulation are verified by comparing with the MCNP calculations and the experimental data. Here the measured data are from neutron integral experiments including graphite and polyethylene samples. For 6 cm-thick polyethylene and 20 cm-thick graphite samples, the results from GEANT4 and PHITS with three evaluated nuclear data libraries agree well with the MCNP calculations. For a 2 cm-thick graphite sample, the simulated results from GEANT4 and PHITS agree with the MCNP calculations, and they all underestimate the experiment data in below 3 MeV and overestimate them in the energy range of 5–7 MeV. The difference between the simulation results and the experimental data depends on the evaluated nuclear data libraries. In overall, GEANT4 and PHITS are performing reasonable jobs for 14.8-MeV neutron transport simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗

Hardware-In-the-Loop Benchmarking Setup for Phasor Based Control Validation

Phasor Based Control is a novel approach to controlling Distributed Energy Resources that aims at relieving various constraints that arise in the distribution grid. It is a two-layer control system with a supervisory control that coordinates distributed controllers to reach voltage phasor targets. The distributed controllers use local synchrophasor measurements and operate as feedback controllers. This control method is currently under development with several algorithms being under consideration for both the central and distributed components. In this report, we present the experimental setup that was prepared to prototype a hardware implementation and validate the control method in Hardware-In-the-Loop.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗

Reactive particle-tracking solutions to a benchmark problem on heavy metal cycling in lake sediments

Geochemical systems are known to exhibit highly variable spatiotemporal behavior. This may be observed both in non-smooth concentration curves in space for a single sampling time and also in variability between samples taken from the same location at different times. However, most models that are designed to simulate these systems provide only single-solution smooth curves and fail to capture the noise and variability seen in the data. We apply a recently developed reactive particle-tracking method to a system that displays highly complex geochemical behavior. When the method is made to most closely resemble a corresponding Eulerian method, in its unperturbed form, we see near-exact match between solutions of the two models. More importantly, we consider two approaches for perturbing the model and find that the spatially-perturbed condition is able to capture a greater degree of the variability present in the data. This method of perturbation is a task to which particle methods are uniquely suited and Eulerian models are not well-suited. Additionally, because of the nature of the algorithm, noisy spatial gradients can be highly resolved by a large number of mobile particles, and this incurs negligible computational cost, as compared to expensive chemistry calculations.

54 ENVIRONMENTAL SCIENCES↗

The battery failure databank: Insights from an open-access database of thermal runaway behaviors of Li-ion cells and a resource for benchmarking risks

The thermal response of Li-ion cells can greatly vary for identical cell designs tested under identical conditions, the distribution of which is costly to fully characterize experimentally. The open-source Battery Failure Databank presented here contains robust, high-quality data from hundreds of abuse tests spanning numerous commercial cell designs and testing conditions. Data was gathered using a fractional thermal runaway calorimeter and contains the fractional breakdown of heat and mass that was ejected, as well as high-speed synchrotron radiography of the internal dynamic response of cells during thermal runaway. The distribution of thermal output, mass ejection, and internal response of commercial cells are compared for different abuse-test conditions, which when normalized on a per amp-hour basis show a strong positive correlation between heat output from cells, the fraction of mass ejected from the cells, their energy- and power-density. Ejected mass was shown to contain 10x more heat per gram than non-ejected mass. The causes of 'outlier' thermal and ejection responses i.e., extreme cases, are elucidated by high-speed radiography which showed how occurrences such as vent clogging can create more hazardous conditions. High-speed radiography also demonstrated how the time-resolved interplay of thermal runaway propagation and mass ejection influences the total heat generated.

25 ENERGY STORAGE↗

Fundamental benchmarking of the discharge properties of negative electrodes in lead acid batteries

The unprecedented scale of energy storage deployment needed to allow high penetration of intermittent renewable energy sources into the electrical grid places significant economic cost and performance targets on battery technologies. Lead batteries, owing to their highly abundant and inexpensive raw materials, can be considered an important solution to grid storage as long as they achieve high material utilization, fast recharge rates, and long cycle life. To address the limitations in material utilization, we need to revisit the electrochemical processes during the discharge step and answer the following question: what are the fundamental limits of the discharge reaction? In this work we discuss how well-defined lead metal surfaces with nanometer scale roughness allow us to resolve the accessible discharge capacity for both faradaic and non-faradaic processes as a function of electrolyte concentration and in the presence of traditional additives. The direct connection between PbSO 4 layer morphology and discharge rates gives us important insights on the mechanism of discharge as related to the dissolution and passivation events. In conclusion, this work sets the stage for reimagining the design of lead batteries with implications to grid storage applications.

25 ENERGY STORAGE↗

Benchmarking optimization methods for materials research: Gradient descent and Bayesian optimization for lithium-ion battery aging diagnostics

Accurate and efficient parameter estimation is essential for battery diagnostics and aging analysis. Here, in this study, we compare two optimization-based approaches—gradient descent and Bayesian optimization—for extracting parameters from differential voltage analysis in lithium-ion batteries. While these techniques are widely used, their relative strengths and limitations for this application are not well understood. The study evaluates the trade-offs between these methods in terms of result quality, computational cost, and reliability within this specific application. The diagnostic results from our battery data suggest adopting gradient descent as an initial method for rapid and efficient analysis, while employing more stable optimization techniques, such as Bayesian optimization, as a verification step to mitigate potential instability. Comparing the two methods provides information on algorithmic choice, while inspiring further discussions on selecting appropriate techniques for specific research tasks.

Zhao, Ziqing [Boston Univ., MA (United States)] (O↗