Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Extending the Licklider Transmission Protocol to Multi-Band Links

Most deep space missions return data to Earth using links operating at a single frequency band. Indeed, their data requirements are low enough that bandwidth regulations do not constrain the system. In contrast, spacecraft such as Kepler or Europa Clipper are transitioning to a new operational paradigm where engineering and science data are transmitted through simultaneous links operating at different frequency bands (henceforth termed multi-band links). This ensures, for instance, that critical data is correctly received using a well characterized X-band link, while science data at a much larger data rate can be returned efficiently (both in terms of bandwidth and energy) through a Ka-band link.Having a spacecraft establish two simultaneous links with a ground station opens a large span of potential improvements for space communications and mission operations. In this paper, we consider the problem of running a Licklider Transmission Protocol (LTP) session over a multi-band link. LTP is an implementation of a selective Automatic Repeat reQuest (ARQ) protocol, i.e. it ensures correct delivery of data over an error prone link with potentially long propagation delays. To maximize its efficiency in deep space environments, LTP operates in deferred-ACK mode and is typically included as one of the core protocols in the Delay Tolerant Networking (DTN) suite.The contributions of this paper are as follows: First, we propose an extension to LTP for multi-band links (denoted MBLTP) and sketch how it can be implemented without modifying the current definition of LTP data units. Next, we develop bounds on the performance of MBLTP when transmitting a single data file over a multi-band link. Three metrics are considered, file expected delivery time, total energy spent and bundle jitter. The results of the analytic model are first benchmarked against simulations to ensure validity, and then compared against the performance of both traditional LTP and Parallel LTP (PLTP).We demonstrate that MBLTP can significantly reduce the latency and jitter with which data products are delivered to destination over a deep space link compared to LTP at moderate energy cost. Similarly, we also demonstrate that MBLTP outperforms PLTP in all considered metrics.

Sanchez Net, Marc↗
NASA NTRS2023

Sub-Continental-Scale Carbon Stocks of Individual Trees in African Drylands

The distribution of dryland trees and their density, cover, size, mass and carbon content are not well known at sub-continental to continental scales. This information is important for ecological protection, carbon accounting, climate mitigation and restoration efforts of dryland ecosystems. We assessed more than 9.9 billion trees derived from more than 300,000 satellite images, covering semi-arid sub-Saharan Africa north of the Equator. We attributed wood, foliage and root carbon to every tree in the 0–1,000 mm year −1 rainfall zone by coupling field data, machine learning, satellite data and high-performance computing. Average carbon stocks of individual trees ranged from 0.54 Mg C ha −1 and 63 kg C tree −1 in the arid zone to 3.7 Mg C ha −1 and 98 kg tree −1 in the sub-humid zone. Overall, we estimated the total carbon for our study area to be 0.84 (±19.8%) Pg C. Comparisons with 14 previous TRENDY numerical simulation studies23 for our area found that the density and carbon stocks of scattered trees have been underestimated by three models and overestimated by 11 models, respectively. This benchmarking can help understand the carbon cycle and address concerns about land degradation. We make available a linked database of wood mass, foliage mass, root mass and carbon stock of each tree for scientists, policymakers, dryland-restoration practitioners and farmers, who can use it to estimate farmland tree carbon stocks from tablets or laptops.

Compton Tucker↗
NASA NTRSDate not supplied

Exploring Quantum State Preparation Using Tensor Networks and Sparse Wavefunction Simulations

The variational quantum eigenvalue solver is a powerful hybrid quantum-classical approach that has been suggested as a candidate method to run on near-term quantum hardware for computing ground state electronic energies of molecular systems. However, even for small molecules, the number of variational parameters and qubits required to minimize the electronic energy is beyond the reach of current quantum computers except for small basis sets. We explore a new paradigm for state preparation where we test how much of the optimization can be approximately prepared with classical computers to reduce the number of optimization steps performed using a quantum device. By adapting a recent algorithm for the factorized form of the UCC ansatz, we can study molecular electronic structure problems with up to 64 qubits. In addition, we also test a related approach of using tensor networks to optimize quantum circuits in order to benchmark various lattice models. We present results using these approaches and discuss strategies for incorporating these ideas into variational algorithms involving near-term quantum computers. Our results help demonstrate the strength of the UCC ansatz and address pressing questions about optimal initial parameterizations and circuit construction.

quantum computing↗
DOE OSTI2022

Techno-Economic Implications of Electrical Machine Scaling for Wave Energy Converters: Preprint

The sizing of an electrical machine for a Wave Energy Converter (WEC) can have a substantial impact on the overall sizing, cost, and rating of the device. An electrical generator is typically part of the power take-off (PTO) system, which is the mechanism by which the energy absorbed by the prime mover is transformed into useable electrical. For practically all WECs, the rate of change of actuation is predominantly determined by the wave resource (i.e., the wave height and frequency) and devices will see a sinusoidally varying velocity according to the wave conditions. The same can then be said for both directly and indirectly coupled PTOs with electrical generators. This techno-economic study investigates electrical machine scaling and associated cost implications through core machine design theory, manufacturer data, supporting literature, and the DOE sponsored Reference Model Project (RMP). The RMP was a partnered effort to develop open-source marine energy (ME) point designs as reference models (RMs) to benchmark ME technology performance and costs, methods for design and analysis of ME technologies, estimations for capital costs, operational costs, and levelized costs of energy (LCOE). The results from this study show torque is directly related to (1) the physical size of the machine required to increase the airgap sheer stresses, (2) the amount of active material, (3) the support structure, (4) bearing size and rating, and (5) offshore cable rating, all of which have a significant effect on overall system costs in terms of both CAPEX and OPEX. This paper aims to be a critical benchmark in helping determine an “optimal” nameplate rating for wave energy devices and their associated PTO. With an optimized rating and sizing process, WEC costs can be reduced, and overall performance can be improved.

cables↗
DOE OSTI2022

Techno-Economic Implications of Electrical Machine Scaling for Wave Energy Converters

The sizing of an electrical machine for a Wave Energy Converter (WEC) can have a substantial impact on the overall sizing, cost, and rating of the device. An electrical generator is typically part of the power take-off (PTO) system, which is the mechanism by which the energy absorbed by the prime mover is transformed into useable electrical. For practically all WECs, the rate of change of actuation is predominantly determined by the wave resource (i.e., the wave height and frequency) and devices will see a sinusoidally varying velocity according to the wave conditions. The same can then be said for both directly and indirectly coupled PTOs with electrical generators. This techno-economic study investigates electrical machine scaling and associated cost implications through core machine design theory, manufacturer data, supporting literature, and the DOE sponsored Reference Model Project (RMP). The RMP was a partnered effort to develop open-source marine energy (ME) point designs as reference models (RMs) to benchmark ME technology performance and costs, methods for design and analysis of ME technologies, estimations for capital costs, operational costs, and levelized costs of energy (LCOE). The results from this study show torque is directly related to (1) the physical size of the machine required to increase the airgap sheer stresses, (2) the amount of active material, (3) the support structure, (4) bearing size and rating, and (5) offshore cable rating, all of which have a significant effect on overall system costs in terms of both CAPEX and OPEX. This paper aims to be a critical benchmark in helping determine an “optimal” nameplate rating for wave energy devices and their associated PTO. With an optimized rating and sizing process, WEC costs can be reduced, and overall performance can be improved.

cables↗
DOE OSTI2024

Summary of a Workshop on Integrating Energy Equity into Power System Planning and Operation

On November 29 and 30, 2023, the Energy Systems Integration Group convened a one-and-a-half-day workshop in Arlington, Virginia, to improve knowledge and practices for integrating energy equity considerations into power system planning and operation. Workshop participants were invited to discuss approaches for integrating energy equity aspects into models and tools and to explore possible pathways for enhanced technical practices. Participants included utility planning and modeling practitioners, social science and energy justice academics, representatives from energy and environmental justice nongovernmental organizations, non-profits, consumer advocates, and representatives from the U.S. Department of Energy, national labs, and other government agencies. This report summarizes the discussion points and outcomes of the workshop, which prioritized the technical aspects of incorporating the challenges and solutions identified by electricity-futures stakeholders and communities. These technical activities include the fundamental grid structure and hardware, detailed modeling approaches that benchmark energy system performance and justify future investments, and engineering designs and limitations for potential solutions to meet energy equity goals in communities.

energy equity↗
DOE OSTI2022

Assessing the Impact of Effective Thermal Conductivity on Gas-cooled Reactor Transients in RELAP5-3D

In block-type high-temperature gas-cooled reactors (HTGRs), coolant holes in blocks lead to a reduction in heat transfer through conduction. In systems codes like RELAP5-3D, we must account for this degradation by using an effective thermal conductivity (ETC). This presentation discusses a few ETC relationships and demonstrates the impact of ETC for the modular High-Temperature Gas-Cooled Reactor 350 MW -- a computational benchmark for HTGR modeling -- and for the High Temperature Test Facility (HTTF) -- an HTGR thermal hydraulics test facility. We demonstrate that the use of ETC leads to temperatures that are higher than the bulk thermal conductivity of the block material would yield, but these differences have no meaningful impact on the transient performance of the reactors. The ETC also reduces the cooldown rate, leading to more time at elevated temperatures. Overall, while accounting for ETC is important in capturing the physics of the reactor, it is not expected to have a meaningful impact on transient performance.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Patch Hierarchical Attention Transformer for Efficient Particle Jet Tagging

Real-time jet tagging is critical for identifying short-lived particle decays in the high-throughput detectors of the Large Hadron Collider, where real-time trigger systems responsible for deciding which collision events to store impose strict latency and accuracy constraints. While transformer architectures achieve the highest jet tagging accuracy when compute is unconstrained, their quadratic self-attention cost makes inference restrictive on trigger budget. Existing efficient variants reduce the computational cost, but hinder the classification performance. To address this limitation, we introduce the Patch Hierarchical Attention Transformer (PHAT-JeT), which combines two mechanisms: a physics-inspired geometric message-passing module that encodes local detector-plane structure, and a hierarchical patch-based attention scheme that computes exact attention within small particle groups while preserving global context through lightweight patch-token communication. Within a restricted budget, PHAT-JeT achieves state-of-the-art accuracy and background rejection among all resource-constrained jet tagging models on four benchmarks (\textsc{hls4ml}, JetClass, Top Tagging, and Quark--Gluon). Our code is available at https://github.com/aaronw5/PHAT-JeT.

Wang, Aaron [Illinois U., Chicago] (ORCID:00000003↗
DOE OSTI2022

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Synthesis of results for Brine Availability Test in Salt (BATS) DECOVALEX-2023 Task E

In the 2023 phase of the international collaborative DECOVALEX modeling project, Task E focused on understanding thermal, hydrological, and mechanical (THM) processes related to predicting brine migration in the excavation damaged zone around a heated excavation in salt. Salt is attractive as a disposal medium for radioactive waste because it is self-healing and is essentially impermeable and non-porous in the far field. Investigation of the short-term, near-field behavior is important for radioactive waste disposal because this early period strongly controls the amount of inflowing brine. Brine leads to corrosion of waste forms and waste packages, and possible dissolution of radionuclides with brine transport being a potential transport vector to the accessible environment.The Task was divided into steps. Step 0 included matching unheated brine inflow data from boreholes at the Waste Isolation Pilot Plant (WIPP) and matching temperature observations during a Brine Availability Test in Salt (BATS) heater test. Step 1 included validation of models against a thermo-poroelastic analytical solution, and two-phase flow around an excavation. Finally, Step 2 required all the individual components covered in steps 0 and 1 to come together to match observed brine inflow behavior during the same BATS heater test.There were a range of approaches from the teams, from mechanistic to prescriptive. Given the uncertainties in the problem, some teams used one- or two-dimensional models of the processes, while other teams included more geometrical complexity in three-dimensional models. Task E was a learning experience for the teams involved, and feedback from the modeling teams has led to changes in follow-on BATS experiments at WIPP. The primary Task E lessons learned were the impact of hydrologic initialization methods (wetting up vs. drying down), the difference between confined and unconfined thermal expansion, and the large changes in permeability associated with heating and cooling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Ecological Insights from Transferable Plant Biomass Mapping across the Arctic using High-resolution Structure-from-Motion and LiDAR Data

Warmer temperatures, permafrost thaw, and increased wildfire activity are driving rapid ecological change across the Arctic, significantly altering plant productivity and aboveground biomass (AGB). These rapid changes highlight the urgent need to improve monitoring of vegetation dynamics in the Earth’s northern ecosystems, where high spatiotemporal heterogeneity occurs at scales finer than those captured by traditional satellite observations. The growing use of Unoccupied Aerial Systems (UASs) presents an opportunity to overcome this limitation. Yet, the diversity of UAS platforms, sensors, and data collection and processing workflows presents challenges for developing standardized, generalizable approaches. To address this challenge, we compiled 672 AGB plots co-located with 183 UAS-based Structure-from-Motion (SfM) or Light Detection and Ranging (LiDAR) surveys collected across the Arctic. Here, we: (1) evaluated the generalizability of UAS-derived canopy structure derived from high-resolution SfM and LiDAR for estimating AGB, (2) assessed scaling errors and their sources in two recent satellite-based AGB products derived from Landsat and MODIS, and (3) demonstrated the use of high-resolution AGB maps to quantify biomass variation across tundra plant functional types (PFTs) and to monitor post-fire recovery. Our results show that both SfM and LiDAR accurately captured AGB and its variability across tundra PFTs using a Random Forest (RF) model (overall RMSE: 0.336 kg/m2), with mapping performance varying slightly by region and data source. Using UAS-derived AGB maps as a benchmark, we identified systematic biases in satellite-derived AGB products, largely attributable to the magnitude of AGB and structural heterogeneity within coarse-resolution pixels. Applying our model to repeat UAS surveys following a tundra fire on Seward Peninsula, we observed rapid AGB recovery in non-shrub patches, with biomass recovering to pre-fire levels within 2 years. In contrast, shrub patches recovered more slowly, with AGB gains continuing over 2–4 years through both in-patch growth and lateral expansion (via dispersal) into remaining burned areas. Overall, these findings demonstrate the generalizability of UAS-based SfM and LiDAR data for estimating tundra AGB and highlight the potential of our approach to be broadly applied to generate high-quality AGB data for ecological monitoring and model benchmarking across the Arctic.

Yang, Daryl [ORNL] (ORCID:0000000317057823)↗
DOE OSTI2021

Rate-Based Absorption Modeling for Postcombustion CO 2 Capture with Additively Manufactured Structured Packing

Carbon capture using amine-based solvents in an absorption process is a leading candidate for reducing greenhouse gas emissions in industrial flue gas streams. To reduce operating costs and associated parasitic energy of these processes, process intensification utilizing additively manufactured structured packing has emerged as a new technology to manage exothermic reactions during absorption while improving CO 2 capture. A rate-based model framework has been developed for these novel packings that incorporates the mass and heat transfer phenomena for amine-based absorption of CO 2 . The rate-based model framework is first benchmarked using available solubility data and pilot plant data for aqueous monoethanolamine. The model validation shows accurate prediction of both CO 2 equilibrium partial pressures and ion speciation for solubility data as well as CO 2 capture, temperature profile, and solvent composition for pilot plant data in the absorption column. The model framework is then applied toward predicting the CO 2 capture performance of additively manufactured structured packing. Simulations agree with experimental data in predicting the CO 2 capture and the capture performance increase due to cooling within the structured packing device. Finally, advantages of this rate-based model framework are the utilization of correlations that may predict mass transfer and heat transfer coefficients of the packing based on the geometric properties of the device and the implementation of the model framework in open-source programming.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Modeling of thermal pressurization in tight claystone using sequential THM coupling: Benchmarking and validation against in-situ heating experiments in COx claystone

We apply thermoporoelasticity and a sequentially coupling technique for modeling thermally-driven coupled Thermo-Hydro-Mechanical (THM) processes in tight claystone. A THM benchmark case with a corresponding analytic solution for thermoporoelasticity under a constant heat loading verifies the model. Thereafter, two in situ heating experiments are simulated for model validation: a smaller-scale heating experiment (TED experiment) and a larger-scale experiment (ALC experiment) in Callovo-Oxfordian (COx) claystone at the Meuse/Haute-Marne underground research laboratory in France. The model exhibits good performance to match the observed temperature and pore pressure evolution for the smaller-scale TED experiment. For the larger-scale ALC experiment, general trends of thermal-pressurization are captured in the modeling, but pressure is underestimated at some monitoring points during cool-down. This indicates that the THM response in the field may be affected by the variability of rock's properties or irreversible or time-dependent mechanical processes that are not included in the current thermoporoelastic model. The main contributions of this work are as follows: (1) we verify and validate the numerical simulator, TOUGH-FLAC, to be a valuable coupled THM modeling tool; (2) prove that the laboratory determined material parameters can be used as reference values for upscaling experiments. However, to better identify and quantify THM processes with modeling of in situ tests, more emphasize should be dedicated to obtaining high-quality mechanical deformation data.

58 GEOSCIENCES↗
DOE OSTI2022

REGAL International Program: Analysis of experimental data for depletion code validation

The Rod-Extremity and Gadolinia AnaLysis (REGAL) Program is a joint international effort to expand the nuclide inventory experimental data for irradiated nuclear fuel, with a specific focus on addressing two challenging needs associated with the characterization of modern, high duty, nuclear fuel. The first challenge is filling the gaps in experimental nuclide inventory data for gadolinia (UO 2 –Gd 2 O 3 ) fuel rods. The huge absorption cross sections of Gd-155 and Gd-157 in the Gd dopant in these rods lead to atypical spatial self-shielding patterns and have an impact on the neutronic environment within the fuel assembly compared to regular UO 2 fuel rods. Additionally, the second challenge is investigating the impact of burnup gradients at rod extremities on fuel composition and neutron leakage, to provide relevant experimental data for assessing computational capabilities to model such impact. A benchmark has been defined as a first step in the development of best-estimate models in the preliminary phase of the experimental data evaluation. Comparison of experimental results obtained in Phase I of the program for two measured pressurized water reactor (PWR) samples, one UO 2 and one UO 2 –Gd 2 O 3 sample, with calculated results obtained with different computational tools based on the defined benchmark are presented and discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Implementation of a realistic artificial data generator for crash data generation

In this paper, a framework is outlined to generate realistic artificial data (RAD) as a tool for comparing different models developed for safety analysis. The primary focus of transportation safety analysis is on identifying and quantifying the influence of factors contributing to traffic crash occurrence and its consequences. The current framework of comparing model structures using only observed data has limitations. With observed data, it is not possible to know how well the models mimic the true relationship between the dependent and independent variables. Further, real datasets do not allow researchers to evaluate the model performance for different levels of complexity of the dataset. RAD offers an innovative framework to address these limitations. Hence, we propose a RAD generation framework embedded with heterogeneous causal structures that generates crash data by considering crash occurrence as a trip level event impacted by trip level factors, demographics, roadway and vehicle attributes. Within our RAD generator we employ three specific modules: (a) disaggregate trip information generation, (b) crash data generation and (c) crash data aggregation. For disaggregate trip information generation, we employ a daily activity-travel realization for an urban region generated from an established activity-based model for the Chicago region. We use this data of more than 2 million daily trips to generate a subset of trips with crash data. For trips with crashes crash location, crash type, driver/vehicle characteristics, and crash severity. The daily RAD generation process is repeated for generating crash records at yearly or multi-year resolution. In conclusion, the crash databases generated can be employed to compare frequency models, severity models, crash type and various other dimensions by facility type - possibly establishing a universal benchmarking system for alternative model frameworks in safety literature.

42 ENGINEERING↗
DOE OSTI2021

U.S. Solar Photovoltaic System and Energy Storage Cost Benchmarks: Q1 2021

NREL has been modeling U.S. solar photovoltaic (PV) system costs since 2009. This year, our report benchmarks costs of U.S. PV for residential, commercial, and utility-scale systems, with and without storage, built in the first quarter of 2021 (Q1 2021). The methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems and it models the capital costs and levelized cost of energy for such systems.

14 SOLAR ENERGY↗
DOE OSTI2021

Early Evaluation of Fugaku A64FX Architecture Using Climate Workloads

The Energy Exascale Earth System Model (E3SM) Project is an ongoing, state-of-the-science Earth system modeling, simulation, and prediction project that targets efficient utilization of U.S. Department of Energy’s (DOE) supercomputers to meet the science needs of the nation and the mission needs of DOE. This work focuses on our early evaluation of the A64FX architecture on Fugaku supercomputer using E3SM benchmarks. We will present results that track hardware trends, facilitate architecture comparison and the specific impact on our workload using an atmospheric model benchmark. We have two variants of the code written in Fortran and C++/Kokkos respectively which were used to collect data on a variety of CPU and GPU platforms. Furthermore, we have conducted a comparative evaluation of the compilers on the A64FX architecture and found GNU to be the best performer for our workload. Our experience so far indicates that Fugaku/A64FX shows promising energy efficiency (performance/Watt) with further performance gains possible through architecture-aware optimization efforts.

Sreepathi, Sarat↗
DOE OSTI2025

Benchmark Tracking System for Performance Monitoring

Benchmarking is essential for high-performance software development, particularly for monitoring performance across code iterations. This project focused on enhancing the benchmarking process for Lamellar, an asynchronous runtime for High-Performance Computing (HPC) systems developed at Pacific Northwest National Laboratory. Prior to this work, benchmark results were difficult to track and compare across code versions, presenting significant challenges in identifying performance regressions and long-term trends. The primary objective was to establish a systematic, reproducible approach for measuring performance and detecting regressions following code commits. Our methodology involved three key components: standardizing benchmark outputs, implementing data versioning, and developing analysis tools. We standardized the benchmark output format to JSON Line records containing specific fields (execution time, hardware specifications, and environmental variables). To address data management challenges, we evaluated several options and eventually chose a git repository dedicated to benchmark data. We developed a suite of Python tools that processed benchmark results, enriched them with metadata, and facilitated search in the repository. The resulting system enables more efficient filtering and comparison of performance metrics across commit histories, hardware configurations, and benchmark variants through a unified query interface. Our implementation reduces computational overhead by first checking for existing results through configuration matching before initiating new benchmark runs, thereby conserving resources. The system has been validated by Lamellar developers. It organizes results by benchmark type and build configurations for efficient retrieval. Future developments include a planned Large Language Model interface for predicting benchmark performance, incorporating the criterion package for statistical analysis, which will enable automated detection of statistically significant performance changes, and integration with continuous integration pipelines. Despite these enhancements being reserved for future work, this project has successfully provided the Lamellar development team with a framework for maintaining consistent performance standards and identifying optimization opportunities across workloads and hardware environments.

97 MATHEMATICS AND COMPUTING↗