Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

High-Fidelity, Large-Scale, Realistic Dataset Development

The final report summarizes the work performed for supporting the ARPA-E Grid Optimization Competition (Challenge 2 and Challenge 3) within the stated period. Challenge 2 For the challenge period, the main responsibility of the team is to investigate, gen- erate, and deliver parts of the data sets for the competition, based on the competition model for Challenge 2, existing data sets from Challenge 1, and data source supplied by other data set teams. Challenge 3 For the challenge period, the main responsibility of the team is to propose, create, deliver, and maintain the data format during the competition period. The data format will specify how the benchmark data will be represented and communicated to competitors. It will also specify how competitors should report back the solutions. The data format will be closely aligned with the problem formulation (maintained by the formulation team) and the solution validation process (maintained by the validation team). Our team is also responsible in investigating, generating, and delivering parts of the data sets for the competition. The data sets will be created based on the competition model for Challenge 3, existing data sets from Challenge 1 and Challenge 2, and data source supplied by other data set teams.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Predicting metabolic modules in incomplete bacterial genomes with MetaPathPredict

The reconstruction of complete microbial metabolic pathways using ‘omics data from environmental samples remains challenging. Computational pipelines for pathway reconstruction that utilize machine learning methods to predict the presence or absence of KEGG modules in incomplete genomes are lacking. Here, we present MetaPathPredict, a software tool that incorporates machine learning models to predict the presence of complete KEGG modules within bacterial genomic datasets. Using gene annotation data and information from the KEGG module database, MetaPathPredict employs deep learning models to predict the presence of KEGG modules in a genome. MetaPathPredict can be used as a command line tool or as a Python module, and both options are designed to be run locally or on a compute cluster. Benchmarks show that MetaPathPredict makes robust predictions of KEGG module presence within highly incomplete genomes.

59 BASIC BIOLOGICAL SCIENCES↗

ATP3 Unified Field Study Data

ATP3 Unified Field Study DataThe Algae Testbed Public-Private Partnership ATP3 was established with the goal of investigating open pond algae cultivation across different geographic climatic seasonal and operational conditions while setting the benchmark for quality data collection analysis and dissemination. Identical algae cultivation systems and data analysis methodologies were established at testbed sites across the continental United States and Hawaii. Within this framework the Unified Field Studies UFS were designed to characterize the cultivation of different algal strains during all 4 seasons across this testbed network. The dataset presented here is the complete curated climatic cultivation harvest and biomass composition data for each season at each site. These data enable others to do in-depth cultivation harvest techno-economic life cycle resource and predictive growth modeling analysis as well as develop crop protection strategies for the nascent algae industry.NREL Sub award Number DE-AC36-08-GO28308

09 BIOMASS FUELS↗

BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset

The BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset adds node-level energy consumption data from watt-meters to the primary sweep of the BUTTER - Empirical Deep Learning Dataset. This dataset contains energy consumption and performance data from 63,527 individual experimental runs spanning 30,582 distinct configurations: 13 datasets, 20 sizes (number of trainable parameters), 8 network "shapes", and 14 depths on both CPU and GPU hardware collected using node-level watt-meters. This dataset reveals the complex relationship between dataset size, network structure, and energy use, and highlights the impact of cache effects. BUTTER-E is intended to be joined with the BUTTER dataset (see "BUTTER - Empirical Deep Learning Dataset on OEDI" resource below) which characterizes the performance of 483k distinct fully connected neural networks but does not include energy measurements.

Array↗

Strategic Plan for Nuclear Energy -- Knowledge Base for Advanced Modeling and Simulation (NE-KAMS)

The Nuclear Energy Computational Fluid Dynamics Advanced Modeling and Simulation (NE-CAMS) system is being developed at the Idaho National Laboratory (INL) in collaboration with Bettis Laboratory, Sandia National Laboratory (SNL), Argonne National Laboratory (ANL), Utah State University (USU), and other interested parties with the objective of developing and implementing a comprehensive and readily accessible data and information management system for computational fluid dynamics (CFD) verification and validation (V&V) in support of nuclear energy systems design and safety analysis. The two key objectives of the NE-CAMS effort are to identify, collect, assess, store and maintain high resolution and high quality experimental data and related expert knowledge (metadata) for use in CFD V&V assessments specific to the nuclear energy field and to establish a working relationship with the U.S. Nuclear Regulatory Commission (NRC) to develop a CFD V&V database, including benchmark cases, that addresses and supports the associated NRC regulations and policies on the use of CFD analysis. In particular, the NE-CAMS system will support the Department of Energy Office of Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program, which aims to develop and deploy advanced modeling and simulation methods and computational tools for reliable numerical simulation of nuclear reactor systems for design and safety analysis. Primary NE-CAMS Elements There are four primary elements of the NE-CAMS knowledge base designed to support computer modeling and simulation in the nuclear energy arena as listed below. Element 1. The database will contain experimental data that can be used for CFD validation that is relevant to nuclear reactor and plant processes, particularly those important to the nuclear industry and the NRC. Element 2. Qualification standards for data evaluation and classification will be incorporated and applied such that validation data sets will result in well-defined, well-characterized data. Element 3. Standards will be established for the design and operation of experiments for the generation of new validation data sets that are to be submitted to NE-CAMS that addresses the completeness and characterization of the dataset. Element 4. Standards will be developed for performing verification and validation (V&V) to establish confidence levels in CFD analyses of nuclear reactor processes; such processes will be acceptable and recognized by both CFD experts and the NRC.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Nitrogen and phosphorus cycling in an ombrotrophic peatland: a benchmark for assessing change

Aims Slow decomposition and isolation from groundwater mean that ombrotrophic peatlands store a large amount of soil carbon (C) but have low availability of nitrogen (N) and phosphorus (P). To better understand the role these limiting nutrients play in determining the C balance of peatland ecosystems, we compile comprehensive N and P budgets for a forested bog in northern Minnesota, USA. Methods N and P within plants, soils, and water are quantified based on field measurements. The resulting empirical dataset are then compared to modern-day, site-level simulations from the peatland land surface version of the Energy Exascale Earth System Model (ELM-SPRUCE).

Salmon, Verity G.↗

Benchmarking graph neural networks for materials chemistry

Graph neural networks (GNNs) have received intense interest as a rapidly expanding class of machine learning models remarkably well-suited for materials applications. To date, a number of successful GNNs have been proposed and demonstrated for systems ranging from crystal stability to electronic property prediction and to surface chemistry and heterogeneous catalysis. However, a consistent benchmark of these models remains lacking, hindering the development and consistent evaluation of new models in the materials field. Here, we present a workflow and testing platform, MatDeepLearn, for quickly and reproducibly assessing and comparing GNNs and other machine learning models. We use this platform to optimize and evaluate a selection of top performing GNNs on several representative datasets in computational materials chemistry. From our investigations we note the importance of hyperparameter selection and find roughly similar performances for the top models once optimized. We identify several strengths in GNNs over conventional models in cases with compositionally diverse datasets and in its overall flexibility with respect to inputs, due to learned rather than defined representations. Meanwhile several weaknesses of GNNs are also observed including high data requirements, and suggestions for further improvement for applications in materials chemistry are discussed.

36 MATERIALS SCIENCE↗

Modeling City Building Stock for Large-Scale Energy Efficiency Improvements using CityBES

Buildings in San Francisco consumed 52% of total primary energy. Improving building energy efficiency is one of the key strategies cities are adopting towards their energy and climate goals. Urban building energy models (UBEM) can support city managers to evaluate and prioritize energy conservation measures for investment and to design effective incentive and rebate programs. This paper introduces methods to develop a standardized dataset of city building stock, and it demonstrates the use of a UBEM tool, City Building Energy Saver (CityBES), for an urban-scale energy retrofit analysis of building stock in the city of San Francisco. CityBES is an open web-based data and computing platform providing city-scale building energy modeling and performance visualization and benchmarking. CityBES utilizes an international standard CityGML to represent the three-dimensional building stock in cities. As an application example, 940 office and retail buildings in six districts of northeast San Francisco were modeled and analyzed with CityBES to evaluate energy savings for five selected measures. The analysis found that replacing existing lighting with LED and adding an air economizer to HVAC systems are cost-effective measures with combined savings per building between 17% to 31%. The CityBES retrofit analysis feature does not require users to have deep knowledge of building systems or building energy models, which helps overcome barriers for city managers and their consultants to adopt UBEM.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Violent Early Solar System, as Told by Lunar Sample Geochronology

One of the legacies of the samples collected by the Apollo and Luna missions is the link forged between radiometric ages of rocks and relative ages according to stratigraphic relationships and impact crater size-frequency distributions. Our current understanding of the history of the inner solar system is based on the relative chronology of individual planets, tied to the absolute geochronology of the Moon via these important samples. Samples from these nearside locations reveal a preponderance of impact-disturbed or recrystallized ages between 3.75 and 3.95 billion years. Argon and lead loss (and correlated disturbances in the Rb-Sr system) have been attributed to metamorphism of the lunar crust by an enormous number of impacts in a brief pulse of time, called the Lunar Cataclysm or Late Heavy Bombardment. Subsequent high-precision geochronometric analyses of Apollo samples and lunar highlands meteorites show a wider range of ages, but very few older than 4 Ga. The paucity of ancient impact melt rocks has been interpreted to mean that either that most impact basins formed at this time, or that ejecta from the large, near-side, young basins dominates the Apollo samples. Selenochronology is getting more complicated: new results question meaning of sample ages, crater counts, crater production functions, and the solar system itself. Improved geological mapping of lunar geologic units and boundaries using multiple remote sensing datasets. High-resolution image-based crater counting of discrete geologic units and relating them to location. Improved understanding of the regolith thickness and its global variation (GRAIL). Tying the sampling of impact-melt rocks to the lunar impact flux. Using improved techniques (magnetic fields, diffusion studies, isotopic analysis) on existing samples. New sample return from benchmark craters, particularly SPA, which appears in 2013 Decadal Survey.

Cohen, Barbara↗

Evaluation of Ocean Biogeochemistry and Carbon Cycling in CMIP Earth System Models With the International Ocean Model Benchmarking (IOMB) Software System

Abstract The International Ocean Model Benchmarking (IOMB) software package is a new community resource that we use here to evaluate surface and upper ocean biogeochemical variables and integrated anthropogenic carbon uptake from earth system models (ESMs) contributing to the 5th and 6th phases of the Coupled Model Intercomparison Project (CMIP5 and CMIP6). IOMB generates graphics and tables for systematically comparing model predictions against multiple datasets. Our analysis reveals some improvement in the multi‐model mean from CMIP5 to CMIP6 for most of the variables we examined. Compared to data‐constrained estimates of ocean anthropogenic carbon uptake for the 1994–2007 period, negative biases exist for many models between 30 and 50°S. Global model estimates of anthropogenic carbon uptake for the same period do not change significantly from CMIP5 to CMIP6, with the combined ensemble mean estimate of 27.8 ± 0.5 Pg C lower than a data‐constrained estimate of 33.0 ± 4.0 Pg C. At the same time, the change in the natural carbon inventory from CMIP is estimated to be a source of 0.7 ± 0.3 Pg C, which is considerably smaller in magnitude than a data‐constrained estimate of 5.0 ± 3.0 Pg C. With chlorofluorocarbon (CFC) predictions available for several models, we demonstrate that negative anthropogenic dissolved inorganic carbon biases coincide with negative biases in CFC concentration, highlighting the importance of weak exchange between the surface and interior ocean in regulating rates of anthropogenic carbon uptake. To examine the robustness of this attribution across the CMIP models, we calculate the global vertical temperature gradient between 200 and 1,000 m as a metric for global stratification and exchange between the surface and deeper waters. We find a linear relationship between the bias of the vertical temperature gradients and the bias in global anthropogenic carbon uptake, consistent with the hypothesis that model biases in anthropogenic carbon uptake are related to biases in surface‐to‐interior exchange by physical processes.

58 GEOSCIENCES↗

A comparison of probabilistic generative frameworks for molecular simulations

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. Here, in this work, we introduce and explain several classes of generative models, broadly sorted into two categories: flow-based models and diffusion models. We select three representative models: neural spline flows, conditional flow matching, and denoising diffusion probabilistic models, and examine their accuracy, computational cost, and generation speed across datasets with tunable dimensionality, complexity, and modal asymmetry. Our findings are varied, with no one framework being the best for all purposes. In a nutshell, (i) neural spline flows do best at capturing mode asymmetry present in low-dimensional data, (ii) conditional flow matching outperforms other models for high-dimensional data with low complexity, and (iii) denoising diffusion probabilistic models appear the best for low-dimensional data with high complexity. Our datasets include a Gaussian mixture model and the dihedral torsion angle distribution of the Aib9 peptide, generated via a molecular dynamics simulation. We hope our taxonomy of probabilistic generative frameworks and numerical results may guide model selection for a wide range of molecular tasks.

Artificial intelligence↗

Airborne imaging spectroscopy surveys of Arctic and boreal Alaska and northwestern Canada 2017–2023

Since 2015, NASA’s Arctic Boreal Vulnerability Experiment (ABoVE) has investigated how climate change impacts the vulnerability and/or resilience of the permafrost-affected ecosystems of Alaska and northwestern Canada. ABoVE conducted extensive surveys with the Next Generation Airborne Visible/Infrared Imaging Spectrometer (AVIRIS-NG) during 2017, 2018, 2019, and 2022 and with AVIRIS-3 in 2023 to characterize tundra, taiga, peatlands, and wetlands in unprecedented detail. The ABoVE AVIRIS dataset comprises ~1700 individual flight lines covering ~120,000 km 2 with nominal 5 m × 5 m spatial resolution. Data include individual transects to capture important gradients like the tundra-taiga ecotone and maps of up to 10,000 km 2 for key study areas like the Mackenzie Delta. The ABoVE AVIRIS surveys enable diverse ecosystem science, provide crucial benchmark data for validating retrievals from the PACE, PRISMA, and EnMAP satellite sensors and help prepare for the SBG and CHIME missions. This paper guides interested researchers to fully explore the ABoVE AVIRIS spectral imagery and complements our guide to the ABoVE airborne synthetic aperture radar surveys.

Miller, Charles E. [California Institute of Techno↗

EV Forecasting-Based Model Predictive Control for Distribution System Congestion Mitigation

The uncoordinated charging of electric vehicles (EVs) in time and space brings congestion issues to the distribution network. This paper proposes an EV charging demand forecasting-based model predictive control (MPC) method for distribution system congestion management. To effectively forecast the time-series EV station charging demand, a hybrid forecasting model that integrates the long short-term memory network (LSTM) and Transformer is proposed. The Transformer-LSTM model is trained using a one-year real historical charging dataset of EV stations to forecast future charging demand in 15-minute intervals. This informs the MPC for distribution network congestion management and minimization of PV curtailment. Numerical results carried out on the modified IEEE 123-bus distribution system demonstrate that the proposed method can effectively resolve line congestion issues through EV smart charging and PV curtailment while outperforming other benchmarks.

ADVANCED PROPULSION SYSTEMS,SOLAR ENERGY↗

Advancing the Frontiers of Deep Learning for Low-Dose 3D Cone-Beam CT Reconstruction

X-ray computed tomography (CT) is an important noninvasive medical imaging modality for studying the structural details of internal organs. Image reconstruction in CT is an inverse problem of recovering an object's internal structure from the absorption profile of X-ray beams (sinogram) measured using a detector. The classical variational approach for CT reconstruction minimizes an energy functional using an appropriate iterative algorithm. Motivated by the success of deep learning (DL), researchers have begun to leverage training data and enhanced computing capabilities in recent years to produce high-fidelity reconstructed images. Nonetheless, much of the academic research in DL algorithms for CT has focused primarily on the two-dimensional setting (with simplified forward operators and noise model) for proofs-of-concept, and a comprehensive benchmarking of various classical and data-driven CT reconstruction approaches has not beenundertaken. The key objective of our CT reconstruction grand challenge was to promote methodological advancements for both classical and DL-based approaches for clinical CT with a reasonably accurately simulated 3D CT forward operator and noise model. We have utilized the publicly available LIDC-IDRI dataset and simulated sinograms and FDK images corresponding to two dose levels (clinical- and low-dose, constituting two tracks of the challenge) starting from the normal-dose images as the ground truth. In this paper, we summarize the motivation, context, and results of our challenge, and highlight the future research directions in DL for clinical CT.

X-ray tomography↗

Development of a Comprehensive Two-Phase Flow Database for the Validation of NEK-2P

Three-dimensional (3-D) two-phase Computational Fluid Dynamics (CFD) codes are emerging as a powerful and potentially practical tool for applications in which detailed local flow information is needed. However, two-phase flow models and associated closure relations are not well established for CFD applications, which is partly due to the lack of high-quality validation data. The main objective of this work is to develop a comprehensive database of two-phase flows that can be used to validate two-phase CFD codes such as NEK-2P. In this project, four advanced local measurement systems, including Particle Image Velocimetry and Planar Laser-Induced Fluorescence (PIV-PLIF), high-speed imaging, x-ray densitometry, and multi-sensor conductivity probe are employed to measure the local two-phase flow parameters of both gas and liquid phases. By combining these techniques, the local void fraction, bubble velocity, interfacial area concentration, bubble frequency, liquid velocity, turbulence intensity, etc., in various two-phase flow regimes can be obtained. These local measurement techniques are first used in a 25.4 mm circular pipe test section. Seven air-water two-phase flow conditions spanning the bubbly, slug, churn-turbulent, and annular flow regimes are measured in this facility. The obtained database contains the radial profiles of both gas- and liquid-phase parameters at three axial locations along the test section. The second facility used in this work contains a 30 mm × 10 mm rectangular test section, in which three two-phase flow and two single-phase flow conditions are measured. Two-dimensional distributions of local two-phase flow parameters in the cross-sectional plane are measured in this facility at three axial locations as well. A facility featuring a 3×3 electrically heated rod bundle is also designed and being constructed in this project. This facility is specially designed for optical measurements and is expected to provide high-quality boiling data in the future. Preliminary analyses have been performed for the data taken in the 25.4 mm circular pipe. Both center-peaked and wall-peaked void fraction profiles have been observed in the data depending on the two-phase flow conditions and/or developing lengths. The 1-D drift-flux model was evaluated with the newly obtained datasets, in which both gas- and liquid-phases data were directly measured. The distribution parameter model has been optimized based on a new void-profile classification method proposed in this study. The optimized drift-flux model shows a significant improvement in predicting both gas velocity and void fraction. The measured liquid-phase turbulence was used to benchmark Sato’s turbulence model considering the bubble-induced shear stress for the three tested bubbly flows. The benchmark results showed good agreement between the PIV measurements and model predictions. In the bubbly flows tested that have low void fractions less than 3%, the effect of the bubble-induced turbulence was found not significant. However, the bubble-induced shear stress becomes important with the increase of the void fraction. The Conjugate Heat Transfer (CHT) model was developed and implemented in NEK-2P. This model allows the coupled simulation of the solid domain and two-phase fluid domain, allowing the specification of realistic boundary conditions. The CHT implementation was verified first with non-boiling simulations. The predicted temperatures in the fluid domain were shown to be identical in simulations with or without the CHT model. The CHT model was then validated through simulations of three Becker benchmark CHF tests performed under both Dryout (DO) and Departure from Nucleate Boiling (DNB) conditions. Reasonably good agreement was obtained between calculated wall temperatures and corresponding experimental data.

42 ENGINEERING↗

Generalizable, fast, and accurate DeepQSPR with fastprop

Abstract Quantitative Structure–Property Relationship studies (QSPR), often referred to interchangeably as QSAR, seek to establish a mapping between molecular structure and an arbitrary target property. Historically this was done on a target-by-target basis with new descriptors being devised to specifically map to a given target. Today software packages exist that calculate thousands of these descriptors, enabling general modeling typically with classical and machine learning methods. Also present today are learned representation methods in which deep learning models generate a target-specific representation during training. The former requires less training data and offers improved speed and interpretability while the latter offers excellent generality, while the intersection of the two remains under-explored. This paper introduces , a software package and general Deep-QSPR framework that combines a cogent set of molecular descriptors with deep learning to achieve state-of-the-art performance on datasets ranging from tens to tens of thousands of molecules. provides both a user-friendly Command Line Interface and highly interoperable set of Python modules for the training and deployment of feedforward neural networks for property prediction. This approach yields improvements in speed and interpretability over existing methods while statistically equaling or exceeding their performance across most of the tested benchmarks. is designed with Research Software Engineering best practices and is free and open source, hosted at github.com/jacksonburns/fastprop.

Burns, Jackson W. (ORCID:0000000206579426)↗

Synthetic Graph Generation for Data-Intensive HPC Benchmarking: Scalability, Analysis and Real-World Application

The benchmarking effort within the Extreme Scale Systems Center at Oak Ridge National Laboratory seeks to provide High Performance Computing benchmarks and test suites of interest to the DoD sponsor. The work described in this report is a part of the effort focusing on graph generation. A previously developed benchmark, SystemBurn, allows the emulation of a broad spectrum of application behavior profiles within a single framework. To complement this effort, similar capabilities are desired for graph-centric problems. This report described the in-depth analysis of the generated synthetic graphs' properties at a variety of scales using different generator implementations and examines their applicability to replicating real world datasets.

97 MATHEMATICS AND COMPUTING↗

Ultra-High Vacuum Outgassing Characterization of Thermally Processed Low-Carbon Steel for Advanced Particle Accelerator and Gravitational Wave Detector Applications

This dissertation investigated AISI 1020 low-carbon steel as an alternative vacuum chamber material to conventional stainless steel for ultra-high vacuum (UHV) and extreme-high vacuum (XHV) applications. After a 400 °C/48 h bake, AISI 1020 tube chambers achieved a hydrogen outgassing rate of 2.4 × 10¿¹6 Torr·L·s¿¹·cm¿², approximately 2,300 times lower than the prebaked 316L stainless-steel comparator, among the lowest hydrogen outgassing rates ever reported for an uncoated metallic vacuum chamber. Bare and magnetite-coated AISI 1020 chambers were then compared using throughput and rate-of-rise methods. The magnetite coating yielded 5× lower water outgassing at room temperature, but this advantage disappeared after 80 °C baking. After full thermal conditioning (400 °C/48 h prebake followed by 150 °C/96 h and 200 °C/110 h), bare steel achieved 25× lower hydrogen outgassing than the magnetite-coated chamber (9.6 × 10¿¹6 Torr·L·s¿¹·cm¿²) and >99% H2 purity with carbon species below RGA detection. Monte Carlo molecular flow simulations of a CEBAF photogun beamline (96 scenarios) showed that replacing 304L stainless steel with AISI 1020 reduces equilibrium H2 pressure by a factor of 833; a single 304L electrode contributes 98.8% of the gas load despite occupying only 9.1% of the internal surface area. A 500-m Einstein Telescope beampipe screening showed that corrugated bellows contribute 18% of the gas load from only 0.7% of the surface area. A five-model adsorption isotherm framework applied to 22 pumpdown datasets (164 fits with AR(1)-GLS correction) established that the experimental protocol, not the material, controls isotherm identifiability: Dubinin–Radushkevich wins isothermal pipe pumpdowns; Langmuir wins thermally dominated chamber bakes. Cross-dataset joint fitting of the AISI 1020 pipe pumpdowns yielded an H2 diffusion activation energy Ed = 7.24 ± 1.28 kcal·mol¿¹, consistent with trap dominated diffusion in commercial low-carbon steels. Two companion innovations were developed: a Variable Conductance Device (VCD, patent pending IDF-00723) for XHV outgassing measurement, and VacuumDesignerPro (VDP), a MATLAB-based design tool validated against LIGO benchmarks.

Al-Allaq, Aiman H [Old Dominion University]↗