Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Aridity-Dependent Land Surface Skin Temperature Biases in CMIP5/6

Land surface skin temperature, a critical indicator of climate change, connects the water and energy cycles between the land and the atmosphere. Here, in this study, we evaluate the simulations of land surface skin temperature from the Coupled Model Intercomparison Project Phase 5 (CMIP5) and CMIP6 models with satellite-based datasets and reanalysis. We find systematic cold skin temperature biases over arid regions in CMIP5/CMIP6 simulations. Over arid and semi-arid regions, latent heat biases drive skin temperature biases by evaporative cooling. Over humid regions, surface downward shortwave and albedo biases are relatively more critical. Spatial patterns of biases remain similar in the latest CMIP6 simulations, suggesting systematic biases in land-atmosphere interactions. These biases need to be corrected or considered while using models for future projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Towards accurate prediction of configurational disorder properties in materials using graph neural networks

Abstract The prediction of configurational disorder properties, such as configurational entropy and order-disorder phase transition temperature, of compound materials relies on efficient and accurate evaluations of configurational energies. Previous cluster expansion methods are not applicable to configurationally-complex material systems, including those with atomic distortions and long-range orders. In this work, we propose to leverage the versatile expressive capabilities of graph neural networks (GNNs) for efficient evaluations of configurational energies and present a workflow combining attention-based GNNs and Monte Carlo simulations to calculate the disorder properties. Using the dataset of face-centered tetragonal gold copper without and with local atomic distortions as an example, we demonstrate that the proposed data-driven framework enables the prediction of phase transition temperatures close to experimental values. We also elucidate that the variance of the energy deviations among configurations controls the prediction accuracy of disorder properties and can be used as the target loss function when training and selecting the GNN models. The work serves as a fundamental step toward a data-driven paradigm for the accelerated design of configurationally-complex functional material systems.

Chemistry↗
DOE OSTI2023

A comparison of machine learning methods to classify radioactive elements using prompt-gamma-ray neutron activation data

The detection of illicit radiological materials is critical to establishing a robust second line of defence in nuclear security. Neutron-capture prompt-gamma activation analysis (PGAA) can be used to detect multiple radioactive materials across the entire Periodic Table. However, long detection times and a high rate of false positives pose a significant hindrance in the deployment of PGAA-based systems to identify the presence of illicit substances in nuclear forensics. In the present work, six different machine-learning algorithms were developed to classify radioactive elements based on the PGAA energy spectra. The model performance was evaluated using standard classification metrics and trend curves with an emphasis on comparing the effectiveness of algorithms that are best suited for classifying imbalanced datasets. We analyse the classification performance based on Precision, Recall, F1-score, Specificity, Confusion matrix, ROC-AUC curves, and Geometric Mean Score (GMS) measures. The tree-based algorithms (Decision Trees, Random Forest and AdaBoost) have consistently outperformed Support Vector Machine and K-Nearest Neighbours. Based on the results presented, AdaBoost is the preferred classifier to analyse data containing PGAA spectral information due to the high recall and minimal false negatives reported in the minority class.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Elucidating the photodissociation fingerprint and quantifying the determination of organic hydroperoxides in gas-phase autoxidation

Hydroperoxides are formed in the atmospheric oxidation of volatile organic compounds, in the combustion autoxidation of fuel, in the cold environment of the interstellar medium, and also in some catalytic reactions. They play crucial roles in the formation and aging of secondary organic aerosols and in fuel autoignition. However, the concentration of organic hydroperoxides is seldom measured, and typical estimates have large uncertainties. In this work, we developed a mild and environmental-friendly method for the synthesis of alkyl hydroperoxides (ROOH) with various structures, and we systematically measured the absolute photoionization cross-sections (PICSs) of the ROOHs using synchrotron vacuum ultraviolet-photoionization mass spectrometry (SVUV-PIMS). A chemical titration method was combined with an SVUV-PIMS measurement to obtain the PICS of 4-hydroperoxy-2-pentanone, a typical molecule for combustion and atmospheric autoxidation ketohydroperoxides (KHPs). We found that organic hydroperoxide cations are largely dissociated by loss of OOH. This fingerprint was used for the identification and accurate quantification of the organic peroxides, and it can therefore be used to improve models for autoxidation chemistry. The synthesis method and photoionization dataset for organic hydroperoxides are useful for studying the chemistry of hydroperoxides and the reaction kinetics of the hydroperoxy radicals and for developing and evaluating kinetic models for the atmospheric autoxidation and combustion autoxidation of the organic compounds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Seasonal representation of extreme precipitation indices over the United States in CMIP6 present-day simulations

Realistically representing the present-day characteristics of extreme precipitation has been a challenge for global climate models, which is due in part to deficiencies in model resolution and physics, but is also due to a lack of consistency in gridded observations. In this study, we use three observation datasets, including gridded rain gauge and satellite data, to assess historical simulations from sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models. We separately evaluate summer and winter precipitation over the United States (US) with a comprehensive set of extreme precipitation indices, including an assessment of precipitation frequency, intensity and spatial structure. The observations exhibit significant differences in their estimates of area-average intensity distributions and spatial patterns of the mean and extremes of precipitation over the US. In general, the CMIP6 multi-model mean performs better than most individual models at capturing daily precipitation distributions and extreme precipitation indices, particularly in comparison to gauge-based data. Also, the representation of the extreme precipitation indices by the CMIP6 models is better in the summer than winter. Although the ‘standard’ horizontal-resolution can vary significantly across CMIP6 models, from ~0.7° to ~2.8°, we find that resolution is not a good indicator of model performance. Overall, our results highlight common biases in CMIP6 models and demonstrate that no single model is consistently the most reliable across all indices.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Quantifying and Zoning Urban Heat Island Effects Using Unsupervised Machine Learning

This work explores the Urban Heat Island (UHI) effects in Maricopa County, Arizona, employing a simulation-based approach that combines large-scale building energy modeling with advanced spatial analysis. Utilizing the Automatic Building Energy Modeling (AutoBEM) software suite, we simulated the energy consumption for approximately 1.35 million buildings based on the Model America version 1.0 (MAv1) dataset. Our methodology incorporated spatial analysis at multiple scales, including individual buildings, clusters of zones determined by K-means clustering, and geographical level evaluation based on Zip codes. The results revealed significant variations in energy consumption and heat emissions across different building types and urban zones. High-emission hotspots identified through clustering pointed to areas most contributing to the UHI effects. Zip code-based area analysis further contextualized these findings, offering an urban context-based perspective on emission distribution and informing potential urban energy policies for mitigating UHI effects.

Chowdhury, Shovan [ORNL]↗
DOE OSTI2021

Retrospective Analysis and Bayesian Model Averaging of CMIP6 Precipitation in the Nile River Basin

The Nile River basin is one of the global hotspots vulnerable to climate change impacts because of a fast-growing population and geopolitical tensions. Previous studies demonstrated that general circulation models (GCMs) frequently show disagreement in the sign of change in annual precipitation projections. Here, we first evaluate the performance of 20 GCMs from phase six of the Coupled Model Intercomparison Project (CMIP6) benchmarked against a high-spatial-resolution precipitation dataset dating back to 1983 from Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Climate Data Record (PERSIANN-CDR). Next, a Bayesian model averaging (BMA) approach is adopted to derive probability distributions of precipitation projections in the Nile basin. Retrospective analysis reveals that most GCMs exhibit considerable (up to 64% of mean annual precipitation) and spatially heterogenous bias in simulating annual precipitation. Moreover, it is shown that all GCMs underestimate interannual variability; thus, the ensemble range is underdispersive and is a poor indicator of uncertainty. The projected changes from the BMA model show that the value and sign of change vary considerably across the Nile basin. Specifically, it is found that projected changes in the two headwaters basins, namely, the Blue Nile and Upper White Nile, are 0.03% and -1.65%, respectively; both are statistically insignificant at α = 0.05. The uncertainty range estimated from the BMA model shows that the probability of a precipitation decrease is much higher in the Upper White Nile basin whereas projected change in the Blue Nile is highly uncertain both in magnitude and sign of change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗
DOE OSTI2025

Seismic monitoring of underground vibration: database of seismic data and ground truth

Seismic waves provide valuable insights into underground activities, serving as an essential tool for monitoring anomalies that could signal containment breaches in geological repositories. We aim to test and refine underground detection and geolocation techniques to identify anomalous vibration signals indicative of potential breaches, thereby strengthening georepository safeguards. We evaluate the effectiveness of two distinct, low-maintenance sensing technologies (surface geophones and underground distributed acoustic sensing (DAS) fiber optic cable) leveraging existing datasets. This report details the experimental designs, instrumentation, and data characteristics for both seismic and DAS arrays. Additionally, we provide a ground truth database documenting relevant operational activities for each experiment.

58 GEOSCIENCES↗
DOE OSTI2025

Data for: Miscanthus × giganteus changes soil structure and increases maximum water holding capacity

The data provided include results from a comparative study evaluating the impact of Miscanthus × giganteus (miscanthus) versus maize on soil structural properties and maximum water holding capacity (MWHC) across two Iowa sites. The dataset includes MWHC values determined using the Funnel Filter Paper Drainage (FFPD) method, as well as additional measurements of MWHC following structural disruption of the soil to isolate the effect of aggregation. It also contains three-dimensional micro-computed tomography (microCT) data used to quantify total porosity and pore size distribution (PSD) of soil aggregates at a 5 µm resolution. All data are provided as raw replicate-level measurements, organized by site, crop, and depth, along with processed summary files in table form in CSV (.csv) format to support reproducibility and downstream analysis.

Misanthus x giganteus↗
DOE OSTI2025

Developing predictive models for µ opioid receptor binding using machine learning and deep learning techniques

Opioids exert their analgesic effect by binding to the µ opioid receptor (MOR), which initiates a downstream signaling pathway, eventually inhibiting pain transmission in the spinal cord. However, current opioids are addictive, often leading to overdose contributing to the opioid crisis in the United States. Therefore, understanding the structure-activity relationship between MOR and its ligands is essential for predicting MOR binding of chemicals, which could assist in the development of non-addictive or less-addictive opioid analgesics. This study aimed to develop machine learning and deep learning models for predicting MOR binding activity of chemicals. Chemicals with MOR binding activity data were first curated from public databases and the literature. Molecular descriptors of the curated chemicals were calculated using software Mold2. The chemicals were then split into training and external validation datasets. Random forest, k-nearest neighbors, support vector machine, multi-layer perceptron, and long short-term memory models were developed and evaluated using 5-fold cross-validations and external validations, resulting in Matthews correlation coefficients of 0.528–0.654 and 0.408, respectively. Furthermore, prediction confidence and applicability domain analyses highlighted their importance to the models’ applicability. Our results suggest that the developed models could be useful for identifying MOR binders, potentially aiding in the development of non-addictive or less-addictive drugs targeting MOR.

Research & Experimental Medicine↗
DOE OSTI2022

A Novel DNA Repair Gene Signature for Immune Checkpoint Inhibitor-Based Therapy in Gastric Cancer

Gastric cancer is a heterogeneous group of diseases with only a fraction of patients responding to immunotherapy. The relationships between tumor DNA damage response, patient immune system and immunotherapy have recently attracted attention. Accumulating evidence suggests that DNA repair landscape is a significant factor in driving response to immune checkpoint blockade (ICB) therapy. In this study, to explore new prognostic and predictive biomarkers for gastric cancer patients who are sensitive and responsive to immunotherapies, we developed a novel 15-DNA repair gene signature (DRGS) and its related scoring system and evaluated the efficiency of the DRGS in discriminating different molecular and immune characteristics and therapeutic outcomes of patients with gastric adenocarcinoma, using publicly available datasets. The results demonstrated that DRGS high score patients showed significantly better therapeutic outcomes for ICB compared to DRGS low score patients (p < 0.001). Integrated analysis of multi-omics data demonstrated that the patients with high DRGS score were characteristic of high levels of anti-tumor lymphocyte infiltration, tumor mutation burden (TMB) and PD-L1 expression, and these patients exhibited a longer overall survival, as compared to the low-score patients. Results obtained from HPA and IHC supported significant dysregulation of the genes in DRGS in gastric cancer tissues, and a positive correlation in protein expression between DRGS and PD-L1. Therefore, the DRGS scoring system may have implications in tailoring immunotherapy in gastric cancers. A preprint has previously been published (Yuan et al., 2021).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Transformation rate maps of dissolved organic carbon in the contiguous US

Riverine dissolved organic carbon (DOC) plays a vital role in regional and global carbon cycles. However, the processes of DOC conversion from soil organic carbon (SOC) and leaching into rivers are insufficiently understood, inconsistently represented, and poorly parameterized, particularly in land surface and Earth system models. As a first attempt to fill this gap, we propose a generic formula that directly connects SOC concentration with DOC concentration in headwater streams, where a single parameter, the transformation rate from SOC in the soil to DOC leaching flux (P r ), accounts for the overall processes governing SOC conversion to DOC and leaching from soils (along with runoff) into headwater streams. We then derive high-resolution P r maps over the contiguous US (CONUS) using SOC data from two different sources: the Harmonized World Soil Database v1.2 (HWSD) and SoilGrids 2.0. Both maps are developed following the same five major steps: (1) selecting independent catchments where observed riverine DOC data are available with reasonable quality; (2) estimating catchment-average SOC for the independent catchments; (3) estimating the P r values for these catchments based on the generic formula and catchment-average SOC; (4) developing a predictive model of P r with machine learning (ML) techniques and catchment-scale climate, hydrology, geology, and other attributes; and (5) deriving a national map of P r based on the ML model. For evaluation, we compare the DOC concentration derived using the P r map and the observed DOC concentration values at evaluation catchments. The resulting mean absolute scaled error and coefficient of determination are 0.73 and 0.47 for the HWSD-based model and 0.58 and 0.72 for the SoilGrids-based model, respectively, suggesting the effectiveness of the overall methodology. Efforts to constrain uncertainty and evaluate sensitivity of P r to different factors are discussed. To illustrate the use of such maps, we derive a riverine DOC concentration reanalysis dataset over CONUS. The two P r maps, robustly derived and empirically validated, lay a critical cornerstone for better simulating the terrestrial carbon cycle in land surface and Earth system models. Our findings not only set a foundation for improving our predictive understanding of the terrestrial carbon cycle at the regional and global scales, but also hold promises for informing policy decisions related to decarbonization and climate change mitigation. The data presented in this study are publicly available at https://doi.org/10.5281/zenodo.14563816 (Li et al., 2024).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Enhancing ChatPORT with CUDA-to-SYCL Kernel Translation Capability

Large Language Models (LLMs) have shown strong capabilities in general code translation. However, code translation involving parallel programming models remains largely unexplored. This work enhances the capabilities of code LLMs in CUDA-to-SYCL kernel translation with parameter-efficient fine-tuning. The resultant fine-tuned LLM, called ChatPORT, is an effort to provide high-fidelity translations from one programming model to another. We describe the preparation of datasets from heterogeneous computing benchmarks for model fine-tuning and testing, the parameter-efficient fine-tuning of 19 open-source code models ranging in size from 0.5 to 34 billion parameters and evaluate the correctness rates of the SYCL kernels by the fine-tuned models. The experimental results show that most code models fail to translate CUDA codes to SYCL correctly. However, fine-tuning these models using a small set of CUDA and SYCL kernels can enhance the capabilities of these models in kernel translation. Depending on the sizes of the models, the correctness rate ranges from 19.9% to 81.7% for a test dataset of 62 CUDA kernels.

Jin, Zheming [ORNL] (ORCID:000000027197780X)↗
DOE OSTI2023

140,142 Ce Neutron Cross Section Resolved Resonance Region Evaluation

A resolved resonance region evaluation of 140,142 Ce was conducted by Oak Ridge National Laboratory. Requested by the US Nuclear Criticality Safety Program, this evaluation is based on recent high-resolution transmission and capture high-resolution measurements of nat Ce and 142 Ce conducted at JRC-Geel at the Geel Linear Accelerator facility. It is also based on recently measured thermal constants available from the EX FOR database. Starting from the resonance parameters from the ENDF/B-VIII.0 library and following a preliminary R-matrix analysis, an updated set of resonance parameters and corresponding covariance in formation was derived by the fit of these experimental datasets using the Reich–Moore approximation of the R-matrix theory, as implemented in the SAMMY code system. The resolved resonance region upper energy limit for 140 Ce was kept at 200 keV, whereas the 142 Ce resonance region was extended from 13 to 26 keV. This new evaluation was found to be in good agreement not only with several integral quantities of interest to the reactor physics community, but also with the stellar Maxwellian-averaged cross section.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

NIST: Soil Respiration, Moisture, Temperature, Chemistry; and Fine Root Measurements from a Transect Through a Forest Edge, Gaithersburg, Maryland, 2017-2021

This dataset contains soil respiration, moisture, temperature, and chemistry, as well as fine root measurements from the National Institute of Standards and Technology (NIST) Forested Optical Reference for Evaluating Sensor Technology (FOREST) research facility at Gaithersburg, Maryland. Measurements were taken at an existing transect array that begins in a grassy meadow, crosses a sharp forest edge, then a small stream, and finally extends upwards in the interior of the forest at the top of a ridge. There are 6 different landscape positions replicated across three transects in the array. Soil respiration was measured during growing seasons in 2017-2019 (2017-06-02 to 2020-02-27). Pedons (1 m3) were isolated from surrounding tree roots using trenching and a fabric to inhibit root ingrowth. Flux measurements inside the pedons were thus assumed to represent heterotrophic only respiration in 2019, and these fluxes were paired with nearby fluxes assumed to represent total respiration. Deep vertical probes measured volumetric moisture content and temperature at the same points in the array every 10 cm in depth to either 90 cm or 120 cm total depth, at 15 minute intervals, from 2019-2021 (2019-07-09 to 2021-09-10). Soil core samples were collected from each of the array points for three different months in early- to mid-2019 (2019-03-19 to 2019-07-10), at three depths each. Soils were analyzed for gravimetric moisture content; pH; total carbon, nitrogen, and phosphorus; texture; microbial biomass carbon, nitrogen, and phosphorus; extractable dissolved organic carbon, nitrogen, and phosphorus; extractable nitrate and ammonia; and extracellular hydrolytic enzyme activities. The fine roots were separated from the cores and segregated by plant functional type (grass or tree species) and if they were dead or alive. Fine roots were then measured for length, surface area, diameter, and dry mass. This dataset contains four data files in comma separated (*.csv) format. These data serve to deepen our understanding of root and soil processes at forest edges and in transitional zones.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

MFA-DVR: direct volume rendering of MFA models

3D volume rendering is widely used to reveal insightful intrinsic patterns of volumetric datasets across many domains. However, the complex structures and varying scales of volumetric data can make efficiently generating high-quality volume rendering results a challenging task. Multivariate functional approximation (MFA) is a new data model that addresses some of the critical challenges: high-order evaluation of both value and derivative anywhere in the spatial domain, compact representation for large-scale volumetric data, and uniform representation of both structured and unstructured data. Here, in this paper, we present MFA-DVR, the first direct volume rendering pipeline utilizing the MFA model, for both structured and unstructured volumetric datasets. We demonstrate improved rendering quality using MFA-DVR on both synthetic and real datasets through a comparative study. We show that MFA-DVR not only generates more faithful volume rendering than using local filters but also performs faster on high-order interpolations on structured and unstructured datasets. MFA-DVR is implemented in the existing volume rendering pipeline of the Visualization Toolkit (VTK) to be accessible by the scientific visualization community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Robust design of semi-automated clustering models for 4D-STEM datasets

Materials discovery and design require characterizing material structures at the nanometer and sub-nanometer scale. Four-Dimensional Scanning Transmission Electron Microscopy (4D-STEM) resolves the crystal structure of materials, but many 4D-STEM data analysis pipelines are not suited for the identification of anomalous and unexpected structures. This work introduces improvements to the iterative Non-Negative Matrix Factorization (NMF) method by implementing consensus clustering for ensemble learning. We evaluate the performance of models during parameter tuning and find that consensus clustering improves performance in all cases and is able to recover specific grains missed by the best performing model in the ensemble. The methods introduced in this work can be applied broadly to materials characterization datasets to aid in the design of new materials.

Bruefach, Alexandra (ORCID:0000000209323477)↗