Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Robust implementation of generative modeling with parametrized quantum circuits

Although the performance of hybrid quantum-classical algorithms is highly dependent on the selection of the classical optimizer and the circuit ansätze, a robust and thorough assessment on-hardware of such features has been missing to date. From the optimizer perspective, the primary challenge lies in the solver’s stochastic nature, and their significant variance over the random initialization. Therefore, a robust comparison requires one to perform several training curves for each solver before one can reach conclusions about their typical performance. Since each of the training curves requires the execution of thousands of quantum circuits in the quantum computer, such a robust study remained a steep challenge for most hybrid platforms available today. In this work, we leverage on Rigetti’s Quantum Cloud Services (QCS™) to overcome this implementation barrier, and we study the on-hardware performance of the data-driven quantum circuit learning (DDQCL) for three different state-of-the-art classical solvers, and on two-different circuit ansätze associated to different entangling connectivity graphs for the same task. Additionally, we assess the gains in performance from varying circuit depths. To evaluate the typical performance associated with each of these settings in this benchmark study, we use at least five independent runs of DDQCL towards the generation of quantum generative models capable of capturing the patterns of the canonical Bars and Stripes dataset. In this experimental benchmarking, the gradient-free optimization algorithms show an outstanding performance compared to the gradient-based solver. In particular, one of them had better performance when handling the unavoidable noisy objective function to be minimized under experimental conditions.

97 MATHEMATICS AND COMPUTING↗

Array-Based Machine Learning for Functional Group Detection in Electron Ionization Mass Spectrometry

Mass spectrometry is a ubiquitous technique capable of complex chemical analysis. The fragmentation patterns that appear in mass spectrometry are an excellent target for artificial intelligence methods to automate and expedite the analysis of data to identify targets such as functional groups. To develop this approach, we trained models on electron ionization (a reproducible hard fragmentation technique) mass spectra so that not only the final model accuracies but also the reasoning behind model assignments could be evaluated. The convolutional neural network (CNN) models were trained on 2D images of the spectra using transfer learning of Inception V3, and the logistic regression models were trained using array-based data and Scikit Learn implementation in Python. Our training dataset consisted of 21,166 mass spectra from the United States’ National Institute of Standards and Technology (NIST) Webbook. The data was used to train models to identify functional groups, both specific (e.g., amines, esters) and generalized classifications (aromatics, oxygen-containing functional groups, and nitrogen-containing functional groups). We found that the highest final accuracies on identifying new data were observed using logistic regression rather than transfer learning on CNN models. It was also determined that the mass range most beneficial for functional group analysis is 0–100 m/z. We also found success in correctly identifying functional groups of example molecules selected from both the NIST database and experimental data. Beyond functional group analysis, we also have developed a methodology to identify impactful fragments for the accurate detection of the models’ targets. The results demonstrate a potential pathway for analyzing and screening substantial amounts of mass spectral data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Training data selection for accuracy and transferability of interatomic potentials

Abstract Advances in machine learning (ML) have enabled the development of interatomic potentials that promise the accuracy of first principles methods and the low-cost, parallel efficiency of empirical potentials. However, ML-based potentials struggle to achieve transferability, i.e., provide consistent accuracy across configurations that differ from those used during training. In order to realize the promise of ML-based potentials, systematic and scalable approaches to generate diverse training sets need to be developed. This work creates a diverse training set for tungsten in an automated manner using an entropy optimization approach. Subsequently, multiple polynomial and neural network potentials are trained on the entropy-optimized dataset. A corresponding set of potentials are trained on an expert-curated dataset for tungsten for comparison. The models trained to the entropy-optimized data exhibited superior transferability compared to the expert-curated models. Furthermore, the models trained to the expert-curated set exhibited a significant decrease in performance when evaluated on out-of-sample configurations.

36 MATERIALS SCIENCE↗

Data Files for Runoff Evaluation in an Earth System Land Model for Permafrost Regions

Modeling of hydrological runoff is essential for accurately capturing spatiotemporal feedbacks within the land–atmosphere system, particularly in sensitive regions such as permafrost landscapes. However, substantial uncertainties persist in the terrestrial runoff parameterization schemes used in Earth system and land surface models. This is particularly true in permafrost regions, where landscape heterogeneity is high and reliable observational data are scarce.This data set includes all files that were produced and applied in the paper Runoff Evaluation in an Earth System Land Model for Permafrost Regions [Xiang et al. in review]. The paper is in review as of July 1 2025 in Geoscientific Model Development (GMD). In this study, we evaluate the performance of runoff parameterization schemes in the Energy Exascale Earth System Model (E3SM) land model (ELM). Our proposed framework leverages simulation results from the Advanced Terrestrial Simulator (ATS), which is a physics-rich integrated surface/subsurface hydrologic model that has been successfully evaluated previously in Arctic tundra regions. We used ATS to simulate runoff from 22 representative hillslopes in the Sagavanirktok River basin, located on the North Slope of Alaska, then compared the output with ELM’s parameterized representation of total runoff. This dataset contains 2 figure image files (*.png, *jpg) that describe the study site and methods, as well as folders (Figure*.zip) that contain the associated data files (*.csv, *.dat) and python code notebooks (*.ipynb) for figures 3-7 in the paper. Jupyter notebook (*.ipynb) files that produce the figure files using the associated data files will run within a python environment configured with Jupyter Lab or Notebook packages.

54 ENVIRONMENTAL SCIENCES↗

Redox potential in Typha-dominated tidal brackish marsh, PIE LTER, Plum Island Sound, MA, June–December 2022

This dataset includes soil redox potential measurements collected at multiple depths within a tidal brackish wetland in the upper estuary of the Plum Island Ecosystems Long-Term Ecological Research site (PIE LTER), Plum Island Sound, Newbury, Massachusetts. Measurements were taken to evaluate temporal variation in redox potential in relation to hydrological events at three replicate locations. Data were recorded every 5 minutes using a Campbell Scientific Volt116 connected to a CR6 datalogger with SWAP instrument redox probes (ORP-30-4-B) and reference electrodes. Measurements were made at the AmeriFlux site US-PLo at four soil depths (5, 10, 15, and 30 cm). The file redox_soiltemp_2022.csv contains temperature-corrected redox values and soil temperature following Silva-Machado et al. (2024). Metadata files redox_soiltemp_dd.csv and redox_soiltemp_flmd.csv provide detailed descriptions of variables and site locations.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Neural Radiance Fields for Commercial Satellite Video

We evaluate neural radiance fields (NeRFs) as a method for reconstructing 3D volumetric scenes from low Earth orbit satellite imagery. We leverage commercial satellite data to reconstruct a scene using existing software tools. In doing so, we identify difficulties in these mapping datasets for NeRF generation. We propose potential applications in geospatial intelligence for context and improved image interpretation.

97 MATHEMATICS AND COMPUTING↗

TCCSP Site Characterization and Feasibility Report

The Tulare County Carbon Storage Project (TCCSP) focused on establishing the geological and commercial viability of a 50 million metric ton (MMT) carbon storage complex located in Tulare County, California. The geologic scope of work included collecting new and existing subsurface data, such as two-dimensional (2D) seismic data, advanced geophysical logs, core and fluid samples, and specialized core-analysis datasets, to support the integration and interpretation of findings from earlier tasks. These efforts contributed to the comprehensive feasibility study for commercial carbon capture and storage (CCS) development at the TCCSP site and in the surrounding region. The TCCSP project team evaluated the feasibility of the Lower Monterey Group (Santa Margarita Sand Member or its equivalent), Temblor Formation sand members (Olcese, Jewett, Vedder), and Lodo-Martinez Zone (Domengine Sandstone, Walker Formation, Lodo Formation, and the Martinez Sand) to serve as commercial CCS reservoirs along with potential for the Upper Monterey Group (Reef Ridge, Antelope Members) and the Kreyenhagen Formation to vertically seal underlying reservoirs from shallow above-zones.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Omics-Lethal Human Viruses, Interferon-Stimulated Response Experiment IFNaCL001

The purpose of this experiment was to evaluate the host interferon-stimulated cellular response to interferon alpha (IFNα) treatment. Sample data was obtained from human lung adenocarcinoma cells (Calu-3) treated with or without IFNα for mRNA and miRNA transcriptome expression analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset download have a direct relationship to a primary sample submission corresponding to a specific interferon response to viral infection.

59 BASIC BIOLOGICAL SCIENCES↗

Omics-Lethal Human Viruses, Interferon-Stimulated Response Experiment IFNFB001

The purpose of this experiment was to evaluate the human host cellular response to interferon alpha/beta (IFNα/β) or interferon gamma (IFNγ) treatment. Sample data was obtained from primary human lung fibroblast (FB) cells inoculated with IFNα/β or IFNγ for transcriptome analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset download have a direct relationship to a primary sample submission corresponding to a specific interferon response to viral infection.

59 BASIC BIOLOGICAL SCIENCES↗

Omics-Lethal Human Viruses, Influenza A Experiment IM103

The purpose of this experiment was to evaluate the host response to wild-type Influenza A/Vietnam/1203/2004 (H5N1; "VN1203") virus infection and mock infection. Sample data was obtained for mouse lung tissue and processed for mRNA, miRNA, proteomics, lipidomics, and metabolomics expression analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics, metabolomics, lipidomics, and transcriptomics dataset download each have a direct relationship to a primary sample submission corresponding to a specific Influenza A virus infection.

59 BASIC BIOLOGICAL SCIENCES↗

Omics-Lethal Human Viruses, MERS-CoV Experiment MFB001

The purpose of this experiment was to evaluate the human host response to wild-type MERS-CoV (icMERS-CoV) virus infection. Sample data was obtained from primary human fibroblasts and processed for mRNA, miRNA, proteomics, metabolomics, and lipidomics expression analysis. econdary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics, metabolomics, lipidomics, and transcriptomics dataset downloads each have a direct relationship to a primary sample submission corresponding to a specific MERS-CoV virus infection.

59 BASIC BIOLOGICAL SCIENCES↗

Fractal Characterization of Multimodal, Multiscale Images of Shale Rock Fracture Networks

An array of multimodal and multiscale images of fractured shale rock samples and analogs was collected with the aim of improving the numerical representation of fracture networks. 2D and 3D reconstructions of fractures and matrices span from 10 –6 to 100 m. The origin of the fracture networks ranged from natural to thermal maturation to hydraulically induced maturation. Images were segmented to improve fracture identification. Then, the fractal dimension and length distribution of the fracture networks were calculated for each image dataset. The resulting network connectivity and scaling associations are discussed at length on the basis of scale, sample and order of magnitude. Fracture network origin plays an important role in the resulting fracture systems and their scaling. Rock analogs are also evaluated using these descriptive tools and are found to be faithful depictions of maturation-induced fracture networks.

58 GEOSCIENCES↗

Analysis of secondary organic aerosol simulation bias in the Community Earth System Model (CESM2.1)

Organic aerosol (OA) has been considered as one of the most important uncertainties in climate modeling due to the complexity in presenting its chemical production and depletion mechanisms. To better understand the capability of climate models and probe into the associated uncertainties in simulating OA, we evaluate the Community Earth System Model version 2.1 (CESM2.1) configured with the Community Atmosphere Model version 6 (CAM6) with comprehensive tropospheric and stratospheric chemistry representation (CAM6-Chem) through a long-term simulation (1988–2019) with observations collected from multiple datasets in the United States. We find that CESM generally reproduces the interannual variation and seasonal cycle of OA mass concentration at surface layer with a correlation of 0.40 compared to ground observations and systematically overestimates (69%) in summer and underestimates (-19%) in winter. Through a series of sensitivity simulations, we reveal that modeling bias is primarily related to the dominant fraction of monoterpene-formed secondary organic aerosol (SOA), and a strong positive correlation of 0.67 is found between monoterpene emission and modeling bias in the eastern US during summer. In terms of vertical profile, the model prominently underestimates OA and monoterpene concentrations by 37%–99% and 82%–99%, respectively, in the upper air (>500 m) as validated against aircraft observations. Our study suggests that the current volatility basis set (VBS) scheme applied in CESM might be parameterized with monoterpene SOA yields that are too high, which subsequently results in strong SOA production near the emission source area. We also find that the model has difficulty in reproducing the decreasing trend of surface OA in the southeastern US probably because of employing pure gas VBS to represent isoprene SOA which is in reality mainly formed through multiphase chemistry; thus, the influence of aerosol acidity and sulfate particle change on isoprene SOA formation has not been fully considered in the model. This study reveals the urgent need to improve the SOA modeling in climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Semi-Supervised Eigenbasis Novelty Detection

Recent discoveries in high-time-resolution radio astronomy data have focused attention on a new class of events. Fast transients are rare pulses of radio frequency energy lasting from microseconds to seconds that might be produced by a variety of exotic astrophysical phenomena. For example, X-ray bursts, neutron stars, and active galactic nuclei are all possible sources of short-duration, transient radio signals. It is difficult to anticipate where such signals might appear, and they are most commonly discovered through analysis of high-time- resolution data that had been collected for other purposes. Transients are often faint and difficult to detect, so improved detection algorithms can directly benefit the science yield of all such commensal monitoring. A new detection algorithm learns a low-dimensional linear manifold for describing the normal data. High reconstruction error indicates a novel signal that does not match the patterns of normal data. One unsupervised portion of the manifold model adapts its representation in response to recent data. A second supervised portion of the model is made of a basis trained in advance using labeled examples of RFI; this prevents false positives due to these events. For a linear model, an orthonormalization operation is used to combine these bases prior to the anomaly detection decision. Another novel aspect of the approach lies in combining basis vectors learned in an unsupervised, online fashion from the data stream with supervised basis vectors learned in advance from known examples of false alarms. Adaptive, data-driven detection is achieved that is also informed by existing domain knowledge about signals that may be statistically anomalous, but are not interesting and should therefore be ignored. The method was evaluated using data from the Parkes Multibeam Survey. This data set was originally collected to search for pulsars, which are astronomical sources that emit radio pulses at regular periods. However, several non-pulsar anomalies have recently been discovered in this dataset, making it a compelling test case. By explicitly filtering known false alarm patterns, the approach yields significantly better performance than current transient detection methods.

Wagstaff, Kiri L.↗

An evaluation of global organic aerosol schemes using airborne observations

Chemical transport models have historically struggled to accurately simulate the magnitude and variability of observed organic aerosol (OA), with previous studies demonstrating that models significantly underestimate observed concentrations in the troposphere. In this study, we explore two different model OA schemes within the standard GEOS-Chem chemical transport model and evaluate the simulations against a suite of 15 globally distributed airborne campaigns from 2008 to 2017, primarily in the spring and summer seasons. These include the ATom, KORUS-AQ, GoAmazon,FRAPPE, SEAC4RS, SENEX, DC3, CalNex, OP3, EUCAARI, ARCTAS and ARCPAC campaigns and provide broad coverage over a diverse set of atmospheric composition regimes – anthropogenic, biogenic, pyrogenic and remote. The schemes include significant differences in their treatment of the primary and secondary components of OA – a “simple scheme” that models primary OA (POA) as non-volatile and takes a fixed-yield approach to secondary OA (SOA) formation and a “complex scheme” that simulates POA as semi-volatile and uses a more sophisticated volatility basis set approach for non-isoprene SOA, with an explicit aqueous uptake mechanism to model isoprene SOA. Despite these substantial differences, both the simple and complex schemes perform comparably across the aggregate dataset in their ability to capture the observed variability (with an R2 of 0.41 and 0.44, respectively). The simple scheme displays greater skill in minimizing the overall model bias (with a normalized mean bias of 0.04 compared to 0.30 for the complex scheme). Across both schemes, the model skill in reproducing observed OA is superior to previous model evaluations and approaches the fidelity of the sulfate simulation within the GEOS-Chem model. However,there are significant differences in model performance across different chemical source regimes, classified here into seven categories.Higher-resolution nested regional simulations indicate that model resolution is an important factor in capturing variability in highly localized campaigns, while also demonstrating the importance of well-constrained emissions inventories and local meteorology, particularly over Asia. Our analysis suggests that a semi-volatile treatment of POA is superior to anon-volatile treatment. It is also likely that the complex scheme parameterization overestimates biogenic SOA at the global scale. While this study identifies factors within the SOA schemes that likely contribute to OA model bias (such as a strong dependency of the bias in the complex scheme on relative humidity and sulfate concentrations), comparisons with the skill of the sulfate aerosol scheme in GEOS-Chem indicate the importance of other drivers of bias, such as emissions, transport and deposition, that are exogenous to the OA chemical scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Historical (1700–2012) Global Multi-Model Estimates of the Fire Emissions from the Fire Modeling Intercomparison Project (FireMIP)

Fire emissions are critical for carbon and nutrient cycles, climate, and air quality. Dynamic Global Vegetation Models (DGVMs) with interactive fire modeling provide important estimates for long-term and large-scale changes of fire emissions. Here we present the first multi-model estimates of global gridded historical fire emissions for 1700-2012, including carbon and 33 species of trace gases and aerosols. The dataset is based on simulations of nine DGVMs with different state-of-the-art global fire models that participated in the Fire Modeling Intercomparison Project (FireMIP), using the same and standardized protocols and forcing data, and the most up-to-date fire emission factor table from field and laboratory studies over various land cover types. We evaluate the simulations of present-day fire emissions by comparing them with satellite-based products. Evaluation results show that most DGVMs simulate present-day global fire emission totals within the range of satellite-based products, and can capture the high emissions over the tropical savannas, low emissions over the arid and sparsely vegetated regions, and the main features of seasonality. However, most of the models fail to simulate the interannual variability, partly due to a lack of modeling peat fires and tropical deforestation fires. Historically, all models show only a weak trend in global fire emissions before ~1850s, consistent with multi-source merged historical reconstructions. The long-term trends among DGVMs are quite different for the 20th century, with some models showing an increase and others a decrease in fire emissions, mainly as a result of the discrepancy in their simulated responses to human population density change and land-use and land-cover change (LULCC). Our study provides a basic dataset for developing regional and global multi-source merged historical reconstructions and merging methods, and analyzing historical changes of fire emissions and their uncertainties as well as their role in the Earth system. It also highlights the importance of accurately modeling the responses of fire emissions to LULCC and population density change in reducing uncertainties in historical reconstructions of fire emissions and providing more reliable future projections.

Li, Fang↗

Feedstock variability impacts the bioconversion of sugar and lignin streams derived from corn stover by Clostridium tyrobutyricum and engineered Pseudomonas putida

Abstract Feedstock variability represents a challenge in lignocellulosic biorefineries, as it can influence both lignocellulose deconstruction and microbial conversion processes for biofuels and biochemicals production. The impact of feedstock variability on microbial performance remains underexplored, and predictive tools for microbial behaviour are needed to mitigate risks in biorefinery scale‐up. Here, twelve batches of corn stover were deconstructed via deacetylation, mechanical refining, and enzymatic hydrolysis to generate lignin‐rich and sugar streams. These batches and their derived streams were characterised to identify their chemical components, and the streams were used as substrates for producing muconate and butyrate by engineered Pseudomonas putida and wildtype Clostridium tyrobutyricum , respectively. Bacterial performance (growth, product titers, yields, and productivities) differed among the batches, but no strong correlations were identified between feedstock composition and performance. To provide metabolic insights into the origin of these differences, we evaluated the effect of twenty‐three isolated chemical components on these microbes, including three components in relevant bioprocess settings in bioreactors, and we found that growth‐inhibitory concentrations were outside the ranges observed in the streams. Overall, this study generates a foundational dataset on P. putida and C. tyrobutyricum performance to enable future predictive models and underscores their resilience in effectively converting fluctuating lignocellulose‐derived streams into bioproducts.

09 BIOMASS FUELS↗

Redox potential in Typha-dominated tidal brackish marsh, PIE LTER, Plum Island Sound, MA, 2023

This dataset includes soil redox potential measurements collected at multiple depths within a tidal brackish wetland in the upper estuary of the Plum Island Ecosystems Long-Term Ecological Research site (PIE LTER), Plum Island Sound, Newbury, Massachusetts (MA). Measurements were taken to evaluate temporal variation in redox potential in relation to hydrological events at three replicate locations. Data were recorded every 5 minutes using a Campbell Scientific Volt116 connected to a CR6 datalogger with SWAP instrument redox probes (ORP-30-4-B) and reference electrodes. Measurements were made at the AmeriFlux site US-PLo at four soil depths (5, 10, 15, and 30 cm). The file redox_soiltemp_2023.csv contains temperature-corrected redox values and soil temperature following Silva-Machado et al. (2024). Metadata files redox_soiltemp_dd.csv and redox_soiltemp_2023_flmd.csv provide detailed descriptions of variables and site locations.

54 ENVIRONMENTAL SCIENCES↗