SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Flood Susceptibility Mapping Using Machine Learning and Geospatial-Sentinel-1 SAR Integration for Enhanced Early Warning Systems

This study presents a comprehensive framework for flood susceptibility mapping by integrating geospatial factors with both statistical and machine learning models. Thirteen Flood-related factors, including DEM, slope, TWI, NDVI, etc., are extracted as features of models, and historical flood data derived from Sentinel-1 SAR from 2018 to 2023 are used as the target variables of the models. These datasets are analyzed using a frequency-based statistical model and three machine learning models, including Random Forest, XGBoost, and CNN, to generate flood susceptibility maps. The performance of each model is evaluated through AUC; and SHAP scores are separately generated for Machine learning (ML) models to explain each feature contribution in the ML model. The generated susceptibility maps are validated by high-flood-risk locations monitored by flood sensors, BLE inundation models, and flood-prone areas suggested by the Local Community Task Force. The results indicate that the XGBoost model outperforms all other models, with an AUC of 0.92 and demonstrates the highest alignment with recommended high-flood-risk locations, while the frequency-based statistical model showed the weakest performance with an AUC of 0.65. SHAP value graphs highlight the elevation, slope, and TWI as the most influential features across all models. The susceptibility maps generated by the machine learning model show strong agreement with the BLE map and high-flood-risk areas identified by the local Community Task Force.

Google Engine↗

DOE OSTI2024

Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology Using Large Language Models—A Case in Optimizing Intermodal Freight Transportation

The incorporation of Artificial Intelligence (AI) models into various optimization systems is on the rise. However, addressing complex urban and environmental management challenges often demands deep expertise in domain science and informatics. This expertise is essential for deriving data and simulation-driven insights that support informed decision-making. In this context, we investigate the potential of leveraging the pre-trained Large Language Models (LLMs) to create knowledge representations for supporting operations research. By adopting ChatGPT-4 API as the reasoning core, we outline an applied workflow that encompasses natural language processing, Methontology-based prompt tuning, and Generative Pre-trained Transformer (GPT), to automate the construction of scenario-based ontologies using existing research articles and technical manuals of urban datasets and simulations. From these ontologies, knowledge graphs can be derived using widely adopted formats and protocols, guiding various tasks towards data-informed decision support. The performance of our methodology is evaluated through a comparative analysis that contrasts our AI-generated ontology with the widely recognized pizza ontology, commonly used in tutorials for popular ontology software. We conclude with a real-world case study on optimizing the complex system of multi-modal freight transportation. Our approach advances urban decision support systems by enhancing data and metadata modeling, improving data integration and simulation coupling, and guiding the development of decision support strategies and essential software components.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2024

Deep-learning-derived planetary boundary layer height from conventional meteorological measurements

Abstract. The planetary boundary layer (PBL) height (PBLH) is an important parameter for various meteorological and climate studies. This study presents a multi-structure deep neural network (DNN) model, which can estimate PBLH by integrating the morning temperature profiles and surface meteorological observations. The DNN model is developed by leveraging a rich dataset of PBLH derived from long-standing radiosonde records augmented with high-resolution micro-pulse lidar and Doppler lidar observations. We access the performance of the DNN with an ensemble of 10 members, each featuring distinct hidden-layer structures, which collectively yield a robust 27-year PBLH dataset over the southern Great Plains from 1994 to 2020. The influence of various meteorological factors on PBLH is rigorously analyzed through the importance test. Moreover, the DNN model's accuracy is evaluated against radiosonde observations and juxtaposed with conventional remote sensing methodologies, including Doppler lidar, ceilometer, Raman lidar, and micro-pulse lidar. The DNN model exhibits reliable performance across diverse conditions and demonstrates lower biases relative to remote sensing methods. In addition, the DNN model, originally trained over a plain region, demonstrates remarkable adaptability when applied to the heterogeneous terrains and climates encountered during the GoAmazon (Green Ocean Amazon; tropical rainforest) and CACTI (Cloud, Aerosol, and Complex Terrain Interactions; middle-latitude mountain) campaigns. These findings demonstrate the effectiveness of deep learning models in estimating PBLH, enhancing our understanding of boundary layer processes with implications for improving the representation of PBL in weather forecasting and climate modeling.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2014

Water Balance in the Amazon Basin from a Land Surface Model Ensemble

Despite recent advances in land surfacemodeling and remote sensing, estimates of the global water budget are still fairly uncertain. This study aims to evaluate the water budget of the Amazon basin based on several state-ofthe- art land surface model (LSM) outputs. Water budget variables (terrestrial water storage TWS, evapotranspiration ET, surface runoff R, and base flow B) are evaluated at the basin scale using both remote sensing and in situ data. Meteorological forcings at a 3-hourly time step and 18 spatial resolution were used to run 14 LSMs. Precipitation datasets that have been rescaled to matchmonthly Global Precipitation Climatology Project (GPCP) andGlobal Precipitation Climatology Centre (GPCC) datasets and the daily Hydrologie du Bassin de l'Amazone (HYBAM) dataset were used to perform three experiments. The Hydrological Modeling and Analysis Platform (HyMAP) river routing scheme was forced with R and B and simulated discharges are compared against observations at 165 gauges. Simulated ET and TWS are compared against FLUXNET and MOD16A2 evapotranspiration datasets andGravity Recovery and ClimateExperiment (GRACE)TWSestimates in two subcatchments of main tributaries (Madeira and Negro Rivers).At the basin scale, simulated ET ranges from 2.39 to 3.26 mm day(exp -1) and a low spatial correlation between ET and precipitation indicates that evapotranspiration does not depend on water availability over most of the basin. Results also show that other simulated water budget components vary significantly as a function of both the LSM and precipitation dataset, but simulated TWS generally agrees with GRACE estimates at the basin scale. The best water budget simulations resulted from experiments using HYBAM, mostly explained by a denser rainfall gauge network and the rescaling at a finer temporal scale.

GPCP↗

NASA NTRS2018

On-Orbit Verification of GLM Navigation on GOES-16

The GOES-R flight project has developed the Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) to perform independent INR evaluations of the optical instruments on the GOES-R series spacecraft. In this presentation, we document the development of navigation (NAV) evaluation capabilities within IPATS for the Geostationary Lightning Mapper (GLM). We also discuss the post-processing quality filtering developed for GLM NAV, and present example results for several GLM background image datasets. Initial results suggest that GOES-16 GLM is compliant with navigation requirements.

GLM↗

NASA NTRS2018

Evaluation of Geostationary Lightning Mapper (GLM) Navigation Performance with the INR Performance Assessment Toolset (IPATS)

Isaacson, Peter J.↗

DOE OSTI2020

Potential Oil Supply and CO2 Demand for CO2 Enhanced Oil Recovery in the United States

This presentation was given at the 2020 Pittsburgh Coal Conference on Sept 10, 2020. It describes an analysis using the FE/NETL CO2 EOR Evaluation System in order to develop price curves for both oil supply as well as CO2 demand resulting from potential application of CO2 EOR. The analysis was conducted on a dataset of conventional oil reservoirs in the lower-48 states.

Morgan, David↗

DOE OSTI2022

Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Series

Anomaly detection is a widely studied task for a broad variety of data types; among them, multiple time series appear frequently in applications, including for example, power grids and traffic networks. Detecting anomalies for multiple time series, however, is a challenging subject, owing to the intricate interdependencies among the constituent series. We hypothesize that anomalies occur in low density regions of a distribution and explore the use of normalizing flows for unsupervised anomaly detection, because of their superior quality in density estimation. Moreover, we propose a novel flow model by imposing a Bayesian network among constituent series. A Bayesian network is a directed acyclic graph (DAG) that models causal relationships; it factorizes the joint probability of the series into the product of easy-to-evaluate conditional probabilities. We call such a graph-augmented normalizing flow approach GANF and propose joint estimation of the DAG with flow parameters. We conduct extensive experiments on real-world datasets and demonstrate the effectiveness of GANF for density estimation, anomaly detection, and identification of time series distribution drift.

Dai, Enyan↗

NASA NTRS2015

Evaluation of Radar Vegetation Indices for Vegetation Water Content Estimation Using Data from a Ground-Based SMAP Simulator

Vegetation water content (VWC) is an important component of microwave soil moisture retrieval algorithms. This paper aims to estimate VWC using L band active and passive radar/radiometer datasets obtained from a NASA ground-based Soil Moisture Active Passive (SMAP) simulator known as ComRAD (Combined Radar/Radiometer). Several approaches to derive vegetation information from radar and radiometer data such as HH, HV, VV, Microwave Polarization Difference Index (MPDI), HH/VV ratio, HV/(HH+VV), HV/(HH+HV+VV) and Radar Vegetation Index (RVI) are tested for VWC estimation through a generalized linear model (GLM). The overall analysis indicates that HV radar backscattering could be used for VWC content estimation with highest performance followed by HH, VV, MPDI, RVI, and other ratios.

soil moisture↗

NASA NTRS2021

FLUXNET-CH4: a global, multi-ecosystem dataset and analysis of methane seasonality from freshwater wetlands

Methane (CH4) emissions from natural landscapes constitute roughly half of global CH4 contributions to the atmosphere, yet large uncertainties remain in the absolute magnitude and the seasonality of emission quantities and drivers. Eddy covariance (EC) measurements of CH4 flux are ideal for constraining ecosystem-scale CH4 emissions due to quasi-continuous and high-temporal-resolution CH4 flux measurements, coincident carbon dioxide, water, and energy flux measurements, lack of ecosystem disturbance, and increased availability of datasets over the last decade. Here, we (1) describe the newly published dataset, FLUXNET-CH4 Version 1.0, the first open-source global dataset of CH4 EC measurements (available at https://fluxnet.org/data/fluxnet-ch4-community-product/, last access: 7 April 2021). FLUXNET-CH4 includes half-hourly and daily gap-filled and non-gap-filled aggregated CH4 fluxes and meteorological data from 79 sites globally: 42 freshwater wetlands, 6 brackish and saline wetlands, 7 formerly drained ecosystems, 7 rice paddy sites, 2 lakes, and 15 uplands. Then, we (2) evaluate FLUXNET-CH4 representativeness for freshwater wetland coverage globally because the majority of sites in FLUXNET-CH4 Version 1.0 are freshwater wetlands which are a substantial source of total atmospheric CH4 emissions; and (3) we provide the first global estimates of the seasonal variability and seasonality predictors of freshwater wetland CH4 fluxes. Our representativeness analysis suggests that the freshwater wetland sites in the dataset cover global wetland bioclimatic attributes (encompassing energy, moisture, and vegetation-related parameters) in arctic, boreal, and temperate regions but only sparsely cover humid tropical regions. Seasonality metrics of wetland CH4 emissions vary considerably across latitudinal bands. In freshwater wetlands (except those between 20°S to 20°N) the spring onset of elevated CH4 emissions starts 3 d earlier, and the CH4 emission season lasts 4 d longer, for each degree Celsius increase in mean annual air temperature. On average, the spring onset of increasing CH4 emissions lags behind soil warming by 1 month, with very few sites experiencing increased CH4 emissions prior to the onset of soil warming. In contrast, roughly half of these sites experience the spring onset of rising CH4 emissions prior to the spring increase in gross primary productivity (GPP). The timing of peak summer CH4 emissions does not correlate with the timing for either peak summer temperature or peak GPP. Our results provide seasonality parameters for CH4 modeling and highlight seasonality metrics that cannot be predicted by temperature or GPP (i.e., seasonality of CH4 peak). FLUXNET-CH4 is a powerful new resource for diagnosing and understanding the role of terrestrial ecosystems and climate drivers in the global CH4 cycle, and future additions of sites in tropical ecosystems and site years of data collection will provide added value to this database. All seasonality parameters are available at https://doi.org/10.5281/zenodo.4672601 (Delwiche et al., 2021). Additionally, raw FLUXNET-CH4 data used to extract seasonality parameters can be downloaded from https://fluxnet.org/data/fluxnet-ch4-community-product/ (last access: 7 April 2021), and a complete list of the 79 individual site data DOIs is provided in Table 2 of this paper.

FLUXNET-CH4↗

DOE OSTI2023

PYK-SubstitutionOME: an integrated database containing allosteric coupling, ligand affinity and mutational, structural, pathological, bioinformatic and computational information about pyruvate kinase isozymes

Interpreting changes in patient genomes, understanding how viruses evolve and engineering novel protein function all depend on accurately predicting the functional outcomes that arise from amino acid substitutions. To that end, the development of first-generation prediction algorithms was guided by historic experimental datasets. However, these datasets were heavily biased toward substitutions at positions that have not changed much throughout evolution (i.e. conserved). Although newer datasets include substitutions at positions that span a range of evolutionary conservation scores, these data are largely derived from assays that agglomerate multiple aspects of function. To facilitate predictions from the foundational chemical properties of proteins, large substitution databases with biochemical characterizations of function are needed. We report here a database derived from mutational, biochemical, bioinformatic, structural, pathological and computational studies of a highly studied protein family—pyruvate kinase (PYK). A centerpiece of this database is the biochemical characterization—including quantitative evaluation of allosteric regulation—of the changes that accompany substitutions at positions that sample the full conservation range observed in the PYK family. We have used these data to facilitate critical advances in the foundational studies of allosteric regulation and protein evolution and as rigorous benchmarks for testing protein predictions. We trust that the collected dataset will be useful for the broader scientific community in the further development of prediction algorithms.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Advantages of a variable‐resolution global climate model in reproducing the seasonal evolution of East Asian summer monsoon

Abstract The East Asian summer monsoon (EASM) is unique among monsoon systems that it features meridional evolution of the summer monsoon. In this study, we evaluate the performances of a Variable‐Resolution Community Earth System Model (VR‐CESM) regionally refined over eastern China (14 km) in reproducing the seasonal evolution of EASM precipitation over China. Compared with reference datasets, VR‐CESM shows better performance than the corresponding globally uniform coarse‐resolution model CESM (quasi‐uniform 1°), especially over western China where complex local topography exists. The northward monsoon migration is closely related to low‐level southerly flows and vertical moisture advection, which are more reasonably simulated in VR‐CESM. The four critical timings of the EASM (monsoon onset, withdrawal, peak, and duration) are also better captured in VR‐CESM than in CESM. The corresponding spatial Pearson correlation coefficients of the four critical timings with respect to reference datasets are about 0.1 higher in VR‐CESM than those in CESM. Both models are most accurate in simulating monsoon onset and least accurate at simulating the monsoon peak. The overestimated zonal thermal contrast in CESM is responsible for the earlier monsoon onset and excessive precipitation in September over the Yangtze River valley. Finer resolution in VR‐CESM, especially over the Tibetan Plateau (TP), appears to be a main factor in simulating better zonal thermal contrast and seasonal evolution of the EASM.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Review and Experimental Comparison of the Durability of Iodine Waste Forms in Semi-Dynamic Leach Testing

To ensure the safe disposal of radioiodine-containing nuclear wastes, a durable iodine waste form (IWF) is required. Many IWFs have been developed and evaluated for chemical durability using a wide range of test methods, making direct comparisons difficult as highlighted in this work through a review of available IWF corrosion data. To move toward a common dataset, a semi-dynamic leach test suite was experimentally demonstrated using several IWF types, providing standard comparisons. The results highlighted clear differences in corrosion resistance between various IWFs. This test suite is suggested for future studies to generate comparable data for a common dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Non-linear dependence of ion heat flux on plasma density at the L–H transition of JET NBI-heated deuterium–tritium plasmas

Abstract Recent JET D–T campaigns opened the possibility of unique isotope studies to investigate the L–H transition physics in view of reactor plasmas and to study the origin of the observed power threshold minimum. In the present paper, we characterise L–H transitions in the low and high-density branches of JET NBI-heated D–T plasmas. As discussed in the paper, L–H transition has been hypothesised to be determined by the transport power losses of plasma ions, i.e. the so-called ion heat flux ( Q i ). We present the first power balance analysis of JET NBI-heated D–T plasmas to evaluate the ion heat flux at the transition. Due to the experimental setting being similar to previous JET D experiments, we also directly compare the results, discussing the isotope effect and similarities between datasets. First, we find an isotope effect between D and D–T Q i , with a lower Q i in D–T plasmas. We confirm that the ion heat flux deviates from density linearity compared to the linear trend observed in wave-heated D plasmas of other tokamaks. The deviation we observe in NBI-heated L–H transitions happens at an isotope-dependent density. Plasma edge rotation correlates with Q i deviation from density linearity in the low-density branch. However, further investigations would be required to assess the role of rotation on Q i and the power threshold minimum at JET. At low plasma density, NBI power dominates Q i , while increasing the density makes the equipartition power dominant. We finally compare our results with hypotheses proposed from evidence in other tokamaks to present a complete overview of ion heat flux analyses in D and D–T NBI-heated plasmas at JET.

Vincenzi, P. (ORCID:0000000251564354)↗

DOE OSTI2025

The impact of curation errors in the PDBBind Database on machine learning predictions of protein–protein binding affinity

The PDBBind database has been widely utilized for the computational prediction of protein–protein binding affinities. While the accuracy of the PDBBind-curated equilibrium dissociation constants (K D ) has been reported for the protein–ligand subset of the PDBBind database, the curation accuracy has not been reported for the protein–protein subset. Here, we present a detailed manual analysis for the subset of PDBBind records with PubMed Central Open Access primary publications and find that ~19% of these records had K D values that were not supported by their primary publications. The impact of these putative curation errors on the machine learning-based prediction of K D from experimental protein–protein 3D structures was evaluated and correcting the curation errors improved the Pearson correlation coefficient between measured and random forest-predicted log 10 (K D ) values by ~8 percentage points. This finding underscores the importance of dataset accuracy for computational modelling and highlights the need for more stringent curation processes when extracting information from the scientific literature.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Position-Enhanced Gradient Attack (PEGA) on Medical Language Models

Federated Learning (FL) enables collaborative training of language models on sensitive clinical notes without sharing the data. However, this paradigm is vulnerable to gradient inversion attacks that can reconstruct private data from shared gradients. We find that state-of-the-art attacks are less effective in the medical domain, failing to overcome the unique challenges posed by its specialized vocabulary and unstructured format. To address this, we introduce the Position-Enhanced Gradient Attack (PEGA), a novel attack that makes gradients position-aware by optimizing token and position embeddings simultaneously. PEGA employs two key innovations: a periodic sorting of positional embeddings to resolve token order ambiguity and a late-stage embedding replacement strategy to correct hard-to-recover critical tokens. To evaluate the leakage of sensitive data more directly, we also propose the Unified PHI-Recall (UPHI), a new metric measuring the recovery of Protected Health Information. Experiments on the MIMIC-III dataset show that PEGA significantly outperforms leading attacks like TAG and LAMP, particularly in its ability to reconstruct identifiable patient information, exposing a more severe and nuanced privacy risk in federated medical NLP.

Xu, Nuo [University of Minnesota]↗

DOE OSTI2026

Constructing a High‐Resolution Aftershock Catalog for the 2017 Mw 8.2 Tehuantepec Earthquake Sequence Using a Machine Learning–Based Workflow

The 8 September 2017 Mw 8.2 Tehuantepec earthquake was the largest instrumentally recorded normal‐faulting earthquake in Mexico. The mainshock occurred offshore within the Tehuantepec seismic gap, generating >30,000 aftershocks in the following year. We applied an open‐source, machine learning (ML)–assisted workflow to construct a high‐resolution aftershock catalog using data from temporary and permanent seismic networks in southern Mexico. The workflow integrates PhaseNet for phase detection; GaMMA for phase association; and VELEST, HypoInverse, and HypoDD for velocity modeling and relocation. We processed seven months of continuous waveform data from 29 broadband stations, including a temporary rapid‐response deployment that improved station coverage of the offshore rupture zone. To evaluate performance, we compared our results against analyst‐reviewed picks and event locations from the Servicio Sismológico Nacional catalog. The resulting catalog contains 11,374 relocated earthquakes and represents the most comprehensive published dataset for this sequence, incorporating the first full use of the temporary network. Relocated hypocenters show improved depth control and align well with the Slab2.0 subduction geometry, revealing clearer separation between offshore slab events and onshore crustal seismicity. This study demonstrates that combining ML‐based detection with established methods provides a scalable and reproducible approach for constructing high‐quality earthquake catalogs in tectonically complex environments and offers practical guidance for adapting similar workflows to other earthquake sequences.

Garcia, Marc [The University of Texas at El Paso, ↗

DOE OSTI2024

A Roadmap for a Lightning Modeling Grand Challenge

This document is a roadmap for building an interconnected model of the physical processes that produce a lightning discharge, and its observable optical and radio signals. We call this a Lightning Modeling Grand Challenge, recognizing that significant effort and coordination of human and financial resources is required to realize the capability. The roadmap serves to outline the coordination of resources necessary to enable stitching together existing knowledge and model components to make a lightning prediction, and to test these predictions with observations. Such a capability does not currently exist. The roadmap is motivated not only by a spirit of scientific inquiry, but by practical challenges faced by US Federal and societal stakeholders. Advancements in lightning observations have outpaced our tests of integrated understanding, leaving many stakeholders unsure how to design their missions to properly detect and discriminate lightning, and unsure how to apply the sometimes-disagreeing lightning signals from diverse instruments. The time is right to connect existing theories and models to support stakeholders in understanding the signals they observe, for needs as diverse as climate monitoring, national security, weather forecasting, public safety, and protection of natural and built environments. The roadmap’s two main technical sections describe the components of a linked physical model, followed by a description of models of lightning signals and sensors that are driven by outputs from the physical model. The goal is to predict the time-varying physical properties of lightning that are self-consistent with the thunderstorm’s structure and dynamics. These lightning signals then propagate through the storm, with realistic dispersion and attenuation, to receivers on the ground or in space. At a high level, the model begins with weather (cloud) model output, including explicit prediction of the electrification of cloud particles. The cloud’s electrical structure drives a model of lightning physics, from initiation, through channel development, and discharges along those channels. Key lightning parameters, such as the temperature and currents in the channel, and their space and time distribution, are then used to produce optical and electromagnetic signal sources that propagate to modeled receivers. This architecture therefore generates a dataset suitable for comparison to existing and envisioned observing systems. The need for additional measurements and field campaigns to support model development is described. In each model sub-component, inputs, outputs, uncertainties, evaluation methods, and next steps are summarized, interleaved with references to the scientific literature. Identifying boundaries between the model sub-components aids in segmenting an integrated, complex model into practical work packages and system sub-components, allowing a diverse team to contribute and maintain the system. We estimate that at least five years of effort and a $\$$10M initial investment is necessary to make a significant step forward. Mechanisms to facilitate community coordination, including annual workshops and open-source code repositories, are described.

54 ENVIRONMENTAL SCIENCES↗