Results for “validation dataset” — Page 83

DOE OSTI2025

High-resolution leaf area index maps generated from unoccupied aerial system, Teller Mile 27, Seward Peninsula, Alaska

Leaf area index (LAI), a measure of the amount of one-side leaf area per ground unit, is an important indicator of plant carbon, energy, and water cycle. In the heterogeneous Arctic landscapes, it has been challenging to accurately measure LAI across species and space needed for Earth system model validation. Here, we use multispectral unoccupied aerial systems (UASs) to scale up and map leaf area index (LAI) , in a low-Arctic tundra landscape on the Seward Peninsula, Alaska. We linked previous published LAI measurements with high-resolution, UAS-collected multispectral data collected over the region of Next Generation Ecosystem Experiments in the Arctic (NGEE Arctic)’s Teller Mile Maker 27 site in 2022 to develop random forest (RF) machine learning models to predict and map LAI. 100 RF models were developed to account for uncertainties in ground LAI plot measurements and process scaling. This dataset includes a raster (*.tif) map of the mean LAI value of the 100 RF models, a raster (*.tif) map of the standard deviation of the RF-modeled LAI data, and a user guide (*.pdf).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Simulating the Trajectory and Biomass Growth of Free-Floating Macroalgal Cultivation Platforms along the U.S. West Coast

Trajectory tracking and macroalgal growth models were coupled to support a novel macroalgae-harvesting concept known as the Nautical Off-shore Macroalgal Autonomous Device (NOMAD). The NOMAD consists of 5 km long carbon-fiber longlines that are seeded and free float southward along the U.S. West Coast for approximately 3 months before harvesting off the California coast, taking advantage of favorable environmental conditions. The trajectory and macroalgal growth models were applied to answer planning questions pertinent to the techno-economic analysis such as identifying the preferred release location, approximate pathway, timing until harvest, and estimated growth. Trajectories were determined with the General NOAA Operational Modeling Environment (GNOME) model, using 11 years of current and wind data, determining probabilities by running nearly 40,000 Monte Carlo simulations varying the start time and location. An accompanying macroalgal growth model was used to estimate the growth of macroalgae based on the trajectory tracks and environmental forcing products, including light, temperature and nutrients. Model results show that NOMAD lines transit south in the months of April to September due to seasonal currents, taking approximately 3 months to reach Southern California. During transit, NOMAD lines are dispersed but typically avoid beaching or passing through marine sanctuaries. NOMAD lines can yield up to 30 kg wet weight per meter of cultivation line.

09 BIOMASS FUELS↗

DOE OSTI2022

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

DOE OSTI2023

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

DOE OSTI2023

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

DOE OSTI2023

MERIT-Plus Dataset: Delineation of endorheic basins in 5 and 15 min upscaled river networks

Endorheic drainage basins, those inland basins not connected directly to ocean, are essential for hydrological modeling of global and regional water balances, land surface water storage, gravity anomalies, sea level rise, etc. Within many hydrological model frameworks, river basins are defined by digital river networks through their flow direction and connectivity datasets. Here we present an improvement to gridded flow direction data and its derivatives produced from upscaled global 5 and 15 arc minute MERIT networks. We explicitly label endorheic and exorheic drainage basins and alter the delineation of endorheic basins by merging small inland watersheds to the adjacent host basins. The resulting datasets have a significantly reduced number of endorheic basins while preserving the total land portion of those basins since most of the merged catchments were inside other larger endorheic areas. We developed and present here the endorheic basin delineation method. This method performs an analysis of the contributing river and basin geometry relative to the location of the flow end point (i.e. potential endorheic lake), proximity of the latter to the drainage basin boundary and the elevation difference between the basin's lowest point and potential spillover location at the basin boundary. The new digital river network was validated using the University of New Hampshire Water Balance Model by comparing the water balance of endorheic inland depressions with modeled accumulation of water in their inland lakes based on the observed historical climate drivers used by WBM.

Earth Systems↗

NASA NTRS2003

Synthesis of Multispectral Bands from Hyperspectral Data: Validation Based on Images Acquired by AVIRIS, Hyperion, ALI, and ETM+

Spectral band synthesis is a key step in the process of creating a simulated multispectral image from hyperspectral data. In this step, narrow hyperspectral bands are combined into broader multispectral bands. Such an approach has been used quite often, but to the best of our knowledge accuracy of the band synthesis simulations has not been evaluated thus far. Therefore, the main goal of this paper is to provide validation of the spectral band synthesis algorithm used in the ART software. The next section contains a description of the algorithm and an example of its application. Using spectral responses of AVIRIS, Hyperion, ALI, and ETM+, the following section shows how the synthesized spectral bands compare with actual bands, and it presents an evaluation of the simulation accuracy based on results of MODTRAN modeling. In the final sections of the paper, simulated images are compared with data acquired by actual satellite sensors. First, a Landsat 7 ETM+ image is simulated using an AVIRIS hyperspectral data cube. Then, two datasets collected with the Hyperion instrument from the EO-1 satellite are used to simulate multispectral images from the ALI and ETM+ sensors.

Blonski, Slawomir↗

NASA NTRS2009

Approach to Managing MeaSURES Data at the GSFC Earth Science Data and Information Services Center (GES DISC)

A major need stated by the NASA Earth science research strategy is to develop long-term, consistent, and calibrated data and products that are valid across multiple missions and satellite sensors. (NASA Solicitation for Making Earth System data records for Use in Research Environments (MEaSUREs) 2006-2010) Selected projects create long term records of a given parameter, called Earth Science Data Records (ESDRs), based on mature algorithms that bring together continuous multi-sensor data. ESDRs, associated algorithms, vetted by the appropriate community, are archived at a NASA affiliated data center for archive, stewardship, and distribution. See http://measures-projects.gsfc.nasa.gov/ for more details. This presentation describes the NASA GSFC Earth Science Data and Information Services Center (GES DISC) approach to managing the MEaSUREs ESDR datasets assigned to GES DISC. (Energy/water cycle related and atmospheric composition ESDRs) GES DISC will utilize its experience to integrate existing and proven reusable data management components to accommodate the new ESDRs. Components include a data archive system (S4PA), a data discovery and access system (Mirador), and various web services for data access. In addition, if determined to be useful to the user community, the Giovanni data exploration tool will be made available to ESDRs. The GES DISC data integration methodology to be used for the MEaSUREs datasets is presented. The goals of this presentation are to share an approach to ESDR integration, and initiate discussions amongst the data centers, data managers and data providers for the purpose of gaining efficiencies in data management for MEaSUREs projects.

Vollmer, Bruce↗

NASA NTRS2015

Evaluating the Sensitivity of Agricultural Model Performance to Different Climate Inputs: Supplemental Material

Projections of future food production necessarily rely on models, which must themselves be validated through historical assessments comparing modeled and observed yields. Reliable historical validation requires both accurate agricultural models and accurate climate inputs. Problems with either may compromise the validation exercise. Previous studies have compared the effects of different climate inputs on agricultural projections but either incompletely or without a ground truth of observed yields that would allow distinguishing errors due to climate inputs from those intrinsic to the crop model. This study is a systematic evaluation of the reliability of a widely used crop model for simulating U.S. maize yields when driven by multiple observational data products. The parallelized Decision Support System for Agrotechnology Transfer (pDSSAT) is driven with climate inputs from multiple sources reanalysis, reanalysis that is bias corrected with observed climate, and a control dataset and compared with observed historical yields. The simulations show that model output is more accurate when driven by any observation-based precipitation product than when driven by non-bias-corrected reanalysis. The simulations also suggest, in contrast to previous studies, that biased precipitation distribution is significant for yields only in arid regions. Some issues persist for all choices of climate inputs: crop yields appear to be oversensitive to precipitation fluctuations but under sensitive to floods and heat waves. These results suggest that the most important issue for agricultural projections may be not climate inputs but structural limitations in the crop models themselves.

simulation↗

DOE OSTI2021

Identifying schools at high-risk for elevated lead in drinking water using only publicly available data

Estimating the risk of lead contamination of schools' drinking water at the State level is a complex, important, and unexplored challenge. Variable water quality among water systems and changes in water chemistry during distribution affect lead dissolution rates from pipes and fittings. In addition, the locations of lead-bearing plumbing materials are uncertain. We tested the capability of six machine learning models to predict the likelihood of lead contamination of drinking water at the schools' taps using only publicly available datasets. The predictive features used in the models correspond to those with a proven correlation to the dominant, but commonly unavailable, factors that govern lead leaching: the presence of lead-bearing plumbing materials and water quality conducive to lead corrosion. By combining water chemistry data from public reports, socioeconomic information from the US census, and spatial features using Geographic Information Systems, we trained and tested models to estimate the likelihood of lead contaminated tap water in over 8,000 schools across California and Massachusetts. Our best-performing model was a Random Forest, with a 10-fold cross validation score of 0.88 for Massachusetts and 0.78 for California using the average Area Under the Receiver Operating Characteristic Curve (ROC AUC) metric. The model was then used to assign a lead leaching risk category to half of the schools across California (the other half was used for training). There was good agreement between the modeled risk categories and the actual lead leaching outcomes for every school; however, the model overestimated the lead leaching risk in up to 17% of the schools. This model is the first of its kind to offer a tool to predict the risk of lead leaching in schools at the State level. Further use of this model can help deploy limited resources more effectively to prevent childhood lead exposure from school drinking water.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

DOE OSTI2025

Automation and machine learning drive rapid optimization of isoprenol production in Pseudomonas putida

Advances in genome engineering have improved our ability to perturb microbial metabolic networks, yet bioproduction campaigns often struggle with parsing complex metabolic datasets to efficiently enhance product titers. We address this challenge by coupling laboratory automation with machine learning to systematically optimize the production of isoprenol, a sustainable aviation fuel precursor, in Pseudomonas putida. The simultaneous downregulation through CRISPR interference of combinations of up to four gene targets, guided by machine learning, permitted us to increase isoprenol titer 5-fold in six consecutive design-build-test-learn cycles. Moreover, machine learning enabled us to swiftly explore a vast experimental design space of 800,000 possible combinations by strategically recommending approximately 400 priority constructs. High-throughput proteomics allowed us to validate CRISPRi downregulation and identify biological mechanisms driving production increases. Our work demonstrates that ML-driven automated design-build-test-learn cycles, when combined with rigorous data validation, can rapidly enhance titers without specific biological knowledge, suggesting that it can be applied to any host, product, or pathway.

Carruthers, David N↗

DOE OSTI2021

Accelerated, scalable and reproducible AI-driven gravitational wave detection

The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware-Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery. By combining a repository for artificial intelligence models and a supercomputing cluster, an entire month's worth of advanced LIGO data is analysed in just 7 min, finding all binary black hole mergers previously identified in this dataset and reporting no misclassifications.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Achieving Realistic Runoff in the Western United States with a Land Surface Model Forced by Dynamically Downscaled Meteorology

Abstract In this study, we calibrate a regional climate model’s (RCM) underlying land surface model (LSM). In addition to providing a realistic representation of runoff across the hydroclimatically diverse western United States, this is done to take advantage of the RCM’s ability to physically resolve meteorological forcing data in ungauged regions, and to prepare the calibrated hydrologic model for tight coupling, or the ability to represent land surface–atmosphere interactions, with the RCM. Specifically, we use a 9-km resolution meteorological forcing dataset across the western United States, from the fifth generation ECMWF Reanalysis (ERA5) downscaled by the Weather Research Forecasting (WRF) regional climate model, as an offline forcing for Noah-Multiparameterization (Noah-MP). We detail the steps involved in producing an LSM capable of accurately representing runoff, including physical parameterization selection, parameter calibration, and regionalization to ungauged basins. Based on our model evaluation from 1954 to 2021 for 586 basins with daily natural streamflow, the streamflow bias is reduced from 24.2% to 4.4%, and the median daily Nash–Sutcliffe efficiency (NSE) is improved from 0.12 to 0.36. When validating against basins with monthly natural streamflow data, we obtain a similar reduction in bias and a median monthly NSE improvement from 0.18 to 0.56. In this study, we also discover the optimal setup when using a donor-basin method to regionalize parameters to ungauged basins, which can vary by 0.06 NSE for unique designs of this regionalization method. Significance Statement This study provides useful guidance for improving a land surface model to accurately represent runoff across a spatially extensive and hydroclimatically diverse region (the western United States). The land surface model is updated to represent runoff more accurately at gauged basins, and then additionally updated for basins without observational data using a mathematical approach called the donor-basin method. We make use of a regional climate model’s reanalysis-derived meteorological data and its underlying land surface model to achieve realistic runoff. The calibrated land surface model can thus be tightly coupled in subsequent studies in a manner that should more accurately reflect runoff conditions. Findings from this study will serve as a useful reference for the atmospheric (and hydrologic) modeling communities and their ability to represent large-scale hydrology accurately.

Meteorology & Atmospheric Sciences↗

DOE OSTI2021

Pushing the Limits of High-speed X-ray Tomography to See the Unknown

First-of-their kind datasets from a high-speed X-ray tomography system were collected, and a novel numerical effort utilizing temporal information to reduce measurement uncertainty was shown. The experimental campaign used three high-speed X-ray imaging systems to collect data at 100 kHz of a scene containing high-velocity objects. The scene was a group of known objects propelled by a 12-gauge shotgun shell reaching speeds of hundreds of meters per second. These data represent a known volume where the individual components are known, with experimental uncertainties that can be used for reconstruction algorithm validation. The numerical effort used synthetic volumes in MATLAB to produce projections along known lines of sight to perform tomographic reconstructions. These projections and reconstructions were performed on a single object at two orientations, representing two timesteps, to increase the reconstruction accuracy.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks↗

DOE OSTI2025

Expediting field-effect transistor chemical sensor design with neuromorphic spiking graph neural networks

Improving the sensitive and selective detection of analytes in a variety of applications requires accelerating the rational design of field-effect transistor (FET) chemical sensors. Achieving high-performance detection relies on identifying optimal probe materials that can effectively interact with target analytes, a process traditionally driven by chemical intuition and time-consuming trial-and-error methods. To address the difficulties in probe screening for FET sensor development, this work presents a methodology that combines neuromorphic machine learning (ML) architectures, specifically a hybrid spiking graph neural network (SGNN), with an enriched dataset of physicochemical properties through semi-automated data extraction using large language models. Achieving a classification accuracy of 0.89 in predicting sensor sensitivity categories, the SGNN model outperformed traditional ML techniques by leveraging its ability to capture both global physicochemical properties and sparse topological features through a hybrid modeling framework. Next-generation sensor design was informed by the actionable insights into the connections between material properties and sensing performance offered by the SGNN framework. Through virtual screening for the detection of per- and polyfluoroalkyl substances (PFAS) as a use case, the effectiveness of the SGNN model was further validated. Density functional theory simulations confirmed graphene as a promising active material for PFAS detection as suggested by the SGNN framework. By bridging gaps in predictive modeling and data availability, this integrated approach provides a strong foundation for accelerating advancements in FET sensor design and innovation.

Ferreira, Rodrigo Pires [Univ. of Chicago, IL (Uni↗

DOE OSTI2022

Making Invisible Visible: Data-Driven Seismic Inversion With Spatio-Temporally Constrained Data Augmentation

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of obtaining data through expensive physical experiments, instruments, and simulations, data augmentation techniques for scientific applications have emerged as a new direction for obtaining scientific data recently. However, existing data augmentation techniques originating from computer vision yield physically unacceptable data samples that are not helpful for the domain problems that we are interested in. In this article, we develop new data augmentation techniques based on convolutional neural networks. Specifically, our generative models leverage different physics knowledge (such as governing equations, observable perception, and physics phenomena) to improve the quality of the synthetic data. To validate the effectiveness of our data augmentation techniques, we apply them to solve a subsurface seismic full-waveform inversion using simulated CO 2 leakage data. Our interest is to invert for subsurface velocity models associated with very small CO 2 leakage. We validate the performance of our methods using comprehensive numerical tests. Here via comparison and analysis, we show that data-driven seismic imaging can be significantly enhanced by using our data augmentation techniques. Particularly, the imaging quality has been improved by 15% in test scenarios of general-sized leakage and 17% in small-sized leakage when using an augmented training set obtained with our techniques.

58 GEOSCIENCES↗

DOE OSTI2025

GRUMDN: A Multi-Task Model for Predicting Human Patterns-of-Life from Stay Transition Data

Understanding human patterns-of-life (PoL) is essential towards ensuring safe and secure indoor facility environment as well as outdoor urban environment. Prediction of human movement in between places of interest is vital in understanding human PoL. Movement between spaces maybe represented and detected in one of the two forms: 1) trajectories: locations measured at regular time intervals by mobile sensors, bluetooth or GPS sensors; or 2) stay transitions: semantic PoI (points of interest) and stay duration data measurable by eventbased sensors that collect data when a check-in or check-out event is detected. Stay transition data provides a more compressed data format compared to trajectories data, especially in situations with longer stay durations, while preserving the information necessary for PoL analysis. Now as introduced briefly in the paper, our deployed end application (Digital Twin of a facility with non-player characters, besides the interactive user in virtual reality) needed a well-performing and validated AI/ML model for simulating high quality stay transitions behavior. In this study we thus primarily present our findings with developing and validating that model, which is a multi-task neural network for stay transition prediction. The neural network consists of two heads, for corresponding two tasks of stay category prediction and stay duration prediction. We evaluated gated recurrent units and multi-layer perceptrons of varying network sizes for stay category prediction; while mixture density networks, noisy generator-only networks, and generative adversarial networks of varying network sizes for stay duration prediction. We have then evaluated four multi-task models, constructed by combining these specialized models, on their ability to predict stay transition data. We tested our models on datasets from two different cases: 1) a simulation-generated dataset of indoor movement within the HFIR (high flux isotope reactor) nuclear reactor facility at Oak Ridge National Laboratory (ORNL); and 2) the GeoLife human mobility dataset of outdoor urban movement available in literature. Our results indicate that GRUMDN, which combines gated recurrent units (GRU) for stay category prediction task, and mixture density networks (MDN) for stay duration prediction task, did overall outperform other multitask models and the current state-of-the-art.

Gunaratne, Chathika [ORNL] (ORCID:0000000225088745↗