Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100

Climate data, analysis and models for the study of natural variability and anthropogenic change

Gridded Temperature Under prior/current support, we completed and published (Jones et al., 2012) the fourth major update to our global land dataset of near-surface air temperatures, CRUTEM4. This is one of the most widely used records of the climate system, having been updated, maintained and further developed with DoE support since the 1980s. We have continued to update the CRUTEM4 (Jones et al., 2012) database that is combined with marine data to produce HadCRUT4 (Morice et al., 2012). The emphasis in our use of station temperature data is to access as many land series that have been homogenized by National Meteorological Services (NMSs, including NCDC/NOAA, Asheville, NC). Unlike the three US groups monitoring surface temperatures in a similar way, we do not infill areas that have no or missing data. We can only infill such regions in CRUTEM4 by accessing more station temperature series. During early 2014, we have begun the extensive task of updating as many of these series as possible using data provided by some NMSs and also through a number of research projects and programs around the world. All the station data used in CRUTEM4 have been available since 2009, but in Osborn and Jones (2014) we have made this more usable using a Google Earth interface (http://www.cru.uea.ac.uk/cru/data/crutem/ge/ ). We have recently completed the update of our infilled land multi-variable dataset (CRU TS 3.10, Harris et al., 2014). This additionally produces complete land fields (except for the Antarctic) for temperature, precipitation, diurnal temperature range, vapour pressure and sunshine/cloud. Using this dataset we have calculated sc-PDSI (self-calibrating Palmer Drought Severity Index) data and compared with other PDSI datasets (Trenberth et al., 2014). Also using CRU TS 3.10 and Reanalysis datasets, we showed no overall increase in global temperature variability despite changing regional patterns (Huntingford et al., 2013). Harris et al. (2014) is an update of an earlier dataset (Mitchell and Jones, 2005) which also had earlier DoE support. The earlier dataset has been cited over 1700 times according to ResearcherID on 31/July/2014 and the recent paper has already been cited 22 times. Analyses of Temperature Data Using the ERA-Interim estimate of the absolute surface air temperature of the Earth (instead of in the more normal form of anomalies) we compared the result against estimates we produced in 1999 with earlier DoE support. The two estimates are surprisingly close (differing by a couple of tenths of a degree Celsius), with the average temperature of the world (for 1981-2010) being very close to 14°C (Jones and Harpham, 2013). We have assessed ERA-Interim against station temperatures from manned and automatic weather station measurements across the Antarctic (Jones and Lister, 2014). Agreement is generally excellent across the Antarctic Peninsula and the sparsely sampled western parts of Antarctica. Differences tend to occur over eastern Antarctica where ERA-Interim is biased warm (up to 6°C) in the interior of the continent and biased cool (up to 6°C) for some of the coastal locations. Opportunities presented themselves during 2012 for collaborative work with a couple of Chinese groups. Three papers develop new temperature series for China as a whole and also for the eastern third of China (Wang et al., 2014, Cao et al., 2013 and Zhao et al., 2014). A dataset of ~400 daily Chinese temperature stations has been added to the CRU datasets. The latter paper finds that urban effects are generally about 10% of the long-term warming trend across eastern China. A fourth paper (Wang et al., 2013) illustrates issues with comparisons between reanalyses and surface temperatures across China, a method that has been widely used by some to suggest urban heating effects are much larger in the region. ERA-Interim can be used but NCEP/NCAR comparisons are very dependent on the period analysed. Earlier a new temperature dataset of homogenized records was developed for China (Li et al., 2009). Urbanization has also been addressed for London (Jones and Lister, 2009) where two rural sites have not warmed more than a city centre site since 1900. Additionally, in Ethymiadis and Jones (2010) we show that land air temperatures agree with marine data around coastal areas, further illustrating that urbanization is not a major component of large-scale surface air temperature change. Early instrumental data (before the development of modern thermometer screens) have always been suspected of being biased warm in summer, due to possible direct exposure to the sun. Two studies (Böhm et al., 2010 and Brunet et al., 2010) show this for the Greater Alpine Region (GAR) and for mainland Spain respectively. The issue is important before about 1870 in the GAR and before about 1900 in Spain. After correction for the problems, summer temperature estimates before these dates are cooler by about 0.4°C. In Jones and Wigley (2010), we discussed the importance of the biases in global temperature estimation. Exposure and to a lesser extent urbanization are the most important biases for the land areas, but both are dwarfed by the necessary adjustments for bucket SST measurements before about 1950. Individual station homogeneity is only important at the local scale. This was additionally illustrated by Hawkins and Jones (2013) where we replicated the temperature record developed by Guy Stewart Callendar in papers in 1938 and 1961. Analyses of Daily Climate Data Work here indicates that ERA-Interim (at least in Europe, Cornes and Jones, 2013, discussed in more detail in this proposal) can be used to monitor extremes (using the ETCCDI software – see Zhang et al., 2011). Additionally, also as a result of Chinese collaboration, a new method of daily temperature homogenization has been developed (Li et al., 2014). In Cornes and Jones (2011) we assessed storm activity in the northeast Atlantic region using daily gridded data. Even though the grid resolution is coarse (5° by 5° lat/long) the changes in storm activity are similar to those developed from the pressure triangle approach with station data. Analyses of humidity and pressure data In Simmons et al. (2010) we showed a reduction in relative humidity over low-latitude and mid-latitude land areas for the 10 years to 2008, based on monthly anomalies of surface air temperature and humidity from ECMWF reanalyses (ERA-40 and ERA-Interim) and our earlier land-only dataset (CRUTEM3) and synoptic humidity observations (HadCRUH). Updates of this station-based humidity dataset (now called HadISDH) extend the record, showing continued reductions (Willett et al., 2013). Analyses of Proxy Temperature Data In Vinther et al. (2010), relationships between the seasonal stable isotope data from Greenland Ice Cores and Greenland and Icelandic instrumental temperatures were investigated for the past 150-200 years. The winter season stable isotope data are found to be influenced by the North Atlantic Oscillation (NAO) and very closely related to SW Greenland temperatures. The summer season stable isotope data display higher correlations with Icelandic summer temperatures and North Atlantic SST conditions than with local SW Greenland temperatures. In Jones et al. (2014) we use these winter isotope reconstructions to show the expected inverse correlation (due to the NAO) with winter-season documentary reconstructions from the Netherlands and Sweden over the last 800 years. Finally, in this section Jones et al. (2013) shows the agreement between tree-ring width measurements from Northern Sweden and Finland and an assessment of the link to explosive volcanic eruptions. An instrumental record for the region in the early 19th century indicates that the summer of 1816 was only slightly below normal, explaining why this year has normal growth for both ring width and density. GCM/RCM/Reanalysis Evaluation In this section we have intercompared daily temperature extremes across Europe in Cornes and Jones (2013) using station data, E-OBS and ERA-Interim. We have additionally considered the impact of the urban issue on the global scale using the results of the Compo et al. (2011) Reanalyses, 20CR. These only make use of SST and station pressure data. Across the world’s land areas, they indicate similar warming since 1900 to that which has occurred (Compo et al., 2013), again illustrating that urbanization is not the cause of the long-term warming. Changes in HadCRUH global land surface specific humidity and CRUTEM3 surface temperatures from 1973 to 1999 were compared to the CMIP3 archive of climate model simulations with 20th Century forcings (Willett et al., 2010). The models reproduce the magnitude of observed interannual variance over all large regions. Observed and modelled trends and temperature-humidity relationships are comparable with the exception of the extra-tropical Southern Hemisphere where observations exhibit no trend but models exhibit moistening.

54 ENVIRONMENTAL SCIENCES↗

Hydropower Infrastructure – LAkes, Reservoirs, and RIvers (HILARRI)

HILARRI is a database of links between major datasets of operational hydropower dams and powerplants, and inland water bodies. These connections are critical for conducting large-scale analysis of hydropower infrastructure and their associated natural and engineered water systems. Features include: – Dams from the National Inventory of Dams (2024) and the Global Reservoir and Dam Database (GRanD v1.3) – Hydropower plants from the Existing Hydropower Assets dataset (EHA 2024) These hydropower infrastructure features are linked to several major datasets that provide hydrologic and hydraulic information relevant for analysis of hydropower systems that includes the integral water resources. That information comes from: – Products from the National Hydrography Dataset (NHD) – NHDPlusV2 Medium Resolution river network flowlines, – NHD waterbodies (limited to lakes and reservoirs), – NHD Watershed Boundary Dataset (HUC12-level for the Conterminous United States (CONUS)) – NHD High Resolution waterbodies – HydroLAKES water bodies (lakes and reservoirs) – LAGOS-US lakes and reservoirs – EPA National Lakes Assessment (2007, 2012, 2017, and 2022) – The Reservoir Sedimentation Database (RESSED) Unique identifiers are used to facilitate joining to the original full datasets. For example, characteristics of NHD flowlines such as estimated average flow rate can be joined from the NHDPlusV2 dataset to a dam or power plant listed in HILARRI based on the ID field, “COMID”, that is common to both datasets. HILARRI only includes basic information about identifiers, location, and data quality or usage notes. It does not contain the attributes or time series data associated with these sites. The HILARRI dataset incorporates information from several datasets to facilitate more effective and accurate analysis of hydropower infrastructure and their associated waterbodies. For example, dams were checked against the most recent American Rivers Dam Removal Database to identify and flag facilities that may no longer exist. Additionally, dams that are listed multiple times in the NID are identified and flagged to avoid double-counting when analyzing and summarizing information. Other quality flags include certainty of operational hydropower (i.e., if one or more datasets indicates hydropower at a particular location), whether an associated water body is accurate or composed of multiple polygons, or whether there is a known issue with reported characteristics in one of the underlying datasets. These additional data flags are designed to increase confidence in data usage for individual to large-scale analyses.

13 HYDRO ENERGY↗

Usage-Based Discovery of Earth Observations

Most providers of Earth Observation data enable search via dataset characteristics, (e.g., quantity being measured, instrument, location, and time). However, the Earth Science Information Partners Federation (ESIP) is attempting to improve dataset discovery by capturing information on how datasets are used. At a usage-based discovery hackfest at the July 2020 ESIP Summer Meeting, participants pooled their collective skills to implement a prototype based on the connections between datasets and data usage, which can reveal unanticipated patterns in dataset connectivity that are not apparent through traditional approaches. A survey of natural hazards websites, focusing on hydrology-related hazards such as floods and hydrology datasets such as rainfall, illustrated the difficulty of gleaning which dataset was actually used and how it was accessed. This difficulty highlights the need for greater transparency on dataset usage in website design. An application wireframe for a usage-based discovery database was conceptualized as a tool to help applications data specialists rapidly assemble a fit-for-purpose website as part of a disaster response, where customer feedback was integral to the manner in which the website would be developed and delivered. Capturing connections among datasets and instances of usage, either for research or applications, could help users identify datasets with a proven track record of utility or those that have been supplanted by more accurate and(or) precise representations. It may also help Earth Observation providers maximize returns on investments in data services. Social discovery, i.e, following discovery paths laid down by previous users of the data, could be a critical tool for improving the timeliness and applicability of dataset delivery at times and in circumstances where practitioners don’t have the capacity to evaluate the deluge of datasets that are returned by today’s search tools.

search↗

Generative Adversarial Network for Synthetic Time Series Data Generation in Smart Grids

The availability of fine grained time series data is a pre-requisite for research in smart-grids. While data for transmission systems is relatively easily obtainable, issues related to data collection, security and privacy hinder the widespread public availability/accessibility of such datasets at the distribution system level. This has prevented the larger research community from effectively applying sophisticated machine learning algorithms to significantly improve the distribution-level accuracy of predictions and increase the efficiency of grid operations. Synthetic dataset generation has proven to be a promising solution for addressing data availability issues in various domains such as computer vision, natural language processing and medicine. However, its exploration in the smart grid context remains unsatisfactory. Previous works have tried to generate synthetic datasets by modeling the underlying system dynamics: an approach which is difficult, time consuming, error prone and often times infeasible in many problems. In this work, we propose a novel data-driven approach to synthetic dataset generation by utilizing deep generative adversarial networks (GAN) to learn the conditional probability distribution of essential features in the real dataset and generate samples based on the learned distribution. To evaluate our synthetically generated dataset, we measure the maximum mean discrepancy (MMD) between real and synthetic datasets as probability distributions, and show that their sampling distance converges. To further validate our synthetic dataset, we perform common smart grid tasks such as k-means clustering and short-term prediction on both datasets. Experimental results show the efficacy of our synthetic dataset approach: the real and synthetic datasets are indistinguishable by solely examining the output of these tasks.

14 SOLAR ENERGY↗

VotE-Dams: a compilation of global dams' locations and attributes (v1)

This dataset represents a compilation of two global and three USA-specific datasets of dam locations and their attributes. The major hurdle toward developing this compilation was the identification of duplicates within the source datasets, especially given the variable precision of dam location coordinates. The most immediately-useful product in this dataset is a spreadsheet (VotE-Dams_v1.csv) that documents the unique dams found across the datasets, their coordinates, and their ids within the respective source datasets. We do not reproduce the source datasets (GRaND, GOODD, GeoDAR, NID, and EHA) here, but their download locations are provided in the README files ('Overview' tab). Some of the source datasets are provided as shapefiles, which require geospatial data software to open (e.g. QGIS/ArcGIS for graphical display, geopandas for Python, rgdal for R, many others freely available). The provided README documents metadata of the source datasets and provides attribute-linking information (i.e. matches attributes among various source datasets that contain the same, or similar, information but have different names). Note that the README is provided as both .xslx and a collection of .csvs (one per tab in the .xslx file). We suggest using the .xlsx version that preserves images, formatting, and sheets. .xlsx files can be viewed using (free) Google Docs or Microsoft Excel.Finally, we provide Technical Documentation.pdf that describes the procedures used to identify unique and duplicate dams.The title of this dataset refers to our 'Veins of the Earth' (VotE) project, which seeks to provide a flexible, scale-free representation of the Earth's river networks. Dams are a critical component of VotE as they heavily influence flows throughout river networks.

54 ENVIRONMENTAL SCIENCES↗

Generation of a suite of 3D computer-generated breast phantoms from a limited set of human subject data

Purpose: The authors previously reported on a three-dimensional computer-generated breast phantom, based on empirical human image data, including a realistic finite-element based compression model that was capable of simulating multimodality imaging data. The computerized breast phantoms are a hybrid of two phantom generation techniques, combining empirical breast CT (bCT) data with flexible computer graphics techniques. However, to date, these phantoms have been based on single human subjects. In this paper, the authors report on a new method to generate multiple phantoms, simulating additional subjects from the limited set of original dedicated breast CT data. The authors developed an image morphing technique to construct new phantoms by gradually transitioning between two human subject datasets, with the potential to generate hundreds of additional pseudoindependent phantoms from the limited bCT cases. The authors conducted a preliminary subjective assessment with a limited number of observers (n= 4) to illustrate how realistic the simulated images generated with the pseudoindependent phantoms appeared. Methods: Several mesh-based geometric transformations were developed to generate distorted breast datasets from the original human subject data. Segmented bCT data from two different human subjects were used as the 'base' and 'target' for morphing. Several combinations of transformations were applied to morph between the 'base' and 'target' datasets such as changing the breast shape, rotating the glandular data, and changing the distribution of the glandular tissue. Following the morphing, regions of skin and fat were assigned to the morphed dataset in order to appropriately assign mechanical properties during the compression simulation. The resulting morphed breast was compressed using a finite element algorithm and simulated mammograms were generated using techniques described previously. Sixty-two simulated mammograms, generated from morphing three human subject datasets, were used in a preliminary observer evaluation where four board certified breast radiologists with varying amounts of experience ranked the level of realism (from 1 ='fake' to 10 ='real') of the simulated images. Results: The morphing technique was able to successfully generate new and unique morphed datasets from the original human subject data. The radiologists evaluated the realism of simulated mammograms generated from the morphed and unmorphed human subject datasets and scored the realism with an average ranking of 5.87 {+-} 1.99, confirming that overall the phantom image datasets appeared more 'real' than 'fake.' Moreover, there was not a significant difference (p > 0.1) between the realism of the unmorphed datasets (6.0 {+-} 1.95) compared to the morphed datasets (5.86 {+-} 1.99). Three of the four observers had overall average rankings of 6.89 {+-} 0.89, 6.9 {+-} 1.24, 6.76 {+-} 1.22, whereas the fourth observer ranked them noticeably lower at 2.94 {+-} 0.7. Conclusions: This work presents a technique that can be used to generate a suite of realistic computerized breast phantoms from a limited number of human subjects. This suite of flexible breast phantoms can be used for multimodality imaging research to provide a known truth while concurrently producing realistic simulated imaging data.

60 APPLIED LIFE SCIENCES↗

Evaluation of daily gridded climate products using in situ FLUXNET data and tree growth modeling

Gridded climate data products have facilitated research in climate and ecology by providing meteorological data continuously across large spatial scales. However, the sensitivity of scientific outcomes to dataset choice remains poorly understood, and evaluation using station-based records can favor datasets built heavily on weather stations. Here, we evaluate seven high-resolution daily gridded datasets covering the contiguous United States using independent meteorology from the FLUXNET2015 dataset, with a focus on the implications of dataset choice for process-based tree growth modeling. We find that gridded products tend to capture temperature accurately while consistently overestimating the magnitude and frequency of precipitation and its extremes. Moreover, datasets vary in how they define a ‘day,’ which significantly affects temporal alignment with FLUXNET2015 observations. Despite differences among the datasets, the interannual variability in tree ring simulations is insensitive to dataset choice, likely because daily-scale biases are averaged out through accumulated growth across several months. However, inaccuracies in temperature and precipitation can significantly bias modeled xylem cell production, with systematically higher annual precipitation in the gridded datasets leading to greater xylem production compared to simulations using in situ data. Our results suggest that model applications, especially those that integrate to time scales longer than one day, are likely insensitive to climate dataset choice, but applications that are sensitive to daily climate variations or to absolute climate values need to carefully consider biases in gridded climate products.

54 ENVIRONMENTAL SCIENCES↗

Gridded Sub-daily Climate Forcings for North America Based on Daymet and ERA5 (Daymet-ERA5)

To support high spatial and temporal resolution land surface modeling, this dataset provides hourly time step historic weather forcing at 1-km spatial resolution for the entire North America. The latest Daymet V4 data provides gridded historic daily weather observations at 1-km spatial resolution from 1980 to 2024. Using sub-daily temporal information from the ECMWF ERA5 reanalysis, Daymet was further temporally downscaled to hourly time steps and provided in the format required for land surface model simulations. The process of temporal downscaling preserves the relative magnitude in each hourly time step from ERA5 while maintaining the total and average values from Daymet for each day. This results in a blended 1980-2024 Daymet-ERA5 dataset. Available variables include surface air temperature, precipitation, specific humidity, shortwave and longwave radiation, wind speed, and pressure. These data can be used as a high-resolution meteorological forcing dataset to support high-resolution land surface modeling where accurate meteorological forcing datasets built from historic observations and/or reanalysis datasets are desirable.

54 ENVIRONMENTAL SCIENCES↗

Location Identifiers, Metadata, and Map for Field Measurements at the East-Taylor Watershed Community Observatory, Colorado, USA (Version 3.3)

This dataset contains identifiers, metadata, and a map of the locations where field measurements have been conducted at the East-Taylor Watershed Community Observatory located in the Upper Colorado River Basin, United States. This is version 3.3 of the dataset and replaces the prior version 3.2 (see below for details on changes between the versions). Dataset description: The East River-Taylor Watershed is the primary field site of the Watershed Function Scientific Focus Area (WFSFA) and the Rocky Mountain Biological Laboratory. Researchers from several institutions generate highly diverse hydrological, biogeochemical, climate, vegetation, geological, remote sensing, and model data at the East-Taylor Watershed in collaboration with the WFSFA. Thus, the purpose of this dataset is to maintain an inventory of the field locations and instrumentation to provide information on the field activities in the East-Taylor Watershed and coordinate data collected across different locations, researchers, and institutions. The dataset contains (1) a README file with information on the various files, (2) three csv files describing the metadata collected for each surface point location, plot and region registered with the WFSFA, (3) csv files with metadata and contact information for each surface point location registered with the WFSFA, (4) a csv file with with metadata and contact information for plots, (5) a csv file with metadata for geographic regions and sub-regions within the watershed, (6) a compiled xlsx file with all the data and metadata which can be opened in Microsoft Excel, (7) a kml map of the locations plotted in the watershed which can be opened in Google Earth, (8) a jpg image of the kml map which can be viewed in any photo viewer, and (9) a zipped file with the registration templates used by the SFA team to collect location metadata. The zipped template file contains two csv files with the blank templates (point and plot), two csv files with instructions for filling out the location templates, and one compiled xlsx file with the instructions and blank templates together. Additionally, the templates in the xlsx include drop down validation for any controlled metadata fields. Persistent location identifiers (Location_ID) are determined by the WFSFA data management team and are used to track data and samples across locations. Dataset uses: This location metadata is used to update the Watershed SFA’s publicly accessible Field Information Portal (an interactive field sampling metadata exploration tool; https://wfsfa-data.lbl.gov/watershed/), the kml map file included in this dataset, and other data management tools internal to the Watershed SFA team. Version Information: The latest version of this dataset publication is version 3.3. This version contains 167 new point locations, 1 new plot, and 2 new geographic regions. Overall, there are a total of 1439 point locations, 75 plots, and 54 geographic regions. Additionally, the kml map of locations and image now includes two boundaries (Upper Ohio Creek (UO) and Carbon Creek (CA)) outside of the East River watershed (USGS HUC-10) and accompanying stream network that represents areas of focus. Refer to methods for further details on the version history. This dataset will be updated on a periodic basis with new measurement location information. Researchers interested in having their East-Taylor Watershed measurement locations added to this list should reach out to the WFSFA data management team at wfsfa-data@googlegroups.com. Acknowledgments: Please cite this dataset if using any of the location metadata in other publications or derived products. If using the location metadata for the 2018 NEON hyperspectral campaign, additionally cite Chadwick et al. (2020). doi:10.15485/1618130. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. Part of this work was performed at SLAC Accelerator Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-76SF00515.

2018 NEON and 2025 CHESS Campaigns↗

Leafweb: Leaf Gas Exchange and Pulse-Amplitude Modulated Fluorometry for C4 Species, June 2026 Release

This dataset contains leaf gas exchange and Pulse-Amplitude Modulated (PAM) fluorometry for 98 C4 species. The C4 photosynthetic pathway employs specialized CO2 concentration mechanisms and Kranz anatomy to enrich CO2 concentration around Rubisco, the enzyme that catalyzes carbon fixation in the Calvin-Benson cycle to suppress photorespiration and increase the use efficiencies of light, nitrogen, and water as compared to the C3 photosynthetic pathways. Large-scale C4 photosynthetic datasets are relatively scarce, which has affected C4 photosynthesis research. To improve C4 photosynthetic data availability, Leafweb organized an effort to systematically collect, compile, standardize, and organize measurements of leaf gas exchange and/or Pulse-Amplitude Modulated (PAM) fluorometry of C4 species. This derived a C4 photosynthetic dataset containing measurements made by independent researchers in multiple countries in various environments (field, garden, or greenhouse). It covers three biochemical subtypes – the nicotinamide adenine dinucleotide phosphate-malic enzyme (NADP-ME), nicotinamide adenine dinucleotide-malic enzyme (NAD-ME), and phosphoenolpyruvate carboxykinase (PEP-CK) subtypes. This dataset is useful for using Artificial Intelligence / Machine Learning and mechanistic models to study C4 photosynthesis and compare across different biochemical subtypes. This dataset contains 3 compressed (*.zip) folders containing 1,892 data files in comma-separate values (*.csv) format. Additional metadata are provided: one data dictionary and a file-level metadata file in comma-separate values (*.csv) format and a user guide in PDF (*.pdf) format.

Zhou, Haoran [Tianjin University, China]↗

Comprehensive Database of Environmental Mitigations Extracted from FERC-Licensed Hydropower Projects Using Artificial Intelligence Techniques, 1998-2023

This dataset provides a comprehensive inventory of environmental mitigation measures required by Federal Energy Regulatory Commission (FERC) licensed hydropower facilities from 461 licenses that were issued from 1998 to 2023. These licenses constitute 446 of the 1015 FERC projects that were active at the end of 2023. 17,612 mentions of environmental mitigations were identified and categorized in 128 unique categories. Mitigations were identified using a Natural Language Processing (NLP) approach, specifically with a Bidirectional Encoder Representations from Transformer (BERT) model. Model-derived results were then reviewed and updated by a subject matter expert as needed. This dataset introduces important enhancements to previous efforts to inventory environmental mitigations, such as including associated license text for each mitigation, tracking the number of instances a mitigation was identified within a license, and providing improved location information. These enhancements significantly expand the dataset's utility, offering greater analytical capabilities and ensuring reproducibility. The dataset is downloadable as a zip file containing the metadata and dataset files.

Ruggles, Thomas [Oak Ridge National Laboratory (OR↗

Automated identification of local contamination in remote atmospheric composition time series

Abstract. Atmospheric observations in remote locations offer a possibility of exploring trace gas and particle concentrations in pristine environments. However, data from remote areas are often contaminated by pollution from local sources. Detecting this contamination is thus a central and frequently encountered issue. Consequently, many different methods exist today to identify local contamination in atmospheric composition measurement time series, but no single method has been widely accepted. In this study, we present a new method to identify primary pollution in remote atmospheric datasets, e.g., from ship campaigns or stations with a low background signal compared to the contaminated signal. The pollution detection algorithm (PDA) identifies and flags periods of polluted data in five steps. The first and most important step identifies polluted periods based on the derivative (time derivative) of a concentration over time. If this derivative exceeds a given threshold, data are flagged as polluted. Further pollution identification steps are a simple concentration threshold filter, a neighboring points filter (optional), a median, and a sparse data filter (optional). The PDA only relies on the target dataset itself and is independent of ancillary datasets such as meteorological variables. All parameters of each step are adjustable so that the PDA can be “tuned” to be more or less stringent (e.g., flag more or fewer data points as contaminated). The PDA was developed and tested with a particle number concentration dataset collected during the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition in the central Arctic. Using strict settings, we identified 62 % of the data as influenced by local contamination. Using a second independent particle number concentration dataset also collected during MOSAiC, we evaluated the performance of the PDA against the same dataset cleaned by visual inspection. The two methods agreed in 94 % of the cases. Additionally, the PDA was successfully applied to a trace gas dataset (CO2), also collected during MOSAiC, and to another particle number concentration dataset, collected at the high-altitude background station Jungfraujoch, Switzerland. Thus, the PDA proves to be a useful and flexible tool to identify periods affected by local contamination in atmospheric composition datasets without the need for ancillary measurements. It is best applied to data representing primary pollution. The user-friendly and open-access code enables reproducible application to a wide suite of different datasets. It is available at https://doi.org/10.5281/zenodo.5761101 (Beck et al., 2021).

54 ENVIRONMENTAL SCIENCES↗

Global transpiration data from sap flow measurements: the SAPFLUXNET database

Plant transpiration links physiological responses of vegetation to water supply and demand with hydrological, energy, and carbon budgets at the land–atmosphere interface. However, despite being the main land evaporative flux at the global scale, transpiration and its response to environmental drivers are currently not well constrained by observations. Here we introduce the first global compilation of whole-plant transpiration data from sap flow measurements (SAPFLUXNET, https://sapfluxnet.creaf.cat/, last access: 8 June 2021). We harmonized and quality-controlled individual datasets supplied by contributors worldwide in a semi-automatic data workflow implemented in the R programming language. Datasets include sub-daily time series of sap flow and hydrometeorological drivers for one or more growing seasons, as well as metadata on the stand characteristics, plant attributes, and technical details of the measurements. SAPFLUXNET contains 202 globally distributed datasets with sap flow time series for 2714 plants, mostly trees, of 174 species. SAPFLUXNET has a broad bioclimatic coverage, with woodland/shrubland and temperate forest biomes especially well represented (80 % of the datasets). The measurements cover a wide variety of stand structural characteristics and plant sizes. The datasets encompass the period between 1995 and 2018, with 50 % of the datasets being at least 3 years long. Accompanying radiation and vapour pressure deficit data are available for most of the datasets, while on-site soil water content is available for 56 % of the datasets. Many datasets contain data for species that make up 90 % or more of the total stand basal area, allowing the estimation of stand transpiration in diverse ecological settings. SAPFLUXNET adds to existing plant trait datasets, ecosystem flux networks, and remote sensing products to help increase our understanding of plant water use, plant responses to drought, and ecohydrological processes. SAPFLUXNET version 0.1.5 is freely available from the Zenodo repository (https://doi.org/10.5281/zenodo.3971689; Poyatos et al., 2020a). The “sapfluxnetr” R package – designed to access, visualize, and process SAPFLUXNET data – is available from CRAN.

58 GEOSCIENCES↗

Creating Benchmark Data for Artificial Intelligence and Machine Learning Space Biology Research

To identify an appropriate AI/ML approach for a specific problem, the best practice is to measure algorithm performance through the benchmarking process. A scientific benchmark consists of an AI-ready dataset and a reference implementation on a specific scientific question. The NASA Science Mission Directorate (SMD) has started the “Benchmark Initiative for AI/ML to create scientific benchmark datasets in three applications: 1) scientific benchmarking, which finds the best algorithm for a specific problem; 2) application benchmarking, which measures algorithm performance against a set of parameters; and 3) system benchmarking, which evaluates performance of hardware and software architecture. Currently, there are no standardized datasets available to benchmark AI/ML algorithms in the domain of space biology. In this work, we constructed two AI/ML-ready biological datasets from experiments in space-flown mice: cellular imaging and RNA-seq. First, radiation-exposed immune cells harbor DNA damage foci that can be fluorescently marked to visualize the amount of damage following exposure to ionizing radiation. However, such large datasets are difficult to analyze visually, due to imaging inconsistencies and human bias, and classical image processing approaches can fail on imaging artifacts. AI/ML are therefore exciting alternative, providing the speed of machines and the accuracy of humans. We have made this dataset available at https://registry.opendata.aws/bps_microscopy/. Second, high-throughput nucleic acid sequencing (DNA-seq, RNA-seq) has become widespread in biomedical research due to the growing availability and affordability of these assays. However, most sequencing datasets suffer from high dimensionality and low sample count. In this work, we used a generative adversarial network to synthesize a standardized, AI-ready, publicly available benchmark dataset for space biology RNA-seq data with sufficient space-flown and ground control mouse liver samples from NASA GeneLab. This dataset is available at https://registry.opendata.aws/bps_rnaseq/. These datasets are now fully open the Space Biology community to test their favorite AI/ML approaches.

James Casaletto↗

A comparative assessment of monthly mean wind speed products over the global ocean

The accurate estimation of marine wind speed is important for climate and air–sea interaction applications. There are many datasets of monthly mean wind speeds available based either on in situ measurements, satellite retrievals, atmospheric reanalysis assimilating both in situ and satellite data and blended datasets combining some or all of these other data sources. Twelve different monthly mean wind speed datasets are compared for the period from 1987 to 2009. The results suggest that we cannot presently be confident that the mean wind speed over the ocean is known to the accuracy required for the calculation of air–sea heat fluxes. Comparisons are complicated by different representations of wind speed being presented in different datasets. The in situ and reanalysis datasets present stability-dependent, earth-relative, wind speeds adjusted to a reference level of 10 m. The satellite and blended datasets present neutral equivalent, surface-relative, speeds adjusted to a reference level of 10 m. Differences between these estimates depend on atmospheric stability and ocean currents and can be greater than the required accuracy target. The adjustment for stability is itself uncertain but it is shown that these uncertainties are likely to be smaller than biases caused when the effects of stability are neglected. Further differences among the datasets are identified. Biases are caused by unidentified rain in Ku-band scatterometer-derived wind speeds and by atmospheric effects on passive microwave wind retrievals. When satellite observations affected by rain are removed a fair-weather bias remains. Some datasets are biased low in coastal regions by the effects of lower wind speeds over land in atmospheric models affecting wind speeds near the coast. All these uncertainties combine to give a wide range of estimates of monthly mean wind speed for the chosen datasets with uncertainty in mean values, spatial patterns and changes over time.

54 ENVIRONMENTAL SCIENCES↗

scPlantAnnotate: an accurate and robust transformer-based model for plant cell type annotation

Accurate cell type annotation remains a major bottleneck in plant single-cell RNA sequencing (scRNA-seq), where existing tools are often adapted from animal studies and perform sub-optimally on plant data. The lack of plant-specific computational frameworks limits the construction of plant cell atlases and downstream biological discovery. We develop and evaluate scPlantAnnotate, a Transformer-based reference annotation framework tailored for plant scRNA-seq data, and benchmark it against state-of-the-art deep learning and conventional methods across multiple plant species. Species-specific scPlantAnnotate models were trained using curated datasets from Arabidopsis thaliana, Zea mays, Oryza sativa, and Glycine max. We compared scPlantAnnotate with leading baselines under both standard random-split evaluation and a more stringent leave-one-dataset-out setting, which tests robustness to completely unseen datasets and tissue types. scPlantAnnotate consistently outperforms existing approaches across all four species under random-split evaluation. In the leave-one-dataset-out setting for A. thaliana, where performance drops markedly for all methods due to strong batch effects and dataset heterogeneity, scPlantAnnotate nonetheless achieves the highest Accuracy, Macro-F1, Balanced Accuracy, and Macro-AUROC on average and ranks first on most held-out datasets. These results demonstrate improved robustness to dataset shifts, a critical yet underexplored challenge in plant scRNA-seq analysis. A freely accessible web server enables users to annotate their own datasets using pretrained models. scPlantAnnotate provides a plant-specific, Transformer-based framework for single-cell annotation that delivers state-of-the-art performance and enhanced robustness to unseen datasets. By addressing limitations of existing tools and enabling scalable reference-based annotation, scPlantAnnotate supports the development of comprehensive plant cell atlases and facilitates broader use of single-cell genomics in plant biology.

Bioinformatics↗

DeepAstroUDA: semi-supervised universal domain adaptation for cross-survey galaxy morphology classification and anomaly detection

Abstract Artificial intelligence methods show great promise in increasing the quality and speed of work with large astronomical datasets, but the high complexity of these methods leads to the extraction of dataset-specific, non-robust features. Therefore, such methods do not generalize well across multiple datasets. We present a universal domain adaptation method, DeepAstroUDA , as an approach to overcome this challenge. This algorithm performs semi-supervised domain adaptation (DA) and can be applied to datasets with different data distributions and class overlaps. Non-overlapping classes can be present in any of the two datasets (the labeled source domain, or the unlabeled target domain), and the method can even be used in the presence of unknown classes. We apply our method to three examples of galaxy morphology classification tasks of different complexities (three-class and ten-class problems), with anomaly detection: (1) datasets created after different numbers of observing years from a single survey (Legacy Survey of Space and Time mock data of one and ten years of observations); (2) data from different surveys (Sloan Digital Sky Survey (SDSS) and DECaLS); and (3) data from observing fields with different depths within one survey (wide field and Stripe 82 deep field of SDSS). For the first time, we demonstrate the successful use of DA between very discrepant observational datasets. DeepAstroUDA is capable of bridging the gap between two astronomical surveys, increasing classification accuracy in both domains (up to 40 % on the unlabeled data), and making model performance consistent across datasets. Furthermore, our method also performs well as an anomaly detection algorithm and successfully clusters unknown class samples even in the unlabeled target dataset.

79 ASTRONOMY AND ASTROPHYSICS↗

Unpaired image translation to mitigate domain shift in liquid argon time projection chamber detector responses

Deep learning algorithms often are developed and trained on a training dataset and deployed on test datasets. Any systematic difference between the training and a test dataset may severely degrade the final algorithm performance on the test dataset—what is known as the domain shift problem . This issue is prevalent in many scientific domains where algorithms are trained on simulated data but applied to real-world datasets. Typically, the domain shift problem is solved through various domain adaptation (DA) methods. However, these methods are often tailored for a specific downstream task, such as classification or semantic segmentation, and may not easily generalize to different tasks. This work explores the feasibility of using an alternative way to solve the domain shift problem that is not specific to any downstream algorithm. The proposed approach relies on modern Unpaired Image-to-Image (UI2I) translation techniques, designed to find translations between different image domains in a fully unsupervised fashion. In this study, the approach is applied to a domain shift problem commonly encountered in Liquid Argon Time Projection Chamber (LArTPC) detector research when seeking a way to translate samples between two differently distributed LArTPC detector datasets deterministically. This translation allows for mapping real-world data into the simulated data domain where the downstream algorithms can be run with much less domain-shift-related performance degradation. Conversely, using the translation from the simulated data to a real-world domain can increase the realism of the simulated dataset and reduce the magnitude of any systematic uncertainties. To evaluate the quality of the translations, we use both pixel-wise metrics and a downstream task to measure the effectiveness of UI2I methods for mitigating the domain shift problem. We adapted several popular UI2I translation algorithms to work on scientific data and demonstrated the viability of these techniques for solving the domain shift problem with LArTPC detector data. To facilitate further development of DA techniques for scientific datasets, the ‘Simple Liquid-Argon Track Samples’ dataset used in this study is also published.

97 MATHEMATICS AND COMPUTING↗

Refine your search to explore more results.