Engineering PapersSearch

SEARCH · Engineering Papers

Results for “data cleaning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Machine learning-powered data cleaning for LEGEND: a semi-supervised approach using affinity propagation and support vector machines

Neutrinoless double-beta decay ($0\nu\beta\beta$) is a rare nuclear process that, if observed, will provide insight into the nature of neutrinos and help explain the matter-antimatter asymmetry in the Universe. The large enriched germanium experiment for neutrinoless double-beta decay (LEGEND) will operate in two phases to search for $0\nu\beta\beta$. The first (second) stage will employ 200 (1000) kg of High-Purity Germanium (HPGe) enriched in 76 Ge to achieve a half-life sensitivity of 10 27 (10 28 ) years. In this study, we present a semi-supervised data-driven approach to remove non-physical events captured by HPGe detectors powered by a novel artificial intelligence model. We utilize affinity propagation to cluster waveform signals based on their shape and a support vector machine to classify them into different categories. We train, optimize, and test our model on data taken from a natural abundance HPGe detector installed in the Full Chain Test experimental stand at the University of North Carolina at Chapel Hill. We demonstrate that our model yields a maximum sacrifice of physics events of $0.024 ^{+0.004}_{-0.003} \%$ after data cleaning. Our model is being used to accelerate data cleaning development for LEGEND-200 and will serve to improve data cleaning procedures for LEGEND-1000.

artificial intelligence

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Cleaned 5-Minute Resolution Air Quality and Meteorological Data from Nine TCEQ CAMS Sites in Houston, Texas (Nov 2021 – Oct 2022)

These data encompass 5-minute air monitoring and meteorological observations collected in the greater Houston, Texas metropolitan region, at nine (9) Continuous Ambient Monitoring Stations (CAMS) operated by the Texas Commission on Environmental Quality (TCEQ) between November 1, 2021 and October 31, 2022. The CAMS sites (CAMS 1, 8, 35, 45, 148, 403, 405, 410, and 1052) were chosen because their instrumentation includes measurements of PM2.5. These sites also provide continuous multi-parameter air-quality and meteorological measurements. Particulate matter (PM2.5, PM10) was sampled along with several trace gases, including ozone (O3), nitrogen oxides (NO, NO2, NOx), sulfur dioxide (SO2), and carbon monoxide (CO). The data set also contains standard surface meteorological parameters (temperature, humidity, pressure, wind speed, and wind direction). Several sites also include AutoGC-based measurements of volatile organic compounds (VOCs). Air monitoring instruments deployed at the selected sites comprise the following systems: BAM-1020 or TEOM (PM2.5), Thermo Scientific TEI 49i (O3), TEI 42i (NOx), and AutoGCs (VOCs). This data set is similar to the data included within the houairq5mX1.00 datastream, except for a few additional quality control steps. A systematic data cleaning and verification process was performed on the data set to ensure its quality and preparation for analysis. Removal of non-numeric status flags (e.g., [LIM], [QAS], [SPZ], [CAL], [PMA], [AQI], [SPN], [MAL]) was accomplished by employing rule-based string parsing to extract valid numerical values. Missing entries were set to -9999; however, invalid or anomalous values (e.g., 99999) were retained as originally reported by the TCEQ to preserve data provenance. The time sequence was verified for completeness, removal of duplicates, and uniformity at 5-minute intervals. Column labeling was standardized, and corresponding values were assessed for physical plausibility. All timestamps in the data set were reported in Coordinated Universal Time (UTC) as provided by the TCEQ. Further, the latitude and longitude coordinates were added for each CAMS site. A subset of the data (June 1–September 30, 2022) has been used in the following publication: Subba et al. 2025. “Implications of sea breeze circulations on boundary layer aerosols in the southern coastal Texas region.” EGUsphere 2025: 1–49, https://doi.org/10.5194/egusphere-2025-2659.

latitude

Analysis of Slow Spill Data for the Mu2e Experiment

The execution of the Mu2e experiment requires a stable, low-intensity proton beam from the Delivery Ring to produce clean data and protect equipment. This is done by performing a “slow extraction,” which is the gradual contraction of the stable region within the accelerator’s beam pipe. The Delivery Ring is currently unable to perform slow extraction with the stability required by Mu2e. To resolve this, the FAN-C team is training machine learning models with the purpose of replacing the Delivery Ring’s current PID controllers with AI-powered controllers. Training these models requires clean, processed data from slow spills. Over the course of this project, data from previous slow spills were processed and analyzed, and the clean data, graphs, and insights gained from the process were provided to the FAN-C team to assist them in their efforts.

Osborn, Thomas [Purdue U., West Lafayette]

Core Model Proposal #410: Updates to Socioeconomic and Macroeconomic Data, Processing Structure, and Visualization

This Core Model Proposal (CMP) comprehensively restructures and updates the macroeconomic and socioeconomic modules in gcamdata. It includes visualizations of key data inputs, accounting identities, and data flows in the context of GCAM-Macro-KLEM. Major improvements include: (1) updating the Penn World Table (PWT) to version 10 and incorporating a new source, the Global Macro Database (GMD); (2) updating the SSP socioeconomics database from version 3.0.1 to 3.2; (3) introducing SSP-specific differentiation of employment and labor force data; (4) improving data integration between national accounts (from PWT, GMD, and GTAP) and GDP/population data from external sources; and (5) general data cleaning and structural refinements. We document the data sources and key assumptions used throughout the processing. These updates establish the foundation for the forthcoming KLEAM version of GCAM-macro.

97 MATHEMATICS AND COMPUTING

Dataset: "Widespread Drought-driven Declines in Streamflows and Water quality in the Upper Colorado River Basin (1998-2022)"

This data package contains the associated data and scripts for Nagamoto, E., Ombadi, M., Ciulla, F. et al. Widespread drought-driven declines in streamflows and water quality in the Upper Colorado River Basin during 1998-2022. Commun Earth Environ 7, 734 (2026). https://doi.org/10.1038/s43247-026-03890-5. This purpose of this study was to investigate the impact of the 21st century drought on water quantity and quality at catchments throughout the Upper Colorado River Basin (UCRB). We used stream flow, water temperature, specific conductance, air temperature, precipitation, and catchment attribute data for over 200 sites in the UCRB, collected from the National Water Information System using Basin3D (Varadharajan, 2023), GAGESII (Falcone, 2010), and the Google Earth Engine. We identified years of severe drought between 1998 and 2022 using the Standardized Precipitation Evaporation Index (SPEI), then calculated the relative change percentage of the stream flow, water temperature, and specific conductance from drought versus non-drought years. We used the attribute information from GAGESII to investigate what physical traits of catchments are associated streamflow vulnerability (greater relative change) or resilience to drought. We used land cover data from the National Land Cover Database (USGS, 2024) to assess any changes to physical attributes that may not be represented in the static attributes information in GAGESII. To increase data availability, we modeled stream temperature using methods from Willard, 2023. While the study period is water years 1998 to 2022, the raw water quantity and quality data extends to 1950 and the meteorological data extends to 1980. The data and code can be downloaded via the UCRB_drought.zip. Within the zip, the files are organized as follows: - INPUTS: Contains all input data used in UCRB_Drought_Workflow.ipynb - OUTPUTS: Contains all intermediate data created from UCRB_Drought_Workflow.ipynb as well as final products including the calculated Standardized Evapotranspiration Index (SPEI) - climatic_variables: The code used to collect meteorologic data from Google Earth Engine - feature_importance: The code used for the catchment attributes analysis - preprocessing: Code used in UCRB_Drought_Workflow_Preprocessing.ipynb - pyeto: Code used in UCRB_Drought_Workflow_Preprocessing.ipynb - calculations: Code used in UCRB_Drought_Workflow_Impacts.ipynb - plotting: Code used in UCRB_Drought_Workflow_Impacts.ipynb - README.md - UCRB_Drought_Workflow_Preprocessing.ipynb: The code used to prep raw data for the analysis - UCRB_Drought_Workflow_Impact.ipynb: The code which uses the prepped raw data for analysis, and plots all figures - requirements_ucrb-drought_v2.yml: The requirements file to create a virtual environment and Jupyter Lab kernel to run the code The INPUTS folder is organized into the following major directories and sub-directories. The "RDC_WT_SC_RAW" folder contains raw data for streamflow, water temperature, and specific conductance in a ".h5" file. The "NLCD_RAW" folder contains ".csv" files with annual land cover percentages for counties within the UCRB. The "MET_RAW" folder contains a ".csv" file with monthly meteorological data (air temperature and precipitation) for the sites in the UCRB which was obtained from code in the climatic_variables folder. The "GAGESII" folder contains ".csv" files with physical catchment attribute variables for catchments across the country. The "WT_LSTM_data" folder contains ".csv" files with calculated WT (Willard, 2023) and the associated RMSEs. The "Upper_Colorado_River_Basin_Boundary" folder contains geographic data including a shapefile for plotting in the UCRB_Drought_Workflow.ipynb. The "RESERVOIRS_RAW" folder contains ".csv" files for each reservoir in the UCRB with daily reservoir storage. There are also two files in the INPUTS folder that have combined reservoir storage data and reservoir metadata. The OUTPUTS folder is organized into the following major directories and sub-directories. The "RDC_WT_SC_data" folder contains a folder "Water_year" with the associated cleaned data, metadata, and data availability information in ".csv" files, a folder "Median_Relchange" with the relative change comparing drought to non-drought years in ".csv" files, and a folder "Peak95_Min5_Relchange" that has ".csv" files for the relative change in peak (95th %) and minimum (5th %) variables. The "NLCD_data" folder contains the difference in land cover from the beginning to end of the study period and the percentage of the county that is within UCRB bounds can be found in Nagamoto et al (2025)). The "MET_data" folder contains separated monthly air temperature and precipitation data and the calculated PET in ".csv" files. The "SPEI_data" folder contains ".csv" files with calculated SPEI values (one restricted to the study period and the other with information from the entire MET data period). The "Paper_Tables" folder contains two ".csv" files containing site information and data availability and information about the GAGESII trait aggregated categories. The base directory includes the file “flmd.csv” for a list and description of all files and the file “dd.csv” for data dictionaries. Scripts for preprocessing, analysis, and figure generation are located in the associated GitHub repository found at [https://github.com/iNAIADS/drought-impacts/tree/develop/UCRB-drought]. UPDATE 1: Title and code file updated to match submitted manuscript 10-15-2025. UPDATE 2: Code and data files updated to match revised manuscript 3-4-2026. UPDATE 3: Code and data files updated to match revised manuscript 6-7-2026. ** NOTE: DD and FLMD have not been updated yet. UPDATE 4: Added associated Manuscript information and DD and FLMD have been updated. To cite this code, please use the following BibTeX: @misc{nagamoto2025drought, author = {Emily Nagamoto and Fabio Ciulla and Mohammad Ombadi and Jared Willard and Rosemary Carroll and Charuleka Varadharajan}, title = {Dataset: "Widespread Drought-driven Declines in Streamflows and Water quality in the Upper Colorado River Basin (1998-2022)"}, year = {2025}, doi = {10.15485/2551894}, publisher = {ESS-DIVE Repository}, url = {https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2551894} }

54 ENVIRONMENTAL SCIENCES

Merged Aerosol Value-Added Product Report

The Merged Aerosol Value-Added Product (VAP) simplifies scientists’ use of Atmospheric Radiation Measurement (ARM) User Facility aerosol data by performing several tedious, time-consuming tasks for the users. First, the VAP identifies the best data available when multiple datastreams exist for a single geophysical quantity so that ARM users do not have to research this for themselves. Second, the VAP consolidates multiple ARM aerosol datastreams into a single file for ARM data users so that they do not have to download, open, and read multiple files for their analysis. Next, the VAP transforms all measurements onto a common one-hour timestamp. The one-hour resolution matches the time resolution of the slowest instrument. Instruments with faster sampling rates than one measurement per hour are averaged over the time interval. Finally, the VAP reads the QA/QC variables and marks data with known issues as missing, so that users do not have to spend excessive time cleaning data. This includes incorporating Data Quality Reports (DQRs) that exist at the time when the VAP data is generated. DQRs are reports filed by instrument mentors or data users that indicate a problem with the output data of individual instruments.

54 ENVIRONMENTAL SCIENCES

Topsoil bulk geochemical compositions - An updated harmonized global dataset

Mineral weathering is a key biogeochemical process because of the capacity of minerals to stabilize organic matter. However, predicting soil weathering status across large spatial areas still isn’t possible due to a lack of global data and theoretical frameworks. To address this knowledge gap, multiple global datasets of bulk topsoil geochemical compositions have been harmonized using R. These datasets document topsoil bulk geochemical compositions across five continents (n = ~16,000 observations). Source data for these observations include the EuroGEOSurveys Geochemical Baseline Database (FOREGS), the US Geological Survey National Geochemical Database (NASGLP), the Geochemical Atlas of Australia (GAA), the US Geological Survey Alaska Geochemical Database (AGD84), the National Cooperative Soil Survey (NCSS), the European Geochemical Mapping of Agricultural Soil (GEMAS), Ecorespira-Amazon (ERA), the New Zealand Geochemical Baseline Survey (NZ_GBS), and the African Soil Information Service (AFSIS). Major elements observed include Aluminum (Al), Calcium (Ca), Iron (Fe), Potassium (K), Magnesium (Mg), Sodium (Na), Titanium (Ti), Manganese (Mn), Phosphorus (P), Carbon (C), and Sulfur (S). This data package includes the harmonized dataset itself, and the R scripts necessary to harmonize these datasets, in addition to metadata that describes all columns, files, and databases used in this project. Methods & Sampling Step 1 – Databases of geochemical data identified This study aimed to leverage existing measurements of topsoil geochemical data. Databases were first identified and deemed appropriate for inclusion if they were measuring soils and performed these measurements on the <2mm soil fraction. Databases such as NCSS and AGD84 needed more post processing to include in the database and this was done using the NCSS_datamerge_031626 R file and Alaska_USGSmerge_031626 R file, respectively. Step 2 – Database harmonization Once appropriate databases were identified, they were harmonized for ease of analysis using the R script Database_Harmonization_031826. This included removing columns from original datasets that would not be used in analysis (removed columns are noted in the code). Then, data cleaning procedures specific to each dataset were undertaken. This includes standardizing columns to include units and adding metadata columns regarding procedures for analyzing specific elements. Functions for standardizing measurements and units are outline in R files: calculate element_mg_kg_031626, calculate_oxide_wt_perc_031626, change_oxide_caps_031626, and conv_2_numeric_031626. This also included adding a unique identifier for each sample to identify it with its respective database (see CD_ID in data dictionary). Geographic information: Data reflect a compilation of datasets collected globally. Geographic areas covered by each of the datasets include: - EuroGEOSurveys Geochemical Baseline Database (FOREGS) - European continent - North American Soil Geochemical Landscapes (NASGLP) - continental United States and limited parts of Canada (see database key for more details) - National Geochemical Survey of Australia (GAA) - Australia - Alaska geochemical database (AGDB4) - Alaska - National Cooperative Soil Survey (NCSS) - Global measurements, but concentrated in the continental United States - Geochemical data for arable land and land under permanent grass cover in continental Europe (GEMAS) - continental Europe - Ecorespira-Amazon (ERA) - Geochemical data from the Amazon basin - Geochemical baseline data for New Zealand (NZGBS) - New Zealand - Geochemical data collected across continental Africa (AfSIS) - Measurements across Africa

EARTH SCIENCE > LAND SURFACE > SOILS