Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Low Latency Flux and Concentration Datasets in Support of Greenhouse Gas Monitoring Based on NASA's GEOS Modeling and Data Assimilation System

We present efforts to develop space-based greenhouse gas monitoring systems that can provide low latency information and traceability to independent observations. Through support from its Carbon Monitoring System program, NASA has developed the capability to assimilate XCO2 retrievals from the Orbiting Carbon Observatory, 2 (OCO-2) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO2 mixing ratio. When OCO-2 data are not available, concentration fields are further informed by a bottom-up flux package based on remotely sensed fire radiative power, nighttime lights, and vegetation reflectance combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of this dataset supports evaluation with independent aircraft data, helping to ensure transparency of remotely sensed data products. These quasi-operational data are currently produced 2-3 months behind real time and are distributed via NASA and international dashboard services to a variety of end users. In this presentation, we provide an overview of the system as well as remaining data gaps and modeling challenges. We also highlight the application of this dataset for detecting emissions anomalies associated with COVID-19 and comparing against independent emissions estimates. Finally, we highlight a new NASA initiative called the Earth Information System (EIS), which aims to support open science and applications by leveraging emerging cloud computing capabilities to increase access to NASA’s greenhouse gas datasets, opportunities for co-development, and transparency in methods for analysis and flux attribution.

Lesley Ott↗

Curating AI-Ready Datasets for Equity and Environmental Justice: A Data-Centric AI Case Study

An equitable and environmentally just community is essentialin order to avoid disproportionate burden borne by vulnerablecommunities. This need becomes pressing in the aftermathof an extreme event such as disaster or hazard when it is diffi-cult for the governing bodies to implement resource allocationas per the need. Artificial Intelligence (AI) algorithms canhelp surface Equity and Environmental Justice (EEJ) issueswhen trained on EEJ datasets. However, curating AI-readyEEJ training datasets is challenging due to differences in fac-tors such as heterogeneity, resolution, modality, and level ofexpertise in labeling. Additionally, EEJ issues involve sensi-tive information where uncertainties and errors could degradethe performance of AI algorithms. For eg. Error in seasonalcrop yield information can highly affect the prediction of an-nual crop yield. To address these challenges, Data-centricAI (DCAI) methods are employed, which enhance AI algo-rithm performance even with limited training samples. DCAIprioritizes data quality, thereby reducing the adverse effectsof uncertainties and errors during the model training process.This research proposes a novel dataset and benchmark for an-alyzing the effect of the Maui Wildfire of 2023 for Equityand Environmental Justice (EEJ) issues. The proposed datasetaligns with the concepts of DCAI such as annotation quality,data preprocessing, privacy, feature engineering, governanceand provenance. We firmly believe that the proposed datasetwould lay a foundation to implement robust and reliable mod-ern AI algorithms for addressing EEJ issues.

Paridhi Parajuli↗

Physics-Based Feature Extraction from Bulk Time-Series PMU Datasets for Event Detection

In this work, two physics-based feature extraction techniques are developed for bulk time-series phasor measurement unit (PMU) datasets collected from the field to train the machine learning model for anomaly detection. Two approaches have been developed to extract useful features for different types of events. An admittance-based feature extraction technique is developed to detect events that involve line outages and system topology variations. The developed algorithm extracts the system equivalent admittance variation. Additionally, Fielder’s Theory is utilized to further reduce the potential computation burden by sectionalizing large-scale grids and datasets into smaller areas. Second, an oscillation-based feature extraction technique is developed to detect low-frequency oscillations in power grids. The dominant oscillation modes in the grids are extracted using energy-sorted Prony analysis. The extracted dominant oscillation modes by the developed work exhibit a high fitting resolution. Finally, the developed techniques have been validated using large-scale and real-world datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Building-Level Comparison of Microsoft and Google Open Building Footprints Datasets

Large-scale datasets of building footprints are a crucial source of information for a variety of efforts. In 2023, the general public benefits from open access to multiple sources of building footprints at the country scale or larger, such as those produced by Microsoft and Google. However, none of the available datasets have attained complete global coverage, and researchers and analysts may need to combine multiple sources to assemble a complete set of building footprints for their area of interest or choose between overlapping sources, requiring an understanding of the differences between different building sources. This paper presents a method to closely examine the quality of different building footprint sources by matching corresponding buildings across datasets, using building footprints in Ethiopia published by Microsoft and Google as an example set.

Gonzales, Jack↗

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations (PDEs) for which a stochastic computational model (SCM) is available and which depend on a vector-valued random control parameter. The cost of a single numerical evaluation of this SCM is assumed to be such that only a limited number of points can be computed for constructing the training dataset (small data). Each point of the training dataset is made up of realizations from a vector-valued stochastic process (the stochastic solution) and the associated random control parameter on which it depends. The presented PLoM constrained by PDE allows for generating a large number of learned realizations of the stochastic process and its corresponding random control parameter. These learned realizations are generated so as to minimize the vector-valued random residual of the PDE in the mean-square sense. Appropriate novel methods are developed to solve this challenging problem. Three applications are presented. The first one is a simple uncertain nonlinear dynamical system with a nonstationary stochastic excitation. The second one concerns the 2D nonlinear unsteady Navier–Stokes equations for incompressible flows in which the Reynolds number is the random control parameter. Here, the last one deals with the nonlinear dynamics of a 3D elastic structure with uncertainties. The results obtained make it possible to validate the PLoM constrained by stochastic PDE but also provide further validation of the PLoM without constraint.

Machine learning↗

Low-Temperature Geothermal Geospatial Datasets: An Example from Alaska

This project is a component of a broader effort focused on geothermal heating and cooling (GHC) with the aim of illustrating the numerous benefits of incorporating GHC and geothermal heat exchange (GHX) into community energy planning and national decarbonization strategies. To better assist private sector investment, it is currently necessary to define and assess the potential of low-temperature geothermal resources. For shallow GHC/GHX fields, there is no formal compilation of subsurface characteristics shared among industry practitioners that can improve system design and operations. Alaska is specifically noted in this work, because heretofore, it has not received a similar focus in geothermal potential evaluations as the contiguous United States. The methodology consists of leveraging relevant data to generate a baseline geospatial dataset of low-temperature resources (less than 150 degrees C) to compare and analyze information accessible to anyone trying to understand the potential of GHC/GHX and small-scale low-temperature geothermal power in Alaska (e.g., energy modelers, communities, planners, and policymakers). Importantly, this project identifies data related to (1) the evaluation of GHC/GHX in the shallow subsurface, and (2) the evaluation of low-temperature geothermal resource availability. Additionally, data is being compiled to assess repurposing of oil and gas wells to contribute co-produced fluids toward the geothermal direct use and heating and cooling resource potential. In this work we identified new data from three different datasets of isolated geothermal systems in Alaska and bottom-hole temperature data from oil and gas wells that can be leveraged for evaluation of low-temperature geothermal resource potential. The goal of this project is to facilitate future deployment of GHC/GHX analysis and community-led programs and update the low-temperature geothermal resources assessment of Alaska. A better understanding of shallow potential for GHX will improve design and operations of highly efficient GHC systems. The deployment and impact that can be achieved for low-temperature geothermal resources will contribute to decarbonization goals and facilitate widespread electrification by shaving and shifting grid loads.

15 GEOTHERMAL ENERGY↗

NETL RDE Image Classification Dataset 2025 - 14 Classes

Dataset including high-speed down-axis RDE images used for updated image classification study. This dataset includes 180,000 images with 14 classifications: 1CW, 1CCW, 2CW, 2CCW, 3CW, 3CCW, Deflagration, 4CW, 4CCW, 5CW, and 5CCW. Images are cropped to center annulus, and resized to 301x301 pixels. Images are filtered using the AFRL Beta correction factor.

Dataset↗

NETL RDE Image Classification Dataset 2020 - 10 Classes

Dataset including high-speed down-axis RDE images used for updated image classification study. This dataset includes 100,000 images with 10 classifications: 1CW, 1CCW, 2CW, 2CCW, 3CW, 3CCW, and Deflagration. Images are cropped to center annulus, and resized to 301x301 pixels. Images are filtered using the AFRL Beta correction factor.

AS↗

Solar PV, Wind Generation, and Load Forecasting Dataset for ERCOT 2018: Performance-Based Energy Resource Feedback, Optimization, and Risk Management (P.E.R.F.O.R.M.)

This report describes the Advanced Research Projects Agency-Energy Performance-Based Energy Resource Feedback, Optimization, and Risk Management (PERFORM) Electric Reliability Council of Texas (ERCOT) dataset consisting of load, solar, and wind deterministic and probabilistic forecasts at three timescales. This dataset consists of 1 year of time-coincident load, wind, and solar actuals and probabilistic forecasts for a region similar to ERCOT. All the data are stored in Hierarchical Data Format 5 (HDF5) files and have been uploaded to an Amazon Web Services repository. The ERCOT data set has 2 years (2017, 2018) of actuals and 1 year (2018) of probabilistic forecasts. These data are provided at various spatial (i.e., site-level, zone-level, and system-level) and temporal scales (i.e., day-ahead, intraday, and intra-hour). Specifically, data are provided for 125 existing wind sites, 22 existing solar sites, 139 proposed wind sites, and 204 proposed solar sites.

14 SOLAR ENERGY↗

ResStock 2024.2 Dataset [Slides]

In the ResStock 2024.2 dataset, ResStock runs are used to create "what-if" scenarios including energy efficiency measures such as heat pumps, envelope improvements, and electrification of appliances. This dataset release includes 15 measure packages across two weather years and incorporates ResStock improvements in variable speed heat pump modeling, geothermal heat pump modeling, and housing characteristic data updates from RECS 2020.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

FlowDash Geothermal Energy Enhancer: Where is Next Geothermal Resource? Machine Learning + Multiple Datasets => Geothermal Exploration Indication?

This is the presentation delivered at the 2025 GEODE Datathon competition. GEODE is a consortium of experts that addresses technology and knowledge gaps in geothermal energy, leveraging technology and best practices from the oil and gas industry. NETL team was awarded the 1st place in the engineering track. 2025 GEODE Datathon had a total of 42 teams from top universities and several major industrial companies. This awarded work is founded on a robust idea and innovative approach that uses machine learning coupled to multiple datasets to visualize geothermal “sweet” spots/indications in Great Basin based on the data provided from the GEODE Datathon. The use case also leveraged other datasets and demonstrated insightful and valuable indications for geothermal exploration.

Geothermal energy, Machine learning, Multiple Data↗

A Forward-Looking Dataset of EV Managed Charging Resource and Costs

This presentation summarizes a high-resolution, forward-looking dataset of EV adoption, EV charging, and managed charging resource. Vehicle-level data are grounded in current adoption and charging patterns, and ~200,000 real-world vehicle-weeks of travel data covering all on-road segments (i.e., light-duty, transit and school buses, local, regional and long-haul medium- and heavy-duty). The data, which include multiple charging profiles per vehicle to bound flexibility, are then processed and aggregated to describe baseline charging and charge management resource by county, hour, year, scenario, and vehicle type. Coupled with one of four scenarios of how EV managed charging costs might evolve over time, the dataset enables a power sector capacity expansion model to select cost-optimal quantities of EV managed charging and supply-side resources to reliably satisfy demand. Five integration strategies: Baseline, Daytime and Flat (passive), Flex (active), and Stress (anti-strategy), illustrate how baseline charging and flexibility potential changes with EVSE build-out and charging preferences.

33 ADVANCED PROPULSION SYSTEMS↗

The Foundational Industry Energy Dataset: Unit-level Characterization and Derived Energy Estimates for Industrial Facilities in 2017

The Foundational Industry Energy Dataset (FIED) addresses several of the areas of growing disconnect between the demands of industrial energy analysis and the state of industrial energy data by providing unit-level characterization by facility. Each facility is identified by a unique registryID, based on the U.S. Environmental Protection Agency (EPA) Facility Registry Service, and includes its coordinates and other geographic identifiers. Energy-using units are characterized by design capacity, as well as their estimated energy use, greenhouse gas emissions, and physical throughput using 2017 data from the EPA's National Emissions Inventory and Greenhouse Gas Reporting Program. An overview of the derivation methods is provided in a separate technical report which will be linked after publication. The Python code used to compile the dataset is available in a GitHub repository. An updated 2020 version is under development.

Array↗

Historical Bolide Infrasound Dataset (1960–1972)

We present the first fully curated, publicly accessible archive of infrasonic records from ten large bolide events documented by the U.S. Air Force Technical Applications Center’s global microbarometer network between 1960 and 1972. Captured on analog strip-chart paper, these waveforms predate modern digital arrays and space-based sensors, making them a unique window on meteoroid activity in the mid-twentieth century. Prior studies drew important scientific conclusions from the records but released only limited artifacts, chiefly period–amplitude tables and unprocessed scans, leaving the underlying data inaccessible for independent study. The present release transforms those limited excerpts into a research-ready resource. By capturing ten large events in the mid-20th century, the dataset constitutes a critical reference point for assessing bolide activity before the advent of modern space-based and digital ground-based monitoring. The multi-year coverage and worldwide distribution of events provide a valuable reference for comparing past and more recent detections, facilitating assessments of long-term flux and the dynamics of acoustic wave propagation in Earth’s atmosphere. The dataset’s availability in a consolidated format ensures straightforward access to waveforms and derived measurements, supporting a wide range of scientific inquiries into bolide physics and infrasound monitoring. By preserving these historical acoustic observations, the collection maintains a significant record of mid-20th-century meteoroid entries. It thereby establishes a basis for further refinement of impact hazard evaluations, contributes to historical continuity in atmospheric observation, and enriches the study of meteoroid-generated infrasound signals on a global scale.

79 ASTRONOMY AND ASTROPHYSICS↗

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗

Comparison of GFED3, QFED2 and FEER1 Biomass Burning Emissions Datasets in a Global Model

Biomass burning contributes about 40% of the global loading of carbonaceous aerosols, significantly affecting air quality and the climate system by modulating solar radiation and cloud properties. However, fire emissions are poorly constrained in models on global and regional levels. In this study, we investigate 3 global biomass burning emission datasets in NASA GEOS5, namely: (1) GFEDv3.1 (Global Fire Emissions Database version 3.1); (2) QFEDv2.4 (Quick Fire Emissions Dataset version 2.4); (3) FEERv1 (Fire Energetics and Emissions Research version 1.0). The simulated aerosol optical depth (AOD), absorption AOD (AAOD), angstrom exponent and surface concentrations of aerosol plumes dominated by fire emissions are evaluated and compared to MODIS, OMI, AERONET, and IMPROVE data over different regions. In general, the spatial patterns of biomass burning emissions from these inventories are similar, although the strength of the emissions can be noticeably different. The emissions estimates from QFED are generally larger than those of FEER, which are in turn larger than those of GFED. AOD simulated with all these 3 databases are lower than the corresponding observations in Southern Africa and South America, two of the major biomass burning regions in the world.

biomass burning↗

Outcomes of a NASA Workshop to Develop a Portfolio of Low Latency Datasets for Time-Sensitive Applications

It is widely accepted that time-sensitive remote sensing data serve the needs of decision makers in the applications communities and yet to date, a comprehensive portfolio of NASA low latency datasets has not been available. This paper will describe the NASA low latency, or Near-Real Time (NRT), portfolio, how it was developed and plans to make it available online through a portal that leverages the existing EOSDIS capabilities such as the Earthdata Search Client (https:search.earthdata.nasa.gov), the Common Metadata Repository (CMR) and the Global Imagery Browse Service (GIBS). This paper will report on the outcomes of a NASA Workshop to Develop a Portfolio of Low Latency Datasets for Time-Sensitive Applications (27-29 September 2016 at NASA Langley Research Center, Hampton VA). The paper will also summarize findings and recommendations from the meeting outlining perceived shortfalls and opportunities for low latency research and application science.

remote sensing↗