SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This dataset contains plant-level wind power production data from ERCOT, recorded at 15-minute intervals. The source of this data is ERCOT's 60-Day SCED Disclosure Report (product number NP3-965-ER), with timestamps provided in UTC.
The FAIR Principles—Findable, Accessible, Interoperable, and Reusable—offer a widely accepted framework for improving the sharing and reuse of digital scientific data by both human and machine users. Following these principles is critical for effective scientific data stewardship, broader scientific collaboration, and compliance with federal and agency data policies. This paper, based on the work of NASA’s Open, Free, and FAIR Working Group (O’FAIR WG) under the Earth Science Data Systems Program, presents an overview of how FAIR is being applied within NASA’s Earth science data landscape. It highlights ongoing progress and challenges, identifies FAIR-enabling resources, and offers recommendations and strategic actions to enhance the FAIRness of NASA-funded open and free Earth science data products. The FAIR-enabling resources identified underscore the vital role of NASA's existing enterprise processes, standards, tools, and infrastructures in supporting FAIR implementation. Our findings show strong performance in making NASA Earth science data more findable and accessible. However, further work is needed—especially in enhancing interoperability, so that different systems and tools can better understand and exchange data. This is especially important for enabling machine-driven discovery and analysis. We emphasize the importance of a balanced strategy that combines a centralized, top-down approach—focused on building enterprise-level capabilities and processes—with a decentralized, bottom-up approach driven by discipline-specific needs and community practices. We advocate for coordinated efforts to enhance (meta)data interoperability to facilitate seamless data and information sharing and exchange of Earth science data both within NASA and across other agencies managing Earth science data.
The proliferation of countries and regions with 100% clean or renewable energy targets necessitates an analysis to determine the number of generating units and storage needed to meet real-time electricity demand on the electric grid. The coastal areas of New England have the capacity to produce a large percentage of the region's energy needs with offshore wind turbines. Here we model offshore wind turbine power production data using MERRA-2 reanalysis and lidar wind speed data sets. We compare this power production to the New England hourly grid demand over the course of one year. 2,000 10 MW offshore wind turbines could satisfy New England's grid demand for about 37% of the year. When combined with 55 GWh of storage, 2,000 turbines could satisfy grid demand for about 72% of the year.
This is the primary data release of the AbacusSummit, a suite of large, high-accuracy cosmological N-body simulations. Documentation describing the suite and code, including links to refereed publications and instructions for manipulating the data contained in this release, may be found at the following URL: https://abacussummit.readthedocs.io/ The primary data products presented in this release are halo catalogs, light cones, and particle data. Several supplemental products are also presented: power spectra, initial conditions, and merger trees. Cleaned halo catalogs are also provided for the subset of simulations that were used in refereed publications at the time of this DOI. This release also contains several large scale-free and high-redshift simulations run as part of the same allocation used to produce AbacusSummit.
The purpose of this data services request was to demonstrate integration of the Atmospheric Radiation Measurement (ARM) User Facility’s “met” datastreams with time series data from other earth science data sources using the BASIN-3D data synthesis software tool. BASIN-3D is an open-source Python library that enables researchers to integrate data across configured public and private data sources. It provides a common query language for researchers to request measurement locations and time series data based on specified locations, variables, time period, statistics, aggregation, and data quality. BASIN-3D acquires the data that match the query from each configured data source and translates the results into harmonized vocabularies, thus reducing researchers' data-wrangling effort. In addition, because the queries are executed on demand, researchers can easily regenerate their synthesized data sets as new data and/or data updates become available, eliminating one-off data products. BASIN-3D can output data using a variety of different data structures for end-user applications including Python pandas data frames and hdf5 output formats.
Nuclear magnetic resonance (NMR) data are rarely deposited in open databases, leading to loss of critical scientific knowledge. Existing data reporting methods (images, tables, lists of values) contain less information than raw data, and are poorly standardized. Together, these issues limit FAIR (findable, accessible, interoperable, reusable) access to these data, which in turn creates barriers for compound dereplication and the development of new data-driven discovery tools. Existing NMR databases are either not designed for natural products data, or employ complex deposition interfaces that disincentivize deposition. Journals, including the Journal of Natural Products (JNP), are now requiring data submission as part of the publication process, creating the need for a streamlined, user-friendly mechanism to deposit and distribute NMR data. Recently, our team reported the development of the Natural Products Magnetic Resonance Database (NP-MRD; www.np-mrd.org). Here in this paper we present a new data deposition platform for the NP-MRD project that is designed to enable users to deposit NMR data for published or submitted manuscripts in under five minutes. This platform includes a suite of automated data extraction and standardization tools, together with a simple-to-use web-based interface and detailed error reporting to simplify the data deposition process and is available at www.np-mrd.org/submissions.
The LCOE Content Model provides data submitters with an easy and consistent means of uploading data that can be used to calculate the levelized cost of energy for MHK devices. These data are important to DOE and will be used to develop data products that provide quantitative information to guide and support programmatic decisions. Data will also be used to evaluate MHK products and determine costs and can help data users compare the combination of capital costs and operations and maintenance over time. The ultimate goal is to use these data to perform research and tailor programs to best benefit the industry.
The Hestia-SWIFL version 1.1 anthropogenic heat (AH) and fossil fuel CO2 (FFCO2) emissions data product represent emissions due to the combustion of fossil fuel and cement production within the state of Arizona from 2019 to 2022. This product was developed as part of the Southwest Urban Corridor Integrated Field Laboratory (SW-IFL) project, which aims to provide new knowledge and tools that address extreme heat, air quality, climate change and related urban environmental issues by integrating high-resolution observations, modeling, and civic engagement. The emissions are generated using a bottom-up/engineering approach and are tied to results generated by the Vulcan Project version 4, an effort to quantify space/time-resolved FFCO2 & AH emissions for the entire United States landscape. A large number of data sources are combined to best estimate the emissions at fine scales such as air quality emissions data, traffic flow data, building information, sociodemographic information, and fuel statistics. The AH product provides emissions for two emissions sources (transportation and point source emissions) in units of Watts per hour per square meter (W/m2) per year (annual files) or per hour (hourly files). The FFCO2 product provides emissions from nine individual emission sectors as well as the total, and in units of tons of carbon (tC) per grid cell per year or per hour. The output made available here places the native spatial resolution of the Hestia FFCO2 & AH emissions data product (points, lines, and polygons) into a regularized 2km x 2km grid at hourly and annual temporal resolutions, and stored in netCDF files. The exact spatial extent is defined by the ASU Weather Research Forecast (WRF) simulation grid. All data are processed using R/Python pm high-performance computing system. 2-27-2026 updates: Bugs in airport hourly profile (both AH and FFCO2) and building spatial patterns (FFCO2 only) were fixed. Hourly emissions are reprocessed for all years to reflect those changes.
The Atmospheric Radiation Measurement (ARM) Data Center is responsible for the timely collection, archival, and curation of science data products. These products are freely available through an online data repository. Metadata creation is paramount for scientific users to find and access over seven petabytes of atmospheric science data. The hierarchical metadata structure allows users to search for information at both broad and narrow levels. This project aims to leverage 30 years’ worth of manually created metadata to enable machine predictions of broad-term classifications from narrow-term descriptions. These classification predictions would assist metadata coordinators with their term selections. This paper discusses the cleaning and preprocessing of the training data, the pipeline developed to determine the best model for this task, and the creation of an API metadata classifier for ARM measurement metadata. Our results show that the Linear Support Vector Classification (LinearSVC) algorithm, along with the Term Frequency – Inverse Document Frequency (TF-IDF) vectorizer, is well-suited for our multi-class classification task. Lengthier input training data led to better results, and artificial balancing was unnecessary for this particular use case. This predictive classifier enhances efficiency in metadata creation, as well as supports greater consistency and accuracy in metadata tagging.
While collaboration among data scientists is a key to organizational productivity, data analysts face significant barriers to achieving this end, including data sharing, accessing and configuring the required computational environment, and a unified method of sharing knowledge. Each of these barriers to collaboration is related to the fundamental question of knowledge management “how can organizations use knowledge more effectively?”. In this paper, we consider the problem of knowledge management in collaborative data analytics and present ShareAL, an integrated knowledge management platform, as a solution to that problem. The ShareAL platform consists of three core components: a full stack web application, a dashboard for analyzing streaming data and a High Performance Computing (HPC) cluster for performing real time analysis. Prior research has not applied knowledge management to collaborative analytics or developed a platform with the same capabilities as ShareAL. ShareAL overcomes the barriers data scientists face to collaboration by providing intuitive sharing of data and analytics via the web application, a shared computing environment via the HPC cluster and knowledge sharing and collaboration via a real time messaging application.
Software that orchestrate data processing and management for mass spectrometry workflows and data products. Stack presented contains a web application, data processing job scheduling, and data processing workers for data processing and management.
The EXploration of Coastal Hydrobiogeochemistry Across a Network of Gradients and Experiments (EXCHANGE) program is a consortium of scientists working together to improve our understanding of how the two-way exchange of water between estuaries or large lake lacustuaries and the terrestrial landscape influence the state and function of ecosystems across the coastal interface. EXCHANGE Campaign 1 (EC1) focuses on the spatial variation in biogeochemical structure and function at the coastal terrestrial-aquatic interface (TAI). In the Fall of 2021, the EXCHANGE Consortium gathered samples from 52 TAIs. Samples collected from EC1 were analyzed for bulk geochemical parameters, bulk physicochemical parameters, organic matter characteristics, and redox-sensitive elements.Please download ec1_README.pdf for a complete list of available data in each .zip folder, package version history, and detailed information about the project. This README will serve as the central place for EC1 Data Package updates. Experimental setup and v1 methods are documented in Myers-Pigg and Pennington et al., 2023 (https://doi.org/10.1038/s41597-023-02548-7).EC1 Data Package Structure:ec1_README.pdfec1_methods.pdfec1_metadata_v3.zip...ec1_dd.csv...ec1_flmd.csv...ec1_sample_catalog.csv...ec1_metadata_kitlevel.csv...ec1_metadata_collectionlevel.csv...ec1_data_collectionlevel.csv...ec1_igsn_metadata.csvec1_soil_v3.zipec1_sediment_v3.zipec1_water_v3.zipec1_processingscripts_v3.zipThis data package is on v3 and was originally published May 2023 (v1). Subsequent updates will be published here with new version numbers. Please see the Change History section in ec1_README.pdf for detailed changes.---Acknowledging EXCHANGE: General Support and Data Product UseWe ask that users of EXCHANGE data add the following acknowledgement when publishing data in scholarly articles and data repositories:"This research is based on work supported by COMPASS-FME, a multi-institutional project supported by the U.S. Department of Energy, Office of Science, Biological and Environmental Research as part of the Environmental System Science Program."
Rubin Observatory will compute timeseries variability features on lightcurves to aid users in identifying objects of interest, both during realtime Alert Production as well as in the annual Data Releases. The Data Products Definition Document (DPDD; LSE-163) allocates space for pre-computed timeseries features, and a sample set is baselined in LDM-151. However, in the subsequent decade the scientfic community has made a great deal of further progress in this area. This technote reviews the relevant literature, grouping related features where possible; discusses potential concerns and open questions; and proposes a new baseline feature set.
Overall, the first three cycles of irradiation proceeded as planned Items of note: Failure rate of thermocouples was higher than expected Downstream needle valves were throttled resulting in part of the exhaust flow being diverted prior to reaching the fission product monitors (this was corrected near the end of cycle 164B). This was more of annoyance than anything and did not prevent proper analysis of fission product data. No evidence of failures on fission product monitoring system.
Abstract Lightning is measured from space using optical instruments that detect transient changes in the illumination of the cloud top. How much of the flash (if any) is recorded by the instrument depends on the instrument detection threshold. NOAA's Geostationary Lightning Mapper (GLM) employs a dynamic threshold that varies across the imaging array and changes over time. This causes flashes in certain regions and at night to be recorded in greater detail than other flashes, and threshold inconsistencies will impose biases on all levels of GLM data products. In this study, we quantify the impact of the varying GLM threshold on event/group/flash detection, flash clustering, and gridded product generation by imposing artificial thresholds on the event data taken from a thunderstorm with a low instrument threshold (∼0.7 fJ). We find that even modest increases in threshold severely impact event (60% loss by 2 fJ, 90% loss by 10 fJ) and group (25% loss by 2 fJ, 81% loss by 10 fJ) detection by suppressing faint illumination of the cloud top from weak sources and scattering. Flash detection is impacted less by threshold increases (4% loss by 2 fJ), but reductions are still significant at higher thresholds (35% loss by 10 fJ, or 44% if single‐group flashes are removed). Undetected pulses cause individual flashes to be split and severely impact the construction of gridded products. All of these factors complicate the interpretation of GLM data, particularly when trended over time under a changing threshold.
We report the extensive development of unconventional reservoirs using horizontal drilling and multistage hydraulic fracturing has generated large volumes of reservoir characterization and production data. The analysis of this abundant data using statistical methods and advanced machine-learning (ML) techniques can provide data-driven insights into well performance. Most predictive modeling studies have focused on the impact that different well completion and stimulation strategies have on well production but have not fully exploited the available in situ rock property data to determine its role in reservoir productivity. We have used machine-learning techniques to rank rock mechanical properties, microseismic attributes, and stimulation parameters in the order of their significance for predicting natural gas production from an unconventional reservoir. The data for this study came from a hydraulically fractured well in the Marcellus Shale in Monongalia County, West Virginia. The data classes included measurements aggregated by well completion stage that included (1) gas production, (2) well-log-derived measurements including bulk density, elastic moduli, shear impedance, compressional impedance, brittleness, and gamma measurements, (3) microseismic attributes, (4) long-period long-duration (LPLD) event counts, (5) fracture counts, and (6) stimulation parameters that included the fluid injection volume and average pumping pressure. To identify observable proxies for the drivers of gas production, we evaluated five commonly used ML approaches including multivariate adaptive regression spline, Gaussian mixture model, random forest, gradient boosting, and neural network. We selected five variables including LPLD event count, seismogenic b-value, hydraulic diffusivity, cumulative moment, and fluid volume as the features most likely to impact gas productivity at the stage level in the study area. The data-driven selection of these parameters for their importance in determining gas production can help reservoir engineers design more effective hydraulic-fracture treatments in the Marcellus Shale and other similar unconventional reservoirs. Plain language summary: We use machine-learning methods and data-driven selection of reservoir parameters to rank and better understand their importance in determining gas production, which can help reservoir engineers design more effective hydraulic-fracture treatments in the Marcellus Shale and other similar unconventional reservoirs.
Tidal inundation along the coastal terrestrial-aquatic interface controls soil and sediment biogeochemistry and gas dynamics. Although a rich literature exist on studies of the influence of tidal waters on the biogeochemistry of coastal ecosystem soils, few studies have experimentally addressed the reverse question: How do soils (or sediments) from different coastal ecosystems influence the biogeochemistry of the tidal waters that inundate them? We conducted short-term microcosm laboratory experiments where seawater was amended with sediments and soils collected across regional gradients of inundation exposure (i.e., frequently to rarely inundated) and measured changes in dissolved oxygen and greenhouse gas concentrations to calculate gas consumption or production rates occurring during seawater exposure to terrestrial materials. This data package contains dissolved oxygen and greenhouse gas data collected during incubation of soils and sediments collected at 18 sites, which were used in the publication Regier et al. (2023) entitled “Coastal inundation regime moderates the short-term effects of sediment and soil additions on seawater oxygen and greenhouse gas dynamics: a microcosm experiment” which is published in Frontiers in Marine Science (DOI: https://doi.org/10.3389/fmars.2023.1308590).---Acknowledging EXCHANGE: General Support and Data Product UseWe ask that users of EXCHANGE data add the following acknowledgement when publishing data in scholarly articles and data repositories:"This research is based on work supported by COMPASS-FME, a multi-institutional project supported by the U.S. Department of Energy, Office of Science, Biological and Environmental Research as part of the Environmental System Science Program."
Solar tracking system failures can dramatically reduce photovoltaic (PV) system energy output through suboptimal irradiance capture and self-shading loss. Detecting tracker failures is not always straightforward; unlike other common PV system failures like inverter outages and blown fuses which take portions of a system completely offline, tracker failures only partially reduce output power and can go unnoticed as a result. Additionally, tracker failures can take one of several forms, each with their own loss characteristics. Here we present two methods of detecting tracker failure events from time-series production data and a method for estimating the associated production loss. Compared with existing detection methods, the proposed power-based detection method showed 0-17% reductions in Type I error rate depending on weather conditions. Here, the loss model estimated production loss with low error (mean bias error = -2.3 %, root-mean-squared error = 6%) in a rudimentary validation.