Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Atmospheric Carbon and Transport – America (ACT-America) Data Sets: Description, Management, and Delivery

The ACT-America project is a NASA Earth Venture Suborbital-2 mission designed to study the transport and fluxes of greenhouse gases. The open and freely available ACT-America data sets provide airborne in situ measurements of atmospheric carbon dioxide, methane, trace gases, aerosols, clouds, and meteorological properties, airborne remote sensing measurements of aerosol backscatter, atmospheric boundary layer height and columnar content of atmospheric carbon dioxide, tower-based measurements, and modeled atmospheric mole fractions and regional carbon fluxes of greenhouse gases over the Central and Eastern United States. In this study, we conducted 121 research flights during five campaigns in four seasons during 2016–2019 over three regions of the US (Mid-Atlantic, Midwest and South) using two NASA research aircraft (B-200 and C-130). We performed three flight patterns (fair weather, frontal crossings, and OCO-2 underflights) and collected more than 1,140 h of airborne measurements via level-leg flights in the atmospheric boundary layer, lower, and upper free troposphere and vertical profiles spanning these altitudes. We also merged various airborne in situ measurements onto a common standard sampling interval, which brings coherence to the data, creates geolocated data products, and makes it much easier for the users to perform holistic analysis of the ACT-America data products. Here, we report on detailed information of data sets collected, the workflow for data sets including storage and processing of the quality controlled and quality assured harmonized observations, and their archival and formatting for users. Finally, we provide some important information on the dissemination of data products including metadata and highlights of applications of ACT-America data sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2012

Ozone highs and associated flow features in the first half of the twentieth century in different data sets

In order to better understand weather extremes, their relation to the large-scale climate variability, and their possible changes over time, observation-based atmospheric data sets are required that reach back in time as far as possible and that provide information on the 3-dimensional structure of the atmosphere. A number of new such data sets have been published in recent years, including historical observations, reanalyses, and reconstructions, some of which reach back into the nineteenth century. However, their usefulness for studying weather extremes remains to be shown. Here we compare some of these historical data sets in the first half of the twentieth century, focusing on one specific type of extreme, namely “ozone highs". Using historical total ozone observations as a starting point, we assess dynamical links between total ozone, the flow near the tropopause, and tropospheric circulation in the “Twentieth Century Reanalysis" (20CR), historical radiosonde and aircraft observations, and hand drawn historical maps. Selected cases are presented for two regions (Europe and China). Ozone highs over Europe in the 1920s to 1950s were qualitatively well reproduced in 20CR and could mostly be interpreted in the context of cut-off lows. Some of these coincided with a blocking high over the North Atlantic or with vigorous cold-air outbreaks. One of these cases is analysed in more detail. Ozone highs over China in the 1930s may have been related to changes in the jet stream and the subtropical tropopause, but they were not always well reproduced in 20CR. The results demonstrate that, in many of the cases, the available data allow a dynamical interpretation. This confirms the potential of the available data and techniques to extend the length of atmospheric data sets suitable for studying extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Parallel analysis tools and new visualization techniques for ultra-large climate data set

ParVis was a project funded under LAB 10-05: “Earth System Modeling: Advanced Scientific Visualization of Ultra-Large Climate Data Sets”. Argonne was the lead lab with partners at PNNL, SNL, NCAR and UC-Davis. This report covers progress from January 1st, 2013 through Dec 1st, 2014. Two previous reports covered the period from Summer, 2010, through September 2011 and October 2011 through December 2012, respectively. While the project was originally planned to end on April 30, 2013, personnel and priority changes allowed many of the institutions to continue work through FY14 using existing funds. A primary focus of ParVis was introducing parallelism to climate model analysis to greatly reduce the time-to-visualization for ultra-large climate data sets. Work in the first two years was conducted on two tracks with different time horizons: one track to provide immediate help to climate scientists already struggling to apply their analysis to existing large data sets and another focused on building a new data-parallel library and tool for climate analysis and visualization that will give the field a platform for performing analysis and visualization on ultra-large datasets for the foreseeable future. In the final 2 years of the project, we focused mostly on the new data-parallel library and associated tools for climate analysis and visualization.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Integrated Data Collection Analysis (IDCA) Program — RDX Standard Data Sets

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of the RDX Type II Class 5 standard, for a third and fourth time in the Proficiency Test and averaged with the analysis results from the first and second time. The results, from averaging all four sets (1, 2, 3 and 4) of data suggest a material to have slightly more impact sensitivity, more BAM friction sensitivity, less ABL friction sensitivity, similar ESD sensitivity, and same DSC sensitivity, compared to the results from Set 1, which was used previously as the values for the RDX standard in IDCA Analysis Reports.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

Development of a MODIS-Derived Surface Albedo Data Set: An Improved Model Input for Processing the NSRDB

A significant source of bias in the transposition of global horizontal irradiance to plane-of-array (POA) irradiance arises from inaccurate estimations of surface albedo. The current physics-based model used to produce the National Solar Radiation Database (NSRDB) relies on model estimations of surface albedo from a reanalysis climatalogy produced at relatively coarse spatial resolution compared to that of the NSRDB. As an input to spectral decomposition and transposition models, more accurate surface albedo data from remotely sensed imagery at finer spatial resolutions would improve accuracy in the final product. The National Renewable Energy Laboratory (NREL) developed an improved white-sky (bi-hemispherical reflectance) broadband (0.3-5.0 ..mu..m) surface albedo data set for processing the NSRDB from two existing data sets: a gap-filled albedo product and a daily snow cover product. The Moderate Resolution Imaging Spectroradiometer (MODIS) sensors onboard the Terra and Aqua satellites have provided high-quality measurements of surface albedo at 30 arc-second spatial resolution and 8-day temporal resolution since 2001. The high spatial and temporal resolutions and the temporal coverage of the MODIS sensor will allow for improved modeling of POA irradiance in the NSRDB. However, cloud and snow cover interfere with MODIS observations of ground surface albedo, and thus they require post-processing. The MODIS production team applied a gap-filling methodology to interpolate observations obscured by clouds or ephemeral snow. This approach filled pixels with ephemeral snow cover because the 8-day temporal resolution is too coarse to accurately capture the variability of snow cover and its impact on albedo estimates. However, for this project, accurate representation of daily snow cover change is important in producing the NSRDB. Therefore, NREL also used the Integrated Multisensor Snow and Ice Mapping System data set, which provides daily snow cover observations of the Northern Hemisphere for the temporal extent of the NSRDB (1998-2015). We provide a review of validation studies conducted on these two products and describe the methodology developed by NREL to remap the data products to the NSRDB grid and integrate them into a seamless daily data set.

14 SOLAR ENERGY↗
DOE OSTI2026

A Public Data Set of Auto-Generated Geotagged PV Site Equipment, Generated via Deep Learning

In this research, we present a data set over 100 photovoltaic (PV) sites in TX, which have been automatically geotagged via a fully autonomous deep learning (DL) pipeline. Specifically, locations of inverters, tracker/fixed tilt rows, batteries, and substations are labeled algorithmically. To ensure high data quality, all systems have been reviewed manually and any deep learning errors have been corrected. This public data set, as well as the open-sourced pipeline used to generate it, is valuable for site planning, modelling, and insurance purposes. Given time and resources, we hope to extend the data set to additional states/regions in the US.

14 SOLAR ENERGY↗
DOE OSTI2025

Sensitivity of Regional WRF‐Chem Air Quality and Weather Simulations to Biomass‐Burning Emission Data Sets: A Case Study of the Impact of Canadian Wildfire on the US°

This study focuses on the period from June 26 to 29, 2023, when record‐breaking Canadian wildfires severely impacted air quality in the Midwest United States. Using the Weather Research and Forecasting Model with Chemistry (WRF‐Chem) and four biomass‐burning data sets (Fire Inventory from NCAR version 1, Fire Inventory from NCAR version 2.5, Quick Fire Emissions Data set [QFED], and Regional ABI‐VIIRS Emission), we analyzed aerosol transport from Canada to the US and assessed the model's accuracy in predicting PM 2.5 , O 3 , CO and aerosol weather feedback. Model simulations were compared with ground‐based and remote sensing observations as well as field measurements from the Community Research on Climate and Urban Science (CROCUS) project. Our findings show that the movement of a low‐pressure system from the Great Lakes to the Atlantic, combined with the high‐pressure system over the Atlantic, caused the transport of aerosols from Canadian wildfires to the US. Results show WRF‐Chem significantly underestimated key atmospheric components: aerosol optical depth (AOD) by over 50%, PM 2.5 by 65%–90% and peak O 3 concentrations by 50%–55% across four biomass burning data sets. Additionally, CO and NO 2 concentrations were underpredicted. The substantial underestimation of PM 2.5 led to an overestimation of temperature by up to 3.6 °C primarily due to excessive downward shortwave radiation, which resulted from the underestimation of direct aerosol effects and an increase in sensible heat flux. Among the biomass‐burning data sets, QFED produced the most accurate AOD and PM 2.5 predictions due to improved wildfire emission estimates, leading to a 1.0 to 1.5 °C reduction in temperature overestimation during the daytime. These findings underscore the need for improving wildfire emission estimates for trace gases and aerosols to enhance air quality and weather feedback predictions.

WRF-chem model↗
DOE OSTI2011

Moving Large Data Sets Over High-Performance Long Distance Networks

In this project we look at the performance characteristics of three tools used to move large data sets over dedicated long distance networking infrastructure. Although performance studies of wide area networks have been a frequent topic of interest, performance analyses have tended to focus on network latency characteristics and peak throughput using network traffic generators. In this study we instead perform an end-to-end long distance networking analysis that includes reading large data sets from a source file system and committing large data sets to a destination file system. An evaluation of end-to-end data movement is also an evaluation of the system configurations employed and the tools used to move the data. For this paper, we have built several storage platforms and connected them with a high performance long distance network configuration. We use these systems to analyze the capabilities of three data movement tools: BBcp, GridFTP, and XDD. Our studies demonstrate that existing data movement tools do not provide efficient performance levels or exercise the storage devices in their highest performance modes. We describe the device information required to achieve high levels of I/O performance and discuss how this data is applicable in use cases beyond data movement performance.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Developing Synthetic Distribution Models Using Open-Source Data Sets

The deployment of distributed generation resources at scale with the distribution side of the power system network over the last two decades has spurred a lot of research interest in distribution networks. Given, the sensitive nature of power system data sets, utilities are still reluctant to open-source distribution networks. Although some open-source data sets are available, they may not cover the region of interest. In this paper, we introduce the Synthetic dIstribution Network Generator (SING), new software that allows users to develop synthetic distribution models, using open-source data sets, in any region of interest within the continental US.

data set↗
DOE OSTI2019

Use cases of lossy compression for floating-point data in scientific data sets

Architectural and technological trends of systems used for scientific computing call for a significant reduction of scientific data sets that are composed mainly of floating-point data. Here, this article surveys and presents experimental results of currently identified use cases of generic lossy compression to address the different limitations of scientific computing systems. The article shows from a collection of experiments run on parallel systems of a leadership facility that lossy data compression not only can reduce the footprint of scientific data sets on storage but also can reduce I/O and checkpoint/restart times, accelerate computation, and even allow significantly larger problems to be run than without lossy compression. In conclusion, these results suggest that lossy compression will become an important technology in many aspects of high performance scientific computing. Because the constraints for each use case are different and often conflicting, this collection of results also indicates the need for more specialization of the compression pipelines.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2011

Cluster Analysis-Based Approaches for Geospatiotemporal Data Mining of Massive Data Sets for Identification of Forest Threats

We investigate methods for geospatiotemporal data mining of multi-year land surface phenology data (250 m2 Normalized Difference Vegetation Index (NDVI) values derived from the Moderate Resolution Imaging Spectrometer (MODIS) in this study) for the conterminous United States (CONUS) as part of an early warning system for detecting threats to forest ecosystems. The approaches explored here are based on k-means cluster analysis of this massive data set, which provides a basis for defining the bounds of the expected or normal phenological patterns that indicate healthy vegetation at a given geographic location. We briefly describe the computational approaches we have used to make cluster analysis of such massive data sets feasible, describe approaches we have explored for distinguishing between normal and abnormal phenology, and present some examples in which we have applied these approaches to identify various forest disturbances in the CONUS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Carbonate clumped isotope analysis (Δ 47 ) of 21 carbonate standards determined via gas‐source isotope‐ratio mass spectrometry on four instrumental configurations using carbonate‐based standardization and multiyear data sets

Rationale Clumped isotope geochemistry examines the pairing or clumping of heavy isotopes in molecules and provides information about the thermodynamic and kinetic controls on their formation. The first clumped isotope measurements of carbonate minerals were first published 15 years ago, and since then, interlaboratory offsets have been observed, and laboratory and community practices for measurement, data analysis, and instrumentation have evolved. Here we briefly review historical and recent developments for measurements, share Tripati Lab practices for four different instrument configurations, test a recently published proposal for carbonate‐based standardization on multiple instruments using multi‐year data sets, and report values for 21 different carbonate standards that allow for recalculations of previously published data sets. Methods We examine data from 4628 standard measurements on Thermo MAT 253 and Nu Perspective IS mass spectrometers, using a common acid bath (90°C) and small‐sample (70°C) individual reaction vessels. Each configuration was investigated by treating some standards as anchors (working standards) and the remainder as unknowns (consistency standards). Results We show that different acid digestion systems and mass spectrometer models yield indistinguishable results when instrument drift is well characterized. For linearity correction, mixed gas‐and‐carbonate standardization or carbonate‐only standardization yields similar results. No difference is observed in the use of three or eight working standards for the construction of transfer functions. Conclusions We show that all configurations yield similar results if instrument drift is robustly characterized and validate a recent proposal for carbonate‐based standardization using large multiyear data sets. Δ 47 values are reported for 21 carbonate standards on both the absolute reference frame (ARF; also refered to as the Carbon Dioxide Equilibrated Scale or CDES) and the new InterCarb‐Carbon Dioxide Equilibrium Scale (I‐CDES) reference frame, facilitating intercomparison of data from a diversity of labs and instrument configurations and restandardization of a broad range of sample sets between 2006, when the first carbonate measurements were published, and the present.

58 GEOSCIENCES↗
DOE OSTI2016

iVirus: facilitating new insights in viral ecology with software and community data sets imbedded in a cyberinfrastructure

Microbes affect nutrient and energy transformations throughout the world’s ecosystems, yet they do so under viral constraints. In complex communities, viral metagenome (virome) sequencing is transforming our ability to quantify viral diversity and impacts. Although some bottlenecks, for example, few reference genomes and nonquantitative viromics, have been overcome, the void of centralized data sets and specialized tools now prevents viromics from being broadly applied to answer fundamental ecological questions. Here we present iVirus, a community resource that leverages the CyVerse cyberinfrastructure to provide access to viromic tools and data sets. The iVirus Data Commons contains both raw and processed data from 1866 samples and 73 projects derived from global ocean expeditions, as well as existing and legacy public repositories. Through the CyVerse Discovery Environment, users can interrogate these data sets using existing analytical tools (software applications known as ‘Apps’) for assembly, open reading frame prediction and annotation, as well as several new Apps specifically developed for analyzing viromes. Because Apps are web based and powered by CyVerse supercomputing resources, they enable scalable analyses for a broad user base. Finally, a use-case scenario documents how to apply these advances toward new data. This growing iVirus resource should help researchers utilize viromics as yet another tool to elucidate viral roles in nature.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Curated Modeled Fault Data Set

The curated fault model simulation data set consists of tagged and fully-described time series representing simulated faults for the AFDD test building (ORNLs Flexible Research Platform (FRP)), including baseline performance, faulty performance, and corresponding energy impact. A total of 26 fault models are considered for 99 simulation scenarios with various fault intensity levels. Additional Contacts: Principal investigator: Matt Leach Matt.Leach@nrel.gov Simulation performer: Janghyun Kim Janghyun.Kim@nrel.gov

AFDD↗
DOE OSTI2025

Open data sets for assessing photovoltaic system reliability

Photovoltaic (PV) systems have become a cornerstone of renewable energy strategies, particularly due to the significant reduction in solar power costs over the past decade. However, the long-term reliability of PV installations presents a persistent challenge, requiring the development of advanced monitoring and predictive maintenance strategies. A wide range of data types is used to evaluate the health of PV systems, including environmental conditions, electrical performance, and inspection imagery. These data enable methodologies such as machine learning (ML) models for lifetime prediction and computer vision techniques for defect detection. However, the acquisition of high-quality and comprehensive data is difficult, particularly in terms of long-term consistency and data variety. Publicly available data sets serve as valuable resources for addressing these challenges, but they often suffer from fragmentation and are difficult to access. This paper presents a comprehensive review of existing open-source data sets related to PV degradation, analyzing their features, functionalities, and potential applications. We categorize these data sets based on the specific aspects of PV system information they cover, such as environmental conditions, operational monitoring, image inspection and module materials, and propose relevant tools and ML models for processing them. In addition, we propose practices for future data collection and usage, while also discussing potential directions in data-driven research. Our aim is to enhance data utilization and publication among researchers and industry professionals, promoting a deeper understanding of the role of data in enhancing the performance and durability of PV systems.

14 SOLAR ENERGY↗
DOE OSTI2026

A Comparison of Three Neodymium Atomic Data Sets for Kilonova Modeling

We examine the impact of input neodymium (Nd) atomic data on the light curves and spectra of kilonovae (KNe), probing the sensitivity of kilonova observables to the atomic physics of this important lanthanide element. We use the SuperNu Monte Carlo radiative transfer code, simulating a simple semianalytic 1D kilonova (KN) with a pure Nd atmosphere, fixing the radiative transfer method while using input atomic data generated by three different codes: the LANL suite of atomic physics codes, HULLAC, and Autostructure. We see that the choice of atomic data significantly shapes the resulting light curves and spectra. Peak bolometric luminosities differ by a ratio of nearly 1.5 between HULLAC/Autostructure and LANL data sets. Moreover, we observe significant near- to mid-IR differences in the structure of the spectra. We specifically attribute these differences to the choice of atomic data for neutral Nd I. Many of the results here have been adapted from a presentation at “Radiative Transfer and Atomic Physics of Kilonovae” in Stockholm, 2023. We additionally present a LANL data set with energies calibrated to available values in the NIST Atomic Spectra Database, and demonstrate that this calibration also significantly affects IR spectral structure at late time. The substantial differences in KN observables that arise from tuning the atomic data of just one lanthanide element highlight the special attention that must be paid to atomic physics uncertainties when modeling KNe, from AT2017gfo to beyond.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Disentangling Sources of Gene Tree Discordance in Phylogenomic Data Sets: Testing Ancient Hybridizations in Amaranthaceae s.l

Gene tree discordance in large genomic data sets can be caused by evolutionary processes such as incomplete lineage sorting and hybridization, as well as model violation, and errors in data processing, orthology inference, and gene tree estimation. Species tree methods that identify and accommodate all sources of conflict are not available, but a combination of multiple approaches can help tease apart alternative sources of conflict. Here, using a phylotranscriptomic analysis in combination with reference genomes, we test a hypothesis of ancient hybridization events within the plant family Amaranthaceae s.l. that was previously supported by morphological, ecological, and Sanger-based molecular data. The data set included seven genomes and 88 transcriptomes, 17 generated for this study. We examined gene-tree discordance using coalescent-based species trees and network inference, gene tree discordance analyses, site pattern tests of introgression, topology tests, synteny analyses, and simulations. We found that a combination of processes might have generated the high levels of gene tree discordance in the backbone of Amaranthaceae s.l. Furthermore, we found evidence that three consecutive short internal branches produce anomalous trees contributing to the discordance. Overall, our results suggest that Amaranthaceae s.l. might be a product of an ancient and rapid lineage diversification, and remains, and probably will remain, unresolved. This work highlights the potential problems of identifiability associated with the sources of gene tree discordance including, in particular, phylogenetic network methods. Our results also demonstrate the importance of thoroughly testing for multiple sources of conflict in phylogenomic analyses, especially in the context of ancient, rapid radiations. We provide several recommendations for exploring conflicting signals in such situations.

59 BASIC BIOLOGICAL SCIENCES↗