Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

An Assessment of New Satellite Data Products for the Development of a Long-Term Global Solar Resource at 10-100 km

A project representing an effort to reprocess the NASA based solar resource data sets is reviewed. The effort represented a collaboration between NASA, NOAA, NREL and the SUNY-Albany and aimed to deliver a 10 km resolution, 3-hourly data set spanning from 1983 through near-present. Part of the project was to transition project capability to NREL for annual processing to extend data set. Due to delays in the key input project called ISCCP, we evaluate only Beta versions of this data set and also introduce the potential use of another NASA Langley based cloud data set for the CERES project. The CERES project uses these cloud properties to compute global top-of-atmosphere and surface fluxes at the 1x1 degree resolution. Here, we also briefly discuss these data sets in potential usage for solar resource benchmarking.

14 SOLAR ENERGY↗

Phase-weighted slant stacking for surface wave dispersion measurement

SUMMARY Surface wave retrieval from ambient noise records using seismic interferometry techniques has been widely used for multiscale shear wave velocity (Vs) imaging. One key step during Vs imaging is the generation of dispersion spectra and the extraction of a reliable dispersion curve from the retrieved surface waves. However, the sparse array geometry usually affects the ability for high-frequency (>1 Hz) seismic signals’ acquisition. Dispersion measurements are degraded by array response due to sparse sampling and often present smeared dispersion spectra with sidelobe artefacts. Previous studies usually focus on interferograms’ domain (e.g. cross-correlation function) and attempt to enhance coherent signals before dispersion measurement. We propose an alternative technique to explicitly deblur dispersion spectra through use of a phase-weighted slant-stacking algorithm. Numerical examples demonstrate the strength of the proposed technique to attenuate array responses as well as incoherent noise. Three different field examples prove the flexibility and superiority of the proposed technique: the first data set consists of ambient noise records acquired using a nodal seismometer array; the second data set utilizes distributed acoustic sensing (DAS) and a marine fibre-optic cable to acquire a similar ambient noise data set; the last data set is a vibrator-based active-source surface wave data. The enhanced dispersion measurements provide cleaner and higher-resolution spectra without distortions which will assist both human interpreters as well as ML algorithms in efficiently picking curves for subsequent Vs inversion.

58 GEOSCIENCES↗

Nonparametric estimators for incomplete surveys

Nonparametric estimators, such as the 1/V{sub max} estimator and the C{sup −} estimator, have been applied extensively to estimate luminosity functions (LFs) of astronomical sources from complete, truncated survey data sets. Application of such estimators to incomplete data sets typically requires further truncation of data, separation into subsets of constant completeness, and/or correction for incompleteness-induced bias. In this paper, we derive generalizations of the above estimators designed for use with incomplete, truncated data sets. We compare these generalized nonparametric estimators, investigate some of their simple statistical properties, and validate them using Monte Carlo simulation methods. We apply a nonparametric estimator to data obtained from the extended Baryon Oscillation Spectroscopic Survey to estimate the QSO LF for redshifts 0.68<z<4.

79 ASTRONOMY AND ASTROPHYSICS↗

Chandra and very large array observations of the nearby Sd galaxy NGC 45

We present an analysis of high angular resolution observations made in the X-ray and the radio with the Chandra X-ray Observatory and the Karl Jansky Very Large Array (VLA), respectively, of the nearby spiral galaxy NGC 45. This galaxy is the third that we have considered in a study of the supernova remnant (SNR) populations of nearby spiral galaxies and the present work represents the first detailed analysis of the discrete X-ray and radio source populations of this galaxy. We analyzed data sets from the three pointed observations made of this galaxy with Chandra along with a merged data set obtained from combining these data sets: the total effective exposure time of the merged data set is 63515 s. A total of 25 discrete X-ray sources are found in the entire field of view of the ACIS-S3 chip, with 16 sources found within the visual extent of the galaxy. We estimate that as many as half of the sources detected in the entire field of view of the ACIS-S3 chip and seven of the sources detected in the optical extent of NGC 45 may be background sources. We analyzed the spectral properties of the discrete X-ray sources within the galaxy and conclude that the majority of these sources are X-ray binaries. We have searched for counterparts at different wavelengths to the discrete X-ray sources and we find two associations: one with a star cluster and the other with a background galaxy. We have found one source that is clearly variable within one observation and seven that are seen to vary from one observation to another. We also conduct a photometric analysis to determine the near-infrared fluxes of the discrete X-ray sources in Spitzer Infrared Array Camera channels. We constructed a cumulative luminosity function of the discrete X-ray sources seen toward NGC 45: taking into account simultaneously the luminosity function of background sources, the fitted slope of the cumulative luminosity function Γ = –1.3{sub −1.6}{sup +0.7} (all error bounds correspond to 90% confidence intervals). The VLA observations reveal seven discrete radio sources: we find no overlaps between these sources and the X-ray detected sources. Based on their measured spectral indices and their locations with respect to the visible extent of NGC 45, we classify one source as a candidate radio SNR associated with the galaxy and the others as likely background galaxies seen in projection toward NGC 45. Finally, we discuss the properties of a background cluster of galaxies (denoted as CXOU J001354.2–231254.7) seen in projection toward NGC 45 and detected by the Chandra observations. The fit parameters to the extracted Chandra spectra of this cluster are a column density N{sub H} = 0.07(<0.14) × 10{sup 22} cm{sup −2}, a temperature kT = 4.22{sub −1.42}{sup +2.08} keV, an abundance Z = 0.30(<0.75) relative to solar and a redshift z = 0.28 ± 0.14. From the fit parameters we derive an electron number density n{sub e} = 4(±1) × 10{sup −3} cm{sup −3}, an unabsorbed X-ray luminosity L{sub 0.5−7.0 keV} ∼ 8.77(±0.96) × 10{sup 43} erg s{sup −1} for the cluster and an X-ray emitting mass M = 2.32(±1.75) × 10{sup 12} M{sub ⊙}.

79 ASTRONOMY AND ASTROPHYSICS↗

A search for anisotropy in the arrival directions of ultra high energy cosmic rays recorded at the Pierre Auger Observatory

Observations of cosmic ray arrival directions made with the Pierre Auger Observatory have previously provided evidence of anisotropy at the 99% CL using the correlation of ultra high energy cosmic rays (UHECRs) with objects drawn from the Véron-Cetty Véron catalog. In this paper we report on the use of three catalog independent methods to search for anisotropy. The 2pt–L, 2pt+ and 3pt methods, each giving a different measure of self-clustering in arrival directions, were tested on mock cosmic ray data sets to study the impacts of sample size and magnetic smearing on their results, accounting for both angular and energy resolutions. If the sources of UHECRs follow the same large scale structure as ordinary galaxies in the local Universe and if UHECRs are deflected no more than a few degrees, a study of mock maps suggests that these three methods can efficiently respond to the resulting anisotropy with a P-value = 1.0% or smaller with data sets as few as 100 events. Using data taken from January 1, 2004 to July 31, 2010 we examined the 20,30,...,110 highest energy events with a corresponding minimum energy threshold of about 49.3 EeV. The minimum P-values found were 13.5% using the 2pt-L method, 1.0% using the 2pt+ method and 1.1% using the 3pt method for the highest 100 energy events. In view of the multiple (correlated) scans performed on the data set, these catalog-independent methods do not yield strong evidence of anisotropy in the highest energy cosmic rays.

79 ASTRONOMY AND ASTROPHYSICS↗

HEP Science Network Requirements--Final Report

The Energy Sciences Network (ESnet) is the primary provider of network connectivity for the US Department of Energy Office of Science, the single largest supporter of basic research in the physical sciences in the United States. In support of the Office of Science programs, ESnet regularly updates and refreshes its understanding of the networking requirements of the instruments, facilities, scientists, and science programs that it serves. This focus has helped ESnet to be a highly successful enabler of scientific discovery for over 20 years. In August 2009 ESnet and the Office of High Energy Physics (HEP), of the DOE Office of Science, organized a workshop to characterize the networking requirements of the programs funded by HEP. The International HEP community has been a leader in data intensive science from the beginning. HEP data sets have historically been the largest of all scientific data sets, and the communty of interest the most distributed. The HEP community was also the first to embrace Grid technologies. The requirements identified at the workshop are summarized below, and described in more detail in the case studies and the Findings section: (1) There will be more LHC Tier-3 sites than orginally thought, and likely more Tier-2 to Tier-2 traffic than was envisioned. It it not yet known what the impact of this will be on ESnet, but we will need to keep an eye on this traffic. (2) The LHC Tier-1 sites (BNL and FNAL) predict the need for 40-50 Gbps of data movement capacity in 2-5 years, and 100-200 Gbps in 5-10 years for HEP program related traffic. Other key HEP sites include LHC Tier-2 and Tier-3 sites, many of which are located at universities. To support the LHC, ESnet must continue its collaborations with university and international networks. (3) While in all cases the deployed 'raw' network bandwidth must exceed the user requirements in order to meet the data transfer and reliability requirements, network engineering for trans-Atlantic connectivity is more complex than network engineering for intra-US connectivity. This is because transoceanic circuits have lower reliability and longer repair times when compared with land-based circuits. Therefore, trans-Atlantic connectivity requires greater deployed bandwidth and diversity to ensure reliability and service continuity of the user-level required data transfer rates. (4) Trans-Atlantic traffic load and patterns must be monitored, and projections adjusted if necessary. There is currently a shutdown planned for the LHC in 2012 that may affect projections of trans-Atlantic bandwidth requirements. (5) There is a significant need for network tuning and troubleshooting during the establishment of new LHC Tier-2 and Tier-3 facilities. ESnet will work with the HEP community to help new sites effectively use the network. (6) SLAC is building the CCD camera for the LSST. This project will require significant bandwidth (up to 30Gbps) to NCSA over the next few years. (7) The accelerator modeling program at SLAC could require the movement of 1PB simulation data sets from the Leadership Computing Facilities at Argonne and Oak Ridge to SLAC. The data sets would need to be moved overnight, and moving 1PB in eight hours requires more than 300Gbps of throughput. This requirement is dependent on the deployment of analysis capabilities at SLAC, and is about five years away. (8) It is difficult to achieve high data transfer throughput to sites in China. Projects that need to transfer data in or out of China are encouraged to deploy test and measurement infrastructure (e.g. perfSONAR) and allow time for performance tuning.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

QuantumScents: Quantum-Mechanical Properties for 3.5k Olfactory Molecules

Quantitative structure–odor relationships are critically important for studies related to the function of olfaction. Current literature data sets contain expert-labeled molecules but lack feature data. This paper introduces QuantumScents, a quantum mechanics augmented derivative of the Leffingwell data set. QuantumScents contains 3.5k structurally and chemically diverse molecules ranging from 2 to 30 heavy atoms (CNOS) and their corresponding 3D coordinates, total PBE0 energy, molecular dipole moment, and per-atom Hirshfeld charges, dipoles, and ratios. The authors demonstrate that Hirshfeld charges and ratios contain sufficient information to perform molecular classification by training a Message Passing Neural Network with chemprop (Heid, E.; et al. ChemRxiv, 2023, DOI: 10.26434/chemrxiv-2023-3zcfl) to predict scent labels. Finally, the QuantumScents data set is freely available on Zenodo along with the authors’ code, example models, and data set generation workflow (https://zenodo.org/doi/10.5281/zenodo.8239853).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ARM Aerial Facility (AAF) Merged Value-Added Product Report for Historical G-1 Field Campaigns

For 30 years, the U.S. Department of Energy (DOE) Office of Science supported an instrumented Grumman Gulfstream-1 (G-1) aircraft for atmospheric field campaigns. Data from the final decade of G-1 operations were archived by the Atmospheric Radiation Measurement (ARM) user facility Data Center (ADC) and made publicly available at no cost to all registered users. To ensure a consistent data format and to improve the accessibility of the ARM airborne data, an integrated data set was recently developed covering the final six years of G-1 operations (2013 to 2018). The integrated data set includes data collected from 236 flights (766.4 hours). Four of the seven field campaigns were based in the U.S. One campaign collected data from the wildfires in the U.S. Pacific Northwest and agricultural burns in the lower Mississippi River valley as part of the Biomass Burning Observation Project (BBOP) in 2013. In 2015, the ARM Cloud Aerosol Precipitation Experiment provided data on atmospheric rivers and associated aerosol-cloud interactions that produce heavy precipitation on the U.S. west coast during the early spring. Research data from Airborne Carbon Measurements-V (ACME-V), collected during the summer of 2015, gave scientists insight into trends and variability of trace gases in the atmosphere over the North Slope of Alaska to improve arctic climate models. In the early summer and autumn of 2016, the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign provided an extensive data set geared toward coupled processes that affect the life cycle of shallow clouds through the interaction among aerosol, cloud, land surface, and ecosystems. In 2014 (March and October), the airborne sampling moved outside of the U.S. to the city of Manaus in central Amazonia, Brazil, where residential and industrial emissions were extensively characterized by flights of the G-1. The GoAmazon2014/15 aircraft campaign data are being integrated with aquatic and terrestrial ecosystem measurements to quantify anthropogenic perturbations to a usually pristine tropical environment. Another international airborne mission was carried out in the Eastern North Atlantic region. The Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) campaign saw the G-1 aircraft fly from Terceira Island in the Azores during the summer of 2017 and the winter of 2018. The campaign studied both seasons to measure key aerosol and cloud processes under various meteorological and cloud conditions with different aerosol sources. Then the G-1 deployed to the Sierras de Córdoba range in central Argentina from October to November 2018 for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) campaign to study orographic convective cloud interactions with their surrounding environment. These comprehensive datastreams provide much-needed insight into spatiotemporal variability of thermodynamic quantities, aerosol and cloud states, and properties for addressing essential science questions in Earth system process studies.

54 ENVIRONMENTAL SCIENCES↗

ARM Aerial Facility (AAF) Merged Value-Added Product Report for Historical G-1 Field Campaigns

For 30 years, the U.S. Department of Energy (DOE) Office of Science supported an instrumented Grumman Gulfstream-1 (G-1) aircraft for atmospheric field campaigns. Data from the final decade of G-1 operations were archived by the Atmospheric Radiation Measurement (ARM) user facility Data Center (ADC) and made publicly available at no cost to all registered users. To ensure a consistent data format and to improve the accessibility of the ARM airborne data, an integrated data set was recently developed covering the final six years of G-1 operations (2013 to 2018). The integrated data set includes data collected from 236 flights (766.4 hours). Four of the seven field campaigns were based in the U.S. One campaign collected data from the wildfires in the U.S. Pacific Northwest and agricultural burns in the lower Mississippi River valley as part of the Biomass Burning Observation Project (BBOP) in 2013. In 2015, the ARM Cloud Aerosol Precipitation Experiment provided data on atmospheric rivers and associated aerosol-cloud interactions that produce heavy precipitation on the U.S. west coast during the early spring. Research data from Airborne Carbon Measurements-V (ACME-V), collected during the summer of 2015, gave scientists insight into trends and variability of trace gases in the atmosphere over the North Slope of Alaska to improve arctic climate models. In the early summer and autumn of 2016, the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign provided an extensive data set geared toward coupled processes that affect the life cycle of shallow clouds through the interaction among aerosol, cloud, land surface, and ecosystems. In 2014 (March and October), the airborne sampling moved outside of the U.S. to the city of Manaus in central Amazonia, Brazil, where residential and industrial emissions were extensively characterized by flights of the G-1. The GoAmazon2014/15 aircraft campaign data are being integrated with aquatic and terrestrial ecosystem measurements to quantify anthropogenic perturbations to a usually pristine tropical environment. Another international airborne mission was carried out in the Eastern North Atlantic region. The Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) campaign saw the G-1 aircraft fly from Terceira Island in the Azores during the summer of 2017 and the winter of 2018. The campaign studied both seasons to measure key aerosol and cloud processes under various meteorological and cloud conditions with different aerosol sources. Then the G-1 deployed to the Sierras de Córdoba range in central Argentina from October to November 2018 for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) campaign to study orographic convective cloud interactions with their surrounding environment. These comprehensive datastreams provide much-needed insight into spatiotemporal variability of thermodynamic quantities, aerosol and cloud states, and properties for addressing essential science questions in Earth system process studies.

54 ENVIRONMENTAL SCIENCES↗

COMBIgor: Data-Analysis Package for Combinatorial Materials Science

Combinatorial experiments involve synthesis of sample libraries with lateral composition gradients requiring spatially-resolved characterization of structure and properties. Here, due to maturation of combinatorial methods and their successful application in many fields, the modern combinatorial laboratory produces diverse and complex data sets requiring advanced analysis and visualization techniques. In order to utilize these large data sets to uncover new knowledge, the combinatorial scientist must engage in data science. For data science tasks, most laboratories adopt common-purpose data management and visualization software. However, processing and cross-correlating data from various measurement tools is no small task for such generic programs. Here we describe COMBIgor, a purpose-built open-source software package written in the commercial Igor Pro environment, designed to offer a systematic approach to loading, storing, processing, and visualizing combinatorial data sets. It includes (1) methods for loading and storing data sets from combinatorial libraries, (2) routines for streamlined data processing, and (3) data analysis and visualization features to construct figures. Most importantly, COMBIgor is designed to be easily customized by a laboratory, group, or individual in order to integrate additional instruments and data-processing algorithms. Utilizing the capabilities of COMBIgor can significantly reduce the burden of data management on the combinatorial scientist.

97 MATHEMATICS AND COMPUTING↗

Evaluation of the National Solar Radiation Database (NSRDB): 1998-2015

This paper validates the performance of the physics-based Physical Solar Model (PSM) data set in the National Solar Radiation Data Base (NSRDB) to quantify the accuracy of the magnitude and the spatial and temporal variability of the solar radiation data. Achieving higher penetrations of solar energy on the electric grid and reducing integration costs requires accurate knowledge of the available solar resource. Understanding the impacts of clouds and other meteorological constituents on the solar resource and quantifying intra-/inter-hour, seasonal, and interannual variability are essential for accurately designing utility-scale solar energy projects. Solar resource information can be obtained from ground-based measurement stations and/or from modeled data sets. The availability of measurements is scarce, both temporally and spatially, because it is expensive to maintain a high-density solar radiation measurement network that collects good quality data for long periods of time. On the other hand, high temporal and spatial resolution gridded satellite data can be used to estimate surface radiation for long periods of time and is extremely useful for solar energy development. Because of the advantages of satellite-based solar resource assessment, the National Renewable Energy Laboratory developed the PSM. The PSM produced gridded solar irradiance -- global horizontal irradiance (GHI), direct normal irradiance (DNI), and diffuse horizontal irradiance -- for the NSRDB at a 4-km by 4-km spatial resolution and half-hourly temporal resolution covering the 18 years from 1998-2015. The NSRDB also contains additional ancillary meteorological data sets, such as temperature, relative humidity, surface pressure, dew point, and wind speed. Details of the model and data are available at https://nsrdb.nrel.gov. The results described in this paper show that the hourly-averaged satellite-derived data have a systematic (bias) error of approximately +5% for GHI and less than +10% for DNI; however, the scatter (root mean square error [RMSE]) difference is higher for the hourly averages.

14 SOLAR ENERGY↗

Evaluation of the National Solar Radiation Database (NSRDB): 1998-2015

This paper validates the performance of the physics-based Physical Solar Model (PSM) data set in the National Solar Radiation Data Base (NSRDB) to quantify the accuracy of the magnitude and the spatial and temporal variability of the solar radiation data. Achieving higher penetrations of solar energy on the electric grid and reducing integration costs requires accurate knowledge of the available solar resource. Understanding the impacts of clouds and other meteorological constituents on the solar resource and quantifying intra-/inter-hour, seasonal, and interannual variability are essential for accurately designing utility-scale solar energy projects. Solar resource information can be obtained from ground-based measurement stations and/or from modeled data sets. The availability of measurements is scarce, both temporally and spatially, because it is expensive to maintain a high-density solar radiation measurement network that collects good quality data for long periods of time. On the other hand, high temporal and spatial resolution gridded satellite data can be used to estimate surface radiation for long periods of time and is extremely useful for solar energy development. Because of the advantages of satellite-based solar resource assessment, the National Renewable Energy Laboratory developed the PSM. The PSM produced gridded solar irradiance -- global horizontal irradiance (GHI), direct normal irradiance (DNI), and diffuse horizontal irradiance -- for the NSRDB at a 4-km by 4-km spatial resolution and half-hourly temporal resolution covering the 18 years from 1998-2015. The NSRDB also contains additional ancillary meteorological data sets, such as temperature, relative humidity, surface pressure, dew point, and wind speed. Details of the model and data are available at https://nsrdb.nrel.gov. The results described in this paper show that the hourly-averaged satellite-derived data have a systematic (bias) error of approximately +5% for GHI and less than +10% for DNI; however, the scatter (root mean square error [RMSE]) difference is higher for the hourly averages.

14 SOLAR ENERGY↗

Serial crystallography with multi-stage merging of thousands of images

KAMO and BLEND provide particularly effective tools to automatically manage the merging of large numbers of data sets from serial crystallography. The requirement for manual intervention in the process can be reduced by extending BLEND to support additional clustering options such as the use of more accurate cell distance metrics and the use of reflection-intensity correlation coefficients to infer `distances' among sets of reflections. This increases the sensitivity to differences in unit-cell parameters and allows clustering to assemble nearly complete data sets on the basis of intensity or amplitude differences. If the data sets are already sufficiently complete to permit it, one applies KAMO once and clusters the data using intensities only. When starting from incomplete data sets, one applies KAMO twice, first using unit-cell parameters. In this step, either the simple cell vector distance of the original BLEND or the more sensitive NCDist is used. This step tends to find clusters of sufficient size such that, when merged, each cluster is sufficiently complete to allow reflection intensities or amplitudes to be compared. One then uses KAMO again using the correlation between reflections with a common hkl to merge clusters in a way that is sensitive to structural differences that may not have perturbed the unit-cell parameters sufficiently to make meaningful clusters. Many groups have developed effective clustering algorithms that use a measurable physical parameter from each diffraction still or wedge to cluster the data into categories which then can be merged, one hopes, to yield the electron density from a single protein form. Since these physical parameters are often largely independent of one another, it should be possible to greatly improve the efficacy of data-clustering software by using a multi-stage partitioning strategy. Here, one possible approach to multi-stage data clustering is demonstrated. The strategy is to use unit-cell clustering until the merged data are sufficiently complete and then to use intensity-based clustering. Using this strategy, it is demonstrated that it is possible to accurately cluster data sets from crystals that have subtle differences.

36 MATERIALS SCIENCE↗

Evapotranspiration in Northern Eurasia: Impact of forcing uncertainties on terrestrial ecosystem model estimates

Abstract The ecosystems in Northern Eurasia (NE) play an important role in the global water cycle and the climate system. While evapotranspiration (ET) is a critical variable to understand this role, ET over this region remains largely unstudied. Using an improved version of the Terrestrial Ecosystem Model with five widely used forcing data sets, we examine the impact that uncertainties in climate forcing data have on the magnitude, variability, and dominant climatic drivers of ET for the period 1979–2008. Estimates of regional average ET vary in the range of 241.4–335.7 mm yr −1 depending on the choice of forcing data. This range corresponds to as much as 32% of the mean ET. Meanwhile, the spatial patterns of long‐term average ET across NE are generally consistent for all forcing data sets. Our ET estimates in NE are largely affected by uncertainties in precipitation ( P ), air temperature ( T ), incoming shortwave radiation ( R ), and vapor pressure deficit (VPD). During the growing season, the correlations between ET and each forcing variable indicate that T is the dominant factor in the north and P in the south. Unsurprisingly, the uncertainties in climate forcing data propagate as well to estimates of the volume of water available for runoff (here defined as P‐ET). While the Climate Research Unit data set is overall the best choice of forcing data in NE according to our assessment, the quality of these forcing data sets remains a major challenge to accurately quantify the regional water balance in NE.

Liu, Yaling↗