Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Enhance Low Level Temperature and Moisture Profiles Through Combining NUCAPS, ABI Observations, and RTMA Analysis

Thermodynamic information from low levels in the atmosphere is crucial for operational weather forecasts and meteorological researchers. The NOAA Unique Combined Atmospheric Processing System (NUCAPS) sounding products have been proven beneficial to fill the data gap between synoptic radiosonde observations (RAOBs). However, compared with the upper troposphere, the accuracy of NUCAPS soundings in the low levels still needs improvement. In this study, a deep neural network (DNN) is applied to fuse multiple data sources to enhance the NUCAPS temperature and moisture profiles in the lower atmosphere. The network is developed by combining satellite observations, including NUCAPS sounding retrievals and high resolution geostationary satellite observations from the Advanced Baseline Imager, and surface analysis from the Real-Time Mesoscale Analysis (RTMA) as inputs, while collocated soundings from ECMWF re-analysis version 5 are used as the benchmark for the training. The performance of the model is evaluated by using the independent testing data set, data from a different year, as well as collocated RAOBs, showing improvement to the temperature and moisture profiles by reducing the root-mean-squared-error (RMSE) by more than 30% in the lower atmosphere (from 700 hPa to surface) in both clear sky and partially cloudy conditions. A convective event from June 18, 2017 is presented to illustrate the application of the enhanced low level soundings on high impact weather events. The enhanced soundings from fused data capture the large surface-based convective available potential energy structures in the preconvection environment, which is very useful for severe storm nowcasting and forecasting applications.

54 ENVIRONMENTAL SCIENCES↗

SECARB Project Overview Book

In 2003, the United States Department of Energy (DOE) issued awards initiating seven Regional Carbon Sequestration Partnerships (RCSP) spanning the United States and portions of Canada. Managed by DOE’s National Energy Technology Laboratory (NETL), the RCSPs currently represent more than 400 state agencies, universities, and private companies, spanning 43 states, three Native American Organizations, and four Canadian provinces. The Southern States Energy Board (SSEB) received an award on October 1, 2003, which established the Board’s overall management and administration of the Southeast Regional Carbon Sequestration Partnership, or SECARB. The geographical region currently includes 13 states and a network of more than 100 stakeholders. The Nation’s leading scientists, university researchers, national laboratories, industrial representatives, environmental organizations, and many others have taken a proactive approach at identifying and characterizing the most promising options for technology deployment and carbon dioxide (CO2) utilization and storage (CCUS) for the Southeast. The results obtained during these injections will be important to the future commercialization of CCUS technologies and the continued use of fossil fuels as a significant energy source in a manner that is environmentally responsible. Each of the six SECARB project locations has been locally coordinated by its own field team. The field teams assume responsibility for the technical scope of work, local education and outreach, permitting, monitoring, verification, and accounting (MVA), and maintaining the validation test’s schedule and budget. Each team contributes new information to the continued characterization of the region. In addition, a task is dedicated to integrating field data and filling gaps in regional characterization data sets. Data and tools developed in the Continued Characterization task are incorporated into a relational database and geographic information system (GIS). All field tests, the continued characterization project, and the cross-cutting functions are designed to support the DOE roadmap by validating technologies and identifying locations throughout the region that could support full-scale CCUS deployment opportunities. Detailed fact sheets for the SECARB projects are available on the SECARB website at www.secarbon.org (see “Projects” tab).

RCSP↗

Spatial-temporal event detection in climate parameter imagery.

Previously developed techniques that comprise statistical parametric mapping, with applications focused on human brain imaging, are examined and tested here for new applications in anomaly detection within remotely-sensed imagery. Two approaches to analysis are developed: online, regression-based anomaly detection and conditional differences. These approaches are applied to two example spatial-temporal data sets: data simulated with a Gaussian field deformation approach and weekly NDVI images derived from global satellite coverage. Results indicate that anomalies can be identified in spatial temporal data with the regression-based approach. Additionally, la Nina and el Nino climatic conditions are used as different stimuli applied to the earth and this comparison shows that el Nino conditions lead to significant decreases in NDVI in both the Amazon Basin and in Southern India.

54 ENVIRONMENTAL SCIENCES↗

The ARM Precipitation Best Estimate (PrecipBE) Value-Added Product Report

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) User Facility’s Precipitation Best-Estimate (PrecipBE) Value-Added Product integrates multiple precipitation datastreams, accounting for data quality and instrument limitations, to deliver comprehensive per-precipitation event properties alongside ancillary ARM data set data. PrecipBE bundles all valid surface rainfall samples into artificial intelligence (AI)-ready tabular and time-series formats, reporting bundle means and uncertainty ranges. This per-event structure provides an insightful and easy-to-use resource for researchers analyzing precipitation characteristics.

54 ENVIRONMENTAL SCIENCES↗

Systems and methods for customizing kernel machines with deep neural networks

A method including receiving an input data set. The input data set can include one of a feature domain set or a kernel matrix. The method also can include constructing dense embeddings using: (i) Nyström approximations on the input data set when the input data set comprises the kernel matrix, and (ii) clustered Nyström approximations on the input data set when the input data set comprises the feature domain set. The method additionally can include performing representation learning on each of the dense embeddings using a multi-layer fully-connected network for each of the dense embeddings to generate latent representations corresponding to each of the dense embeddings. The method further can include applying a fusion layer to the latent representations corresponding to the dense embeddings to generate a combined representation. The method additionally can include performing classification on the combined representation. Other embodiments of related systems and methods are also disclosed.

Song, Huan↗

SPRUCE Vegetation Phenology in Experimental Plots from PhenoCam Imagery, 2015-2024

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2025 (2015-08-24 to 2025-03-31), with start- and end-of-season phenological transition dates derived through the end of autumn 2024. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: (1) 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step. • Contains 36 files in *.csv format inside a compressed (*.zip) file. (2) Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e., vegetation type). • Contains one file in *.csv format. (3) Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure. • Contains two files in *.csv format, one for snow on trees and one for snow on ground. This data set consists of two sets of companion files: (1) Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. • Contains three files in HTML format, one for each vegetation type. • One additional file in HTML format with the transition dates plotted for each vegetation type, by year. (2) R files for processing PhenoCam files and flags. • Contains five files in R file(*.R) format and the components of the phenocamr package (Version 1.1.4) used for calculating transition dates for 2015-2024. These are contained in a compressed (*.zip) file. User Note: All imagery is posted in near-real time to the PhenoCam Project web page (https://phenocam.nau.edu), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/sprucecams. This data set is based on the complete camera record from SPRUCE and supersedes all previously released PhenoCam datasets (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

54 ENVIRONMENTAL SCIENCES↗

Non-linear relationships between daily temperature extremes and US agricultural yields uncovered by global gridded meteorological datasets

Global agricultural commodity markets are highly integrated among major producers. Prices are driven by aggregate supply rather than what happens in individual countries in isolation. Furthermore, estimating the effects of weather-induced shocks on production, trade patterns and prices hence requires a globally representative weather data set. Recently, two data sets that provide daily or hourly records, GMFD and ERA5-Land, became available. Starting with the US, a data rich region, we formally test whether these global data sets are as good as more fine-scaled country-specific data in explaining yields and whether they estimate similar response functions. While GMFD and ERA5-Land have lower predictive skill for US corn and soybeans yields than the fine-scaled PRISM data, they still correctly uncover the underlying non-linear temperature relationship. All specifications using daily temperature extremes under any of the weather data sets outperform models that use a quadratic in average temperature. Correctly capturing the effect of daily extremes has a larger effect than the choice of weather data. In a second step, focusing on Sub Saharan Africa, a data sparse region, we confirm that GMFD and ERA5-Land have superior predictive power to CRU, a global weather data set previously employed for modeling climate effects in the region.

54 ENVIRONMENTAL SCIENCES↗

Method for phase retrieval to reduce a sampling requirement when imaging a dynamic process

A method for retrieving phase information in a coherent diffraction imaging process includes acquiring a plurality of 3D data sets, each 3D data set corresponding to one of a plurality of time states, and reconstructing a 3D image of the object at a given time state using the 3D data set from all of the time states. Each 3D data set is acquired by: illuminating an object positioned in a first position with a coherent beam; measuring a first 2D diffraction pattern using an area detector; rotating the object around a tilt axis thereof to a second position that is different from the first position; re-illuminating the object positioned in the second position with the coherent beam; re-measuring a second 2D diffraction pattern using the area detector; and repeating the rotating, re-illuminating and re-measuring steps such that each 3D data set includes a predetermined number of diffraction patterns.

36 MATERIALS SCIENCE↗

Station-based Surface Data Value-Added Product

This report describes the Atmospheric Radiation Measurement (ARM) Best Estimate (ARMBE) station-based surface data (ARMBESTNS) value-added product. It is a twin data product of the ARMBE 2-Dimensional gridded (ARMBE2DGRID) data set. Unlike the ARMBE2DGRID data set, ARMBESTNS data are reported at the original site locations and show the original information (except for the interpolation over time). Therefore, the users have the flexibility to process the data with the approach more suitable for their applications. This document provides information about the input data, quality control (QC) method, and output format of this data set. As much of the information is identical to that of the ARMBE2DGRID data, this document will emphasize more on the different aspects of these two data sets.

97 MATHEMATICS AND COMPUTING↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2022

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2023, with start- and end-of-season phenological transition dates derived through the end of autumn 2022. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step Contains 35 files in *.csv format inside a compressed (*.zip) file. Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e. vegetation type) Contains one file in *.csv format Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure Contains two files in *.csv format, one for snow on trees and one for snow on ground This data set consists of two sets of companion files: Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. Contains three files in HTML format, one for each vegetation type One additional file in HTML format with the transition dates plotted for each vegetation type, by year R files for processing Phenocam files and flags. Contains five files in R file (*.R) format in one compressed (*.zip) file User Note: All imagery is posted in near-real time to the PhenoCam Project web page (http://phenocam.sr.unh.edu/), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/y7z5mau7. The data reported here are based on the complete camera record from SPRUCE and supersedes the previously released phenocam datasets (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

SPRUCE Experiment, Marcell Experimental Forest, Sp↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2023

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2024, with start- and end-of-season phenological transition dates derived through the end of autumn 2023. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: (1) 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step • Contains 36 files in *.csv format inside a compressed (*.zip) file. (2) Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e. vegetation type) • Contains one file in *.csv format (3) Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure • Contains two files in *.csv format, one for snow on trees and one for snow on ground This data set consists of two sets of companion files: (1) Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. • Contains three files in HTML format, one for each vegetation type • One additional file in HTML format with the transition dates plotted for each vegetation type, by year (2) R files for processing Phenocam files and flags. • Contains five files in R file (*.R) format in one compressed (*.zip) file User Note: All imagery is posted in near-real time to the PhenoCam Project web page (http://phenocam.sr.unh.edu/), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/sprucecams. The data reported here are based on the complete camera record from SPRUCE and supersedes the previously released data inclusive of the 2015-2022 data (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

Spruce and Peatland Responses Under Changing Envir↗

Method and apparatus for using an accelerometer signal to detect misfiring in an internal combustion engine

The method comprises operating an engine and collecting a real-time accelerometer signal from an accelerometer sensor. The real-time accelerometer signal is digitized and filtered to isolate data in a frequency range associated with combustion to produce a filtered signal data set. The filtered signal data set is integrated to produce an integrated signal data set, and misfire is detected by comparing the integrated signal data set with a predetermined reference data set associated with the same operating point. The apparatus is a control system for an engine that comprises an accelerometer sensor mounted to the engine; a look-up table in which is stored predetermined reference data sets, in association with predetermined operating conditions; and an electronic controller programmed to carry out the foregoing method.

33 ADVANCED PROPULSION SYSTEMS↗

SPT-GMOS: A GEMINI/GMOS-SOUTH SPECTROSCOPIC SURVEY OF GALAXY CLUSTERS IN THE SPT-SZ SURVEY

We present the results of SPT-GMOS, a spectroscopic survey with the Gemini Multi-Object Spectrograph (GMOS) on Gemini South. The targets of SPT-GMOS are galaxy clusters identified in the SPT-SZ survey, a millimeter-wave survey of 2500 deg{sup 2} of the southern sky using the South Pole Telescope (SPT). Multi-object spectroscopic observations of 62 SPT-selected galaxy clusters were performed between 2011 January and 2015 December, yielding spectra with radial velocity measurements for 2595 sources. We identify 2243 of these sources as galaxies, and 352 as stars. Of the galaxies, we identify 1579 as members of SPT-SZ galaxy clusters. The primary goal of these observations was to obtain spectra of cluster member galaxies to estimate cluster redshifts and velocity dispersions. We describe the full spectroscopic data set and resulting data products, including galaxy redshifts, cluster redshifts, and velocity dispersions, and measurements of several well-known spectral indices for each galaxy: the equivalent width, W , of [O ii] λλ 3727, 3729 and H- δ , and the 4000 Å break strength, D4000. We use the spectral indices to classify galaxies by spectral type (i.e., passive, post-starburst, star-forming), and we match the spectra against photometric catalogs to characterize spectroscopically observed cluster members as a function of brightness (relative to m {sup ⋆}). Finally, we report several new measurements of redshifts for ten bright, strongly lensed background galaxies in the cores of eight galaxy clusters. Combining the SPT-GMOS data set with previous spectroscopic follow-up of SPT-SZ galaxy clusters results in spectroscopic measurements for >100 clusters, or ∼20% of the full SPT-SZ sample.

79 ASTRONOMY AND ASTROPHYSICS↗

Physics-Based GOES Product for Use in NREL's National Solar Radiation Database: Preprint

The Global Solar Insolation Project (GSIP) is an operational physical model from the National Oceanic and Atmospheric Administration (NOAA) that computes global horizontal radiation (GHI) using the visible and infrared channel measurements from geostationary operational environmental satellites (GOES). GSIP uses a two-stage scheme that retrieves cloud properties and uses those properties in the Satellite Algorithm for Surface Radiation Budget (SASRAB) model to calculate surface radiation. The National Renewable Energy Laboratory, University of Wisconsin, and NOAA have recently collaborated to adapt GSIP to create a high-temporal and spatial resolution data set. The data sets are currently being incorporated into the widely used National Solar Radiation Data Base.

14 SOLAR ENERGY↗

Interfractional Reproducibility of Lung Tumor Location Using Various Methods of Respiratory Motion Mitigation

Purpose: To determine interfractional reproducibility of the location of lung tumors using respiratory motion mitigation. Methods and Materials: Free-breathing four-dimensional computed tomography (CT) data sets and CT data sets during breath hold were acquired weekly for 17 patients undergoing treatment for non-small-cell lung cancer. Distances between the center of the gross tumor volume (GTV) and a reproducible bony reference point under conditions of breath hold on end inspiration (EI) and end expiration (EE) and during free breathing on the 0% phase (corresponding to EI) and 50% phase (corresponding to EE) were analyzed for interfractional reproducibility. Systematic uncertainties in tumor location were determined as the difference in distance between the GTV center on the first CT data set and the mean location of GTV centers on the subsequent data sets. Random uncertainties in tumor location were determined as the standard deviation of the distances between the GTV centers and the bony reference points. Margins to account for systematic and random interfractional variations were estimated based on these uncertainties. Results: Mean values of interfractional setup uncertainties were as follows: systematic uncertainties-EI, 0.3 cm; EE, 0.2 cm; 0% phase, 0.3 cm; and 50% phase, 0.3 cm; and random uncertainties-EI, 0.3 cm; EE, 0.3 cm; 0% phase, 0.3 cm; and 50% phase, 0.3 cm. There does not appear to be any correlation between uncertainties and GTV size, but there appears to be a weak positive correlation between uncertainties and the magnitude of GTV excursion. Conclusions: Voluntary breath hold and gating on either EI or EE appear to be equally reliable methods of ensuring the reproducibility of lung tumor position. We recommend setup margins of 0.3 cm if using cone-beam CT or kilovoltage X-ray with fiducials and aligning directly to the tumor and 0.8 cm when aligning to a nearby bony surrogate using cone-beam CT or kilovoltage X-ray.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Improving the Accuracy of Nearest-Neighbor Classification Using Principled Construction and Stochastic Sampling of Training-Set Centroids

A conceptually simple way to classify images is to directly compare test-set data and training-set data. The accuracy of this approach is limited by the method of comparison used, and by the extent to which the training-set data cover configuration space. Here we show that this coverage can be substantially increased using coarse-graining (replacing groups of images by their centroids) and stochastic sampling (using distinct sets of centroids in combination). We use the MNIST and Fashion-MNIST data sets to show that a principled coarse-graining algorithm can convert training images into fewer image centroids without loss of accuracy of classification of test-set images by nearest-neighbor classification. Distinct batches of centroids can be used in combination as a means of stochastically sampling configuration space, and can classify test-set data more accurately than can the unaltered training set. On the MNIST and Fashion-MNIST data sets this approach converts nearest-neighbor classification from a mid-ranking- to an upper-ranking member of the set of classical machine-learning techniques.

97 MATHEMATICS AND COMPUTING↗

Z-checker: A framework for assessing lossy compression of scientific data

Because of the vast volume of data being produced by today’s scientific simulations and experiments, lossy data compressor allowing user-controlled loss of accuracy during the compression is a relevant solution for significantly reducing the data size. However, lossy compressor developers and users are missing a tool to explore the features of scientific data sets and understand the data alteration after compression in a systematic and reliable way. To address this gap, we have designed and implemented a generic framework called Z-checker. On the one hand, Z-checker combines a battery of data analysis components for data compression. On the other hand, Z-checker is implemented as an open-source community tool to which users and developers can contribute and add new analysis components based on their additional analysis demands. In this article, we present a survey of existing lossy compressors. Then, we describe the design framework of Z-checker, in which we integrated evaluation metrics proposed in prior work as well as other analysis tools. Specifically, for lossy compressor developers, Z-checker can be used to characterize critical properties (such as entropy, distribution, power spectrum, principal component analysis, and autocorrelation) of any data set to improve compression strategies. For lossy compression users, Z-checker can detect the compression quality (compression ratio and bit rate) and provide various global distortion analysis comparing the original data with the decompressed data (peak signal-to-noise ratio, normalized mean squared error, rate–distortion, rate-compression error, spectral, distribution, and derivatives) and statistical analysis of the compression error (maximum, minimum, and average error; autocorrelation; and distribution of errors). Z-checker can perform the analysis with either coarse granularity (throughout the whole data set) or fine granularity (by user-defined blocks), such that the users and developers can select the best fit, adaptive compressors for different parts of the data set. Z-checker features a visualization interface displaying all analysis results in addition to some basic views of the data sets such as time series. To the best of our knowledge, Z-checker is the first tool designed to assess lossy compression comprehensively for scientific data sets.

97 MATHEMATICS AND COMPUTING↗

hpMCA: A Python-based Graphical Program for Energy Dispersive X-Ray Diffraction Data Collection and Analysis

Energy-dispersive X-ray diffraction (EDXD) at synchrotron beamlines is commonly used for the study of material properties under high pressure and/or high temperature. Experimenters typically rely on the availability of robust data collection and analysis at a beamline, but this has become increasingly difficult, especially with the introduction of multi-element detectors that generate complex, multi-dimensional data sets. These data sets have energy resolution, and they can also be resolved in relation to sample position, diffraction angle, or different external stimuli. We report a new Python-based graphical program, hpMCA, for EDXD data collection and analysis that streamlines the experimental process for the beamline users. The program features a user-friendly interface, capability for online viewing and analyzing data from multi-element energy-dispersive detectors, and includes features useful for working with samples under high pressure and/or high temperature, such as crystal phase identification, real-time unit cell lattice refinement, and pressure determination based on an equation of state.

data analysis software↗