Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

International Space Station (ISS) Anomalies Trending Study

The NASA Engineering and Safety Center (NESC) set out to utilize data mining and trending techniques to review the anomaly history of the International Space Station (ISS) and provide tools for discipline experts not involved with the ISS Program to search anomaly data to aid in identification of areas that may warrant further investigation. Additionally, the assessment team aimed to develop an approach and skillset for integrating data sets, with the intent of providing an enriched data set for discipline experts to investigate that is easier to navigate, particularly in light of ISS aging and the plan to extend its life into the late 2020s. This report contains the outcome of the NESC Assessment.

Beil, Robert J.↗
DOE OSTI2026

Historical and Future Global Irrigation Energy Consumption by Fuel and Region

Irrigation energy use is a significant component of agricultural production costs, contributing directly to the energy and emissions intensity of crop production and ultimately to food prices. Understanding the existing structure of irrigation energy consumption help achieve food-energy-water security and environmental goals. We present a comprehensive global data set detailing country-level irrigation energy consumption, emphasizing the comparative use of electric, diesel, and emerging solar pumps. To our knowledge, no such data set exists. We draw from a literature review to develop a logistic transformed regression model to estimate the shares of fuel sources for irrigation across countries over historical years to construct a global data set of country-level irrigation energy consumption by multiple fuel sources. Additionally, we compare our estimates of irrigation energy use with agricultural energy use as reported by the International Energy Agency and other external sources. We then use this data to project future irrigation energy use with the Global Change Analysis Model, which is a multisector dynamics model, to showcase the usage of this data set. Projections under the reference scenario show a global shift in fuel types for irrigation pumping, while patterns vary across regions, with India and Pakistan leading in solar-powered irrigation growth and countries like the USA and China continuing to rely primarily on grid electricity. This data set provides a resource to understand the role of irrigation fuel choices within the broader energy sector, as well as the connected agricultural, land use, and water sectors under alternative future scenarios, enabling informed decision making toward efficient agricultural practices.

Global Change Analysis Model (GCAM)↗
DOE OSTI2024

A system identification approach for non-intrusive reduced order modeling of radiation-induced photocurrents

In this study, development of compact photocurrent models is currently dominated by analytical techniques that rely on physical assumptions to render the governing equations solvable in a closed form. Violation of these assumptions can reduce the accuracy of the models and/or limit their scope. In this paper we show that system identification of nonlinear state-space systems can serve as an alternative numerical basis for non-intrusive reduced order modeling of photocurrent effects. To that end we develop a compact gray box photocurrent model (GBPM) by using a state-space representation with a low-dimensional latent state equation that mimics a mathematical model for the response of an idealized class of devices to ionizing radiation. In so doing we obtain a model that learns the dynamics of a quantity of interest directly from its measurements without requiring snapshots of the internal device state or its discretized model, and can be inferred from very small data sets. To demonstrate the approach we train the GBPM using a small experimental data set for a Z5236 Zener diode and a small synthetic data set obtained by simulating a synthetic pn-junction device. We then compare the GBPMs with black box models trained on the same data and show that performance of the latter is limited by the size of the data set, while the former are able to achieve excellent performance in both the reproductive and the predictive regimes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Application of sulfur SAD to small crystals with a large asymmetric unit and anomalous substructure

The application of sulfur single-wavelength anomalous dispersion (S-SAD) to determine the crystal structures of macromolecules can be challenging if the asymmetric unit is large, the crystals are small, the size of the anomalously scattering sulfur structure is large and the resolution at which the anomalous signals can be accurately measured is modest. Here, as a study of such a case, approaches to the SAD phasing of orthorhombic Ric-8A crystals are described. The structure of Ric-8A was published with only a brief description of the phasing process [Zeng et al. (2019), Structure , 27 , 1137–1141]. Here, alternative approaches to determining the 40-atom sulfur substructure of the 103 kDa Ric-8A dimer that composes the asymmetric unit are explored. At the data-collection wavelength of 1.77 Å measured at the Frontier micro-focusing Macromolecular Crystallography (FMX) beamline at National Synchrotron Light Source II, the sulfur anomalous signal strength, |Δ ano |/σΔ ano ( d ′′/sig), approaches 1.4 at 3.4 Å resolution. The highly redundant, 11 000 000-reflection data set measured from 18 crystals was segmented into isomorphous clusters using BLEND in the CCP 4 program suite. Data sets within clusters or sets of clusters were scaled and merged using AIMLESS from CCP 4 or, alternatively, the phenix.scale_and_merge tool from the Phenix suite. The latter proved to be the more effective in extracting anomalous signals. The HySS tool in Phenix , SHELXC / D and PRASA as implemented in the CRANK 2 program suite were each employed to determine the sulfur substructure. All of these approaches were effective, although HySS , as a component of the phenix.autosol tool, required data from all crystals to find the positions of the sulfur atoms. Critical contributors in this case study to successful phase determination by SAD included (i) the high-flux FMX beamline, featuring helical-mode data collection and a helium-filled beam path, (ii) as recognized by many authors, a very highly redundant, multiple-crystal data set and (iii) the inclusion within that data set of data from crystals that were scanned over large ω ranges, yielding highly isomorphous and highly redundant intensity measurements.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2013

Tool for Automated Retrieval of Generic Event Tracks (TARGET)

Methods have been developed to identify and track tornado-producing mesoscale convective systems (MCSs) automatically over the continental United States, in order to facilitate systematic studies of these powerful and often destructive events. Several data sources were combined to ensure event identification accuracy. Records of watches and warnings issued by National Weather Service (NWS), and tornado locations and tracks from the Tornado History Project (THP) were used to locate MCSs in high-resolution precipitation observations and GOES infrared (11-micron) Rapid Scan Operation (RSO) imagery. Thresholds are then applied to the latter two data sets to define MCS events and track their developments. MCSs produce a broad range of severe convective weather events that are significantly affecting the living conditions of the populations exposed to them. Understanding how MCSs grow and develop could help scientists improve their weather prediction models, and also provide tools to decision-makers whose goals are to protect populations and their property. Associating storm cells across frames of remotely sensed images poses a difficult problem because storms evolve, split, and merge. Any storm-tracking method should include the following processes: storm identification, storm tracking, and quantification of storm intensity and activity. The spatiotemporal coordinates of the tracks will enable researchers to obtain other coincident observations to conduct more thorough studies of these events. In addition to their tracked locations, their areal extents, precipitation intensities, and accumulations all as functions of their evolutions in time were also obtained and recorded for these events. All parameters so derived can be catalogued into a moving object database (MODB) for custom queries. The purpose of this software is to provide a generalized, cross-platform, pluggable tool for identifying events within a set of scientific data based upon specified criteria with the possibility of storing identified events into a searchable database. The core of the application uses an implementation of the connected component labeling (CCL) algorithm to identify areas of interest, then uses a set of criteria to establish spatial and temporal relationships between identified components. The CCL algorithm is used for identifying objects within images for computer vision. This application applies it to scientific data sets using arbitrary criteria. The most novel concept was applying a generalized CCL implementation to scientific data sets for establishing events both spatially and temporally. The combination of several existing concepts (pluggable components, generalized CCL algorithm, etc.) into one application is also novel. In addition, how the system is designed, i.e., its extensibility with pluggable components, and its configurability with a simple configuration file, is innovative. This allows the system to be applied to new scenarios with ease.

Clune, Thomas↗
NASA NTRS2005

Aerosol and Cloud Observations and Data Products by the GLAS Polar Orbiting Lidar Instrument

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. The backscatter lidar operates at two wavelengths, 532 and 1064 nm. Both receiver channels meet and exceed their design goals, and beginning with a two month period through October and November 2003, an excellent global lidar data set now exists. The data products for atmospheric observations include the calibrated, attenuated backscatter cross section for cloud and aerosol; height detection for multiple cloud layers; planetary boundary layer height; cirrus and aerosol optical depth and the height distribution of aerosol and cloud scattering cross section profiles. The data sets are now in open release through the NASA data distribution system. The initial results on global statistics for cloud and aerosol distribution has been produced and in some cases compared to other satellite observations. The sensitivity of the cloud measurements is such that the 70% global cloud coverage result should be the most accurate to date. Results on the global distribution of aerosol are the first that produce the true height distribution for model inter-comparison.

Spinhirne, J. D.↗
NASA NTRS1992

Earth observing system. Output data products and input requirements, version 2.0. Volume 3: Algorithm summary tables and non-EOS data products

Volume 3 assists Earth Observing System (EOS) investigators in locating required non-EOS data products by identifying their non-EOS input requirements and providing the information on data sets available at various Distributed Active Archive Centers (DAAC's), including those from Pathfinder Activities and Earth Probes. Volume 3 is intended to complement, not to duplicate, the the EOSDIS Science Data Plan (SDP) by providing detailed data set information which was not presented in the SDP. Section 9 of this volume discusses the algorithm summary tables containing information on retrieval algorithms, expected outputs and required input data. Section 10 describes the non-EOS input requirements of instrument teams and IDS investigators. Also described are the current and future data holdings of the original seven DAACS and data products planned from the future missions and projects including Earth Probes and Pathfinder Activities. Section 11 describes source of information used in compiling data set information presented in this volume. A list of data set attributes used to describe various data sets is presented in section 12 along with their descriptions. Finally, Section 13 presents the SPSO's future plan to improve this report .

Lu, Yun-Chi↗
NASA NTRS1982

Mars' global properties - Maps and applications

Mars data sets from many sources have been put into a common digital format and global maps at constant scale have been produced. These formatted data sets form the basis of the Mars Consortium. They currently include maps of geology, volcanic units, channels, wind features, topography, gravity, Viking approach and apoapsis color, predawn temperature residuals, thermal inertia, radiometric and solar albedo, water vapor abundance, 1.4 micrometers albedo, crater abundance, Earth-based radar and photographic telescope observations, and terrestrial spectral observations. The generation of these data sets is briefly described. As an example of their use, the mapped geologic units are characterized in terms of color, predawn temperature and elevation, and unusual areas identified. The Oxia Palus region is examined as an example of combining higher resolution data with the Consortium data sets. Use of the existing data sets and submission of new ones are encouraged.

Kieffer, H. H.↗
NASA NTRS2012

A Technique Using Principal Component Analysis to Compare Seasonal Cycles of Earth Radiation from CERES and Model Computations

A method for quantitatively comparing the seasonal cycles of two global data sets is presented. The seasonal cycles of absorbed solar radiation (ASR) and outgoing longwave radiation (OLR) have been computed from an eight-year data set from the Clouds and Earth's Radiant Energy System (CERES) scanning radiometers and from a model data set produced by the NASA Goddard Space Flight Center Global Modeling and Assimilation Office. To compare the seasonal cycles from these two data sets, principal component (PC) analysis is used, where the PCs express the time variations and the corresponding empirical orthogonal functions (EOFs) describe the geographic variations. Ocean has a long thermal response time compared to land, so land and ocean are separated for the analysis. The root-mean square values for the seasonal cycles of ASR and OLR are extremely close for the two data sets. The first three PCs are quite close, showing that the time responses and magnitudes over the globe are very similar. The agreement between the two sets of PCs is quantified by computing the matrix of inner products of the two sets. For ASR over land, the first PCs of CERES and the model agree to better than 99.9%. The EOF maps are similar for most of the globe, but differ in a few places, and the agreement of the EOF maps is likewise quantified. Maps of differences between the annual cycles show regions of agreement and disagreement.

Smith, G. Louis↗
DOE OSTI2021

SPRUCE Ground Observations of Phenology in Experimental Plots, 2020

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2020, the fifth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2020 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) format containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2020. User note: Ground observations of phenology from 2016-2021 are available. SPRUCE Ground Observations of Phenology in Experimental Plots 2021, https://doi.org/10.25581/spruce.099/1874936 for the most recent data as well as links to all other ground phenology datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains

In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target dataset. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here we employ domain adaptation techniques— Maximum Mean Discrepancy (MMD) as an additional transfer loss and Domain Adversarial Neural Networks (DANNs)— and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated datasets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to ~20%. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

galaxies: interactions↗
DOE OSTI2022

SPRUCE Ground Observations of Phenology in Experimental Plots, 2021

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2021, the sixth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2021 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) format containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2021. User note: Ground observations of phenology from 2016-2020 are available. See the user guide for links to all other ground phenology datasets.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

Graphics Processing Unit Assisted Thermographic Compositing

Objective: To develop a software application utilizing general purpose graphics processing units (GPUs) for the analysis of large sets of thermographic data. Background: Over the past few years, an increasing effort among scientists and engineers to utilize the GPU in a more general purpose fashion is allowing for supercomputer level results at individual workstations. As data sets grow, the methods to work them grow at an equal, and often great, pace. Certain common computations can take advantage of the massively parallel and optimized hardware constructs of the GPU to allow for throughput that was previously reserved for compute clusters. These common computations have high degrees of data parallelism, that is, they are the same computation applied to a large set of data where the result does not depend on other data elements. Signal (image) processing is one area were GPUs are being used to greatly increase the performance of certain algorithms and analysis techniques. Technical Methodology/Approach: Apply massively parallel algorithms and data structures to the specific analysis requirements presented when working with thermographic data sets.

Ragasa, Scott↗
NASA NTRS1986

ISCCP reduced resolution satellite radiance data

The International Satellite Cloud Climatology Project (ISCCP) is the first active project of the World Climate Research Program. It is a multinational data collection project focused on collecting a data set that will improve the ability to predict and/or simulate the radiative effects of clouds on climate. For specified cloud parameters, the goals are to archieve values for 3-hour periods over the whole globe for 5 years at 30 km resolution. The task of collecting and processing radiance data from both geosynchronous and polar orbiting satellites began in July 1983. A diagram was shown illustrating the flow of data from the transmitting satellites to the various receiving institutions that handle it. The various stages of processing were then explained in detail, emphasizing Level B3-normalized, reformatted, reduced raw satellite data. The reduction of data by sampling is an essential step in the flow. By the time the ISCCP data reaches the Global Processing Center at Goddard Institute for Space Studies (GISS), the volume has been reduced by a factor of 1000. The Pilot Climate Data System (PLDS) will provide access to the ISCCP data set. It should prove to be one of the cleanest satellite data sets because it will have been through three filters--that of the operational agency, the Global Processing Center, and the PCDS. The ISCCP data set also includes other correlative data sets delivered in compatible format.

Rossow, W.↗
NASA NTRS2011

Determining the Completeness of the Nimbus Meteorological Data Archive

NASA launched the Nimbus series of meteorological satellites in the 1960s and 70s. These satellites carried instruments for making observations of the Earth in the visible, infrared, ultraviolet, and microwave wavelengths. The original data archive consisted of a combination of digital data written to 7-track computer tapes and on various film media. Many of these data sets are now being migrated from the old media to the GES DISC modern online archive. The process involves recovering the digital data files from tape as well as scanning images of the data from film strips. Some of the challenges of archiving the Nimbus data include the lack of any metadata from these old data sets. Metadata standards and self-describing data files did not exist at that time, and files were written on now obsolete hardware systems and outdated file formats. This requires creating metadata by reading the contents of the old data files. Some digital data files were corrupted over time, or were possibly improperly copied at the time of creation. Thus there are data gaps in the collections. The film strips were stored in boxes and are now being scanned as JPEG-2000 images. The only information describing these images is what was written on them when they were originally created, and sometimes this information is incomplete or missing. We have the ability to cross-reference the scanned images against the digital data files to determine which of these best represents the data set from the various missions, or to see how complete the data sets are. In this presentation we compared data files and scanned images from the Nimbus-2 High-Resolution Infrared Radiometer (HRIR) for September 1966 to determine whether the data and images are properly archived with correct metadata.

Johnson, James↗
DOE OSTI2023

SPRUCE Ground Observations of Phenology in Experimental Plots, 2022

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2022 (2022-03-28 to 2021-11-17), the seventh full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2022 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2022.

SPRUCE experiment, plant phenological phases, Spru↗
DOE OSTI2024

SPRUCE Ground Observations of Phenology in Experimental Plots, 2023

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2023 (2023-03-30 to 2023-11-29), the eighth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2023 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2023.

Marcell Experimental Forest↗
DOE OSTI2025

SPRUCE Ground Observations of Phenology in Experimental Plots, 2024

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2024 (2025-03-06 to 2025-11-21), the ninth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2024 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2024.

54 ENVIRONMENTAL SCIENCES↗