Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

A Comparative Analysis between GIMSS NDVIg and NDVI3g for Monitoring Vegetation Activity Change in the Northern Hemisphere during 1982-2008

The long-term Normalized Difference Vegetation Index (NDVI) time-series data set generated from the Advanced Very High Resolution Radiometers (AVHRR) has been widely used to monitor vegetation activity change. The third version of NDVI (NDVI3g) produced by the Global Inventory Modeling and Mapping Studies (GIMMS) group was released recently. The comparisons between the new and old versions should be conducted for linking existing studies with future applications of NDVI3g in monitoring vegetation activity change. Based on simple and piecewise linear regression methods, this research made a comparative analysis between NDVIg and NDVI3g for monitoring vegetation activity change and its responses to climate change in the middle and high latitudes of the Northern Hemisphere during 1982–2008. Our results indicated that there were large differences between NDVIg and NDVI3g in the spatial patterns for both the overall changing trends and the timing of Turning Points (TP) in NDVI time series, which spread over almost the entire study region. The average NDVI trend from NDVI3g was almost twice as great as that from NDVIg and the detected average timing of TP from NDVI3g was about one year later. Although the general spatial patterns were consistent between two data sets for detecting the responses of growing-season NDVI to temperature and precipitation changes, there were large differences in the response magnitude, with a higher response magnitude to temperature in NDVI3g and an opposite response to precipitation change for the two data sets. Finally, these results demonstrated that the NDVIg data set may underestimate the vegetation activity change trend and its response to climate change in the middle and high latitudes of the Northern Hemisphere during the past three decades.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Comparing Satellite- and Ground-Based Observations of Cloud Occurrence Over High Southern Latitudes

The 2B-CLDCLASS-LIDAR R05 (2BCL5) and the raDAR/liDAR (DARDAR) satellite retrievals of cloud occurrence are compared as a function of altitude and latitude. The largest disparities are observed at low altitudes over high southern latitudes. These data sets are cross referenced to ground-based measurements from the Atmospheric Radiation Measurement (ARM) West Antarctic Radiation Experiment (AWARE) campaign at McMurdo Station, Antarctica. Compared with AWARE observations, both 2BCL5 and DARDAR underestimate cloud occurrence below 1.5 km, with 2BCL5 and DARDAR distinguishing roughly one third of cloud occurrences observed by AWARE at 0.5 km. While DARDAR identifies greater cloud occurrences than 2BCL5 below 1.5 km, cloud occurrence values for the two data sets have similar differences relative to ground-based measurements. Therefore, the DARDAR retrievals of greater cloud occurrence at low altitudes are likely due to a larger quantity of false positives associated with radar ground clutter or attenuated lidar retrievals. DARDAR cloud occurrences match better with AWARE than 2BCL5 above 5 km. However, the likely underestimation of ground-based measurements at higher altitudes suggests DARDAR may underestimate high level cloud occurrence. Finally, both data sets indicate the presence of liquid containing clouds at temperatures within the homogeneous freezing regime, despite the fact that the ECMWF-AUX data set implemented in their processing clearly indicates temperatures below -38°C. Finally, using AWARE radiosonde (ECMWF-AUX) temperature data, we find that 2BCL5 detects 13.3% (13.8%) of mixed phase clouds below -38°C, while DARDAR detects 5.7% (6.6%) of mixed phase and 1.1% (1.3%) of liquid phase clouds below -38°C.

54 ENVIRONMENTAL SCIENCES↗

A BLIND METHOD TO DETREND INSTRUMENTAL SYSTEMATICS IN EXOPLANETARY LIGHT CURVES

The study of the atmospheres of transiting exoplanets requires a photometric precision, and repeatability, of one part in ∼10{sup 4}. This is beyond the original calibration plans of current observatories, hence the necessity to disentangle the instrumental systematics from the astrophysical signals in raw data sets. Most methods used in the literature are based on an approximate instrument model. The choice of parameters of the model and their functional forms can sometimes be subjective, causing controversies in the literature. Recently, Morello et al. (2014, 2015) have developed a non-parametric detrending method that gave coherent and repeatable results when applied to Spitzer/IRAC data sets that were debated in the literature. Said method is based on independent component analysis (ICA) of individual pixel time-series, hereafter “pixel-ICA”. The main purpose of this paper is to investigate the limits and advantages of pixel-ICA on a series of simulated data sets with different instrument properties, and a range of jitter timescales and shapes, non-stationarity, sudden change points, etc. The performances of pixel-ICA are compared against the ones of other methods, in particular polynomial centroid division, and pixel-level decorrelation method. We find that in simulated cases pixel-ICA performs as well or better than other methods, and it also guarantees a higher degree of objectivity, because of its purely statistical foundation with no prior information on the instrument systematics. The results of this paper, together with previous analyses of Spitzer/IRAC data sets, suggest that photometric precision and repeatability of one part in 10{sup 4} can be achieved with current infrared space instruments.

79 ASTRONOMY AND ASTROPHYSICS↗

Data simulation for the Lightning Imaging Sensor (LIS)

This project aims to build a data analysis system that will utilize existing video tape scenes of lightning as viewed from space. The resultant data will be used for the design and development of the Lightning Imaging Sensor (LIS) software and algorithm analysis. The desire for statistically significant metrics implies that a large data set needs to be analyzed. Before 1990 the quality and quantity of video was insufficient to build a usable data set. At this point in time, there is usable data from missions STS-34, STS-32, STS-31, STS-41, STS-37, and STS-39. During the summer of 1990, a manual analysis system was developed to demonstrate that the video analysis is feasible and to identify techniques to deduce information that was not directly available. Because the closed circuit television system used on the space shuttle was intended for documentary TV, the current value of the camera focal length and pointing orientation, which are needed for photoanalysis, are not included in the system data. A large effort was needed to discover ancillary data sources as well as develop indirect methods to estimate the necessary parameters. Any data system coping with full motion video faces an enormous bottleneck produced by the large data production rate and the need to move and store the digitized images. The manual system bypassed the video digitizing bottleneck by using a genlock to superimpose pixel coordinates on full motion video. Because the data set had to be obtained point by point by a human operating a computer mouse, the data output rate was small. The loan and subsequent acquisition of a Abekas digital frame store with a real time digitizer moved the bottleneck from data acquisition to a problem of data transfer and storage. The semi-automated analysis procedure was developed using existing equipment and is described. A fully automated system is described in the hope that the components may come on the market at reasonable prices in the next few years.

Boeck, William L.↗

Discovering invariant spatial features in electron energy loss spectroscopy images on the mesoscopic and atomic levels

Over the last two decades, Electron Energy Loss Spectroscopy (EELS) imaging with a scanning transmission electron microscope has emerged as a technique of choice for visualizing complex chemical, electronic, plasmonic, and phononic phenomena in complex materials and structures. The availability of the EELS data necessitates the development of methods to analyze multidimensional data sets with complex spatial and energy structures. Traditionally, the analysis of these data sets has been based on analysis of individual spectra, one at a time, whereas the spatial structure and correlations between individual spatial pixels containing the relevant information of the physics of underpinning processes have generally been ignored and analyzed only via the visualization as 2D maps. Here, we develop a machine learning-based approach and workflows for the analysis of spatial structures in 3D EELS data sets using a combination of dimensionality reduction and multichannel rotationally invariant variational autoencoders. This approach is illustrated for the analysis of both the plasmonic phenomena in a system of nanowires and in the core excitations in functional oxides using low loss and core-loss EELS, respectively. The code developed in this manuscript is open sourced and freely available and provided as a Jupyter notebook for the interested reader.

36 MATERIALS SCIENCE↗

Crystallization, dehydration and experimental phasing of WbdD, a bifunctional kinase and methyltransferase from Escherichia coli O9a

The optimization of WbdD crystals using a novel dehydration protocol and experimental phasing at 3.5 Å resolution by cross-crystal averaging followed by molecular replacement of electron density into a non-isomorphous 3.0 Å resolution native data set are reported. WbdD is a bifunctional kinase/methyltransferase that is responsible for regulation of lipopolysaccharide O antigen polysaccharide chain length in Escherichia coli serotype O9a. Solving the crystal structure of this protein proved to be a challenge because the available crystals belonging to space group I23 only diffracted to low resolution (>95% of the crystals diffracted to resolution lower than 4 Å and most only to 8 Å) and were non-isomorphous, with changes in unit-cell dimensions of greater than 10%. Data from a serendipitously found single native crystal that diffracted to 3.0 Å resolution were non-isomorphous with a lower (3.5 Å) resolution selenomethionine data set. Here, a strategy for improving poor (3.5 Å resolution) initial phases by density modification and cross-crystal averaging with an additional 4.2 Å resolution data set to build a crude model of WbdD is desribed. Using this crude model as a mask to cut out the 3.5 Å resolution electron density yielded a successful molecular-replacement solution of the 3.0 Å resolution data set. The resulting map was used to build a complete model of WbdD. The hydration status of individual crystals appears to underpin the variable diffraction quality of WbdD crystals. After the initial structure had been solved, methods to control the hydration status of WbdD were developed and it was thus possible to routinely obtain high-resolution diffraction (to better than 2.5 Å resolution). This novel and facile crystal-dehydration protocol may be useful for similar challenging situations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

SPRUCE Anaerobic oxidation of methane mitigates net methane production and responds to long-term experimental warming in a northern bog: Supporting data

This data set contains measurements of anaerobic oxidation of methane (AOM), net methane (CH4) production, carbon dioxide (CO2) production, and gross CH4 production measurements from the SPRUCE experiment (Hanson et al. 2017). CH4 is greenhouse gas with 45 times the sustained global warming potential of CO2 over 100 years, which may have significant implications on global climate change. The process of AOM plays a large role in the extent of CH4 emissions from wetland environments like those at the SPRUCE experiment site. This study conducted two on different dates. In experiment 1, net CH4 and CO2 production were measured with a gas chromatograph through the peat profile at in situ temperatures of the SPRUCE plots four times from May to October, 2016 (2016-05 to 2016-10). Two treatments were examined, a Porewater Treatment that was a 1:1 volumetric peat:porewater slurry and a No Porewater Treatment that was field-moist peat with no porewater added. Additionally, net CH4 production were measured at frequent intervals (from 4 hr to 9 d) in peat from selected SPRUCE plots from soil collected on October 16, 2016 (2016-10-16). Samples were collected from the SPRUCE plots, immediately made anaerobic, and transported to the University of Oregon for rate measurements within several days of collection. In experiment 2, AOM, net CH4 production, CO2 production, and gross CH4 production were measured through the peat profile at in situ field temperatures once from samples collected in July, 2021 (2021-07). The same two porewater treatments were examined. AOM was measured with a 13CH4 tracer method using a Picarro G2201-i analyzer for isotopic CO2/CH4 quantification with a small stable isotope module attached. This data set contains three data files in comma separate (*.csv) format. This data set is associated with the following publication: Barney, M, AM Hopple, LL Gregory, JK Keller, and SD Bridgham. 2024. Anaerobic oxidation of methane mitigates net methane production and responds to long-term experimental warming in a northern bog. Soil Biology and Biochemistry, 190, 109316. https://doi.org/10.1016/j.soilbio.2024.109316.

SPRUCE Experiment, Marcell Experimental Forest, Me↗

Comparison of High Pressure Transient PVT Measurements and Model Predictions – Part I

A series of experiments consisting of vessel-to-vessel transfers of pressurized gas using Transient PVT methodology have been conducted to provide a data set for optimizing heat transfer correlations in high pressure flow systems. In rapid expansions such as these, the heat transfer conditions are neither adiabatic nor isothermal. Compressible flow tools exist, such as NETFLOW that can accurately calculate the pressure and other dynamical mechanical properties of such a system as a function of time. However to properly evaluate the mass that has transferred as a function of time these computational tools rely on heat transfer correlations that must be confirmed experimentally. In this work new data sets using helium gas are used to evaluate the accuracy of these correlations for receiver vessel sizes ranging from 0.090 L to 13 L and initial supply pressures ranging from 2 MPa to 40 MPa. The comparisons show that the correlations developed in the 1980s from sparse data sets perform well for the supply vessels but are not accurate for the receivers, particularly at early time during the transfers. This report focuses on the experiments used to obtain high quality data sets that can be used to validate computational models. Part II of this report discusses how these data were used to gain insight into the physics of gas transfer and to improve vessel heat transfer correlations. Network flow modeling and CFD modeling is also discussed.

99 GENERAL AND MISCELLANEOUS↗

High-Resolution Gridded Level 3 Aerosol Optical Depth Data from MODIS

The state-of-art satellite observations of atmospheric aerosols over the last two decades from NASA's MODIS instruments have been extensively utilized in climate change and air quality research and applications. The operational algorithms now produce level 2 aerosol data at varying spatial resolutions (1, 3, and 10 km) and level 3 data at 1 degree. The local and global applications have been benefited from the coarse resolution gridded data sets (i.e., level 3, 1 degree), as it is easier to use since data volume is low and, several online and offline tools are readily available to access and analyze the data with minimal computing resources. At the same time, researchers who require data at much finer spatial scales have to go through a challenging process of obtaining, processing, and analyzing larger volumes of data sets that require high-end computing resources and coding skills. Therefore, we have created a high spatial resolution (HRG, 0.1x0.1 degree) daily and monthly aerosol optical depth (AOD) product by combining two MODIS operational algorithms, namely Deep Blue (DB) and Dark Target (DT). The new HRG AODs meets the accuracy requirements of level 2 AOD data and provide either the same or more spatial coverage on daily and monthly scales. The data sets are provided in daily and monthly files through open Ftp server with python scripts to read and map the data. The reduced data volume with an easy to use format and tools to access the data will encourage more users to utilize the data for research and applications.

aerosol↗

Satellite Elevation Magnetic and Gravity Models of Major South American Plate Tectonic Features

Some MAGSAT scalar and vector magnetic anomaly data together with regional gravity anomaly data are being used to investigate the regional tectonic features of the South American Plate. An initial step in this analysis is three dimensional modeling of magnetic and gravity anomalies of major structures such as the Andean subduction zone and the Amazon River Aulacogen at satellite elevations over an appropriate range of physical properties using Gaus-Legendre quadrature integration method. In addition, one degree average free-air gravity anomalies of South America and adjacent marine areas are projected to satellite elevations assuming a spherical Earth and available MAGSAT data are processed to obtain compatible data sets for correlation. Correlation of these data sets is enhanced by reduction of the MAGSAT data to radial polarization because of the profound effect of the variation of the magnetic inclination over South America.

Vonfrese, R. R. B.↗

SAR terrain classifier and mapper of biophysical attributes

In preparation for the launch of SIR-C/X-SAR and design studies for future orbital SAR, a program has made considerable progress in the development of an SAR terrain classifier and algorithms for quantification of biophysical attributes. The goal of this program is to produce a generalized software package for terrain classification and estimation of biophysical attributes and to make this package available to the larger scientific community. The basic elements of the SAR (Synthetic Aperture Radar) terrain classifier are outlined. An SAR image is calibrated with respect to known system and processor gains and external targets (if available). A Level 1 classifier operates on the data to differentiate: urban features, surfaces and tall and short vegetation. Level 2 classifiers further subdivide these classes on the basis of structure. Finally, biophysical and geophysical inversions are applied to each class to estimate attributes of interest. The process used to develop the classifiers and inversions is shown. Radar scattering models developed from theory and from empirical data obtained by truck-mounted polarimeters and the JPL AirSAR are validated. The validated models are used in sensitivity studies to understand the roles of various scattering sources (i.e., surface trunk, branches, etc.) in determining net backscatter. Model simulations of sigma (sup o) as functions of the wave parameters (lambda, polarization and angle of incidence) and the geophysical and biophysical attributes are used to develop robust classifiers. The classifiers are validated using available AirSAR data sets. Specific estimators are developed for each class on the basis of the scattering models and empirical data sets. The candidate algorithms are tested with the AirSAR data sets. The attributes of interest include: total above ground biomass, woody biomass, soil moisture and soil roughness.

Ulaby, Fawwaz T.↗

Non-Cooperative Facial Recognition Video Dataset Collection Plan

The Pacific Northwest National Laboratory (PNNL) will produce a non-cooperative (i.e. not posing for the camera) facial recognition video data set for research purposes to evaluate and enhance facial recognition systems technology. The aggregate data set consists of 1) videos capturing PNNL role players and public volunteers in three key operational settings, 2) photographs of the role players for enrolling in an evaluation database, and 3) ground truth data that documents when the role player is within various camera fields of view. PNNL will deliver the aggregate data set to DHS who may then choose to make it available to other government agencies interested in evaluating and enhancing facial recognition systems. The three operational settings that will be the focus of the video collection effort include: 1) unidirectional crowd flow 2) bi-directional crowd flow, and 3) linear and/or serpentine queues.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

User guide to the Magellan synthetic aperture radar images

The Magellan radar-mapping mission collected a large amount of science and engineering data. Now available to the general scientific community, this data set can be overwhelming to someone who is unfamiliar with the mission. This user guide outlines the mission operations and data set so that someone working with the data can understand the mapping and data-processing techniques used in the mission. Radar-mapping parameters as well as data acquisition issues are discussed. In addition, this user guide provides information on how the data set is organized and where specific elements of the set can be located.

Wall, Stephen D.↗

Coordinated ionospheric and magnetospheric observations from the ISIS 2 satellite by the ISIS 2 experimenters. Volume 2: Auroral optical emissions magnetic field perturbations, and plasma characteristics, measured simultaneously on the same magnetic field line

The data set consists of a selected number of passes, each comprising a format combination that is most appropriate for the particular data set. A list of ISIS 2 experimenters, with addresses and telephone numbers is included. A brief description of the ISIS 2 satellite is given, followed by more detailed instrument descriptions, format descriptions, data set descriptions, and the data themselves.

Shepherd, G. G.↗

Two Weeks In The Life of Skybridge

This report documents a new large public data set for researchers studying the behavior of large commodity high-performance computing systems. Such large data sets are typically confined within institutions and access to them is limited to institutional partners. We provide it to promote HPC research more widely. The data set provides a two week time series of performance data collected once per minute using the Lightweight Distributed Metric Service from the system Skybridge at Sandia National Laboratories and the corresponding job-level accounting information. General system log information is not provided.

97 MATHEMATICS AND COMPUTING↗

Efficient First-Order Algorithms for Large-Scale, Non-Smooth Maximum Entropy Models with Application to Wildfire Science

Maximum entropy (MaxEnt) models are a class of statistical models that use the maximum entropy principle to estimate probability distributions from data. Due to the size of modern data sets, MaxEnt models need efficient optimization algorithms to scale well for big data applications. State-of-the-art algorithms for MaxEnt models, however, were not originally designed to handle big data sets; these algorithms either rely on technical devices that may yield unreliable numerical results, scale poorly, or require smoothness assumptions that many practical MaxEnt models lack. In this paper, we present novel optimization algorithms that overcome the shortcomings of state-of-the-art algorithms for training large-scale, non-smooth MaxEnt models. Our proposed first-order algorithms leverage the Kullback–Leibler divergence to train large-scale and non-smooth MaxEnt models efficiently. For MaxEnt models with discrete probability distribution of n elements built from samples, each containing m features, the stepsize parameter estimation and iterations in our algorithms scale on the order of O(mn) operations and can be trivially parallelized. Moreover, the strong ℓ1 convexity of the Kullback–Leibler divergence allows for larger stepsize parameters, thereby speeding up the convergence rate of our algorithms. To illustrate the efficiency of our novel algorithms, we consider the problem of estimating probabilities of fire occurrences as a function of ecological features in the Western US MTBS-Interagency wildfire data set. Our numerical results show that our algorithms outperform the state of the art by one order of magnitude and yield results that agree with physical models of wildfire occurrence and previous statistical analyses of wildfire drivers.

Physics↗

A survey of long-term interplanetary magnetic field variations

Interplanetary-magnetic-field data from the IMP-10, IMP-A, and Heos spacecraft have been merged into a composite data set spanning the period from 1963 to 1974. Consideration of the mutual consistency of the individual data sets reveals agrement typically to within 0.2 gamma. Analysis of the composite data set reveals the following: (1) although the yearly averaged magnitudes of all field vectors show virtually no solar-cycle variation, the yearly averaged magnitudes of positive- and negative-polarity field vectors show separate solar-cycle variations consistent with variations in the average azimuthal angles of positive- and negative-polarity field vectors; (2) there is no solar latitude dependence of long-time average field magnitudes; (3) field vectors parallel to the earth-sun line are on the average 1 gamma less in magnitude than field vectors perpendicular to this line; and (4) the solar latitude-dependent dominant polarity effect exhibits a complex sign reversal in the period from 1968 to 1971 and a measure of symmetry in 1972 through 1974 not found in earlier data.

King, J. H.↗

Migrating data from TcSE to DOORS : an evaluation of the T-Plan Integrator software application.

This report describes our evaluation of the T-Plan Integrator software application as it was used to transfer a real data set from the Teamcenter for Systems Engineering (TcSE) software application to the DOORS software application. The T-Plan Integrator was evaluated to determine if it would meet the needs of Sandia National Laboratories to migrate our existing data sets from TcSE to DOORS. This report presents the struggles of migrating data and focuses on how the Integrator can be used to map a data set and its data architecture from TcSE to DOORS. Finally, this report describes how the bulk of the migration can take place using the Integrator; however, about 20-30% of the data would need to be transferred from TcSE to DOORS manually. This report does not evaluate the transfer of data from DOORS to TcSE.

99 GENERAL AND MISCELLANEOUS↗