Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

An Integrated Indexing and Search Service for Distributed File Systems

Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy. In this article, we present TagIt, a scalable data management service framework aimed at scientific datasets, which can be integrated into prevalent distributed file system architectures. A key feature of TagIt is a scalable, distributed metadata indexing framework, which facilitates a flexible tagging capability to support data discovery. Furthermore, the tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. We have integrated TagIt into two popular distributed file systems, i.e., GlusterFS and CephFS. Our evaluation demonstrates that TagIt can expedite data search operation by up to 10× over the extant decoupled approach.

97 MATHEMATICS AND COMPUTING↗

In-medium $\Delta (1232)$ potential, pion production in heavy-ion collisions and the symmetry energy

Using the dcQMD transport model, the isoscalar and isovector in-medium potentials of the Δ (1232) baryon are studied and information regarding their effective strength is obtained from a comparison to experimental pion production data in heavy-ion collisions below 800 MeV/nucleon impact energy. The best description is achieved for an isoscalar potential moderately more attractive than the nucleon optical potential and a rather small isoscalar relative effective mass $m$$^{*}_{Δ}$ ≈ 0.45. For the isovector component only a constraint between the potential’s strength at saturation and the isovector effective mass difference can be extracted, which depends on quantities such as the slope of the symmetry energy and the neutron-proton effective mass difference. These results are incompatible with the usual assumption, in transport models, that the Δ (1232) and nucleon potentials are equal. The density dependence of symmetry energy can be studied using the high transverse momentum tail of pion multiplicity ratio spectra. Results are however correlated with the value of neutron-proton effective mass difference. Furthermore, this region of spectra is shown to be affected by uncertain model ingredients such as the pion potential or in-medium correction to inelastic scattering cross-sections at levels smaller than 10%. Extraction of precise constraints for the density dependence of symmetry energy above saturation will require experimental data for pion production in heavy-ion collisions below 800 MeV/nucleon impact energy and experimental values for the high transverse momentum tail of pion multiplicity ratio spectra accurate to better than 5%.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Earth System Grid (ESG) Data Node Software Stack

The ESG-CET system consist of two major components: 1) Gateways that support portal services, which serve as interfaces to end-users who can search, discover, and request data and data products, and 2) Data Nodes where the data actually resides. The Data is "published" to the Data Node, which makes the data visible to a Gateway and enables its delivery to end-users. It is expected that Gateways will only be installed by a small number of centers devoted to serving data (e.g., LLNL/PCMDI, NCAR, GFDL, DADC, DKRZ, ANU, JAMSTEC), whereas it is hoped that most climate modeling centers will install the Data Node software through which they can serve their model output.

Williams, D. N.↗

The ARM Data System and Archive

Every observationally based research program needs a way to collect data from instruments, convert the data from its raw format into a more usable format, apply quality control, process it into higher-order data products, store the data, and make the data available to its scientific community. This data flow is illustrated pictorially in Fig. 11-1. These are the basic requirements of any scientific data system, and ARM’s data system would have to address these requirements and more. This research provides one view of the development of the ARM data system, which includes the ARM Data Archive, and some of the notable decisions that were made along the way.

97 MATHEMATICS AND COMPUTING↗

Large emissions of CO2 and CH4 due to active-layer warming in Arctic tundra: Supporting Data

Climate warming may accelerate decomposition of Arctic soil carbon, but few controlled experiments have manipulated the entire active layer. To determine surface-atmosphere fluxes of carbon dioxide and methane under anticipated end-of-century warming, we used heating rods to warm soil (by 3.8 °C) to the depth of permafrost in polygonal tundra over two growing seasons at the Barrow Environmental Observatory in Utqiaġvik (formerly Barrow), Alaska. This data product includes supporting data for the companion paper entitled "Large emissions of CO2 and CH4 due to active-layer warming in Arctic tundra", published in Nature Communications by Torn et al. This data package contains seven data files in csv format with corresponding data dictionaries and file-level metadata, describing vegetation biomass dry weight ("Utqiagvik_Vegetation_Biomass_2014.csv"), radiocarbon measurements of respired carbon dioxide ("Utqiagvik_Radiocarbon_2015_2016.csv"), surface-atmosphere fluxes of carbon dioxide and methane and associated soil temperature ("Utqiagvik_Fluxes_Temperature_2015_2016.csv"), and soil temperature measurements averaged every 15-min and 1-hr for 2015 and 2016 ("Utqiagvik_Temperature_15min_2015.csv", "Utqiagvik_Temperature_15min_2016.csv", "Utqiagvik_Temperature_1hr_2015.csv", "Utqiagvik_Temperature_1hr_2016.csv"). There are no specific software requirements to use these data. UIC Science Native Corporation facilitated our scientific research on the Barrow Environmental Observatory, which is Iñupiat land.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Charged Wellbore Casing Controlled Source Electromagnetics (CWC-CSEM) for Reservoir Imaging and Monitoring (Final report)

This project addresses the needs of the U.S. Department of Energy (DOE) to develop advanced monitoring technologies and protocols to track the fate of subsurface carbon dioxide (CO2) plumes for carbon storage. Specifically, the project seeks to develop and test a unique and novel system of technologies consisting of electromagnetic data acquisition, coupled multiphysics imaging, and reservoir model enhancement to understand the migration and long-term distribution of CO2 in the subsurface. The overarching objective is to develop an integrated approach for long term monitoring of carbon storage. The two main components of the project include the methodology development and the test of the method at a field site. The methodology component consists of 1) developing the field procedure and protocol for collecting time-lapse controlled-source electromagnetic (CSEM) data with source electric current injected into the subsurface through wellbore casings; 2) building of background 3D electrical conductivity utilizing multiple sources of data such as supplemental surface transient EM (TEM) surveys, well-logs, and seismic structural information, for enhancing CSEM signal from reservoir depths; and 3) coupled multiphysics simulations and inversion of CSEM data constrained by production data and by structural information from seismic imaging of the reservoir and overlying formations. The testing component used the field site of Bell Creek Oil Field, which served both as a field laboratory for the method development as well as a test site to evaluate the CSEM signal strengths and the methodology developed in this research project. We have accomplished all the proposed tasks and developed the methodology as planned. These include the procedure for time-lapse CSEM data acquisition, data processing techniques, integration with 3D conductivity model building, fast reservoir simulation for history matching using machine learning, and interpreting CSEM data with coupling to the reservoir modeling. Collectively, the outcome of these tasks form a coherent workflow that can be applied to monitor dedicated carbon storage in saline reservoirs. The testing component evaluated the applicability and limitations of the method, and concluded that the method would be ideal for monitoring dedicated carbon storage sites utilizing saline reservoirs.

54 ENVIRONMENTAL SCIENCES↗

Site B - NREL ASSIST (SN11) Thermodynamic Retrievals TROPoe / Derived Data

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe v0.12 (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous observations from the NREL ASSIST-II (SN 11) infrared spectrometer. Observations are noise-filtered but not averaged in time to minimize errors due to non-uniform clouds. Additional input data in TROPoe are cloud base height (CBH), which is a combined data product that uses data from ceilometers at sites A1 and H and scanning lidars from ARM sites C1 and E37. The CBH is weighted inversely proportionally to the distance to the respective site to take into account the spatial variability of clouds (see https://github.com/StefanoWind/ASSIST_analysis/blob/main/awaken_processing/combine_cbh.py). The full pipeline for running the retrieval is available at https://github.com/StefanoWind/TROPoe_processor. Met data was not ingested. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) that provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see, e.g., Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at ARM SGP, OK.

17 WIND ENERGY↗

Site G - NREL ASSIST (SN10) Thermodynamic Retrievals TROPoe / Derived Data

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe v0.12 (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous observations from the NREL ASSIST-II (SN 10) infrared spectrometer. Observations are noise-filtered but not averaged in time to minimize errors due to non-uniform clouds. Additional input data in TROPoe are cloud base height (CBH), which is a combined data product that uses data from ceilometers at sites A1 and H and scanning lidars from ARM sites C1 and E37. The CBH is weighted inversely proportionally to the distance to the respective site to take into account the spatial variability of clouds (see https://github.com/StefanoWind/ASSIST_analysis/blob/main/awaken_processing/combine_cbh.py). The full pipeline for running the retrieval is available at https://github.com/StefanoWind/TROPoe_processor. Met data was not ingested. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) that provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see, e.g., Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at ARM SGP, OK.

17 WIND ENERGY↗

Site C1a - NREL ASSIST (SN12) Thermodynamic Retrievals TROPoe / Derived Data

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe v0.12 (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous observations from the NREL ASSIST-II (SN 12) infrared spectrometer. Observations are noise-filtered but not averaged in time to minimize errors due to non-uniform clouds. Additional input data in TROPoe are cloud base height (CBH), which is a combined data product that uses data from ceilometers at sites A1 and H and scanning lidars from ARM sites C1 and E37. The CBH is weighted inversely proportionally to the distance to the respective site to take into account the spatial variability of clouds (see https://github.com/StefanoWind/ASSIST_analysis/blob/main/awaken_processing/combine_cbh.py). The full pipeline for running the retrieval is available at https://github.com/StefanoWind/TROPoe_processor. Met data was not ingested. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) that provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see, e.g., Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at ARM SGP, OK.

17 WIND ENERGY↗

Eddy Flux and Meteorology over Deciduous Forest, Prairie, and Soybean Ecosystems in Missouri, USA, during the Total Solar Eclipse of 2017

Eddy fluxes and meteorology data are reported at high temporal resolution for three flux tower sites in Mid-Missouri before, during, and after the Total Solar Eclipse of August 21, 2017. Mid-Missouri experienced up to 2 minutes and 40 seconds of totality at around solar noon during the eclipse (Fig. 1). The sites are located in deciduous oak-hickory forest, native prairie, and soybean ecosystems (Table 1 and Fig. 3). Eddy fluxes were computed using a wavelet-based approach that permitted the calculation of two-minute mean fluxes without losing low frequency flux contributions (Fig. 2). During the eclipse, standard meteorological variables were sampled and recorded at 5 second intervals. The two-minute means of fluxes and meteorology are reported. This data product includes three data files in NetCDF (*.nc) format, three data dictionary files and a file-level metadata file in comma separate (*.csv) format, and a user guide in PDF (*.pdf) format.

54 ENVIRONMENTAL SCIENCES↗

CRGTBSO3 TBS Ozone Data

The Tethered Balloon System (TBS) operated for two weeks during a summer IOP of the CoURAGE campaign. This dataset includes data collected from an En-Sci electrochemical cell (ECC) ozonesonde on the TBS. The ozonesonde was connected to an iMet-4RSB radiosonde, and the overall data collected included ozone, relative humidity, temperature, and altitude. The data from the iMet is the same as that found in the TBSMERGED data product. The TBS also had another instrument (iMet XQ2) that collected meteorological data, which may have more accurate relative humidity (RH) data. This ozonesonde data set is intended to complement the TBSMERGED data product, the CRGTBSO3 surface ozone measurements, and the CoURAGE SWARM ozone lidar (TOLNet) measurements from other locations.

Atmospheric relative humidity↗

The Shuttle Imaging Radar B (SIR-B) experiment report

The primary objective of the SIR-B experiment was to acquire multiple-incidence-angle radar imagery of a variety of Earth's surfaces to better understand the effects of imaging geometry on radar backscatter. A complementary objective was to map extensive regions of particular interest. Under these broad objectives, many specific scientific experiments were defined by the 43 SIR-B Science Team members, including studies in the area of geology, vegetation, radar penetration, oceanography, image analysis, and calibration technique development. Approximately 20 percent of the planned digital data were collected, meeting 40 percent of the scientific objectives. This report is an overview of the SIR-B experiment and includes the science investigations, hardware design, mission scenario, mission operations, events of the actual missions, astronaut participation, data products (including auxiliary data), calibrations, and a summary of the actual coverage. Also included are several image samples.

Cimino, Jo Bea↗

Results from the Earth Radiation Budget Experiment (ERBE)

The Earth Radiation Budget Experiment (ERBE) has been observing the earth during the past 4 years from three satellites. Numerous validation procedures have been applied to the data. Particularly important have been intercomparisons between three channels of scanning radiometers and wide and medium field-of-view radiometers. These intercomparisons and onboard calibration targets have provided assurance of high data quality. In addition to the classic radiation budget parameters: global absorbed and emitted energy, ERBE is producing fluxes on scales of 250 km that can significantly increase understanding of the earth's climate. Of particular interest are ERBE measurements of clear-sky albedos and longwave fluxes, which are part of the ERBE data products. Use of data from the precessing ERBE satellite together with data from the sun-synchronous NOAA-9 and NOAA-10 satellites also provides information on the diurnal cycle of shortwave and longwave fluxes.

Barkstrom, Bruce R.↗

Application of left- and right-looking SAR stereo to depth measurements of the Ammavaru outflow channel, Lada Terra, Venus

Venusian channels are too narrow to be resolved by Magellan's radar altimeter, so they are not visible in the standard topographic data products. Stereo image data, in addition to their benefit to geologic mapping of Venus structures as a whole, are indispensible in measuring the topography across the channels. These measurements can then be used in conjunction with the regional topographic maps based on the altimeter data to produce cross-sectional areas for the channels and estimate the fluid discharge through them. As an example of the application of the stereo image data to venusian channels, a number of test depth and profile measurements were made of the large outflow channel system in Lada Terra, centered at 50 deg S latitude, 21 deg E longitude (F-MIDR 50S021). These measurements were made by viewing the cycle 1 and 2 digital FMIDRs in stereo on a display monitor, so as to minimize the errors in measuring parallax displacement as much as possible. The MIDRs are produced at a scale of 75 m/pixel. This corresponds to a vertical scale of about 17 m/pixel, when calculating the height of a feature from its parallax displacement. An error in placement determination of 1 pixel was assumed to characterize the vertical accuracy as plus or minus 17 m. When this technique was applied to the outflow channel, it was noted that the walls of the collapsed terrain source and 'trough reach' of the channel are laid over in both the cycle 1 and 2 images. This is evident when examining the distance between features on the plateau and the cliff walls in the two images. The layover 'shifts' the features closer to the apparent edge of the wall relative to the oppositely illuminated image.

Parker, T. J.↗

Enabling High Performance Reconfigurable Ground Data Processing Systems

The deployment of high data rate instruments onboard satellites with direct broadcast capability demands the implementation of powerful ground data processing systems. Conversely, to enable the widespread usage of direct broadcast data and the generation of subsequent data products, low cost data processing systems must be available. Reconfigurable computers based on Field Programmable Gate Arrays (FPGA) enable the implementation of ground data processing systems that lead to higher performance and lower cost while keeping a high degree of programmability and maintainability. This paper presents the conceptualization of the MODIS Adaptive Level One Accelerator (ALOA), a prototype under construction at NASA's Goddard Space Flight Center. The ALOA is a computer workstation augmented by a reconfigurable computer. The system will calibrate and geographically locate data from the EOS-AM1 MODerate resolution Imaging Spectroradiometer (MODIS) instrument at near real-time data rates.

Hines, Tonjua M.↗

Global Lidar Measurements of Clouds and Aerosols from Space Using the Geoscience Laser Altimeter System (GLAS)

The Geoscience Laser Altimeter System (GLAS) is scheduled for launch on the ICESat satellite as part of the NASA EOS mission in 2002. GLAS will be used to perform high resolution surface altimetry and will also provide a continuously operating atmospheric lidar to profile clouds, aerosols, and the planetary boundary layer with horizontal and vertical resolution of 175 and 76.8 m, respectively. GLAS is the first active satellite atmospheric profiler to provide global coverage. Data products include direct measurements of the heights of aerosol and cloud layers, and the optical depth of transmissive layers. In this poster we provide an overview of the GLAS atmospheric data products, present a simulated GLAS data set, and show results from the simulated data set using the GLAS data processing algorithm. Optical results from the ER-2 Cloud Physics Lidar (CPL), which uses many of the same processing algorithms as GLAS, show algorithm performance with real atmospheric conditions during the Southern African Regional Science Initiative (SAFARI 2000).

Hlavka, Dennis L.↗

NASA Earth Sciences Data Support System and Services for the Northern Eurasia Earth Science Partnership Initiative

The presentation describes data management of NASA remote sensing data for Northern Eurasia Earth Science Partnership Initiative (NEESPI). Many types of ground and integrative (e.g., satellite, GIs) data will be needed and many models must be applied, adapted or developed for properly understanding the functioning of Northern Eurasia cold and diverse regional system. Mechanisms for obtaining the requisite data sets and models and sharing them among the participating scientists are essential. The proposed project targets integration of remote sensing data from AVHRR, MODIS, and other NASA instruments on board US- satellites (with potential expansion to data from non-US satellites), customized data products from climatology data sets (e.g., ISCCP, ISLSCP) and model data (e.g., NCEPNCAR) into a single, well-architected data management system. It will utilize two existing components developed by the Goddard Earth Sciences Data & Information Services Center (GES DISC) at the NASA Goddard Space Flight Center: (1) online archiving and distribution system, that allows collection, processing and ingest of data from various sources into the online archive, and (2) user-friendly intelligent web-based online visualization and analysis system, also known as Giovanni. The former includes various kinds of data preparation for seamless interoperability between measurements by different instruments. The latter provides convenient access to various geophysical parameters measured in the Northern Eurasia region without any need to learn complicated remote sensing data formats, or retrieve and process large volumes of NASA data. Initial implementation of this data management system will concentrate on atmospheric data and surface data aggregated to coarse resolution to support collaborative environment and climate change studies and modeling, while at later stages, data from NASA and non-NASA satellites at higher resolution will be integrated into the system.

Leptoukh, Gregory↗

NASA Earth Sciences Data Support System and Services for the Northern Eurasia Earth Science Partnership Initiative

The presentation describes the recently awarded ACCESS project to provide data management of NASA remote sensing data for the Northern Eurasia Earth Science Partnership Initiative (NEESPI). The project targets integration of remote sensing data from MODIS, and other NASA instruments on board US-satellites (with potential expansion to data from non-US satellites), customized data products from climatology data sets (e.g., ISCCP, ISLSCP) and model data (e.g., NCEP/NCAR) into a single, well-architected data management system. It will utilize two existing components developed by the Goddard Earth Sciences Data & Information Services Center (GES DISC) at the NASA Goddard Space Flight Center: (1) online archiving and distribution system, that allows collection, processing and ingest of data from various sources into the online archive, and (2) user-friendly intelligent web-based online visualization and analysis system, also known as Giovanni. The former includes various kinds of data preparation for seamless interoperability between measurements by different instruments. The latter provides convenient access to various geophysical parameters measured in the Northern Eurasia region without any need to learn complicated remote sensing data formats, or retrieve and process large volumes of NASA data. Initial implementation of this data management system will concentrate on atmospheric data and surface data aggregated to coarse resolution to support collaborative environment and climate change studies and modeling, while at later stages, data from NASA and non-NASA satellites at higher resolution will be integrated into the system.

Leptoukh, Gregory↗