Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Kepler Uniform Modeling of KOIs: MCMC Notes for Data Release 25

This document describes data products related to the reported planetary parameters and uncertainties for the Kepler Objects of Interest (KOIs) based on a Markov-Chain-Monte-Carlo (MCMC) analysis. Reported parameters, uncertainties and data products can be found at the NASA Exoplanet Archive . The codes used for this data analysis are available on the Github website (Rowe 2016). The relevant paper for details of the calculations is Rowe et al. (2015). The main differences between the model fits discussed here and those in the DR24 catalogue are that the DR25 light curves were used in the analysis, our processing of the MAST light curves took into account different data flags, the number of chains calculated was doubled to 200 000, and the parameters which are reported are based on a damped least-squares fit, instead of the median value from the Markov chain or the chain with the lowest 2 as reported in the past.

DR25↗

Sizing the science data processing requirements for EOS

The methodology used in the compilation and synthesis of baseline science requirements associated with the 30 + EOS (Earth Observing System) instruments and over 2,400 EOS data products (both output and required input) proposed by EOS investigators is discussed. A brief background on EOS and the EOS Data and Information System (EOSDIS) is presented, and the approach is outlined in terms of a multilayer model. The methodology used to compile, synthesize, and tabulate requirements within the model is described. The principal benefit of this approach is the reduction of effort needed to update the analysis and maintain the accuracy of the science data processing requirements in response to changes in EOS platforms, instruments, data products, processing center allocations, or other model input parameters. The spreadsheets used in the model provide a compact representation, thereby facilitating review and presentation of the information content.

Wharton, Stephen W.↗

Data management and scientific integration within the Atmospheric Radiation Measurement Program

The Atmospheric Radiation Measurement (ARM) Program has been developed by the U.S. Department of Energy with the goal to improve the predictive capabilities of General Circulation Models (GCM's) in their treatment of clouds and radiative transfer effects. To achieve this goal, three experimental testbeds were designed for the deployment of instruments that will collect atmospheric data used to drive the GCM's. Each site, known as a Cloud and Radiation Testbed (CART), consists of a highly available, redundant data system for the collection of data from a variety of instrumentation. The first CART site was deployed in April 1992 in the Southern Great Plains (SGP), Lamont, Oklahoma, with the other two sites to follow in September 1995 in the Tropical Western Pacific and in 1997 on the North Slope of Alaska. Approximately 400 MB of data are transferred per day via the Internet from the SGP site to the ARM Experiment Center at Pacific Northwest Laboratory in Richland, Washington. The Experiment Center is central to the ARM data path and provides for the collection, processing, analysis, and delivery of ARM data. Data are received from the CART sites from a variety of instrumentation, observational systems, amd external data sources. The Experiment Center processes these data streams on a continuous basis to provide derived data products to the ARM Science Team in near real-time while providing a three-month running archive of data. A primary requirement of the ARM Program is to preserve and protect all data produced or acquired. This function is performed at Oak Ridge National Laboratory where leading edge technology is employed for the long-term storage of ARM data. The ARM Archive provides access to data for participation outside of the ARM Program. The ARM Program involves a collaborative effort by teams from various DOE National Laboratories, providing multi-disciplinary areas of expertise. This paper will discuss the collaborative methods in which the ARM teams translate the scientific goals of the Program into data products. By combining atmospheric scientists, systems engineers, and software engineers, the ARM Program has successfully designed and developed an environment where advances in understanding the parameterizations of GCM's can be made.

Gracio, Deborah K.↗

Digital Archive Issues from the Perspective of an Earth Science Data Producer

Contents include the following: Introduction. A Producer Perspective on Earth Science Data. Data Producers as Members of a Scientific Community. Some Unique Characteristics of Scientific Data. Spatial and Temporal Sampling for Earth (or Space) Science Data. The Influence of the Data Production System Architecture. The Spatial and Temporal Structures Underlying Earth Science Data. Earth Science Data File (or Relation) Schemas. Data Producer Configuration Management Complexities. The Topology of Earth Science Data Inventories. Some Thoughts on the User Perspective. Science Data User Communities. Spatial and Temporal Structure Needs of Different Users. User Spatial Objects. Data Search Services. Inventory Search. Parameter (Keyword) Search. Metadata Searches. Documentation Search. Secondary Index Search. Print Technology and Hypertext. Inter-Data Collection Configuration Management Issues. An Archive View. Producer Data Ingest and Production. User Data Searching and Distribution. Subsetting and Supersetting. Semantic Requirements for Data Interchange. Tentative Conclusions. An Object Oriented View of Archive Information Evolution. Scientific Data Archival Issues. A Perspective on the Future of Digital Archives for Scientific Data. References Index for this paper.

Barkstrom, Bruce R.↗

CLASSY. II. A Technical Overview of the COS Legacy Archive Spectroscopic Survey

The COS Legacy Archive Spectroscopic SurveY (CLASSY) is designed to provide the community with a spectral atlas of 45 nearby star-forming galaxies that were chosen to cover similar properties to those seen at high z (z > 6). The prime high-level science product of CLASSY is accurately coadded UV spectra, ranging from ∼1000 to 2000 Å, derived from a combination of archival and new data obtained with HST's Cosmic Origins Spectrograph (COS). This paper details the multistage technical processes of creating this prime data product and the methodologies involved in extracting, reducing, aligning, and coadding far-ultraviolet and near-ultraviolet (NUV) spectra. We provide guidelines on how to successfully utilize COS observations of extended sources, despite COS being optimized for point sources, and best-practice recommendations for the coaddition of UV spectra in general. Moreover, we discuss the effects of our reduction and coaddition techniques in the scientific application of the CLASSY data. In particular, we find that accurately accounting for flux calibration offsets can affect the derived properties of the stellar populations, while customized extractions of NUV spectra for extended sources are essential for correctly diagnosing the metallicity of galaxies via C iii] nebular emission. Despite changes in spectral resolution of up to ∼25% between individual data sets (due to changes in the COS line-spread function), no adverse affects were observed on the difference in velocity width and outflow velocities of isolated absorption lines when measured in the final combined data products, owing in part to our signal-to-noise regime of S/N < 20.

Bethan L. James↗

The NPOESS Preparatory Project (NPP) Science Data Segment (SDS) Data Depository and Distribution Element (SD3E) System Architecture

The National Polar-orbiting Operational Environmental Satellite System (NPOESS), the U.S. Government's future low-Earth orbiting satellite system, will monitor global weather and environmental conditions. Serving as a risk reduction for NPOESS, the NPOESS Preparatory Project (NPP) will provide remotely sensed atmospheric, land, ocean, ozone, and sounder data that will serve the meteorological and global climate change scientific communities. The National Aeronautics and Space Administration (NASA) NPP Science Data Segment's (SDS) primary role is to independently assess the quality of the NPP science and environmental data records for their ability to support climate research. The SDS is composed of nine elements; an input element that receives data from the operational agencies and acts as a buffer, a calibration analysis element, five elements devoted to measurement based quality assessment, an element used to test algorithmic improvements, and an element that provides overall science direction. Each element requires a set of sensor specific science data products for their evaluation. There are four NPP sensors that will be flown on the NPP observatory. They are the Visible Infrared Imagining Radiometer Suite (VIIRS), the Advanced Technology Microwave Sounder (ATMS), the Cross-Track Infrared Sounder (CrIS), and the Ozone Mapper/Profiler Suite (OMPS). It is estimated that these four sensors combined will make daily data requests for approximately six terabytes of NPP science products from the operational data providers. As a result, issues associated with duplicate data requests, data transfers of large volumes of diverse products, and data transfer failures raised concerns with respect to the network traffic and bandwidth consumption. Therefore, a central data broker system for receiving and buffering data requests and data products for the SDS was developed. The data element for this system is called the SDS Data Depository and Distribution Element (SD3E). It supports science mission data assessment by assuring the timely and validated acquisition and subsequent transfer of the NPP Science Mission data to the SDS Elements and NPP Science Team. The six science elements that interface with the SD3E span across the NASA Goddard Space Flight Center (GSFC), the NASA Jet Propulsion Laboratory (JPL), and the University of Wisconsin. As the primary communication vehicle for the science elements and science team, the SD3E has an interface to the operational data providers: National Environment Satellite, Data, and Information Service (NESDIS) Interface Data Processing System (IDPS) and the National Oceanic Atmospheric Administration's (NOAA) Comprehensive Large Array-data Stewardship system (CLASS) Archive Data System (ADS), that are responsible for product generation and archive and distribution respectively. The SD3E is designed to be a semi-customizable and semi-automated system. This system is designed to provide flexibility and ease of use for the science users in accessing the latest data products by creating a rolling data cache that temporarily stores the products locally before transferring the data to the SDS Measurement based elements for the land, ocean, atmosphere, sounder, and ozone. This paper describes the design and architecture of one of the nine SDS elements, the SD3E, and how this system has provided a mechanism for efficient data exchange, how it has helped in alleviating some of the network traffic and usage, and how it has contributed to reducing operational costs.

Ho, Evelyn L.↗

Assessment of Algal Farm Designs Using a Dynamic Modular Approach

The notion of renewable energy provides an important mechanism for diversifying an energy portfolio, which ultimately would have numerous benefits including increased energy resilience, reduction of foreign energy supplies, reduced GHG emissions, development of a green energy sector that contributes to economic growth, and providing a sustainable energy supply. The conversion of autotrophic algae to liquid transportation fuels is the basis of several decades of research to competitively bring energy-scale production into reality; however, many challenges still remain for making algal biofuels economically viable. Addressing current challenges associated with algal production systems, in part, requires the ability to assess spatial and temporal variability, rapidly evaluate alternative algal production system designs, and perform large-scale assessments considering multiple scenarios for thousands of potential sites. We introduce the Algae Logistics Model (ALM) which helps to address these challenges. The flexible nature of the ALM architecture allows the model to: 1) interface with external biomass production and resource assessment models, as well as other relevant datasets including those with spatiotemporal granularity; 2) interchange design processes to enable operational and economic assessments of multiple design configurations, including the integration of current and new innovative technologies; and 3) conduct trade-off analysis to help understand the site-specific techno-economic trade-offs and inform technology decisions. This study uses the ALM to investigate a baseline open-pond production system determined by model harmonization efforts conducted by the U.S. Department of Energy. Six sites in the U.S. southern-tier were sub-selected and assessed using daily site-specific algae biomass productivity data to determine the economic viability of large-scale open-pond systems. Results show that costs can vary significantly depending on location and biomass productivity and that integration of novel dewatering equipment, order of operations, and equipment scaling can also have significant impacts on economics.

09 BIOMASS FUELS↗

DESAlert: Enabling Real-Time Transient Follow-Up with Dark Energy Survey Data

Here, the Dark Energy Survey is undertaking an observational programme imaging 1/4 of the southern hemisphere sky with unprecedented photometric accuracy. In the process of observing millions of faint stars and galaxies to constrain the parameters of the dark energy equation of state, the Dark Energy Survey will obtain pre-discovery images of the regions surrounding an estimated 100 gamma-ray bursts over 5 yr. Once gamma-ray bursts are detected by, e.g., the Swift satellite, the DES data will be extremely useful for follow-up observations by the transient astronomy community. We describe a recently-commissioned suite of software that listens continuously for automated notices of gamma-ray burst activity, collates information from archival DES data, and disseminates relevant data products back to the community in near-real-time. Of particular importance are the opportunities that non-public DES data provide for relative photometry of the optical counterparts of gamma-ray bursts, as well as for identifying key characteristics (e.g., photometric redshifts) of potential gamma-ray burst host galaxies. We provide the functional details of the DESAlert software, and its data products, and we show sample results from the application of DESAlert to numerous previously detected gamma-ray bursts, including the possible identification of several heretofore unknown gamma-ray burst hosts.

79 ASTRONOMY AND ASTROPHYSICS↗

Aqua MODIS 8-Year On-Orbit Operation and Calibration

Launched in May 2002, the NASA EOS Aqua MODIS has successfully operated for more than 8 years. Observations from Aqua MODIS and its predecessor, Terra MODIS, have generated an unprecedented amount of data products and made significant contributions to studies of changes in the Earth s system of land, oceans, and atmosphere. MODIS collects data in 36 spectral bands: 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB). It has a set of on-board calibrators (OBC), providing sensor on-orbit radiometric, spectral, and spatial calibration and characterization. This paper briefly summarizes Aqua MODIS on-orbit operation and calibration activities and illustrates instrument on-orbit performance from launch to present. Discussions are focused on OBC functions and changes in detector radiometric gains, spectral responses, and spatial registrations. With ongoing calibration effort, Aqua MODIS will continue serving the science community with high quality data products

Xiong, Xiaoxiong↗

Soil Moisture Active Passive (SMAP) Radiometer Subband Calibration and Calibration Drift

The SMAP is one of four first-tier missions recommended by the US National Research Council's Committee on Earth Science and Applications from Space (Earth Science and Applications from Space: National Imperatives for the Next Decade and Beyond, Space Studies Board, National Academies Press, 2007). The observatory was launched on Jan 31, 2015. The goal of the SMAP is to measure the global soil moisture and freeze/thaw from space. The L-band radiometer is the passive portion of the spaceborne instrument. It measures all four Stokes antenna temperatures and outputs counts. The Level 1B Brightness Temperature (L1B_TB) science algorithm converts radiometer counts to the Earths surface brightness temperature. The results are reported in the radiometer level 1B data product together with the calibrated antenna temperature (TA) and all of the corrections to the unwanted sources contribution. The calibrated L1B data product are required to satisfy the overall radiometer error budget of 1.3 K needed to meet the soil moisture requirement of 0.04 volumetric fraction uncertainty and the calibration drift requirement of no larger than 0.4 K per month.

Peng, Jinzheng↗

Soil Moisture Active/Passive (SMAP) Radiometer Subband Calibration and Calibration Drift

The SMAP is one of four first-tier missions recommended by the US National Research Council's Committee on Earth Science and Applications from Space (Earth Science and Applications from Space: National Imperatives for the Next Decade and Beyond, Space Studies Board, National Academies Press, 2007)]. The observatory was launched on Jan 31, 2015. The goal of the SMAP is to measure the global soil moisture and freeze/thaw from space. The L-band radiometer is the passive portion of the spaceborne instrument. It measures all four Stokes antenna temperatures and outputs counts. The Level 1B Brightness Temperature (L1B_TB) science algorithm converts radiometer counts to the Earths surface brightness temperature. The results are reported in the radiometer level 1B data product together with the calibrated antenna temperature (TA) and all of the corrections to the unwanted sources contribution. The calibrated L1B data product are required to satisfy the overall radiometer error budget of 1.3 K needed to meet the soil moisture requirement of 0.04 volumetric fraction uncertainty and the calibration drift requirement of no larger than 0.4 K per month.

Peng, Jinzheng↗

Calibration Inter-Comparison of MODIS and VIIRS Reflective Solar Bands Using Lunar Observations

Multispectral band observations from Terra and Aqua MODIS, launched in December 1999 and May 2002, respectively, and from SNPP and NOAA-20 VIIRS, launched in November 2011 and October 2017, respectively, have continuously enabled a broad range of applications and studies of the Earth system and its changes via a set of geophysical and environmental parameters. The quality of MODIS and VIIRS science and environmental data products relies strongly on the calibration accuracy and stability of individual sensors, as well as their calibration consistency, especially for the data products generated using observations from sensors across different platforms. Both MODIS and VIIRS instruments carry a similar set of on-board calibrators for their on-orbit calibration. Besides, lunar observations are regularly scheduled and implemented in support of their reflective solar bands (RSB) calibration, especially their long-term stability monitoring. In this paper, we provide an overview of MODIS and VIIRS solar and lunar calibration methodologies applied for the RSB on-orbit calibration, and describe the approach developed for their calibration inter-comparisons using lunar observations, including corrections for the effects caused by differences in the relative spectral response and adopted solar spectra between individual sensors. The MODIS and VIIRS calibration inter-comparison results derived from their regularly scheduled lunar observations are presented and discussed, including associated uncertainties and a comparison with those derived using the Earth-view targets. Also discussed are remaining challenges in lunar calibration and inter-comparison for the Earth-observing sensors, as well as on-going efforts for future improvements.

Multispectral band↗

Time Series of Magnetic Field Parameters Extracted from Merged Space-Weather MDI/HMI Active Region Patches as Potential Tool for Solar Flare Forecasting

Space-Weather MDI Active Region Patches (SMARPs) and Space-Weather HMI Active Region Patches (SHARPs) are two recently developed data products, which have been used for solar flare prediction studies. The present work is an effort to expand the application of SMARP and SHARP summary heliomagnetic parameters to the forecasting of solar flares. A new data product was derived by filtering, rescaling, and merging the SMARP and SHARP summary parameter data series, which were further converted into two-dimensional arrays by selecting time slices corresponding to R-value maxima, where R-value is a measure of the unsigned magnetic flux near polarity inversion lines. The resulting combined MDI-HMI time series currently span the period between April 4, 1996 and December 13, 2022, and can be extended to a more recent date, providing an opportunity to correlate and compare them with other solar activity parameters, such as the daily solar flare index, which is computed as a sum of the product of GOES X-ray flare magnitude and flare duration, for all M- and X-class flares during a day. Preliminary results demonstrate a significant overall correlation, with Pearson coefficients between 0.339 and 0.627. In addition, an oscillating pattern is seen in the daily-averaged sliding-window correlation coefficient. Time-lagged cross-correlation indicates that a leader-follower dynamic exists in some parameters, especially R-value, where they lead the flare index by at least several days, which may have potential for further application in space weather forecasting.

Heliophysics↗

Automated Production of Movies on a Cluster of Computers

A method of accelerating and facilitating production of video and film motion-picture products, and software and generic designs of computer hardware to implement the method, are undergoing development. The method provides for automation of most of the tedious and repetitive tasks involved in editing and otherwise processing raw digitized imagery into final motion-picture products. The method was conceived to satisfy requirements, in industrial and scientific testing, for rapid processing of multiple streams of simultaneously captured raw video imagery into documentation in the form of edited video imagery and video derived data products for technical review and analysis. In the production of such video technical documentation, unlike in production of motion-picture products for entertainment, (1) it is often necessary to produce multiple video derived data products, (2) there are usually no second chances to repeat acquisition of raw imagery, (3) it is often desired to produce final products within minutes rather than hours, days, or months, and (4) consistency and quality, rather than aesthetics, are the primary criteria for judging the products. In the present method, the workflow has both serial and parallel aspects: processing can begin before all the raw imagery has been acquired, each video stream can be subjected to different stages of processing simultaneously on different computers that may be grouped into one or more cluster(s), and the final product may consist of multiple video streams. Results of processing on different computers are shared, so that workers can collaborate effectively.

Nail, Jasper↗

Limiting Data Friction by Reducing Data Download Using Spatiotemporally Aligned Data Organization Through STARE

Current data processing practice limits the volume and variety of relevant geoscience data that can practically be applied to important problems. File archives in centralized data centers are the principal means by which Earth Science data are accessed. This approach, however, requires laborious search, retrieval, and eventual customization/adaptation for the data to be used. Such fractionation makes it even more difficult to share outcomes, i.e. research artifacts and data products, hampering reusability and repeatability, since end users generally have their own research agenda and preferences as well as scarce resources. Thus, while finding and downloading data files from central data centers are already costly for end users working in their own field, using data products from other disciplines rapidly becomes prohibitive. This curtails scientific productivity, limits avenues of study, and endangers quality and reproducibility. The Spatio-Temporal Adaptive Resolution Encoding (STARE) is a unifying scheme that facilitates the indexing, access, and fusion of diverse Earth Science data. STARE implements an innovative encoding of geo-spatiotemporal information, originally developed for aligning datasets with diverse spatiotemporal characteristics in an array database. The spatial component of STARE recursively quadfurcates a root polyhedron, producing a hierarchical scheme for addressing geographic locations and regions. The temporal component of STARE uses conventional date-time units as an indexing hierarchy. The additional encoding of spatial and temporal resolution information in STARE enables comparisons and conditional selections across diverse datasets. Moreover, spatiotemporal set-operations, e.g. union and intersection, are mapped to efficient integer operations with STARE. Applied to existing data models (point, grid, spacecraft swath) and corresponding granules, STARE indexes provide a streamlined description usable as geo-spatiotemporal metadata. When coupled with large scale, distributed hardware and software, STARE-based data access reduces pre-analysis data preparation costs by offering a convenient means to align different datasets spatiotemporally without specialized effort in parallel computing or distributed data management.

Kuo, Kwo-Sen↗

Science Data Center concepts for moderate-sized NASA missions

The paper describes the approaches taken by the NASA Science Data Operations Center to the concepts for two future NASA moderate-sized missions, the Orbiting Solar Laboratory (OSL) and the Tropical Rainfall Measuring Mission (TRMM). The OSL space science mission will be a free-flying spacecraft with a complement of science instruments, placed in a high-inclination, sun synchronous orbit to allow continuous study of the sun for extended periods. The TRMM is planned to be a free-flying satellite for measuring tropical rainfall and its variations. Both missions will produce 'standard' data products for the benefit of their communities, and both depend upon their own scientific community to provide algorithms for generating the standard data products.

Price, R.↗

Implementing the Data Center Energy Productivity Metric in a High Performance Computing Data Center

As data centers proliferate in size and number, the improvement of their energy efficiency and productivity has become an economic and environmental imperative. Making these improvements requires metrics that are robust, interpretable, and practical. We discuss the properties of a number of the proposed metrics of energy efficiency and productivity. In particular, we focus on the Data Center Energy Productivity (DCeP) metric, which is the ratio of useful work produced by the data center to the energy consumed performing that work. We describe our approach for using DCeP as the principal outcome of a designed experiment using a highly instrumented, high-performance computing data center. We found that DCeP was successful in clearly distinguishing different operational states in the data center, thereby validating its utility as a metric for identifying configurations of hardware and software that would improve energy productivity. We also discuss some of the challenges and benefits associated with implementing the DCeP metric, and we examine the efficacy of the metric in making comparisons within a data center and between data centers.

Sego, Landon H.↗

Terra MODIS: 20 years of on-orbit calibration and performance

For nearly 20 years, Terra MODIS observations have generated a broad range of data products, enabling the remote sensing community and users worldwide for their studies of many key geophysical parameters of the Earth’s system. MODIS collects data in 36 spectral bands, covering wavelengths from 0.41 to 14.4 μm, that are calibrated by a set of on-board calibrators (OBC). Also contributed to sensor on-orbit calibration and characterization are near monthly-scheduled lunar observations and long-term trends of sensor responses over select ground targets. The quality of MODIS data products relies strongly on the dedicated efforts to the operate instrument, derive and update calibration parameters, and improve calibration strategies and algorithms in order to address on-orbit changes of sensor characteristics and its OBC functions. This paper provides an overview of Terra MODIS on-orbit operation and calibration activities over the last 20 years, including changes made to extend and preserve instrument and OBC functions and their implementation strategies. It illustrates sensor on-orbit performance using data from its OBC, lunar observations, and select ground targets and discusses major changes in sensor characteristics and corrections applied to the L1B algorithms or updates of calibration look-up tables (LUTs). Also described in this paper are lessons learned from Terra MODIS and future efforts to further extend its long-term data records.

Terra↗