Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

Storage and Read-Optimized Data Placement Structures for High-Performance Analysis [Book Chapter]

Here, we present state-of-art structures and methods for efficient data preparation and representation for analysis. Our intent is to introduce the data science and analytics communities to open source data placements, structures, and methods. These practices can make the foundational processes of data preparation and access dramatically more efficient than typical raw file or database representations and use more conservative storage. To illustrate this, we introduce two highly efficient data placement structures. We then present a tutorial, supported by step-by-step examples, of how to create, use, and access data, structured by Parquet or ORC (Optimized Row Columnar), using Apache Spark. Finally, we illustrate the benefits of using these structures with computational and storage volume benchmarks.

97 MATHEMATICS AND COMPUTING↗

Hospice Landscape Report

In July 2018, CMS requested assistance from Oak Ridge National Laboratory (ORNL) to provide expert data science support aimed at developing algorithms for data mining of medical data for operational and payment purposes. The project is intended to be exploratory: work is aimed at alleviating challenges associated with improper payments, specifically audit methodologies and targeting and changes to risk scores. Project goals include developing new, sophisticated methods for audit targeting and improved profile– payment error correlations, specifically focused on Medicare Part C, the program under which MAOs provide health care services to beneficiaries. ORNL conducted RADV analyses against RAPS and EDS data as well as a hospice landscape analysis per a January 2015 dataset that included Medicare beneficiaries who were in hospice in 2017 and 2018. Ongoing work under this project also involves development of predictive models for RADV investigations and hospice landscape.

97 MATHEMATICS AND COMPUTING↗

Status of availability of Mariner 10 (1973-085A) TV picture data

The Mariner 10 TV data now available from the National Space Science Data Center (NSSDC) are described, and the procedures for ordering these data are explained. Descriptions of the TV data products and supporting documentation scheduled to become available through NSSDC in the future are also included.

Source record↗

System performance testing of the DSN radio science system, Mark 3-78

System performance tests are required to evaluate system performance following initial system implementation and subsequent modification, and to validate system performance prior to actual operational usage. Non-real-time end-to-end Radio Science system performance tests are described that are based on the comparison of open-loop radio science data to equivalent closed-loop radio metric data, as well as an abbreviated Radio Science real-time system performance test that validates critical Radio Science System elements at the Deep Space Station prior to actual operational usage.

Berman, A. L.↗

Ultraviolet photometry from the Orbiting Astronomical Observatory. XXXII - An atlas of ultraviolet stellar spectra

Ultraviolet stellar fluxes are presented in graphs and tables for 164 bright stars in the spectral region from 1200 to 3600 A. The spectra represent a subset of OAO 2 spectrometer data on file at the National Space Science Data Center. The monochromatic flux is given in units of erg per (sq cm-s-A) with a spectral resolution of about 22 A in the region from 3600 to 1850 A and of approximately 12 A in the region from 1850 to 1160 A.

Code, A. D.↗

Ultraviolet photometry from the Orbiting Astronomical Observatory. XXXVIII - A second atlas of ultraviolet stellar spectra

Ultraviolet stellar spectra are presented for 132 stars in the spectral region from 1200 to 1850 A and 34 stars in the region from 1800 to 3600 A in a graphical and tabular form. The spectra represent a subset of OAO 2 spectrometer data on file at the National Space Science Data Center. The monochromatic flux is given in units of ergs/sq cm s A with a spectral resolution of about 12 A in the region from 1850 to 1160 A and of about 22 A in the region from 3600 to 1800 A.

Meade, M. R.↗

Ultraviolet photometry from the Orbiting Astronomical Observatory. XXXIV - Filter photometry of 531 stars of diverse types

Ultraviolet magnitudes for 531 stars observed with the Wisconsin Experiment Package on OAO 2 are tabulated. It is noted that these data constitute a subset of the OAO 2 data on file at the National Space Science Data Center. The tabulation contains previously published data all reduced to a uniform magnitude system. It is pointed out that the observations were obtained with the medium band interference filter photometers. Eleven magnitudes are given designated by their centroid wavelengths.

Code, A. D.↗

An interactive, discipline-independent data visualization system

The data visualization techniques used by National Space Science Data Center Graphics System are discussed. The system includes a self-describing data abstraction for the storage and manipulation of multidimensional data for discipline-independent scientific applications. The system's data format and graphics display are described. Consideration is given to techniques developed for the rapid display and manipulation of large, complex data sets and for manipulating algorithms with portable implementations which can operate on any data object or geometry. The processes of operating the system are given and examples are presented from applying the system to various types of data, including TOMS data, data from the International Satellite Cloud Climatology Project, and IRAS data.

Treinish, Lloyd A.↗

The Space Telescope SI C&DH system

The Hubble Space Telescope Scientific Instrument Control and Data Handling Subsystem (SI C&DH) is designed to interface with five scientific instruments of the Space Telescope to provide ground and autonomous control and collect health and status information using the Standard Telemetry and Command Components (STACC) multiplex data bus. It also formats high throughput science data into packets. The packetized data is interleaved and Reed-Solomon encoded for error correction and Pseudo Random encoded. An inner convolutional coding with the outer Reed-Solomon coding provides excellent error correction capability. The subsystem is designed with the capacity for orbital replacement in order to meet a mission life of fifteen years. The spacecraft computer and the SI C&DH computer coordinate the activities of the spacecraft and the scientific instruments to achieve the mission objectives.

Gadwal, Govind R.↗

Data archiving

The viewgraphs of a discussion on data archiving presented at the National Space Science Data Center (NSSDC) Mass Storage Workshop is included. The mass storage system at the National Center for Atmospheric Research (NCAR) is described. Topics covered in the presentation include product goals, data library systems (DLS), client system commands, networks, archival devices, DLS features, client application systems, multiple mass storage devices, and system growth.

Pitts, David↗

Catalog of solar wind events identified from observations by ISTP spacecraft

The ISTP Science Planning and Operations Facility (SPOF), in collaboration with ISTP investigators, is developing a catalog of solar wind events and features. The catalog is primarily based on plasma and magnetic field observations from the WIND and IMP-8 spacecraft. Interplanetary events that may trigger magnetospheric activity are included as well as features of interest for using the solar wind as a plasma laboratory. Catalog coverage begins on September 8, 1992, the start of ISTP science data collection. The catalog is based on Key Parameter data sets (preliminary summary data at approximately 1 min time resolution produced quickly for survey purposes) and as such has limited citability in formal scientific work. Its primary intent is to serve as a reference for identifying candidate periods for further study, such as may be the focus of coordinated data analysis efforts during ISTP and/or IACG Science Campaigns. To facilitate access by members of the ISTP and wider space physics communities, the catalog will be available on the World Wide Web. The contents of the catalog will be described, and samples of catalog information will be presented.

Peredo, M.↗

LITE data processing

The Lidar In-space Technology Experiment (LITE) was a payload onboard the Space Shuttle Discovery as part of the September 1994 STS-64 mission. LITE successfully made both atmospheric and surface measurements at the 355 nm, 532 nm, and 1064 nm wavelengths [Winker et al., 1996]. At mission completion, nearly 45 Gbytes of data had been obtained. As the data were collected they were organized into three data sets. The largest of these data sets contained the single-shot full resolution digitized lidar signals for all three wavelengths. The other two data sets contained the instrument status data block (ISDB) and the quick look science data (QLSD). ISDB information was generated once per second and contained timing parameters and engineering data related to the health, status, and configuration of the instrument. The QLSD are 100shot averages of the 355 nm and 532 nm lidar signals and were generated at ten second intervals. As the LITE data were generated, they were output to low-rate and high-rate telemetry streams. The low-rate data contained the ISDB and QLSD. The lowrate data were transmitted to the ground by the Shuttle S-band system through the Tracking and Data Relay Satellite System (TDRSS). The high-rate data contained the full resolution digitized lidar signals for all three wavelengths, the ISDB, and QLSD. The high-rate data were transmitted in real time by the Ku-band system through TDRSS downlink to the LITE operations center at the Johnson Space Center (JSC). High-rate data were only obtained when the orbiter and TDRSS telemetry link coincided with the real-time operations of LITE. The low-rate data were backed up by a Shuttle recorder during periods when the telemetry link was unavailable, and the entire lowrate data stream was transferred to the ground over the course of the mission. A total of 53 hours of lowrate data and 45.5 hours of high-rate data were acquired. All of the LITE raw telemetry data have been archived at the NASA Langley Research Center (LaRC), and the LITE high-rate data have been processed to the level 1 data product. This paper describes the data processing steps required to convert the LITE raw, high-rate telemetry data to the LITE level 1 data product.

Powell, Kathleen A.↗

Use of Sonification for Analysis and Detection of Plasma Bubbles at 21 MHz

This research explores sonification as a useful tool for space science data exploration. Our interest lies in basic scientific analysis of plasmas of the ionosphere, of interplanetary space and of the interstellar medium. These plasmas all contain irregularities. Propagation of electromagnetic waves, like optical or radio waves, through a medium with random fluctuations in refractive index results in amplitude and phase fluctuations (Scheuer 1968). These variations may be displayed via sonification, using changes in sounds to represent the data variations. This is particularly useful extending science to the visually-impaired. The xSonify Java-based tool was developed to explore sonification techniques and its value for general science analysis and also assistive technology.

Wanda, Diaz↗

Modifying the Heliophysics Data Policy to Better Enable Heliophysics Research

The Heliophysics (HP) Science Data Management Policy, adopted by HP in June 2007, has helped to provide a structure for the HP data lifecycle. It provides guidelines for Project Data Management Plans and related documents, initiates Resident Archives to maintain data services after a mission ends, and outlines a route to the unification of data finding, access, and distribution through Virtual observatories. Recently we have filled in missing pieces that assure more coherence and a home for the VxOs (through the 'Heliophsyics Data and Model Consortium'), and provide greater clarity with respect to long term archiving. In particular, the new policy which has been vetted with many community members, details the 'Final Archives' that are to provide long-term data access. These are distinguished from RAs in that they provide little additional service beyond servicing data, but critical to their success is that the final archival materials include calibrated data in useful formats such as one finds in CDAWeb and various ASCII or FITS archives. Having a clear goal for legacy products, to be detailed as part of the Mission Archives Plans presented at Senior Reviews, will help to avoid the situation so common in the past of having archival products that preserve bits well but not readily usable information. We hope to avoid the need for the large numbers of 'data upgrade' projects that have been necessary in recent years.

Hayes, Jeffrey↗

New Collections of Aura Atmospheric data Products at the GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the primary archive of atmospheric composition data from the Aura Ozone Monitoring Instrument (OMI), Microwave Limb sounder (MLS), and High-Resolution Dynamics Limb Sounder (HIRDLS) instruments. The most recent versions of Aura OMI, MLS and HIRDLS data are available free to the public (http://disc.gsfc.nasa.gov/Aura). TES data are at ASDC (http://eosweb.larc.nasa.gov).

Johnson, James↗

Relating OGO-5 H(+) Plasmapause Transitions to Mid-Latitude Topside-Ionospheric Signatures

Plasmapause transitions, as seen in the H + and He+ density gradients measured by the Orbiting Geophysical Observatory 5 (OGO 5) ion spectrometer [Sharp, IEE Trans. in Geosci. Elect., 1969], have been investigated in an attempt to relate them to their topside ionospheric signatures as seen in the Alouette-1 & 2 and ISIS-1 data. The satellite data were obtained from the National Space Science Data Center (NSSDC). A search of the OGO-5 data revealed 54 sharp plasmapause crossings as evaluated from the H+ density. The ionospheric footprints (at 1400 km altitude) of the magnetic-field lines through the locations of these plasmapause crossings were then used to search for topside ionospheric electron-density profiles from the NSSDC. No profiles corresponding to these projections were identified. A similar search of the topside-sounder 35-mm ionogram-film database, however, identified 17 cases of candidate "conjunctions" involving Alouette l & 2 and ISIS 1. We will present samples of the plasmapause OGO-5 ion transitions and the related topside ionospheric signatures and discuss the observations in relation to the recent similar study based on Explorer-45 and ISIS-2 data [Grebowsky et al., JASTP, 2009].

Truhlik, Vladimir↗

Eight Year Climatologies from Observational (AIRS) and Model (MERRA) Data

We examine climatologies derived from eight years of temperature, water vapor, cloud, and trace gas observations made by the Atmospheric Infrared Sounder (AIRS) instrument flying on the Aqua satellite and compare them to similar climatologies constructed with data from a global assimilation model, the Modern Era Retrospective-Analysis for Research and Applications (MERRA). We use the AIRS climatologies to examine anomalies and trends in the AIRS data record. Since sampling can be an issue for infrared satellites in low earth orbit, we also use the MERRA data to examine the AIRS sampling biases. By sampling the MERRA data at the AIRS space-time locations both with and without the AIRS quality control we estimate the sampling bias of the AIRS climatology and the atmospheric conditions where AIRS has a lower sampling rate. While the AIRS temperature and water vapor sampling biases are small at low latitudes, they can be more than a few degrees in temperature or 10 percent in water vapor at higher latitudes. The largest sampling biases are over desert. The AIRS and MERRA data are available from the Goddard Earth Sciences Data and Information Services Center (GES DISC). The AIRS climatologies we used are available for analysis with the GIOVANNI data exploration tool. (see, http://disc.gsfc.nasa.gov).

Hearty, Thomas↗

Restoration of APOLLO Data by the NSSDC and PDS Lunar Data Node

The Apollo Lunar Surface Experiment Packages (ALSEPs), suites of instruments deployed by the Apollo 12. 14, 15, 16 and 17 astronauts on the lunar surface, still represent the only in-situ measurements of the Moon's environment taken over long time periods, Much of these data are housed at the National Space Science Data Center (NSSDC) at Goddard Space Flight Center but are in forms that are not readily usable, such as microfilm, hardcopy, and magnetic tapes with older, obsolete formats. The Lunar Data Node (LDN) has been formed under the auspices of the Planetary Data System (PDS) Geosciences Node to put relevant, scientifically important Apollo data into accessible digital form for use by researchers and mission planners. The LDN has prioritized the restoration of these data based on their scientific and engineering value and the level of effort required. We will report on progress made and plans for future data restorations.

Williams, David R.↗