Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Catalog”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Scientific requirements for space science data systems

In the 1990's space plasma physics studies will increasingly involve correlative analysis of observations from multiple instruments and multiple spacecraft. The solar terrestrial physics missions in the 1990's will be designed around simultaneous observations from spacecraft monitoring the solar wind, the polar magnetosphere and the near and distant magnetotail. Within these regions, clusters of spacecraft flying in formation will increasingly involve comparative magnetospheric studies. No single lab will have the expertise to process and analyze all of the different types of data so the data repositories will be distributed. Catalog and browse systems will be required to help select events for study. Data compression techniques may be useful in designing the data bases used for selecting events for study. Data compression onboard the spacecraft will be necessary, since instrument data rates will be much larger than available telemetry rates. However, considerable care will be necessary to avoid losing valuable data when applying data compression algorithms.

Walker, Raymond J.↗

Transformation of OODT CAS to Perform Larger Tasks

A computer program denoted OODT CAS has been transformed to enable performance of larger tasks that involve greatly increased data volumes and increasingly intensive processing of data on heterogeneous, geographically dispersed computers. Prior to the transformation, OODT CAS (also alternatively denoted, simply, 'CAS') [wherein 'OODT' signifies 'Object-Oriented Data Technology' and 'CAS' signifies 'Catalog and Archive Service'] was a proven software component used to manage scientific data from spaceflight missions. In the transformation, CAS was split into two separate components representing its canonical capabilities: file management and workflow management. In addition, CAS was augmented by addition of a resource-management component. This third component enables CAS to manage heterogeneous computing by use of diverse resources, including high-performance clusters of computers, commodity computing hardware, and grid computing infrastructures. CAS is now more easily maintainable, evolvable, and reusable. These components can be used separately or, taking advantage of synergies, can be used together. Other elements of the transformation included addition of a separate Web presentation layer that supports distribution of data products via Really Simple Syndication (RSS) feeds, and provision for full Resource Description Framework (RDF) exports of metadata.

Mattmann, Chris↗

Astronomical Data Center Bulletin, volume 1, number 3

A catalog of galactic O-type stars, a machine-readable version of the bright star catalog, a two-micron sky survey, sky survey sources with problematical Durchmusterung identifications, data retrieval for visual binary stars, faint blue objects, the sixth catalog of galactic Wolf-Rayet stars, declination versus magnitude distribution, the SAO-HD-GC-DM cross index catalog, star cross-identification tables, astronomical sources, bibliographical star index search updates, DO-HD and HD-DO cross indices, and catalogs, are reviewed.

Mead, J. M.↗

Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement

Atmospheric data are collected by researchers every day. Campaigns such as GOAmazon 2014/2015 and the Amazon Tall Tower Observatory collect essential data on aerosols, gases, cloud properties, and meteorological parameters in the Brazilian Amazon basin. These data products provide insights and essential information for analyzing and predicting natural processes. However, in Brazil, it is estimated that more than 80% of the scientific data collected are not published due to the lack of web portals that collect and store these data. This makes it difficult, or even impossible, to access and integrate the data, which can result in the loss of significant amounts of information and significantly affect the understanding of the overall data. To address this problem, we propose a data portal architecture and open data deployment that enable Big Data processing, human interaction, and download-oriented approaches with tools that help users catalog, publish and visualize atmospheric data. Thus, we describe the architecture developed, based on the experience of the Atmospheric Radiation Measurement Data Center, which incorporates the principles of FAIR, the infrastructure and content management system for managing scientific data. The portal partial results were tested with environmental data from contaminated areas at the University of São Paulo. Overall, this data portal creates more shared knowledge about atmospheric processes by providing users with access to open environmental data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Clustering with Missing Values: No Imputation Required

Clustering algorithms can identify groups in large data sets, such as star catalogs and hyperspectral images. In general, clustering methods cannot analyze items that have missing data values. Common solutions either fill in the missing values (imputation) or ignore the missing data (marginalization). Imputed values are treated as just as reliable as the truly observed data, but they are only as good as the assumptions used to create them. In contrast, we present a method for encoding partially observed features as a set of supplemental soft constraints and introduce the KSC algorithm, which incorporates constraints into the clustering process. In experiments on artificial data and data from the Sloan Digital Sky Survey, we show that soft constraints are an effective way to enable clustering with missing values.

constraints↗

A survey of possible missions to the periodic comets in the interval 1974 - 2010

Catalogs are developed to survey the mission possibilities for the short period comets. In the first the physical and pertinent orbital characteristics are given for 65 short period comets. The second catalog is one containing the predicted perihelia for each of the 65 comets between 1974 and 2010. Geometry is included to indicate feasibility of Earth-based observation and sighting within 100 days of perihelion. The comets are divided on the basis of size and activity into three groups from the data in the first catalog: primary, secondary and low interest. The perihelia are separated into two groups: satisfactory and not satisfactory on the basis of earth-comet distance.

Bender, D. F.↗

Photometric redshift-aided classification using ensemble learning

We present SHEEP, a new machine learning approach to the classic problem of astronomical source classification, which combines the outputs from the XGBoost, LightGBM, and CatBoost learning algorithms to create stronger classifiers. A novel step in our pipeline is that prior to performing the classification, SHEEP first estimates photometric redshifts, which are then placed into the data set as an additional feature for classification model training; this results in significant improvements in the subsequent classification performance. SHEEP contains two distinct classification methodologies: (i) Multi-class and (ii) one versus all with correction by a meta-learner. We demonstrate the performance of SHEEP for the classification of stars, galaxies, and quasars using a data set composed of SDSS and WISE photometry of 3.5 million astronomical sources. The resulting F1 -scores are as follows: 0.992 for galaxies; 0.967 for quasars; and 0.985 for stars. In terms of the F1-scores for the three classes, SHEEP is found to outperform a recent RandomForest-based classification approach using an essentially identical data set. Our methodology also facilitates model and data set explainability via feature importances; it also allows the selection of sources whose uncertain classifications may make them interesting sources for follow-up observations.

79 ASTRONOMY AND ASTROPHYSICS↗

The initial data products from the EUVE software - A photon's journey through the End-to-End System

The End-to-End System (EES) is a unique collection of software modules created for use at the Center for EUV Astrophysics. The 'pipeline' is a shell script which executes selected EES modules and creates initial data products: skymaps, data sets for individual sources (called 'pigeonholes') and catalogs of sources. This article emphasizes the data from the all-sky survey, conducted between July 22, 1992 and January 21, 1993. A description of each of the major data products will be given and, as an example of how the pipeline works, the reader will follow a photon's path through the software pipeline into a pigeonhole. These data products are the primary goal of the EUVE all-sky survey mission, and so their relative importance for the follow-up science will also be discussed.

Antia, Behram↗

New astronomy space experiments with television scanning.

Application of data from the Celescope Catalog of Ultraviolet Observations to various problems of stellar and interstellar astrophysics. These include refinements in the incorporation of line blanketing in theoretical stellar-atmosphere models, variations in the law of interstellar extinction from one region of the sky to another, and selection and identification of various types of peculiar stars for further investigation. In addition, the data were analyzed to determine the photometric and astrometric accuracy of the Celescope equipment.

Davis, R. J.↗

Screening, cataloging and indexing of earth resource aircraft missions

Data obtained from 30 earth resources aircraft missions, flown between September 1, 1973 and September 1, 1974, were screened, cataloged, and indexed using microfilm copy. The manhours required for completing the task are presented, and problems encountered during the project are reported. It is concluded that a cataloging and indexing report of remote sensor data can be prepared on a timely basis for a relatively low cost from microfilm. Recommendations are given in order to further facilitate the task.

Source record↗

Data Release 1 of the Dark Energy Spectroscopic Instrument

In 2021 May the Dark Energy Spectroscopic Instrument (DESI) collaboration began a 5 yr spectroscopic redshift survey to produce a detailed map of the evolving three-dimensional structure of the Universe between z = 0 and z ≈ 4. DESI’s principal scientific objectives are to place precise constraints on the equation of state of dark energy, the gravitationally driven growth of large-scale structure, and the sum of the neutrino masses, and to explore the observational signatures of primordial inflation. We present DESI DR1, which consists of all data acquired during the first 13 months of the DESI main survey, as well as a uniform reprocessing of the DESI Survey Validation data, which were previously made public in the DESI Early Data Release. The DR1 main survey includes high-confidence redshifts for 18.7M objects, of which 13.1M are spectroscopically classified as galaxies, 1.6M as quasars, and 4M as stars, making DR1 the largest sample of extragalactic redshifts ever assembled. We summarize the DR1 observations, the spectroscopic data-reduction pipeline and data products, large-scale structure catalogs, value-added catalogs, and describe how to access and interact with the data. In addition to fulfilling its core cosmological objectives with unprecedented precision, we expect DR1 to enable a wide range of transformational astrophysical studies and discoveries.

79 ASTRONOMY AND ASTROPHYSICS↗

Repeating sources of classical gamma-ray bursts

From an analysis of the first catalog of the Burst and Transient Source Experiment (BATSE) experiment (Fishman et al. 1993, 1994a) on the Compton Gamma Ray Observatory (CGRO), we find an excessive number of pairs of gamma-ray bursts which are clustered in both a space and time . The angular separation between the two bursts in each pair is less than their positional uncertainties, and the interval between their occurrence times is within several days. Optimizing the signal, we find that the probability of observing such a clustered excess froma Poisson ensemble is approximately 2 x 10(exp -5). We suggest that these bursts arise from repeating sources. A detailed study of the most prolific source, GBS 0855-00, is presented in a separate paper (Wang & Lingenfelter 1993a, b). Unlike most of the 'soft' gamma-ray repeaters, these repeating bursts have relatively hard spectra, complex light curves, and widely varying durations, that are indistinguishable from classical gamma-ray bursts. Although the significance of the clustered excess was optimized a posteriori, because it depends on temporal and spatial bin sized that could not be defined a priori, we can use the optimizations from the first catalog to test subsequent BATSE data sets. Unfortunately, the failure of the on-board tape recorders during the second catalog period seriously reduced the number of accurately positioned bursts (Fishman et al. 1994b), so that we can neither confirm, nor refute, the predicted repitition in that sample, and we must await the results of the third catalog.

Wang, V. C.↗

An Einstein Observatory SAO-based catalog of B-type stars

About 4000 X-ray images obtained with the Einstein Observatory are used to measure the 0.16-4.0 keV emission from 1545 B-type SAO stars falling in the about 10 percent of the sky surveyed with the IPC. Seventy-four detected X-ray sources with B-type stars are identified, and it is estimated that no more than 15 can be misidentified. Upper limits to the X-ray emission of the remaining stars are presented. In addition to summarizing the X-ray measurements and giving other relevant optical data, the present extensive catalog discusses the reduction process and analyzes selection effects associated with both SAO catalog completeness and IPC target selection procedures. It is concluded that X-ray emission, at the level of Lx not less than 10 exp 30 ergs/s, is quite common in B stars of early spectral types (B0-B3), regardless of luminosity class, but that emission, at the same level, becomes less common, or nonexistent, in later B-type stars.

Grillo, F.↗

TLSLEAF: Automatic Leaf Angle Estimates From Single-Scan Terrestrial Laser Scanning

Leaf angle distribution (LAD) in forest canopies affects estimates of leaf area, light interception, and global-scale photosynthesis, but is often simplified to a single theoretical value. Here, we present TLSLeAF (Terrestrial Laser Scanning Leaf Angle Function), an automated open-source method of deriving LADs from terrestrial laser scanning. TLSLeAF produces canopy-scale leaf angle and LADs by relying on gridded laser scanning data. The approach increases processing speed, improves angle estimates, and requires minimal user input. Key features are automation, leaf–wood classification, beta parameter output, and implementation in R to increase accessibility for the ecology community. TLSLeAF precisely estimates leaf angle with minimal distance effects on angular estimates while rapidly producing LADs on a consumer-grade machine. We challenge the popular spherical LAD assumption, showing sensitivity to ecosystem type in plant area index and foliage profile estimates that translate to c. 25% and c. 11% increases in canopy net photosynthesis (c. 25%) and solar-induced chlorophyll fluorescence (c. 11%). TLSLeAF can now be applied to the vast catalog of laser scanning data already available from ecosystems around the globe. The ease of use will enable widespread adoption of the method outside of remote-sensing experts, allowing greater accessibility for addressing ecological hypotheses and large-scale ecosystem modeling efforts.

3D↗

A Strategic Approach to Medical Care for Exploration Missions

Exploration missions will present significant new challenges to crew health, including effects of variable gravity environments, limited communication with Earth-based personnel for diagnosis and consultation for medical events, limited resupply, and limited ability for crew return. Providing health care capabilities for exploration class missions will require system trades be performed to identify a minimum set of requirements and crosscutting capabilities which can be used in design of exploration medical systems. Current and future medical data, information, and knowledge must be cataloged and put in formats that facilitate querying and analysis. These data may then be used to inform the medical research and development program through analysis of risk trade studies between medical care capabilities and system constraints such as mass, power, volume, and training. These studies will be used to define a Medical Concept of Operations to facilitate stakeholder discussions on expected medical capability for exploration missions. Medical Capability as a quantifiable variable is proposed as a surrogate risk metric and explored for trade space analysis that can improve communication between the medical and engineering approaches to mission design. The resulting medical system approach selected will inform NASA mission architecture, vehicle, and subsystem design for the next generation of spacecraft.

Antonsen, E.↗

Data management for support of the Oregon Transect Ecosystem Research (OTTER) project

Management of data collected during projects that involve large numbers of scientists is an often overlooked aspect of the experimental plan. Ecosystem science projects like the Oregon Transect Ecosystem Research (OTTER) Project that involve many investigators from many institutions and that run for multiple years, collect and archive large amounts of data. These data range in size from a few kilobytes of information for such measurements as canopy chemistry and meteorological variables, to hundreds of megabytes of information for such items as views from multi-band spectrometers flown on aircraft and scenes from imaging radiometers aboard satellites. Organizing and storing data from the OTTER Project, certifying those data, correcting errors in data sets, validating the data, and distributing those data to other OTTER investigators is a major undertaking. Using the National Aeronautics and Space Administration's (NASA) Pilot Land Data System (PLDS), a Support mechanism was established for the OTTER Project which accomplished all of the above. At the onset of the interaction between PLDS and OTTER, it was not certain that PLDS could accomplish these tasks in a manner that would aid researchers in the OTTER Project. This paper documents the data types that were collected under the auspices of the OTTER Project and the procedures implemented to store, catalog, validate, and certify those data. The issues of the compliance of investigators with data-management requirements, data use and certification, and the ease of retrieving data are discussed. We advance the hypothesis that formal data management is necessary in ecological investigations involving multiple investigators using many data gathering instruments and experimental procedures. The issues and experience gained in this exercise give an indication of the needs for data management systems that must be addressed in the coming decades when other large data-gathering endeavors are undertaken by the ecological science community.

Skiles, J. W.↗

Enhancing Discovery, Search, and Access of NASA Hydrological Data by Leveraging GEOSS

An ongoing NASA-funded project has removed a longstanding barrier to accessing NASA data (i.e., accessing archived time-step array data as point-time series) for selected variables of the North American and Global Land Data Assimilation Systems (NLDAS and GLDAS, respectively) and other EOSDIS (Earth Observing System Data Information System) data sets (e.g., precipitation, soil moisture). These time series (data rods) are pre-generated. Data rods Web services are accessible through the CUAHSI Hydrologic Information System (HIS) and the Goddard Earth Sciences Data and Information Services Center (GES DISC) but are not easily discoverable by users of other non-NASA data systems. The Global Earth Observation System of Systems (GEOSS) is a logical mechanism for providing access to the data rods. An ongoing GEOSS Water Services project aims to develop a distributed, global registry of water data, map, and modeling services cataloged using the standards and procedures of the Open Geospatial Consortium and the World Meteorological Organization. The ongoing data rods project has demonstrated the feasibility of leveraging the GEOSS infrastructure to help provide access to time series of model grid information or grids of information over a geographical domain for a particular time interval. A recently-begun, related NASA-funded ACCESS-GEOSS project expands on these prior efforts. Current work is focused on both improving the performance of the generation of on-the-fly (OTF) data rods and the Web interfaces from which users can easily discover, search, and access NASA data.

GEOSS↗