SEARCH · Engineering Papers

Results for “Data Catalog”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

All sources NASA NTRS DOE OSTI

NASA NTRS2014

Aggregation Tool to Create Curated Data albums to Support Disaster Recovery and Response

Despite advances in science and technology of prediction and simulation of natural hazards, losses incurred due to natural disasters keep growing every year. Natural disasters cause more economic losses as compared to anthropogenic disasters. Economic losses due to natural hazards are estimated to be around $6-$10 billion dollars annually for the U.S. and this number keeps increasing every year. This increase has been attributed to population growth and migration to more hazard prone locations such as coasts. As this trend continues, in concert with shifts in weather patterns caused by climate change, it is anticipated that losses associated with natural disasters will keep growing substantially. One of challenges disaster response and recovery analysts face is to quickly find, access and utilize a vast variety of relevant geospatial data collected by different federal agencies such as DoD, NASA, NOAA, EPA, USGS etc. Some examples of these data sets include high spatio-temporal resolution multi/hyperspectral satellite imagery, model prediction outputs from weather models, latest radar scans, measurements from an array of sensor networks such as Integrated Ocean Observing System etc. More often analysts may be familiar with limited, but specific datasets and are often unaware of or unfamiliar with a large quantity of other useful resources. Finding airborne or satellite data useful to a natural disaster event often requires a time consuming search through web pages and data archives. Additional information related to damages, deaths, and injuries requires extensive online searches for news reports and official report summaries. An analyst must also sift through vast amounts of potentially useful digital information captured by the general public such as geo-tagged photos, videos and real time damage updates within twitter feeds. Collecting and aggregating these information fragments can provide useful information in assessing damage in real time and help direct recovery efforts. The search process for the analyst could be made much more efficient and productive if a tool could go beyond a typical search engine and provide not just links to web sites but actual links to specific data relevant to the natural disaster, parse unstructured reports for useful information nuggets, as well as gather other related reports, summaries, news stories, and images. This presentation will describe a semantic aggregation tool developed to address similar problem for Earth Science researchers. This tool provides automated curation, and creates "Data Albums" to support case studies. The generated "Data Albums" are compiled collections of information related to a specific science topic or event, containing links to relevant data files (granules) from different instruments; tools and services for visualization and analysis; information about the event contained in news reports, and images or videos to supplement research analysis. An ontology-based relevancy-ranking algorithm drives the curation of relevant data sets for a given event. This tool is now being used to generate a catalog of Hurricane Case Studies at Global Hydrology Resource Center (GHRC), one of NASA's Distribute Active Archive Centers. Another instance of the Data Albums tool is currently being created in collaboration with NASA/MSFC's SPoRT Center, which conducts research on unique NASA products and capabilities that can be transitioned to the operational community to solve forecast problems. This new instance focuses on severe weather to support SPoRT researchers in their model evaluation studies

Ramachandran, Rahul↗

NASA NTRS1982

The astronomical data base and retrieval system at NASA

More than 250 machine-readable catalogs of stars and extended celestial objects are now available at the NASA/Goddard Space Flight Center (GSFC) as the result of over a decade of catalog acquisition, verification and documentation. Retrieval programs are described which permit the user to obtain from a remote terminal bibliographical listings for stars; to find all celestial objects from a given list that are within a defined angular separation from each object in another list; to plot celestial objects on overlays for sky survey plate areas; and to search selected catalogs for objects by criteria of position, identification number, magnitude or spectral type.

Mead, J. M.↗

DOE OSTI2025

Validating the galaxy and quasar catalog-level blinding scheme for the DESI 2024 analysis

In the era of precision cosmology, ensuring the integrity of data analysis through blinding techniques is paramount — a challenge particularly relevant for the Dark Energy Spectroscopic Instrument (DESI). DESI represents a monumental effort to map the cosmic web, with the goal to measure the redshifts of tens of millions of galaxies and quasars. Given the data volume and the impact of the findings, the potential for confirmation bias poses a significant challenge. To address this, we implement and validate a comprehensive blind analysis strategy for DESI Data Release 1 (DR1), tailored to the specific observables DESI is most sensitive to: Baryonic Acoustic Oscillations (BAO), Redshift-Space Distortion (RSD) and primordial non-Gaussianities (PNG). We carry out the blinding at the catalog level, implementing shifts in the redshifts of the observed galaxies to blind for BAO and RSD signals and weights to blind for PNG through a scale-dependent bias. We validate the blinding technique on mocks as well as on data by applying a second blinding layer to perform a series of sanity checks; the latter allows probing complexities in real data not captured in mocks. We find that the blinding strategy alters the data vector in a controlled way, and the BAO and RSD analysis choices are robust to blinding. The successful validation of the blinding strategy paves the way for the unblinded DESI DR1 analysis, alongside future blind analyses with DESI and other surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data

We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation (emulator) used in the mocks. Importantly, we find a close agreement (≤ 8% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, making it particularly relevant to the broad current and future analyses of DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1993

A catalog of intracluster gas temperatures

We have searched the Einstein Monitor Proportional Counter (MPC) data base for observations of clusters of galaxies. By coadding the MPC spectra obtained during all pointed observations of clusters with IPC count rates greater than 0.1 counts/s, we have obtained sufficient photon statistics to estimate the X-ray temperature of 84 clusters. Combining the MPC results with EXOSAT and Ginga results reported in the literature yields a combined sample of 104 clusters with known X-ray temperatures. One of the best studied X-ray correlations between clusters is that between their X-ray luminosity and gas temperature. We show that the best-fit power-law relation for our combined cluster sample can be explained by the observed increase in the gas-to-stellar mass ratio between low- and high-temperature clusters. The statistical significance of any evolution in our combined X-ray sample has been examined and compared with the statistical properties of clusters culled from optical catalogs. We find that there is strong evidence for a decrease in the X-ray luminosity of optically rich clusters beyond z approximately about 0.06. This result is used to estimate the normalization of the primordial power spectrum of density fluctuations.

David, L. P.↗

NASA NTRSDate not supplied

DIP for Service Providers

The second DIP workshop’s topic is DIP for Service Providers. The workshop presentation covers topics such as DIP onboarding process, service authentication, catalog service capabilities, API requirements, NASA services and their access points, and data requirements for service providers. The Onboarding Process describes the required documentation that enables to collaborate with NASA as well as other industry partners through DIP. Also, step by step approach for the partner to take to register services or consme services through the DIP platform. The Catalog Service describes the different ways for the users to search for services that are of interest as well as registering services to the platform, so other users can search and discover. The API Requirements and Service Specifications describes the benefits of DIP's API management approach via API Gateway where services are managed centrally but ownership is decentralized and partners completely own the administration of their own services. NASA Services and Data Access Points topic describes the services, both data access service and machine learning prediction service, that NASA provides via the DIP platform in near time and post operations via REST API endpoints defined on the API Gateway. Also, NASA's approach for data storage process is explained. The Data Requirements for service providers describes the requirements for storing and exposing to support the performance of services that are provided by the service providers. Lastly, NASA's technology development plan with preliminary scheduler will be presented. There will be a Q&A session at the end of each segment of the presentation to solicit feedback from the participants.

ATM-X↗

DOE OSTI2022

Deep Realistic Extragalactic Model (DREaM) Galaxy Catalogs: Predictions for a Roman Ultra-deep Field

In the next decade, deep galaxy surveys from telescopes such as the James Webb Space Telescope and Roman Space Telescope will provide transformational data sets that will greatly enhance the understanding of galaxy formation during the epoch of reionization (EoR). In this work, we present the Deep Realistic Extragalactic Model (DREaM) for creating synthetic galaxy catalogs. Our model combines dark matter simulations, subhalo abundance matching and empirical models, and includes galaxy positions, morphologies, and spectral energy distributions. The resulting synthetic catalog extends to redshifts z ~ 12, and galaxy masses log 10 (M/M ⊙ ) = 5 covering an area of 1 deg 2 on the sky. We use DREaM to explore the science returns of a 1 deg 2 Roman ultra-deep field (UDF), and to provide a resource for optimizing ultra-deep survey designs. We find that a Roman UDF to ~30 m AB will potentially detect more than 10 6 M UV < -17 galaxies, with more than 10 4 at redshifts z > 7, offering an unparalleled data set for constraining galaxy properties during the EoR. Our synthetic catalogs and simulated images are made publicly available to provide the community with a tool to prepare for upcoming data.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1985

The generation of infrared and ultraviolet astronomical data bases and retrieval systems

Observations with the Infrared Astronomy Satellite (IRAS) and with the International Ultraviolet Explorer (IUE) satellite have stimulated the need for machine-readable data bases at infrared and ultraviolet wavelengths along with associated software. This paper describes the generation of three such data sets at the Astronomical Data Center (ADC) of the NASA-Goddard Space Flight Center (GSFC): the Catalog of Infrared Observations, the Combined List of Astronomical Sources, and the Bibliographical Index of Objects Observed by IUE 1978-82. The discussion is divided by spectral regime and includes summaries of the data products developed in each category.

Mead, J. M.↗

NASA NTRS2011

Integrating Machine Learning into a Crowdsourced Model for Earthquake-Induced Damage Assessment

On January 12th, 2010, a catastrophic 7.0M earthquake devastated the country of Haiti. In the aftermath of an earthquake, it is important to rapidly assess damaged areas in order to mobilize the appropriate resources. The Haiti damage assessment effort introduced a promising model that uses crowdsourcing to map damaged areas in freely available remotely-sensed data. This paper proposes the application of machine learning methods to improve this model. Specifically, we apply work on learning from multiple, imperfect experts to the assessment of volunteer reliability, and propose the use of image segmentation to automate the detection of damaged areas. We wrap both tasks in an active learning framework in order to shift volunteer effort from mapping a full catalog of images to the generation of high-quality training data. We hypothesize that the integration of machine learning into this model improves its reliability, maintains the speed of damage assessment, and allows the model to scale to higher data volumes.

crowdsourcing↗

DOE OSTI2021

AbacusSummit Halo Light Cone Catalogs

This is a set of halo light cone catalogs from the AbacusSummit suite of cosmological N-body simulations (abacussummit.readthedocs.io/). They are a value-added data product provided by post-processing the simulation output. The main application of the halo light cone catalogs is the construction of realistic mock galaxy catalogues and weak lensing maps on the sky. The algorithm (described in Hadzhiyska et al. 2021) associates CompaSO halos from 29 redshift epochs spanning z = 0.1-2.5 with their particles at the time of light-cone crossing. It then records the halo and particle information into an easily accessible product, which can be read with the CompaSO reader. The 25 base resolution boxes at fiducial cosmology have a halo light cone catalog covering an octant of the sky to z approx 0.8 and about 2000 deg2 extending to z approx 2.4. The huge boxes provide light cone information of the full sky until z approx 2.18 and extend further towards the corners of the box (available until z = 2.25). Galaxy mock catalogs on the sky can be generated easily though the AbacusHOD script providing an extended HOD framework (see Yuan et al. 2021, for details), which has been modified to work with the halo light cone catalogs. The available tracers are luminous red galaxies (LRGs), emission-line galaxies (ELGs), and quasi-stellar objects (QSOs).

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1990

A synopsis of Langley Research Center's lidar effort for the 1986 FIRE IFO

The lidar data obtained by the Langley Aircraft Lidar in October 1986 in Wisconsin is being reduced in a transparent, simple fashion and will be published in its reduced form in a NASA Reference Publication (RP). This reduced data will also be submitted to the FIRE data archives. Some of this reduced data will be presented at the FIRE FSET Workshop to acquaint the science team with the data format to be used in the archive and the upcoming catalog contained in the RP. A new method was utilized in Wisconsin for obtain the depolarization ratio of aerosols. This method involves using a half-wave plate to calibrate the lidar under field conditions. The theory behind this technique will be presented at this workshop as well as some of the lidar calibration results. The lidar calibration will be utilized in interpreting some of the dual polarization lidar data obtained during the IFO in Wisconsin. Some of these data are also discussed. A continuous wave laser lab-type lidar simulator was constructed during the previous year. One of the primary reasons for the construction of the simulator was to attempt dual-polarization lidar-like calibrations under laboratory, rather than field conditions. The data collected by this system was used to experimentally check and thus, inspire confidence in the algorithms being used to interpret the lidar data obtained in the field. A computer program which simulates noisy lidar data was used as a part of this effort in order to obtain some feel for the noise in the inversion parameters as a function of noise in the actual measurements. The lidar simulation will be described in addition to presenting some of the lab-generated calibration data.

Alvarez, Jose M.↗

DOE OSTI2021

Central Asia Seismic Hazard Assessment (Casha) "Complete" Catalog of Earthquakes

Probabilistic Seismic Hazard Assessments (PSHA) greatly benefit from reliable earthquake catalogs. Central Asia, while rich in seismic monitoring history, reports a fraction of their earthquake data to international data collection centres. Furthermore, since the collapse of Soviet Union until now, monitoring and data collection efforts in Central Asia have not been centralized, making monitoring and reporting uneven and disconnected in this time period. Lawrence Livermore National Laboratory (LLNL) has undertaken a multi-year effort to systematically work with national seismic monitoring and data centres and seismic networks in Kazakhstan, Kyrgyzstan, and Tajikistan to compile a unified seismological bulletin for Central Asia. In tandem with this effort, an earthquake catalog that is processed to be PSHA ready was also generated. The processing for this effort included further duplicate identification and removal, magnitude harmonization and catalog completeness analyses. This report describes the “complete” PSHA-ready earthquake catalog, including the completeness intervals that were applied.

58 GEOSCIENCES↗

DOE OSTI2025

The Pan-Arctic Vegetation Cover (PAVC) database v1.1

The Pan-Arctic Vegetation Cover (PAVC) database contains synthesized field-data observations of vegetation cover from 978 Arctic Alaska plots with observations from 2010 to 2021. The cover datasets contain plot data at both the plant functional type (PFT) and species-level resolution, with standardized PFT definitions and species names. We synthesized publicly available point-intercept and visual estimate plots from the Arctic Vegetation Archive of Alaska, the Alaska Vegetation Plots Database, the North Slope Science Catalog, and the National Ecological Observatory Network; as well as previously unpublished data from the Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic).Users will find four synthesized datasets, 4 associated data descriptor (dd) files, and 1 metadata file in the PAVC database:synthesized_species_fcover.csv contains fractional cover (fcover) for unique accepted species names, where names include vegetation identified at the family, genus, species, subspecies, and variety levels, as well as general functional types across all 5 data sources. The synthesized_species_fcover_dd.csv accompanies this dataset with header information.synthesized_pft_fcover.csv contains fcover for the following PFTs: non-vascular plants with lichen and bryophyte subcategories, trees with deciduous and evergreen subcategories, shrubs with deciduous and evergreen subcategories, graminoids (grasses), and forbs (herbaceous flowering plants) measured as total cover. Litter and “other” cover are also included as total cover. Additional “types” include water and bare ground, which were measured as top cover. The synthesized_pft_fcover_dd.csv accompanies this dataset with header information.species_pft_checklist.csv is a lookup table containing the translation from a dataset species name to an accepted species name and to a PFT. This table can be used to clarify our species to PFT adjudications, and to aid users in assigning their own PFTs. Any issues found in this checklist should be reported in the Issues tab of our github.survey_unit_information.csv contains auxiliary information about the plots synthesized in this database. It contains useful information for filtering plots of interest based on temporal, geospatial, and contextual information about the plot surveys.flmd.csv contains metadata information about each file in the database.This research was performed as a part of the NGEE Arctic project. The NGEE Arctic project was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2019

Highlighting Recent Uses of the NASA Worldview Mapping Application

NASA’s Worldview (https://worldview.earthdata.nasa.gov/) web mapping application from the Earth Observing System Data and Information System (EOSDIS) provides a low friction solution for users of different scientific backgrounds to access satellite imagery and data products. Worldview uses imagery from the Global Imagery Browse Services (GIBS), which has an increasing catalog of 800+ products serving global, full-resolution satellite imagery from NASA’s Earth observing fleet. NASA promotes the open sharing of all data with researchers, private industry, academia, and the general public. Worldview encourages this open data policy. Numerous general news publications feature Worldview for its unique imagery. Worldview also helps scholarly research in identifying field research locations, mapping thermal hotspots of active burning fires, and visualizing theoretical models of weather storm systems amongst other uses. This presentation shares some recent uses of Worldview which highlight its capabilities.

Plato, Edward A.↗

NASA NTRS2019

Highlighting Recent Uses of the NASA Worldview Mapping Application

Plato, Edward A.↗

DOE OSTI2020

Trans-Neptunian Objects Found in the First Four Years of the Dark Energy Survey

In this paper, we present a catalog of 316 trans-Neptunian bodies (TNOs) detected from the first four seasons ("Y4" data) of the Dark Energy Survey (DES). The survey covers a contiguous 5000 deg 2 of the southern sky in the grizY optical/NIR filter set, with a typical TNO in this part of the sky being targeted by 25–30 Y4 exposures. This paper focuses on the methods used to detect these objects from the ≈60,000 Y4 exposures, a process made challenging by the absence of the few-hour repeat observations employed by TNO-optimized surveys. Newly developed techniques include: transient/moving object detection by comparison of single-epoch catalogs to catalogs of "stacked" images; quantified astrometric error from atmospheric turbulence; new software for detecting TNO linkages in a temporally sparse transient catalog, and for estimating the rate of spurious linkages; use of faint stars to determine the detection efficiency versus magnitude in all exposures. Final validation of the reality of linked orbits uses a new "sub-threshold confirmation" test, wherein we demand the object be detectable in a stack of the exposures in which the orbit indicates an object should be present, but was not individually detected. This catalog contains all validated TNOs which were detected on ≥6 unique nights in the Y4 data, and is complete to r 23.3 mag with virtually no dependence on orbital properties for bound TNOs at distance 30 au < d < 2500 au. The catalog includes 245 discoveries by DES, 139 not previously published. The final DES TNO catalog is expected to yield >0.3 mag more depth, and arcs of >4 yr for nearly all detections.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

Combining Spectroscopic and Imaging Galaxy Surveys for Improved Measurements of Large-Scale Structure

Galaxy imaging surveys represent a promising opportunity for testing cosmological models but suffer from significant challenges associated with galaxy redshift uncertainty. I present improved techniques for the use of spectroscopic redshifts for measurements of large-scale structure with galaxy imaging surveys. I additionally present the results of the application of these techniques to data from the Sloan Digital Sky Survey (SDSS) and the Dark Energy Survey (DES). The results of my work are photometric redshift measurements of the approximately 100 million galaxies comprising the the DES Year 3 Weak Lensing Source Galaxy Catalog, constraints on parameters of the Lambda-CDM cosmological model based on the gravitational lensing and clustering of the DES Year 3 source and lens galaxy catalogs, an algorithm for propagating uncertainties measured in simulations to analogous measurements on data, and measurements of the incidence of projection effects in optically detected clusters of galaxies. I argue that continued development of the methods I have worked on is a promising path toward a conclusive test of Lambda-CDM with galaxy surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2000

The Spectral Evolution of Solar Flare Hard X-Ray Emission Observed with BATSE

We present a more detailed characterization of spectral evolution in solar flare hard X-ray emission than has been previously described. Our characterization is consistent with some earlier results but utilizes higher time resolution data and reveals nuances in spectral evolution that have never been reported. We employ an underutilized data set, the Burst and Transient Source Experiment (BATSE) solar flare catalog, for our investigation and different methodology than previous studies. Our findings support the conclusion that properties of the particle Abstract: acceleration mechanism in flares, such as the acceleration rate or efficiency, are indeed important to understanding spectral evolution. On the other hand, time-of-flight models, which assume accelerator properties to be negligible, cannot explain the observed detailed spectral evolution, and correlations that we would expect to exist between spectral evolution patterns and parameters derived from time-of-flight model inversions are not supported by the data. In this fashion, we establish an observational context in which to interpret future High Energy Solar Spectroscopic Imager (HESSI) observations and delineate some constraints for theoretical models of particle acceleration.

Newton, Elizabeth K.↗