Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Catalog”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Nowcasting Earthquakes With Stochastic Simulations: Information Entropy of Earthquake Catalogs

Earthquake nowcasting has been proposed as a means of tracking the change in large earthquake potential in a seismically active area. The method was developed using observable seismic data, in which probabilities of future large earthquakes can be computed using Receiver Operating Characteristic methods. Furthermore, analysis of the Shannon information content of the earthquake catalogs has been used to show that there is information contained in the catalogs, and that it can vary in time. So an important question remains, where does the information originate? In this paper, we examine this question using stochastic simulations of earthquake catalogs. Our catalog simulations are computed using an Earthquake Rescaled Aftershock Seismicity (“ERAS”) stochastic model. This model is similar in many ways to other stochastic seismicity simulations, but has the advantage that the model has only 2 free parameters to be set, one for the aftershock (Omori-Utsu) time decay, and one for the aftershock spatial migration away from the epicenter. Generating a simulation catalog and fitting the two parameters to the observed catalog such as California takes only a few minutes of wall clock time. While clustering can arise from random, Poisson statistics, we show that significant information in the simulation catalogs arises from the “non-Poisson” power-law aftershock clustering, implying that the practice of de-clustering observed catalogs may remove information that would otherwise be useful in forecasting and nowcasting. We also show that the nowcasting method provides similar results with the ERAS model as it does with observed seismicity.

58 GEOSCIENCES↗
DOE OSTI2023

A Data Processing Pipeline for Socio-Technical Network Analysis [Slides]

With the rapid adoption of emerging technologies, there is a need to catalog and model sociotechnical interdependencies that have been historically used to influence the operation of Critical Infrastructure networks including the impacts of mergers and acquisitions, hostile takeovers, and foreign investment. Our research intends to address this need with two primary contributions. First, we have developed a data curation and processing pipeline to generate sociotechnical networks extracted from a variety of data sources including SEC filings and infrastructure asset databases. The pipeline, implemented in Apache Airflow, extracts and normalizes the representation of entities and relations, specified within ontologies. Second, networks produced by our pipeline enable the development of graph-theoretic metrics that consider the properties of network components in addition to its topology. Measures of network complexity, such as degree distribution, reachability analyses, temporal analysis, and community detection may be adapted to indicate adversarial organizational influence. Our intent is to provide an extensible, machine-actionable approach to quickly communicate such models, reproduce previous results, and adapt them to new, unanticipated situations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A Data Processing Pipeline for Adversarial Socio-Technical Network Analysis

With the rapid adoption of emerging technologies, there is a need to catalog and model sociotechnical interdependencies that have been historically used to influence the operation of Critical Infrastructure networks including the impacts of mergers and acquisitions, hostile takeovers, and foreign investment. Our research intends to address this need with two primary contributions. First, we have developed a data curation and processing pipeline to generate sociotechnical networks extracted from a variety of data sources including SEC filings and infrastructure asset databases. The pipeline, implemented in Apache Airflow, extracts and normalizes the representation of entities and relations, specified within ontologies. Our intent is to provide an extensible, machine-actionable approach to quickly communicate such models, reproduce previous results, and adapt them to new, unanticipated situations. Second, networks produced by our pipeline enable the development of graph-theoretic metrics that consider the properties of network components in addition to its topology. Metadata associated with network components---whether semantic, temporal, or geospatial---affects the alignment of generated networks with assumptions underlying complexity metrics. Validation of generated networks relative to component types defined by an ontology, may allow the research community to adapt metrics to the semantics of the domains being studied. Generated networks may be processed as knowledge, dynamic, or spatial graphs and enables a variety of analyses including automated reasoning and measures of network complexity. Automated reasoning views extracted entities and relations as a knowledge graph; this enables application of inference rules that represent historically-attested adversarial business methods and applies that behavior to a specific geographic context. Measures of network complexity, including degree distribution, reachability analyses, temporal analysis, and community detection can be adapted to indicate adversarial organizational influence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Blinding scheme for the scale-dependence bias signature of local primordial non-Gaussianity for DESI 2024

The next generation of spectroscopic surveys is expected to achieve an unprecedented level of accuracy in the measurement of cosmological parameters. To avoid confirmation bias and thereby improve the reliability of these results, blinding procedures become a standard practice in the cosmological analyses of such surveys. Blinding is especially crucial when the impact of observational systematics is important relative to the cosmological signal, and a detection of that signal would have significant implications. This is the case for local primordial non-gaussianity, as probed by the scale-dependent bias of the galaxy power spectrum at large scales that are heavily sensitive to the dependence of the target selection on the imaging quality, known as imaging systematics. We propose a blinding method for the scale-dependent bias signature of local primordial non-gaussianity at the density field level which consists in generating a set of weights for the data that replicate the scale-dependent bias. The applied blinding is predictable, and can be straightforwardly combined with other catalog-level blinding procedures that have been designed for the baryon acoustic oscillation and redshift space distortion signals. The procedure is validated through simulations that replicate data from the first year of observation of the Dark Energy Spectroscopic Instrument, but may find applications to other upcoming spectroscopic surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Updated Void Catalogs of the SDSS DR7 Main Sample

Abstract We produce several public void catalogs using a volume-limited subsample of the Sloan Digital Sky Survey Data Release 7 (SDSS DR7). Using new implementations of three different void-finding algorithms, VoidFinder and two ZOBOV-based algorithms (VIDE and REVOLVER), we identify 1163, 531, and 518 cosmic voids with radii >10 h −1 Mpc, respectively, out to a redshift of z = 0.114 assuming a Planck 2018 cosmology, and 1184, 535, and 519 cosmic voids assuming a WMAP5 cosmology. We compute effective radii and centers for all voids and find none with an effective radius >54 h −1 Mpc. The median void effective radius is 15–19 h −1 Mpc for all three algorithms. We extract and discuss several properties of the void populations, including radial density profiles, the volume fraction of the catalog contained within voids, and the fraction of galaxies contained within voids. Using 64 mock galaxy catalogs created from the Horizon Run 4 N -body simulation, we compare simulated and observed void properties and find good agreement between the SDSS DR7 and mock catalog results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Predicting Solar Energetic Particles Using SDO/HMI Vector Magnetic Data Products and a Bidirectional LSTM Network

Solar energetic particles (SEPs) are an essential source of space radiation, and are hazardous for humans in space, spacecraft, and technology in general. In this paper, we propose a deep-learning method, specifically a bidirectional long short-term memory (biLSTM) network, to predict if an active region (AR) would produce an SEP event given that (i) the AR will produce an M- or X-class flare and a coronal mass ejection (CME) associated with the flare, or (ii) the AR will produce an M- or X-class flare regardless of whether or not the flare is associated with a CME. The data samples used in this study are collected from the Geostationary Operational Environmental Satellite's X-ray flare catalogs provided by the National Centers for Environmental Information. We select M- and X-class flares with identified ARs in the catalogs for the period between 2010 and 2021, and find the associations of flares, CMEs, and SEPs in the Space Weather Database of Notifications, Knowledge, Information during the same period. Each data sample contains physical parameters collected from the Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory. Experimental results based on different performance metrics demonstrate that the proposed biLSTM network is better than related machine-learning algorithms for the two SEP prediction tasks studied here. We also discuss extensions of our approach for probabilistic forecasting and calibration with empirical evaluation

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

The Hobby–Eberly Telescope Dark Energy Experiment (HETDEX) Survey Design, Reductions, and Detections*

In this work, we describe the survey design, calibration, commissioning, and emission-line detection algorithms for the Hobby–Eberly Telescope Dark Energy Experiment (HETDEX). The goal of HETDEX is to measure the redshifts of over a million Lyα emitting galaxies between 1.88 < z < 3.52, in a 540 deg 2 area encompassing a comoving volume of 10.9 Gpc 3 . No preselection of targets is involved; instead the HETDEX measurements are accomplished via a spectroscopic survey using a suite of wide-field integral field units distributed over the focal plane of the telescope. This survey measures the Hubble expansion parameter and angular diameter distance, with a final expected accuracy of better than 1%. Additionally, we detail the project's observational strategy, reduction pipeline, source detection, and catalog generation, and present initial results for science verification in the Cosmological Evolution Survey, Extended Groth Strip, and Great Observatories Origins Deep Survey North fields. We demonstrate that our data reach the required specifications in throughput, astrometric accuracy, flux limit, and object detection, with the end products being a catalog of emission-line sources, their object classifications, and flux-calibrated spectra.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

The Atacama Cosmology Telescope: Summary of DR4 and DR5 Data Products and Data Access

Two recent large data releases for the Atacama Cosmology Telescope (ACT), called DR4 and DR5, are available for public access. These data include temperature and polarization maps that cover nearly half the sky at arcminute resolution in three frequency bands; lensing maps and component-separated maps covering ~ 2,100 deg 2 of sky; derived power spectra and cosmological likelihoods; a catalog of over 4,000 galaxy clusters; and supporting ancillary products including beam functions and masks. The data and products are described in a suite of ACT papers; here we provide a summary. In order to facilitate ease of access to these data we present a set of Jupyter IPython notebooks developed to introduce users to DR4, DR5, and the tools needed to analyze these data. The data products (excluding simulations) and the set of notebooks are publicly available on the NASA Legacy Archive for Microwave Background Data Analysis (LAMBDA); simulation products are available on the National Energy Research Scientific Computing Center (NERSC).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Photometric calibration in u -band using blue halo stars

ABSTRACT We develop a method to calibrate u-band photometry based on the observed colour of blue Galactic halo stars. The Galactic halo stars belong to an old stellar population of the Milky Way and have relatively low metallicity. The ‘blue tip’ of the halo population – the main sequence turn-off (MSTO) stars – is known to have a relatively uniform intrinsic edge u-g colour with only slow spatial variation. In SDSS data, the observed variation is correlated with Galactic Latitude, which we attribute to contamination by higher metallicity disc stars and fit with an empirical curve. This curve can then be used to calibrate u-band imaging if g-band imaging of matching depth is available. Our approach can be applied to single-field observations at |b| > 30°, and removes the need for standard star observations or overlap with calibrated u-band imaging. We include in our method the calibration of g-band data with ATLAS-Refcat2. We test our approach on stars in KiDS DR 4, ATLAS DR 4, and DECam imaging from the NOIRLab Source Catalog (NSC DR2), and compare our calibration with SDSS. For this process, we use synthetic magnitudes to derive the colour equations between these data sets, in order to improve zero-point accuracy. We find an improvement for all data sets, reaching a zero-point precision of 0.016 mag for KiDS (compared to the original 0.033 mag), 0.020 mag for ATLAS (originally 0.027 mag), and 0.016 mag for DECam (originally 0.041 mag). Thus, this method alone reaches the goal of 0.02 mag photometric precision in u-band for the Rubin Observatory’s Legacy Survey of Space and Time (LSST).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Cosmic filaments from cosmic strings

Cosmic strings are generically predicted in many extensions of the Standard Model of particle physics. In this work, we propose a new avenue for detecting cosmic strings through their effect on the filamentary structure in the cosmic web. Using cosmological simulations of the density wake from a cosmic string, we examine a variety of filament structure probes. We show that the largest effect of the cosmic string is an overdensity in the filament distribution around the string wake. The signal from the overdensity is stronger at higher redshift and more robust with a wider field. We analyze the spatial distribution of filaments from a publicly available catalog of filaments built from Sloan digital sky survey galaxies. With existing data, we find no evidence for the presence of a cosmic string wake with string tension parameter $\textit{Gμ}$ above 5 × 10 –6 . However, we project WFIRST will be able to detect a signal from such a wake at the 99% confidence level at redshift $\textit{z}$ = 2, with significantly higher confidence and the possibility of probing lower tensions ($\textit{Gμ}$ ~ 10 –6 ), at $\textit{z}$ = 10. The sensitivity of this method is not competitive with constraints derived from the cosmic microwave background. However, it provides an independent discovery channel at low redshift, which could be a smoking gun in scenarios in which the cosmic microwave background bound can be weakened.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Constraining the galaxy-halo connection of infrared-selected unWISE galaxies with galaxy clustering and galaxy-CMB lensing power spectra

We present the first detailed analysis of the connection between galaxies and their dark matter halos for the unWISE galaxy catalog—a full-sky, infrared-selected sample built from WISE data, containing over 500 million galaxies. Using unWISE galaxy-galaxy autocorrelation and Planck CMB lensing-galaxy cross-correlation measurements down to 10 arcmin angular scales, we constrain the halo occupation distribution (HOD), a model describing how central and satellite galaxies are distributed within dark matter halos, for three unWISE galaxy samples at mean redshifts z ¯ ≈ 0.6 , 1.1, and 1.5, assuming a fixed cosmology at the best-fit Planck Λ CDM values. We constrain the characteristic minimum halo mass to host a central galaxy, M min HOD = 1.8 3 - 1.63 + 0.41 × 10 12 M ⊙ / h , 5.22 - 4.80 + 0.34 × 10 12 M ⊙ / h , 6.60 - 1.11 + 0.30 × 10 13 M ⊙ / h and the mass scale at which one satellite galaxy per halo is found, M 1 ' = 1.1 3 - 0.70 + 0.32 × 10 13 M ⊙ / h , 1.18 - 1.11 + 0.30 × 10 13 M ⊙ / h , 1.23 - 1.17 + 0.14 × 10 14 M ⊙ / h for the unWISE samples at z ¯ ≈ 0.6 , 1.1, and 1.5, respectively. We find that all three samples are dominated by central galaxies, rather than satellites. Using our constrained HOD models, we infer the effective linear galaxy bias for each unWISE sample, and find that it does not evolve as steeply with redshift as found in previous perturbation-theory-based analyses of these galaxies. We discuss possible sources of systematic uncertainty in our results, the most significant of which is the uncertainty on the galaxy redshift distribution. Our HOD constraints provide a detailed, quantitative understanding of how the unWISE galaxies populate the underlying dark matter halo distribution. These constraints will have a direct impact on future studies employing the unWISE galaxies as a cosmological and astrophysical probe, including measurements of ionized gas thermodynamics and dark matter profiles via Sunyaev-Zel’dovich and lensing cross-correlations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

BASS XXXII: Studying the Nuclear Millimeter-wave Continuum Emission of AGNs with ALMA at Scales ≲100–200 pc

To understand the origin of nuclear (≲100 pc) millimeter-wave (mm-wave) continuum emission in active galactic nuclei (AGNs), we systematically analyzed subarcsecond resolution Band-6 (211–275 GHz) Atacama Large Millimeter/submillimeter Array data of 98 nearby AGNs (z < 0.05) from the 70 month Swift/BAT catalog. The sample, almost unbiased for obscured systems, provides the largest number of AGNs to date with high mm-wave spatial resolution sampling (~1–200 pc), and spans broad ranges of 14–150 keV luminosity {$40\lt \mathrm{log}[{L}_{14-150}/(\mathrm{erg}\,{{\rm{s}}}^{-1})]\lt 45$}, black hole mass $[5\lt \mathrm{log}({M}_{\mathrm{BH}}/{M}_{\odot })\lt 10$], and Eddington ratio ($-4\lt \mathrm{log}{\lambda }_{\mathrm{Edd}}\lt 2$). We find a significant correlation between 1.3 mm (230 GHz) and 14–150 keV luminosities. Its scatter is ≈0.36 dex, and the mm-wave emission may serve as a good proxy of the AGN luminosity, free of dust extinction up to N H ~ 10 26 cm –2 . While the mm-wave emission could be self-absorbed synchrotron radiation around the X-ray corona according to past works, we also discuss different possible origins of the mm-wave emission: AGN-related dust emission, outflow-driven shocks, and a small-scale (<200 pc) jet. The dust emission is unlikely to be dominant, as the mm-wave slope is generally flatter than expected. Also, due to no increase in the mm-wave luminosity with the Eddington ratio, a radiation-driven outflow model is possibly not the common mechanism. Furthermore, we find independence of the mm-wave luminosity on indicators of the inclination angle from the polar axis of the nuclear structure, which is inconsistent with a jet model whose luminosity depends only on the angle.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Enhancing Multiplet Alignment Measurements with Imaging

We demonstrate that measurements of the gravitational tidal field made with spectroscopic redshifts can be improved with information from imaging surveys. The average orientation of small groups of galaxies, or “multiplets” is correlated with large-scale structure and is used to measure the direction of tidal forces. Previously, multiplet intrinsic alignment has been measured in DESI using galaxies that have spectroscopic redshifts. The DESI Legacy Imaging catalog can be used to supplement multiplet catalogs. Our findings show that galaxy positions from the imaging catalog produce a measurement similar to the measurements made with only spectroscopic data. This demonstrates that imaging can improve our signal-to-noise ratio for multiplet alignment in DESI.

Cosmic Web↗
DOE OSTI2021

Salton Sea Geodatabase for Geothermal Exploration Artificial Intelligence

These files contain the geodatabases related to Salton Sea Geothermal Field. It includes all input and output files used with the Geothermal Exploration Artificial Intelligence. Input and output files are sorted into three categories: raw data, pre-processed data, and analysis (post-processed data). In each of these categories there are six additional types of raster catalogs which are titled Radar, SWIR, Thermal, Geophysics, Geology, and Wells. The files are used with the Geothermal Exploration Artificial Intelligence for the Salton Sea Geothermal Site to identify indicators of blind geothermal systems. The included zip file is a geodatabase to be used with ArcGIS and the tar file is an inclusive database that encompasses the inputs and outputs for the Salton Sea Geothermal Site.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Desert Peak Geodatabase for Geothermal Exploration Artificial Intelligence

These files contain the geodatabases related to the Desert Peak Geothermal Field. It includes all input and output files used in the project. The files include data categories of raw data, pre-processed data, and analysis (post-processed data). In each of these categories there are six additional types of raster catalogs including Radar, SWIR, Thermal, Geophysics, Geology, and Wells. The files for the Desert Peak Geothermal Site are used with the Geothermal Exploration Artificial Intelligence to identify indicators of blind geothermal systems. The included zip file is a geodatabase to be used with ArcGIS and the tar file is an inclusive database that encompasses the inputs and outputs for the Desert Peak Geothermal Field.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Brady Geodatabase for Geothermal Exploration Artificial Intelligence

These files contain the geodatabases related to Brady's Geothermal Field. It includes all input and output files for the Geothermal Exploration Artificial Intelligence. Input and output files are sorted into three categories: raw data, pre-processed data, and analysis (post-processed data). In each of these categories there are six additional types of raster catalogs which are titled Radar, SWIR, Thermal, Geophysics, Geology, and Wells. These inputs and outputs were used with the Geothermal Exploration Artificial Intelligence to identify indicators of blind geothermal systems at the Brady Hot Springs Geothermal Site. The included zip file is a geodatabase to be used with ArcGIS and the tar file is an inclusive database that encompasses the inputs and outputs for the Brady Hot Springs Geothermal Site.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Galaxy Clusters Discovered via the Thermal Sunyaev-Zel’dovich Effect in the 500-square-degree SPTpol Survey

We present a catalog of 689 galaxy cluster candidates detected at significance ξ > 4 via their thermal Sunyaev-Zel’dovich (SZ) effect signature in 95 and 150 GHz data from the 500-square-degree SPTpol survey. We use optical and infrared data from the Dark Energy Camera and the Wide-field Infrared Survey Explorer (WISE) and Spitzer satellites, to confirm 544 of these candidates as clusters with ~ 94% purity. The sample has an approximately redshift-independent mass threshold at redshift z > 0.25. The confirmed sample spans 1.5 × 10 14 < M 500 c < 9 × 10 14 M ⊙ /h 70 and 0.03 < z ≲ 1.6 in mass and redshift, respectively, with a median mass of 2.5×10 14 M ⊙ /h 70 and median redshift z = 0.7; 21% of the confirmed clusters are at z > 1. We use external radio data from the Sydney University Molonglo Sky Survey (SUMSS) to estimate contamination to the SZ signal from synchrotron sources. The contamination reduces the recovered ξ by a median value of 0.032, or ~ 0.8% of the ξ = 4 threshold value, and ~ 7% of candidates have a predicted contamination greater than Δξ = 1. With the exception of a small number of systems (< 1%), an analysis of clusters detected in single-frequency 95 and 150 GHz data shows no significant contamination of the SZ signal by emission from dusty or synchrotron sources. This cluster sample, representing the deepest SZ-selected cluster sample to date, will be a key component in upcoming astrophysical and cosmological analyses of clusters. In addition to the cluster catalog, we also release the millimeter-wave maps and associated data products used to produce this sample. These maps have depths of 5.3 (11.7) µK CMB -arcmin at 150 (95) GHz and an effective angular resolution of 1. '2 (1. '7). The SPTpol products are available at https:// pole.uchicago.edu/public/data/sptpol_500d_clusters/index.html, and the NASA LAMBDA website. An interactive sky server with the SPTpol maps and Dark Energy Survey data release 2 images is also available at NCSA https://skyviewer.ncsa.illinois.edu.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Scale tests of the new DUNE data pipeline

In preparation for the second runs of the ProtoDUNE detectors at CERN (NP02 and NP04)[1], DUNE has established a new data pipeline for bringing the data from the EHN-1 experimental hall at CERN to primary tape storage at Fermilab and CERN, and then spreading it out to a distributed disk data store at many locations around the world. This system includes a new Ingest Daemon and a new Declaration Daemon. The Rucio[2] replica catalog, and FTS3 transport are used to transport all files. All file metadata is declared to the new MetaCat[3] metadata service. All of these new components have been successfully tested at a scale equal to the expected output of the detector data acquisition system (~2-4 GB/s), and the expected network bandwidth out of the experimental hall. We present the procedure that was used to test and the results of the test.

Timm, Steven↗