Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Sparse Data Management in HDF5

The importance of sparse data management is growing with data produced by large-scale experimental and observational facilities that contain small amounts of non-zero values. In this document, we explore different design options to support sparse data in HDF5, one of the most popular highperformance I/O libraries and file formats used for scientific data. We discuss several use cases and requirements. Our main hard design constraint is that any changes to the HDF5 dataset API would be a burden on users and not acceptable. The remaining options are discussed below. We provide rationale for what we believe is the strongest candidate and describe how its potential benefits can be simulated with the existing HDF5 library. We have conducted a set of computational experiments the results of which are reported here. They show that our candidate meets all relevant requirements and gives us a certain degree of confidence for an HDF5 library-native implementation.

Mainzer, John↗

Lyman continuum leaker candidates among highly ionised, low-redshift dwarf galaxies selected from He II

Contemporary research suggests that the reionisation of the intergalactic medium (IGM) in the early Universe was predominantly realised by star-forming (proto-)galaxies (SFGs). Due to observational constraints, our knowledge on the origins of sufficient amounts of ionising Lyman continuum (LyC) photons and the mechanisms facilitating their transport into the IGM remains sparse. Recent efforts have thus focussed on the study of local analogues to these high-redshift objects. We aim to acquire a set of very low-redshift SFGs that exhibit signs of a hard radiation field being present. A subsequent analysis of their emission line properties is intended to shed light on how the conditions prevalent in these objects compare to those predicted to be present in early SFGs that are thought to be LyC emitters (LCEs). We used archival spectroscopic SDSS DR12 data to select a sample of low-redshift He II 4686 emitters and restricted it to a set of SFGs with an emission line diagnostic sensitive to the presence of an active galactic nucleus, which serves as our only selection criterion. We performed a population spectral synthesis with FADO to reconstruct these galaxies’ star-formation histories (SFHs). Utilising the spectroscopic information at hand, we constrained the predominant ionisation mechanisms in these galaxies and inferred information on interstellar medium (ISM) conditions relevant for the escape of LyC radiation. Our final sample consists of eighteen ionised, metal-poor galaxies (IMPs). These low-mass (6.2 ≤ log(M * /M ⊙ ) ≤ 8.8), low-metallicity (7.54 ≤log(O/H) + 12 ≤ 8.13) dwarf galaxies appear to be predominantly ionised by stellar sources. We find large [OIII] 5007/[OII] 3727 ratios and [SII] 6717,6731/Hα deficiencies, which provide strong indications for these galaxies to be LCEs. At least 40% of these objects are candidates for featuring cosmologically significant LyC escape fractions ≳10%. The IMPs’ SFHs exhibit strong similarities and almost all galaxies appear to contain an old (> 1 Gyr) stellar component, while also harbouring a young, two-stage (~10 Myr and < 1 Myr) starburst, which we speculate might be related to LyC escape. The properties of the compact emission line galaxies presented here align well with those observed in many local LCEs. In fact, our sample may prove as an extension to the rather small catalogue of local LCEs, as the extreme ISM conditions we find are assumed to facilitate LyC leakage. Notably, all of our eighteen candidates are significantly closer (z < 0.1) than most established LCEs. If the inferred LyC photon loss is genuine, this demonstrates that selecting SFGs from He II 4686 is a powerful selection criterion in the search for LCEs.

79 ASTRONOMY AND ASTROPHYSICS↗

SPECTRUM AND ANISOTROPY OF TURBULENCE FROM MULTI-FREQUENCY MEASUREMENT OF SYNCHROTRON POLARIZATION

We consider turbulent synchrotron-emitting media that also exhibit Faraday rotation and provide a statistical description of synchrotron polarization fluctuations. In particular, we consider these fluctuations as a function of the spatial separation of the direction of the measurements and as a function of wavelength for the same line of sight. On the basis of our general analytical approach, we introduce several measures that can be used to obtain the spectral slopes and correlation scales of both the underlying magnetic turbulence responsible for emission and the spectrum of the Faraday rotation fluctuations. We show the synergetic nature of these measures and discuss how the study can be performed using sparsely sampled interferometric data. We also discuss how additional characteristics of turbulence can be obtained, including the turbulence anisotropy and the three-dimensional direction of the mean magnetic field. In addition, we consider the cases when the synchrotron emission and Faraday rotation regions are spatially separated. Appealing to our earlier study, we explain that our new results are applicable to a wide range of spectral indexes of relativistic electrons responsible for synchrotron emission. We expect wide application of our techniques, both with existing synchrotron data sets and with big forthcoming data sets from LOFAR and SKA.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimating the state of a geophysical system with sparse observations: time delay methods to achieve accurate initial states for prediction

The problem of forecasting the behavior of a complex dynamical system through analysis of observational time-series data becomes difficult when the system expresses chaotic behavior and the measurements are sparse, in both space and/or time. Despite the fact that this situation is quite typical across many fields, including numerical weather prediction, the issue of whether the available observations are "sufficient" for generating successful forecasts is still not well understood. An analysis by Whartenby et al. (2013) found that in the context of the nonlinear shallow water equations on a β plane, standard nudging techniques require observing approximately 70 % of the full set of state variables. Here we examine the same system using a method introduced by Rey et al. (2014a), which generalizes standard nudging methods to utilize time delayed measurements. Here, we show that in certain circumstances, it provides a sizable reduction in the number of observations required to construct accurate estimates and high-quality predictions. In particular, we find that this estimate of 70 % can be reduced to about 33 % using time delays, and even further if Lagrangian drifter locations are also used as measurements.

58 GEOSCIENCES↗

SDSS/SEGUE spectral feature analysis for stellar atmospheric parameter estimation

Large-scale and deep sky survey missions are rapidly collecting a large amount of stellar spectra, which necessitate the estimation of atmospheric parameters directly from spectra and make it feasible to statistically investigate latent principles in a large data set. We present a technique for estimating parameters T{sub eff}, log g, and [Fe/H] from stellar spectra. With this technique, we first extract features from stellar spectra using the LASSO algorithm; then, the parameters are estimated from the extracted features using the support vector regression. On a subsample of 20,000 stellar spectra from the Sloan Digital Sky Survey (SDSS) with reference parameters provided by the SDSS/SEGUE Spectroscopic Parameter Pipeline, estimation consistency are 0.007458 dex for log T{sub eff} (101.609921 K for T{sub eff}), 0.189557 dex for log g, and 0.182060 for [Fe/H], where the consistency is evaluated by mean absolute error. Prominent characteristics of the proposed scheme are sparseness, locality, and physical interpretability. In this work, each spectrum consists of 3821 fluxes, and 10, 19, and 14 typical wavelength positions are detected, respectively, for estimating T{sub eff}, log g, and [Fe/H]. It is shown that the positions are related to typical lines of stellar spectra. This characteristic is important in investigating physical indications from analysis results. Then, stellar spectra can be described by the individual fluxes on the detected positions (PD) or local integration of fluxes near them (LI). The aforementioned consistency is the result based on features described by LI. If features are described by PD, consistency is 0.009092 dex for log T{sub eff} (124.545075 K for T{sub eff}), 0.198928 dex for log g, and 0.206814 dex for [Fe/H].

79 ASTRONOMY AND ASTROPHYSICS↗

Influence of Vertical Hydrologic Exchange Flow, Channel Flow, and Biogeochemical Kinetics on CH 4 Emissions From Rivers

Abstract CH 4 emissions from inland water are highly uncertain in the current global CH 4 budget, especially for rivers and streams due to sparse measurements and the uncertainty of measurements caused by turbulent water flow. A previous study has revealed that vertical hydrologic exchange flow (VHEF) is the main regulator of CH 4 emissions from riverbed sediments. However, to what extent the understanding obtained from the plot‐scale can be extended to the reach scale and basin scale remains unknown. To address this challenge, we developed a process‐based model to estimate CH 4 flux at the air‐water interface using the attributes available in the national hydrography data set. It calculates the annual mean flux of VHEF, CH 4 production in sediments, and CH 4 transport in the river channel in a sequential manner. Model performance is evaluated by CH 4 efflux observed at the Hanford reach of the Columbia River. We show that reach‐wise sediment hydrologic and biogeochemical conditions estimated from the national hydrography data set could serve as a good indicator of CH 4 emissions from rivers. Aerobic methane oxidation and export to the downstream are the dominant ways of total CH 4 loss for the large lowland river. The hotspots of CH 4 emissions are likely to be at the reaches with fine sediments and slow channel velocity. This study demonstrates the possibility of quantifying CH 4 emissions at the reach scale and the modeling framework has the potential to be extended to the basin scale to improve estimates of CH 4 emissions from lotic inland water.

58 GEOSCIENCES↗

Uncovering anisotropic magnetic phases via fast dimensionality analysis

A quantitative geometric predictor for the dimensionality of magnetic interactions is presented. This predictor is based on networks of superexchange interactions and can be quickly calculated for crystalline compounds of arbitrary chemistry, occupancy, or symmetry. The resulting data are useful for classifying structural families of magnetic compounds. We have examined compounds from a demonstration set of 42,520 materials with 3d transition metal cations. The predictor reveals trends in magnetic interactions that are often not apparent from the space group of the compounds, such as triclinic or monoclinic compounds that are strongly 2D. We present speci c cases where the predictor identi es compounds that should exhibit competition between 1D and 2D interactions, and how the predictor can be used to identify sparsely-populated regions of chemical space with as-yet-unexplored topologies of speci c 3d magnetic cations. The predictor can be accessed for the full list of compounds using a searchable frontend, and further information on the connectivity, symmetry, valence, and cation-anion and cation-cation coordination can be freely exported.

36 MATERIALS SCIENCE↗

PyAMG: Algebraic Multigrid Solvers in Python

PyAMG is a Python package of algebraic multigrid (AMG) solvers and supporting tools for approximating the solution to large, sparse linear systems of algebraic equations, Ax = b, where A is an n × n sparse matrix. Sparse linear systems arise in a range of problems in science, from fluid flows to solid mechanics to data analysis. While the direct solvers available in SciPy’s sparse linear algebra package (scipy.sparse.linalg) are highly efficient, in many cases iterative methods are preferred due to overall complexity. However, the iterative methods in SciPy, such as CG and GMRES, often require an efficient preconditioner in order to achieve a lower complexity. Preconditioning is a powerful tool whereby the conditioning of the linear system and convergence rate of the iterative method are both dramatically improved. PyAMG constructs multigrid solvers for use as a preconditioner in this setting. A summary of multigrid and algebraic multigrid solvers can be found in Olson (2015a), in Olson (2015b), and in Falgout (2006); a detailed description can be found in Briggs et al. (2000) and Trottenberg et al. (2001).

97 MATHEMATICS AND COMPUTING↗

47 Tuc in Rubin Data Preview 1. Exploring Early LSST Data and Science Potential

We present analyses of the early data from Rubin Observatory’s Data Preview 1 (DP1) for the field of the globular cluster 47 Tuc. The DP1 data set for 47 Tuc includes four nights of observations from the Rubin Commissioning Camera (LSSTComCam), covering multiple bands (ugriy). We address challenges of crowding in the inner region of the cluster and toward the SMC in DP1, and demonstrate improved star–galaxy separation by fitting fifth-degree polynomials to the stellar loci in color–color diagrams and applying multidimensional sigma clipping. We compile a catalog of 3576 probable 47 Tuc member stars selected via a combination of isochrone, Gaia proper-motion, and color–color space matched filtering. We explore the sources of photometric scatter in the 47 Tuc color–color sequence, evaluating contributions from various potential sources, including differential extinction within the cluster. Finally, of the 72 well-characterized variables in the field, we recover three known variable stars, including two RR Lyrae and one eclipsing binary, in the coadd-based object catalog, and identify 62 in the difference image-based object catalog. Although the DP1 lightcurves have sparse temporal sampling, they appear to follow the patterns of densely sampled literature lightcurves well. Despite some data limitations for crowded-field stellar analysis, DP1 demonstrates the promising scientific potential for future LSST data releases.

Choi, Yumi [NSF National Optical-Infrared Astronom↗

Phase-weighted slant stacking for surface wave dispersion measurement

SUMMARY Surface wave retrieval from ambient noise records using seismic interferometry techniques has been widely used for multiscale shear wave velocity (Vs) imaging. One key step during Vs imaging is the generation of dispersion spectra and the extraction of a reliable dispersion curve from the retrieved surface waves. However, the sparse array geometry usually affects the ability for high-frequency (>1 Hz) seismic signals’ acquisition. Dispersion measurements are degraded by array response due to sparse sampling and often present smeared dispersion spectra with sidelobe artefacts. Previous studies usually focus on interferograms’ domain (e.g. cross-correlation function) and attempt to enhance coherent signals before dispersion measurement. We propose an alternative technique to explicitly deblur dispersion spectra through use of a phase-weighted slant-stacking algorithm. Numerical examples demonstrate the strength of the proposed technique to attenuate array responses as well as incoherent noise. Three different field examples prove the flexibility and superiority of the proposed technique: the first data set consists of ambient noise records acquired using a nodal seismometer array; the second data set utilizes distributed acoustic sensing (DAS) and a marine fibre-optic cable to acquire a similar ambient noise data set; the last data set is a vibrator-based active-source surface wave data. The enhanced dispersion measurements provide cleaner and higher-resolution spectra without distortions which will assist both human interpreters as well as ML algorithms in efficiently picking curves for subsequent Vs inversion.

58 GEOSCIENCES↗

$S$ Hmax orientation in the Alpine region from observations of stress-induced anisotropy of nonlinear elasticity

The orientation of $S$ Hmax is commonly estimated from in situ borehole breakouts and earthquake focal mechanisms. Borehole measurements are expensive, and therefore sparse, and earthquake measurements can only be made in regions with many well-characterized earthquakes. Here, we derive the stress-field orientation using stress-induced anisotropy in nonlinear elasticity. In this method, we measure the strain derivative of velocity as a function of azimuth. We use a natural pump-probe (NPP) approach which consists of measuring elastic wave speed using empirical Green’s functions (probe) at different points of the earth tidal strain cycle (pump). The approach is validated using a larger data set in the Northern Alpine Foreland region where the orientation of maximum horizontal compressive stress is known from borehole breakouts and drilling-induced fractures. The technique resolves NNW-SSW to N-S directed $S$ Hmax which is in good agreement with conventional methods and the recent crustal stress model. We confirm that the NPP method can be applied to dense large-scale seismic arrays. The technique is then applied to the Southern Alps to understand the contemporary stress pattern associated with the ongoing deformation due to counterclockwise rotation of the Adriatic plate with respect to the European plate. Our results explain why the two major faults in Northeastern Italy, the Giudicarie Fault and the Periadriatic Line (Pustertal–Gailtal Fault) are currently inactive, while the currently acting stress field allows faults in Slovenia to deform actively. We have demonstrated that the pump-probe method has the potential to fill in the measurement gap left by conventional approaches, both in terms of regional coverage and in depth.

58 GEOSCIENCES↗

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗

Remotely sensed physical property estimation from powder contaminated surfaces

It is the intent of this paper to demonstrate the veracity of a method to estimate the total solid contaminant mass present on a sparsely coated surface encompassing a pixel from longwave infrared spectra. Sparsely coated surfaces create complex radiometry due to the interactions of electromagnetic energy between intimate materials. Current algorithms can be used on intimate mixtures to identify the abundances of materials in a pixel, but they cannot provide additional property information. Radiative transfer models can create mixture signatures, but only with a set of well-characterized physical parameters that are typically not known or are difficult to retrieve. Finally, the approach described here creates a parameter inversion model from a radiative transfer model and uses empirically measured mixture data to retrieve physical characteristics of the contaminated surface and derive a total contaminant mass present.

97 MATHEMATICS AND COMPUTING↗

Topological Analysis of The SPOKE Graph

The SPOKE graph [2, 6] is a sparse decorated semantic graph representing a collection of knowledge collected in many scientific databases from the fields of healthcare, biochemistry, chemistry, biology, et cetera. This knowledge graph is stored as a relational dataset decorated with metadata on each constituent vertex and edge. Formally, the graph is G(V, E, D), where V is a set of n vertices V := {1, ..., n} and edges of the form (i, j) ϵ E for i, j ϵ V, and table D that for any item in V υ E stores unstructured data such as vertex/edge type, nature of a relationship, et cetera. D(i) = {data involving vertex i ϵ V}, and D(i, j) = {data involving edge (i, j) ϵ E}. Here, we treat the graph as undirected in the sense that a direct relationship for (i, j) causes a (possibly opposite) reverse direct relationship for (j, i). The SPOKE graph G(V, E, D) is formed by processing a collection of relational datasets from medicine, chemistry, and biology, connecting many entities. Here, we analyze an instance from 2019, Spoke-20190707, where a graph file contains 6.16M edges and associated metadata and a vertex file contains 2.15M vertices and the associated metadata. There are 12 different types of vertex entities; all edge types used are implicit (see §2). There is other metadata in D on edges and vertices, but we just use the topology and the vertex labels in this report. SPOKE is growing as more knowledge is gained and more datasets are added. SPOKE is likely to grow 10x during the next phase of this project, and we therefore would like to consider topoligical analysis techniques that are scalable to several orders of magnitude larger than the current dataset (say >1B edges).

59 BASIC BIOLOGICAL SCIENCES↗

EXPRES. II. Searching for Planets around Active Stars: A Case Study of HD 101501

By controlling instrumental errors to below 10 cm s{sup −1}, the EXtreme PREcision Spectrograph (EXPRES) allows for a more insightful study of photospheric velocities that can mask weak Keplerian signals. Gaussian processes (GP) have become a standard tool for modeling correlated noise in radial velocity data sets. While GPs are constrained and motivated by physical properties of the star, in some cases they are still flexible enough to absorb unresolved Keplerian signals. We apply GP regression to EXPRES radial velocity measurements of the 3.5 Gyr old chromospherically active Sun-like star, HD 101501. We obtain tight constraints on the stellar rotation period and the evolution of spot distributions using 28 seasons of ground-based photometry, as well as recent Transiting Exoplanet Survey Satellite data. Light-curve inversion was carried out on both photometry data sets to reveal the spot distribution and spot evolution timescales on the star. We find that the >5 m s{sup −1} rms radial velocity variations in HD 101501 are well modeled with a GP stellar activity model without planets, yielding a residual rms scatter of 45 cm s{sup −1}. We carry out simulations, injecting and recovering signals with the GP framework, to demonstrate that high-cadence observations are required to use GPs most efficiently to detect low-mass planets around active stars like HD 101501. Sparse sampling prevents GPs from learning the correlated noise structure and can allow it to absorb prospective Keplerian signals. We quantify the moderate to high-cadence monitoring that provides the necessary information to disentangle photospheric features using GPs and to detect planets around active stars.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Reduced Order Model to Predict Dispersion of Flammable Refrigerant into a Space

As the HVAC&R industry mobilizes to deploy more low-GWP refrigerants, relevant standards are being continually reviewed and updated. Those include the general safety standards ISO 5149 and ASHRAE 15, and the equipment standards IEC and UL. The standards systematically set the allowable maximum amount of refrigerant that should be used in different equipment types and different applications. To do so, they rely on predictions of how a leaked refrigerant mass will disperse into a space. Dispersion characteristics, such as total flammable volume and its residence time, determine the risk associated with the presence of the flammable refrigerant. The standards have included provisions for the use of flammable refrigerants for approximately two decades. They relied on limited analytical analyses and test cases in their development. Dispersion of a refrigerant into a space is complex. Computational fluid dynamics (CFD) are the most accurate in predicting a given problem. However, CFD is computationally expensive and requires specialized expertise and resources and is not suitable for use by standards development working group as prediction tool. This paper presents the development of a reduced order model (ROM) that predicts the key dispersion characteristics relevant to the dispersion of a leaked refrigerant into a space for any combination of input variables. The inputs are the refrigerant release height, the total released refrigerant mass and its release flow rate, the refrigerant molecular weight, the ventilation flow rate, the floor area and height of the space, recirculation air flow rate, and the tightness of the space. The outputs are histograms of volume fraction of the room in prescribed concentration bins and the total mass of the refrigerant in each bin normalized by the total refrigerant charge at 13 prescribed simulation time stamps between 1 and 900 seconds. The ROM is constructed from a set of CFD simulations with carefully chosen combinations of input parameters. The selection if done using a multidimensional sparse grid which is a generalization of the classical tensor approach but offers additional flexibility and thus can be more carefully tuned towards a specific model. The tuning is done to improve the accuracy, measured in the difference between the output values of the ROM and the CFD model, while minimizing the computational cost, measured in number of CFD simulations which is orders of magnitude more expensive than the processing the training data.

Edwards, Dean↗

Peak2Patch: High-Fidelity Functional Group Identification through Attention-Based Fusion of Infrared and Mass Spectra

Identifying molecular structure based on spectroscopic readings is a key task in a variety of chemical and biological applications. Common spectroscopy techniques, such as Infrared (IR) Spectroscopy and Mass Spectrometry (MS), provide detailed information on the structure of molecular compounds but nonetheless require expert-level knowledge to decode. Machine learning has emerged as a potential solution for automating structure prediction from chemical spectra; however, current approaches generally focus on single sensor modalities, neglecting to leverage the complementary information contained within differing spectra. In this paper, we introduce Peak2Patch, a novel approach to fusion-enhanced prediction of functional groups from IR and mass spectra. First, we perform a detailed comparison of backbone networks for encoding both sparse mass spectra and dense IR spectra and demonstrate the superior performance of transformer neural networks over current state-of-the-art convolutional neural networks. Second, we evaluate three broad categories of fusion: early (raw feature), middle (deep feature), and late (decision) fusion, demonstrating the potential of a deep feature fusion-based approach. Lastly, we present Peak2Patch, our attention-based fusion scheme, which leverages cross-attention to mix features between encoded tokens of the two modalities. We validate our approach on a publicly available multimodal spectroscopic data set of 790k simulated molecules, demonstrating a large improvement in functional group prediction over both the previous state-of-the-art and our own strong single-modal baselines.

Jacobson, Philip [Sandia National Laboratories (SN↗

Technical Report: Algorithm and Implementation for Quasispecies Abundance Inference with Confidence Intervals from Metagenomic Sequence Data

This report describes the design and implementation of an algorithm for estimating relative microbial abundances, together with confidence limits, using data from metagenomic DNA sequencing. For the background behind this project and a detailed discussion of our modeling approach for metagenomic data, we refer the reader to our earlier technical report, dated March 4, 2014. Briefly, we described a fully Bayesian generative model for paired-end sequence read data, incorporating the effects of the relative abundances, the distribution of sequence fragment lengths, fragment position bias, sequencing errors and variations between the sampled genomes and the nearest reference genomes. A distinctive feature of our modeling approach is the use of a Chinese restaurant process (CRP) to describe the selection of genomes to be sampled, and thus the relative abundances. The CRP component is desirable for fitting abundances to reads that may map ambiguously to multiple targets, because it naturally leads to sparse solutions that select the best representative from each set of nearly equivalent genomes.

59 BASIC BIOLOGICAL SCIENCES↗