SEARCH · Engineering Papers

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Deterministic and Monte Carlo Nuclear Data Adjustment Methods [Slides]

For the Bayesian Monte Carlo methodology, a need to understand convergence of the posterior moments as a function of the number of parameter realizations is required. In high-dimensional systems, it can be very costly to sample entire parameter space and perform functional evaluation for every realization. Bayesian Monte Carlo allows one to relax the GLLS approximations of model linearity and prior/posterior PDF shape. The Bayesian Stochastic Collocation Method is a deterministic approach to “sample” the parameter space. It allows one to relax the GLLS approximations of model linearity and posterior PDF shape. Higher-order posterior moments (i.e., skewness, kurtosis, etc.) can be studied through polynomial expansion. Tensor product quadrature scales poorly and can use sparse grid quadrature methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Influence of Vertical Hydrologic Exchange Flow, Channel Flow, and Biogeochemical Kinetics on CH 4 Emissions From Rivers

Abstract CH 4 emissions from inland water are highly uncertain in the current global CH 4 budget, especially for rivers and streams due to sparse measurements and the uncertainty of measurements caused by turbulent water flow. A previous study has revealed that vertical hydrologic exchange flow (VHEF) is the main regulator of CH 4 emissions from riverbed sediments. However, to what extent the understanding obtained from the plot‐scale can be extended to the reach scale and basin scale remains unknown. To address this challenge, we developed a process‐based model to estimate CH 4 flux at the air‐water interface using the attributes available in the national hydrography data set. It calculates the annual mean flux of VHEF, CH 4 production in sediments, and CH 4 transport in the river channel in a sequential manner. Model performance is evaluated by CH 4 efflux observed at the Hanford reach of the Columbia River. We show that reach‐wise sediment hydrologic and biogeochemical conditions estimated from the national hydrography data set could serve as a good indicator of CH 4 emissions from rivers. Aerobic methane oxidation and export to the downstream are the dominant ways of total CH 4 loss for the large lowland river. The hotspots of CH 4 emissions are likely to be at the reaches with fine sediments and slow channel velocity. This study demonstrates the possibility of quantifying CH 4 emissions at the reach scale and the modeling framework has the potential to be extended to the basin scale to improve estimates of CH 4 emissions from lotic inland water.

58 GEOSCIENCES↗

DOE OSTI2023

Lyman continuum leaker candidates among highly ionised, low-redshift dwarf galaxies selected from He II

Contemporary research suggests that the reionisation of the intergalactic medium (IGM) in the early Universe was predominantly realised by star-forming (proto-)galaxies (SFGs). Due to observational constraints, our knowledge on the origins of sufficient amounts of ionising Lyman continuum (LyC) photons and the mechanisms facilitating their transport into the IGM remains sparse. Recent efforts have thus focussed on the study of local analogues to these high-redshift objects. We aim to acquire a set of very low-redshift SFGs that exhibit signs of a hard radiation field being present. A subsequent analysis of their emission line properties is intended to shed light on how the conditions prevalent in these objects compare to those predicted to be present in early SFGs that are thought to be LyC emitters (LCEs). We used archival spectroscopic SDSS DR12 data to select a sample of low-redshift He II 4686 emitters and restricted it to a set of SFGs with an emission line diagnostic sensitive to the presence of an active galactic nucleus, which serves as our only selection criterion. We performed a population spectral synthesis with FADO to reconstruct these galaxies’ star-formation histories (SFHs). Utilising the spectroscopic information at hand, we constrained the predominant ionisation mechanisms in these galaxies and inferred information on interstellar medium (ISM) conditions relevant for the escape of LyC radiation. Our final sample consists of eighteen ionised, metal-poor galaxies (IMPs). These low-mass (6.2 ≤ log(M * /M ⊙ ) ≤ 8.8), low-metallicity (7.54 ≤log(O/H) + 12 ≤ 8.13) dwarf galaxies appear to be predominantly ionised by stellar sources. We find large [OIII] 5007/[OII] 3727 ratios and [SII] 6717,6731/Hα deficiencies, which provide strong indications for these galaxies to be LCEs. At least 40% of these objects are candidates for featuring cosmologically significant LyC escape fractions ≳10%. The IMPs’ SFHs exhibit strong similarities and almost all galaxies appear to contain an old (> 1 Gyr) stellar component, while also harbouring a young, two-stage (~10 Myr and < 1 Myr) starburst, which we speculate might be related to LyC escape. The properties of the compact emission line galaxies presented here align well with those observed in many local LCEs. In fact, our sample may prove as an extension to the rather small catalogue of local LCEs, as the extreme ISM conditions we find are assumed to facilitate LyC leakage. Notably, all of our eighteen candidates are significantly closer (z < 0.1) than most established LCEs. If the inferred LyC photon loss is genuine, this demonstrates that selecting SFGs from He II 4686 is a powerful selection criterion in the search for LCEs.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2016

Validation of spatiodemographic estimates produced through data fusion of small area census records and household microdata

Techniques such as Iterative Proportional Fitting have been previously suggested as a means to generate new data with the demographic granularity of individual surveys and the spatial granularity of small area tabulations of censuses and surveys. This article explores internal and external validation approaches for synthetic, small area, household- and individual-level microdata using a case study for Bangladesh. Using data from the Bangladesh Census 2011 and the Demographic and Health Survey, we produce estimates of infant mortality rate and other household attributes for small areas using a variation of an iterative proportional fitting method called P-MEDM. We conduct an internal validation to determine: whether the model accurately recreates the spatial variation of the input data, how each of the variables performed overall, and how the estimates compare to the published population totals. We conduct an external validation by comparing the estimates with indicators from the 2009 Multiple Indicator Cluster Survey (MICS) for Bangladesh to benchmark how well the estimates compared to a known dataset which was not used in the original model. The results indicate that the estimation process is viable for regions that are better represented in the microdata sample, but also revealed the possibility of strong overfitting in sparsely sampled sub-populations.

42 ENGINEERING↗

DOE OSTI2021

Phase-weighted slant stacking for surface wave dispersion measurement

SUMMARY Surface wave retrieval from ambient noise records using seismic interferometry techniques has been widely used for multiscale shear wave velocity (Vs) imaging. One key step during Vs imaging is the generation of dispersion spectra and the extraction of a reliable dispersion curve from the retrieved surface waves. However, the sparse array geometry usually affects the ability for high-frequency (>1 Hz) seismic signals’ acquisition. Dispersion measurements are degraded by array response due to sparse sampling and often present smeared dispersion spectra with sidelobe artefacts. Previous studies usually focus on interferograms’ domain (e.g. cross-correlation function) and attempt to enhance coherent signals before dispersion measurement. We propose an alternative technique to explicitly deblur dispersion spectra through use of a phase-weighted slant-stacking algorithm. Numerical examples demonstrate the strength of the proposed technique to attenuate array responses as well as incoherent noise. Three different field examples prove the flexibility and superiority of the proposed technique: the first data set consists of ambient noise records acquired using a nodal seismometer array; the second data set utilizes distributed acoustic sensing (DAS) and a marine fibre-optic cable to acquire a similar ambient noise data set; the last data set is a vibrator-based active-source surface wave data. The enhanced dispersion measurements provide cleaner and higher-resolution spectra without distortions which will assist both human interpreters as well as ML algorithms in efficiently picking curves for subsequent Vs inversion.

58 GEOSCIENCES↗

DOE OSTI2023

$S$ Hmax orientation in the Alpine region from observations of stress-induced anisotropy of nonlinear elasticity

The orientation of $S$ Hmax is commonly estimated from in situ borehole breakouts and earthquake focal mechanisms. Borehole measurements are expensive, and therefore sparse, and earthquake measurements can only be made in regions with many well-characterized earthquakes. Here, we derive the stress-field orientation using stress-induced anisotropy in nonlinear elasticity. In this method, we measure the strain derivative of velocity as a function of azimuth. We use a natural pump-probe (NPP) approach which consists of measuring elastic wave speed using empirical Green’s functions (probe) at different points of the earth tidal strain cycle (pump). The approach is validated using a larger data set in the Northern Alpine Foreland region where the orientation of maximum horizontal compressive stress is known from borehole breakouts and drilling-induced fractures. The technique resolves NNW-SSW to N-S directed $S$ Hmax which is in good agreement with conventional methods and the recent crustal stress model. We confirm that the NPP method can be applied to dense large-scale seismic arrays. The technique is then applied to the Southern Alps to understand the contemporary stress pattern associated with the ongoing deformation due to counterclockwise rotation of the Adriatic plate with respect to the European plate. Our results explain why the two major faults in Northeastern Italy, the Giudicarie Fault and the Periadriatic Line (Pustertal–Gailtal Fault) are currently inactive, while the currently acting stress field allows faults in Slovenia to deform actively. We have demonstrated that the pump-probe method has the potential to fill in the measurement gap left by conventional approaches, both in terms of regional coverage and in depth.

58 GEOSCIENCES↗

DOE OSTI2018

Uncovering anisotropic magnetic phases via fast dimensionality analysis

A quantitative geometric predictor for the dimensionality of magnetic interactions is presented. This predictor is based on networks of superexchange interactions and can be quickly calculated for crystalline compounds of arbitrary chemistry, occupancy, or symmetry. The resulting data are useful for classifying structural families of magnetic compounds. We have examined compounds from a demonstration set of 42,520 materials with 3d transition metal cations. The predictor reveals trends in magnetic interactions that are often not apparent from the space group of the compounds, such as triclinic or monoclinic compounds that are strongly 2D. We present speci c cases where the predictor identi es compounds that should exhibit competition between 1D and 2D interactions, and how the predictor can be used to identify sparsely-populated regions of chemical space with as-yet-unexplored topologies of speci c 3d magnetic cations. The predictor can be accessed for the full list of compounds using a searchable frontend, and further information on the connectivity, symmetry, valence, and cation-anion and cation-cation coordination can be freely exported.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Simulations of Sparse Static Detector Networks for City-Scale Radiological/Nuclear Detection

Sparse static detector networks in urban environments can be used in efforts to detect illicit radioactive sources, such as stolen nuclear material or radioactive "dirty bombs." We use detailed simulations to evaluate multiple configurations of detector networks and their ability to detect sources moving through a $6\times 6$ km 2 area of downtown Chicago. A detector network's probability of detecting a source increases with detector density but can also be increased with strategic node placement. Here, we show that the ability to fuse correlated data from a source-carrying vehicle passing by multiple detectors can significantly contribute to the overall detection probability. In this article, we distinguish static sensor deployments operated as networks able to correlate signals between sensors, from deployments operated as arrays where each sensor is operated individually. In particular, we show that additional visual attributes of source-carrying vehicles, such as vehicle color and make, can greatly improve the ability of a detector network to detect illicit sources.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2021

Electrochemistry-Induced Restructuring of Tin-Doped Indium Oxide Nanocrystal Films of Relevance to CO 2 Reduction

The electrochemical reduction of CO 2 into fuels using renewable electricity presents an opportunity to utilize captured CO 2 . Electrocatalyst development has been a primary focus of research in this area. This is especially true at the nanoscale, where researchers have focused on understanding nanostructure-property relationships. However, electrocatalyst structure may evolve during operation. Indium- and tin-based oxides have been widely studied as electrocatalysts for CO 2 reduction to formate, but evolution of these catalysts during operation is not well-characterized. Here, we report the evolution of nanoscale structure of precise tin-doped indium oxide nanocrystals under CO 2 reduction conditions. We show that sparse monolayer nanocrystal films desorb from the electrode upon charging, but thicker nanocrystal films remain, likely due to an increased number of physical contacts. Upon applying a cathodic voltage of –1.0 V vs RHE or greater, the original 10-nm diameter nanocrystals are no longer visible, and instead form a larger microstructural network. Elemental analysis suggests the network is an oxygen-deficient indium-tin metal alloy. We hypothesize that this morphological evolution is the result of nanocrystal sintering due to oxide reduction. Furthermore, these data provide insights into the morphological evolution of tin-doped indium oxide nanocrystal electrocatalysts under reducing conditions and highlight the importance of post-electrochemical structural characterization of electrocatalysts.

25 ENERGY STORAGE↗

DOE OSTI2022

Deep Learning for Simultaneous Inference of Hydraulic and Transport Properties

Abstract Identification of a heterogeneous conductivity field and reconstruction of a contaminant release history are key aspects of subsurface remediation. These two goals are achieved by combining model predictions with sparse and noisy hydraulic head and concentration measurements. Solution of this inverse problem is notoriously difficult due to, in part, high dimensionality of the parameter space and high computational cost of repeated forward solves. We use a convolutional adversarial autoencoder (CAAE) to parameterize a heterogeneous non‐Gaussian conductivity field via a low‐dimensional latent representation. A three‐dimensional dense convolutional encoder‐decoder (DenseED) network serves as a forward surrogate of the flow and transport model. The CAAE‐DenseED surrogate is fed into the ensemble smoother with multiple data assimilation (ESMDA) algorithm to sample from the Bayesian posterior distribution of the unknown parameters, forming a CAAE‐DenseED‐ESMDA inversion framework. The resulting CAAE‐DenseED‐ESMDA inversion strategy is used to identify a three‐dimensional contaminant source and conductivity field. A comparison of the inversion results from CAAE‐ESMDA with physical flow and transport simulator and from CAAE‐DenseED‐ESMDA shows that the latter yields accurate reconstruction results at the fraction of the computational cost of the former.

Zhou, Zitong↗

DOE OSTI2025

AmeriFlux CA-LU2 Lutose

This is the AmeriFlux version of the carbon flux data for the site CA-LU2 Lutose. Site Description - Lutose is a peat plateau that burned from a moderate forest fire in June 2007. Prior to the fire the site was likley an open canopy of stunted black spruce and a ground layer of Labrador tea shurbs and lichen or sphagnum. No black spruce survived the fire and lichens were still completely absent during this study. By 2019, most charred tree boles has fallen over and vegetation recovery was dominated by dense Labrador tea shrubs and sparse regenerating black spruce with around >150cm of peat.

Schulze, Christopher [University of Alberta]↗

DOE OSTI2017

Remotely sensed physical property estimation from powder contaminated surfaces

It is the intent of this paper to demonstrate the veracity of a method to estimate the total solid contaminant mass present on a sparsely coated surface encompassing a pixel from longwave infrared spectra. Sparsely coated surfaces create complex radiometry due to the interactions of electromagnetic energy between intimate materials. Current algorithms can be used on intimate mixtures to identify the abundances of materials in a pixel, but they cannot provide additional property information. Radiative transfer models can create mixture signatures, but only with a set of well-characterized physical parameters that are typically not known or are difficult to retrieve. Finally, the approach described here creates a parameter inversion model from a radiative transfer model and uses empirically measured mixture data to retrieve physical characteristics of the contaminated surface and derive a total contaminant mass present.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Topological Analysis of The SPOKE Graph

The SPOKE graph [2, 6] is a sparse decorated semantic graph representing a collection of knowledge collected in many scientific databases from the fields of healthcare, biochemistry, chemistry, biology, et cetera. This knowledge graph is stored as a relational dataset decorated with metadata on each constituent vertex and edge. Formally, the graph is G(V, E, D), where V is a set of n vertices V := {1, ..., n} and edges of the form (i, j) ϵ E for i, j ϵ V, and table D that for any item in V υ E stores unstructured data such as vertex/edge type, nature of a relationship, et cetera. D(i) = {data involving vertex i ϵ V}, and D(i, j) = {data involving edge (i, j) ϵ E}. Here, we treat the graph as undirected in the sense that a direct relationship for (i, j) causes a (possibly opposite) reverse direct relationship for (j, i). The SPOKE graph G(V, E, D) is formed by processing a collection of relational datasets from medicine, chemistry, and biology, connecting many entities. Here, we analyze an instance from 2019, Spoke-20190707, where a graph file contains 6.16M edges and associated metadata and a vertex file contains 2.15M vertices and the associated metadata. There are 12 different types of vertex entities; all edge types used are implicit (see §2). There is other metadata in D on edges and vertices, but we just use the topology and the vertex labels in this report. SPOKE is growing as more knowledge is gained and more datasets are added. SPOKE is likely to grow 10x during the next phase of this project, and we therefore would like to consider topoligical analysis techniques that are scalable to several orders of magnitude larger than the current dataset (say >1B edges).

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Measuring Electron Diffusion and Constraining the Neutral Current $\pi^0$ Background for Single-Photon Events in MicroBooNE

Liquid Argon Time Projection Chambers (LArTPCs) are a rising technology in the field of experimental neutrino physics. LArTPCs use ionization electrons and scintillation light to reconstruct neutrino interactions with exceptional calorimetric and position resolution capabilities. Here, I present two analyses conducted in the MicroBooNE LArTPC at Fermilab: a measurement of the longitudinal electron diffusion coefficient, $D_L$, in the MicroBooNE detector and a constraint of the systematic uncertainty on MicroBooNE's single-photon analysis due to the dominant neutral current (NC) \piz{} background. Longitudinal electron diffusion modifies the spatial and timing resolution of the detector, and measuring it will help correct for these effects. Furthermore, current measurements of $D_L$ in liquid argon are sparse and in tension with one another, making the MicroBooNE measurement especially valuable. We report a measurement of $3.74^{+0.28}_{-0.29}$ cm$^2$/s. MicroBooNE is searchin g for si ngle-photon events as a potential explanation for the MiniBooNE low-energy excess (LEE) of electron neutrino-like events, which has been interpreted as evidence for low-mass sterile neutrinos. However, this search is overwhelmed by a large NC \piz{} background. By performing a sideband selection of NC \piz{} events, we apply a data-driven rate constraint to the single-photon analysis to reduce the systematic uncertainties. At present, this constraint improves the single-photon analysis' median sensitivity to the LEE-like signal from 0.9$\sigma$ to $1.5\sigma$. This sensitivity is expected to improve significantly as more data become available. Both of these measurements will not only benefit MicroBooNE, but also inform future LArTPC experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2015

A method of surface marker location optimization for tumor motion estimation in lung stereotactic body radiation therapy

Purpose: Accurately localizing lung tumor localization is essential for high-precision radiation therapy techniques such as stereotactic body radiation therapy (SBRT). Since direct monitoring of tumor motion is not always achievable due to the limitation of imaging modalities for treatment guidance, placement of fiducial markers on the patient’s body surface to act as a surrogate for tumor position prediction is a practical alternative for tracking lung tumor motion during SBRT treatments. In this work, the authors propose an innovative and robust model to solve the multimarker position optimization problem. The model is able to overcome the major drawbacks of the sparse optimization approach (SOA) model. Methods: The principle-component-analysis (PCA) method was employed as the framework to build the authors’ statistical prediction model. The method can be divided into two stages. The first stage is to build the surrogate tumor matrix and calculate its eigenvalues and associated eigenvectors. The second stage is to determine the “best represented” columns of the eigenvector matrix obtained from stage one and subsequently acquire the optimal marker positions as well as numbers. Using 4-dimensional CT (4DCT) and breath hold CT imaging data, the PCA method was compared to the SOA method with respect to calculation time, average prediction accuracy, prediction stability, noise resistance, marker position consistency, and marker distribution. Results: The PCA and SOA methods which were both tested were on all 11 patients for a total of 130 cases including 4DCT and breath-hold CT scenarios. The maximum calculation time for the PCA method was less than 1 s with 64 752 surface points, whereas the average calculation time for the SOA method was over 12 min with 400 surface points. Overall, the tumor center position prediction errors were comparable between the two methods, and all were less than 1.5 mm. However, for the extreme scenarios (breath hold), the prediction errors for the PCA method were not only smaller, but were also more stable than for the SOA method. Results obtained by imposing a series of random noises to the surrogates indicated that the PCA method was much more noise resistant than the SOA method. The marker position consistency tests using various combinations of 4DCT phases to construct the surrogates suggested that the marker position predictions of the PCA method were more consistent than those of the SOA method, in spite of surrogate construction. Marker distribution tests indicated that greater than 80% of the calculated marker positions fell into the high cross correlation and high motion magnitude regions for both of the algorithms. Conclusions: The PCA model is an accurate, efficient, robust, and practical model for solving the multimarker position optimization problem to predict lung tumor motion during SBRT treatments. Due to its generality, PCA model can also be applied to other imaging guidance system whichever using surface motion as the surrogates.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Explosion Detection Using Smartphones: Ensemble Learning with the Smartphone High-Explosive Audio Recordings Dataset and the ESC-50 Dataset

Explosion monitoring is performed by infrasound and seismoacoustic sensor networks that are distributed globally, regionally, and locally. However, these networks are unevenly and sparsely distributed, especially at the local scale, as maintaining and deploying networks is costly. With increasing interest in smaller-yield explosions, the need for more dense networks has increased. To address this issue, we propose using smartphone sensors for explosion detection as they are cost-effective and easy to deploy. Although there are studies using smartphone sensors for explosion detection, the field is still in its infancy and new technologies need to be developed. We applied a machine learning model for explosion detection using smartphone microphones. The data used were from the Smartphone High-explosive Audio Recordings Dataset (SHAReD), a collection of 326 waveforms from 70 high-explosive (HE) events recorded on smartphones, and the ESC-50 dataset, a benchmarking dataset commonly used for environmental sound classification. Two machine learning models were trained and combined into an ensemble model for explosion detection. The resulting ensemble model classified audio signals as either “explosion”, “ambient”, or “other” with true positive rates (recall) greater than 96% for all three categories.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

DOE OSTI2026

Peak2Patch: High-Fidelity Functional Group Identification through Attention-Based Fusion of Infrared and Mass Spectra

Identifying molecular structure based on spectroscopic readings is a key task in a variety of chemical and biological applications. Common spectroscopy techniques, such as Infrared (IR) Spectroscopy and Mass Spectrometry (MS), provide detailed information on the structure of molecular compounds but nonetheless require expert-level knowledge to decode. Machine learning has emerged as a potential solution for automating structure prediction from chemical spectra; however, current approaches generally focus on single sensor modalities, neglecting to leverage the complementary information contained within differing spectra. In this paper, we introduce Peak2Patch, a novel approach to fusion-enhanced prediction of functional groups from IR and mass spectra. First, we perform a detailed comparison of backbone networks for encoding both sparse mass spectra and dense IR spectra and demonstrate the superior performance of transformer neural networks over current state-of-the-art convolutional neural networks. Second, we evaluate three broad categories of fusion: early (raw feature), middle (deep feature), and late (decision) fusion, demonstrating the potential of a deep feature fusion-based approach. Lastly, we present Peak2Patch, our attention-based fusion scheme, which leverages cross-attention to mix features between encoded tokens of the two modalities. We validate our approach on a publicly available multimodal spectroscopic data set of 790k simulated molecules, demonstrating a large improvement in functional group prediction over both the previous state-of-the-art and our own strong single-modal baselines.

Jacobson, Philip [Sandia National Laboratories (SN↗

DOE OSTI2013

Compressive Sensing Based Machine Learning Strategy For Characterizing The Flow Around A Cylinder With Limited Pressure Measurements

Compressive sensing is used to determine the flow characteristics around a cylinder (Reynolds number and pressure/flow field) from a sparse number of pressure measurements on the cylinder. Using a supervised machine learning strategy, library elements encoding the dimensionally reduced dynamics are computed for various Reynolds numbers. Convex L1 optimization is then used with a limited number of pressure measurements on the cylinder to reconstruct, or decode, the full pressure field and the resulting flow field around the cylinder. Aside from the highly turbulent regime (large Reynolds number) where only the Reynolds number can be identified, accurate reconstruction of the pressure field and Reynolds number is achieved. The proposed data-driven strategy thus achieves encoding of the fluid dynamics using the L2 norm, and robust decoding (flow field reconstruction) using the sparsity promoting L1 norm.

Bright, Ido↗