SEARCH · Engineering Papers
Results for “Sparse estimation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Methods of Reverberation Mapping. I. Time-lag Determination by Measures of Randomness
A class of methods for measuring time delays between astronomical time series is introduced in the context of quasar reverberation mapping, which is based on measures of randomness or complexity of the data. Several distinct statistical estimators are considered that do not rely on polynomial interpolations of the light curves nor on their stochastic modeling, and do not require binning in correlation space. Methods based on von Neumann’s mean-square successive-difference estimator are found to be superior to those using other estimators. An optimized von Neumann scheme is formulated, which better handles sparsely sampled data and outperforms current implementations of discrete correlation function methods. This scheme is applied to existing reverberation data of varying quality, and consistency with previously reported time delays is found. In particular, the size–luminosity relation of the broad-line region in quasars is recovered with a scatter comparable to that obtained by other works, yet with fewer assumptions made concerning the process underlying the variability. The proposed method for time-lag determination is particularly relevant for irregularly sampled time series, and in cases where the process underlying the variability cannot be adequately modeled.
Vibration Analysis of the Space Shuttle External Tank Cable Tray Flight Data with and without PAL Ramp
External Tank Cable Tray vibration data for three successive Space Shuttle flights were analyzed to assess response to buffet and the effect of removal of the Protuberance Air Loads (PAL) ramp. Waveform integration, spectral analysis, cross-correlation analysis and wavelet analysis were employed to estimate vibration modes and temporal development of vibration motion from a sparse array of accelerometers and an on-board system that acquired 16 channels of data for approximately the first two minutes of each flight. The flight data indicated that PAL ramp removal had minimal effect on the fluctuating loads on the cable tray. The measured vibration frequencies and modes agreed well with predicted structural response.
Vibration Analysis of the Space Shuttle External Tank Cable Tray Flight Data With and Without PAL Ramp
External Tank Cable Tray vibration data for three successive Space Shuttle flights were analyzed to assess response to buffet and the effect of removal of the Protuberance Air Loads (PAL) ramp. Waveform integration, spectral analysis, cross-correlation analysis and wavelet analysis were employed to estimate vibration modes and temporal development of vibration motion from a sparse array of accelerometers and an on-board system that acquired 16 channels of data for approximately the first 2 min of each flight. The flight data indicated that PAL ramp removal had minimal effect on the fluctuating loads on the cable tray. The measured vibration frequencies and modes agreed well with predicted structural response.
Linearized Functional Minimization for Inverse Modeling
Heterogeneous aquifers typically consist of multiple lithofacies, whose spatial arrangement significantly affects flow and transport. The estimation of these lithofacies is complicated by the scarcity of data and by the lack of a clear correlation between identifiable geologic indicators and attributes. We introduce a new inverse-modeling approach to estimate both the spatial extent of hydrofacies and their properties from sparse measurements of hydraulic conductivity and hydraulic head. Our approach is to minimize a functional defined on the vectors of values of hydraulic conductivity and hydraulic head fields defined on regular grids at a user-determined resolution. This functional is constructed to (i) enforce the relationship between conductivity and heads provided by the groundwater flow equation, (ii) penalize deviations of the reconstructed fields from measurements where they are available, and (iii) penalize reconstructed fields that are not piece-wise smooth. We develop an iterative solver for this functional that exploits a local linearization of the mapping from conductivity to head. This approach provides a computationally efficient algorithm that rapidly converges to a solution. A series of numerical experiments demonstrates the robustness of our approach.
Wide-area, long-term satellite rain estimation using GOES high resolution imagery
Initial results are presented from a simple technique that has been developed to investigate the utility of satellite rain estimation over the intermountain west of the United States during the summer season. Gage information is relatively sparse over this region, and convective rainfall is strongly modulated by orographic influences; the semiarid character of the region often results in substantial evaporation of precipitation beneath high cloud bases. The rain estimation technique described here obtains results that are generally comparable with the Adler/Negri CST technique.
Building Alternative Indices of Socioeconomic Status for Population Modeling in Data-Sparse Contexts (Short Paper)
Population modeling requires clear definitions of socioeconomic status (SES) to ensure overall estimate accuracy and locate potentially underserved subpopulations. This presents a challenge as SES can be measured in myriad ways and for divergent purposes, and the data required to calculate these metrics may be lacking, particularly in low and middle income countries (LMICs). To support more refined SES measurement, we explore improvements upon the Demographic and Health Survey’s (DHS) Wealth Index (DHS-WI) using alternative characterizations of SES based on multiple correspondence analysis (MCA) and hierarchical clustering. We produce the MCA-derived metrics first on a full suite of household economic, demographic, and dwelling variables, then on a reduced set of occupant-only SES characteristics. We explore the utility of these metrics relative to DHS-WI based on their ability to 1) differentiate DHS household types and 2) identify mixtures of SES levels within DHS samples and mapped at high spatial resolution. We find that our full suite MCA yields more clearly defined SES segments and that our reduced MCA delineates occupant SES most clearly, suggesting potential pathways to improve upon the DHS-WI in future population modeling efforts for LMICs.
Impact of binary interactions on the diffuse supernova neutrino background
Binary interactions, especially mass transfer and mergers, can strongly influence the evolution of massive stars and change their final properties and the occurrence of supernovae. Here, we investigate how binary interactions affect predictions of the diffuse flux of neutrinos. By performing stellar population syntheses including prescriptions for binary interactions, we show that the resulting detection rates of the diffuse supernova neutrino background is enhanced by 15%–20% compared to estimates without binary considerations. A source of significant uncertainty arises due to the presently sparse knowledge of the evolution of rapidly rotating carbon-oxygen cores, especially those created as a result of mergers near the white dwarf to core collapse boundary. As a result, the enhancement effect may be as small as a few percent if the effects of rotation in postmerger systems are neglected, or as large as 75% if trends are extrapolated. Our estimates serve to highlight that binary effects can be important.
A Comparison of Soil Moisture Retrieval Models Using SIR-C Measurements over the Little Washita River Watershed
Six SIR-C L-band measurements over the Little Washita River watershed in Chickasha, Oklahoma during 11-17 April 1994 have been analyzed for studying the change of soil moisture in the region. Two algorithms developed recently for estimation of moisture content in bare soil were applied to these measurements and the results were compared with those sampled on the ground. There is a good agreement between the values of soil moisture estimated by either one of the algorithms and those measured from ground sampling for bare or sparsely vegetated fields. The standard error from this comparison is on the order of 0.05-0.06 cu cm/cu cm, which is comparable to that expected from a regression between backscattering coefficients and measured soil moisture. Both algorithms provide a poor estimation of soil moisture or fail to give solutions to areas covered with moderate or dense vegetation. Even for bare soils the number of pixels that bear no numerical solution from the application of either one of the two algorithms to the data is not negligible. Results from using one of these algorithms indicate that the fraction of these pixels becomes larger as the bare soils become drier. The other algorithm generally gives a larger fraction of these pixels when the fields are vegetation-covered. The implication and impact of these features are discussed in this article.
Adaptive OFDM Waveform Design for Spatio-Temporal-Sparsity Exploited STAP Radar
In this chapter, we describe a sparsity-based space-time adaptive processing (STAP) algorithm to detect a slowly moving target using an orthogonal frequency division multiplexing (OFDM) radar. The motivation of employing an OFDM signal is that it improves the target-detectability from the interfering signals by increasing the frequency diversity of the system. However, due to the addition of one extra dimension in terms of frequency, the adaptive degrees-of-freedom in an OFDM-STAP also increases. Therefore, to avoid the construction a fully adaptive OFDM-STAP, we develop a sparsity-based STAP algorithm. We observe that the interference spectrum is inherently sparse in the spatio-temporal domain, as the clutter responses occupy only a diagonal ridge on the spatio-temporal plane and the jammer signals interfere only from a few spatial directions. Hence, we exploit that sparsity to develop an efficient STAP technique that utilizes considerably lesser number of secondary data compared to the other existing STAP techniques, and produces nearly optimum STAP performance. In addition to designing the STAP filter, we optimally design the transmit OFDM signals by maximizing the output signal-to-interference-plus-noise ratio (SINR) in order to improve the STAP performance. The computation of output SINR depends on the estimated value of the interference covariance matrix, which we obtain by applying the sparse recovery algorithm. Therefore, we analytically assess the effects of the synthesized OFDM coefficients on the sparse recovery of the interference covariance matrix by computing the coherence measure of the sparse measurement matrix. Our numerical examples demonstrate the achieved STAP-performance due to sparsity-based technique and adaptive waveform design.
Dynamic Stochastic Superresolution of sparsely observed turbulent systems
Real-time capture of the relevant features of the unresolved turbulent dynamics of complex natural systems from sparse noisy observations and imperfect models is a notoriously difficult problem. The resulting lack of observational resolution and statistical accuracy in estimating the important turbulent processes, which intermittently send significant energy to the large-scale fluctuations, hinders efficient parameterization and real-time prediction using discretized PDE models. This issue is particularly subtle and important when dealing with turbulent geophysical systems with an vast range of interacting spatio-temporal scales and rough energy spectra near the mesh scale of numerical models. Here, we introduce and study a suite of general Dynamic Stochastic Superresolution (DSS) algorithms and show that, by appropriately filtering sparse regular observations with the help of cheap stochastic exactly solvable models, one can derive stochastically ‘superresolved’ velocity fields and gain insight into the important characteristics of the unresolved dynamics, including the detection of the so-called black swans. The DSS algorithms operate in Fourier domain and exploit the fact that the coarse observation network aliases high-wavenumber information into the resolved waveband. It is shown that these cheap algorithms are robust and have significant skill on a test bed of turbulent solutions from realistic nonlinear turbulent spatially extended systems in the presence of a significant model error. In particular, the DSS algorithms are capable of successfully capturing time-localized extreme events in the unresolved modes, and they provide good and robust skill for recovery of the unresolved processes in terms of pattern correlation. Moreover, we show that DSS improves the skill for recovering the primary modes associated with the sparse observation mesh which is equally important in applications. The skill of the various DSS algorithms depends on the energy spectrum of the turbulent signal and the observation time relative to the decorrelation time of the turbulence at a given spatial scale in a fashion elucidated here. The DSS technique exploiting a simple Gaussian closure of the nonlinear stochastic forecast model emerges as the most suitable trade-off between the superresolution skill and computational complexity associated with estimating the cross-correlations between the aliasing modes of the sparsely observed turbulent signal. Such techniques offer a promising and efficient approach to constraining unresolved turbulent fluxes through stochastic superparameterization and a subsequent improvement in coarse-grained filtering and prediction of the next generation atmosphere–ocean system (AOS) models.
Hierarchical Bayesian Inverse Problems: A High-Dimensional Statistics Viewpoint
This paper analyzes hierarchical Bayesian inverse problems using techniques from highdimensional statistics. Furthermore, our analysis leverages a property of hierarchical Bayesian regularizers that we call approximate decomposability to obtain non-asymptotic bounds on the reconstruction error attained by maximum a posteriori estimators. The new theory explains how hierarchical Bayesian models that exploit sparsity, group sparsity, and sparse representations of the unknown parameter can achieve accurate reconstructions in high-dimensional settings.
Irrigation Infrastructure and Modernization – Setting a Baseline: Estimates of Irrigation Water Conveyance Infrastructure Extents and Composition and the Potential Water, Energy, and Economic Benefits of Modernization in the Western U.S.
In the Western United States (U.S.), water delivery for irrigation is still largely managed using century-old equipment and designs. Modernization of this vital water conveyance infrastructure, such as piping of earthen canals, is known to improve water availability and water quality for farmers, while saving energy and enabling new hydropower. However, there is sparse information about the extent of irrigation water delivery infrastructure, which makes it challenging to estimate the cost of upgrades at scale and the potential benefits of accelerating modernization work. This report estimates a variety of previously unquantified data points related to irrigation water delivery infrastructure in the Western U.S. to support stakeholders interested in nationwide modernization planning. The findings should be considered approximations, useful for understanding the scale, range, or variability of these indicators. Taken together, the findings of this report illustrate some of the challenges and opportunities involved in modernizing the agricultural water delivery infrastructure in the Western U.S. Accelerating the pace of modernization could strengthen the long-term resilience of U.S. food systems while providing significant economic, energy, water, and environmental benefits.
Accuracy optimized neural networks do not effectively model optic flow tuning in brain area MSTd
Accuracy-optimized convolutional neural networks (CNNs) have emerged as highly effective models at predicting neural responses in brain areas along the primate ventral stream, but it is largely unknown whether they effectively model neurons in the complementary primate dorsal stream. We explored how well CNNs model the optic flow tuning properties of neurons in dorsal area MSTd and we compared our results with the Non-Negative Matrix Factorization (NNMF) model, which successfully models many tuning properties of MSTd neurons. To better understand the role of computational properties in the NNMF model that give rise to optic flow tuning that resembles that of MSTd neurons, we created additional CNN model variants that implement key NNMF constraints – non-negative weights and sparse coding of optic flow. While the CNNs and NNMF models both accurately estimate the observer's self-motion from purely translational or rotational optic flow, NNMF and the CNNs with nonnegative weights yield substantially less accurate estimates than the other CNNs when tested on more complex optic flow that combines observer translation and rotation. Despite its poor accuracy, NNMF gives rise to tuning properties that align more closely with those observed in primate MSTd than any of the accuracy-optimized CNNs. This work offers a step toward a deeper understanding of the computational properties and constraints that describe the optic flow tuning of primate area MSTd.
A state-space Bayesian framework for estimating biogeochemical transformations using time-lapse geophysical data
We develop a state-space Bayesian framework to combine time-lapse geophysical data with other types of information for quantitative estimation of biogeochemical parameters during bioremediation. We consider characteristics of end-products of biogeochemical transformations as state vectors, which evolve under constraints of local environments through evolution equations, and consider time-lapse geophysical data as available observations, which could be linked to the state vectors through petrophysical models. We estimate the state vectors and their associated unknown parameters over time using Markov chain Monte Carlo sampling methods. To demonstrate the use of the state-space approach, we apply it to complex resistivity data collected during laboratory column biostimulation experiments that were poised to precipitate iron and zinc sulfides during sulfate reduction. We develop a petrophysical model based on sphere-shaped cells to link the sulfide precipitate properties to the time-lapse geophysical attributes and estimate volume fraction of the sulfide precipitates, fraction of the dispersed, sulfide-encrusted cells, mean radius of the aggregated clusters, and permeability over the course of the experiments. Results of the case study suggest that the developed state-space approach permits the use of geophysical datasets for providing quantitative estimates of end-product characteristics and hydrological feedbacks associated with biogeochemical transformations. Although tested here on laboratory column experiment datasets, the developed framework provides the foundation needed for quantitative field-scale estimation of biogeochemical parameters over space and time using direct, but often sparse wellbore data with indirect, but more spatially extensive geophysical datasets.
REANALYSIS OF F-STATISTIC GRAVITATIONAL-WAVE SEARCHES WITH THE HIGHER CRITICISM STATISTIC
We propose a new method of gravitational-wave detection using a modified form of higher criticism, a statistical technique introduced by Donoho and Jin. Higher criticism is designed to detect a group of sparse, weak sources, none of which are strong enough to be reliably estimated or detected individually. We apply higher criticism as a second-pass method to synthetic F-statistic and C-statistic data for a monochromatic periodic source in a binary system and quantify the improvement relative to the first-pass methods. We find that higher criticism on C-statistic data is more sensitive by {approx}6% than the C-statistic alone under optimal conditions (i.e., binary orbit known exactly) and the relative advantage increases as the error in the orbital parameters increases. Higher criticism is robust even when the source is not monochromatic (e.g., phase-wandering in an accreting system). Applying higher criticism to a phase-wandering source over multiple time intervals gives a {approx}> 30% increase in detectability with few assumptions about the frequency evolution. By contrast, in all-sky searches for unknown periodic sources, which are dominated by the brightest source, second-pass higher criticism does not provide any benefits over a first-pass search.
Characteristics of thermospheric infrasound predicted using ray tracing and weakly non-linear waveform analyses
Infrasonic signals refracted by thermal gradients in the rarefied upper atmosphere are modeled using a combination of ray tracing and weak shock theory to develop an understanding of thermospheric infrasound signals produced by energetic, transient sources. Canonical arrival structures in the form of u-wave signatures are identified for returns refracted at lower altitudes within the thermosphere, and possible multi-pathing produced by effective sound speed inflections are investigated to elucidate more complex arrival structures, which are found to be spatially localized. Furthermore, variability in the source characteristics is investigated and it is found that whereas some waveform phase information is lost due to finite amplitude effects, arrival characteristics are strongly dependent on the peak overpressure near the source. Variability in the propagation path is considered using archived atmospheric specifications and implies that despite uncertainties related to the dynamic and sparsely sampled nature of the atmosphere, thermospheric signatures might be useful in estimating the yield for explosive sources. Last, thermospheric arrivals from a failed rocket launch, as well as those from several large chemical explosions, are analyzed and it is found that qualitative trends match those predicted, and analyses here provide additional insight into such signatures.
Gene and transcript abundances of bacterial type III secretion systems from the rumen microbiome are correlated with methane yield in sheep
Background: Ruminants are important contributors to global methane emissions via microbial fermentation in their reticulo-rumens. This study is part of a larger program, characterising the rumen microbiomes of sheep which vary naturally in methane yield (g CH4/kg DM/day) and aims to defne diferences in microbial communities, and in gene and transcript abundances that can explain the animal methane phenotype. Methods: Rumen microbiome metagenomic and metatranscriptomic data were analysed by Gene Set Enrichment, sparse partial least squares regression and the Wilcoxon Rank Sum test to estimate correlations between specifc KEGG bacterial pathways/genes and high methane yield in sheep. KEGG genes enriched in high methane yield sheep were reassembled from raw reads and existing contigs and analysed by MEGAN to predict their phylogenetic origin. Protein coding sequences from Succinivibrio dextrinosolvens strains were analysed using Efective DB to predict bacterial type III secreted proteins. The efect of S. dextrinosolvens strain H5 growth on methane formation by rumen methanogens was explored using co-cultures. Results: Detailed analysis of the rumen microbiomes of high methane yield sheep shows that gene and transcript abundances of bacterial type III secretion system genes are positively correlated with methane yield in sheep. Most of the bacterial type III secretion system genes could not be assigned to a particular bacterial group, but several genes were afliated with the genus Succinivibrio, and searches of bacterial genome sequences found that strains of S. dextrinosolvens were part of a small group of rumen bacteria that encode this type of secretion system. In co-culture experiments, S. dextrinosolvens strain H5 showed a growth-enhancing efect on a methanogen belonging to the order Methanomassiliicoccales, and inhibition of a representative of the Methanobrevibacter gottschalkii clade. Conclusions: This is the frst report of bacterial type III secretion system genes being associated with high methane emissions in ruminants, and identifes these secretions systems as potential new targets for methane mitigation research. The effects of S. dextrinosolvens on the growth of rumen methanogens in co-cultures indicate that bacteriamethanogen interactions are important modulators of methane production in ruminant animals.