Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

The GEOS Ozone Data Assimilation System: Specification of Error Statistics

A global three-dimensional ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center. The Total Ozone Mapping Spectrometer (TOMS) total ozone and the Solar Backscatter Ultraviolet (SBUV) or (SBUV/2) partial ozone profile observations are assimilated. The assimilation, into an off-line ozone transport model, is done using the global Physical-space Statistical Analysis Scheme (PSAS). This system became operational in December 1999. A detailed description of the statistical analysis scheme, and in particular, the forecast and observation error covariance models is given. A new global anisotropic horizontal forecast error correlation model accounts for a varying distribution of observations with latitude. Correlations are largest in the zonal direction in the tropics where data is sparse. Forecast error variance model is proportional to the ozone field. The forecast error covariance parameters were determined by maximum likelihood estimation. The error covariance models are validated using x squared statistics. The analyzed ozone fields in the winter 1992 are validated against independent observations from ozone sondes and HALOE. There is better than 10% agreement between mean Halogen Occultation Experiment (HALOE) and analysis fields between 70 and 0.2 hPa. The global root-mean-square (RMS) difference between TOMS observed and forecast values is less than 4%. The global RMS difference between SBUV observed and analyzed ozone between 50 and 3 hPa is less than 15%.

Stajner, Ivanka↗

Patterns of Canopy and Surface Layer Consumption in a Boreal Forest Fire from Repeat Airborne Lidar

Fire in the boreal region is the dominant agent of forest disturbance with direct impacts on ecosystem structure, carbon cycling, and global climate. Global and biome-scale impacts are mediated by burn severity, measured as loss of forest canopy and consumption of the soil organic layer. To date, knowledge of the spatial variability in burn severity has been limited by sparse field sampling and moderate resolution satellite data. Here, we used pre- and post-fire airborne lidar data to directly estimate changes in canopy vertical structure and surface elevation for a 2005 boreal forest fire on Alaskas Kenai Peninsula. We found that both canopy and surface losses were strongly linked to pre-fire species composition and exhibited important fine-scale spatial variability at sub-30m resolution. The fractional reduction in canopy volume ranged from 0.61 in lowland black spruce stands to 0.27 in mixed white spruce and broad leaf forest. Residual structure largely reflects standing dead trees, highlighting the influence of pre-fire forest structure on delayed carbon losses from above ground biomass, post-fire albedo, and variability in understory light environments. Median loss of surface elevation was highest in lowland black spruce stands (0.18 m) but much lower in mixed stands (0.02 m), consistent with differences in pre-fire organic layer accumulation. Spatially continuous depth-of-burn estimates from repeat lidar measurements provide novel information to constrain carbon emissions from the surface organic layer and may inform related research on post-fire successional trajectories. Spectral measures of burn severity from Landsat were correlated with canopy (r = 0.76) and surface (r = -0.71) removal in black spruce stands but captured less of the spatial variability in fire effects for mixed stands (canopy r = 0.56, surface r = -0.26), underscoring the difficulty in capturing fire effects in heterogeneous boreal forest landscapes using proxy measures of burn severity from Landsat.

Alonzo, Michael↗

Biome-scale temperature sensitivity of ecosystem respiration revealed by atmospheric CO2 observations

Abstract The temperature sensitivity of ecosystem respiration regulates how the terrestrial carbon sink responds to a warming climate but has been difficult to constrain observationally beyond the plot scale. Here we use observations of atmospheric CO 2 concentrations from a network of towers together with carbon flux estimates from state-of-the-art terrestrial biosphere models to characterize the temperature sensitivity of ecosystem respiration, as represented by the Arrhenius activation energy, over various North American biomes. We infer activation energies of 0.43 eV for North America and 0.38 eV to 0.53 eV for major biomes therein, which are substantially below those reported for plot-scale studies (approximately 0.65 eV). This discrepancy suggests that sparse plot-scale observations do not capture the spatial-scale dependence and biome specificity of the temperature sensitivity. We further show that adjusting the apparent temperature sensitivity in model estimates markedly improves their ability to represent observed atmospheric CO 2 variability. This study provides observationally constrained estimates of the temperature sensitivity of ecosystem respiration directly at the biome scale and reveals that temperature sensitivities at this scale are lower than those based on earlier plot-scale studies. These findings call for additional work to assess the resilience of large-scale carbon sinks to warming.

54 ENVIRONMENTAL SCIENCES↗

Efficient Implementation of an Optimal Interpolator for Large Spatial Data Sets

Scattered data interpolation is a problem of interest in numerous areas such as electronic imaging, smooth surface modeling, and computational geometry. Our motivation arises from applications in geology and mining, which often involve large scattered data sets and a demand for high accuracy. The method of choice is ordinary kriging. This is because it is a best unbiased estimator. Unfortunately, this interpolant is computationally very expensive to compute exactly. For n scattered data points, computing the value of a single interpolant involves solving a dense linear system of size roughly n x n. This is infeasible for large n. In practice, kriging is solved approximately by local approaches that are based on considering only a relatively small'number of points that lie close to the query point. There are many problems with this local approach, however. The first is that determining the proper neighborhood size is tricky, and is usually solved by ad hoc methods such as selecting a fixed number of nearest neighbors or all the points lying within a fixed radius. Such fixed neighborhood sizes may not work well for all query points, depending on local density of the point distribution. Local methods also suffer from the problem that the resulting interpolant is not continuous. Meyer showed that while kriging produces smooth continues surfaces, it has zero order continuity along its borders. Thus, at interface boundaries where the neighborhood changes, the interpolant behaves discontinuously. Therefore, it is important to consider and solve the global system for each interpolant. However, solving such large dense systems for each query point is impractical. Recently a more principled approach to approximating kriging has been proposed based on a technique called covariance tapering. The problems arise from the fact that the covariance functions that are used in kriging have global support. Our implementations combine, utilize, and enhance a number of different approaches that have been introduced in literature for solving large linear systems for interpolation of scattered data points. For very large systems, exact methods such as Gaussian elimination are impractical since they require 0(n(exp 3)) time and 0(n(exp 2)) storage. As Billings et al. suggested, we use an iterative approach. In particular, we use the SYMMLQ method, for solving the large but sparse ordinary kriging systems that result from tapering. The main technical issue that need to be overcome in our algorithmic solution is that the points' covariance matrix for kriging should be symmetric positive definite. The goal of tapering is to obtain a sparse approximate representation of the covariance matrix while maintaining its positive definiteness. Furrer et al. used tapering to obtain a sparse linear system of the form Ax = b, where A is the tapered symmetric positive definite covariance matrix. Thus, Cholesky factorization could be used to solve their linear systems. They implemented an efficient sparse Cholesky decomposition method. They also showed if these tapers are used for a limited class of covariance models, the solution of the system converges to the solution of the original system. Matrix A in the ordinary kriging system, while symmetric, is not positive definite. Thus, their approach is not applicable to the ordinary kriging system. Therefore, we use tapering only to obtain a sparse linear system. Then, we use SYMMLQ to solve the ordinary kriging system. We show that solving large kriging systems becomes practical via tapering and iterative methods, and results in lower estimation errors compared to traditional local approaches, and significant memory savings compared to the original global system. We also developed a more efficient variant of the sparse SYMMLQ method for large ordinary kriging systems. This approach adaptively finds the correct local neighborhood for each query point in the interpolation process.

Memarsadeghi, Nargess↗

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗

Improvements to TOVS retrievals over sea ice and applications to estimating Arctic energy fluxes

Modeling studies suggest that polar regions play a major role in modulating the Earth's climate and that they may be more sensitive than lower latitudes to climate change. Until recently, however, data from meteorological stations poleward of 70 degs have been sparse, and consequently, our understanding of air-sea-ice interaction processes is relatively poor. Satellite-borne sensors now offer a promising opportunity to observe polar regions and ultimately to improve parameterizations of energy transfer processes in climate models. This study focuses on the application of the TIROS-N operational vertical sounder (TOVS) to sea-ice-covered regions in the nonmelt season. TOVS radiances are processed with the improved initialization inversion ('3I') algorithm, providng estimates of layer-average temperature and moisture, cloud conditions, and surface characteristics at a horizontal resolution of approximately 100 km x 100 km. Although TOVS has flown continuously on polar-orbiting satellites since 1978, its potential has not been realized in high latitudes because the quality of retrievals is often significantly lower over sea ice and snow than over the surfaces. The recent availability of three Arctic data sets has provided an opportunity to validate TOVS retrievals: the first from the Coordinated Eastern Arctic Experiment (CEAREX) in winter 1988/1989, the second from the LeadEx field program in spring 1992, and the third from Russian drifting ice stations. Comparisons with these data reveal deficiencies in TOVS retrievals over sea ice during the cold season; e.g., ice surface temperature is often 5 to 15 K too warm, microwave emissivity is approximately 15% too low at large view angles, clear/cloudy scenes are sometimes misidentified, and low-level inversions are often not captured. In this study, methods to reduce these errors are investigated. Improvements to the ice surface temperature retrieval have reduced rms errors from approximately 7 K to 3 K; correction of microwaves (50 GHz) brightness temperatures for view angle dependence now allows the surface type (open water versus sea ice) to be determined; modifications to the clear/cloud tests have improved cloud detection over sea ice, especially where it is inhomogeneous; and improved surface temperature estimates have resulted in more successful diagnoses of low-level stratification. Applications of improved retrievals to studies of the Arctic energy budget are encouraging. Preliminary calculations of air-ice stress vectors, 10-m wind speed, and horizontal advection of heat and moisture are presented.

Francis, Jennifer A.↗

Satellite Embedding-Based Population Imputation for Areas with Missing Building Footprint Data: A Computer Vision-Based Approach

High-resolution population modeling is important for supporting effective decision-making across diverse sectors. LandScan Mosaic generates population estimates at the level of individual buildings and aggregates them to 3 arc-second grids, and this approach performs well in regions where building footprint data are comprehensive and reliable. However, large portions of the globe still suffer from incomplete, sparse, or entirely missing building stock datasets, creating a structural limitation for strictly building-based population models. To address this research gap, this study proposes a computer vision-based framework that employs Google Earth Engine satellite embeddings and UNet, which allows us to directly impute grid-level population estimates in building-data-deficient areas. Applied to Taiwan as a case study, the framework achieved strong predictive performance with R$^{2}$ of 0.89, RMSE of 18.70, and MAE of 8.41, outperforming traditional machine learning approaches. Notably, the proposed framework effectively addressed building false-positive errors inherent in Global Human Settlement Layer (GHSL) data, correctly identifying uninhabited areas that were erroneously classified as populated. The framework also offers significant advantages for global population mapping, particularly in terms of scalability and temporal consistency, thereby extending the coverage and accuracy of high-resolution population products in data-scarce regions worldwide. Urban planners, decision makers, and related stakeholders can obtain granular population distributions to support more accurate and targeted infrastructure investment, service delivery, resource allocation, and risk assessment decisions.

97 MATHEMATICS AND COMPUTING↗

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models that includes the Navier–Stokes, Kuramoto–Sivashinsky and Sine–Gordon equations. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that, in general, the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level exceeds a critical threshold σ c . We provide explicit bounds on σ c in the case of Gaussian white noise and we explicitly characterize the spurious terms that arise in the case of trigonometric and/or polynomial libraries. Furthermore, we show that, if the data is suitably denoised (a simple moving average filter is sufficient), then asymptotic consistency is recovered for models with locally-Lipschitz, polynomial-growth nonlinearities. Our results reveal important aspects of weak-form equation learning, which may be used to improve future algorithms. We demonstrate our findings numerically using the Lorenz system, the cubic oscillator, a viscous Burgers-growth model and a Kuramoto–Sivashinsky-type high-order PDE.

asymptotic consistency↗

Constraining the Size of Near Earth Asteroids

Quick and accurate determination of the size of an asteroid is of great interest to the Asteroid Threat Assessment Project and is difficult to accomplish. With a combination of visible and thermal measurements we employ a method that leverages the size estimations of each model as physical constraints on the true diameter. This method breaks degeneracies present in the thermal and visible model from sparse data. In the visible bands we use both the established H-G relationship and its successor the H-G1G2 model, which has improved capabilities in the opposition effect and large phase angles. For the thermal models we use the Near Earth Asteroid Thermal Model (NEATM), the Night Emission Simulated Thermal Model (NESTM), and the Advanced Thermophysical Model (ATPM).

Nelson, Tyler↗

Stochastic Gradients for Large-Scale Tensor Decomposition

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is a recently proposed version of tensor decomposition that allows for a variety of loss functions such as Bernoulli loss for binary data or Huber loss for robust estimation. Here, the stochastic gradient is formed from randomly sampled elements of the tensor and is efficient because it can be computed using the sparse matricized-tensor times Khatri--Rao product tensor kernel. For dense tensors, we simply use uniform sampling. For sparse tensors, we propose two types of stratified sampling that give precedence to sampling nonzeros. Numerical results demonstrate the advantages of the proposed approach and its scalability to large-scale problems.

97 MATHEMATICS AND COMPUTING↗

Ice crystal growth in water vapor at high saturation

A simple technique is presented for estimating the energy of formation of monolayer icelike clusters at ice-vapor interfaces. Under the assumptions that the ice surfaces are smooth and sparsely covered with monomers, dimers, etc., in near equilibrium with the vapor, and that the bond energies and configurational entropy dominate the energy of formation, it is found that the basal surfaces prefer triangular embryos with an orientation which reverses from layer to layer, whereas the most stable clusters on the prism surfaces are rectangular in configuration. The preferred prism clusters are determined to have a significantly lower critical energy of formation than the basal clusters due to differences in both corner free energy and configurational entropy. This phenomenon provides a mechanism for strongly anisotropic crystal growth at high saturations.

Bartley, D. L.↗

Spaceborne Applications of P Band Imaging Radars for Measuring Forest Biomass

In three sites of boreal and temperate forests, P band HH, HV, and VV polarization data combined estimate total aboveground dry woody biomass within 12 to 27% of the values derived from allometric equations, depending on forest complexity. Biomass estimates derived from HV-polarization data only are 2 to 14% less accurate. When the radar operates at circular polarization, the errors exceed 100% over flooded forests, wet or damaged trees and sparse open tall forests because double-bounce reflections of the radar signals yield radar signatures similar to that of tall and massive forests. Circular polarizations, which minimize the effect of Faraday rotation in spaceborne applications, are therefore of limited use for measuring forest biomass. In the tropical rain forest of Manu, in Peru, where forest biomass ranges from 4 kg/sq m in young forest succession up to 50 kg/sq m in old, undisturbed floodplain stands, the P band horizontal and vertical polarization data combined separate biomass classes in good agreement with forest inventory estimates. The worldwide need for large scale, updated, biomass estimates, achieved with a uniformly applied method, justifies a more in-depth exploration of multi-polarization long wavelength imaging radar applications for tropical forests inventories.

Rignot, Eric J.↗

Estimating Sonic Boom Metrics Across a Community Using a Kalman Filter

As part of the Quesst mission, NASA will fly the X‑59 aircraft over selected communities to evaluate community responses to low-intensity sonic booms. The purpose of these community tests is to determine the dose-response relationship between the noise exposure metrics and the community response. The independent variables for the dose-response relationship are the noise exposure metrics experienced by survey respondents within the community. Two sources of noise exposure metrics are available in each community: measurements at sparse locations throughout the community, and calculations from propagation models across the community. Both the measurements and calculations are subject to uncertainty. A Kalman filter is proposed to combine the measured and calculated noise exposure metrics to obtain the best estimate of the true noise exposure metrics across the community. The noise exposure metrics estimated by the Kalman filter have lower uncertainty than either the measured or calculated noise exposure metrics alone. Simulations demonstrate that the Kalman filter produces a more accurate estimate of the true noise exposure metrics than other noise estimation methods.

Sonic boom↗

A Note on Substructuring Preconditioning for Nonconforming Finite Element Approximations of Second Order Elliptic Problems

In this paper an algebraic substructuring preconditioner is considered for nonconforming finite element approximations of second order elliptic problems in 3D domains with a piecewise constant diffusion coefficient. Using a substructuring idea and a block Gauss elimination, part of the unknowns is eliminated and the Schur complement obtained is preconditioned by a spectrally equivalent very sparse matrix. In the case of quasiuniform tetrahedral mesh an appropriate algebraic multigrid solver can be used to solve the problem with this matrix. Explicit estimates of condition numbers and implementation algorithms are established for the constructed preconditioner. It is shown that the condition number of the preconditioned matrix does not depend on either the mesh step size or the jump of the coefficient. Finally, numerical experiments are presented to illustrate the theory being developed.

Maliassov, Serguei↗

An Assessment of Our Ability to Model the Upper Troposphere and Lower Stratosphere in Interactive Climate Models

The physics of the upper troposphere is dominated by the different phases of water, while the lower stratosphere is governed by the presence of ozone. The tropopause may be regarded as the layer which separates the regions where stratospheric and tropospheric processes dominate the physics, but it is clearly not a smooth transition level. Modelling this region in comprehensive climate models is complicated, partly because of the constraints inherent in numerical methods (such as the finite resolution used in models) and partly because of our incomplete knowledge of the physical and chemical interactions which occur (such as the phase transitions of water and the composition of aerosols). However, studies of stratospheric impacts on climate change clearly require the tropopause region to be modelled with a high degree of accuracy. This paper will examine how well we can currently model the structure and dynamics of the tropopause region; this includes some comparisons of the simulated atmospheric composition with observational estimates of these species, some studies of discrepancies between forecasts and observations in the Data Assimilation System of the Data Assimilation office, and inferences for sparsely observed quantities. The analysis will focus on meteorological quantities, physical forcing mechanisms, and the transport and interactions of trace species.

Pawson, Steven↗

Spacecraft Station-Keeping Trajectory and Mission Design Tools

Two tools were developed for designing station-keeping trajectories and estimating delta-v requirements for designing missions to a small body such as a comet or asteroid. This innovation uses NPOPT, a non-sparse, general-purpose sequential quadratic programming (SQP) optimizer and the Two-Level Differential Corrector (T-LDC) in LTool (Libration point mission design Tool) to design three kinds of station-keeping scripts: vertical hovering, horizontal hovering, and orbiting. The T-LDC is used to differentially correct several trajectory legs that join hovering points. In a vertical hovering, the maximum and minimum range points must be connected smoothly while maintaining the spacecrafts range from a small body, all within the law of gravity and the solar radiation pressure. The same is true for a horizontal hover. A PatchPoint is an LTool class that denotes a space-time event with some extra information for differential correction, including a set of constraints to be satisfied by T-LDC. Given a set of PatchPoints, each with its own constraint, the T-LDC differentially corrects the entire trajectory by connecting each trajectory leg joined by PatchPoints while satisfying all specified constraints at the same time. Vertical and horizontal hover both are needed to minimize delta-v spent for station keeping. A Python I/F to NPOPT has been written to be used from an LTool script. In vertical hovering, the spacecraft stays along the line joining the Sun and a small body. An instantaneous delta-v toward the anti- Sun direction is applied at the closest approach to the small body for station keeping. For example, the spacecraft hovers between the minimum range (2 km) point and the maximum range (2.5 km) point from the asteroid 1989ML. Horizontal hovering buys more time for a spacecraft to recover if, for any reason, a planned thrust fails, by returning almost to the initial position after some time later via a near elliptical orbit around the small body. The mapping or staging orbit may be similarly generated using T-LDC with a set of constraints. Some delta-v tables are generated for several different asteroid masses.

Chung, Min-Kun J.↗

Chapter 10: Development of a Precipitation Retrieval Scheme for Cross-track Passive Microwave Sounding Instruments

The measurement of precipitation (snowfall and rainfall) across the globe is of great importance to both science and society. Despite the importance, measurements from surface-based instruments are limited in extent and are generally absent from sparsely populated or inhospitable regions, including over the world’s oceans. Satellite-based observations have the potential to provide the necessary information to generate estimates of precipitation across the whole of the Earth’s surface. However, adequate temporal and spatial sampling is required to capture vagaries of precipitation and it is necessary to exploit all possible satellite (and, where appropriate surface) information. While much research has been carried out into the retrieval of precipitation from observations gathered by conically-scanning passive microwave imagers in previous decades, relatively little has been done to fully utilise the observations from the cross-track scanning passive microwave sounding instruments. This paper will review a number of cross-track precipitation retrieval schemes, together an evaluation of their performance, and future directions.

Precipitation retrievals↗

Missing the Reef for the Corals: Unexpected Trends Between Coral Reef Condition and the Environment at the Ecosystem Scale

It is incontrovertible that many coral reefs are in various stages of decline and may be unable to withstand the effects of global climate change, jeopardizing vital ecosystem goods and services to hundreds of millions of people around the world. An estimated 50% of the world's corals have already been lost, and those remaining may be lost by 2030 under the “business as usual” CO2 emissions scenario. However, the foundation of these predictions is a surprisingly sparse dataset, wherein ~0.01–0.1% of the world's reef area has been quantitatively surveyed. Further, the available data comprise observations at the 1–10 m scale, which are not evenly spaced across reefs, but often clustered in areas representing focused survey effort. This impedes modeling and predicting the impact of a changing environment at the ecosystem scale. Here we highlight deficiencies in our current understanding of the relationship between coral reefs and their environments. Specifically, we conduct a meta-analysis using estimates of coral cover from a variety of local surveys, quantitatively relating reef condition to a suite of biogeophysical forcing parameters. We find that readily available public data for coral cover exhibit unexpected trends (e.g., a positive correlation between coral cover and multi-year cumulative thermal stress), contrary to prevailing scientific expectations. We illustrate a significant gap in our current understanding, and thereby prediction, of coral reefs at the ecosystem scale that can only be remedied with uniform, high-density data across vast coral reef regions, such as that from remote sensing.

Eric J Hochberg↗