Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Measurement of the small-scale 3D Lyman- α forest power spectrum

Small-scale correlations measured in the Lyman-α (Lyα) forest encode information about the intergalactic medium and the primordial matter power spectrum. In this article, we present and implement a simple method to measure the 3-dimensional power spectrum, P 3D , of the Lyα forest at wavenumbers k corresponding to small, ~ Mpc scales. In order to estimate P 3D from sparsely and unevenly distributed data samples, we rely on averaging 1-dimensional Fourier Transforms, as previously carried out to estimate the 1-dimensional power spectrum of the Lyα forest, P 1D . Further, this methodology exhibits a very low computational cost. We confirm the validity of this approach through its application to Nyx cosmological hydrodynamical simulations. Subsequently, we apply our method to the eBOSS DR16 Lyα forest sample, providing as a proof of principle, a first P 3D measurement averaged over two redshift bins z = 2.2 and z = 2.4. This work highlights the potential for forthcoming P 3D measurements, from upcoming large spectroscopic surveys, to untangle degeneracies in the cosmological interpretation of P 1D .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

State Estimation-Based Distributed Energy Resource Optimization for Distribution Voltage Regulation in Telemetry-Sparse Environments Using a Real-Time Digital Twin

Real-time state estimation using a digital twin can overcome the lack of in-field measurements inside an electric feeder to optimize grid services provided by distributed energy resources (DERs). Optimal reactive power control of DERs can be used to mitigate distribution system voltage violations caused by increased penetrations of photovoltaic (PV) systems. In this work, a new technology called the Programmable Distribution Resource Open Management Optimization System (ProDROMOS) issued optimized DER reactive power setpoints based-on results from a particle swarm optimization (PSO) algorithm wrapped around OpenDSS time-series feeder simulations. This paper demonstrates the use of the ProDROMOS in a RT simulated environment using a power hardware-in-the-loop PV inverter and in a field demonstration, using a 678 kW PV system in Grafton (MA, USA). The primary contribution of the work is demonstrating a RT digital twin effectively provides state estimation pseudo-measurements that can be used to optimize DER operations for distribution voltage regulation.

Darbali-Zamora, Rachid↗
NASA NTRS2021

Probabilistic Machine Learning Estimation of Ocean Mixed Layer Depth from Dense Satellite and Sparse In-Situ Observations

The ocean mixed layer plays an important role in the coupling between the upper ocean and atmosphere across a wide range of time scales. Estimation of the variability of the ocean mixed layer is therefore important for atmosphere-ocean prediction and analysis. The increasing coverage of in situ Argo profile data allows for an increasingly accurate analysis of the mixed layer depth (MLD) variability associated with deviations from the seasonal climatology. However, sampling rates are not sufficient to fully resolve subseasonal (<90 day) MLD variability. Yet, many multivariate observations-based analyses include implicit modeled subseasonal MLD variability. One analysis method is optimal interpolation of in situ data, but the interior analysis can be improved by leveraging surface data with regression or variational approaches. Here, we demonstrate how machine learning methods and satellite sea surface temperature, salinity, and height facilitate MLD estimation in a pilot study of two regions: the mid-latitude southern Indian and the eastern equatorial Pacific Oceans. We construct multiple machine learning architectures to produce weekly 1/2° gridded MLD anomaly fields (relative to a monthly climatology) with uncertainty estimates. We test multiple traditional and probabilistic machine learning techniques to compare both accuracy and probabilistic calibration. We validate our methodology by applying it to ocean model simulations. We find that incorporating sea surface data through a machine learning model improves the performance of spatiotemporal MLD variability estimation compared to optimal interpolation of Argo observations alone. These preliminary results are a promising first step for the application of machine learning to MLD prediction.

Machine Learning↗
DOE OSTI2022

Sparsifying priors for Bayesian uncertainty quantification in model discovery

We propose a probabilistic model discovery method for identifying ordinary differential equations governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, where models are expressed as sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy coefficients, we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities) and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov chain Monte Carlo, and we explore two sparsifying priors: the spike and slab prior, and the regularized horseshoe prior. UQ-SINDy is shown to discover accurate models in the presence of noise and with orders-of-magnitude less data than current model discovery methods, thus providing a transformative method for real-world applications which have limited data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

MME-based attitude dynamics identification and estimation for SAMPEX

A method is described for obtaining optimal attitude estimation algorithms for spacecraft lacking attitude rate measurement devices (rate gyros), and then demonstrated using actual flight data from the Solar, Anomalous, and Magnetospheric Particle Explorer (SAMPEX) spacecraft. SAMPEX does not have on-board rate sensing, and relies on sun sensors and a three-axis magnetometer for attitude determination. Problems arise since typical attitude estimation is accomplished by filtering measurements of both attitude and attitude rates. Rates are nearly always sampled much more densely than are attitudes. Thus, the absence/loss of rate data normally reduces both the total amount of data available and the sampling density (in time) by a substantial fraction. As a result, the sensitivity of the estimates to model uncertainty and to measurement noise increases. In order to maintain accuracy in the attitude estimates, there is increased need for accurate models of the rotational dynamics. The proposed approach is based on the minimum model error (MME) optimal estimation strategy, which has been successfully applied to estimation of poorly modeled dynamic systems which are relatively sparsely and/or noisily measured. The MME estimates may be used to construct accurate models of the system dynamics (i.e. perform system model identification). Thus, an MME-based approach directly addresses the problems created by absence of attitude rate measurements.

Depena, Juan↗
DOE OSTI2021

Transfer-Learnt Energy Models for Predicting Electricity Consumption in Buildings with Limited and Sparse Field Data

Modeling energy consumption is critical for energy-efficient utilization of the electric appliances in a building, smart grid programs (like demand-response), and many other smart home applications. State-of-the-art energy modeling techniques either rely on theoretical models, or extensive instrumentation of the building envelope to gather ``big" data to train a deep neural network. While theoretical models are often limited by their estimation accuracy, it is not always feasible to gather a significant amount of field data. In this paper, we explore transfer learning-based strategies to train much more accurate model for energy estimation when using a sparse field data. We transferred knowledge, in the form of data and parameters, from the simulation framework to the field data. We evaluated the efficacy of our approach on field data collected from six commercial buildings and our results indicate that transfer learning-based models trained over one month data can perform comparative (and in some cases better) than the state-of-the-art machine learning and deep learning solutions.

Jain, Milan↗
DOE OSTI2020

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters.

42 ENGINEERING↗
DOE OSTI2021

Cardinality-Regularized Hawkes-Granger Model

We propose a new sparse Granger-causal learning framework for temporal event data. We focus on a specific class of point processes called the Hawkes process. We begin by pointing out that most of the existing sparse causal learning algorithms for the Hawkes process suffer from a singularity in maximum likelihood estimation. As a result, their sparse solutions can appear only as numerical artifacts. In this paper, we propose a mathematically well-defined sparse causal learning framework based on a cardinality-regularized Hawkes process, which remedies the pathological issues of existing approaches. We leverage the proposed algorithm for the task of instance-wise causal event analysis, where sparsity plays a critical role. We validate the proposed framework with two real use-cases, one from the power grid and the other from the cloud data center management domain.

Ide, Tsuyoshi↗
NASA NTRS2016

Investigation of Unsteady Pressure-Sensitive Paint (uPSP) and a Dynamic Loads Balance to Predict Launch Vehicle Buffet Environments

This NESC assessment examined the accuracy of estimating buffet loads on in-line launch vehicles without booster attachments using sparse unsteady pressure measurements. The buffet loads computed using sparse sensor data were compared with estimates derived using measurements with much higher spatial resolution. The current method for estimating launch vehicle buffet loads is through wind tunnel testing of models with approximately 400 unsteady pressure transducers. Even with this relatively large number of sensors, the coverage can be insufficient to provide reliable integrated unsteady loads on vehicles. In general, sparse sensor spacing requires the use of coherence-length-based corrections in the azimuthal and axial directions to integrate the unsteady pressures and obtain reasonable estimates of the buffet loads. Coherence corrections have been used to estimate buffet loads for a variety of launch vehicles with the assumption methodology results in reasonably conservative loads. For the Space Launch System (SLS), the first estimates of buffet loads exceeded the limits of the vehicle structure, so additional tests with higher sensor density were conducted to better define the buffet loads and possibly avoid expensive modifications to the vehicle design. Without the additional tests and improvements to the coherence-length analysis methods, there would have been significant impacts to the vehicle weight, cost, and schedule. If the load estimates turn out to be too low, there is significant risk of structural failure of the vehicle. This assessment used a combination of unsteady pressure-sensitive paint (uPSP), unsteady pressure transducers, and a dynamic force and moment balance to investigate the integration schemes used with limited unsteady pressure data by comparing them with direct integration of extremely dense fluctuating pressure measurements. An outfall of the assessment was to evaluate the potential of using the emerging uPSP technique in a production test environment for future launch vehicles. The results show that modifications to the current technique can improve the accuracy of buffet estimates. More importantly, the uPSP worked remarkably well and, with improvements to the frequency response, sensitivity, and productivity, will provide an enhanced method for measuring wind tunnel buffet forcing functions (BFFs).

Schuster, David M.↗
DOE OSTI2023

Non-asymptotic analysis of ensemble Kalman updates: effective dimension and localization

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in applications where generating each particle is costly. This paper develops a non-asymptotic analysis of ensemble Kalman updates, which rigorously explains why a small ensemble size suffices if the prior covariance has moderate effective dimension due to fast spectrum decay or approximate sparsity. Here, we present our theory in a unified framework, comparing everal implementations of ensemble Kalman updates that use perturbed observations, square root filtering and localization. As part of our analysis, we develop new dimension-free covariance estimation bounds for approximately sparse matrices that may be of independent interest.

Mathematics↗
DOE OSTI2024

The 3D Lyman- α forest power spectrum from eBOSS DR16

We measure the three-dimensional power spectrum (P3D) of the transmitted flux in the Lyman-α (Ly α) forest using the complete extended Baryon Oscillation Spectroscopic Survey data release 16 (eBOSS DR16). This sample consists of ~205 000 quasar spectra in the redshift range 2 ≤ z ≤ 4 at an effective redshift z = 2.334. We propose a pair-count spectral estimator in configuration space, weighting each pair by exp( i k ∙ r), for wave vector k and pixel pair separation r, effectively measuring the anisotropic power spectrum without the need for fast Fourier transforms. This accounts for the window matrix in a tractable way, avoiding artefacts found in Fourier-transform based power spectrum estimators due to the sparse sampling transverse to the line of sight of Ly α skewers. We extensively test our pipeline on two sets of mocks: (i) idealized Gaussian random fields with a sparse sampling of Ly α skewers, and (ii) log-normal LyaCoLoRe mocks including realistic noise levels, the eBOSS survey geometry and contaminants. On eBOSS DR16 data, the Kaiser formula with a non-linear correction term obtained from hydrodynamic simulations yields a good fit to the power spectrum data in the range $(0.02 ≤ k ≤ 0.35)$ h Mpc -1 at the 1–2σ level with a covariance matrix derived from LyaCoLoRe mocks. We demonstrate a promising new approach for full-shape cosmological analyses of Ly α forest data from cosmological surveys such as eBOSS, the currently observing Dark Energy Spectroscopic Instrument and future surveys such as the Prime Focus Spectrograph, WEAVE-QSO, and 4MOST.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1975

Satellite microwave observations of soil moisture variations

The electrically scanning microwave radiometer (ESMR) on the Nimbus 5 satellite was used to observe microwave emissions from vegetated and soil surfaces over an Illinois-Indiana study area, the Mississippi Valley, and the Great Salt Lake Desert in Utah. Analysis of microwave brightness temperatures (T sub B) and antecedent rainfall over these areas provided a way to monitor variations of near-surface soil moisture. Because vegetation absorbs microwave emission from the soil at the 1.55 cm wavelength of ESMR, relative soil moisture measurements can only be obtained over bare or sparsely vegetated soil. In general T sub B increased during rainfree periods as evaporation of water and drying of the surface soil occurs, and drops in T sub B are experienced after significant rainfall events wet the soil. Microwave observations from space are limited to coarse resolutions (10-25 km), but it may be possible in regions with sparse vegetation cover to estimate soil moisture conditions on a watershed or agricultural district basis, particularly since daily observations can be obtained.

Schmugge, T. J.↗
NASA NTRS1976

Quantitative mapping of rainfall rates over the oceans utilizing Nimbus-5 ESMR data

The electrically scanning microwave radiometer (ESMR) data from the Nimbus 5 satellite was used to deduce estimates of precipitation amount over the oceans. An atlas of the global oceanic rainfall was prepared and the global rainfall maps analyzed and related to available ground truth information as well as to large scale processes in the atmosphere. It was concluded that the ESMR system provides the most reliable and direct approach yet known for the estimation of rainfall over sparsely documented, wide oceanic regions.

Rao, M. S. V.↗
NASA NTRS1989

A one- and two-layer model for estimating evapotranspiration with remotely sensed surface temperature and ground-based meteorological data over partial canopy cover

Surface-air temperature differences are commonly used in a bulk resistance equation for estimating sensible heat flux (H), which is inserted in the one-dimensional energy balance equation to solve for the latent heat flux (LE) as a residual. Serious discrepancies between estimated and measured LE have been observed for partial-canopy-cover conditions, which are mainly attributed to inappropriate estimates of H. To improve the estimates of H over sparse canopies, one- and two-layer resistance models that account for some of the factors causing poor agreement are developed. The utility of the two models is tested with remotely sensed and micrometeorological data for a furrowed cotton field with 20 percent cover and a dry soil surface. It is found that the one-layer model performs better than the two-layer model when a theoretical bluff-body correction for heat transfer is used instead of an empirical adjustment; otherwise, the two-layer model is better.

Kustas, William P.↗
NASA NTRS2007

Status of the L2 and Lunar Charged Particle Environment Models

The L2 Charged Particle Environment (L2-CPE) model is an engineering tool which provides free field charged particle environments for distant magnetotail, magnetosheath, and solar wind environments. L2-CPE is intended for use in assessing contributions from low energy radiation environments (4.1 keV to few MeV) to radiation dose in thin materials used in construction of spacecraft to be placed in orbit about the Sun-Earth L2 point. This paper describes the status of the current version of the L2-CPE model including structure of the model used to organize plasma environments into solar wind, magnetosheath, and magnetotail environments, the algorithms used to estimate radiation fluence in sparsely sampled environments, the updated graphical user interface, and output options for flux and fluence environments. In addition, we describe the status and plans for updating the model to include environments relevant to lunar programs.

Minow, Joseph I.↗
DOE OSTI2021

Utilizing Earth Observations of Soil Freeze/Thaw Data and Atmospheric Concentrations to Estimate Cold Season Methane Emissions in the Northern High Latitudes

The northern wetland methane emission estimates have large uncertainties. Inversion models are a qualified method to estimate the methane fluxes and emissions in northern latitudes but when atmospheric observations are sparse, the models are only as good as their a priori estimates. Thus, improving a priori estimates is a competent way to reduce uncertainties and enhance emission estimates in the sparsely sampled regions. Here, we use a novel way to integrate remote sensing soil freeze/thaw (F/T) status from SMOS satellite to better capture the seasonality of methane emissions in the northern high latitude. The SMOS F/T data provide daily information of soil freezing state in the northern latitudes, and in this study, the data is used to define the cold season in the high latitudes and, thus, improve our knowledge of the seasonal cycle of biospheric methane fluxes. The SMOS F/T data is implemented to LPX-Bern DYPTOP model estimates and the modified fluxes are used as a biospheric a priori in the inversion model CarbonTracker Europe-CH 4 . The implementation of the SMOS F/T soil state is shown to be beneficial in improving the inversion model’s cold season biospheric flux estimates. Our results show that cold season biospheric CH4 emissions in northern high latitudes are approximately 0.60 Tg lower than previously estimated, which corresponds to 17% reduction in the cold season biospheric emissions. This reduction is partly compensated by increased anthropogenic emissions in the same area (0.23 Tg), and the results also indicates that the anthropogenic emissions could have even larger contribution in cold season than estimated here.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Probing for the Trace Estimation of a Permuted Matrix Inverse Corresponding to a Lattice Displacement

We report thatpProbing is a general technique that is used to reduce the variance of the Hutchinson stochastic estimator for the trace of the inverse of a large, sparse matrix A. The variance of the estimator is the sum of the squares of the off-diagonal elements of A -1 . Therefore, this technique computes probing vectors that when used in the estimator annihilate the largest off-diagonal elements. For matrices that display decay of the magnitude of |A$^{-1}_{ij}$| with the graph distance between nodes i and j, this is achieved through graph coloring of increasing powers A k . Equivalently, when a matrix stems from a lattice discretization, it is computationally beneficial to find a distance-k coloring of the lattice. Previously, a hierarchical coloring was proposed so that k can be increased at runtime as needed without discarding previous work. In this work, we study probing for the more general problem of computing the trace of a permutation of A -1 , say PA -1 . The motivation comes from lattice quantum chromodynamics (QCD), where we need to construct “disconnected diagrams” to extract flavor-separated generalized parton functions. In lattice QCD, where the matrix has a four-dimensional toroidal lattice structure, these nonlocal operators correspond to a PA -1 , where P is the permutation relating to some displacement $\vec{p}$ in one or more dimensions. We focus on a single dimension displacement (p), but our methods are general. We show that probing on A k or (PA) k does not annihilate the largest magnitude elements. To resolve this issue, our displacement-based probing works on PA k using a new coloring scheme that works directly on appropriately displaced neighborhoods on the lattice. We prove lower bounds on the number of colors needed and study the effect of this scheme on variance reduction, both theoretically and experimentally on a real-world lattice QCD calculation. We achieve orders of magnitude speedup over the unprobed or the naively probed methods.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

Integrated Tail Buffet Loads on the F/A-18

The unsteady pressures acting on the vertical tails of a full-scale F/A-18 fighter aircraft were studied to gain a better understanding of tail-buffet loads that frequently occur on fighter aircraft operating at high angles-of-attack. Data for the study were acquired during two test entries in the 80- by 120-Foot Wind Tunnel wherein the aircraft was tested at wind speeds up to 100 knots and at angles-of-attack from 20deg to 40deg. For the purposes of this paper, the primary difference between the two tests is that, during the first wind-tunnel entry, the pressure transducers were more sparsely spaced and covered less of the fin than during the second entry. In addition to a brief description of the spectral analysis methods used for the unsteady aerodynamic pressures and loads, an analysis of the effects of sensor density on estimating integrated loads is presented. It was found that the integrated loads determined from sparse sensor arrays are significantly higher than actual loads. However, a modest increase in the number of sensors can greatly reduce the error and a method for correcting load estimates from sparse sensor arrays is also suggested. The results for the time-averaged, power-spectral analysis are then presented for the tail-fin bending moments. Power spectra are presented for the aircraft at zero sideslip over an angle-of-attack range from 20deg to 40deg and for the aircraft at an angle-of-attack of 30deg over a sideslip range from -16deg to 16deg. Since the aircraft was equipped with a removable leading-edge extension (LEX) fence to reduce tail-buffet loads, the tail-fin bending moment loads are also presented for that configuration. The LEX fence is shown to significantly reduce bending moment loads over a broad range frequencies, for all the aircraft attitudes presented.

Meyn, Larry A.↗