Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Data for: A hybrid biophysical-machine learning framework for diurnal surface energy flux estimation using proximal sensing

Thermal-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal datasets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for specific surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of an ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81-0.94) and H (R2 = 0.46-0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical – machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

Agricultural Sciences↗

A Hybrid Biophysical‐Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing

Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy ( LE ) and sensible heat ( H ) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R 2 = 0.81–0.94) and H (R 2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

evapotranspiration↗

Hyperspectral Aquatic Radiative Transfer Modeling Using a High-Performance Cluster Computing-Based Approach

Abstract For aquatic studies, radiative transfer (RT) modeling can be used to compute hyperspectral above-surface remote sensing reflectance that can be utilized for inverse model development. Inverse models can provide bathymetry and inherent-and bottom-optical property estimation. Because measured oceanic field/organic datasets are often spatio-temporally sparse, synthetic data generation is useful in yielding sufficiently large datasets for inversion model development; however, these forward-modeled data are computationally expensive and time-consuming to generate. This study establishes the magnitude of wall-clock-time savings achieved for performing large, aquatic RT batch-runs using parallel computing versus a sequential approach. Given 2,600 simulations and identical compute-node characteristics, sequential architecture required ~100 hours until termination, whereas a parallel approach required only ~2.5 hours (42 compute nodes) a 40x speed-up. Tools developed for this parallel execution are discussed.

58 GEOSCIENCES↗

Hydrologic applicability of satellite-based precipitation estimates for irrigation water management in the data-scarce region

Reliable precipitation estimates are crucial for planning and managing water resources, monitoring hydrologic extremes, and fulfilling irrigation water requirements. Accurate precipitation estimates are particularly challenging in complex mountain terrains, where monitoring gauges are often sparsely distributed due to their remote locations, and high installation and long-term operation costs. Recent advances in satellite-based precipitation estimates offer promising opportunities to improve our understanding of hydrologic processes and their applications for irrigation water management. Several datasets are available varying considerably in terms of their data sources, quality control methods, estimation procedure, and spatiotemporal resolutions. Choosing the most suitable dataset for a particular application is a complex task. In this study, we (1) evaluate the performance of six satellite-based precipitation estimates (SPEs): i) CHIRPS v2.0, ii) CMORPH v1.0, iii) ERA5, iv) IMERG v6, v) MSWEP v2.8, and vi) PERSIANN-CDR against the gauge precipitation using continuous statistical and categorical indices, (2) integrate SPEs with a calibrated semi-distributed hydrologic model to predict streamflow, and (3) demonstrate practical implications of improved streamflow prediction for irrigation water management in the central Himalayan region, Nepal. Our results illustrate that satellite-based precipitation estimates have competitive performance in capturing a wide range of rainfall characteristics, with demonstrated variability across river basins and time scales. Further, there are no significant discrepancies observed in satellite-based precipitation estimates for estimating irrigation water requirements for the three major crops (maize, wheat, and paddy) during the cropping period across the selected river basins, showing a greater promise for irrigation water management planning and decision making.

54 ENVIRONMENTAL SCIENCES↗

Polynomial meta-models with canonical low-rank approximations: Numerical insights and comparison to sparse polynomial chaos expansions

The growing need for uncertainty analysis of complex computational models has led to an expanding use of meta-models across engineering and sciences. The efficiency of meta-modeling techniques relies on their ability to provide statistically-equivalent analytical representations based on relatively few evaluations of the original model. Polynomial chaos expansions (PCE) have proven a powerful tool for developing meta-models in a wide range of applications; the key idea thereof is to expand the model response onto a basis made of multivariate polynomials obtained as tensor products of appropriate univariate polynomials. The classical PCE approach nevertheless faces the “curse of dimensionality”, namely the exponential increase of the basis size with increasing input dimension. To address this limitation, the sparse PCE technique has been proposed, in which the expansion is carried out on only a few relevant basis terms that are automatically selected by a suitable algorithm. An alternative for developing meta-models with polynomial functions in high-dimensional problems is offered by the newly emerged low-rank approximations (LRA) approach. By exploiting the tensor–product structure of the multivariate basis, LRA can provide polynomial representations in highly compressed formats. Through extensive numerical investigations, we herein first shed light on issues relating to the construction of canonical LRA with a particular greedy algorithm involving a sequential updating of the polynomial coefficients along separate dimensions. Specifically, we examine the selection of optimal rank, stopping criteria in the updating of the polynomial coefficients and error estimation. In the sequel, we confront canonical LRA to sparse PCE in structural-mechanics and heat-conduction applications based on finite-element solutions. Canonical LRA exhibit smaller errors than sparse PCE in cases when the number of available model evaluations is small with respect to the input dimension, a situation that is often encountered in real-life problems. By introducing the conditional generalization error, we further demonstrate that canonical LRA tend to outperform sparse PCE in the prediction of extreme model responses, which is critical in reliability analysis.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Combined Force-Frequency Sampling for Simulation of Systems Having Rugged Free Energy Landscapes.

An adaptive, machine learning-based sampling method is presented for simulation of systems having rugged, multidimensional free energy landscapes. The method's main strength resides in its ability to learn both from the frequency of visits to distinct states and the generalized force estimates that arise in a system as it evolves in phase space. This is accomplished by introducing a self-integrating artificial neural network, which generates an estimate of the free energy directly from its derivatives. The usefulness of the proposed combined approach is examined in the context of two concrete examples, namely, an alanine dipeptide molecule in water and a polymer diffusing through a narrow pore. This new method is found to be robust, faster, and more accurate than approaches that rely only on frequency-based or generalized force-based estimations. After combining the proposed approach with overfill protection and support for sparse data storage and training, the method is shown to be more effective than comparable, previously available techniques and capable of scaling efficiently to larger numbers of collective variables.

Sevgen, Emre↗

Estimating the Noise Floor of Sonic Boom Metrics Across the USA

NASA is building the X-59 Quiet Supersonic Technology aircraft to produce low noise sonic booms for a series of community noise surveys across the USA. Survey participants will rate their perception of the low booms from supersonic X-59 flyovers. Several noise metrics are proposed to quantify the noise dose: A-, B-, D-, E-weighted Sound Exposure Level, Stevens Perceived Level, and Indoor Sonic Boom Annoyance Predictor. Sparse measurements across the survey area will be used to estimate community noise exposure. The level of these low booms may be comparable to the ambient noise level in some locations, leading to uncertainty in noise exposure estimations. This uncertainty may necessitate increased reliance on sonic boom propagation predictions for exposure estimation. Low-boom signal to ambient noise ratio is one way to quantify uncertainty in measured sonic boom levels. An empirical relationship between A-weighted ambient level and sonic boom metric levels is used in conjunction with the National Park Service’s L50 SPL map to estimate sonic boom metric ambient levels across the USA. The estimate of ambient sonic boom metric levels will aid in X-59 test planning and execution.

sonic boom↗

CO 2 storage site characterization using ensemble-based approaches with deep generative models

Estimating spatially distributed properties such as permeability from available sparse measurements is a great challenge in efficient subsurface CO 2 storage operations. In this paper, a deep generative model that can accurately capture complex subsurface structure is tested with an ensemble-based inversion method for accurate and accelerated characterization of CO 2 storage sites. We chose Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) for its realistic reservoir property representation and Ensemble Smoother with Multiple Data Assimilation (ES-MDA) for its robust data fitting and uncertainty quantification capability. WGAN-GP are trained to generate high-dimensional permeability fields from a low-dimensional latent space and ES-MDA then updates the latent variables by assimilating available measurements. Several subsurface site characterization examples including Gaussian, channelized, and fractured reservoirs are used to evaluate the accuracy and computational efficiency of the proposed method and the main features of the unknown permeability fields are characterized accurately with reliable uncertainty quantification. Furthermore, the estimation performance is compared with a widely-used variational, i.e., optimization-based, inversion approach, and the proposed approach outperforms the variational inversion method in several benchmark cases. We explain such superior performance by visualizing the objective function in the latent space: because of nonlinear and aggressive dimension reduction via generative modeling, the objective function surface becomes extremely complex while the ensemble approximation can smooth out the multi-modal surface during the minimization. This suggests that the ensemble-based approach works well over the variational approach when combined with deep generative models at the cost of forward model runs unless convergence-ensuring modifications are implemented in the variational inversion.

42 ENGINEERING↗

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗

Estimated Ambient Sonic Boom Metric Levels and X-59 Signal-to-Noise Ratios across the USA

NASA is building the X-59 Quiet Supersonic Technology aircraft to produce low noise sonic booms for a series of community noise surveys across the USA. Survey participants will rate their perception of the low-booms from supersonic X-59 flyovers. Several noise metrics are proposed to quantify the noise dose: A-, B-, D-, and E-weighted Sound Exposure Level, Stevens Perceived Level, and Indoor Sonic Boom Annoyance Predictor. Sparse measurements across the survey area will be used to estimate community noise exposure. The level of these low-booms may be comparable to the ambient noise level in some locations, leading to uncertainty in noise exposure estimations. This uncertainty may necessitate increased reliance on sonic boom propagation predictions for exposure estimation. Low-boom signal to ambient noise ratio is one way to quantify uncertainty in measured sonic boom levels. An empirical relationship between A-weighted ambient level and sonic boom metric levels is used in conjunction with the National Park Service’s L50 SPL map to estimate ambient noise levels expressed in terms of sonic boom noise metrics across the USA. These estimates of ambient levels will aid in X-59 community test planning and execution. The signal-to-noise ratio for the undertrack X-59 sonic boom is also estimated, and an example application of these data is presented for comparing potential noise monitor sites prior to a community noise test.

X-59↗

Using automated machine learning for the upscaling of gross primary productivity

Estimating gross primary productivity (GPP) over space and time is fundamental for understanding the response of the terrestrial biosphere to climate change. Eddy covariance flux towers provide in situ estimates of GPP at the ecosystem scale, but their sparse geographical distribution limits larger-scale inference. Machine learning (ML) techniques have been used to address this problem by extrapolating local GPP measurements over space using satellite remote sensing data. However, the accuracy of the regression model can be affected by uncertainties introduced by model selection, parameterization, and choice of explanatory features, among others. Recent advances in automated ML (AutoML) provide a novel automated way to select and synthesize different ML models. In this work, we explore the potential of AutoML by training three major AutoML frameworks on eddy covariance measurements of GPP at 243 globally distributed sites. We compared their ability to predict GPP and its spatial and temporal variability based on different sets of remote sensing explanatory variables. Explanatory variables from only Moderate Resolution Imaging Spectroradiometer (MODIS) surface reflectance data and photosynthetically active radiation explained over 70 % of the monthly variability in GPP, while satellite-derived proxies for canopy structure, photosynthetic activity, environmental stressors, and meteorological variables from reanalysis (ERA5-Land) further improved the frameworks' predictive ability. We found that the AutoML framework Auto-sklearn consistently outperformed other AutoML frameworks as well as a classical random forest regressor in predicting GPP but with small performance differences, reaching an r 2 of up to 0.75. We deployed the best-performing framework to generate global wall-to-wall maps highlighting GPP patterns in good agreement with satellite-derived reference data. This research benchmarks the application of AutoML in GPP estimation and assesses its potential and limitations in quantifying global photosynthetic activity.

54 ENVIRONMENTAL SCIENCES↗

Adaptive sparse grid expansions of the vibrational Hamiltonian

The vibrational Hamiltonian involves two high dimensional operators, the kinetic energy operator (KEO), and the potential energy surface (PES). Both must be approximated for systems involving more than a few atoms. Adaptive approximation schemes are not only superior to truncated Taylor or many-body expansions (MBE), they also allow for error estimates, and thus operators of predefined precision. To this end, modified sparse grids (SG) are developed that can be combined with adaptive MBEs. This MBE/SG hybrid approach yields a unified, fully adaptive representation of the KEO and the PES. Refinement criteria, based on the vibrational self-consistent field (VSCF) and vibrational configuration interaction (VCI) methods, are presented. The combination of the adaptive MBE/SG approach and the VSCF plus VCI methods yields a black box like procedure to compute accurate vibrational spectra. This is demonstrated on a test set of molecules, comprising water, formaldehyde, methanimine, and ethylene. The test set is first employed to prove convergence for semi-empirical PM3-PESs and subsequently to compute accurate vibrational spectra from CCSD(T)-PESs that agree well with experimental values.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A New Approach to Reduce Uncertainties in Space Radiation Cancer Risk Predictions

The prediction of space radiation induced cancer risk carries large uncertainties with two of the largest uncertainties being radiation quality and dose-rate effects. In risk models the ratio of the quality factor (QF) to the dose and dose-rate reduction effectiveness factor (DDREF) parameter is used to scale organ doses for cosmic ray proton and high charge and energy (HZE) particles to a hazard rate for γ-rays derived from human epidemiology data. In previous work, particle track structure concepts were used to formulate a space radiation QF function that is dependent on particle charge number Z, and kinetic energy per atomic mass unit, E. QF uncertainties where represented by subjective probability distribution functions (PDF) for the three QF parameters that described its maximum value and shape parameters for Z and E dependences. Here I report on an analysis of a maximum QF parameter and its uncertainty using mouse tumor induction data. Because experimental data for risks at low doses of γ-rays are highly uncertain which impacts estimates of maximum values of relative biological effectiveness (RBE max ), I developed an alternate QF model, denoted QF γAcute where QFs are defined relative to higher acute γ-ray doses (0.5 to 3 Gy). The alternate model reduces the dependence of risk projections on the DDREF, however a DDREF is still needed for risk estimates for high-energy protons and other primary or secondary sparsely ionizing space radiation components. Risk projections (upper confidence levels (CL)) for space missions show a reduction of about 40% (CL~50%) using the QF γAcute model compared the QFs based on RBE max and about 25% (CL~35%) compared to previous estimates. In addition, I discuss how a possible qualitative difference leading to increased tumor lethality for HZE particles compared to low LET radiation and background tumors remains a large uncertainty in risk estimates.

59 BASIC BIOLOGICAL SCIENCES↗

Data-domain correlation approach for joint hydrogeologic inversion of time-lapse hydrogeologic and geophysical data

Inverse estimations of hydrogeologic properties are often highly uncertain due to the expense of collecting hydrogeologic data and the subsequent lack of information. Geophysical data can potentially help fill this information gap because geophysical methods can survey large areas remotely and relatively inexpensively. However, geophysical data are difficult to incorporate into hydrogeological parameter estimations due primarily to a lack of knowledge concerning the petrophysical relationships between hydrogeological and geophysical parameters. We present a method which allows time lapse geophysical data to be directly incorporated into a hydrogeological parameter estimation when there is a strong correlation between changes in geophysical and hydrogeological properties. This approach bypasses the need for an explicit petrophysical transform by formulating the geophysical part of the hydrogeological inversion in terms of a data domain correlation operator. We demonstrate the approach with a synthetic electrical resistivity monitoring application used to estimate the hydraulic conductivity distribution. Including time lapse resistivity data to supplement sparse hydrological data appears to greatly improve resolution of hydraulic conductivity in this case. More generally, the formulation and results suggest that geophysical monitoring data can be effectively incorporated into a hydrogeological parameter estimation using a data domain correlation operator, assuming there is a strong correlation between changes in hydrogeological and geophysical properties.

58 GEOSCIENCES↗

Intercepted photosynthetically active radiation estimated by spectral reflectance

Interception of photosynthetically active radiation (PAR) was evaluated relative to greenness and normalized difference (MSS (7-5)/(7+5) for five planting dates of wheat for 1978-79 and 1979-80 at Phoenix, Arizona. Intercepted PAR was calculated from leaf area index and stage of growth. Linear relatinships were found with greeness and normalized difference with separate relatinships describing growth and senescence of the crop. Normalized difference was significantly better than greenness for all planting dates. For the leaf area growth portion of the season the relation between PAR interception and normalized difference was the same over years and planting dates. For the leaf senescence phase the relationships showed more variability due to the lack of data on light interception in sparse and senescing canopies. Normalized difference could be used to estimate PAR interception throughout a growing season.

Hatfield, J. L.↗

Remotely sensed physical property estimation from powder contaminated surfaces

It is the intent of this paper to demonstrate the veracity of a method to estimate the total solid contaminant mass present on a sparsely coated surface encompassing a pixel from longwave infrared spectra. Sparsely coated surfaces create complex radiometry due to the interactions of electromagnetic energy between intimate materials. Current algorithms can be used on intimate mixtures to identify the abundances of materials in a pixel, but they cannot provide additional property information. Radiative transfer models can create mixture signatures, but only with a set of well-characterized physical parameters that are typically not known or are difficult to retrieve. Finally, the approach described here creates a parameter inversion model from a radiative transfer model and uses empirically measured mixture data to retrieve physical characteristics of the contaminated surface and derive a total contaminant mass present.

97 MATHEMATICS AND COMPUTING↗

Continuous surface-to-distributed acoustic sensor snapshots explain reactivation of individual natural fractures during an unconventional reservoir stimulation

ABSTRACT Fiber-optic sensing technologies allow petroleum engineering teams to detect hydraulic fracture interaction with boreholes during unconventional reservoir stimulation. In combination with high-repeatability seismic sources, the same distributed acoustic sensors (DASs) enable vertical seismic profiling (VSP) of the fracture evolution away from the boreholes. We discovered clear signatures of seismic scattering on activated fractures during nine days of continuous seismic monitoring of the fracturing stages at the Austin Chalk/Eagle Ford Field Laboratory. The present study applies a novel approach for quantitative analysis of the scattering events in terms of the evolution of the geometry and elastic stiffness of individual fractures. Our characterization strategy sequentially refines the fracture models: from a stack of 1D soft layers to 3D rectangular inclusions. First, we estimate the number of fracture locations and reflectivity using a modified sparse-spike deconvolution of the stacked VSP traces. The fracture set consists of five fractures spaced by 15–30 m with a reflectivity of approximately 1%. Then, we develop a scattering integral method to refine these estimates along with an inversion of the fracture top and bottom for each monitoring vintage. We find that, initially, some of the fractures are located above the monitoring fiber with the height of approximately 100 m. Then we integrate the seismic interpretation with the low-frequency DAS and pressure and microseismic monitoring to reconstruct the activation process of the fractures. Most likely, some of the natural fractures slowly grew downward to the monitoring fiber as a result of fluid injections in the stimulated well. This led to bright strain anomalies but did not trigger seismicity. The top of the fractures remained almost constant and were limited by a lithologic boundary/stress barrier. To our knowledge, this is the first time VSP data enabled tracking of the fracture evolution with such high spatial and temporal resolution, which was previously only available for crosswell surveys and at a much smaller scale.

Glubokovskikh, Stanislav↗

Generation of Data-Driven Expected Energy Models for Photovoltaic Systems

Although unique expected energy models can be generated for a given photovoltaic (PV) site, a standardized model is also needed to facilitate performance comparisons across fleets. Current standardized expected energy models for PV work well with sparse data, but they have demonstrated significant over-estimations, which impacts accurate diagnoses of field operations and maintenance issues. This research addresses this issue by using machine learning to develop a data-driven expected energy model that can more accurately generate inferences for energy production of PV systems. Irradiance and system capacity information was used from 172 sites across the United States to train a series of models using Lasso linear regression. The trained models generally perform better than the commonly used expected energy model from international standard (IEC 61724-1), with the two highest performing models ranging in model complexity from a third-order polynomial with 10 parameters (Radj2 = 0.994) to a simpler, second-order polynomial with 4 parameters (Radj2=0.993), the latter of which is subject to further evaluation. Subsequently, the trained models provide a more robust basis for identifying potential energy anomalies for operations and maintenance activities as well as informing planning-related financial assessments. We conclude with directions for future research, such as using splines to improve model continuity and better capture systems with low (≤1000 kW DC) capacity.

14 SOLAR ENERGY↗