Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Probabilistic Damage Characterization Using the Computationally-Efficient Bayesian Approach

This work presents a computationally-ecient approach for damage determination that quanti es uncertainty in the provided diagnosis. Given strain sensor data that are polluted with measurement errors, Bayesian inference is used to estimate the location, size, and orientation of damage. This approach uses Bayes' Theorem to combine any prior knowledge an analyst may have about the nature of the damage with information provided implicitly by the strain sensor data to form a posterior probability distribution over possible damage states. The unknown damage parameters are then estimated based on samples drawn numerically from this distribution using a Markov Chain Monte Carlo (MCMC) sampling algorithm. Several modi cations are made to the traditional Bayesian inference approach to provide signi cant computational speedup. First, an ecient surrogate model is constructed using sparse grid interpolation to replace a costly nite element model that must otherwise be evaluated for each sample drawn with MCMC. Next, the standard Bayesian posterior distribution is modi ed using a weighted likelihood formulation, which is shown to improve the convergence of the sampling process. Finally, a robust MCMC algorithm, Delayed Rejection Adaptive Metropolis (DRAM), is adopted to sample the probability distribution more eciently. Numerical examples demonstrate that the proposed framework e ectively provides damage estimates with uncertainty quanti cation and can yield orders of magnitude speedup over standard Bayesian approaches.

Warner, James E.↗

DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks

Electroconvection is a multiphysics problem involving coupling of the flow field with the electric field as well as the cation and anion concentration fields. Here, we use electroconvection as a benchmark problem to put forward a new data assimilation framework, the DeepM&Mnet, for simulating multiphysics and multiscale problems at speeds much faster than standard numerical methods using pre-trained neural networks. We first pre-train DeepONets that can predict independently each field, given general inputs from the rest of the fields of the coupled system. DeepONets can approximate nonlinear operators and are composed of two sub-networks, a branch net for the input fields and a trunk net for the locations of the output field. DeepONets, which are extremely fast, are used as building blocks in the DeepM&Mnet and form constraints for the multiphysics solution along with some sparse available measurements of any of the fields. We demonstrate the new methodology and document the accuracy of each individual DeepONet, and subsequently we present two different DeepM&Mnet architectures that infer accurately and efficiently 2D electroconvection fields for unseen electric potentials. Furthermore, the DeepM&Mnet framework is general and can be applied for building any complex multiphysics and multiscale models based on very few measurements using pre-trained DeepONets in a “plug-and-play” mode.

97 MATHEMATICS AND COMPUTING↗

Bayesian chain graph models to characterize microbe-environment dynamics

Microbiome data require statistical models that can simultaneously decode microbes' reaction to the environment and interactions among microbes. While a multiresponse linear regression model seems like a straight-forward solution, we argue that treating it as a graphical model is problematic given that the regression coefficient matrix does not encode the conditional dependence structure between response and predictor nodes. This observation is especially important in biological settings when we have prior knowledge on the edges from specific experimental interventions that can only be properly encoded under a conditional dependence model. Here, we propose a chain graph model with two sets of nodes (predictors and responses) whose solution yields a graph with edges that indeed represent conditional dependence, thus agreeing with the experimenter's intuition on the average behavior of nodes under treatment. The solution to our model is sparse via the Bayesian linear regression (LASSO). In addition, we propose an adaptive extension so that different shrinkages can be applied to different edges to incorporate edge-specific prior knowledge. Our model is computationally inexpensive through an efficient Gibbs sampling algorithm and can account for binary, counting, and compositional responses via an appropriate hierarchical structure. We test the performance of our model in a variety of simulated datasets, thereby showing superior performance to state-of-the-art approaches. We further apply our model to human gut and soil microbial compositional datasets, and we highlight that CG-LASSO can estimate biologically meaningful network structures in the data.

compositional data↗

Ridged Plains of Lunae Planum: Thickness Distribution Revised

New data are used to revise the isopach of plains-forming material in the Lunae Planum region. The distribution of data points in the region has not increased; consequently, the new map is still valid for generalized thickness trends only. The isopach map is based on a total of 65 points; 32 points represent thickness estimates at partially buried craters. The remaining 33 points define the limits of plains-forming materials (zero thickness). Suitable buried craters are randomly distributed and sparse near the western edge and northern portion of the area. The overall thickness trend is similar to the previously mapped distribution, but there is a significant reduction in thickness values.

Dehon, R. A.↗

Analysis of Snow Bidirectional Reflectance from ARCTAS Spring-2008 Campaign

The spring 2008 Arctic Research of the Composition of the Troposphere from Aircraft and Satellites (ARCTAS) experiment was one of major intensive field campaigns of the International Polar Year aimed at detailed characterization of atmospheric physical and chemical processes in the Arctic region. A part of this campaign was a unique snow bidirectional reflectance experiment on the NASA P-3B aircraft conducted on 7 and 15 April by the Cloud Absorption Radiometer (CAR) jointly with airborne Ames Airborne Tracking Sunphotometer (AATS) and ground-based Aerosol Robotic Network (AERONET) sunphotometers. The CAR data were atmospherically corrected to derive snow bidirectional reflectance at high 1 degree angular resolution in view zenith and azimuthal angles along with surface albedo. The derived albedo was generally in good agreement with ground albedo measurements collected on 15 April. The CAR snow bidirectional reflectance factor (BRF) was used to study the accuracy of analytical Ross-Thick Li-Sparse (RTLS), Modified Rahman-Pinty-Verstraete (MRPV) and Asymptotic Analytical Radiative Transfer (AART) BRF models. Except for the glint region (azimuthal angles phi less than 40 degrees), the best fit MRPV and RTLS models fit snow BRF to within 0.05. The plane-parallel radiative transfer (PPRT) solution was also analyzed with the models of spheres, spheroids, randomly oriented fractal crystals, and with a synthetic phase function. The latter merged the model of spheroids for the forward scattering angles with the fractal model in the backscattering direction. The PPRT solution with synthetic phase function provided the best fit to measured BRF in the full range of angles. Regardless of the snow grain shape, the PPRT model significantly over-/underestimated snow BRF in the glint/backscattering regions, respectively, which agrees with other studies. To improve agreement with experiment, we introduced a model of macroscopic snow surface roughness by averaging the PPRT solution over the slope distribution function and by adding a simple model of shadows. With macroscopic roughness described by two parameters, the AART model achieved an accuracy of about plus or minus 0.05 with a possible bias of plus or minus 0.03 in the spectral range 0.4-2.2 micrometers. This high accuracy holds at view zenith angles below 55-60 degrees covering the practically important range for remote sensing applications, and includes both glint and backscattering directions.

Lyapustin, A.↗

Ground Heat Flux Reconstruction Using Bayesian Uncertainty Quantification Machinery and Surrogate Modeling

Ground heat flux (G 0 ) is a key component of the land-surface energy balance of high-latitude regions. Despite its crucial role in controlling permafrost degradation due to global warming, G 0 is sparsely measured and not well represented in the outputs of global scale model simulation. In this study, an analytical heat transfer model is tested to reconstruct G 0 across seasons using soil temperature series from field measurements, Global Climate Model, and climate reanalysis outputs. The probability density functions of ground heat flux and of model parameters are inferred using available G 0 data (measured or modeled) for snow-free period as a reference. When observed G 0 is not available, a numerical model is applied using estimates of surface heat flux (dependent on parameters) as the top boundary condition. These estimates (and thus the corresponding parameters) are verified by comparing the distributions of simulated and measured soil temperature at several depths. Aided by state-of-the-art uncertainty quantification methods, the developed G 0 reconstruction approach provides novel means for assessing the probabilistic structure of the ground heat flux for regional permafrost change studies.

54 ENVIRONMENTAL SCIENCES↗

Machine learning for detection of 3D features using sparse x-ray tomographic reconstruction

In many inertial confinement fusion (ICF) experiments, the neutron yield and other parameters cannot be completely accounted for with one and two dimensional models. This discrepancy suggests that there are three dimensional effects that may be significant. Sources of these effects include defects in the shells and defects in shell interfaces, the fill tube of the capsule, and the joint feature in double shell targets. Due to their ability to penetrate materials, x rays are used to capture the internal structure of objects. Methods such as computational tomography use x-ray radiographs from hundreds of projections, in order to reconstruct a three dimensional model of the object. In experimental environments, such as the National Ignition Facility and Omega-60, the availability of these views is scarce, and in many cases only consists of a single line of sight. Mathematical reconstruction of a 3D object from sparse views is an ill-posed inverse problem. These types of problems are typically solved by utilizing prior information. Neural networks have been used for the task of 3D reconstruction as they are capable of encoding and leveraging this prior information. We utilize half a dozen, different convolutional neural networks to produce different 3D representations of ICF implosions from the experimental data. Deep supervision is utilized to train a neural network to produce high-resolution reconstructions. These representations are used to track 3D features of the capsules, such as the ablator, inner shell, and the joint between shell hemispheres. Machine learning, supplemented by different priors, is a promising method for 3D reconstructions in ICF and x-ray radiography, in general.

Wolfe, Bradley T. (ORCID:0000000268301614)↗

Estimating Sparse Direct Effects in Multivariate Regression With the Spike-and-Slab LASSO

The multivariate regression interpretation of the Gaussian chain graph model simultaneously parametrizes (i) the direct effects of p predictors on q outcomes and (ii) the residual partial covariances between pairs of outcomes. We introduce a new method for fitting sparse versions of these models with spike-and-slab LASSO (SSL) priors. We develop an Expectation Conditional Maximization algorithm to obtain sparse estimates of the p × q matrix of direct effects and the q × q residual precision matrix. Our algorithm iteratively solves a sequence of penalized maximum likelihood problems with self-adaptive penalties that gradually filter out negligible regression coefficients and partial covariances. Because it adaptively penalizes individual model parameters, our method is seen to outperform fixed-penalty competitors on simulated data. We establish the posterior contraction rate for our model, buttressing our method’s excellent empirical performance with strong theoretical guarantees. Using our method, we estimated the direct effects of diet and residence type on the composition of the gut microbiome of elderly adults.

EM algorithm↗

The Global Drivers of Photosynthesis and Light Use Efficiency Seasonality: A Granger Frequency Causality Analysis

Photosynthesis and light use efficiency (LUE) are major factors in the evolution of the continental carbon cycle due to their contribution to gross primary production (GPP). However, while the drivers of photosynthesis and LUE on a plant or canopy scale can often be identified, significant uncertainties exist when modeling these on a global scale. This is due to sparse observations in regions such as the tropics and the lack of a direct global observation dataset. Although others have attempted to address this issue using correlations (Beer, 2010) or calculating GPP from vegetation indices (Running, 2004), in this study we take a new approach. We combine the statistical method of Granger frequency causality and partial Granger frequency causality with remote sensing data products (including sun-induced fluorescence used as a proxy for GPP) to determine the main environmental drivers of GPP across the globe.

photosynthesis↗

Cosmological cross-correlations and nearest neighbour distributions

ABSTRACT Cross-correlations between data sets are used in many different contexts in cosmological analyses. Recently, k-nearest neighbour cumulative distribution functions (kNN-CDF) were shown to be sensitive probes of cosmological (auto) clustering. In this paper, we extend the framework of NN measurements to describe joint distributions of, and correlations between, two data sets. We describe the measurement of joint kNN-CDFs, and show that these measurements are sensitive to all possible connected N-point functions that can be defined in terms of the two data sets. We describe how the cross-correlations can be isolated by combining measurements of the joint kNN-CDFs and those measured from individual data sets. We demonstrate the application of these measurements in the context of Gaussian density fields, as well as for fully non-linear cosmological data sets. Using a Fisher analysis, we show that measurements of the halo-matter cross-correlations, as measured through NN measurements are more sensitive to the underlying cosmological parameters, compared to traditional two-point cross-correlation measurements over the same range of scales. Finally, we demonstrate how the NN cross-correlations can robustly detect cross-correlations between sparse samples – the same regime where the two-point cross-correlation measurements are dominated by noise.

79 ASTRONOMY AND ASTROPHYSICS↗

Mars Atmospheric Dynamics

The Martian atmosphere is dynamically similar to the Earth's. Its spin-axis rotation rate is only minutes longer than Earth's so the Coriolois force is nearly identical to Earth's. The inclination of its spin axis is also similar to Earth's giving it similarity in seasonal change. And the Martian atmosphere is nearly transparent to solar radiation (except during dust periods) such that it is heated primarily by upwelling infrared radiation from the surface. These characteristics make Mars an ideal laboratory for studying the dynamics of rapidly rotating differentially heated atmospheres. This talk reviews what we have learned about Mars atmospheric dynamics and how if compares with Earth. The source of information to make such a comparison comes from observations and models. The former are sparse and that the latter have played a major role in shaping our thinking about the general circulation on Mars. However, the models need validation. Fortunately, the first two orbiters in NASA's Mars Surveyor Program have instrumentation to address many of the issues related to the general circulation and climate of Mars. The first, Mars Global Surveyor, is already at Mars gathering data. The second, the Mars 98 Orbiter to be launched later this year, carries a dedicated atmospheric sounder. Thus, much will be learned about Mars' atmosphere in the next few years.

Haberle, Robert↗

Extrapolation of the dna fragment-size distribution after high-dose irradiation to predict effects at low doses

The patterns of DSBs induced in the genome are different for sparsely and densely ionizing radiations: In the former case, the patterns are well described by a random-breakage model; in the latter, a more sophisticated tool is needed. We used a Monte Carlo algorithm with a random-walk geometry of chromatin, and a track structure defined by the radial distribution of energy deposition from an incident ion, to fit the PFGE data for fragment-size distribution after high-dose irradiation. These fits determined the unknown parameters of the model, enabling the extrapolation of data for high-dose irradiation to the low doses that are relevant for NASA space radiation research. The randomly-located-clusters formalism was used to speed the simulations. It was shown that only one adjustable parameter, Q, the track efficiency parameter, was necessary to predict DNA fragment sizes for wide ranges of doses. This parameter was determined for a variety of radiations and LETs and was used to predict the DSB patterns at the HPRT locus of the human X chromosome after low-dose irradiation. It was found that high-LET radiation would be more likely than low-LET radiation to induce additional DSBs within the HPRT gene if this gene already contained one DSB.

NASA Discipline Radiation Health↗

Classification of Dust Days by Satellite Remotely Sensed Aerosol Products

Considerable progress in satellite remote sensing (SRS) of dust particles has been seen in the last decade. From an environmental health perspective, such an event detection, after linking it to ground particulate matter (PM) concentrations, can proxy acute exposure to respirable particles of certain properties (i.e. size, composition, and toxicity). Being affected considerably by atmospheric dust, previous studies in the Eastern Mediterranean, and in Israel in particular, have focused on mechanistic and synoptic prediction, classification, and characterization of dust events. In particular, a scheme for identifying dust days (DD) in Israel based on ground PM10 (particulate matter of size smaller than 10 nm) measurements has been suggested, which has been validated by compositional analysis. This scheme requires information regarding ground PM10 levels, which is naturally limited in places with sparse ground-monitoring coverage. In such cases, SRS may be an efficient and cost-effective alternative to ground measurements. This work demonstrates a new model for identifying DD and non-DD (NDD) over Israel based on an integration of aerosol products from different satellite platforms (Moderate Resolution Imaging Spectroradiometer (MODIS) and Ozone Monitoring Instrument (OMI)). Analysis of ground-monitoring data from 2007 to 2008 in southern Israel revealed 67 DD, with more than 88 percent occurring during winter and spring. A Classification and Regression Tree (CART) model that was applied to a database containing ground monitoring (the dependent variable) and SRS aerosol product (the independent variables) records revealed an optimal set of binary variables for the identification of DD. These variables are combinations of the following primary variables: the calendar month, ground-level relative humidity (RH), the aerosol optical depth (AOD) from MODIS, and the aerosol absorbing index (AAI) from OMI. A logistic regression that uses these variables, coded as binary variables, demonstrated 93.2 percent correct classifications of DD and NDD. Evaluation of the combined CART-logistic regression scheme in an adjacent geographical region (Gush Dan) demonstrated good results. Using SRS aerosol products for DD and NDD, identification may enable us to distinguish between health, ecological, and environmental effects that result from exposure to these distinct particle populations.

satellite remote sensing↗

Evaluation of Satellite-Based Rainfall Estimates in the Lower Mekong River Basin (Southeast Asia)

Satellite-based precipitation is an essential tool for regional water resource applications that requires frequent observations of meteorological forcing, particularly in areas that have sparse rain gauge networks. To fully realize the utility of remotely sensed precipitation products in watershed modeling and decision-making, a thorough evaluation of the accuracy of satellite-based rainfall and regional gauge network estimates is needed. In this study, Tropical Rainfall Measuring Mission (TRMM) Multi-Satellite Precipitation Analysis (TMPA) 3B42 v.7 and Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS) daily rainfall estimates were compared with daily rain gauge observations from 2000 to 2014 in the Lower Mekong River Basin (LMRB) in Southeast Asia. Monthly, seasonal, and annual comparisons were performed, which included the calculations of correlation coefficient, coefficient of determination, bias, root mean square error (RMSE), and mean absolute error (MAE). Our validation test showed TMPA to correctly detect precipitation or no-precipitation 64.9% of all days and CHIRPS 66.8% of all days, compared to daily in-situ rainfall measurements. The accuracy of the satellite-based products varied greatly between the wet and dry seasons. Both TMPA and CHIRPS showed higher correlation with in-situ data during the wet season (June–September) as compared to the dry season (November–January). Additionally, both performed better on a monthly than an annual time-scale when compared to in-situ data. The satellite-based products showed wet biases during months that received higher cumulative precipitation. Based on a spatial correlation analysis, the average r-value of CHIRPS was much higher than TMPA across the basin. CHIRPS correlated better than TMPA at lower elevations and for monthly rainfall accumulation less than 500 mm. While both satellite-based products performed well, as compared to rain gauge measurements, the present research shows that CHIRPS might be better at representing precipitation over the LMRB than TMPA.

Dandridge, Chelsea↗

Retrieving the global distribution of the threshold of wind erosion from satellite data and implementing it into the Geophysical Fluid Dynamics Laboratory land–atmosphere model (GFDL AM4.0/LM4.0)

Dust emission is initiated when surface wind velocities exceed the threshold of wind erosion. Many dust models used constant threshold values globally. Here we use satellite products to characterize the frequency of dust events and land surface properties. By matching this frequency derived from Moderate Resolution Imaging Spectroradiometer (MODIS) Deep Blue aerosol products with surface winds, we are able to retrieve a climatological monthly global distribution of the wind erosion threshold (V(threshold)) over dry and sparsely vegetated surfaces. This monthly two-dimensional threshold velocity is then implemented into the Geophysical Fluid Dynamics Laboratory coupled land–atmosphere model (AM4.0/LM4.0). It is found that the climatology of dust optical depth (DOD) and total aerosol optical depth, surface PM10 dust concentrations, and the seasonal cycle of DOD are better captured over the “dust belt” (i.e., northern Africa and the Middle East) by simulations with the new wind erosion threshold than those using the default globally constant threshold. The most significant improvement is the frequency distribution of dust events, which is generally ignored in model evaluation. By using monthly rather than annual mean V(threshold), all comparisons with observations are further improved. The monthly global threshold of wind erosion can be retrieved under different spatial resolutions to match the resolution of dust models and thus can help improve the simulations of dust climatology and seasonal cycles as well as dust forecasting.

Bing Pu↗

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches.

42 ENGINEERING↗

The Evolution of Gridded NUCAPS: An Overview of Research to Operations Activities

The next-generation S-NPP and NOAA-20 Cross-track Infrared Sounder (CrIS) temperature and moisture profiles can provide valuable observations; (1) Where conventional radiosonde observations are sparse, (2) Between radiosonde launches. CrIS observations are combined with the Advanced Technology Microwave Sounder (ATMS) to produce high quality vertical soundings in clear and partly cloudy conditions. NUCAPS (NOAA Unique Combined Atmospheric Processing System) is the operational algorithm for processing combined hyperspectral infrared and microwave measurements. NUCAPS Soundings are operationally available in AWIPS as Skew-T plots. The capability to visualize the data in plan view or cross section would be valuable to maximize the benefits of NUCAPS data in AWIPS. A multi-organizational collaboration through the JPPS Soundings Applications Initiative developed the capability for plan view and cross section displays of NUCAPS in AWIPS (i.e., Gridded NUCAPS).

Berndt, Emily↗

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗