Markovian Statistical Model of Cloud Optical Thickness. Part I: Theory and Examples
Explore the source record for details and available documents.
54 ENVIRONMENTAL SCIENCES↗
SEARCH · Engineering Papers
Results for “STATISTICAL MODELS”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Challenging Practices of Algebraic Battery Life Models through Statistical Validation and Model Identification via Machine-Learning
Various modeling techniques are used to predict the capacity fade of Li-ion batteries. Algebraic reduced-order models, which are inherently interpretable and computationally fast, are ideal for use in battery controllers, technoeconomic models, and multi-objective optimizations. For Li-ion batteries with graphite anodes, solid-electrolyte-interphase (SEI) growth on the graphite surface dominates fade. This fade is often modeled using physically informed equations, such as square-root of time for predicting solvent-diffusion limited SEI growth, and Arrhenius and Tafel-like equations predicting the temperature and state-of-charge rate dependencies. In some cases, completely empirical relationships are proposed. However, statistical validation is rarely conducted to evaluate model optimality, and only a handful of possible models are usually investigated. This article demonstrates a novel procedure for automatically identifying reduced-order degradation models from millions of algorithmically generated equations via bi-level optimization and symbolic regression. Identified models are statistically validated using cross-validation, sensitivity analysis, and uncertainty quantification via bootstrapping. On a LiFePO 4 /Graphite cell calendar aging data set, automatically identified models utilizing square-root, power law, stretched exponential, and sigmoidal functions result in greater accuracy and lower uncertainty than models identified by human experts, and demonstrate that previously known physical relationships can be empirically "rediscovered" using machine learning.
25 ENERGY STORAGE↗
Stochastic multiscale modeling for quantifying statistical and model errors with application to composite materials
This paper provides a coherent and efficient computational framework for stochastic multiscale analysis of material systems in the presence of parametric uncertainties and modeling errors. Uncertainty in those model parameters that are not deduced as upscaled quantities is attributed to an uncertainty “germ”. While such parameters can appear at any scale, they are predominant at the finest analysis scale. Additional uncertainties stemming from statistical estimation, attributed to lack of data and model error, are associated with each submodel contributing to the multiscale system. Here, a robust and efficient framework based on a generalized extended polynomial chaos expansion (gEPCE) is proposed to simultaneously propagate all these uncertainties in order to provide a probabilistic representation of specific quantities of interest (QoI). We characterize the full probability distribution of the QoI and the uncertainty in the failure probability pertaining to its tails. By combining gEPCE with kernel density estimation (KDE) and directional derivatives, we construct sensitivity measures that connect these statistical metrics of QoI to the various sources of uncertainty to assess their individual and combined impacts. An illustrative problem featuring three-point bending of a composite beam is investigated to demonstrate the presented approach.
36 MATERIALS SCIENCE↗
Stochastic modeling and statistical calibration with model error and scarce data
This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.
Bayesian inference↗
Spatiotemporal Learning in Power Modules: Wavelet-Enhanced Forecasting of Thermomechanical Degradation
Detecting internal defects in power electronics packages is critical for their performance and reliability, especially under extreme operating conditions, as these defects can lead to catastrophic failure if not properly addressed. Confocal scanning acoustic microscopy (C-SAM) plays a key role in the nondestructive evaluation of bond layer degradation within a power electronics package by detecting defects such as delamination, voids, and cracks. However, accurately quantifying and predicting these defects from C-SAM images remains a significant challenge due to the low noise-to-signal ratio, which typically arises from both imaging process and bond patterns itself. In this paper, we explore machine learning strategies for processing C-SAM images and providing predictive models of defect growth. We use C-SAM images of sintered copper and sintered silver samples, which are obtained under accelerated thermal experiments, as the representative dataset for our study. We investigate the effect of Fourier transforms and wavelet transforms on these datasets to remove high-frequency noise and address noise across multiple scales with histogram equalization to enhance the contrast and improve the visibility of defects. As a result, defect boundaries can be clearly distinguished, enabling more accurate tracking of their growth over time. We then employ different time-series forecasting algorithms on the denoised images to formulate an image-based lifetime prediction model. Statistical models and deep-learning techniques are trained on images obtained in the early stages of thermal shock, and defect growth in the later stages is predicted. Our work serves as a preliminary attempt to improve the accuracy of lifetime prediction models of power electronics packages, which is critical under extreme operating environments.
24 POWER TRANSMISSION AND DISTRIBUTION↗
An adaptive knowledge-based data-driven approach for turbulence modeling using ensemble learning technique under complex flow configuration: 3D PWR sub-channel with DNS data
This work describes a new approach to increase the accuracy of Reynolds-averaged Navier–Stokes (RANS) in modeling turbulence flow leveraging the machine learning technique. Traditionally, different turbulence models for Reynolds stress are developed for different flow patterns based on human knowledge. Each turbulence model has a certain application domain and prediction uncertainty. In recent years, with the rapid improvements of machine learning techniques, researchers start to develop an approach to compensate for the prediction discrepancy of traditional turbulence models with statistical models and data. However, the approach has deficiencies in several aspects. For example, the amount of human knowledge introduced to the statistical model couldn’t be controlled, which makes the statistical model learn from a very naïve stage and limits its application. In this work, a new approach is developed to address those deficiencies. Here, the new approach uses the “ensemble learning” technique to control the amount of human knowledge introduced into the statistical model. Therefore, the new approach could be adaptive to the multiple application domains. In conclusion, according to the results of case study, the new approach shows higher accuracy than both traditional turbulence models and the previous machine learning approach.
42 ENGINEERING↗
Accelerated statistical failure analysis of multifidelity TRISO fuel models
Statistical nuclear fuel failure analysis is critical for the design and development of advanced reactor technologies. Although Monte Carlo Sampling (MCS) is a standard method of statistical failure analysis for fuels, the low failure probabilities of some advanced fuel forms and the correspondingly large number of required model evaluations limit its application to low-fidelity (e.g., 1-D) fuel models. In this paper, we present four other statistical methods for fuel failure analysis in Bison, considering tri-structural isotropic (TRISO)-coated particle fuel as a case study. The statistical methods considered are Latin hypercube sampling (LHS), adaptive importance sampling (AIS), subset simulation (SS), and the Weibull theory. Using these methods, we analyzed both 1-D and 2-D representations of TRISO models to compute failure probabilities and the distributions of fuel properties that result in failures. The results of these methods compare well across all TRISO models considered. Overall, SS and the Weibull theory were deemed the most efficient, and can be applied to both 1-D and 2-D TRISO models to compute failure probabilities. Moreover, since SS also characterizes the distribution of parameters that cause TRISO failures, and can consider failure modes not described by the Weibull criterion, it may be preferred over the other methods. Finally, a discussion on the efficacy of different statistical methods of assessing nuclear fuel safety is provided.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Correct Interpretations of ENDF-102 Definitions for Resonance Effects
My Uncle Willie circa 1600 wrote “What’s in a name; a rose by any other name would smell as sweet.” I fear in this case we have a somewhat similar problem in that we may be using the same word but are not using the same definition; specifically, the word Unresolved. The simplest physics definition as it applies to neutron resonances, is the energy point where we can no longer see/measure ALL – let me repeat that – ALL - of the individual resonances. That seems simple and clear, but the question is: how to represent resonances beyond this point in order to accurately reproduce the effects we have seen in measurements and expect/need to reproduce in our applications. We know there are more, unseen resonances, otherwise we wouldn’t say Unresolved. The ENDF approach is well defined in ENDF-102 and simple: for ENDF data the only way to represent Unresolved data is by using a theoretical model to define the distribution of resonances, including those that are too narrow to measure (i.e., are unresolved). It is important to note that in ENDF this is the one and only Unresolved model, e.g., there is no provision in ENDF to accurately define individually ALL resonances above the Resolved energy range – by ALL here I mean both those that we can measure and those that we cannot individually measure, but that theory and integral measurements tells us are present. An alternative approach, which would appear to be equally valid, would be to include the latest measured data as tabulated energy expendent data extending upwards in energy above the Resolved energy range. In this approach the evaluation would not include an ENDF style Unresolved energy range; it would only include a Resolved resonance region, followed by tabulated higher energy points, representing the resonances that could be measured beyond the Resolved range. But an important point to note: By listing these resonances above the resolved energy one admits that at least some resonances in this energy range are missing as Unresolved; i.e., they are too narrow or overlapping to measure. The purpose of this paper is to illustrate that the later approach, while done with good intentions, and appearing to be valid/adequate in plots, does not meet the need of our engineering applications. Why? As we will see below, of these two possible approaches, only the ENDF use of a model to statistically include the missing, i.e., unresolved, resonances, can meet our engineering needs to reproduce the integral effects we have measured and understand. Only with this statistical model can we predict and include in our calculated results the important effects of temperature (Doppler broadening), and energy integrals (self-shielding). Below I will first present results using two ENDF/B-VIII.1 evaluations, U235 and U238, that use the correct ENDF-102 definition of an Unresolved resonance region, using a statistical model to include the effects of resonances that theory predicts are present, but are too narrow to measure. These two evaluations reproduce the expected temperature (Doppler) and energy integral (self-shielding) effects that we expect. Next I will present results using one ENDF/B-VIII.1 evaluation, 26-Fe-56, that does not use an ENDF-102 Unresolved resonance region; instead above its Resolved energy range it lists many tabulated energy points, that look like measured data, but by definition, since they are included above the ENDF Resolved energy range there are missing Unresolved resonances, i.e., there are missing the resonances that are too narrow to resolve, i.e., are unresolved. My conclusion, and I hope yours, is that the below figures illustrate that this approach does not reproduce the temperature and energy integrals that we expect and need to accurately calculate results for our fission reactor calculations. As such this approach should not be used in ENDF formatted evaluations.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Solving Statistical Flowgraph Models: A Brief Review
Statistical flowgraph models (SFGMs) have proven useful for analysis and modeling of multistate processes in various fields. In this paper we briefly review flowgraph models, describe how to set up a model, and provide a fully worked example from biostatistics. References are provided for more details.
97 MATHEMATICS AND COMPUTING↗
Estimation of pollen productivity and dispersal: How pollen assemblages in small lakes represent vegetation
Abstract Quantitative understanding of vegetation dynamics over timespans beyond a century remains limited. In this regard, the pollen‐based reconstruction of past vegetation enables unique research opportunities by quantifying changes in plant community compositions during hundreds to thousands of years. Critically, the methodological basis for most reconstruction approaches rests upon estimates of pollen productivity and dispersal. Previous studies, however, have reached contrasting conclusions concerning these estimates, which may be perceived to challenge the applicability and reliability of pollen‐based reconstruction. Here we show that conflicting estimates of pollen production and dispersal are, at least in part, artifacts of fixed assumptions of pollen dispersal and insufficient spatial resolution of vegetation data surrounding the pollen‐collecting lake. We implemented a Bayesian statistical model that related pollen assemblages in surface sediments of 33 small lakes (<2 ha) in the northeastern United States, with surrounding vegetation ranging from 10 1 to >10 5 m from the lake margin. Our analysis revealed three key insights. First, pollen productivity is largely conserved within taxa and across forest types. Second, when local (within a 1‐km radius) vegetation abundances are not considered, pollen‐source areas may be overestimated for some common taxa (Cupressaceae, Pinus , Quercus , and Tsuga ). Third, pollen dispersal mechanisms may differ between local and regional scales; this is missed by pollen‐dispersal models used in previous studies. These findings highlight the complex interactions between vegetation heterogeneity on the landscape and pollen dispersal. We suggest that, when estimating pollen productivity and dispersal, both detailed local and extended regional vegetation must be taken into account. Also, both deductive (mechanistic models) and inductive (statistical models) approaches are needed to better understand the emergent properties of pollen dispersal in heterogeneous landscapes.
54 ENVIRONMENTAL SCIENCES↗
Scalable statistical inference of photometric redshift via data subsampling
Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for bigger problems. But full probabilistic statistical models often outperform other models in quantifying uncertainties associated with model predictions. We develop a data-driven statistical modeling framework that combines the uncertainties from an ensemble of statistical models learned on smaller subsets of data carefully chosen to account for imbalances in the input space. We demonstrate this method on a photometric redshift estimation problem in cosmology, which seeks to infer a distribution of the redshift—the stretching effect in observing the light of far-away galaxies—given multivariate color information observed for an object in the sky. Our proposed method performs balanced partitioning, graph-based data subsampling across the partitions, and training of an ensemble of Gaussian process models.
data subsampling↗
Rapid measurement of soluble xylo-oligomers using near-infrared spectroscopy (NIRS) and multivariate statistics: calibration model development and practical approaches to model optimization
Rapid monitoring of biomass conversion processes using techniques such as near-infrared (NIR) spectroscopy can be substantially quicker and less labor-, resource-, and energy-intensive than conventional measurement techniques such as gas or liquid chromatography (GC or LC) due to the lack of solvents and preparation methods, as well as removing the need to transfer samples to an external lab for analytical evaluation. The purpose of this study was to determine the feasibility of rapid monitoring of a biomass conversion process using NIR spectroscopy combined with multivariate statistical modeling, and to examine the impact of (1) subsetting the samples in the original dataset by process location and (2) reducing the spectral range used in the calibration model on model performance. We develop multivariate calibration models for the concentrations of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids at multiple points in a biomass conversion process which produces and then purifies XOS compounds from sugar cane bagasse. A single model using samples from multiple locations in the process stream showed acceptable performance as measured by standard statistical measures. However, compared to the single model, we show that separate models built by segregating the calibration samples according to process location show improved performance. We also show that combining an understanding of the sample spectra with simple multivariate analysis tools can result in a calibration model with a substantially smaller spectral range that provides essentially equal performance to the full-range model. We demonstrate that real-time monitoring of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids concentration at multiple points in a process stream using NIR spectroscopy coupled with multivariate statistics is feasible. Segregation of sample populations by process location improves model performance. Models using a reduced spectral range containing the most relevant spectral signatures show very similar performance to the full-range model, reinforcing the importance of performing robust exploratory data analysis before beginning multivariate modeling.
09 BIOMASS FUELS↗
Robustness of the Stochastic Parameterization of Subgrid-Scale Wind Variability in Sea Surface Fluxes
Abstract High-resolution numerical models have been used to develop statistical models of the enhancement of sea surface fluxes resulting from spatial variability of sea surface wind. In particular, studies have shown that flux enhancement is not a deterministic function of the resolved state. Previous studies focused on single geographical areas or used a single high-resolution numerical model. This study extends the development of such statistical models by considering six different high-resolution models, four different geographical regions, and three different 10-day periods, allowing for a systematic investigation of the robustness of both the deterministic and stochastic parts of the data-driven parameterization. Results indicate that the deterministic part, based on regressing the unresolved normalized flux onto resolved-scale normalized flux and precipitation, is broadly robust across different models, regions, and time periods. The statistical features of the stochastic part of the model (spatial and temporal autocorrelation and parameters of a Gaussian process fit to the regression residual) are also found to be robust and not strongly sensitive to the underlying model, modeled geographical region, or time period studied. Best-fit Gaussian process parameters display robust spatial heterogeneity across models, indicating potential for improvements to the statistical model. These results illustrate the potential for the development of a generic, explicitly stochastic parameterization of sea surface flux enhancements dependent on wind variability.
Endo, Kota↗
Bayesian Spatial Models for Projecting Corn Yields
Climate change is predicted to impact corn yields. Previous studies analyzing these impacts differ in data and modeling approaches and, consequently, corn yield projections. We analyze the impacts of climate change on corn yields using two statistical models with different approaches for dealing with county-level effects. The first model, which is novel to modeling corn yields, uses a computationally efficient spatial basis function approach. We use a Bayesian framework to incorporate both parametric and climate model structural uncertainty. We find that the statistical models have similar predictive abilities, but the spatial basis function model is faster and hence potentially a useful tool for crop yield projections. We also explore how different gridded temperature datasets affect the statistical model fit and performance. Compared to the dataset with only weather station data, we find that the dataset composed of satellite and weather station data results in a model with a magnified relationship between temperature and corn yields. For all statistical models, we observe a relationship between temperature and corn yields that is broadly similar to previous studies. We use downscaled and bias-corrected CMIP5 climate model projections to obtain detrended corn yield projections for 2020–2049 and 2069–2098. In both periods, we project a decrease in the mean corn yield production, reinforcing the findings of other studies. However, the magnitude of the decrease and the associated uncertainties we obtain differ from previous studies.
54 ENVIRONMENTAL SCIENCES↗
Attribution of heterogeneous stress distributions in low-grain polycrystals under conditions leading to damage
In high-purity polycrystalline metallic materials, voids tend to favor grain boundaries as nucleation sites due to the elevated stress states produced by granular interactions and the weakened grain boundary from the relative atomic disorder. To quantify the key factors of this elevated stress state, simple compression of a small multi-grain cylinder of body-centered cubic tantalum was simulated using a single crystal plasticity model that incorporates non-Schmid effects. Four increasingly complex synthetic microstructures were created to tractably incorporate grain boundary interactions, and a statistically significant number of combinations were performed by varying the initial crystallographic orientations of the microstructure. Most of these simulations produce the maximum von Mises stress on a grain boundary and less frequently at the multi-grain junctions. To build a statistical model for the maximum von Mises stress at the grain boundary, physically based features that could contribute to the elevated stress state were selected. Then, a learning algorithm based on information theory was used to identify which of these features contributed the most information to the data set. The identified features include a grain’s propensity to accommodate both elastic and plastic deformations and their directional components. The misalignment of the direction of each grain’s mechanical response was found to be strongly correlated to the magnitude of the stress near the grain boundary. For all of the synthetic microstructures, the statistical models produce a residual distribution that is nearly Gaussian with a variance of, at most, 10% of the prior distribution. The successful performance of the statistical model implies the correct identification of the physical features that cause severe stress localization in polycrystalline materials. The statistical models constructed here can be used to formulate a physically motivated void nucleation model which is sensitive to a microstructure’s propensity to produce elevated stress states. As a result, these statistical models also enable the design of material microstructures, in which the crystallographic orientation is chosen to resist void nucleation.
36 MATERIALS SCIENCE↗
Damage and Failure in a Statistical Crack Model
In this paper I will take a close look at a statistical crack model (SCM) as is used in engineering computer codes to simulate fracture at high strain rates. My general goal is to understand the macroscopic behavior effected by the microphysical processes incorporated into an SCM. More specifically, I will assess the importance of including local interactions between cracks into the growth laws of an SCM. My strategy will be to construct a numerical laboratory that represents a single computational cell containing a realization of a statistical distribution of cracks. The cracks will evolve by the microphysical models of the SCM, leading to quantifiable damage and failure of the computational cell. I will use the numerical data generated by randomly generated ensembles of the fracture process to establish scaling laws that will modify and simplify the implementation of the SCM into large scale engineering codes.
42 ENGINEERING↗
Particle Size Distribution Dynamics Can Help Constrain the Phase State of Secondary Organic Aerosol
Particle phase state is a property of atmospheric aerosols that has important implications for the formation, evolution, and gas/particle partitioning of secondary organic aerosol (SOA). In this work, we use a size-resolved chemistry and microphysics model (SOM-TOMAS), updated to include an explicit treatment of particle phase state, to constrain the bulk diffusion coefficient (Db) of SOA produced from ??- pinene ozonolysis. By leveraging data from laboratory experiments performed in the absence of a seed and under dry conditions, we find that the Db for SOA can be constrained (1-7 ×10-15 cm2 s-1 in these experiments) by simultaneously reproducing the time-varying SOA mass concentrations and the evolution of the particle size distribution. Another version of our model that used the predicted SOA composition to calculate the glass transition temperature, viscosity, and, ultimately, Db (~10-15 cm2 s-1) of the SOA was able to reproduce the mass and size distribution measurements when we included oligomer formation (oligomers accounted for about a fifth of the SOA mass). Our work highlights the potential of a size resolved SOA model to constrain the particle phase state of SOA by utilizing historical measurements of the evolution of the particle size distribution.
He, Yicong↗
A Stochastic Reduced-Order Model for Statistical Microstructure Descriptors Evolution
Integrated computational materials engineering (ICME) models have been a crucial building block for modern materials development, relieving heavy reliance on experiments and significantly accelerating the materials design process. However, ICME models are also computationally expensive, particularly with respect to time integration for dynamics, which hinders the ability to study statistical ensembles and thermodynamic properties of large systems for long time scales. To alleviate the computational bottleneck, we propose to model the evolution of statistical microstructure descriptors as a continuous-time stochastic process using a non-linear Langevin equation, where the probability density function (PDF) of the statistical microstructure descriptors, which are also the quantities of interests (QoIs), is modeled by the Fokker–Planck equation. In this work, we discuss how to calibrate the drift and diffusion terms of the Fokker–Planck equation from the theoretical and computational perspectives. The calibrated Fokker–Planck equation can be used as a stochastic reduced-order model to simulate the microstructure evolution of statistical microstructure descriptors PDF. Considering statistical microstructure descriptors in the microstructure evolution as QoIs, we demonstrate our proposed methodology in three integrated computational materials engineering (ICME) models: kinetic Monte Carlo, phase field, and molecular dynamics simulations.
97 MATHEMATICS AND COMPUTING↗