Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “applied statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

An Efficient Bayesian Approach to Learning Droplet Collision Kernels: Proof of Concept Using “Cloudy,” a New n -Moment Bulk Microphysics Scheme

The small-scale microphysical processes governing the formation of precipitation particles cannot be resolved explicitly by cloud resolving and climate models. Instead, they are represented by microphysics schemes that are based on a combination of theoretical knowledge, statistical assumptions, and fitting to data (“tuning”). Historically, tuning was done in an ad hoc fashion, leading to parameter choices that are not explainable or repeatable. Recent work has treated it as an inverse problem that can be solved by Bayesian inference. The posterior distribution of the parameters given the data—the solution of Bayesian inference—is found through computationally expensive sampling methods, which require over $\mathcal{O}$(10 5 ) evaluations of the forward model; this is prohibitive for many models. We present a proof of concept of Bayesian learning applied to a new bulk microphysics scheme named “Cloudy,” using the recently developed Calibrate-Emulate-Sample (CES) algorithm. Cloudy models collision-coalescence and collisional breakup of cloud droplets with an adjustable number of prognostic moments and with easily modifiable assumptions for the cloud droplet mass distribution and the collision kernel. The CES algorithm uses machine learning tools to accelerate Bayesian inference by reducing the number of forward evaluations needed to $\mathcal{O}$(10 2 ). It also exhibits a smoothing effect when forward evaluations are polluted by noise. In a suite of perfect-model experiments, we show that CES enables computationally efficient Bayesian inference of parameters in Cloudy from noisy observations of moments of the droplet mass distribution. In an additional imperfect-model experiment, a collision kernel parameter is successfully learned from output generated by a Lagrangian particle-based microphysics model.

54 ENVIRONMENTAL SCIENCES↗

Screening of metal complexes and organic solvents using the COSMOSAC-LANL model to enhance the energy density in a non-aqueous redox flow cell: an insight into the solubility

In this paper, we have proposed a first-principles methodology to screen transition metal complexes against a particular organic solvent and organic solvents against a particular transition metal complex based on their solubility information without the knowledge of heat of fusion and melting temperature. The energy density of a non-aqueous redox flow cell directly depends on the solubility of the redox active species in the non-aqueous medium. Here, we have used the “COSMOSAC-LANL” activity coefficient model which is based on first-principles COSMO calculations where the microscopic information is passed to the macroscopic world via a dielectric continuum solvation model, followed by a post-statistical thermodynamic treatment of the self-consistent properties of the solute particle to calculate the solubility. To model the activity coefficient at infinite dilution for the binary mixtures, a 3-suffix Margules (3sM) function is introduced for the quantitative estimation of the asymmetric interactions and, for the combinatorial term, the Staverman–Guggenheim (SG) form is used. The new activity coefficient model is separately called the “LANL” activity coefficient model. The metal complex and the organic solvent have been treated as a simple binary mixture. The present model has been applied to a set of 14 different organic solvents and 16 different transition metal complexes. Using the new LANL activity coefficient model in combination with the ADF-COSMOSAC-2013 model, we have shown how one can improve the solubility of a transition metal complex in an organic solvent. We applied our model to screen 84 binary mixtures to predict the compatible pair of redox active species and organic solvent to increase the energy density. The solvation mechanism of the transition metal complexes in the organic solvents was obtained using the new model. The results have been compared with the experimental and theoretical results where they are available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Efficient Langevin dynamics for “noisy” forces

Efficient Boltzmann-sampling using first-principles methods is challenging for extended systems due to the steep scaling of electronic structure methods with the system size. Additionally, stochastic approaches provide a gentler system-size dependency at the cost of introducing “noisy” forces, which could limit the efficiency of the sampling. When the forces are deterministic, the first-order Langevin dynamics (FOLD) offers efficient sampling by combining a well-chosen preconditioning matrix S with a time-step-bias-mitigating propagator [G. Mazzola and S. Sorella, Phys. Rev. Lett. 118, 015703 (2017)]. However, when forces are noisy, S is set equal to the force-covariance matrix, a procedure that severely limits the efficiency and the stability of the sampling. Here, we develop a new, general, optimal, and stable sampling approach for FOLD under noisy forces. We apply it for silicon nanocrystals treated with stochastic density functional theory and show efficiency improvements by an order-of-magnitude.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Detection of Extreme Phenomena in the Stable Boundary Layer over the Amazonian Forest

We apply different methods for detection of extreme phenomena (EP) in air-turbulent time series measured in the nocturnal boundary layer above the Amazon forest. The methods used were: (a) a Morlet complex wavelet transform, which is often used in analysis of non-linear application processes. Through the use of the wavelet, it is possible to observe a phase singularity that involves a strong interaction between an extensive range of scales; (b) recurrence plot tests, which were used to identify a sudden change between different stable atmospheric states. (c) statistical analysis of early-warning signals, which verify simultaneous increases in the autocorrelation function and in the variance in the state variable; and (d) analysis of wind speed versus turbulent kinetic energy to identify different turbulent regimes in the stable boundary layer. We found it is adequate to use a threshold to classify the cases of strong turbulence regime, as a result of the occurrence of EP in the tropical atmosphere. All methods used corroborate and indicate synergy between events that culminate in what we classify as EP of the stable boundary layer above the tropical forest.

54 ENVIRONMENTAL SCIENCES↗

Untargeted GC-MS Metabolic Profiling of Anaerobic Gut Fungi Reveals Putative Terpenoids and Strain-Specific Metabolites

Background/Objectives: Anaerobic gut fungi (Neocallimastigomycota) are biotechnologically relevant, lignocellulose-degrading microbes with under-explored biosynthetic potential for secondary metabolites. Untargeted metabolomic profiling with gas chromatography–mass spectrometry (GC-MS) was applied to two gut fungal strains, Anaeromyces robustus and Caecomyces churrovis, to establish a foundational metabolomic dataset to identify metabolites and provide insights into gut fungal metabolic capabilities. Methods: Gut fungi were cultured anaerobically in rumen-fluid-based media with a soluble substrate (cellobiose), and metabolites were extracted using the Metabolite, Protein, and Lipid Extraction (MPLEx) method, enabling metabolomic and proteomic analysis from the same cell samples. Samples were derivatized and analyzed via GC-MS, followed by compound identification by spectral matching to reference databases, molecular networking, and statistical analyses. Results: Distinct metabolites were identified between A. robustus and C. churrovis, including 2,3-dihydroxyisovaleric acid produced by A. robustus and maltotriitol, maltotriose, and melibiose produced by C. churrovis. C. churrovis may polymerize maltotriose to form an extracellular polysaccharide, like pullulan. GC-MS profiling potentially captured sufficiently volatile products of proteomically detected, putative non-ribosomal peptide synthetases and polyketide synthases of A. robustus and C. churrovis. The triterpene squalene and triterpenoid tetrahymanol were putatively identified in A. robustus and C. churrovis. Their conserved, predicted biosynthetic genes—squalene synthase and squalene tetrahymanol cyclase—were identified in A. robustus, C. churrovis, and other anaerobic gut fungal genera. Conclusions: This study provides a foundational, untargeted metabolomic dataset to unmask gut fungal metabolic pathways and biosynthetic potential and to prioritize future efforts for compound isolation and identification.

Biochemistry & Molecular Biology↗

Stream Temperature Prediction in a Shifting Environment: Explaining the Influence of Deep Learning Architecture

Stream temperature is a fundamental control on ecosystem health. Recent efforts incorporating process guidance into deep learning models for predicting stream temperature have been shown to outperform existing statistical and physical models. This performance is in part because deep learning architectures can actively learn spatiotemporal relationships that govern how water and energy propagate through a river network. However, exploration of how spatiotemporal awareness and process guidance influence a model's generalizability under shifting environmental conditions such as climate change is limited. Here, we use Explainable Artificial Intelligence (XAI) to interrogate how differing deep learning architectures affect a model's learned spatial and temporal dependencies, and how those learned dependencies affect a model's ability to maintain high accuracy when applied to unseen environmental conditions. Using the Delaware River Basin in the northeastern United States as a test case, we compare two spatiotemporally aware process–guided deep learning models for predicting stream temperature (a recurrent graph convolution network—RGCN, and a temporal convolution graph model—Graph WaveNet). Both models achieve equally high predictive performance when testing data are well represented in the training data (test root mean squared errors of 1.64°C and 1.65°C); however, Graph WaveNet significantly outperforms RGCN in 4 out of 5 experiments where test partitions represent different types of unseen environmental conditions. XAI results show that the architecture of Graph WaveNet leads to learned spatial relationships with greater fidelity to physical processes, and that this fidelity improves the generalizability of the model when applied to shifting and/or unseen environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

Supervised machine learning-based multivariate regression of parallel closures for a high-collisionality deuterium-carbon plasma

Many plasmas of interest in laboratory experiments and space consist of multiple ion species. In tokamak edge plasmas, for instance, ionized impurities expelled from the vessel wall influence plasma transport. When describing multi-species plasmas using fluid equations, we need accurate closure relations to close the set of fluid equations. In this study, we introduce the development of fitting formulas for parallel closures using supervised machine learning, in conjunction with the recent closure theory, considering multi-ion collisions and arbitrary ion temperatures. We apply this approach to a high-collisionality deuterium-carbon plasma and demonstrate its effectiveness. As a result, the machine learning-based method for developing practical and accurate closures can be extended to a wider range of plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Association of Serum Bile Acid and Unsaturated Fatty Acid Profiles with the Risk of Diabetic Retinopathy in Type 2 Diabetic Patients

Aim: We aimed to identify the ability of serum bile acids (BAs) and unsaturated fatty acids (UFAs) profiles to predict the development of diabetic retinopathy (DR) in type 2 diabetes mellitus (T2DM) patients. Methods: We first used univariate and multivariate analysis to compare 15 serum BA and 11 UFA levels in healthy control (HC) group (n = 82), T2DM patients with DR (n = 58) and T2DM patients without DR (n = 60). Forty T2DM patients were considered for validation. Then, the receiver operating characteristic curve (ROC) and decision curve analysis were used to assess the diagnostic value and clinical benefit of serum biomarkers alone, clinical variables alone or in combination, and the area under the curve (AUC), integrated discrimination improvement (IDI), and net reclassification improvement (NRI) were used to further assess whether the addition of biomarkers significantly improved the predictive ability of the model. Results: Orthogonal partial least squares-discriminant analysis (OPLS-DA) of serum BAs and UFAs separated the three cohorts including HC, T2DM patients with or without DR. The difference in serum BA and UFA profiles of T2DM patients with or without DR was mainly manifested in the three metabolites of taurolithocholic acid (TLCA), tauroursodeoxycholic acid (TUDCA) and arachidonic acid (AA). Together, they had an AUC of 0.785 (0.918 for validation cohort) for predicting DR in T2DM patients. After adjusting for numerous confounding factors, TLCA, TUDCA, and AA were independent predictors that differentiated T2DM with or without DR. The results of AUC, IDI, and NRI demonstrated that adding these three biomarkers to a model with clinical variables statistically increased their predictive value and were replicated in our independent validation cohort. Conclusion: These findings highlight the association of three metabolites, TLCA, TUDCA and AA, with DR and may indicate their potential value in the pathogenesis of DR.

60 APPLIED LIFE SCIENCES↗

Effect of stress on Laves phase precipitation in creep ruptured Grade 92 ferritic martensitic steel characterized by a novel accessible method

At high temperature conditions relevant to fossil and nuclear energy plants, Laves phase (Fe 2 X, X=Mo, W) precipitation is observed in common ferritic martensitic (FM) structural steels, with various reported effects on creep behavior. Despite being valuable metrics to correlate with mechanical properties and other precipitate phases, the volume fraction and number density of Laves phase precipitates has been difficult to quantify accurately using common techniques such as transmission electron microscopy (TEM) due to the relatively large size (∼0.25 μm) and low number density (∼10 11 cm −3 ) of Laves precipitates. Here, to address this characterization challenge, we developed and demonstrated a high-throughput and widely accessible method to quantify the volume fraction and number density of the Laves phase based on scanning electron microscope (SEM) images with a backscattered electron signal and the information depth (ID) of backscattered electrons. We applied this new technique in creep ruptured Grade 92 FM steel to study the effect of Laves phase on creep properties and determine the influence of stress on Laves phase precipitation. The quantitative accuracy of the SEM-based volume fraction and number density values was verified using synchrotron high energy X-ray diffraction and serial sectioning tomography. Stress did not significantly affect the Laves phase size or volume fraction during creep testing at 550 – 650°C and stress levels of 90 – 260 MPa (vs. unstressed conditions). Conversely, a moderate but statistically significant stress-enhanced increase in Laves phase number density, corresponding to an increase in nucleation rate, occurred during creep exposure above 110 MPa.

Creep↗

Hyper-fidelity depletion coupled with discrete pebble motion in pebble bed reactors

Pebble bed reactors have raised new interest during the past decade due to their attractive characteristics. Therefore, accurate simulations must be performed to better understand these systems and ensure optimal and safe designs. Most current methods use lower fidelity approaches with representative unit-cells or macro-zones with uniform fluxes, which have accuracy and flexibility limitations. A novel hyper-fidelity method for pebble bed reactors depletion is presented and internally couples Serpent 2 and a pseudo-motion routine. Pseudo-motion is applied handling vertical shifts of compositions in a static pebble bed, random reinsertion of used pebbles, insertion of fresh pebbles and used pebbles discarding. Associated with individual depletion to correctly determine the flux spectrum and composition in each pebble, this hyper-fidelity approach paves the way towards more accurate depletion calculation in pebble bed reactors. Using this method, a demonstration is completed on a small-scale reactor. In this application, the core reaches equilibrium, and the following data is extracted: core-wise parameters evolution, pebble-wise spatial and statistical distribution. Discarded pebbles are analyzed, and relevant information is shown. This work proves the feasibility of hyper fidelity depletion with Serpent 2, and the range of use for this method: reactor design and analysis for equilibrium and slow transients, lower fidelity methods validation and feeding fuel performance, thermal-hydraulics, or waste management models. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A framework for measuring weak-lensing magnification using the Fundamental Plane

ABSTRACT Galaxy–galaxy lensing is an essential tool for probing dark matter haloes and constraining cosmological parameters. While galaxy–galaxy lensing measurements usually rely on shear, weak-lensing magnification contains additional constraining information. Using the Fundamental Plane (FP) of elliptical galaxies to anchor the size distribution of a background population is one method that has been proposed for performing a magnification measurement. We present a formalism for using the FP residuals of elliptical galaxies to jointly estimate the foreground mass and background redshift errors for a stacked lens scenario. The FP residuals include information about weak-lensing magnification κ, and therefore foreground mass, since to first order, non-zero κ affects galaxy size but not other FP properties. We also present a modular, extensible code that implements the formalism using emulated galaxy catalogues of a photometric galaxy survey. We find that combining FP information with observed number counts of the source galaxies constrains mass and photo-z error parameters significantly better than an estimator that includes number counts only. In particular, the constraint on the mass is 17.0 per cent if FP residuals are included, as opposed to 27.7 per cent when only number counts are included. The effective size noise for a foreground lens of mass $M_\mathrm{ H}=10^{14}\, \mathrm{M}_\odot$, with a conservative selection function in size and surface brightness applied to the source population, is σκ, eff = 0.250. We discuss the improvements to our FP model necessary to make this formalism a practical companion to shear analyses in weak-lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Detection of defects in atomic-resolution images of materials using cycle analysis

The automated detection of defects in high-angle annular dark-field Z-contrast (HAADF) scanning-transmission-electron microscopy (STEM) images has been a major challenge. Here, we report an approach for the automated detection and categorization of structural defects based on changes in the material’s local atomic geometry. The approach applies geometric graph theory to the already-found positions of atomic-column centers and is capable of detecting and categorizing any defect in thin diperiodic structures (i.e., “2D materials”) and a large subset of defects in thick diperiodic structures (i.e., 3D or bulk-like materials). Despite the somewhat limited applicability of the approach in detecting and categorizing defects in thicker bulk-like materials, it provides potentially informative insights into the presence of defects. The categorization of defects can be used to screen large quantities of data and to provide statistical data about the distribution of defects within a material. This methodology is applicable to atomic column locations extracted from any type of high-resolution image, but here we demonstrate it for HAADF STEM images.

36 MATERIALS SCIENCE↗

Case studies in bias reduction and inference for electronic health record data with selection bias and phenotype misclassification

Electronic health records (EHR) are not designed for population‐based research, but they provide easy and quick access to longitudinal health information for a large number of individuals. Many statistical methods have been proposed to account for selection bias, missing data, phenotyping errors, or other problems that arise in EHR data analysis. However, addressing multiple sources of bias simultaneously is challenging. We developed a methodological framework (R package, SAMBA ) for jointly handling both selection bias and phenotype misclassification in the EHR setting that leverages external data sources. These methods assume factors related to selection and misclassification are fully observed, but these factors may be poorly understood and partially observed in practice. As a follow‐up to the methodological work, we demonstrate how to apply these methods for two real‐world case studies, and we evaluate their performance. In both examples, we use individual patient‐level data collected through the University of Michigan Health System and various external population‐based data sources. In case study (a), we explore the impact of these methods on estimated associations between gender and cancer diagnosis. In case study (b), we compare corrected associations between previously identified genetic loci and age‐related macular degeneration with gold standard external summary estimates. These case studies illustrate how to utilize diverse auxiliary information to achieve less biased inference in EHR‐based research.

60 APPLIED LIFE SCIENCES↗

Brighter-fatter Effect in Near-infrared Detectors—III. Fourier-domain Treatment of Flat Field Correlations and Application to WFIRST

Weak gravitational lensing has emerged as a leading probe of the growth of cosmic structure. However, the shear signal is very small and accurate measurement depends critically on our ability to understand how non-ideal instrumental effects affect astronomical images. The Wide-Field Infrared Survey Telescope (WFIRST) will fly a focal plane containing 18 Teledyne H4RG-10 near-infrared detector arrays, which present different instrument calibration challenges from previous weak lensing observations. Previous work [Paper I: Hirata & Choi, PASP, 132, 014501 (2020); and Paper II: Choi & Hirata, PASP, 132, 014502 (2020)] has shown that correlation functions of flat field images, including cross-correlations between different time slices that are enabled by the non-destructive read capability of the infrared detectors, are effective tools for disentangling linear and nonlinear inter-pixel capacitance (IPC) and the brighter-fatter effect (BFE). Here we present a Fourier-domain treatment of the flat field correlations, which allows us to expand the previous formalism to all orders in IPC, BFE, and classical nonlinearity. We show that biases in simulated flat field analyses in Paper I are greatly reduced through the use of this formalism. We then apply this updated formalism to flat field data from three WFIRST flight candidate detectors, and explore the robustness to variations in the analysis. We find that the BFE is present in all three detectors, and that its contribution to the flat field correlations dominates over the nonlinear IPC, in accordance with the results from Paper II on a development detector. The magnitude of the BFE is such that the effective area of a pixel is increased by (3.54 ± 0.03) × 10 -7 for every electron deposited in a neighboring pixel (sensor chip assembly [SCA] 20829, statistical error, not IPC-deconvolved). We compare IPC maps from flat field autocorrelation measurements to those obtained from the single pixel reset method and find a median difference of 0.113% for SCA 20829. After further diagnosis of this difference, we ascribe it largely to an additional source of cross-talk, the vertical trailing pixel effect, and recommend further work to develop a model for this effect. These results represent a significant step toward calibration of the non-ideal effects in WFIRST detectors.

79 ASTRONOMY AND ASTROPHYSICS↗

Pulse profile modelling of thermonuclear burst oscillations – II. Handling variability

ABSTRACT Pulse profile modelling is a relativistic ray-tracing technique that can be used to infer masses, radii, and geometric parameters of neutron stars. In a previous study, we looked at the performance of this technique when applied to thermonuclear burst oscillations from accreting neutron stars. That study showed that ignoring the variability associated with burst oscillation sources resulted in significant biases in the inferred mass and radius, particularly for the high count rates that are nominally required to obtain meaningful constraints. In this follow-on study, we show that the bias can be mitigated by slicing the bursts into shorter segments where variability can be neglected, and jointly fitting the segments. Using this approach, the systematic uncertainties on the mass and radius are brought within the range of the statistical uncertainty. With about 106 source counts, this yields uncertainties of approximately 10 per cent for both the mass and radius. However, this modelling strategy requires substantial computational resources. We also confirm that the posterior distributions of the mass and radius obtained from multiple bursts of the same source can be merged to produce outcomes comparable to that of a single burst with an equivalent total number of counts.

Astronomy & Astrophysics↗

Fully Convolutional Spatio-Temporal Models for Representation Learning in Plasma Science

We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important fusion energy science issue that must be resolved for advanced tokamak plasmas such as the $25B burning plasma international thermonuclear experimental reactor (ITER) experiment. While a variety of statistical methods have been used to address the problem of tokamak disruption prediction and control, recent approaches based on deep learning have proven particularly compelling. In the present paper, we introduce further improvements to the fusion recurrent neural network (FRNN) software suite, which delivered cross-machine disruption predictions with unprecedented accuracy using a large database of experimental signals from two major tokamaks. Up to now, FRNN was based on the long short-term memory (LSTM) variant of recurrent neural networks to leverage the temporal information in the data. Here, we implement and apply the "temporal convolutional neural network (TCN)" architecture to the time-dependent input signals. Furthermore, this allows highly optimized convolution operations to carry the majority of the computational load of training, thus enabling a reduction in training time, and the effective use of high-performance computing resources for hyperparameter tuning. At the same time, the TCN-based architecture achieves better predictive performance when compared with the LSTM architecture for various tasks for a representative fusion database.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

We Know Where We Don't Know: 3D Bayesian CNNs for Credible Geometric Uncertainty

Deep learning has been successfully applied to the segmentation of 3D Computed Tomography (CT) scans. Establishing the credibility of these segmentations requires uncertainty quantification (UQ) to identify untrustworthy predictions. Recent UQ architectures include Monte Carlo dropout networks (MCDNs), which approximate deep Gaussian processes, and Bayesian neural networks (BNNs), which learn the distribution of the weight space. BNNs are advantageous over MCDNs for UQ but are thought to be computationally infeasible in high dimension, and neither architecture has produced interpretable geometric uncertainty maps. We propose a novel 3D Bayesian convolutional neural network (BCNN), the first deep learning method which generates statistically credible geometric uncertainty maps and scales for application to 3D data. We present experimental results on CT scans of graphite electrodes and laser-welded metals and show that our BCNN outperforms an MCDN in recent uncertainty metrics. The geometric uncertainty maps generated by our BCNN capture distributions of sigmoid values that are interpretable as confidence intervals, critical for applications that rely on deep learning for high-consequence decisions.

97 MATHEMATICS AND COMPUTING↗

Regridding uncertainty for statistical downscaling of solar radiation

Abstract. Initial steps in statistical downscaling involve being able to compare observed data from regional climate models (RCMs). This prediction requires (1) regridding RCM outputs from their native grids and at differing spatial resolutions to a common grid in order to be comparable to observed data and (2) bias correcting RCM data, for example via quantile mapping, for future modeling and analysis. The uncertainty associated with (1) is not always considered for downstream operations in (2). This work examines this uncertainty, which is not often made available to the user of a regridded data product. This analysis is applied to RCM solar radiation data from the NA-CORDEX (North American Coordinated Regional Climate Downscaling Experiment) data archive and observed data from the National Solar Radiation Database housed at the National Renewable Energy Lab. A case study of the mentioned methods over California is presented.

14 SOLAR ENERGY↗