Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “random variables”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

A necessary condition for the emergence of diffusion instability in media with nonclassical diffusion

A necessary condition is derived for the emergence of diffusion instability in media in which diffusion does not obey classical Fick laws. The equations derived by Yadav and Horsthemke [Phys. Rev. E 74, 066118 (2006)] using the continuous-time random walk model are employed as equations simulating reaction-diffusion processes. The waiting-time distribution function is represented by the sum of a finite number of exponents. It is shown that passage to the diffusion limit in the time variable is an incorrect operation if it is used to analyze diffusion instability in media with a distribution function that differs from the Poisson distribution function.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

SOLAR CYCLE VARIABILITY AND SURFACE DIFFERENTIAL ROTATION FROM Ca II K-LINE TIME SERIES DATA

Analysis of over 36 yr of time series data from the NSO/AFRL/Sac Peak K-line monitoring program elucidates 5 components of the variation of the 7 measured chromospheric parameters: (a) the solar cycle (period {approx} 11 yr), (b) quasi-periodic variations (periods {approx} 100 days), (c) a broadband stochastic process (wide range of periods), (d) rotational modulation, and (e) random observational errors, independent of (a)-(d). Correlation and power spectrum analyses elucidate periodic and aperiodic variation of these parameters. Time-frequency analysis illuminates periodic and quasi-periodic signals, details of frequency modulation due to differential rotation, and in particular elucidates the rather complex harmonic structure (a) and (b) at timescales in the range {approx}0.1-10 yr. These results using only full-disk data suggest that similar analyses will be useful for detecting and characterizing differential rotation in stars from stellar light curves such as those being produced by NASA's Kepler observatory. Component (c) consists of variations over a range of timescales, in the manner of a 1/f random process with a power-law slope index that varies in a systematic way. A time-dependent Wilson-Bappu effect appears to be present in the solar cycle variations (a), but not in the more rapid variations of the stochastic process (c). Component (d) characterizes differential rotation of the active regions. Component (e) is of course not characteristic of solar variability, but the fact that the observational errors are quite small greatly facilitates the analysis of the other components. The data analyzed in this paper can be found at the National Solar Observatory Web site http://nsosp.nso.edu/cak{sub m}on/, or by file transfer protocol at ftp://ftp.nso.edu/idl/cak.parameters.

79 ASTRONOMY AND ASTROPHYSICS↗

A review of imputation strategies for isobaric labeling-based shotgun proteomics

The throughput efficiency and increased depth of coverage provided by isobaric-labeled proteomics measurements have led to increased usage of these techniques. However, the structure of missing data is uniquely different than unlabeled studies. In this review, we compare the efficacy of nine imputation methods on a CPTAC proteomics iTRAQ dataset. Imputation methods were evaluated with regard to accuracy, variability, statistical hypothesis test inference and run time over datasets consisting of varying number of iTRAQ plexes and percentages of missing data. In general, expectation maximization and random forest imputation methods yielded the best performances, and constant-based methods performed poorly consistently across all dataset sizes and percentages of missing values. For datasets with small sample sizes and higher percentages of missing data, results indicate that statistical inference with no imputation may be preferable. Based on the findings in this review, there are core imputation methods that perform higher for isobaric-labeled proteomics data, but great care and consideration as to whether imputation should be used should be given for datasets comprised of a small number of samples, as well as to factors such as computational time and reproducibility of imputation values.

Bramer, Lisa M.↗

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗

ROM-Based Surrogate Systems Modeling of EBR-II

We report the System Analysis Module (SAM), developed and maintained by Argonne National Laboratory, is designed to provide whole-plant transient safety analysis capabilities for a number of advanced non-light water reactors, including sodium-cooled fast reactor (SFR), lead-cooled fast reactor (LFR), and molten salt reactor (MSR)/fluoride-salt-cooled high-temperature reactor (FHR) designs. SAM is primarily constructed as a systems-level analysis tool, with the potential to incorporate reduced order models from three-dimensional computational fluid dynamics (CFD) simulations to improve characterization of complex, multidimensional physics. It is recognized that the computational expense associated with CFD can be intractable for various engineering analyses, such as uncertainty quantification, inference, and design optimization. This paper explores the reducibility of a SAM model using recent advances in randomized linear algebra techniques, which attempt to find recurring patterns in the various realizations generated by a model after randomly perturbing all its input parameters. The reduction is described in terms of fewer degrees of freedom (DOFs), referred to as the active DOFs, for the model variables such as input model parameters and model responses. The results indicate that there is significant room for additional reduction that may be leveraged for additional computational gains when employing SAM for engineering-intensive analyses that require repeated model executions. Different from physics-based reduction approaches, the proposed approach allows one to estimate upper bounds on the reduction errors, which are rigorously developed in this work. Finally, different methods for surrogate model construction, such as regression and neural network-based training, are employed to correlate the input and output active DOFs, which are related back to the original variables using matrix-based linear transformations.

42 ENGINEERING↗

Quantification and prediction of error in MIMO tests

Dynamic testing of systems is most realistic of real-world conditions when multiple input and multiple output (MIMO) techniques are used. To replicate measured environmental conditions, a series of desired outputs (responses) on the system must be realized by inverting the frequency response functions (FRF) matrix for input estimation. System identification is dependent on the number of inputs and outputs, which affect the type of solutions. In input estimation, the auto spectra of the determined inputs are affected by both the auto spectra and cross spectra of the desired outputs. This research evaluates errors and investigates two sources in an experimental setting. The first significant error source is test-to-test variability in FRFs from system identification tests, quantified by magnitude variability from long-duration tests. The second significant error source is the realization of time histories from frequency domain inputs. The spectral content of the realized random process deviates from the desired content and is also quantified. The structure is a linear three-story frame fixed at the base; two inputs are provided uniaxially with the use of suspended electrodynamic shakers. The proposed model for error sources was found to be effective in predicting errors in a SISO (single-input single-output) and a square (2-input 2-output) MIMO test.

Yousef, Odey↗

Model-Form Epistemic Uncertainty Quantification for Modeling with Differential Equations: Application to Epidemiology

Modeling real-world phenomena to any degree of accuracy is a challenge that the scientific research community has navigated since its foundation. Lack of information and limited computational and observational resources necessitate modeling assumptions which, when invalid, lead to model-form error (MFE). The work reported herein explored a novel method to represent model-form uncertainty (MFU) that combines Bayesian statistics with the emerging field of universal differential equations (UDEs). The fundamental principle behind UDEs is simple: use known equational forms that govern a dynamical system when you have them; then incorporate data-driven approaches – in this case neural networks (NNs) – embedded within the governing equations to learn the interacting terms that were underrepresented. Utilizing epidemiology as our motivating exemplar, this report will highlight the challenges of modeling novel infectious diseases while introducing ways to incorporate NN approximations to MFE. Prior to embarking on a Bayesian calibration, we first explored methods to augment the standard (non-Bayesian) UDE training procedure to account for uncertainty and increase robustness of training. In addition, it is often the case that uncertainty in observations is significant; this may be due to randomness or lack of precision in the measurement process. This uncertainty typically manifests as “noisy” observations which deviate from a true underlying signal. To account for such variability, the NN approximation to MFE is endowed with a probabilistic representation and is updated using available observational data in a Bayesian framework. By representing the MFU explicitly and deploying an embedded, data-driven model, this approach enables an agile, expressive, and interpretable method for representing MFU. In this report we will provide evidence that Bayesian UDEs show promise as a novel framework for any science-based, data-driven MFU representation; while emphasizing that significant advances must be made in the calibration of Bayesian NNs to ensure a robust calibration procedure.

97 MATHEMATICS AND COMPUTING↗

Investigation of the performance characteristics of Doppler radar technique for aircraft collision hazard warning, phase 3

System studies, equipment simulation, hardware development and flight tests which were conducted during the development of aircraft collision hazard warning system are discussed. The system uses a cooperative, continuous wave Doppler radar principle with pseudo-random frequency modulation. The report presents a description of the system operation and deals at length with the use of pseudo-random coding techniques. In addition, the use of mathematical modeling and computer simulation to determine the alarm statistics and system saturation characteristics in terminal area traffic of variable density is discussed.

Source record↗

Foreshock Langmuir Waves for Unusually Constant Solar Wind Conditions: Data and Implications for Foreshock Structure

Plasma wave data are compared with ISEE 1's position in the electron foreshock for an interval with unusually constant (but otherwise typical) solar wind magnetic field and plasma characteristics. For this period, temporal variations in the wave characteristics can be confidently separated from sweeping of the spatially varying foreshock back and forth across the spacecraft. The spacecraft's location, particularly the coordinate D(sub f) downstream from the foreshock boundary (often termed DIFF), is calculated by using three shock models and the observed solar wind magnetometer and plasma data. Scatterplots of the wave field versus D(sub f) are used to constrain viable shock models, to investigate the observed scatter in the wave fields at constant D(sub f), and to test the theoretical predictions of linear instability theory. The scatterplots confirm the abrupt onset of the foreshock waves near the upstream boundary, the narrow width in D(sub f) of the region with high fields, and the relatively slow falloff of the fields at large D(sub f), as seen in earlier studies, but with much smaller statistical scatter. The plots also show an offset of the high-field region from the foreshock boundary. It is shown that an adaptive, time-varying shock model with no free parameters, determined by the observed solar wind data and published shock crossings, is viable but that two alternative models are not. Foreshock wave studies can therefore remotely constrain the bow shock's location. The observed scatter in wave field at constant D(sub f) is shown to be real and to correspond to real temporal variations, not to unresolved changes in D(sub f). By comparing the wave data with a linear instability theory based on a published model for the electron beam it is found that the theory can account qualitatively and semiquantitatively for the abrupt onset of the waves near D(sub f) = 0, for the narrow width and offset of the high-field region, and for the decrease in wave intensity with increasing D(sub f). Quantitative differences between observations and theory remain, including large overprediction of the wave fields and the slower than predicted falloff at large D(sub f) of the wave fields. These differences, as well as the unresolved issue of the electron beam speed in the high-field region of the foreshock, are discussed. The intrinsic temporal variability of the wave fields, as well as their overprediction based on homogeneous plasma theory, are indicative of stochastic growth physics, which causes wave growth to be random and varying in sign, rather than secular.

Cairns, Iver H.↗

Use of Uncertainty in Modeling DFLAW Treatment at Hanford - 17115

Average or mean is understood by most; standard deviation (SD) is understood by few. Certainty is easy to model; uncertainty is not. The flowsheet simulation, described in this paper, placed uncertainties in the G2 model of the Hanford Tank Waste Treatment and Immobilization Plant's (WTP) Direct Feed Low-Activity Waste (DFLAW) process for performance and sensitivity evaluations. G2 is a dynamic material balance model that starts and proceeds with operating logic until all the feed is processed. Dynamic material balance is achieved by tracking the flows, storage, and change of all materials within the plant as time increments. Processing equipment and limitations of the flowsheet are modeled (e.g., equipment types, piping, volumes, flowrates, efficiencies, and physical and chemical environments that impact separations, phase equilibriums, and chemical reactions). Operating logic represents the rules and strategies of a running plant. The G2 model simulated both certainty and uncertainty scenarios for comparison purposes. For the uncertainty scenarios, process decisions were made using presumed values to simulate various operational measurement errors and process variabilities. Presumed means that the known G2 values are adjusted to replicate measurement errors and variabilities. These include: 1) volume measurement, 2) sample analysis, 3) melter decontamination factor (DF), 4) glass former weighing, and 5) glass former composition variations. The errors were randomly generated in accordance with SD values of measurement devices, laboratory methods, and glass former composition ranges. The G2 model runs give insight on the DFLAW process' controllability and the expected range of glass properties. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Uncertainty quantification for generalized Langevin dynamics

Here, we present efficient finite difference estimators for goal-oriented sensitivity indices with applications to the generalized Langevin equation (GLE). In particular, we apply these estimators to analyze an extended variable formulation of the GLE where other well known sensitivity analysis techniques such as the likelihood ratio method are not applicable to key parameters of interest. These easily implemented estimators are formed by coupling the nominal and perturbed dynamics appearing in the finite difference through a common driving noise or common random path. After developing a general framework for variance reduction via coupling, we demonstrate the optimality of the common random path coupling in the sense that it produces a minimal variance surrogate for the difference estimator relative to sampling dynamics driven by independent paths. In order to build intuition for the common random path coupling, we evaluate the efficiency of the proposed estimators for a comprehensive set of examples of interest in particle dynamics. These reduced variance difference estimators are also a useful tool for performing global sensitivity analysis and for investigating non-local perturbations of parameters, such as increasing the number of Prony modes active in an extended variable GLE.

97 MATHEMATICS AND COMPUTING↗

Long-Term Variability of Soil Moisture in the Southern Sierra: Measurement and Prediction

Using 6 yr (Water Year [WY] 2009–WY 2014) of hourly in situ measurements from a spatially distributed water-balance cluster, we quantified the long-term accuracy of an algorithm used to predict spatial patterns of depth-integrated soil-water storage within the rain–snow transition zone of the southern Sierra Nevada. The algorithm—the multivariate, non-parametric regression-tree estimator Random Forest—was used to predict soil-water storage based on a combination of attributes at each instrument cluster (soil texture, topographic wetness index, elevation, northness, and canopy cover). Out-of-bag R 2 (similar to cross-validation for Random Forest) was used to quantify the accuracy of the estimator for unobserved data. Accuracy was consistently high during the wet-up, snow-cover, and early recession periods of average and wet years. The accuracy declined at the end of a 3-yr dry period, and the relative rank of the independent variables in the model shifted. Soil texture was the highest-ranked independent variable across all years, followed by elevation and northness. Topographic wetness increased in importance during dry periods. Northness exhibited high importance during the wet-up and early recession periods of most water years. As a result, during dry years, the importance of elevation declined. In dry years, notable differences in soil-water storage at each depth include lower-than-average storage in the deeper regolith at the beginning of the water year and lower storage in near-surface layers during the winter resulting from transient snow cover.

54 ENVIRONMENTAL SCIENCES↗

Random Positional Variation Among the Skull, Mandible, and Cervical Spine With Treatment Progression During Head-and-Neck Radiotherapy

Purpose: With 54{sup o} of freedom from the skull to mandible to C7, ensuring adequate immobilization for head-and-neck radiotherapy (RT) is complex. We quantify variations in skull, mandible, and cervical spine movement between RT sessions. Methods and Materials: Twenty-three sequential head-and-neck RT patients underwent serial computed tomography. Patients underwent planned rescanning at 11, 22, and 33 fractions for a total of 93 scans. Coordinates of multiple bony elements of the skull, mandible, and cervical spine were used to calculate rotational and translational changes of bony anatomy compared with the original planning scan. Results: Mean translational and rotational variations on rescanning were negligible, but showed a wide range. Changes in scoliosis and lordosis of the cervical spine between fractions showed similar variability. There was no correlation between positional variation and fraction number and no strong correlation with weight loss or skin separation. Semi-independent rotational and translation movement of the skull in relation to the lower cervical spine was shown. Positioning variability measured by means of vector displacement was largest in the mandible and lower cervical spine. Conclusions: Although only small overall variations in position between head-and-neck RT sessions exist on average, there is significant random variation in patient positioning of the skull, mandible, and cervical spine elements. Such variation is accentuated in the mandible and lower cervical spine. These random semirigid variations in positioning of the skull and spine point to a need for improved immobilization and/or confirmation of patient positioning in RT of the head and neck.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Process Variability Effects on Tensile Response in Injection Molded, Fluorinated Thermoplastics

The mechanical properties of fluorinated thermoplastics (i.e., tensile strength and elongation) can vary with changes in injection molding processing parameters. Four fluoropolymers are examined: poly(vinylidene fluoride) (PVDF) and random poly(vinylidene fluoride-co-chlorotrifluoroethylene) (PVDF-CTFE) with three CTFE concentrations. Dog bones were manufactured with various cylinder dwell times and mold cooling times to assess the manufacturing sensitivity to the tensile response. Dwell and cooling times increasingly impact mechanical performance as CTFE concentration increases. Specimens exhibit higher tensile strength as a function of injection order. The first injected specimen exhibits the lowest tensile strength and highest elongation in all copolymers. This trend becomes more pronounced among fluoropolymers with higher CTFE concentration and lower weight-averaged molecular weight. Parallel plate rheology was used to obtain the zero-shear viscosity as a function of material type, process, and injection order. We found that in the copolymers, the first injected sample exhibited a lower zero-shear viscosity than the next, which indicates a lower molecular weight in the first injected specimen. This phenomenon was not presented for the PVDF homopolymer. Copolymer mechanical uncertainties are hypothesized to result from the shorter molecular weight chains extruding out of the specimens' sides as a flash due to higher mobility with CTFE segments.

36 MATERIALS SCIENCE↗

Process Variability Effects on Tensile Response in Injection Molded, Fluorinated Thermoplastics

The mechanical properties of fluorinated thermoplastics (i.e., tensile strength and elongation) can vary with changes in injection molding processing parameters. Four fluoropolymers are examined: poly(vinylidene fluoride) (PVDF) and random poly(vinylidene fluoride-co-chlorotrifluoroethylene) (PVDF-CTFE) with three CTFE concentrations. Dog bones were manufactured with various cylinder dwell times and mold cooling times to assess the manufacturing sensitivity to the tensile response. Dwell and cooling times increasingly impact mechanical performance as CTFE concentration increases. Specimens exhibit higher tensile strength as a function of injection order. The first injected specimen exhibits the lowest tensile strength and highest elongation in all copolymers. This trend becomes more pronounced among fluoropolymers with higher CTFE concentration and lower weight-averaged molecular weight. Parallel plate rheology was used to obtain the zero-shear viscosity as a function of material type, process, and injection order. We found that in the copolymers, the first injected sample exhibited a lower zero-shear viscosity than the next, which indicates a lower molecular weight in the first injected specimen. This phenomenon was not present for the PVDF homopolymer. Copolymer mechanical uncertainties are hypothesized to result from the shorter molecular weight chains extruding out of the specimens’ sides as a flash due to higher mobility with CTFE segments.

36 MATERIALS SCIENCE↗

Deep Learning Classification of Cheatgrass Invasion in the Western United States Using Biophysical and Remote Sensing Data

Cheatgrass (Bromus tectorum) invasion is driving an emerging cycle of increased fire frequency and irreversible loss of wildlife habitat in the western US. Yet, detailed spatial information about its occurrence is still lacking for much of its presumably invaded range. Deep learning (DL) has demonstrated success for remote sensing applications but is less tested on more challenging tasks like identifying biological invasions using sub-pixel phenomena. We compare two DL architectures and the more conventional Random Forest and Logistic Regression methods to improve upon a previous effort to map cheatgrass occurrence at >2% canopy cover. High-dimensional sets of biophysical, MODIS, and Landsat-7 ETM+ predictor variables are also compared to evaluate different multi-modal data strategies. All model configurations improved results relative to the case study and accuracy generally improved by combining data from both sensors with biophysical data. Cheatgrass occurrence is mapped at 30 m ground sample distance (GSD) with an estimated 78.1% accuracy, compared to 250-m GSD and 71% map accuracy in the case study. Furthermore, DL is shown to be competitive with well-established machine learning methods in a limited data regime, suggesting it can be an effective tool for mapping biological invasions and more broadly for multi-modal remote sensing applications.

54 ENVIRONMENTAL SCIENCES↗

A solution of the Gross-Witten matrix model by nonlinear random processes

We illustrate the stochastic method for solving the Schwinger-Dyson equations in large-N quantum field theories described in ArXiv:1009.4033 on the example of the Gross-Witten unitary matrix model. In the strong-coupling limit, this method can be applied directly, while in the weak-coupling limit we change the variables from compact to noncompact ones in order to cast the Schwinger-Dyson equations in the stochastic form. This leads to a new action with an infinite number of higher-order interaction terms. Nevertheless, such an action can be efficiently handled. This suggests the way to apply the method of ArXiv:1009.4033 to field theories with U(N) field variables as well as to effective field theories in the large-N limit.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

HIV Promoter Integration Site Primarily Modulates Transcriptional Burst Size Rather Than Frequency

Mammalian gene expression patterns, and their variability across populations of cells, are regulated by factors specific to each gene in concert with its surrounding cellular and genomic environment. Lentiviruses such as HIV integrate their genomes into semi-random genomic locations in the cells they infect, and the resulting viral gene expression provides a natural system to dissect the contributions of genomic environment to transcriptional regulation. Previously, we showed that expression heterogeneity and its modulation by specific host factors at HIV integration sites are key determinants of infected-cell fate and a possible source of latent infections. Here, we assess the integration context dependence of expression heterogeneity from diverse single integrations of a HIV-promoter/GFP-reporter cassette in Jurkat T-cells. Systematically fitting a stochastic model of gene expression to our data reveals an underlying transcriptional dynamic, by which multiple transcripts are produced during short, infrequent bursts, that quantitatively accounts for the wide, highly skewed protein expression distributions observed in each of our clonal cell populations. Interestingly, we find that the size of transcriptional bursts is the primary systematic covariate over integration sites, varying from a few to tens of transcripts across integration sites, and correlating well with mean expression. In contrast, burst frequencies are scattered about a typical value of several per cell-division time and demonstrate little correlation with the clonal means. This pattern of modulation generates consistently noisy distributions over the sampled integration positions, with large expression variability relative to the mean maintained even for the most productive integrations, and could contribute to specifying heterogeneous, integration-site-dependent viral production patterns in HIV-infected cells. Genomic environment thus emerges as a significant control parameter for gene expression variation that may contribute to structuring mammalian genomes, as well as be exploited for survival by integrating viruses.

59 BASIC BIOLOGICAL SCIENCES↗