Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

Direct Breakthrough Curve Prediction From Statistics of Heterogeneous Conductivity Fields

In this paper, we present a methodology to predict the shape of solute breakthrough curves in heterogeneous aquifers at early times and/or under high degrees of heterogeneity, both cases in which the classical macrodispersion theory may not be applicable. The methodology relies on the observation that breakthrough curves in heterogeneous media are generally well described by lognormal distributions, and mean breakthrough times can be predicted analytically. The log-variance of solute arrival is thus sufficient to completely specify the breakthrough curves, and this is calibrated as a function of aquifer heterogeneity and dimensionless distance from a source plane by means of Monte Carlo analysis and statistical regression. Using the ensemble of simulated groundwater flow and solute transport realizations employed to calibrate the predictive regression, reliability estimates for the prediction are also developed. Additional theoretical contributions include heuristics for the time until an effective macrodispersion coefficient becomes applicable, and also an expression for its magnitude that applies in highly heterogeneous systems. Finally, it is seen that the results here represent a way to derive continuous time random walk transition distributions from physical considerations rather than from empirical field calibration.

58 GEOSCIENCES↗

Optimizing Piezoelectric Nanocomposites by High‐Throughput Phase‐Field Simulation and Machine Learning

Abstract Piezoelectric nanocomposites with oxide fillers in a polymer matrix combine the merit of high piezoelectric response of the oxides and flexibility as well as biocompatibility of the polymers. Understanding the role of the choice of materials and the filler‐matrix architecture is critical to achieving desired functionality of a composite towards applications in flexible electronics and energy harvest devices. Herein, a high‐throughput phase‐field simulation is conducted to systematically reveal the influence of morphology and spatial orientation of an oxide filler on the piezoelectric, mechanical, and dielectric properties of the piezoelectric nanocomposites. It is discovered that with a constant filler volume fraction, a composite composed of vertical pillars exhibits superior piezoelectric response and electromechanical coupling coefficient as compared to the other geometric configurations. An analytical regression is established from a linear regression‐based machine learning model, which can be employed to predict the performance of nanocomposites filled with oxides with a given set of piezoelectric coefficient, dielectric permittivity, and stiffness. This work not only sheds light on the fundamental mechanism of piezoelectric nanocomposites, but also offers a promising material design strategy for developing high‐performance polymer/inorganic oxide composite‐based wearable electronics.

42 ENGINEERING↗

Machine‐learning‐based predictive control of nonlinear processes. Part II: Computational implementation

Abstract Machine learning is receiving more attention in classical engineering fields, and in particular, recurrent neural networks (RNNs) coupled with ensemble regression tools have demonstrated the capability of modeling nonlinear dynamic processes. In Part I of this two‐article series, the Lyapunov‐based model predictive control (LMPC) method using a single RNN model and an ensemble of RNN models, respectively, was rigorously developed for a general class of nonlinear systems. In the present article, computational implementation issues of this new control method ranging from training of the RNN models, ensemble regression of the RNN models, and parallel computation for accelerating the real‐time model calculations are addressed. Furthermore, a chemical reactor example is used to demonstrate the implementation and effectiveness of these machine‐learning tools in LMPC as well as compare them with standard state‐space model identification tools.

Wu, Zhe↗

Cardiorespiratory fitness and health‐related quality of life in adolescents: A longitudinal analysis from the LabMed Physical Activity Study

Abstract Objective The purpose of this study was to examine the longitudinal associations between cardiorespiratory fitness and health‐related quality of life (HRQoL) in a sample of adolescents, and to determine whether changes in cardiorespiratory fitness were associated with HRQoL over a 2‐year follow‐up. Methods This is a longitudinal analysis with 571 Portuguese adolescents (274 boys and 297 girls) aged 12‐18 years. HRQoL was measured with the Kidscreen‐10 questionnaire; the 20 m shuttle‐run was used to estimate cardiorespiratory fitness; socioeconomic status was assessed with the Family Affluence Scale; and pubertal stage was assessed with Tanner stages. Linear regression and analysis of covariance ( ancova s) were used to examine the associations between cardiorespiratory fitness and HRQoL. Results HRQoL decreased over a 2‐year period both in boys and girls ( P < .05). Moreover, girls at baseline and at follow‐up reported significantly lower HRQoL values than boys (between subjects P < .001). After adjustments for potential confounders, regression analyses showed significant cross‐sectional associations between cardiorespiratory fitness and HRQoL both at baseline ( B = 0.095; P = .023) and at follow‐up (B = 0.090; P = .012). ancova showed that adolescents whose cardiorespiratory fitness decreased over time exhibited lower scores of HRQoL at follow‐up, compared to those with persistent high cardiorespiratory fitness; this held after adjustments for age, sex, socioeconomic status, and pubertal stage. Conclusions Changes in cardiorespiratory fitness during adolescence were associated with HRQoL over a 2‐year period. This study suggests that improving cardiorespiratory fitness could be an important strategy in improving the HRQoL of adolescents.

Evaristo, Olga S.↗

Restrictive spirometry pattern among construction trade workers

Spirometry-based studies of occupational lung disease have mostly focused on obstructive or mixed obstructive/restrictive outcomes. We wanted to determine if restrictive spirometry pattern (RSP) is associated with occupation and increased mortality. Study participants included 18,145 workers with demographic and smoking data and repeatable spirometry. The mortality analysis cohort included 15,445 workers with known vital status and cause of death through December 31, 2016. Stratified analyses explored RSP prevalence by demographic and clinical variables and trade. Log-binomial regression models explored RSP risk factors while controlling for important confounders such as smoking, obesity, and comorbidities. Cox regression models explored mortality risk by spirometry category. Prevalence of RSP was very high (28.6%). Mortality hazard ratios for RSP were 1.50 for all causes, 1.86 for cardiovascular diseases, 2.31 for respiratory diseases, and 1.66 for lung cancer. All construction trades except painters, machinists, and roofers had significantly elevated risk for RSP compared to our internal reference group. RSP was significantly associated with both parenchymal and pleural changes seen by chest X-ray. Construction trade workers are at significantly increased risk for RSP independent of obesity. Individuals with RSP are at increased risk for all-cause mortality as well as mortality attributable to respiratory diseases, cardiovascular diseases, and lung cancer. RSP deserves greater attention in occupational medicine and epidemiology.

60 APPLIED LIFE SCIENCES↗

A nomogram for prediction of stage III/IV gastric cancer outcome after surgery: A multicenter population‐based study

Abstract Most patients with gastric cancer (GC) are first diagnosed at stage III‐IV and surgery resection remains the primary therapeutic modality for these patients. However, clinical staging used for prediction of those patients provides limited information. We collected clinicopathological data and disease‐progression information from 508 patients with stage III‐IV GC at three Chinese hospitals and 1298 patients from the Surveillance, Epidemiology, and End Results database. Based on the stepwise multivariate regression model, we constructed a novel nomogram to predict overall survival (OS). The performance of discrimination for this model was measured using Harrell's concordance index (C‐index) and receiver‐operating characteristic curve (ROC), and was validated using calibration plots. Multivariate Cox regression analyses showed that tumor size, age at diagnosis, N stage, tumor grade, and distant metastases were outstanding independent prognostic factors of stage III‐IV GC. We developed a nomogram based on these five prognostic predictors. In the training set, the C‐index of the nomogram was 0.645 (95% CI: 0.611‐0.679), which was higher than that of the American Joint Committee on Cancer TNM system alone (sixth TNM: 0.544; seventh TNM: 0.575; eighth TNM: 0.568). Similar results were observed in validation cohort. Moreover, calibration blots demonstrated good consistency between the actual and predicted OS probabilities. According to the nomogram, GC individuals could be classified into three groups (low‐, middle‐, and high‐risk) ( P < .001). Our nomogram complements the current staging system for prediction of individual prognosis with stage III‐IV GC, and may be helpful for making individualized treatment decisions.

Gao, Zhiying↗

Development of a prediction model for radiotherapy response among patients with head and neck squamous cell carcinoma based on the tumor immune microenvironment and hypoxia signature

Abstract Introduction The immune system and hypoxia are major factors influencing radiosensitivity in patients with different cancer types. This study aimed at developing a model to predict radiotherapy response in patients with head and neck squamous cell carcinoma (HNSCC) based on the tumor immune microenvironment and hypoxia signature. Materials and Methods We first evaluated the hypoxia status and tumor immune microenvironment in the Cancer Genome Atlas (TCGA) cohort by using transcriptomic data. Differentially expressed genes (DEGs) were identified between the “high immunity and low hypoxia” and “low immunity and high hypoxia” groups and those DEGs significantly associated with disease‐specific survival in the univariate Cox regression analysis were selected as the prognostic DEGs. We selected the immune hypoxia–related genes (IHRGs) by intersecting prognostic DEGs with immune and hypoxia gene sets. We used the IHRGs to train a multivariate Cox regression model in the TCGA cohort, based on which we calculated the IHRG prognostic index (IHRGPI) for each patient and validated its efficacy in predicting radiotherapy response in the Gene Expression Omnibus cohorts. Furthermore, we explored potential mechanisms and effective combinational treatment strategies for different IHRGPI groups. Results Five IHRGs were used to construct the IHRGPI, which was used to dichotomize the cohorts. The patients with lower IHRGPI showed a better radiotherapy response across different cohorts and endpoints, including overall survival, progression‐free survival, and recurrence‐free survival ( p < 0.05). Patients with higher IHRGPI showed greater hypoxia and lesser immune cell infiltration. A lower IHRGPI indicated a better immunotherapy response, while a higher IHRGPI indicated a better chemotherapy response. Conclusions IHRGPI is promising for predicting radiotherapy response and guiding combinational treatment strategies in patients with HNSCC.

Zhu, Guang‐Li↗

Prediction of spout diameter in gas-solid spouted beds using factorial design of experiments approach with the aid of advanced optical fibre probe

In this study, the effects of five operating and design variables (solid density, static bed height, particle diameter, superficial gas velocity, and inlet diameter) on the average spout diameter of a 0.152 m inside diameter gas-solid spouted bed have been assessed experimentally using advanced gas-solid optical fibre probe technique. Statistical analysis of the experimental data including the factorial design of the experiments using MINITAB17 statistical software has been performed to determine the extent of the effects of these variables on the spout diameter as a case study. It was found that all five operating and design variables, except the solid density together with the 2-ways interactions between particles size and inlet diameter, in addition to gas velocity and inlet diameter, have a significant effect on the average spout diameter. Regression analysis was performed to correlate these variables with the average spout diameter for the gas-solid spouted beds. The obtained preliminary regression correlation was able to closely predict the average spout diameter of this work with the mean relative deviation value of 0.7 %.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Speedup of UEDGE Parameter Scans Using Machine-Learning Optimized OpenMP Parallelization and a Continuation Solver

This article presents the OpenMP parallelization of the preconditioning Jacobian assembly and right‐hand side residual evaluation in UEDGE. A continuation algorithm, utilizing the internal NKSOL implicit Jacobian‐Free Newton‐Krylov solver to efficiently scan physical parameters, is also presented. The implemented parallelization reduces the computational time for a benchmark scan run on 32 threads by compared to the serial version when using trained random forest regression models to identify the optimal decomposition of the system of equations. Random forest regression models applied to the UEDGE time‐dependent and continuation solver algorithms did not yield meaningful improvement in computational performance. A benchmark DIII‐D gas injection rate scan in the 0.35–0.75 kA interval, performed on a test cluster using the parallelized code and continuation solver, produced 1066 steady‐state solutions with a 22 s average wall‐clock computational time per steady‐state solution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Allometric relationships for Quercus gambelii and Robinia neomexicana for biomass estimation following disturbance

Abstract In the southwestern USA, increases in size, frequency, and severity of wildfire are driving the conversion of forests to shrub‐dominated ecosystems. Increases in drought extent and severity, coupled with the way that shrub‐dominated systems are perpetuated by high‐severity fire, predisposes these post‐disturbance landscapes to remain in a non‐forest condition. Consequently, understanding the distribution of aboveground biomass in post‐disturbance, shrub‐dominated ecosystems is central to constraining the uncertainty surrounding how these ecosystems interact with light and water to sequester carbon. Here we present allometric regressions for Quercus gambelii (Gambel oak) and Robinia neomexicana (New Mexico locust), two species that dominate post‐fire landscapes in the southwestern USA. Our allometric regressions are designed to be driven by either field plot or high‐resolution remote sensing data, using either shrub area or shrub volume to estimate biomass.

Krofcheck, Dan J.↗

Response surface modeling of CO 2 dynamic storage efficiency factor in high permeability thick sandstones

In order to utilize as much of the pore space for CO 2 storage in high permeability thick saline aquifers, it is vital to investigate the interactions of injected CO 2 with formation brine and rock. In order to quantify the displacement process, we investigate the dynamic storage efficiency factor (DSEF) for saline aquifers where pressure increase is minimal during the injection phase. Dimensionless numbers are derived from basic governing equations, constitutive equations, initial and boundary conditions using the inspection analysis. Then using the Hammersley sequence sampling, 178 numerical experiments are designed, and a compositional reservoir simulator is used to perform these simulations. In the next step, response surface regression analysis is used to establish a relationship between DSEF obtained from the numerical simulations and the corresponding dimensionless numbers. The simulation results show that for the studied conditions the underground dynamics is mostly influenced by the gravity number, followed by effective aspect ratio and dip numbers. The results from the response surface regression analysis are used to develop a correlation, which can be used to estimate the dynamic CO 2 storage capacity of relevant zones. This study provides quantitative measures for the different competing mechanisms involved in underground displacement of fluids in CO 2 geological storage, which can serve as a useful tool during planning phase of storage projects.

02 PETROLEUM↗

Relationship of computed tomography perfusion and positron emission tomography to tumour progression in malignant glioma

Introduction: This study aimed to explore the potential for computed tomography (CT) perfusion and 18-Fluorodeoxyglucose positron emission tomography (FDG-PET) in predicting sites of future progressive tumour on a voxel-by-voxel basis after radiotherapy and chemotherapy. Methods: Ten patients underwent pre-radiotherapy magnetic resonance (MR), FDG-PET and CT perfusion near the end of radiotherapy and repeated post-radiotherapy follow-up MR scans. The relationships between these images and tumour progression were assessed using logistic regression. Cross-validation with receiver operating characteristic (ROC) analysis was used to assess the value of these images in predicting sites of tumour progression. Results: Pre-radiotherapy MR-defined gross tumour; near-end-of-radiotherapy CT-defined enhancing lesion; CT perfusion blood flow (BF), blood volume (BV) and permeability-surface area (PS) product; FDG-PET standard uptake value (SUV); and SUV:BF showed significant associations with tumour progression on follow-up MR imaging (P < 0.0001). The mean sensitivity (±standard deviation), specificity and area under the ROC curve (AUC) of PS were 0.64 ± 0.15, 0.74 ± 0.07 and 0.72 ± 0.12 respectively. This mean AUC was higher than that of the pre-radiotherapy MR-defined gross tumour and near-end-of-radiotherapy CT-defined enhancing lesion (both AUCs = 0.6 ± 0.1, P ≤ 0.03). The multivariate model using BF, BV, PS and SUV had a mean AUC of 0.8 ± 0.1, but this was not significantly higher than the PS only model. Conclusion: PS is the single best predictor of tumour progression when compared to other parameters, but voxel-based prediction based on logistic regression had modest sensitivity and specificity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Assessing robustness of factor ranking for supersaturated designs

Supersaturated designs can potentially be a beneficial tool for efficiently exploring a large number of factors with a moderately sized design. However, because more factors are being considered than there are runs, the stability of the identified factors depends heavily on effect sparsity and the lack of highly influential observations. A helpful tool for the analysis of supersaturated designs is least absolute shrinkage and selection operation (LASSO), which is useful when the effects of many explanatory variables are sparse in a high-dimensional dataset. To understand the impact of individual observations on the selected factors, the LASSO influence plot was created. This work describes an application of this plot and its variants that can be used to identify influential points, increase understanding of the impact of individual observations on model parameters, and the robustness of results in analyses with supersaturated designs. These graphical methods can serve as a complement to other regression diagnostics techniques in the LASSO regression setting.

3-D LASSO influence plots↗

A Corrected Score Function Framework for Modelling Circadian Gene Expression

Many biological processes display oscillatory behaviour based on an approximately 24 h internal timing system specific to each individual. One process of particular interest is gene expression, for which several circadian transcriptomic studies have identified associations between gene expression during a 24 h period and an individual's health. A challenge with analysing data from these studies is that each individual's internal timing system is offset relative to the 24 h day-night cycle, where day–night cycle time is recorded for each collected sample. Laboratory procedures can accurately determine each individual's offset and determine the internal time of sample collection. However, these laboratory procedures are labour-intensive and expensive. Here, in this paper, we propose a corrected score function framework to obtain a regression model of gene expression given internal time when the offset of each individual is too burdensome to determine. A feature of this framework is that it does not require the probability distribution generating offsets to be symmetric with a mean of zero. Simulation studies validate the use of this corrected score function framework for cosinor regression, which is prevalent in circadian transcriptomic studies. Illustrations with data from three circadian transcriptomic studies further demonstrate that the proposed framework consistently mitigates bias relative to using a score function that does not account for this offset.

59 BASIC BIOLOGICAL SCIENCES↗

Field evaluation of semi‐automated moisture estimation from geophysics using machine learning

Geophysical methods can provide three-dimensional (3D), spatially continuous estimates of soil moisture. However, point-to-point comparisons of geophysical properties to measure soil moisture data are frequently unsatisfactory, resulting in geophysics being used for qualitative purposes only. This is because (1) geophysics requires models that relate geophysical signals to soil moisture, (2) geophysical methods have potential uncertainties resulting from smoothing and artifacts introduced from processing and inversion, and (3) results from multiple geophysical methods are not easily combined within a single soil moisture estimation framework. To investigate these potential limitations, an irrigation experiment was performed wherein soil moisture was monitored through time, and several surface geophysical datasets indirectly sensitive to soil moisture were collected before and after irrigation: ground penetrating radar, electrical resistivity tomography (ERT), and frequency domain electromagnetics (FDEM). Data were exported in both raw and processed form, and then snapped to a common 3D grid to facilitate moisture prediction by standard calibration techniques, multivariate regression, and machine learning. A combination of inverted ERT data, raw FDEM, and inverted FDEM data was most informative for predicting soil moisture using a random regression forest model (one-thousand 60/40 training/test cross-validation folds produced root mean squared errors ranging from 0.025–0.046 cm 3 /cm 3 ). This cross-validated model was further supported by a separate evaluation using a test set from a physically separate portion of the study area. Machine learning was conducive to a semi-automated model-selection process that could be used for other sites and datasets to locally improve accuracy.

54 ENVIRONMENTAL SCIENCES↗

Parameter inference from event ensembles and the top-quark mass

One of the key tasks of any particle collider is measurement. In practice, this is often done by fitting data to a simulation, which depends on many parameters. Sometimes, when the effects of varying different parameters are highly correlated, a large ensemble of data may be needed to resolve parameter-space degeneracies. An important example is measuring the top-quark mass, where other physical and unphysical parameters in the simulation must be profiled when fitting the top-quark mass parameter. We compare four different methodologies for top-quark mass measurement: a classical histogram fit similar to one commonly used in experiment augmented by soft-drop jet grooming; a 2D profile likelihood fit with a nuisance parameter; a machine-learning method called DCTR; and a linear regression approach, either using a least-squares fit or with a dense linearly-activated neural network. Despite the fact that individual events are totally uncorrelated, we find that the linear regression methods work most effectively when we input an ensemble of events sorted by mass, rather than training them on individual events. Although all methods provide robust extraction of the top-quark mass parameter, the linear network does marginally best and is remarkably simple. For the top study, we conclude that the Monte-Carlo-based uncertainty on current extractions of the top-quark mass from LHC data can be reduced significantly (by perhaps a factor of 2) using networks trained on sorted event ensembles. More generally, machine learning from ensembles for parameter estimation has broad potential for collider physics measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Temporal covariance structure of multi-spectral phenotypes and their predictive ability for end-of-season traits in maize

Vegetation indices (VIs) derived from multi-spectral imaging (MSI) platforms can be used to study properties of crop canopy, providing non-destructive phenotypes that could be used to better understand growth curves throughout the growing season. To investigate the amount of variation present in several VIs and their relationship with important end-of-season traits, genetic and residual (co)variances for VIs, grain yield and moisture were estimated using data collected from maize hybrid trials. The VIs considered were Normalized Difference Vegetation Index (NDVI), Green NDVI, Red Edge NDVI, Soil-Adjusted Vegetation Index, Enhanced Vegetation Index and simple Ratio of Near Infrared to Red (Red) reflectance. Genetic correlations of VIs with grain yield and moisture were used to fit multi-trait models for prediction of end-of-season traits and evaluated using within site/year cross-validation. To explore alternatives to fitting multiple phenotypes from MSI, random regression models with linear splines were fit using data collected in 2016 and 2017. Heritability estimates ranging from (0.10 to 0.82) were observed, indicating that there exists considerable amount of genetic variation in these VIs. Furthermore, strong genetic and residual correlations of the VIs, NDVI and NDRE, with grain yield and moisture were found. Considerable increases in prediction accuracy were observed from the multi-trait model when using NDVI and NDRE as a secondary trait. Finally, random regression with a linear spline function shows potential to be used as an alternative to mixed models to fit VIs from multiple time points.

59 BASIC BIOLOGICAL SCIENCES↗

The impact of demographic, clinical, genetic, and imaging variables on tau PET status

Purpose: A substantial proportion of amyloid-β (Aβ)+ patients with clinically diagnosed Alzheimer’s disease (AD) dementia and mild cognitive impairment (MCI) are tau PET–negative, while some clinically diagnosed non-AD neurodegenerative disorder (non-AD) patients or cognitively unimpaired (CU) subjects are tau PET–positive. We investigated which demographic, clinical, genetic, and imaging variables contributed to tau PET status. Methods: We included 2338 participants (430 Aβ+ AD dementia, 381 Aβ+ MCI, 370 non-AD, and 1157 CU) who underwent [ 18 F]flortaucipir ( n = 1944) or [ 18 F]RO948 ( n = 719) PET. Tau PET positivity was determined in the entorhinal cortex, temporal meta-ROI, and Braak V-VI regions using previously established cutoffs. We performed bivariate binary logistic regression models with tau PET status (positive/negative) as dependent variable and age, sex, APOE ε4, Aβ status (only in CU and non-AD analyses), MMSE, global white matter hyperintensities (WMH), and AD-signature cortical thickness as predictors. Additionally, we performed multivariable binary logistic regression models to account for all other predictors in the same model. Results: Tau PET positivity in the temporal meta-ROI was 88.6% for AD dementia, 46.5% for MCI, 9.5% for non-AD, and 6.1% for CU. Among Aβ+ participants with AD dementia and MCI, lower age, MMSE score, and AD-signature cortical thickness showed the strongest associations with tau PET positivity. In non-AD and CU participants, presence of Aβ was the strongest predictor of a positive tau PET scan. Conclusion: We identified several demographic, clinical, and neurobiological factors that are important to explain the variance in tau PET retention observed across the AD pathological continuum, non-AD neurodegenerative disorders, and cognitively unimpaired persons.

60 APPLIED LIFE SCIENCES↗