Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Robust regression on noisy data for fusion scaling laws

We introduce the method of geodesic least squares (GLS) regression for estimating fusion scaling laws. Based on straightforward principles, the method is easily implemented, yet it clearly outperforms established regression techniques, particularly in cases of significant uncertainty on both the response and predictor variables. We apply GLS for estimating the scaling of the L-H power threshold, resulting in estimates for ITER that are somewhat higher than predicted earlier.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-E-J-137: Incorporating Tumor Regression Into Robust Plan Optimization for Head and Neck Radiotherapy

Purpose: To develop a robust planning paradigm which incorporates a tumor regression model into the optimization process to ensure tumor coverage in head and neck radiotherapy. Methods: Simulation and weekly MR images were acquired for a group of head and neck patients to characterize tumor regression during radiotherapy. For each patient, the tumor and parotid glands were segmented on the MR images and the weekly changes were formulated with an affine transformation, where morphological shrinkage and positional changes are modeled by a scaling factor, and centroid shifts, respectively. The tumor and parotid contours were also transferred to the planning CT via rigid registration. To perform the robust planning, weekly predicted PTV and parotid structures were created by transforming the corresponding simulation structures according to the weekly affine transformation matrix averaged over patients other than him/herself. Next, robust PTV and parotid structures were generated as the union of the simulation and weekly prediction contours. In the subsequent robust optimization process, attainment of the clinical dose objectives was required for the robust PTV and parotids, as well as other organs at risk (OAR). The resulting robust plans were evaluated by looking at the weekly and total accumulated dose to the actual weekly PTV and parotid structures. The robust plan was compared with the original plan based on the planning CT to determine its potential clinical benefit. Results: For four patients, the average weekly change to tumor volume and position was −4% and 1.2 mm laterally-posteriorly. Due to these temporal changes, the robust plans resulted in an accumulated PTV D95 that was, on average, 2.7 Gy higher than the plan created from the planning CT. OAR doses were similar. Conclusion: Integration of a tumor regression model into target delineation and plan robust optimization is feasible and may yield improved tumor coverage. Part of this research is supported by Varian Medical System.

60 APPLIED LIFE SCIENCES↗

Adaptive Online Multivariate Signal Extraction With Locally Weighted Robust Polynomial Regression

High-frequency, multivariate data collected in real-time and used to control or make decisions regarding a process’ operation often contain some noise and outliers. Thus, a method to extract the signal is needed in order to reduce the number and magnitude of control-based adjustments that are implemented. Such a method must be (i) online, depending only on past and current observations; (ii) fast, producing a smooth value more quickly than the measurement frequency; (iii) robust, ignoring brief bursts of erroneously measured values; (iv) multivariate, ignoring observations that are jointly unusual; (v) adaptive, adjusting to periods of rapid fluctuation in the signal versus periods of stability; and (vi) purely data-driven, not incorporating any information about the process from which the data are collected. Most existing methods are only able to address a subset of these six features. Furthermore, we also require the method to be nonlinear, providing a local nonlinear estimate of the signal. In this work, we propose a novel, real-time signal extraction method based on a local, robust polynomial fit. We demonstrate the performance of our method compared to a state-of-the-art competitor through simulation. For illustration, the methodology is applied to data collected from a reverse osmosis water treatment process.

97 MATHEMATICS AND COMPUTING↗

A Selective Overview and Comparison of Robust Mixture Regression Estimators

Summary Mixture regression models have been widely used in business, marketing and social sciences to model mixed regression relationships arising from a clustered and thus heterogeneous population. The unknown mixture regression parameters are usually estimated by maximum likelihood estimators using the expectation–maximisation algorithm based on the normality assumption of component error density. However, it is well known that the normality‐based maximum likelihood estimation is very sensitive to outliers or heavy‐tailed error distributions. This paper aims to give a selective overview of the recently proposed robust mixture regression methods and compare their performance using simulation studies.

Yu, Chun↗

Generalized Bayesian MARS: Tools for Stochastic Computer Model Emulation

The multivariate adaptive regression spline (MARS) approach of Friedman and its Bayesian counterpart are effective approaches for the emulation of computer models. The traditional assumption of Gaussian errors limits the usefulness of MARS, and many popular alternatives, when dealing with stochastic computer models. Here, we propose a generalized Bayesian MARS (GBMARS) framework which admits the broad class of generalized hyperbolic distributions as the induced likelihood function. This allows us to develop tools for the emulation of stochastic simulators which are parsimonious, scalable, and interpretable and require minimal tuning, while providing powerful predictive and uncertainty quantification capabilities. GBMARS is capable of robust regression with t distributions, quantile regression with asymmetric Laplace distributions, and a general form of “Normal-Wald” regression in which the shape of the error distribution and the structure of the mean function are learned simultaneously. We demonstrate the effectiveness of GBMARS on various stochastic computer models, and we show that it compares favorably to several popular alternatives.

97 MATHEMATICS AND COMPUTING↗

PV Degradation Methodology Comparison – A Basis for a Standard

What is the best method to determine long-term PV system performance and degradation rates? Ideally, one universally applicable methodology would be desirable so that a single number could be derived. However, data sets vary in their attributes and evidence is presented that defining two methodologies may be preferable. Monte Carlo simulations of artificial performance data allowed investigation of different methodologies and their respective confidence intervals. Tradeoffs between different approaches were delineated, elucidating as to why two separate approaches may need to be included in a standard. Regression approaches tend to be preferable when data sets are less contaminated by seasonality, noise and occurrence of outliers although robust regression can significantly improve the accuracy when outliers are present. In the presence of outliers, marked seasonality, or strong soiling events, year-on-year approaches tend to outperform regression approaches.

14 SOLAR ENERGY↗

The updated ITPA global H-mode confinement database: description and analysis

The multi-machine ITPA Global H-mode Confinement Database has been upgraded with new data from JET with the ITER-like wall and ASDEX Upgrade with the full tungsten wall. This paper describes the new database and presents results of regression analysis to estimate the global energy confinement scaling in H-mode plasmas using a standard power law. Various subsets of the database are considered, focusing on type of wall and divertor materials, confinement regime (all H-modes, ELMy H or ELM-free) and ITER-like constraints. Apart from ordinary least squares, two other, robust regression techniques are applied, which take into account uncertainty on all variables. Regression on data from individual devices shows that, generally, the confinement dependence on density and the power degradation are weakest in the fully metallic devices. Using the multi-machine scalings, predictions are made of the confinement time in a standard ELMy H-mode scenario in ITER. The uncertainty on the scaling parameters is discussed with a view to practically useful error bars on the parameters and predictions. One of the derived scalings for ELMy H-modes on an ITER-like subset is studied in particular and compared to the IPB98(y,2) confinement scaling in engineering and dimensionless form. Transformation of this new scaling from engineering variables to dimensionless quantities is shown to result in large error bars on the dimensionless scaling. Regression analysis in the space of dimensionless variables is therefore proposed as an alternative, yielding acceptable estimates for the dimensionless scaling. The new scaling, which is dimensionally correct within the uncertainties, suggests that some dependencies of confinement in the multi- machine database can be reconciled with parameter scans in individual devices. This includes vanishingly small dependence of confinement on line-averaged density and normalized plasma pressure (β), as well as a noticeable, positive dependence on effective atomic mass and plasma triangularity. Extrapolation of this scaling to ITER yields a somewhat lower confinement time compared to the IPB98(y, 2) prediction, possibly related to the considerably weaker dependence on major radius in the new scaling (slightly above linear). Further studies are needed to compare more flexible regression models with the power law used here. In addition, data from more devices concerning possible ‘hidden variables’ could help to determine their influence on confinement, while adding data in sparsely populated areas of the parameter space may contribute to further disentangling some of the global confinement dependencies in tokamak plasmas.

Database↗

Comparison of personal radio frequency electromagnetic field exposure in different urban areas across Europe

Background: Only limited data are available on personal radio frequency electromagnetic field (RF-EMF) exposure in everyday life. Several European countries performed measurement studies in this area of research. However, a comparison between countries regarding typical exposure levels is lacking. Objectives: To compare for the first time mean exposure levels and contributions of different sources in specific environments between different European countries. Methods: In five countries (Belgium, Switzerland, Slovenia, Hungary, and the Netherlands), measurement studies were performed using the same personal exposure meters. The pooled data were analyzed using the robust regression on order statistics (ROS) method in order to allow for data below the detection limit. Mean exposure levels were compared between different microenvironments such as homes, public transports, or outdoor. Results: Exposure levels were of the same order of magnitude in all countries and well below the international exposure limits. In all countries except for the Netherlands, the highest total exposure was measured in transport vehicles (trains, car, and busses), mainly due to radiation from mobile phone handsets (up to 97%). Exposure levels were in general lower in private houses or flats than in offices and outdoors. At home, contributions from various sources were quite different between countries. Conclusions: Highest total personal RF-EMF exposure was measured inside transport vehicles and was well below international exposure limits. This is mainly due to mobile phone handsets. Mobile telecommunication can be considered to be the main contribution to total RF-EMF exposure in all microenvironments.

60 APPLIED LIFE SCIENCES↗

Dynamic heterogeneity of DNA methylation and hydroxymethylation in embryonic stem cell populations captured by single-cell 3D high-content analysis

Cell-surface markers and transcription factors are being used in the assessment of stem cell fate and therapeutic safety, but display significant variability in stem cell cultures. We assessed nuclear patterns of 5-hydroxymethylcytosine (5hmC, associated with pluripotency), a second important epigenetic mark, and its combination with 5-methylcytosine (5mC, associated with differentiation), also in comparison to more established markers of pluripotency (Oct-4) and endodermal differentiation (FoxA2, Sox17) in mouse embryonic stem cells (mESC) over a 10-day differentiation course in vitro: by means of confocal and super-resolution imaging together with 3D high-content analysis, an essential tool in single-cell screening. In summary: 1) We did not measure any significant correlation of putative markers with global 5mC or 5hmC. 2) While average Oct-4 levels stagnated on a cell-population base (0.015 lnIU/day), Sox17 and FoxA2 increased 22-fold and 3-fold faster, respectively (Sox17: 0.343 lnIU/day; FoxA2: 0.046 lnIU/day). In comparison, global DNA methylation levels increased 4-fold faster (0.068 lnIU/day), and global hydroxymethylation declined at 0.046 lnIU/day, both with a better explanation of the temporal profile. 3) This progression was concomitant with the occurrence of distinct nuclear codistribution patterns that represented a heterogeneous spectrum of states in differentiation; converging to three major coexisting 5mC/5hmC phenotypes by day 10: 5hmC{sup +}/5mC{sup −}, 5hmC{sup +}/5mC{sup +}, and 5hmC{sup −}/5mC{sup +} cells. 4) Using optical nanoscopy we could delineate the respective topologies of 5mC/5hmC colocalization in subregions of nuclear DNA: in the majority of 5hmC{sup +}/5mC{sup +} cells 5hmC and 5mC predominantly occupied mutually exclusive territories resembling euchromatic and heterochromatic regions, respectively. Simultaneously, in a smaller subset of cells we observed a tighter colocalization of the two cytosine variants, presumably delineating chromatin domains in remodeling. We conclude that 1) 5mC emerges as the most differential marker in our model system. 2) However, the combined enrollment of the two DNA modifications provided higher-definition screening and lead to the identification of cell subpopulations based on differential 5hmC/5mC phenotypes corresponding to different 5hmC/5mC ratios. The results encourage: a) assessing the regenerative potential of early-endodermal cells enriched for the three DNA methylation/hydroxymethylation categories, and b) exploring the universality of this type of epigenetic phenotyping across other lineage-specific differentiations. - Highlights: • First reported single-molecule super-resolution 3D-visualization of 5mC/5hmC sites in cells. • Identification of cells with differential 5mC/5hmC nuclear codistribution phenotypes. • Application of principle component and robust regression analyses for evaluation of 3D high-content-screening data. • Global 5mC constitutes a highly differential spatiotemporal in situ marker in early endodermal cell differentiation.

60 APPLIED LIFE SCIENCES↗

Advanced Signal Decomposition Analysis and Anomaly Detection in Photovoltaic Systems

With the rapid expansion of large-scale photovoltaic (PV) plants, it is paramount for solar stakeholders to understand the reliability and efficiency of their plants to inform maintenance decisions, increase production, and understand the design factors that impact performance. Diagnosing underperformance in PV plants is challenging due to the relatively few monitoring points with respect to the large geographic footprint of the plant. This work introduces a cutting-edge method that transforms the analysis and management of key factors influencing PV plant performance, including performance loss rate (PLR), recoverable soiling, and major system changes. Identifying these factors is critical for deriving actionable insights. Leveraging advanced analytical techniques such as wavelet transformation, robust regression, and extreme point analysis, this approach provides a nuanced understanding of these factors. This method has been tested across two synthetic datasets and one real dataset, consistently surpassing existing benchmarks by achieving a lower median mean absolute error and reduced error variability across all comparable components.

14 SOLAR ENERGY↗

Three-dimensional quadratic modeling and quantitative evaluation of the diaphragm on a volumetric CT scan in patients with chronic obstructive pulmonary disease

Purpose: In patients with chronic obstructive pulmonary disease (COPD), diaphragm function may deteriorate due to reduced muscle fiber length. Quantitative analysis of the morphology of the diaphragm is therefore important. In the authors current study, they propose a diaphragm segmentation method for COPD patients that uses volumetric chest computed tomography (CT) data, and they provide a quantitative analysis of the diaphragmatic dimensions. Methods: Volumetric CT data were obtained from 30 COPD patients and 10 normal control patients using a 16-row multidetector CT scanner (Siemens Sensation 16) with 0.75-mm collimation. Diaphragm segmentation using 3D ray projections on the lower surface of the lungs was performed to identify the draft diaphragmatic lung surface, which was modeled using quadratic 3D surface fitting and robust regression in order to minimize the effects of segmentation error and parameterize diaphragm morphology. This result was visually evaluated by an expert thoracic radiologist. To take into consideration the shape features of the diaphragm, several quantification parameters—including the shape index on the apex (SIA) (which was computed using gradient set to 0), principal curvatures on the apex on the fitted diaphragm surface (CA), the height between the apex and the base plane (H), the diaphragm lengths along the x-, y-, and z-axes (XL, YL, ZL), quadratic-fitted diaphragm lengths on the z-axis (FZL), average curvature (C), and surface area (SA)—were measured using in-house software and compared with the pulmonary function test (PFT) results. Results: The overall accuracy of the combined segmentation method was 97.22% ± 4.44% while the visual accuracy of the models for the segmented diaphragms was 95.28% ± 2.52% (mean ± SD). The quantitative parameters, including SIA, CA, H, XL, YL, ZL, FZL, C, and SA were 0.85 ± 0.05 (mm{sup −1}), 0.01 ± 0.00 (mm{sup −1}), 17.93 ± 10.78 (mm), 129.80 ± 11.66 (mm), 163.19 ± 13.45 (mm), 71.27 ± 17.52 (mm), 61.59 ± 16.98 (mm), 0.01 ± 0.00 (mm{sup −1}), and 34 380.75 ± 6680.06 (mm{sup 2}), respectively. Several parameters were correlated with the PFT parameters. Conclusions: The authors propose an automatic method for quantitatively evaluating the morphological parameters of the diaphragm on volumetric chest CT in COPD patients. By measuring not only the conventional length and surface area but also the shape features of the diaphragm using quadratic 3D surface modeling, the proposed method is especially useful for quantifying diaphragm characteristics. Their method may be useful for assessing morphological diaphragmatic changes in COPD patients.

60 APPLIED LIFE SCIENCES↗

The Impact of Below Detection Limit Samples in (NPP) Decommissioning Residual Risk Assessment - 17033

There are some technical problems with finalizing regulations and standards that address nuclear power plant (NPP) decommissioning site soil analyses for license termination. It is difficult to know how to best include detection limit observations from site soil analysis, because typical soil collection data is reported above, at, and below the detection limit. In addition, multiple detection limits are required to adequately estimate the soil radionuclide concentrations. In the literature, researchers analyzing environmental data refer to below the detection limit observations as 'left-censored data'. Left-censored data are less than the detection limit of the instrument(s) that made the measurements. Conventional approaches to managing left-censored data either ignore or simply replace the detection limits with zero, a fraction of the detection limit, or the detection limit itself. However, these approaches are statistically biased and limited in their usefulness. The Kaplan-Meier method, robust regression on order statistics method, and maximum likelihood estimation method are proposed to estimate the left-censored data more precisely. The proposed methods are applied to data from a Monazite powder manufacturing plant and the Colorado School of Mines Research Institute. Summary statistics such as the sample mean, sample standard deviation, sample percentiles are calculated from each data set and are used in risk and volume estimation calculations. Previous environmental analyses, such as the exposure assessment, recognize the uncertainty issue that is addressed in this research using the Latin hypercube sampling approach. Next, probabilistic distributions of the input parameters are developed for the uncertainty analyses. Finally, a framework methodology depicting the decision-making process in the proposed method is presented. The framework defines the critical steps, the amount of radioactivity, types of distributions, censoring percentage, sample size, and number of detection limits; it also allows the user to select the appropriate approach based on their site-specific data and analyses. The goal of this research is to develop a more precise risk assessment, estimate of the volume of soil removal, examine potential cost savings. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Robust Segmented Mixed Effect Regression Model for Baseline Electricity Consumption Forecasting

Renewable energy production has been surging around the world in recent years. To mitigate the increasing uncertainty and intermittency of the renewable generation, proactive demand response algorithms and programs are proposed and developed to further improve the utilization of load flexibility and increase the efficiency of power system operation. One of the biggest challenges to efficient control and operation of demand response resources is how to forecast the baseline electricity consumption and estimate the load impact from demand response resources accurately. In this paper, we propose a mixed effect segmented regression model and a new robust estimate for forecasting the baseline electricity consumption in Southern California, USA, by combining the ideas of random effect regression model, segmented regression model, and the least trimmed squares estimate. Since the log-likelihood of the considered model is not differentiable at breakpoints, we propose a new backfitting algorithm to estimate the unknown parameters. The estimation performance of the new estimation procedure has been demonstrated with both simulation studies and the real data application for the electric load baseline forecasting in Southern California.

42 ENGINEERING↗

A robust and efficient stepwise regression method for building sparse polynomial chaos expansions

Polynomial Chaos (PC) expansions are widely used in various engineering fields for quantifying uncertainties arising from uncertain parameters. The computational cost of classical PC solution schemes is unaffordable as the number of deterministic simulations to be calculated grows dramatically with the number of stochastic dimension. This considerably restricts the practical use of PC at the industrial level. A common approach to address such problems is to make use of sparse PC expansions. This paper presents a non-intrusive regression-based method for building sparse PC expansions. The most important PC contributions are detected sequentially through an automatic search procedure. The variable selection criterion is based on efficient tools relevant to probabilistic method. Two benchmark analytical functions are used to validate the proposed algorithm. The computational efficiency of the method is then illustrated by a more realistic CFD application, consisting of the non-deterministic flow around a transonic airfoil subject to geometrical uncertainties. To assess the performance of the developed methodology, a detailed comparison is made with the well established LAR-based selection technique. The results show that the developed sparse regression technique is able to identify the most significant PC contributions describing the problem. Moreover, the most important stochastic features are captured at a reduced computational cost compared to the LAR method. The results also demonstrate the superior robustness of the method by repeating the analyses using random experimental designs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Regression Based Approach for Robust Finite Element Analysis on Arbitrary Grids. LDRD Final Report

This report summarizes the work performed under a one-year LDRD project aiming to enable accurate and robust numerical simulation of partial differential equations for meshes that are of poor quality. Traditional finite element methods use the mesh to both discretize the geometric domain and to define the finite element shape functions. The latter creates a dependence between the quality of the mesh and the properties of the finite element basis that may adversely affect the accuracy of the discretized problem. In this project, we propose a new approach for defining finite element shape functions that breaks this dependence and separates mesh quality from the discretization quality. At the core of the approach is a meshless definition of the shape functions, which limits the purpose of the mesh to representing the geometric domain and integrating the basis functions without having any role in their approximation quality. The resulting non-conforming space can be utilized within a standard discontinuous Galerkin framework providing a rigorous foundation for solving partial differential equations on low-quality meshes. We present a collection of numerical experiments demonstrating our approach in a wide range of settings: strongly coercive elliptic problems, linear elasticity in the compressible regime, and the stationary Stokes problem. We demonstrate convergence for all problems and stability for element pairs for problems which usually require inf-sup compatibility for conforming methods, also referring to a minor modification possible through the symmetric interior penalty Galerkin framework for stabilizing element pairs that would otherwise be traditionally unstable. Mesh robustness is particularly critical for elasticity, and we provide an example that our approach provides a greater than 5x improvement in accuracy and allows for taking an 8x larger stable timestep for a highly deformed mesh, compared to the continuous Galerkin finite element method. The report concludes with a brief summary of ongoing projects and collaborations that utilize or extend the products of this work.

97 MATHEMATICS AND COMPUTING↗