Robust Grouped Variable Selection Using Distributionally Robust Optimization
Not provided.
Mathematics↗
SEARCH · Engineering Papers
Results for “variable selection”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Variable Selection in the Presence of Factors: A Model Selection Perspective
Not Available
García-Donato, Gonzalo↗
Tunable bandpass filter with variable selectivity
Basic active RC networks constructed from stages that realize second-order transfer functions using two integrators offer excellent stability. Modifications of the basic network produce a highly stable bandpass filter having separate controls that independently adjust center frequency, Q, and center frequency gain.
Kerwin, W. J.↗
Select Variables Affecting Thermal System Design of a Liquid-Cooled Stator
NASA Glenn Researchers have endeavored to create a high-power-density, efficient electric motor called the High Efficiency Megawatt Motor (HEMM) with a goal of exceeding 98% efficiency and 1.46 MW of power. These aggressive goals were set because increasing the power density and efficiency of electric machines (motors and generators) is integral to bringing electrified aircraft (EA) to commercial realization. Resistive losses in the stator windings are by far the largest (34%) contributor to this design’s total energy losses. Previous testing of a HEMM-like stator test article (statorette) showed good agreement between measured performance and model predictions. Therefore, a foundation was provided to test other engineering parameters that are encountered when designing an electric machine. Of particular interest are the effects of changes to the thickness of the epoxy from the potting process, changes in the fluid volume/flow path around the end windings, and changes in the viscosity of the cooling fluid on the overall thermal performance of the unit. The impact of those parameters as revealed through a third-generation build, test, and finite element model analysis of a statorette test section is the focus of this paper.
EAP↗
Assessing microbial community patterns under incipient soil formation from basalt
Microbial dynamics drive the biotic machinery of early soil evolution. However, integrated knowledge of microbial community establishment, functional associations, and community assembly processes in incipient soil is lacking. This study presents a novel approach of combining microbial phylogenetic profiling, functional predictions, and community assembly processes to analyze drivers of microbial community establishment in an emerging soil system. Rigorous sub-meter sampling of a basalt-soil lysimeter after two years of irrigation revealed the contrasting depth-dependent distribution patterns of soil parameters and community diversity. Phylogenetic analysis of 16S rRNA gene indicated the presence of diverse bacterial and archaeal phyla, with high relative abundance of Actinobacteria on the surface and a consistently high abundance of Proteobacteria at all depths. Predicted functional gene analysis suggested dominant autotrophy signatures, evidence of an incomplete nitrogen cycle, and predicted enzymes of iron (III) to iron (II) conversion followed by intracellular uptake, transport, and regulation. Null modeling revealed microbial community assembly predominantly governed by variable selection. The relative influence of the variable selection decreased with depth, indicating unique and relatively harsh environmental conditions near the surface and more benign conditions with depth. Additionally, high levels of dispersal influenced community composition near the center of the domain, suggesting that spatial processes interact with deterministic selection imposed by the environment. Characterizing the complexity in incipient soils can advance research insights about microbial community diversity and assembly in other incipient systems (e.g., transformation of marginal soils, or soils recovering from disturbances such as fire, erosion, intensive agricultural practices, or contamination).
Sengupta, Aditi↗
Comparison of linear regression, k-nearest neighbour and random forest methods in airborne laser-scanning-based prediction of growing stock
Abstract In this study, for five sites around the world, we look at the effects of different model types and variable selection approaches on forest yield modelling performances in an area-based approach (ABA). We compared ordinary least squares regression (OLS), k-nearest neighbours (kNN) and random forest (RF). Our objective was to test if there are systematic differences in accuracy between OLS, kNN and RF in ABA predictions of growing stock volume. The analyses are based on a 5-fold cross-validation at five study sites: an eucalyptus plantation, a temperate forest and three different boreal forests. Two completely independent validation datasets were also available for two of the boreal sites. For the kNN, we evaluated multiple measures of distance including Euclidean, Mahalanobis, most similar neighbour (MSN) and an RF-based distance metric. The variable selection approaches we examined included a heuristic approach (for OLS, kNN and RF), exhaustive search among all combinations (OLS only) and all variables together (RF only). Performances varied by model type and variable selection approaches among sites. OLS and RF had similar accuracies and were more efficient than any of the kNN variants. Variable selection did not affect RF performance. Heuristic and exhaustive variable selection performed similarly for OLS. kNN fared the poorest amongst model types, and kNN with RF distance was prone to overfitting when compared with a validation dataset. Additional caution is therefore required when building kNN models for volume prediction though ABA, being preferable instead to opt for models based on OLS with some variable selection, or RF with all variables together.
Cosenza, Diogo N.↗
Variable structure Human Intention Estimator with mobility and vision constraints as model selection criteria
Not provided.
Automation & Control Systems↗
Monthly means of selected climate variables for 1985 - 1989
Meteorologists are accustomed to viewing instantaneous weather maps, since these contain the most relevant information for the task of producing short-range weather forecasts. Climatologists, on the other hand, tend to deal with long-term means, which portray the average climate. The recent emphasis on dynamical extended-range forecasting and, in particular measuring and predicting short term climate change makes it important that we become accustomed to looking at variations on monthly and longer time scales. A convenient toll for researchers to familiarize themselves with the variability which occurs in selected parameters on these time scales is provided. The format of the document was chosen to help facilitate the intercomparison of various parameters and highlight the year-to-year variability in monthly means.
Schubert, S.↗
Microdiverse bacterial clades prevail across Antarctic wetlands
Antarctica's extreme environmental conditions impose selection pressures on microbial communities. Indeed, a previous study revealed that bacterial assemblages at the Cierva Point Wetland Complex (CPWC) are shaped by strong homogeneous selection. Yet which bacterial phylogenetic clades are shaped by selection processes and their ecological strategies to thrive in such extreme conditions remain unknown. Here, we applied the phyloscore and feature-level βNTI indexes coupled with phylofactorization to successfully detect bacterial monophyletic clades subjected to homogeneous (HoS) and heterogenous (HeS) selection. Remarkably, only the HoS clades showed high relative abundance across all samples and signs of putative microdiversity. The majority of the amplicon sequence variants (ASVs) within each HoS clade clustered into a unique 97% sequence similarity operational taxonomic unit (OTU) and inhabited a specific environment (lotic, lentic or terrestrial). Our findings suggest the existence of microdiversification leading to sub-taxa niche differentiation, with putative distinct ecotypes (consisting of groups of ASVs) adapted to a specific environment. We hypothesize that HoS clades thriving in the CPWC have phylogenetically conserved traits that accelerate their rate of evolution, enabling them to adapt to strong spatio-temporally variable selection pressures. Variable selection appears to operate within clades to cause very rapid microdiversification without losing key traits that lead to high abundance. Variable and homogeneous selection, therefore, operate simultaneously but on different aspects of organismal ecology. The result is an overall signal of homogeneous selection due to rapid within-clade microdiversification caused by variable selection. It is unknown whether other systems experience this dynamic, and we encourage future work evaluating the transferability of our results.
59 BASIC BIOLOGICAL SCIENCES↗
Effects of selected design variables on three ramp, external compression inlet performance
Two inlet performance tests and one inlet/airframe drag test were conducted in 1969 at the NASA-Ames Research Center. The basic inlet system was two-dimensional, three ramp (overhead), external compression, with variable capture area. The data from these tests were analyzed to show the effects of selected design variables on the performance of this type of inlet system. The inlet design variables investigated include inlet bleed, bypass, operating mass flow ratio, inlet geometry, and variable capture area.
Kamman, J. H.↗
HPC Campaign Management: Remote data access with user-defined error bound using ADIOS and ZFP
Remote access to large-scale scientific datasets, like those generated by combustion simulations or other high-performance computing (HPC) applications, presents a significant challenge. Downloading entire datasets is often impractical due to their size and the bandwidth limitations of typical networks. To address this challenge, we propose a novel approach that enables efficient remote access to large datasets distributed across multiple facilities. Our method enables technologies to download only the data values of a select variable, in a select region of interest, to a user-defined accuracy. For this purpose, we extended the ADIOS IO library to provide read functions with user-defined accuracy, a remote data server that understands multidimensional selections of specific variables, steps and accuracy from an ADIOS dataset, and which uses lossy compression on the remote site to reduce the data to be transferred back to the client. In addition, our extension of the ADIOS library collects metadata from multiple datasets in small files called Campaign Archives, which can be shared among project participants on any HPC, cloud or laptop, and which can easily facilitate the discovery of content and pointers to the data location as well as remote access to the data by local tools as if data was local. This feature called Campaign Management, enables a group of scientists to manage related datasets stored in multiple files, across multiple facilities as if it was in a single file/database. We demonstrate the effectiveness of our approach using a 1.5 TB dataset from the S3D combustion simulation on Frontier at the Oak Ridge Leadership Facility. Even a single variable from this dataset, at 64 GB, is too large to be processed on a standard laptop. We show two different reading patterns for 2D plots and 3D visualization, with careful settings that a scientist studying combustion data would do and show that running the same Python scripts on Frontier directly takes comparable time than running them on the local laptop with remote access to the data on Frontier.
Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗
Development of LACIE CCEA-1 weather/wheat yield models
The advantages and disadvantages of the casual (phenological, dynamic, physiological), statistical regression, and analog approaches to modeling for grain yield are examined. Given LACIE's primary goal of estimating wheat production for the large areas of eight major wheat-growing regions, the statistical regression approach of correlating historical yield and climate data offered the Center for Climatic and Environmental Assessment the greatest potential return within the constraints of time and data sources. The basic equation for the first generation wheat-yield model is given. Topics discussed include truncation, trend variable, selection of weather variables, episodic events, strata selection, operational data flow, weighting, and model results.
Strommen, N. D.↗
Cross-national analysis of food security drivers: comparing results based on the Food Insecurity Experience Scale and Global Food Security Index
Abstract The second UN Sustainable Development Goal establishes food security as a priority for governments, multilateral organizations, and NGOs. These institutions track national-level food security performance with an array of metrics and weigh intervention options considering the leverage of many possible drivers. We studied the relationships between several candidate drivers and two response variables based on prominent measures of national food security: the 2019 Global Food Security Index (GFSI) and the Food Insecurity Experience Scale’s (FIES) estimate of the percentage of a nation’s population experiencing food security or mild food insecurity (FI ). We compared the contributions of explanatory variables in regressions predicting both response variables, and we further tested the stability of our results to changes in explanatory variable selection and in the countries included in regression model training and testing. At the cross-national level, the quantity and quality of a nation’s agricultural land were not predictive of either food security metric. We found mixed evidence that per-capita cereal production, per-hectare cereal yield, an aggregate governance metric, logistics performance, and extent of paid employment work were predictive of national food security. Household spending as measured by per-capita final consumption expenditure (HFCE) was consistently the strongest driver among those studied, alone explaining a median of 92% and 70% of variation (based on out-of-sample R 2 ) in GFSI and FI , respectively. The relative strength of HFCE as a predictor was observed for both response variables and was independent of the countries used for model training, the transformations applied to the explanatory variables prior to model training, and the variable selection technique used to specify multivariate regressions. The results of this cross-national analysis reinforce previous research supportive of a causal mechanism where, in the absence of exceptional local factors, an increase in income drives increase in food security. However, the strength of this effect varies depending on the countries included in regression model fitting. We demonstrate that using multiple response metrics, repeated random sampling of input data, and iterative variable selection facilitates a convergence of evidence approach to analyzing food security drivers.
42 ENGINEERING↗
Development of Building Design Optimization Methodology: Residential Building Applications
Building design optimization is a highly complex problem, requiring long computational running processes because of the many options that exist when a building is being designed. This paper introduces an integrated approach through which to perform this optimization within an acceptable time frame. The approach includes the methods of variable selection, model simplification, and a sequential optimization process. Using singular value decomposition, a large number of design variables is reduced to a smaller subset that can be solved more quickly through the optimization algorithm. To expedite the variable selection process, a modeling approach that quickly simulates annual energy consumption was developed to replace full annual energy simulations. The developed methodology was applied to two residential buildings in the US, and the results are discussed herein. To assess the accuracy of the integrated optimization methodology, the optimized life cycle costs are compaa variables demonstrating the strongest contributions in the optimization study were identified. The proposed methodology significantly shortened the time requirements for the optimization processes of the two case studies by 74% and 84%; the optimized life cycle costs were within 0.05% and 0.06%, respectively, of the optimum point.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Extending Classification Algorithms to Case-Control Studies
Classification is a common technique applied to ’omics data to build predictive models and identify potential markers of biomedical outcomes. Despite the prevalence of case-control studies, the number of classification methods available to analyze data generated by such studies is extremely limited. Conditional logistic regression is the most commonly used technique, but the associated modeling assumptions limit its ability to identify a large class of sufficiently complicated ’omic signatures. We propose a data preprocessing step which generalizes and makes any linear or nonlinear classification algorithm, even those typically not appropriate for matched design data, available to be used to model case-control data and identify relevant biomarkers in these study designs. We demonstrate on simulated case-control data that both the classification and variable selection accuracy of each method is improved after applying this processing step and that the proposed methods are comparable to or outperform existing variable selection methods. Finally, we demonstrate the impact of conditional classification algorithms on a large cohort study of children with islet autoimmunity.
59 BASIC BIOLOGICAL SCIENCES↗
Fast Solution in Sparse LDA for Binary Classification
An algorithm that performs sparse linear discriminant analysis (Sparse-LDA) finds near-optimal solutions in far less time than the prior art when specialized to binary classification (of 2 classes). Sparse-LDA is a type of feature- or variable- selection problem with numerous applications in statistics, machine learning, computer vision, computational finance, operations research, and bio-informatics. Because of its combinatorial nature, feature- or variable-selection problems are NP-hard or computationally intractable in cases involving more than 30 variables or features. Therefore, one typically seeks approximate solutions by means of greedy search algorithms. The prior Sparse-LDA algorithm was a greedy algorithm that considered the best variable or feature to add/ delete to/ from its subsets in order to maximally discriminate between multiple classes of data. The present algorithm is designed for the special but prevalent case of 2-class or binary classification (e.g. 1 vs. 0, functioning vs. malfunctioning, or change versus no change). The present algorithm provides near-optimal solutions on large real-world datasets having hundreds or even thousands of variables or features (e.g. selecting the fewest wavelength bands in a hyperspectral sensor to do terrain classification) and does so in typical computation times of minutes as compared to days or weeks as taken by the prior art. Sparse LDA requires solving generalized eigenvalue problems for a large number of variable subsets (represented by the submatrices of the input within-class and between-class covariance matrices). In the general (fullrank) case, the amount of computation scales at least cubically with the number of variables and thus the size of the problems that can be solved is limited accordingly. However, in binary classification, the principal eigenvalues can be found using a special analytic formula, without resorting to costly iterative techniques. The present algorithm exploits this analytic form along with the inherent sequential nature of greedy search itself. Together this enables the use of highly-efficient partitioned-matrix-inverse techniques that result in large speedups of computation in both the forward-selection and backward-elimination stages of greedy algorithms in general.
Moghaddam, Baback↗
Effects of random forest modeling decisions on biogeochemical time series predictions
Abstract Random forests (RF) are an increasingly popular machine learning approach used to model biogeochemical processes in the Earth system. While RF models are robust to many assumptions that complicate deterministic models, there are several important parameterization decisions for appropriate use and optimal model fit. We explored the role that parameter decisions, including training/testing data splitting strategies, variable selection, and hyperparameters play on RF goodness‐of‐fit by constructing models using 1296 unique parameter combinations to predict concentrations of nitrate, a key nutrient for biogeochemical cycling in aquatic ecosystems. Models were built on long‐term, publicly available water quality and meteorology time series collected by the National Estuarine Research Reserve monitoring network for two contrasting ecosystems representing freshwater and brackish estuaries. We found that accounting for temporal dependence when splitting data into training and testing subsets was key for avoiding over‐estimation of model predictive power. In addition, variable selection, the ratio of training to testing data, and to a lesser degree, variables per split and number of trees, were significant parameters for optimizing RF goodness‐of‐fit. We also explored how model parameter decisions influenced interpretation of the relative importance of predictors to the model, and model predictor‐dependent variable relationships, with results suggesting that both data structure and model parameterization influence these factors. Because much of the current RF literature is written for the computational and statistical science communities, the primary goal of this study is to provide guidelines for aquatic scientists new to machine learning to apply RF techniques appropriately to aquatic biogeochemical datasets.
54 ENVIRONMENTAL SCIENCES↗
Robust Measurement of Stellar Streams around the Milky Way: Correcting Spatially Variable Observational Selection Effects in Optical Imaging Surveys
Observations of density variations in stellar streams are a promising probe of low-mass dark matter substructure in the Milky Way. However, survey systematics such as variations in seeing and sky brightness can also induce artificial fluctuations in the observed densities of known stellar streams. These variations arise because survey conditions affect both object detection and star–galaxy misclassification rates. To mitigate these effects, we use Balrog synthetic source injections in the Dark Energy Survey (DES) Y3 data to calculate detection rate variations and classification rates as functions of survey properties. We show that these rates are nearly separable with respect to survey properties and can be estimated with sufficient statistics from the synthetic catalogs. Applying these corrections reduces the standard deviation of relative detection rates across the DES footprint by a factor of 5, and our corrections significantly change the inferred linear density of the Phoenix stream when including faint objects. Additionally, for artificial streams with DES-like survey properties we are able to recover density power spectra with reduced bias. We also find that uncorrected power-spectrum results for Legacy Survey of Space and Time (LSST)-like data can be around 5 times more biased, highlighting the need for such corrections in future ground-based surveys.
79 ASTRONOMY AND ASTROPHYSICS↗