DOE OSTI · 2319050
Feature selection with distance correlation
Abstract
Choosing which properties of the data to use as input to multivariate decision algorithms—also known as feature selection—is an important step in solving any problem with machine learning. While there is a clear trend towards training sophisticated deep networks on large numbers of relatively unprocessed inputs (so-called automated feature engineering), for many tasks in physics, sets of theoretically well-motivated and well-understood features already exist. Working with such features can bring many benefits, including greater interpretability, reduced training and run time, and enhanced stability and robustness. We develop a new feature selection method based on distance correlation, and demonstrate its effectiveness on the tasks of boosted top- and W -tagging. Using our method to select features from a set of over 7,000 energy flow polynomials, we show that we can match the performance of much deeper architectures, by using only ten features and two orders-of-magnitude fewer model parameters. Published by the American Physical Society 2024
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Das, Ranit, Kasieczka, Gregor, Shih, David (ORCID:0000000334083871). 2024-03-06. Feature selection with distance correlation. https://doi.org/10.1103/physrevd.109.054009. https://engineeringpapers.com/record/osti%3A2319050/feature-selection-with-distance-correlation
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.