Feature Selection

Marvin N. Wright*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingBook chapterResearchpeer-review

Abstract

Feature selection, also known as variable or descriptor selection, is the process of finding a subset of features to use with a given task and learner. Finding the optimal set of features can improve predictive performance, reduce noise in data, and make models easier to interpret. There are multiple ways to perform feature selection, including with filters and wrappers. Filters calculate a value for each feature which can then be used to select them, for example selecting features where the feature value is greater than some value Y. Wrappers fit models on selected feature subsets and evaluate their performance to then pick the optimal subset – sequential forward selection is a well-known example. This chapter introduces mlr3fselect and mlr3filters for feature selection and filter methods. The design of these packages is similar to mlr3tuning so the interface should feel familiar to readers who read Chapter 4. Filters are first discussed including feature importance and embedded methods special cases. Then wrappers are discussed, including automating the process with nested resampling.

Original languageEnglish
Title of host publicationApplied Machine Learning Using mlr3 in R
EditorsBernd Bischl, Raphael Sonabend, Lars Kotthoff, Michel Lang
Number of pages15
PublisherCRC Press
Publication date2024
Pages146-160
Chapter6
ISBN (Print)978-1-032-51567-0, 978-1-032-50754-5
ISBN (Electronic)978-1-003-40284-8
DOIs
Publication statusPublished - 2024

Bibliographical note

Publisher Copyright:
© 2024 selection and editorial matter, Bernd Bischl, Raphael Sonabend, Lars Kotthoff, and Michel Lang. All rights reserved.

Cite this