Feature Selection

Marvin N. Wright*

*Corresponding author af dette arbejde

Publikation: Bidrag til bog/antologi/rapportBidrag til bog/antologiForskningpeer review

Abstract

Feature selection, also known as variable or descriptor selection, is the process of finding a subset of features to use with a given task and learner. Finding the optimal set of features can improve predictive performance, reduce noise in data, and make models easier to interpret. There are multiple ways to perform feature selection, including with filters and wrappers. Filters calculate a value for each feature which can then be used to select them, for example selecting features where the feature value is greater than some value Y. Wrappers fit models on selected feature subsets and evaluate their performance to then pick the optimal subset – sequential forward selection is a well-known example. This chapter introduces mlr3fselect and mlr3filters for feature selection and filter methods. The design of these packages is similar to mlr3tuning so the interface should feel familiar to readers who read Chapter 4. Filters are first discussed including feature importance and embedded methods special cases. Then wrappers are discussed, including automating the process with nested resampling.

OriginalsprogEngelsk
TitelApplied Machine Learning Using mlr3 in R
RedaktørerBernd Bischl, Raphael Sonabend, Lars Kotthoff, Michel Lang
Antal sider15
ForlagCRC Press
Publikationsdato2024
Sider146-160
Kapitel6
ISBN (Trykt)978-1-032-51567-0, 978-1-032-50754-5
ISBN (Elektronisk)978-1-003-40284-8
DOI
StatusUdgivet - 2024

Bibliografisk note

Publisher Copyright:
© 2024 selection and editorial matter, Bernd Bischl, Raphael Sonabend, Lars Kotthoff, and Michel Lang. All rights reserved.

Citationsformater