On the Properties of Bias-Variance Decomposition for kNN Regression Научная публикация
| Журнал |
Известия Иркутского государственного университета. Серия: Математика (Bulletin of Irkutsk State University. Series Mathematics)
ISSN: 1997-7670 |
||
|---|---|---|---|
| Вых. Данные | Год: 2023, Том: 43, Страницы: 110-121 Страниц : 12 DOI: 10.26516/1997-7670.2023.43.110 | ||
| Ключевые слова | bias-variance decomposition, machine learning, k-nearest neighbors algorithm, overfitting | ||
| Авторы |
|
||
| Организации |
|
Информация о финансировании (1)
| 1 | Институт математики им. С.Л. Соболева СО РАН | FWNF-2022-0015 |
Реферат:
When choosing the optimal complexity of the method for constructing decision functions, an important tool is the decomposition of the quality criterion into bias and variance. It is generally assumed (and in practice this is most often true) that with increasing complexity of the method, the bias component monotonically decreases, and the variance component increases. The conducted research shows that in some cases this behavior is violated. In this paper, we obtain an expression for the variance component for the kNN method for the linear regression problem in the formulation when the “explanatory” features are random variables. In contrast to the well-known result obtained for non-random “explanatory” variables, in the considered case, the variance may increase with the growth of k.
Библиографическая ссылка:
Nedel`ko V.M.
On the Properties of Bias-Variance Decomposition for kNN Regression
Известия Иркутского государственного университета. Серия: Математика (Bulletin of Irkutsk State University. Series Mathematics). 2023. V.43. P.110-121. DOI: 10.26516/1997-7670.2023.43.110 WOS РИНЦ OpenAlex
On the Properties of Bias-Variance Decomposition for kNN Regression
Известия Иркутского государственного университета. Серия: Математика (Bulletin of Irkutsk State University. Series Mathematics). 2023. V.43. P.110-121. DOI: 10.26516/1997-7670.2023.43.110 WOS РИНЦ OpenAlex
Даты:
| Поступила в редакцию: | 5 дек. 2022 г. |
| Принята к публикации: | 23 янв. 2023 г. |
| Опубликована в печати: | 5 апр. 2023 г. |
| Опубликована online: | 5 апр. 2023 г. |
Идентификаторы БД:
| Web of science: | WOS:000954547200008 |
| РИНЦ: | 50361679 |
| OpenAlex: | W4327648033 |