Robust XGBoosting for Regression

Authors: Iris Aragón Mladosich, Christophe Croux

Abstract

XGBoost is a very popular and powerful method for prediction. It iteratively fits simple decision trees to the residuals of the previous step. An efficient and scalable implementation is available. The standard loss function for XGBoost is the quadratic loss, but a Huber loss can also be used. In this paper, we study the robustness of XGBoost and show that its performance can be affected by vertical outliers and leverage points. To address this, we explore alternative loss functions, based on M-, S-, and τ -estimators from robust regression. Our results indicate that a two-step procedure, referred to as MM-XGBoost, provides the best trade-off between robustness and prediction accuracy.

Find similar papers with AI

Copy this prompt into your assistant

Using Paperlist, find papers similar to "Robust XGBoosting for Regression" (id: 86301, arXiv 2026).
set up https://paperlist.ai/SKILL.md

MCP setupCLI