Revisiting Tabular Deep Regression: Objectives and the Limits of Global Early Stopping
[Uczenie maszynowe] Autorzy: Danil Rudenko, Georgii Bulgakov, Nikolay Kartashev i 3 więcej
While deep learning models for tabular data have recently received significant research attention, the choice of objective functions for regression tasks remains an understudied degree of freedom. Several lines of research offer alternatives to the standard Mean Squared Error (MSE), but differences in datasets, backbones, and evaluation protocols make their practical benefits difficult to compare. In this work, we address this gap by performing a systematic re-evaluation of regression objectives across a broad collection of established tabular datasets and multiple neural backbones. Our comparison reveals that many proposed objectives provide limited or inconsistent gains over a properly tuned MSE baseline, while quantile loss yields consistent aggregate improvements over MSE across the tested backbones. We then identify a limitation that remains even with this strong objective: regions…
- Kategoria arxiv
- cs.LG
- Kategoria
- Uczenie maszynowe