Dokument: Boosting interaction tree stumps for modeling interactions

Titel:	Boosting interaction tree stumps for modeling interactions
URL für Lesezeichen:	https://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=70368
URN (NBN):	urn:nbn:de:hbz:061-20250728-095602-8
Kollektion:	Publikationen
Sprache:	Englisch
Dokumententyp:	Wissenschaftliche Texte » Artikel, Aufsatz
Medientyp:	Text
Autoren:	Lau, Michael [Autor] Schikowski, Tamara [Autor] Schwender, Holger [Autor]
Dateien:	[Dateien anzeigen] Adobe PDF [Details] 1,41 MB in einer Datei [ZIP-Datei erzeugen] Dateien vom 28.07.2025 / geändert 28.07.2025
Stichwörter:	Linear interaction models, Machine learning, Penalized regression, Polygenic risk scores
Beschreibung:	Incorporating interaction effects is essential for accurately modeling complex underlying relationships in many applications. Often, not only strong predictive performance is desired, but also the interpretability of the resulting model. This need is evident in areas such as epidemiology, in which uncovering the interplay of biological mechanisms is critical for understanding complex diseases. Classical linear models, frequently used for constructing genetic risk scores, fail to capture interaction effects autonomously, while modern machine learning methods such as gradient boosting often produce black-box models that lack interpretability. Existing linear interaction models are largely limited to consider two-way interactions. To address these limitations, a novel statistical learning method, BITS (Boosting Interaction Tree Stumps), is introduced to construct linear models while autonomously detecting and incorporating interaction effects. BITS uses gradient boosting on interaction tree stumps, i.e., decision trees with a single split, where in BITS this split can possibly occur on an interaction term. A branch-and-bound approach is employed in BITS to discard weakly predictive terms. For high-dimensional data, a hybrid search strategy combining greedy and exhaustive approaches is proposed. Regularization techniques are integrated to prevent overfitting and the inclusion of spurious interaction effects. Simulation studies and real data applications demonstrate that BITS produces interpretable models with strong predictive performance. Moreover, in the simulation study, BITS primarily identifies truly influential terms.
Rechtliche Vermerke:	Originalveröffentlichung: Lau, M., Schikowski, T., & Schwender, H. (2025). Boosting interaction tree stumps for modeling interactions. Computational Statistics & Data Analysis, 213, Article 108247. https://doi.org/10.1016/j.csda.2025.108247
Lizenz:	Dieses Werk ist lizenziert unter einer Creative Commons Namensnennung 4.0 International Lizenz
Fachbereich / Einrichtung:	Mathematisch- Naturwissenschaftliche Fakultät
Dokument erstellt am:	28.07.2025
Dateien geändert am:	28.07.2025