Evaluating the performance of ensemble learning methods in diabetes disease classification

Evaluating the performance of ensemble learning methods in diabetes disease classification. Download PDF Abstract Diabetes mellitus is a widespread metabolic disorder marked by chronic hyperglycemia and severe complications. Early and accurate detection is crucial for effective management and preventing disease progression.

This study systematically evaluates the performance of three ensemble learning strategies Bagging, Boosting, and Stacking on three benchmark diabetes datasets: Pima Indians Diabetes (PID), Frankfurt Hospital Diabetes, and Sylhet Hospital Diabetes. To address class imbalance while preventing data leakage, the Synthetic Minority Oversampling Technique (SMOTE) was applied exclusively to the training data after train-test splitting and independently within each cross-validation fold. All models were evaluated using stratified k-fold cross-validation, and performance was assessed using accuracy, precision, recall, F1-score, receiver operating characteristic area under the curve (ROC-AUC), and calibration analysis.

Statistical significance testing was additionally conducted to compare the performance of competing ensemble methods. Experimental results show that all three ensemble paradigms achieved strong performance after SMOTE, with the best-performing model varying by dataset rather than one paradigm uniformly dominating. On the PID dataset, Light Gradient Boosting achieved the highest accuracy (75.97%) On the Frankfurt dataset Bagging and Light Gradient Boosting reached the highest accuracy (98.50%), while on the Sylhet dataset, Bagging perfect accuracy (99.09%) closely followed by Random Forest, Extra Trees and Gradient Boosting (99.03%).

Medical Disclaimer: This article is for informational purposes only and does not constitute medical advice. Always consult with qualified healthcare professionals for medical decisions and treatment options.