Investigation of different decision trees and k-nearest neighbor methods in data mining: An application on gynecology and birth data

In data mining, the algorithms used for classification can generally be examined under two headings as "unsupervised" and "supervised". "Decision trees" and "k-nearest neighbor (KNN)" algorithms in supervised data mining; nonparametric methods and has predictive feature. With these algorithms applied for classification purposes, explanatory variables which are most effective on the answer variable in the study (birth weight of babies) have been determined. From decision trees; "CART, CHAID, exhaustive CHAID, QUEST, Random Forest and C4.5" algorithms have been used. In k-nearest neighbor algorithm; "Euclidean" and "Manhattan (City block)" distance measurements have been applied. Considering the classification performances, it has been tried to determine optimal estimation algorithms. According to these results; the highest estimation rate in terms of sensitivity has been observed in the "CART" algorithm with 88.4%. The highest estimation rate in terms of specificity criterion has been seen 98.2% in the "Random Forest" algorithm. The highest estimation rate in terms of accuracy criterion has been seen 94.5% in the "C4.5" algorithm. The lowest rate in terms of the risk estimate has been observed in the "C4.5" of 5.6%. When the results are examined in general; it can be said that all algorithms work with "good classification, high estimation and low error rate". In addition, this study may contribute to early investigations of the birth weight of newborn babies, whether it is low birth weight or not, and thus taking preventive measures. Keywords: Cross Validation, Supervised Methods, Euclidean Distance, Risk Estimation, Classification