Publication:
Performance Evaluation Metrics for Software Fault Prediction Studies

No Thumbnail Available
Date
2012
Authors
Çatal, Çağatay
Journal Title
Journal ISSN
Volume Title
Publisher
Budapest Tech, Becsi Ut 96-B, Budapest, H-1034, Hungary
Research Projects
Organizational Units
Journal Issue
Abstract

Experimental studies confirmed that only a small portion of software modules cause faults in software systems. Therefore, the majority of software modules are represented with non-faulty labels and the rest are marked with faulty labels during the modeling phase. These kinds of datasets are called irnbalanced, and different performance metrics exist to evaluate the performance of proposed fault prediction techniques. In this study, we investigate 85 fault prediction papers based on their performance evaluation metrics and categorize these metrics into two main groups. Evaluation methods such as cross validation and stratified sampling are not in the scope of this paper, and therefore only evaluation metrics are examined This study shows that researchers have used different evaluation parameters for software fault prediction until now and more studies on performance evaluation metrics for imbalanced datasets should be conducted

Description
Keywords
Performance Evaluation , Software Fault Prediction , Machine Learning , Oriented Design Metrics , Models , Performans Değerlendirmesi , Yazılım Hatası Tahmini , Makine Öğrenme , Odaklı Tasarım Metrikleri , Modeller
Citation