Extended version of “The impact of tangled code changes on defect prediction models” @ EMSE journal

In 2013 we published a paper with the title “The impact of tangled code changes” for the 10th Working Conference on Mining Software Repositories. This year, we published an extended version of this paper showing the impact of tangled code changes on actual defect prediction models proposed by so many researchers in the past decade:

“When interacting with source control management system, developers often commit unrelated or loosely related code changes in a single transaction. When analyzing version histories, such tangled changes will make all changes to all modules appear related, possibly compromising the resulting analyses through noise and bias. In an investigation of five open-source Java projects, we found between 7% and 20% of all bug fixes to consist of multiple tangled changes. Using a multi-predictor approach to untangle changes, we show that on average at least 16.6% of all source files are incorrectly associated with bug reports. These incorrect bug file associations seem to not significantly impact models classifying source files to have at least one bug or no bugs. But our experiments show that untangling tangled code changes can result in more accurate regression bug prediction models when compared to models trained and tested on tangled bug datasets–in our experiments, the statistically significant accuracy improvements lies between 5% and 200%. We recommend better change organization to limit the impact of tangled changes.”

For more info we refer to the publisher website.

  • [PDF] [DOI] K. Herzig, S. Just, and A. Zeller, “The impact of tangled code changes on defect prediction models,” Empirical software engineering, pp. 1-34, 2015.
    journal={Empirical Software Engineering},
    title={The impact of tangled code changes on defect prediction models},
    publisher={Springer US},
    keywords={Defect prediction; Untangling; Data noise},
    author={Herzig, Kim and Just, Sascha and Zeller, Andreas},