If you use this data, please cite "FLACOCO: Fault Localization for Java based on Industry-grade Coverage", Technical report, arXiv 2111.12513, 2021.
@techreport{flacoco2021,
title = {FLACOCO: Fault Localization for Java based on Industry-grade Coverage},
year = {2021},
author = {André Silva and Matias Martinez and Benjamin Danglot and Davide Ginelli and Martin Monperrus},
url = {http://arxiv.org/pdf/2111.12513},
number = {2111.12513},
institution = {arXiv},
}Flacocobot scanned 22 Java projects that use Maven as building system. In total, Flacocobot analyzed 58 pull requests. Among them, 19 fail due to test failures or errors related to the logic of the program, and Flacocobot found suspicious lines for 16 of them (84.21%).
The following table shows the pull requests analyzed by Flacocobot.
- FSL - Found Suspicious Lines: it indicates that Flacocobot found suspicious lines associated with the failure;
- NF - Not Failing: it indicates that it has not been possible to reproduce the failure;
- NT - Not Testable: it indicates that it has not been possible to execute the test cases (e.g., it has not been possible to detect the test cases);
- NC - Not Clonable: it indicates that it has not been possible to clone the repository;
- NB - Not Buildable: it indicates that it has not been possible to build the project.
- The folder
datacontains a subfolder for every project scanned by Flacocobot during the experiment. - For every project, the folder
log-filescontains the log files associated with the executions of Flacocobot on the open failing pull requests of that project. The name of every log file has the following structure:<project>_<pullRequestNumber>-<pullRequestUpdate>. - If Flacocobot found suspicious lines, every project folder contains also the folder
suspicious-lines. - The folder
suspicious-lineshas a subfolder for every pull request if the project has more than one pull request analyzed by Flacocobot. - The files contained in the
suspicious-linesfolder contain the suspicious lines found by Flacocobot. If the file name starts withdiff_, it means that the file contains the suspicious lines found by Flacocobot that are contained in the diff between the main code base and the changes introduced by the pull request. - For every suspicious line, the suspiciousness score and the failing test cases that cover that line are reported.