Welcome to GitBug-Actions - We build executable code datasets using GitHub Actions!
GitBug-Actions is a research initiative that develops tools for mining and executing software repositories. Our main focus is on creating reproducible bug-fix benchmarks by leveraging GitHub Actions, ensuring that discovered bugs and their fixes can be reliably reproduced in the future.
Our flagship tool that mines repositories and builds executable code datasets. It:
- Analyzes GitHub repositories and their commit history
- Executes GitHub Actions locally to extract execution information (e.g., tests)
- Creates Docker images with reproducible environments
- Ensures long-term reproducibility
A comprehensive Java bug benchmark featuring recent bugs from real-world projects:
- Web Interface
- Available on HuggingFace
- Fully reproducible environment with Docker support
- Detailed test execution results and metadata
If you use our tools in your research, please cite:
@inproceedings{gitbugactions,
title = {GitBug-Actions: Building Reproducible Bug-Fix Benchmarks with GitHub Actions},
year = {2024},
doi = {10.1145/3639478.3640023},
author = {Saavedra, Nuno and Silva, Andr{\'e} and Monperrus, Martin},
booktitle = {Proceedings of the ACM/IEEE 46th International Conference on Software Engineering: Companion Proceedings},
}@inproceedings{gitbugjava,
title={GitBug-Java: A Reproducible Benchmark of Recent Java Bugs},
author={Silva, Andr{\'e} and Saavedra, Nuno and Monperrus, Martin},
booktitle={Proceedings of the 21st International Conference on Mining Software Repositories},
doi={10.1145/3643991.3644884}
}Visit our main repositories to get started:
- gitbugactions - For the main mining tool
- gitbug-java - For the Java bug benchmark
Each repository includes detailed setup instructions and usage examples.
We welcome contributions to any of our projecs, feel free to open a PR!
