Refactoring benchmark of real-world, multi-hop tasks within the realm of code.
In this repository we contain the exact copies of repositories that were used for the task and test generation parts of RefactorBench. To run agents on these repositories, we recommend using SWE-agent's Docker solution or some similar dockerized setup where a copy of the repository is loaded onto an image and persists for all task instances. We find that this allows local running of RefactorBench (a huge blocker for democratizing access to software engineering agent research).
This repository includes code from the Django project, licensed under the BSD License.
- Original repository: https://github.com/django/django
- License: BSD License (included in the LICENSE file)
This repository includes code from the Salt project, licensed under the Apache 2.0 License.
- Original repository: https://github.com/saltstack/salt
- License: Apache License 2.0 (included in the LICENSE file)
This repository includes code from the Flask project, licensed under the BSD License.
- Original repository: https://github.com/pallets/flask
- License: BSD License (included in the LICENSE file)
This repository includes code from the FastAPI project, licensed under the MIT License.
- Original repository: https://github.com/tiangolo/fastapi
- License: MIT License (included in the LICENSE file)
This repository includes code from the Celery project, licensed under the BSD License.
- Original repository: https://github.com/celery/celery
- License: BSD License (included in the LICENSE file)
This repository includes code from the Ansible project, licensed under the GPLv3 License.
- Original repository: https://github.com/ansible/ansible
- License: GPLv3 License (included in the LICENSE file)
This repository includes code from the Requests project, licensed under the Apache 2.0 License.
- Original repository: https://github.com/psf/requests
- License: Apache License 2.0 (included in the LICENSE file)
This repository includes code from the Scrapy project, licensed under the BSD License.
- Original repository: https://github.com/scrapy/scrapy
- License: BSD License (included in the LICENSE file)
This repository includes code from the Tornado project, licensed under the Apache 2.0 License.
- Original repository: https://github.com/tornadoweb/tornado
- License: Apache License 2.0 (included in the LICENSE file)