Skip to content

Commit

Permalink
added docker installation steps to readme
Browse files Browse the repository at this point in the history
  • Loading branch information
dsingal0 committed Jul 7, 2024
1 parent 18a04c3 commit f4ba21b
Showing 1 changed file with 11 additions and 0 deletions.
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -170,6 +170,17 @@ pip install "unsloth[cu121-ampere-torch230] @ git+https://github.com/unslothai/u
nvcc
python -m xformers.info
python -m bitsandbytes
```

### Docker Installation
1. Edit Dockerfile to match required CUDA and Pytorch version. By default, CUDA 12.1.1 and Pytorch 2.3 are used, but you modify to use CUDA 11.8 and Pytorch 2.x instead as well as install optional dependencies by changing `unsloth[cu121-torch230]`.
2. Build docker image
```bash
docker build -t unsloth:latest .
```
3. Run unsloth docker image
```bash
docker run --gpus all -it --rm -v $PWD:/workspace --ulimit memlock=-1 --ulimit stack=67108864 --ipc host unsloth:latest
```

## 📜 Documentation
Expand Down

0 comments on commit f4ba21b

Please sign in to comment.