From f4ba21b243f3df968e8449e0dd2ea2152d604414 Mon Sep 17 00:00:00 2001 From: Dhruv Singal Date: Sun, 7 Jul 2024 11:46:06 -0700 Subject: [PATCH] added docker installation steps to readme --- README.md | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/README.md b/README.md index f3bc0608b..18c2fe137 100644 --- a/README.md +++ b/README.md @@ -170,6 +170,17 @@ pip install "unsloth[cu121-ampere-torch230] @ git+https://github.com/unslothai/u nvcc python -m xformers.info python -m bitsandbytes +``` + +### Docker Installation +1. Edit Dockerfile to match required CUDA and Pytorch version. By default, CUDA 12.1.1 and Pytorch 2.3 are used, but you modify to use CUDA 11.8 and Pytorch 2.x instead as well as install optional dependencies by changing `unsloth[cu121-torch230]`. +2. Build docker image +```bash +docker build -t unsloth:latest . +``` +3. Run unsloth docker image +```bash +docker run --gpus all -it --rm -v $PWD:/workspace --ulimit memlock=-1 --ulimit stack=67108864 --ipc host unsloth:latest ``` ## 📜 Documentation