Skip to content

Commit

Permalink
Move habana dockerfile to dev/docker (#100)
Browse files Browse the repository at this point in the history
* move habana dockerfile

* modify docker file link
  • Loading branch information
kira-lin authored Feb 6, 2024
1 parent a6a2102 commit ebcd45b
Show file tree
Hide file tree
Showing 3 changed files with 13 additions and 17 deletions.
10 changes: 10 additions & 0 deletions dev/docker/Dockerfile.habana
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
FROM vault.habana.ai/gaudi-docker/1.14.0/ubuntu22.04/habanalabs/pytorch-installer-2.1.1:latest

ENV LANG=en_US.UTF-8

COPY ../../ /root/llm-on-ray

WORKDIR /root/llm-on-ray

RUN pip install . && \
pip install --upgrade-strategy eager optimum[habana]
4 changes: 3 additions & 1 deletion docs/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,8 @@ Intel® 1st, 2nd, 3rd, and 4th Gen Xeon® Scalable Performance processor
#### 1. Prerequisites
For Intel GPU, ensure the [Intel® oneAPI Base Toolkit](https://www.intel.com/content/www/us/en/developer/tools/oneapi/base-toolkit.html) is installed.

For Gaudi, ensure the [SynapseAI SW stack and container runtime](https://docs.habana.ai/en/latest/Installation_Guide/Bare_Metal_Fresh_OS.html?highlight=installer#run-using-containers) is installed.

#### 2. Clone the repository and install dependencies.
```bash
git clone https://github.com/intel/llm-on-ray.git
Expand All @@ -51,7 +53,7 @@ source $(python -c "import oneccl_bindings_for_pytorch as torch_ccl;print(torch_

For Gaudi:

Please use the [Dockerfile](../inference/habana/Dockerfile) to build the image. Alternatively, you can install the dependecies on a bare metal machine. In this case, please refer to [here](https://docs.habana.ai/en/latest/Installation_Guide/Bare_Metal_Fresh_OS.html#build-docker-bare).
Please use the [Dockerfile](../dev/docker/Dockerfile.habana) to build the image. Alternatively, you can install the dependecies on a bare metal machine. In this case, please refer to [here](https://docs.habana.ai/en/latest/Installation_Guide/Bare_Metal_Fresh_OS.html#build-docker-bare).

```bash
docker build \
Expand Down
16 changes: 0 additions & 16 deletions inference/habana/Dockerfile

This file was deleted.

0 comments on commit ebcd45b

Please sign in to comment.