diff --git a/README.md b/README.md index a8d1790..041e9a9 100644 --- a/README.md +++ b/README.md @@ -10,6 +10,9 @@ Install the dependencies ```sh +# Install poetry if not already available +curl -sSL https://install.python-poetry.org | python3 - + # Install dependencies poetry install @@ -30,3 +33,24 @@ curl -X 'POST' \ } }' ``` + +### Cuda GPU Support + +For GPU support try the following: + +```sh +# Create a virtual env +python3 -m venv venv + +# Activate the venv +source venv/bin/active + +# Install torch with the special index +pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124 + +# Install the package +pip install -e . + +# Run the server +poetry run uvicorn docling_serve.app:app --reload +```