Skip to content

Commit

Permalink
Add poetry install shell cmd to the readme (#7)
Browse files Browse the repository at this point in the history
* Add poetry install shell cmd to the readme

Signed-off-by: Brent Salisbury <[email protected]>

* Add GPU support instructions

- Validated on an EC2 GPU instance to work.
- Closes #8

Signed-off-by: Brent Salisbury <[email protected]>

* Update README.md

Signed-off-by: Anil Vishnoi <[email protected]>

---------

Signed-off-by: Brent Salisbury <[email protected]>
Signed-off-by: Anil Vishnoi <[email protected]>
Co-authored-by: Anil Vishnoi <[email protected]>
  • Loading branch information
nerdalert and vishnoianil authored Oct 11, 2024
1 parent ac3518c commit 3824aa6
Showing 1 changed file with 24 additions and 0 deletions.
24 changes: 24 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,9 @@
Install the dependencies

```sh
# Install poetry if not already available
curl -sSL https://install.python-poetry.org | python3 -

# Install dependencies
poetry install

Expand All @@ -30,3 +33,24 @@ curl -X 'POST' \
}
}'
```

### Cuda GPU Support

For GPU support try the following:

```sh
# Create a virtual env
python3 -m venv venv

# Activate the venv
source venv/bin/active

# Install torch with the special index
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124

# Install the package
pip install -e .

# Run the server
poetry run uvicorn docling_serve.app:app --reload
```

0 comments on commit 3824aa6

Please sign in to comment.