[Inference] Integrate vllm example #1482
Job | Run time |
---|---|
30s | |
3m 50s | |
1h 31m 10s | |
3m 54s | |
4m 45s | |
1h 32m 13s | |
1h 34m 7s | |
4m 20s | |
5m 5s | |
1h 32m 33s | |
1h 34m 17s | |
5m 16s | |
1h 33m 4s | |
9h 45m 4s |
Job | Run time |
---|---|
30s | |
3m 50s | |
1h 31m 10s | |
3m 54s | |
4m 45s | |
1h 32m 13s | |
1h 34m 7s | |
4m 20s | |
5m 5s | |
1h 32m 33s | |
1h 34m 17s | |
5m 16s | |
1h 33m 4s | |
9h 45m 4s |