[Inference] Integrate vllm example (#262) #132
Job | Run time |
---|---|
28s | |
19m 27s | |
3m 54s | |
19m 9s | |
4m 55s | |
3m 33s | |
17m 50s | |
5m 20s | |
22m 35s | |
3m 40s | |
4m 17s | |
20m 31s | |
20m 31s | |
2h 26m 10s |
Job | Run time |
---|---|
28s | |
19m 27s | |
3m 54s | |
19m 9s | |
4m 55s | |
3m 33s | |
17m 50s | |
5m 20s | |
22m 35s | |
3m 40s | |
4m 17s | |
20m 31s | |
20m 31s | |
2h 26m 10s |