[Inference] Integrate vllm example #1490
Job | Run time |
---|---|
33s | |
18m 41s | |
20m 46s | |
18m 23s | |
5m 20s | |
21m 3s | |
3m 52s | |
17m 39s | |
4m 36s | |
4m 17s | |
21m 17s | |
4m 25s | |
3m 55s | |
2h 24m 47s |
Job | Run time |
---|---|
33s | |
18m 41s | |
20m 46s | |
18m 23s | |
5m 20s | |
21m 3s | |
3m 52s | |
17m 39s | |
4m 36s | |
4m 17s | |
21m 17s | |
4m 25s | |
3m 55s | |
2h 24m 47s |