[Inference] Integrate vllm example #1485
Job | Run time |
---|---|
30s | |
7m 37s | |
4m 20s | |
5m 30s | |
4m 3s | |
7m 29s | |
4m 19s | |
5m 49s | |
4m 20s | |
4m 24s | |
7m 20s | |
5m 38s | |
4m 15s | |
1h 5m 34s |
Job | Run time |
---|---|
30s | |
7m 37s | |
4m 20s | |
5m 30s | |
4m 3s | |
7m 29s | |
4m 19s | |
5m 49s | |
4m 20s | |
4m 24s | |
7m 20s | |
5m 38s | |
4m 15s | |
1h 5m 34s |