[Bug]: max_seqs_in_batch=1 induces a FATAL

[rpavlovicTT]

Your current environment

vLLM branch: dev (last verified commit: 2f33504)

tt-metal branch: main (last verified commit: 47fb1a2)

Model Input Dumps

No response

🐛 Describe the bug

Running examples/offline_inference_tt.py with max_seqs_in_batch=1 results in FATAL error

FATAL    | ttnn.pad: For sharded inputs, only height-sharding is supported.

Repro on T3K machine:

python examples/offline_inference_tt.py --model "meta-llama/Meta-Llama-3.1-8B-Instruct" --measure_perf --max_seqs_in_batch 1

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[skhorasganiTT]

Addressed in tenstorrent/tt-metal#17422