Attention input refactor in the model defintion#176

Merged

masahi merged 6 commits intooctoml:batch-servingfrom masahi:model-attn-input-refactor

Jan 27, 2024

+97-97

Commits on Jan 26, 2024

Commits on Jan 27, 2024

fix
masahi
committed