[Finetune] Add finetune Gaudi workflow #1408

Job	Run time
Lint / lint	32s
Tests / getting-started-test (3.9)	1m 23s
Tests / bare-test (3.9)	1m 38s
Tests / getting-started-test (3.10)	1m 42s
Tests / setup-test (3.9)	2m 14s
Tests / bare-test (3.10)	1m 38s
Tests / setup-test (3.10)	2m 23s
Tests / bare-test (3.11)	1m 21s
Tests / getting-started-test (3.11)	1m 41s
Tests / setup-test (3.11)	1m 57s
Tests / docker-test (3.9)	18m 14s
Tests / docker-test (3.10)	16m 14s
Tests / docker-test (3.11)	17m 15s
Benchmark / benchmark	1m 35s
Finetune / finetune (EleutherAI/gpt-j-6b)	17m 16s
Finetune_Gaudi / finetune (EleutherAI/gpt-j-6b)	1m 3s
Finetune / finetune (NousResearch/Llama-2-7b-chat-hf)	14m 14s
Finetune / finetune (mistralai/Mistral-7B-v0.1)	19m 23s
Finetune_Gaudi / finetune (meta-llama/Llama-2-7b-chat-hf)	1s
Finetune / finetune (google/gemma-2b)	6m 49s
Inference / inference (gpt-j-6b)	10m 24s
Finetune_Gaudi / finetune (mistralai/Mistral-7B-v0.1)	1s
Inference / inference (mistral-7b-v0.1)	4m 37s
Finetune_Gaudi / finetune (google/gemma-2b)	3s
Inference / inference (mpt-7b-ipex-llm)	5m 23s
Inference / inference (llama-2-7b-chat-hf-vllm)	3m 28s
Inference_Gaudi / inference (llama-2-7b-chat-hf)	1m 6s
Inference / inference (gemma-2b)	7m 22s
Inference_Gaudi / inference (llama-2-70b-chat-hf)	1m 34s
Inference_Gaudi / inference (llama-2-7b-chat-hf-vllm)	1m 39s
	2h 44m 10s

Provide feedback