llm-ray inference & finetune

Support OpenAI protocol and REST API #18

Sign in to view logs

Triggered via pull request January 3, 2024 03:21

KepingYan

synchronize #18

rest_api

Status Success

Total duration 1h 1m 2s

Artifacts –

workflow_orders_on_pr.yml

on: pull_request

Matrix: call-finetune / finetune test

Matrix: call-inference / inference test

Annotations

7 warnings

call-inference / inference test (mistral-7b-v0.1)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

call-inference / inference test (gpt-j-6b)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

call-inference / inference test (mpt-7b, nathan0/mpt-7b-deltatuner-model)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

call-inference / inference test (mpt-7b-bigdl)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

call-finetune / finetune test (EleutherAI/gpt-j-6b)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

call-finetune / finetune test (meta-llama/Llama-2-7b-chat-hf)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

call-finetune / finetune test (meta-llama/Llama-2-7b-chat-hf)

Delete stale containers failed, docker rm fail with exit code 1 for container 1aafdb1fdfd78fd073b5eb71c408472ecaba0d5ff9f1b065f80304411e1c8480