Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tests] Add inference predicter tests after tests folders build #42

Closed
wants to merge 21 commits into from

Conversation

yutianchen666
Copy link
Contributor

@yutianchen666 yutianchen666 commented Jan 9, 2024

after pr #31 done

defaults:
run:
shell: bash

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove line

python -m pip install --upgrade pip
pip install -r ./tests/requirements.txt

- name: Start tests-utils
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- name: Start tests-utils
- name: Start tests

run: |
bash -c "./tests/run_test.sh"

- name: Test Summary
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove this if there is no use


on:
workflow_call:
inputs:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove inputs as tests are running on github CI

zhangjian94cn pushed a commit to zhangjian94cn/llm-on-ray that referenced this pull request Feb 4, 2024
* Add deepspeed_inference.py

* update

* fix input

* update

* update scaling config

* Add streaming_generate

* Add DeepSpeedPredictor to model serve

* update README

* Add deepspeed_inference_example

* remove test

* fix return value bug

* Fix DeepSpeedPredictor

* fix generate

* remove examples and debug print

* remove *.sh

* Add deepspeed requirements

* enable DeepSpeed in CI

* update Dockerfile

* add device support

* update

* update

* update

* update

* update

* update

* update

* nit

* nit

* update

* add install oneapi and start-ray-cluster scripts

Signed-off-by: Wu, Xiaochang <[email protected]>

* remove sudo for docker

Signed-off-by: Wu, Xiaochang <[email protected]>

* fix path

Signed-off-by: Wu, Xiaochang <[email protected]>

* nit

Signed-off-by: Wu, Xiaochang <[email protected]>

* nit

Signed-off-by: Wu, Xiaochang <[email protected]>

* nit

Signed-off-by: Wu, Xiaochang <[email protected]>

* nit

Signed-off-by: Wu, Xiaochang <[email protected]>

* nit

Signed-off-by: Wu, Xiaochang <[email protected]>

* update

Signed-off-by: Wu, Xiaochang <[email protected]>

* update deepspeed version

---------

Signed-off-by: Wu, Xiaochang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants