Code

Feat/trust remote code#73

Code

Open

jouDance wants to merge 31 commits intoray-project:mainray-project/llmperf:mainfrom Jounce-IO:feat/trust_remote_codeJounce-IO/llmperf:feat/trust_remote_codeCopy head branch name to clipboard

+16,108-32

Commits

Commits on Jul 16, 2024

• feat: add sample time to result_metrics

  jonzarecki

  committed
  2aa9902

  Copy full SHA for 2aa9902

• feat: request_metrics instead of request_config

  jonzarecki

  committed
  cea6baa

  Copy full SHA for cea6baa

Commits on Jul 31, 2024

• fix: add check to prevent bug in llmperf

  jonzarecki

  committed
  8520c3c

  Copy full SHA for 8520c3c

• chore: add gh issue of vllm

  jonzarecki

  committed
  e49e32b

  Copy full SHA for e49e32b

Commits on Aug 1, 2024

• fix: add handling for when certain errors occur in vllm

  jonzarecki

  committed
  fa28bd2

  Copy full SHA for fa28bd2

Commits on Sep 1, 2024

• add dolly dataset

  jonzarecki

  committed
  26db07c

  Copy full SHA for 26db07c

Commits on Sep 10, 2024

• Use appropriate tokenizer instead of defaulting to Llama tokenizer

  markVaykhansky

  committed
  5ff3299

  Copy full SHA for 5ff3299

• CR Fixes

  markVaykhansky

  committed
  fdb8e21

  Copy full SHA for fdb8e21

• Merge pull request #1 from Jounce-IO/use_appropriate_tokenizer

  Show description for fbf6782
  markVaykhansky

  authored
  fbf6782

  Copy full SHA for fbf6782

Commits on Sep 11, 2024

• Trim line optimally

  markVaykhansky

  committed
  437f351

  Copy full SHA for 437f351

• Add break + fix token count return value

  markVaykhansky

  committed
  f0a0bc6

  Copy full SHA for f0a0bc6

• Log prompts

  markVaykhansky

  committed
  aa30928

  Copy full SHA for aa30928

• Bugfix - returned non-trimmed line

  markVaykhansky

  committed
  f1e0001

  Copy full SHA for f1e0001

• Fix typo

  markVaykhansky

  committed
  5760f15

  Copy full SHA for 5760f15

• Merge pull request #2 from Jounce-IO/fix_generating_more_tokens_then_required

  Show description for e6ff81b
  markVaykhansky

  authored
  e6ff81b

  Copy full SHA for e6ff81b

• CR Fixes

  markVaykhansky

  committed
  5a275ad

  Copy full SHA for 5a275ad

• Merge pull request #3 from Jounce-IO/log_generated_propmpts

  Show description for d7622ba
  markVaykhansky

  authored
  d7622ba

  Copy full SHA for d7622ba

• Better CLI argument

  markVaykhansky

  committed
  94cc3f3

  Copy full SHA for 94cc3f3

Commits on Sep 12, 2024

• Merge pull request #4 from Jounce-IO/log_generated_propmpts

  Show description for 004d3af
  markVaykhansky

  authored
  004d3af

  Copy full SHA for 004d3af

Commits on Sep 19, 2024

• Fail llm-perf if error rate is bigger than 50

  markVaykhansky

  committed
  f5ec0b4

  Copy full SHA for f5ec0b4

• Fail llm-perf if error rate is bigger than 50

  markVaykhansky

  committed
  080c6f4

  Copy full SHA for 080c6f4

• Merge pull request #5 from Jounce-IO/raise-exception-when-errors

  Show description for afafa0b
  markVaykhansky

  authored
  afafa0b

  Copy full SHA for afafa0b

Commits on Sep 23, 2024

• Add max num errors allowed parameter

  markVaykhansky

  committed
  7cd1727

  Copy full SHA for 7cd1727

• Ignore dotenv

  markVaykhansky

  committed
  10dfbbd

  Copy full SHA for 10dfbbd

• Fix param typo

  markVaykhansky

  committed
  2465465

  Copy full SHA for 2465465

• Merge pull request #6 from Jounce-IO/raise-exception-when-errors

  Show description for f816533
  markVaykhansky

  authored
  f816533

  Copy full SHA for f816533

Commits on Sep 24, 2024

• Change fixed error count to error ratio

  markVaykhansky

  committed
  b825817

  Copy full SHA for b825817

• Remote error rate check after finished llmperf run

  markVaykhansky

  committed
  a3f3c21

  Copy full SHA for a3f3c21

• Fix constant value

  markVaykhansky

  committed
  1edae85

  Copy full SHA for 1edae85

Commits on Sep 25, 2024

• Fail on timeout

  markVaykhansky

  committed
  f32d776

  Copy full SHA for f32d776

Commits on Oct 9, 2024

• add

  jouDance

  committed
  5e7e05c

  Copy full SHA for 5e7e05c