Code

Ap/fix mistral template#183

Code

Closed

aldopareja wants to merge 10 commits intomaininstructlab/training:mainfrom ap/fix_mistral_templateinstructlab/training:ap/fix_mistral_templateCopy head branch name to clipboard

+295-158

Commits

Commits on Aug 14, 2024

• more timeout

  aldo-pareja

  committed
  6d2f446

  Copy full SHA for 6d2f446

• increased performance of data process and made a flag for the number of parallel processes

  aldo-pareja

  committed
  8602d22

  Copy full SHA for 8602d22

• fixed multipack sampler and made more efficient parallel calls over datasets

  aldo-pareja

  committed
  804512d

  Copy full SHA for 804512d

• fixed linting

  aldo-pareja

  committed
  3ea8438

  Copy full SHA for 3ea8438

Commits on Aug 15, 2024

• fixed the cosine loss

  aldo-pareja

  committed
  b13fe5c

  Copy full SHA for b13fe5c

Commits on Aug 20, 2024

• printing data arguments so input data is traceable

  aldo-pareja

  committed
  80f3cc6

  Copy full SHA for 80f3cc6

Commits on Aug 27, 2024

• Refactor special tokens handling and improve chat template flexibility

  Show description for f98edae
  aldo-pareja

  committed
  f98edae

  Copy full SHA for f98edae

• Refactor data processing and tokenization

  Show description for 020e6ae
  aldo-pareja

  committed
  020e6ae

  Copy full SHA for 020e6ae

• added MixtralForCausalLM as another supported model

  aldo-pareja

  committed
  246527c

  Copy full SHA for 246527c

Commits on Aug 29, 2024

• Merge remote-tracking branch 'origin/main' into ap/fix_mistral_template

  Show description for e61f228
  aldo-pareja

  committed
  e61f228

  Copy full SHA for e61f228