Code

Simplified kv caching#20

Code

Draft

jlamypoirier wants to merge 4 commits intoadd_flash_attentionbigcode-project/transformers:add_flash_attentionfrom simpler_pre_allocationbigcode-project/transformers:simpler_pre_allocationCopy head branch name to clipboard

+133-110

Commits

Commits on Apr 24, 2023

• Simplified kv caching

  jlamypoirier

  committed
  e18f754

  Copy full SHA for e18f754

Commits on Apr 25, 2023

• misc

  jlamypoirier

  committed
  42513fb

  Copy full SHA for 42513fb

• Fixes and cleanup

  jlamypoirier

  committed
  4427b7d

  Copy full SHA for 4427b7d

• Remove error

  jlamypoirier

  committed
  b50afe0

  Copy full SHA for b50afe0