Skip to content
Back to pull request #908

Optimize TPU Flash Attention (20x XLA compilation speed-up on 32k long context) #265

Sign in to view logs

Optimize TPU Flash Attention (20x XLA compilation speed-up on 32k long context)

Optimize TPU Flash Attention (20x XLA compilation speed-up on 32k long context) #265

Run time

Learn about OS pricing on GitHub Actions
Job Run time
build-and-test-job (a)
28m 13s
build-and-test-job (b)
13m 18s
build-and-test-job (c)
12m 18s
build-and-test-job (d)
9m 48s
build-and-test-job (e)
12m 15s
1h 15m 52s