Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Peft token level fwd/bwd #1233

Closed
wants to merge 10 commits into from
+711 −215
Closed

Peft token level fwd/bwd #1233

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
03f7e5e
init
xinhaoc Nov 23, 2023
325c177
Merge branch 'peft' into peft_xinhao
xinhaoc Nov 27, 2023
4ddcc7b
Merge branch 'peft' into peft_xinhao
xinhaoc Dec 4, 2023
96cb2a9
Merge branch 'peft' into peft_xinhao
xinhaoc Jan 17, 2024
0444a9d
fix alignment
xinhaoc Jan 24, 2024
3a6b2ab
Merge branch 'peft' into peft_xinhao
xinhaoc Feb 6, 2024
cffbf4f
fix
xinhaoc Feb 9, 2024
99bcadf
Merge branch 'peft' into peft_xinhao
xinhaoc Feb 15, 2024
dd1366f
Merge branch 'peft' into peft_xinhao
xinhaoc Feb 25, 2024
17257cd
Merge branch 'peft' into peft_xinhao
goliaro Apr 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'peft' into peft_xinhao
@xinhaoc
xinhaoc authored Jan 17, 2024
commit 96cb2a966337f00bb0f899dd3a3d27470c41d30d
1 change: 0 additions & 1 deletion src/ops/inc_multihead_self_attention.cu
View file
Original file line number Diff line number Diff line change
@@ -1098,7 +1098,6 @@ void peft_bwd_kernel(IncMultiHeadSelfAttentionMeta const *m,
int strideA = m->vProjSize;
int strideB = m->vProjSize;
int strideC = num_tokens * num_total_tokens; // num_new_tokens * total_tokens

checkCUDA(cublasGemmStridedBatchedEx(m->handle.blas,
CUBLAS_OP_T,
CUBLAS_OP_N,
You are viewing a condensed version of this merge commit. You can view the full changes here.