Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include discussions about VoCo-LLaMA in your paper. #13

Open
Yxxxb opened this issue Nov 19, 2024 · 2 comments
Open

Include discussions about VoCo-LLaMA in your paper. #13

Yxxxb opened this issue Nov 19, 2024 · 2 comments

Comments

@Yxxxb
Copy link

Yxxxb commented Nov 19, 2024

Dear authors,
@shuyansy @UnableToUseGit

I kindly think you need to discuss VoCo-LLaMA[1] in the "Intro" section of your paper at the very least.
As I find the citation and discussions related to VoCo-LLaMA are removed in your latest arxiv version (v3).
The motivations and ideas between Video-XL and VoCo-LLaMA are similar.

[1] Xubing Ye, et al. "VoCo-LLaMA: Towards Vision Compression with Large Language Models." arXiv preprint arXiv:2406.12275 (2024).

@shuyansy
Copy link
Collaborator

Dear VoCo-LLaMA team,
Thank you for your valuable feedback regarding the introduction section of our paper and the comparison with VoColLLaMA. We greatly appreciate your thorough review and the opportunity to address these concerns.

Currently, our work is presented as a concise technical report, and as such, we have not yet included detailed discussions for every related work. However, we recognize the importance of elaborating on these distinctions. VoCo-LLaMA is an excellent piece of work, and we have cited it appropriately in our new manuscript. We plan to enhance the discussion in subsequent versions, explicitly addressing the differences and contributions relative to VoCo-LLaMA.

Additionally, we acknowledge there are other related works, particularly regarding KV and prompt compression (e.g., Auto-Compressors, ICAE, Gist, Beacon, etc.), that are relevant to the scope of our study. Our approach introduces several enhancements compared to these methods, which we will detail in future revisions to provide a more comprehensive comparison.

Thank you once again for your insightful comments. Please let me know if you have any other issues.

@Yxxxb
Copy link
Author

Yxxxb commented Nov 19, 2024

Thanks for reply!
And hope to see more interesting work in the visual field of auto-regressive compression!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants