Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: 推理minicpmv时,encoding_image_with_clip耗时很久 #11941

Open
4 tasks done
EnzhiZhou opened this issue Feb 18, 2025 · 2 comments
Open
4 tasks done
Labels
enhancement New feature or request

Comments

@EnzhiZhou
Copy link

Prerequisites

  • I am running the latest code. Mention the version if possible as well.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

在高通平台termux,运行ndk编译的库,有增加OpenCL,推理miniCPMV-2.6单张图片和一段文字“请描述图片中人的动作”。总耗时60秒,其中encoding_image_with_clip就花了51秒

Motivation

希望看下是否为该仓库源代码的问题

Possible Implementation

No response

@EnzhiZhou EnzhiZhou added the enhancement New feature or request label Feb 18, 2025
@ylsdamxssjxxdd
Copy link
Contributor

目前clip.cpp的后端不能启用cuda等GPU后端加速,导致解码图像很慢,有人能帮助解决吗❤

1 similar comment
@ylsdamxssjxxdd
Copy link
Contributor

目前clip.cpp的后端不能启用cuda等GPU后端加速,导致解码图像很慢,有人能帮助解决吗❤

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants