Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLIP模型在部分场景下效果明显低于MobileCLIP模型;请考虑提供MobileCLIPv2模型的.tflite文件 #37

Open
keepChatAlive opened this issue Feb 23, 2025 · 1 comment

Comments

@keepChatAlive
Copy link

在我的测试中,搜索具有特定武器(比如弓箭)的角色图片时,CLIP模型效果明显低于MobileCLIP模型。CLIP模型返回的结果就好像“未理解弓箭这个概念”一样,MobileCLIP排在最开始的结果基本可以准确识别各类冷兵器。
此外,MobileCLIP模型的性能似乎比此次更新前(2024-11)的时候略有下降
可以考虑使用MobileCLIP模型作为默认选项,特别是MobileCLIPv2编码器似乎增加了GPU和多线程支持,优化后性能应该可以类似于当前的CLIP模型

@jelychow
Copy link
Collaborator

TF 模型目前导出测试识别率存在一些问题,故此没有支持, mobile clip 目前没有量化识别速度较慢,看个人选择

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants