autocomplet高token消耗 #2228

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

5 tasks done

ShuguangSun opened this issue Apr 9, 2025 · 0 comments

Labels

bug

ShuguangSun commented Apr 9, 2025

例行检查

我已确认目前没有类似 issue
我已确认我已升级到最新版本
我已完整查看过项目 README，尤其是常见问题部分
我理解并愿意跟进此 issue，协助测试和提供反馈
我理解并认可上述内容，并理解项目维护者精力有限，不遵循规则的 issue 可能会被无视或直接关闭

问题描述

通过one-api与直接链接原服务API的FIM的token情况，通过one-api的FIM的token消耗大约是直连的5~10倍

复现步骤

比较两个类似场景（vscode continue, 相同workspace，打开相同的一些文件，对同一个文件从0开始编辑类似的内容）， one-api 比直连的 token 消耗及费用都要高，用两个不同的api key，可以在服务商网站上看到one-api出去的，token消耗量要10倍左右

从one-api的日志看，似乎"补全"的token异常高，经常维持在4k左右

相关截图

ShuguangSun added the bug label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment