New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

不知道什么原因，感觉速度慢于pytorch推理 #880

Open

zhuxiaosheng opened this issue Aug 27, 2023 · 1 comment

zhuxiaosheng commented Aug 27, 2023

不知道什么原因，一位用trt推理会更快，但是在cf10数据集上测试的对比结果是：相同参数的情况下，推理耗时是pytorch的4倍
如下图：

yangxianpku commented Nov 9, 2023

建议你先转成trt engine，不要在线转

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment