New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bge-rerank-base用onnx部署显存持续增长不会释放，直到溢出 #796

Open

ZTurboX opened this issue May 17, 2024 · 2 comments

ZTurboX commented May 17, 2024

bge-rerank-base用onnx部署显存持续增长不会释放，直到溢出

Collaborator

staoxiao commented May 17, 2024

@ZTurboX , you can refer to #789

Author

ZTurboX commented May 20, 2024

@ZTurboX , you can refer to #789

torch model not has this problem, but convert to onnx model has this problem even set batch_size and max_length

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment