BAAI/bge-reranker-v2-minicpm-layerwise RAG Model could not use

[flyfox666]

Bug Report

BAAI/bge-reranker-v2-minicpm-layerwise could not be used in RAG doucment setting

but BAAI/bge-reranker-v2-m3 is ok and no problem

Description

failed as attached

Bug Summary:
equires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.

Steps to Reproduce:

[Outline the steps to reproduce the bug. Be as detailed as possible.]
copy the BAAI/bge-reranker-v2-minicpm-layerwise in to Reranking Model

Expected Behavior:
[Describe what you expected to happen.]

Actual Behavior:
[Describe what actually happened.]

Environment

• Open WebUI Version: v0.1.124

• Ollama (if applicable): 0.1.34

• Operating System: wsl2 win11 docker for desktop

• Browser (if applicable): chrome

Reproduction Details

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• I have included the browser console logs.
• I have included the Docker container logs.

Logs and Screenshots

Browser Console Logs:
[Include relevant browser console logs, if applicable]

Docker Container Logs:
[Include relevant Docker container logs, if applicable]

2024-05-09 18:23:12 Traceback (most recent call last):
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 298, in update_reranking_config
2024-05-09 18:23:12 update_reranking_model(app.state.RAG_RERANKING_MODEL, True)
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 151, in update_reranking_model
2024-05-09 18:23:12 app.state.sentence_transformer_rf = sentence_transformers.CrossEncoder(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 66, in init
2024-05-09 18:23:12 self.config = AutoConfig.from_pretrained(model_name, trust_remote_code=trust_remote_code, revision=revision)
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1141, in from_pretrained
2024-05-09 18:23:12 trust_remote_code = resolve_trust_remote_code(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 622, in resolve_trust_remote_code
2024-05-09 18:23:12 raise ValueError(
2024-05-09 18:23:12 ValueError: Loading /app/backend/data/cache/embedding/models/models--BAAI--bge-reranker-v2-minicpm-layerwise/snapshots/47b5332b296c4d8cb6ee2c60502cc62a0d708881 requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.

Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]

Installation Method

[Describe the method you used to install the project, e.g., manual installation, Docker, package manager, etc.]

Additional Information

[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]

Note

If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!