public/model-qwen3-embedding-8b
62
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

add use case for vllm & modify Citation (#5)

Browse Source 
- add use case for vllm & modify Citation (7c0a850d147a83b59e7422f38fb6a672df0c52d5)

Co-authored-by: yanzhao <zyznull@users.noreply.huggingface.co>
This commit is contained in:
ai-modelscope 2025-06-12 00:23:52 +08:00
parent 90b66b21a0
commit 56f8ecd8be
1 changed files with 1 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -64,11 +64,9 @@ KeyError: 'qwen3'
# Requires sentence-transformers>=2.7.0 # Requires sentence-transformers>=2.7.0
from sentence_transformers import SentenceTransformer from sentence_transformers import SentenceTransformer
from modelscope import snapshot_download
# Load the model # Load the model
model_dir = snapshot_download("Qwen/Qwen3-Embedding-8B") model = SentenceTransformer("Qwen/Qwen3-Embedding-8B")
model = SentenceTransformer(model_dir)
# We recommend enabling flash_attention_2 for better acceleration and memory saving, # We recommend enabling flash_attention_2 for better acceleration and memory saving,
# together with setting `padding_side` to "left": # together with setting `padding_side` to "left":