From 47e681497519eb8c9b668c23456e5baf5d890d9a Mon Sep 17 00:00:00 2001 From: ai-modelscope Date: Tue, 29 Apr 2025 17:19:49 +0800 Subject: [PATCH] Update README.md --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 296e8ec..ad4976f 100644 --- a/README.md +++ b/README.md @@ -95,7 +95,7 @@ print("thinking content:", thinking_content) print("content:", content) ``` -For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create an OpenAI-compatible API endpoint: +For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint: - SGLang: ```shell python -m sglang.launch_server --model-path Qwen/Qwen3-0.6B --reasoning-parser qwen3 @@ -105,7 +105,7 @@ For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create vllm serve Qwen/Qwen3-0.6B --enable-reasoning --reasoning-parser deepseek_r1 ``` -For local use, applications such as llama.cpp, Ollama, LMStudio, and MLX-LM have also supported Qwen3. +For local use, applications such as Ollama, LMStudio, MLX-LM, llama.cpp, and KTransformers have also supported Qwen3. ## Switching Between Thinking and Non-Thinking Mode