public/model-qwen3-1-7b
38
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
ai-modelscope 2025-04-29 17:20:04 +08:00
parent 0bb2f33adb
commit 08faa2576a
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -95,7 +95,7 @@ print("thinking content:", thinking_content)
print("content:", content) print("content:", content)
``` ```
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create an OpenAI-compatible API endpoint: For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint:
- SGLang: - SGLang:
```shell ```shell
python -m sglang.launch_server --model-path Qwen/Qwen3-1.7B --reasoning-parser qwen3 python -m sglang.launch_server --model-path Qwen/Qwen3-1.7B --reasoning-parser qwen3
@ -105,7 +105,7 @@ For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create
vllm serve Qwen/Qwen3-1.7B --enable-reasoning --reasoning-parser deepseek_r1 vllm serve Qwen/Qwen3-1.7B --enable-reasoning --reasoning-parser deepseek_r1
``` ```
For local use, applications such as llama.cpp, Ollama, LMStudio, and MLX-LM have also supported Qwen3. For local use, applications such as Ollama, LMStudio, MLX-LM, llama.cpp, and KTransformers have also supported Qwen3.
## Switching Between Thinking and Non-Thinking Mode ## Switching Between Thinking and Non-Thinking Mode