vLLM + Open WebUI Deployment Jan-v1-4B
1. Tutorial Introduction
Jan-v1-4B is a 4-billion-parameter open-source language model released by the Jan team (JanHQ) in August 2025. Targeted at intelligent body-based reasoning and tool invocation, it is the first release of the Jan family and is optimized for real-world workflow scenarios in Jan apps. Based on Qwen3-4B-Thinking-2507, this model has been fine-tuned and expanded, achieving an accuracy of 91.11 TP3T on the SimpleQA benchmark, demonstrating significant performance improvements achieved through model expansion and tuning. Official documentation also indicates that it can outperform some larger models on this benchmark.
This tutorial uses resources for a single RTX 4090 card.
2. Project Examples

3. Operation steps
1. After starting the container, click the API address to enter the Web interface

2. After entering the webpage, you can start a conversation with the model
If "Model" is not displayed, it means the model is being initialized. Since the model is large, please wait about 2-3 minutes and refresh the page.
How to use

4. Discussion
🖌️ If you see a high-quality project, please leave a message in the background to recommend it! In addition, we have also established a tutorial exchange group. Welcome friends to scan the QR code and remark [SD Tutorial] to join the group to discuss various technical issues and share application effects↓
