vLLM+Open WebUI Deployment Devstral-Small-2505

1. Tutorial Introduction

Devstral-Small-2505 is an agent-based large language model (LLM) designed for software engineering tasks, released by Mistral AI and All Hands AI on May 21, 2025. Devstral excels at using tools to explore code bases, edit multiple files, and drive software engineering agents. The model performs well on SWE-bench, making it the top open source model in the benchmark.

This tutorial uses the resources for the dual-SIM A6000.

2. Project Examples

3. Operation steps

1. After starting the container, click the API address to enter the Web interface

If "Model" is not displayed, it means the model is being initialized. Since the model is large, please wait about 2-3 minutes and refresh the page.

2. After entering the webpage, you can start a conversation with the model

How to use

4. Discussion

🖌️ If you see a high-quality project, please leave a message in the background to recommend it! In addition, we have also established a tutorial exchange group. Welcome friends to scan the QR code and remark [SD Tutorial] to join the group to discuss various technical issues and share application effects↓