HyperAI

1. Tutorial Introduction

MiniCPM-V 4.5 is an extremely efficient large-scale end-side model open-sourced by the Natural Language Processing Laboratory of Tsinghua University and Mianbi Intelligence in August 2025. MiniCPM-V 4.5 has 8B parameters. The model has excellent performance in many fields such as pictures, videos, OCR, etc., especially in the understanding of high-refresh videos. It can process high-refresh-rate videos and accurately identify content. The model supports hybrid inference mode to balance performance and response speed. MiniCPM-V 4.5 is end-side deployment-friendly, with low video memory usage and fast inference speed. It is suitable for application in car computers, robots and other devices, setting a new benchmark for the development of end-side AI. The relevant paper results are "MiniCPM-V: A GPT-4V Level MLLM on Your Phone".

The computing resources used in this tutorial are a single RTX 4090 card.

2. Effect display

Image Understanding

Multi-image comparison

OCR text extraction

Video Understanding

3. Operation steps

1. Start the container

2. Usage steps

If "Bad Gateway" is displayed, it means the model is initializing. Since the model is large, please wait about 2-3 minutes and refresh the page.

4. Discussion

🖌️ If you see a high-quality project, please leave a message in the background to recommend it! In addition, we have also established a tutorial exchange group. Welcome friends to scan the QR code and remark [SD Tutorial] to join the group to discuss various technical issues and share application effects↓

Citation Information

The citation information for this project is as follows:

@article{yao2024minicpm,
  title={MiniCPM-V: A GPT-4V Level MLLM on Your Phone},
  author={Yao, Yuan and Yu, Tianyu and Zhang, Ao and Wang, Chongyi and Cui, Junbo and Zhu, Hongji and Cai, Tianchi and Li, Haoyu and Zhao, Weilin and He, Zhihui and others},
  journal={arXiv preprint arXiv:2408.01800},
  year={2024}
}