Building a Private Knowledge Base with FastGPT, ChatGLM, Ollama, and M3E Embeddings
Hardware Requirements
The following configurations are for reference only:
ChatGLM3-6B + M3E: NVIDIA RTX 3060 12GB or higher
Qwen:4B + M3E: NVIDIA RTX 3060 12GB or higher
Qwen:2B + M3E: NVIDIA GTX 1660 6GB or higher
Larger models require better GPU performance. Extremely small models can run on low-end CPUs, but inference accuracy will be poo ...
Posted on Fri, 15 May 2026 11:00:07 +0000 by elementaluk