Local Deployment of FastGPT + One-API + ChatGLM3-6B Knowledge Base
1. Local Model Setup
Required Repositories & Resources:
ChatGLM3-6B code: https://github.com/THUDM/ChatGLM3
FastGPT: https://github.com/labring/FastGPT
Vector model M3E (deploy via Docker): https://huggingface.co/moka-ai/m3e-base
Anaconda3 installer: https://mirrors.tuna.tsinghua.edu.cn/anaconda/archive/
Create Conda Environment
conda cre ...
Posted on Fri, 15 May 2026 00:19:05 +0000 by DaveEverFade
Local API Invocation for ChatGLM3-6B
ChatGLM3-6B Local API Invocation Method
Starting the Local ChatGLM3-6B Model
1. Create a New Conda Environment
Execute the following commands to create a new Conda environment:
conda create -n chatglm3-demo python=3.11
conda activate chatglm3-demo
2. Navigate to the openai_api_demo Module and Run the Following Code:
python api_server.py
If yo ...
Posted on Sun, 10 May 2026 17:53:22 +0000 by jamesflynn