Deploying Qwen3 and Qwen3-VL on Raspberry Pi 4B with ImmortalWrt and llama.cpp
System Installation and Storage Configuration
Download the ImmortalWrt image for the bcm2711 target (Raspberry Pi 4B) from the official releases. Use a tool like BalenaEtcher to flash the rpi-4-ext4-factory.img.gz image onto the TF card.
After flashing, the root partition defaults to a minimal size. To utilize the full storage capacity for mod ...
Posted on Sat, 22 Aug 2026 16:53:04 +0000 by phppssh
DeepSeek API Integration and Qwen3-0.6B Local Deployment: A Practical Guide
DeepSeek API Integration
DeepSeek provides a convenient API service for integrating large language models into applications. This section covers the process of registering an account, testing the API with Postman, and implementing the API call in Python.
1.1 Account Registration and Funding
Visit the DeepSeek Open Platform and click the " ...
Posted on Tue, 02 Jun 2026 17:32:15 +0000 by UnsuitableBadger
Building a Production-Ready Qwen3 Model Service Platform from Scratch
System Requirements
This guide covers deploying Qwen3 models on an Ubuntu 22.04 cloud instance equipped with an NVIDIA A10 GPU (24GB VRAM). The setup requires network connectivity for downloading container images and model files.
Environment Verification
Confirm GPU availability:
lspci | grep -i nvidia
gcc --version
NVIDIA Driver Installation
...
Posted on Thu, 14 May 2026 21:11:23 +0000 by phyzar