Scraping Classical Poetry Websites with Scrapy
Project Setup in PyCharm
Create a new Python project named ScrapyProject in PyCharm.
Scrapy Installation
Package Installation
pip install scrapy
For faster installasion in China:
pip install scrapy -i https://pypi.tuna.tsinghua.edu.cn/simple/
Project Structure Initilaization
scrapy startproject poetry_scraper
Key directories and files:
spid ...
Posted on Fri, 12 Jun 2026 16:32:14 +0000 by junrey