Understanding Scrapy's Request Object and Data Flow Between Components
Data Flow Between Scrapy Components
Scrapy manages communication between different components through two fundamental objects: Request and Response. The Spider generates Request objects, which travel through the engine and download middleware before being executed by the downloader. Each Request eventually produces a Response that flows back th ...
Posted on Fri, 08 May 2026 21:33:48 +0000 by bow-viper1
Automating 12306 Train Ticket Queries: A Comparative Study of HTTP Scraping and Selenium Automation
Automating 12306 Train Ticket Queries: A Comparative Study of HTTP Scraping and Selenium Automation
Automating routine tasks on web platforms often requires choosing between lightweight API interaction and robust browser automation. This article details two Python implementations for querying train availability on the 12306 railway system. The ...
Posted on Fri, 08 May 2026 15:57:37 +0000 by maxelcat