Building Basic Web Scrapers in Python: HTTP Requests, Concurrency, and Traversal Strategies
Understanding HTTP Verbs in Data Retrieval
Web interactions primarily rely on two HTTP methods: GET and POST. GET requests are stateless and idempotent, typically used for fetching resources directly via a URL. POST requests are designed for transmitting data to a server, often triggered by form submissions or API calls where parameters are emb ...
Posted on Thu, 27 Aug 2026 16:14:40 +0000 by ryeman98
Web Scraping with XPath: Extracting News Headlines from 36Kr
Having previously explored the powerful BeautifulSoup library for HTML parsing and techniques for capturing HTTP requests through on line tools, we now turn our attention to another fundamental web scraping approach: XPath. XPath serves as a query language designed to navigate and select specific portions of XML documents. While originally deve ...
Posted on Fri, 12 Jun 2026 18:32:30 +0000 by 9mm