Building API Automation Test Framework with Python Requests
This framework implements automated interface testing using Python's unittest module combined with the requests library for HTTP operations.
Project Structure
aototest/
├── Common/ # Utility classes: database helpers, file operations
├── Config/ # Configuration: environment URLs, credentials, DB connections
├── Data/ ...
Posted on Sun, 19 Jul 2026 16:59:10 +0000 by businessman332211
Simulating GitHub Login with Python requests Library
Simulating GitHub Login
Login Process Overview
When implementing login simulation for GitHub, three main steps are required:
Retrieve the authenticity token from the login page using session.get
Construct form data and headers, then submit to the /session endpoint via session.post
Verify login status by parsing the profile page title
Main Fun ...
Posted on Sat, 11 Jul 2026 16:55:50 +0000 by Colton.Wagner
Advanced Web Scraping with Python Requests: Session Management, Proxies, and Thread Pools
Session-Based Cookie Handling
When scraping user-specific data, traditional requests.get() calls often fail to retrieve the target information. Consider a scenario where you need to access a user's profile page on a social networking site. Without proper cookie management, you'll receive the login page instead of the authenticated profile data. ...
Posted on Fri, 26 Jun 2026 17:27:49 +0000 by Genesis730
Python Requests Library for HTTP Operations
Installation
Install the library via pip:
pip install requests
For unstable networks, specify a mirror source:
pip install requests -i https://pypi.mirrors.ustc.edu.cn/simple/
Available mirrors include:
Tsinghua University: https://pypi.tuna.tsinghua.edu.cn/simple
Alibaba Cloud: http://mirrors.aliyun.com/pypi/simple/
University of Science an ...
Posted on Tue, 23 Jun 2026 16:28:07 +0000 by bobbfwed
Ajax Data Scraping and MySQL Storage Implementation
Practical Ajax Data Scraping and MySQL Integration
Target Data Extraction
Extract movie details including title, categories, duration, release location/date, description, and rating from Scrape | Movie pages, then store in MySQL database.
Ajax Request Analysis
By inspecting network requests from the target website, we identify the structured da ...
Posted on Fri, 19 Jun 2026 18:01:01 +0000 by citricsquid
Advanced Python Web Scraping for TV Show Information and Search
This article demonstrates how to create a Python scraper to collect online TV show data and implement advanced search functionality. We use requests and BeautifulSoup for scraping, and pandas for data processing and storage.
#### 1. Scraping Online TV Show Information
First, we need a website that provides TV show listings, assuming we can lega ...
Posted on Wed, 03 Jun 2026 17:41:08 +0000 by ridiculous
Essential Web Scraping Techniques using Urllib and Requests in Python
Utilizing the urllib Module for Web Requests
The urllib library is a built-in Python module used for handling URLs. It provides several ways to fetch data from the web, ranging from simple function calls to complex custom handlers.
Basic Web Access and Custom Openers
The simplest way to retrieve a webpage is using urlopen. For more advanced con ...
Posted on Tue, 26 May 2026 16:22:22 +0000 by andybrooke
Managing Sessions, Errors, and HTTP Requests in Python Web Scraping
Handling HTTP Cookies and Session State
HTTP is inherently stateless, meaning each request is independent. To maintain user sesions across multiple requests, web servers rely on cookies. When building scrapers, managing these cookies correctly is essential for accessing authenticated or personalized content.
Manual Cookie Injection
The simplest ...
Posted on Wed, 20 May 2026 07:53:20 +0000 by weknowtheworld
Practical Network Programming in Python: Sockets and HTTP
Socket Programming Basics
Socket communication enables direct network data transfer between applicatinos. Python's socket module provides essential functionality for creating network connections:
Server Implementation
import socket
server = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
host = socket.gethostname()
port = 54321
server.bind( ...
Posted on Tue, 19 May 2026 22:51:16 +0000 by renzaho
Building an API Automation Framework with Excel and Requests
Framework Overview
Managing API test cases across multiple endpoints often leads to scattered Python files that become difficult to maintain. When an API changes, developers must locate and update corresponding test files individually. This framework addresses the problem by centralizing test data in Excel files, allowing test case updates with ...
Posted on Tue, 19 May 2026 11:53:19 +0000 by phphelpme