Python ProxyPool for web spider
22.05.2024, 09.04.2025 -
Python ProxyPool for web spider
Discover an Incredible Website - https://github.com/jhao104/proxy_pool
Description
Python ProxyPool for web spider is a crawler proxy IP pool project that regularly collects and verifies free proxy IP published online to ensure its availability, provides API and CLI usage, and supports extended proxy sources. The project captures free proxy IP, verifies and eliminates failed IPs, forming a highly available proxy pool, with detailed documents and concise structure, suitable for crawler novices to learn.