# Craigslist Automated Lead Pipeline & Anti-Bot hCaptcha Solver

Canonical page: https://taharafi.com/work/craigslist-scraper/
Author: Taha Rafi

Fault-tolerant Python pipeline extracting 27,000+ listings in minutes with automated hCaptcha bypass.

## Overview
Engineered a fault-tolerant Python extraction pipeline capable of indexing 27,000+ Craigslist listings in minutes, solving hCaptcha challenges via direct protocol APIs, and parsing obfuscated contact numbers into formatted Excel workbooks.

## Technologies
Python 3, Requests, Selenium, CapSolver API, OpenPyXL, PyInstaller

## Engineering
- High-Throughput Search Walk: Queries Craigslist JSON search API with date-cursor pagination, extracting 27k summaries in under a minute.
- Automated CAPTCHA Solver: CapSolver protocol integration solving hCaptcha challenges against direct reply endpoints.
- Obfuscated Number Parser: Proprietary regex parser extracting masked phone numbers while ignoring prices and dates.
- Fault-Tolerant State Machine: Post-ID keyed architecture that flushes to disk every 200 records, allowing seamless pause/resume.

## Deliverables
- Python CLI Scraper
- CapSolver Anti-Bot Module
- Obfuscated Contact Regex Parser
- Standalone Windows Binary

## Sources
Contact: connect@taharafi.com