Description
Summary I have a working SaaS web scraper running on a VPS that collects data from a specific website. The core scraper is already built and functioning well — I'm not looking to rebuild it from scratch. The problems to fix: Cloudflare protection blocking requests intermittently (JS challenges, bot detection, TLS fingerprinting) Cookies expire and the scraper doesn't handle re-authentication/session refresh gracefully Additional work needed: WebSocket support — the target site uses WebSocket connections for real-time data; need proper handling, reconnection logic, and message parsing integrated into the scraper Redis integration — use Redis for session/cookie storage, job queuing, caching scraped data, and/or pub-sub between scraper workers What I need specifically: Robust Cloudflare bypass (e.g. curl_cffi, playwright-stealth, session rotation) Smart cookie lifecycle: auto-refresh, re-login on expiry, Redis-backed persistent sessions Stable WebSocket client with auto-reconnect and error handling Redis layer for state management and/or queue (BullMQ, Celery, RQ, etc.) Clean integration into existing codebase — no full rewrites Stack info shared with selected candidates: Scraper language/framework Current architecture on VPS Target site behavior & data structure Ideal candidate: Proven experience bypassing Cloudflare in production Strong with WebSocket clients (handling ping/pong, reconnects, binary/JSON frames) Familiar with Redis (sessions, queues, pub-sub) Comfortable patching existing code cleanly To apply: Send a short message describing how you've handled Cloudflare bypass + session management in a past project. Bonus if you've used Redis + WebSockets in a scraping context. Budget: Fixed price — open to proposals Timeline: ASAP