Senior Scraping Automation Engineer (Python)

#vacancy #data #web #scraping #Python #opportunity #highload #automation #Playwright #Puppeteer #remote

Vacancy - Senior Scraping Automation Engineer
Company - Globalwork
Remote job
Fulltime, B2B contract
Salary - 4000-5000 USD gross

🔺Project
A company developing a web platform that helps freelancers find remote jobs more effectively with AI is looking for ❗Senior Scraping Automation Engineer


✅ What You’ll Do
- Design and develop a reliable web scraping & automation layer: handle and minimize CAPTCHAs, deal with IP blocking (IP rotation, proxies, rate limiting), automate systems with email verification, verification codes/links, logins, and other multi-step flows.
- Build and scale high-load services: workers, task queues, flow orchestration.
- Build a platform that scales reliably: retries, deduplication, throttling, graceful degradation, timeouts.
- Design an architecture that supports horizontal scaling and remains resilient to unstable external systems, UI changes, deadlocks, and partial failures.
- Set up monitoring and alerting for critical systems (CAPTCHA spikes, blocks, failure rates by ATS, queue health, etc.).

✅ We expect from You
- 5+ years of Scraping Automation experience.
- Strong understanding of anti-bot / anti-scraping constraints: CAPTCHAs, IP blocking, proxies, session persistence, throttling, redirect loops, retries, and timeouts.
- Experience building high-load distributed systems with microservices, workers and queues, designed for fault tolerance and scalability.
- Strong practical production experience with Python for scraping, automation, or integration-heavy services.
- Hands-on production experience with web scraping / browser automation: Playwright/ Puppeteer / Selenium, dynamic websites, SPAs, unstable external systems, and anti-bot / anti-scraping constraints.
- Confident with Postgres, Redis and NATS (or similar message brokers) in production.

📮 For applications please write to Показать контакты