Senior Web Scraper (Scrapy)

Location: Warsaw, Poland; hybrid

Salary: PLN 132,000–194,500 yearly

Company

hirify.global is a consumer intelligence company delivering retail and consumer buying insights through large-scale data collection, analytics, and digital shelf technologies.

What you will do

• Design and build distributed scraping architectures that scale across thousands of domains.
• Reverse engineer APIs and mobile applications using traffic analysis and reverse-engineering tools.
• Develop crawlers that handle JavaScript checks, browser behavior detection, fingerprinting, WAFs, and other anti-bot measures.
• Prototype new scraping approaches, investigate edge cases, and share technical knowledge.
• Set up anomaly detection and monitoring to identify scraping blockers and failures early.
• Collaborate with Customer Success, Operations, and Data teams to deliver high-quality data at scale.

Requirements

• 5+ years of experience with Python and large-scale scraping projects.
• Deep knowledge of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, and bypass techniques.
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.
• Experience with proxies, session management, cookie injection, TLS tuning, and debugging browser, HTTP, and device-level interactions.
• Knowledge of Parquet or Avro, real-time stream processing, MongoDB, InfluxDB, and Redis.
• Ability to work in a hybrid setup in Warsaw, Poland.

Nice to have

• Real-device simulation for mobile scraping and experience with high-security or mobile-first platforms.
• Distributed task queues such as Celery or Kafka.
• Linux or cloud experience with AWS or GCP.
• Basic Kubernetes, Cloud Run, or Cloud Functions knowledge.

Culture & Benefits

• Ownership and freedom to experiment within a team focused on innovation.
• Flexible working environment and flexible hours.
• Volunteer time off.
• LinkedIn Learning.
• Employee Assistance Program.