Senior Software Engineer (Web Scraping)

Location: Madrid, Spain

Salary: €46,000–€70,000 per year

Company

hirify.global is a consumer intelligence company that processes large-scale retail and digital data to provide insights for brands and retailers.

What you will do

• Design and build distributed scraping architectures that scale across thousands of domains.
• Reverse engineer APIs and mobile applications using traffic inspection and debugging tools.
• Detect anti-bot mechanisms and develop crawlers that adapt to browser and device behavior checks.
• Lead technical experimentation in scraping, investigate edge cases, and share solutions with the team.
• Set up anomaly detection and monitoring to identify scraping blockers and failures early.

Requirements

• 5+ years of experience with Python and large-scale scraping projects.
• Strong knowledge of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, proxies, session management, cookies, and TLS.
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.
• Strong debugging skills across browsers, HTTP traffic, and device-level interactions.
• Knowledge of Parquet or Avro, real-time stream processing, and databases such as MongoDB, InfluxDB, and Redis.
• Independent problem-solving skills and the ability to investigate complex, unfamiliar technical challenges.

Nice to have

• Experience with real-device simulation for mobile scraping and high-security or mobile-first platforms.
• Experience maintaining distributed task queues such as Celery or Kafka.
• Exposure to Linux, AWS, GCP, Kubernetes, Cloud Run, or Cloud Functions.

Culture & Benefits

• Flexible working environment and flexible hours.
• Ownership and freedom to experiment in an innovation-focused team.
• Volunteer time off.
• LinkedIn Learning.
• Employee Assistance Program.