Senior Software Engineer (Web Scraping, Data Acquisition, Data Collection)

Location: Hybrid in Warsaw, Poland

Salary: PLN 132,000–194,500 yearly

Company

hirify.global is a consumer intelligence company that processes large-scale retail and digital shelf data to deliver insights into consumer buying behavior for retailers and brands.

What you will do

• Design and build distributed scraping architectures that scale across thousands of domains.
• Reverse engineer APIs and mobile applications using Frida, mitmproxy, Charles Proxy, Burp, and related tools.
• Identify anti-bot measures, fingerprinting, WAFs, JavaScript challenges, and browser behavior detection.
• Develop crawlers that adapt to blocking mechanisms and appear more human-like.
• Introduce anomaly detection and monitoring to identify scraping failures and blockers early.
• Prototype new scraping approaches, investigate edge cases, and share technical knowledge.

Requirements

• 5+ years of experience with Python and large-scale scraping projects.
• Deep knowledge of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, and bypass techhirify.globalues.
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.
• Experience with proxies, session management, cookie injection, TLS tuning, and debugging browser, HTTP, and device-level interactions.
• Knowledge of Parquet or Avro, real-time stream processing, and databases including MongoDB, InfluxDB, and Redis.
• Ability to work in a hybrid setup in Warsaw, Poland.

Nice to have

• Experience with real-device simulation for mobile scraping and high-security or mobile-first platforms.
• Experience with distributed task queues such as Celery or Kafka.
• Exposure to Linux, AWS, GCP, Kubernetes, Cloud Run, or Cloud Functions.

Culture & Benefits

• Ownership and freedom to experiment within an innovation-focused team.
• Collaboration with scraping, engineering, analytics, customer success, operations, and data specialists.
• Flexible working environment and flexible hours.
• Volunteer time off, LinkedIn Learning, and an Employee Assistance Program.
• Opportunities to influence tools, technical strategy, and data acquisition practices.