Назад
Company hidden
1 месяц назад

Senior Software Engineer (Web Scraping)

46 000 - 70 000€
Формат работы
remote (только Portugal)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Portugal
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Software Engineer (Web Scraping): Design and build distributed scraping architectures that scale across thousands of domains with an accent on API and mobile-app reverse engineering, anti-bot technologies, and large-scale data collection. Focus on detecting scraping blockers, developing human-like crawlers, and building anomaly monitoring for reliable high-volume extraction.

Location: Remote role associated with Lisbon, Portugal

Salary: €46,000–€70,000 yearly

Company

hirify.global provides consumer intelligence and digital shelf data, processing billions of data points from web and mobile sources for retailers and brands.

What you will do

  • Design and build distributed scraping architectures that scale across thousands of domains.
  • Reverse engineer APIs and mobile applications using Frida, mitmproxy, Charles Proxy, Burp, and related tools.
  • Detect anti-bot measures and develop crawlers that can adapt to browser and JavaScript challenges.
  • Lead technical innovation by identifying edge cases, prototyping new approaches, and sharing knowledge.
  • Build anomaly detection and monitoring to identify blockers and failures early.
  • Collaborate with Customer Success, Operations, and Data teams to deliver high-quality data at scale.

Requirements

  • 5+ years of experience with Python and large-scale scraping projects.
  • Deep understanding of anti-bot technologies, fingerprinting, WAFs, and JavaScript challenges.
  • Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.
  • Experience with proxies, session management, cookie injection, TLS tuning, and debugging browser, HTTP, and device-level interactions.
  • Knowledge of Parquet or Avro, real-time stream processing, MongoDB, InfluxDB, and Redis.

Nice to have

  • Real-device simulation for mobile scraping and experience with high-security or mobile-first platforms.
  • Experience maintaining distributed task queues such as Celery or Kafka.
  • Linux or cloud experience with AWS or GCP.
  • Basic knowledge of Kubernetes, Cloud Run, and Cloud Functions.

Culture & Benefits

  • Flexible working environment and flexible hours.
  • Ownership and freedom to experiment within an innovation-focused team.
  • Volunteer time off.
  • LinkedIn Learning.
  • Employee Assistance Program.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →