Назад
Company hidden
2 месяца назад

Web Scraping Engineer (Python)

4 500 - 7 000€
Формат работы
hybrid
Тип работы
fulltime
Грейд
middle/senior
Английский
b2
Страна
Lithuania
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Web Scraping Engineer (Python) (Web Scraping): Building scalable scrapers and backend solutions for high-throughput scraping and parsing infrastructure with an accent on resilient scraping strategies, website unblocking, and system observability. Focus on processing hundreds of thousands of service requests per second, developing asynchronous systems, and maintaining reliable scraping and parsing features.

Location: Vilnius, Lithuania — hybrid

Salary: €4,500–€7,000 gross per month

Company

hirify.global develops proxy and web data scraping solutions for businesses, supporting large-scale scraping and parsing products used by e-commerce, market intelligence, and AI industry clients.

What you will do

  • Develop scalable web scrapers and new scraping and parsing features.
  • Define resilient scraping strategies and unblock websites for scraping.
  • Build backend solutions for scraping and parsing challenges of varying complexity.
  • Improve system observability and maintain the existing infrastructure.
  • Work with infrastructure processing 60PB+ of monthly data traffic, 300k+ service requests per second, and 500k+ Kafka messages per second.

Requirements

  • Professional experience with Python.
  • Understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
  • Git version-control skills.
  • Knowledge of website unblocking, scraping techniques, and open-source scraping tools.
  • Experience with browser Developer Tools, browser automation, TLS/SSL networking, and asynchronous programming.

Nice to have

  • Web development knowledge and experience with CSS selectors or XPath.
  • Experience with Go, C++, browser source code, or frontend frameworks.
  • Experience with Pydantic, FastAPI, SQLAlchemy, Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, or Prometheus.
  • Domain-specific machine learning experience related to scraping.
  • Experience building scalable systems.

Culture & Benefits

  • Access to internal learning options, external conferences, mentorship, and year-round knowledge sharing.
  • Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app.
  • Team events, an overseas workation, and quarterly team-building budgets.
  • Bonus vacation days, paid life-moment days off, barista coffee, and required work tools.

Hiring process

  • Artificial intelligence tools may support application, resume, and response reviews.
  • Final hiring decisions are made by humans.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →