1 месяц назад
Senior Web Scraper (Python)
40 000 - 54 700€
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Web Scraper (Python/Scrapy): Designing and maintaining robust web crawlers and Scrapy spiders for large-scale e-commerce data collection with an accent on resilience, data quality, and anti-bot countermeasures. Focus on architecting crawling solutions across multiple codebases, validating scraped data, and working with HTTP protocols, browser mechanisms, and cloud infrastructure.
Location: Lisbon, Portugal
Salary: €40,000–€54,700 yearly
Company
NIQ for Digital Commerce collects and processes large-scale e-commerce data to provide real-time retail market visibility and analytics for professionals.
What you will do
- Design, implement, and document robust Scrapy spiders that remain resilient to website changes.
- Maintain existing spiders and improve the reliability of data collection.
- Conduct code reviews and validate data quality.
- Design web-crawling solutions using HTTP protocol knowledge, browser mechanisms, and internal tools to address advanced anti-bot countermeasures.
- Contribute to significant developments across multiple codebases and provide technical documentation and training.
Requirements
- Master’s degree in Computer Science, IT, or a related field.
- At least 3 years of professional software engineering experience.
- Knowledge of BeautifulSoup or Scrapy, HTML, JavaScript, and single-page applications.
- Experience with RESTful and/or GraphQL APIs and Python web frameworks such as Django or FastAPI.
- Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting.
- Experience with major cloud providers such as AWS, GCP, or Azure.
Nice to have
- Experience with time-series databases such as InfluxDB.
- Additional Scrapy framework experience.
Culture & Benefits
- Flexible working environment.
- Volunteer time off.
- LinkedIn Learning.
- Employee Assistance Program.
- Autonomous, collaborative environment with opportunities for learning and technically challenging work.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →