1 день назад
Staff Crawling Engineer (Node.js)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff Crawling Engineer (Node.js): Building and operating reliable production crawling and data-collection services for healthcare and life sciences products with an accent on concurrency, browser automation, and data quality. Focus on integrating crawlers with Kafka and downstream processing systems, recovering from production failures, and designing scalable monitoring and maintenance workflows.
Location: Belgrade, hybrid with remote work and occasional office days
Company
provides data, software, AI, and consulting solutions for healthcare and life sciences companies through its Smile BI Devs software and analytics unit.
What you will do
- Design, build, and maintain Node.js crawling and data-collection services for static, dynamic, and JavaScript-rendered websites.
- Develop crawling processes with concurrency control, scheduling, retries, monitoring, rate limits, and failure recovery.
- Integrate crawling services with Kafka and downstream data-processing systems.
- Ensure the completeness, consistency, timeliness, and quality of collected data.
- Diagnose production failures, website changes, and performance issues.
- Contribute to architecture, code reviews, technical standards, documentation, testability, and mentoring.
Requirements
- 10+ years of professional software-engineering experience or equivalent Staff-level capability.
- Substantial experience building and operating production web crawlers, web-scraping systems, or comparable data-acquisition services.
- Advanced Node.js and JavaScript skills, including asynchronous programming, concurrency, and event-driven processing.
- Strong knowledge of HTTP, HTML, DOM structures, APIs, and dynamically rendered websites.
- Experience with browser automation using Puppeteer, Playwright, or Selenium.
- Experience with SQL, relational databases, Git, Linux, Docker, and reliable production processes.
- Professional working proficiency in English.
Nice to have
- TypeScript or Python experience.
- Kafka and PostgreSQL experience.
- Knowledge of CI/CD, monitoring, alerting, and observability.
- Experience with proxy management, access restrictions, resilient browser automation, international websites, multilingual data, or e-commerce datasets.
Culture & Benefits
- Flexible remote setup with occasional office days and workspace access.
- Flexible working hours supporting collaboration and focused work.
- Private healthcare insurance.
- €1,000 annual training budget.
- 35 days of annual leave.
- Paid parking, office kitchen, and a dog-friendly workplace.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Utorg
3 часа назад
Senior Backend Developer (Fintech)
5 дней назад
Expert Engineer Backend T Cloud Public (REF5659N)
BETBY
3 часа назад
Senior Scala Engineer (iGaming)
5 000 - 7 000€
5 дней назад
Senior Backend Engineer (DevX)
Valletta.Software | AI-Care
3 часа назад
Lead Go Engineer (AI/ML integration and configuration)
4 500 - 4 500$
1 день назад
Go Developer (Fintech)
2 900 - 4 550€