Experienced Web Scraping Engineer (Python)

Location: Remote, associated with Warsaw, Poland

Salary: From PLN 23,000 gross per month; compensation is negotiable based on skills and experience.

Company

hirify.global develops proxy and web data scraping solutions for businesses, including Fortune 500 companies.

What you will do

• Develop scalable web scrapers and new scraping and parsing features.
• Define resilient scraping strategies and unblock websites for scraping.
• Develop backend solutions for scraping and parsing problems of varying scale.
• Improve system observability and maintain the existing infrastructure.
• Work with systems processing 60PB+ of monthly data traffic, 300k+ service requests per second, and 500k+ Kafka messages per second.

Requirements

• Professional experience with Python and asynchronous programming.
• Understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
• Experience with Git, browser automation, Dev Tools, and different web scraping techniques and open-source tools.
• Knowledge of website unblocking and network technologies, including TLS and SSL.

Nice to have

• Web development knowledge and experience with CSS selectors or XPath.
• Experience with Go, C++, browser source code, or a frontend framework.
• Experience with Pydantic, FastAPI, SQLAlchemy, Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, or Prometheus.
• Domain-specific machine learning experience or experience building scalable systems.

Culture & Benefits

• Remote full-time work within an engineering team focused on large-scale scraping and parsing systems.
• Support for learning how to build scrapers and sharing practical expertise.
• Collaboration with colleagues from different nationalities and professional backgrounds.