Python Developer (Web Scraping)

TL;DR

Python Developer (Web Scraping): Building and maintaining advanced automated data extraction pipelines for complex financial portals with an accent on Playwright, MFA handling, and serverless AWS architecture. Focus on designing scalable, fault-tolerant scraping systems and reverse-engineering secure authentication flows.

Location: Must be based in Lisbon, Portugal (Hybrid: 4 days in office, 1 day remote).

Company

hirify.global is a leading financial technology platform providing access to alternative investments for the global wealth management industry.

What you will do

• Design and implement advanced scraping solutions using Python, Playwright, and AWS.
• Automate interactions with JavaScript-heavy and authentication-secured websites, including MFA and CAPTCHA handling.
• Architect scraping pipelines using serverless AWS components like Lambda, Step Functions, and S3.
• Build scalable systems with fault tolerance, intelligent logging, and retry mechanisms.
• Integrate and manage complex workflows across multiple portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Requirements

• 5+ years of experience in Python development with a focus on automation and data extraction.
• Proven expertise in web scraping using tools like Playwright, Selenium, or Scrapy.
• In-depth experience handling multi-step authentication flows, MFA, and session management.
• Proficiency in deploying and managing scraping workloads in AWS (Lambda, S3, IAM, CloudWatch).
• Solid understanding of web protocols (HTTP/HTTPS) and ability to reverse-engineer network calls.
• Must be based in Lisbon, Portugal and able to work from the office 4 days per week.

Nice to have

• Experience with CI/CD pipelines, Docker, and infrastructure as code (Terraform/CloudFormation).
• Familiarity with data pipeline orchestration tools like Apache Airflow.
• Background in data engineering or ETL workflows.
• Experience scraping from secure enterprise-level portals in finance, healthcare, or legal sectors.

Culture & Benefits

• Competitive salary with annual performance bonus and equity for all full-time employees.
• Comprehensive healthcare coverage with 100% employer-paid health and dental insurance.
• Generous paid time off (PTO) policy.
• Collaborative office environment focused on innovation and team interaction.