Senior Data Scraping Engineer (Python)

TL;DR

Senior Data Scraping Engineer (Python): Building and managing end-to-end data extraction workflows for a hybrid AI-human platform with an accent on dynamic content handling and data quality. Focus on scaling scraping operations, ensuring reliability across complex web structures, and integrating LLMs to enhance automation.

Compensation: $37 per hour

Company

hirify.global connects specialized talent with AI projects from major tech innovators to unlock the potential of Generative AI.

What you will do

• Own end-to-end data extraction workflows across complex websites to ensure accurate, structured datasets.
• Leverage internal tools like Apify and OpenRouter alongside custom workflows for accelerated data collection.
• Adapt scraping approaches to handle JavaScript-rendered content and dynamic site behavior.
• Enforce rigorous data quality standards through validation, cross-source consistency, and systematic verification.
• Scale scraping operations using efficient batching and parallelization while monitoring for failures.

Requirements

• At least 3 years of relevant experience in data engineering, web scraping, or automation.
• Strong proficiency in Python web scraping (BeautifulSoup, Selenium) and handling dynamic content (JS, AJAX).
• Proven ability to extract data from complex, inconsistent HTML structures.
• Solid background in data cleaning, normalization, and validation.
• English proficiency: B2 or above required.

Nice to have

• Bachelor's or Master’s Degree in Engineering, Applied Mathematics, or Computer Science.
• Hands-on experience with LLMs and AI frameworks.
• Link to GitHub portfolio.

Culture & Benefits

• Fully remote work on your own schedule.
• Gain experience in a unique hybrid environment collaborating with AI agents.
• Performance-based bonus programs for high-quality work.
• Opportunity to contribute to projects for major tech innovators.