Data Engineer (Web Scraping)

TL;DR

Data Engineer (Web Scraping): Designing and optimizing end-to-end data pipelines for scraping and processing structured and unstructured data with an accent on text data handling and intelligence collection. Focus on building scalable infrastructure using Google Cloud Platform, collaborating with ML engineers, and ensuring data quality for AI safety and threat intelligence initiatives.

Location: Must be based in the U.S.

Salary: $105,000–$125,000

Company

hirify.global provides safety and threat-intelligence solutions for frontier AI labs, unicorns, and global technology platforms.

What you will do

• Design and implement end-to-end data pipelines for scraping and processing structured and unstructured data.
• Conduct ad hoc web scraping and data collection to support research and intelligence initiatives.
• Prepare data for analysis through cleaning, transformation, anonymization, and masking.
• Contribute to the development of internal and external APIs.
• Collaborate with ML engineers and software developers to deliver actionable insights and functional tools.

Requirements

• Must be based in the U.S.
• 2+ years of professional experience in data engineering or a related field.
• Proficiency in Python and SQL.
• Experience with web scraping tools such as Beautiful Soup, Selenium, or Scrapy.
• Experience with Google Cloud Platform services including storage, databases, and workflow orchestration.
• Experience building and managing data pipelines, particularly for text data.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• 401(k) retirement plan.
• Performance-based annual bonus.
• Support for professional development including conferences and training.
• Generous PTO and paid holiday schedule.