Senior Data Engineer (AWS/Spark)

TL;DR

Senior Data Engineer (AWS/Spark): Building and optimizing scalable data pipelines and entity resolution systems with an accent on ETL automation, big data processing, and distributed systems. Focus on architecting high-performance dataflows using PySpark and Airflow to handle terabytes of data.

Location: Remote (United States)

Salary: $143,100 - $174,600

Company

hirify.global is a people search engine that helps millions of users reconnect with others and protect against fraud using a massive database of billions of records.

What you will do

• Build infrastructure and data automation pipelines to ingest, process, and load data from various sources.
• Collaborate with stakeholders and data science teams to develop data products, including entity resolution and best selection.
• Create unit and stress-test components to monitor technical performance and resolve identified issues.
• Develop data analysis tools to provide insights and capture key metrics.
• Research technical solutions and maintain comprehensive documentation.
• Implement best practices for data governance, quality, cleansing, and ETL activities.

Requirements

• 7+ years of production data engineering experience.
• Proven experience working with large datasets exceeding 100M+ records or multiple terabytes.
• 2+ years of experience with highly scalable, distributed systems and cluster architectures using AWS.
• 5+ years of professional programming experience with Python.
• 5+ years of experience with big data ecosystems (Spark is required, PySpark preferred).
• 3+ years of experience with SQL, schema design, and dimensional data modeling.
• 2+ years of experience with dataflow orchestration tools (e.g., Airflow) and non-relational databases (e.g., DynamoDB, Elasticsearch).
• Bachelor’s degree in Computer Science, Mathematics, Information Systems, or a related field.

Culture & Benefits

• 100% medical, dental, and vision coverage.
• Unlimited employee PTO.
• Company bonus program and equity plans.
• 401(k) retirement plan.
• Discretionary, merit-based annual salary increases.
• Remote-first company culture with a focus on work-life balance.