Senior Data Engineer (AWS)

TL;DR

Senior Data Engineer (AWS/PySpark): Developing and optimizing data systems, including ETL pipelines, storage, and entity resolution with an accent on scalable distributed systems and cluster architectures. Focus on building data automation pipelines, integrating new components, and ensuring high-performance processing of datasets exceeding 100M+ records.

Location: Remote (United States)

Salary: $143,100 - $174,600

Company

hirify.global is a people intelligence platform that leverages 60 billion public records to help users reconnect with others and help companies verify information and prevent fraud.

What you will do

• Build infrastructure and data automation pipelines to ingest, process, and load data from various sources.
• Collaborate with stakeholders and data science teams to develop data products, including entity resolution and best selection.
• Create unit and stress-test components to monitor technical performance and resolve identified issues.
• Develop data analysis tools to capture key metrics and provide actionable data insights.
• Research scalable solutions and maintain comprehensive technical documentation.
• Implement best practices for data governance, quality, cleansing, and ETL activities.

Requirements

• Must be based in the United States.
• 7+ years of development experience in data engineering within a production environment.
• 5+ years of experience with highly scalable distributed systems and cluster architectures using AWS and EMR.
• 5+ years of professional programming experience with Python.
• 5+ years of experience in big data ecosystems, specifically with Spark (PySpark preferred).
• 5+ years of experience with SQL, schema design, and dimensional data modeling.
• 5+ years of experience with dataflow orchestration tools such as Airflow.
• 2+ years of experience with non-relational databases like DynamoDB or Elasticsearch.
• Bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field.

Culture & Benefits

• Remote-first team environment with high employee tenure.
• 100% medical, dental, and vision coverage.
• Unlimited employee PTO.
• Equity plans and 401(k) options.
• Bonus program and discretionary merit-based salary increases.