Senior Data Engineer

TL;DR

Senior Data Engineer (Data Pipeline): Design, implement, and scale data solutions from batch to streaming for low-latency requirements. Focus on building scalable production-grade data pipelines, real-time data streams, and collaborating with various teams to triage data or ETL issues.

Location: Remote

Company

hirify.global is a globally distributed tech consultancy based in Silicon Valley.

What you will do

• Build scalable production-grade data pipelines and real-time data streams.
• Write and design scalable, cloud-ready applications.
• Lead technical projects through architecture, design, and implementation phases.
• Collaborate with Machine Learning, Data Science, Design, Software Engineering and Business teams to triage data or ETL issues.
• Build tests and health checks to maintain code and data quality.
• Monitor and analyze data flowing through various systems by adding appropriate visualizations and dashboards.

Requirements

• Advanced Python and SQL
• Experience in ETL design, implementation, and maintenance.
• Experience in AWS, GCP or Azure delivering data-centric product experiences
• 5+ years experience in related role
• Experience with in-memory and disk-based databases, relational and non-relational databases, full-text search engines, database design, development, and maintenance.
• Working knowledge in Data Lake, Data warehouse and massive parallel processing

Nice to have

• Working knowledge in IAM, Federated Authentication, SSO, SAML, Encryption, Security, APIs, Disaster Recovery or Backup
• Strong ability in distributed systems for large-scale data processing
• Experience with Spark and Pandas
• Experience with Open Tables (Hudi, Delta Lake, DataBricks, Iceberg as related to Data Lakehouse)
• Experience with Infrastructure as Code and CI/CD Pipelines

Culture & Benefits

• Every other Friday off (26 extra days off a year)
• Remote-first and flexible schedule
• Explorer and Relocate programs (three months abroad or full relocation)
• Paid sick days and local holidays
• Business English classes
• Continuous learning support