Sr. Data Platform Engineer

TL;DR

Sr. Data Platform Engineer: Ensuring reliability, availability, and cost efficiency of an Airbyte-based data ingestion platform running on Kubernetes with an accent on operating and monitoring production data sync infrastructure. Focus on designing Python-based monitoring systems, managing AWS resources, and optimizing infrastructure costs.

Location: Hyderabad, India (Hybrid / On-site)

Company

hirify.global is a global leader in AI-powered customer experience assurance, providing a unified platform for continuous testing and monitoring across various channels.

What you will do

• Own and operate Airbyte infrastructure running on Kubernetes.
• Ensure reliable data syncs from source databases into downstream data pipelines.
• Monitor and troubleshoot Airbyte sync failures and performance issues.
• Design, build, and maintain Python-based monitoring and alerting systems.
• Manage and optimize infrastructure costs related to data sync workloads.
• Manage and ensure availability of AWS resources used for data sync and storage.
• Collaborate with downstream data consumers to resolve ingestion-related issues.
• Perform root cause analysis and incident resolution for ingestion failures.

Requirements

• 5-8 years of experience in data platform engineering.
• Strong experience with Python for monitoring, automation, and alerting.
• Hands-on experience operating Airbyte in production.
• Experience running workloads on Kubernetes.
• Solid understanding of AWS, especially S3, IAM, and monitoring services.
• Experience with data ingestion pipelines and ETL/ELT concepts.

Nice to have

• Familiarity with containerization (Docker).
• Experience with infrastructure cost monitoring tools.
• Knowledge of data platform reliability or SRE practices.

Culture & Benefits

• Emphasis on delivering excellence, innovation, integrity, and curiosity.
• Commitment to diversity, equity, inclusion, and belonging.
• Workplace where individuals feel valued, respected, and empowered.
• Focus on continuous evaluation and enhancement of policies to align with DEIB principles.
• Discrimination-free environment where individuals are evaluated solely on their merits and abilities.

Hiring process

• AI tools may support parts of the hiring process, such as reviewing applications or analyzing resumes.
• Final hiring decisions are ultimately made by humans.