Senior Data Platform Engineer (Kafka & Databricks)

Location: Remote

Company

hirify.global provides geo-intelligence and asset integrity solutions for construction, infrastructure, and natural resources, using Earth and infrastructure data to support safer, more resilient projects.

What you will do

• Design, deploy, maintain, and scale secure, highly available Kafka clusters on AWS using MSK or self-managed deployments.
• Manage and optimize Databricks workspaces, clusters, jobs, and Structured Streaming pipelines on AWS.
• Automate infrastructure and configuration with Terraform and GitOps principles, including CI/CD for cluster and topic configuration.
• Implement observability with metrics, Grafana dashboards, CloudWatch alarms, and log aggregation.
• Develop runbooks for incident response, disaster recovery, rolling upgrades, and documented RPO/RTO strategies.
• Collaborate with development teams on Kafka practices for .NET microservices and Databricks streaming jobs while improving cost optimization, reliability, security, and operational maturity.

Requirements

• 5+ years of experience in data platform, cloud platform, SRE, DevOps, or infrastructure engineering, including at least 3 years of hands-on Kafka production operations.
• Strong knowledge of Kafka internals, including partitions, replication, ISR, controller quorum, and KRaft.
• Expertise with AWS VPC, EC2, MSK, IAM, Secrets Manager, and networking.
• Familiarity with Databricks Structured Streaming and Kafka Connect.
• Experience with TLS/mTLS, SASL/SCRAM, ACLs, and secure cluster design.
• Proficiency in Infrastructure as Code, with Terraform preferred.
• Familiarity with CI/CD pipelines for cluster and topic configuration.
• Experience with monitoring and alerting using Grafana, CloudWatch, and log aggregation, as well as disaster recovery strategies.
• Strong scripting skills in Bash and Python, excellent documentation and communication skills, and at least upper-intermediate spoken and written English.

Nice to have

• Cloud certifications, preferably AWS.
• Knowledge of Schema Registry, Protobuf, and schema governance.
• Previous experience working with geospatial data.

Culture & Benefits

• Remote work with in-office collaboration.
• Work environment based on alignment, autonomy, personal accountability, and trust.
• International geo-data environment with projects and opportunities across the world.
• Inclusive culture and opportunities for professional growth locally or worldwide.