Lead Data Engineer (Big Data)

TL;DR

Lead Data Engineer (Big Data): Designing and scaling large-scale, data-intensive systems and distributed data pipelines with an accent on high throughput and low-latency performance. Focus on building REST APIs, optimizing backend services, and managing massive datasets using Python and AWS.

Location: Fully remote (Global), must work within Eastern Standard Time (EST) business hours

Company

SaaS provider redefining Sales Performance Management (SPM) for global industry leaders to optimize revenue and seller performance.

What you will do

• Design and scale REST APIs and large-scale data processing pipelines for high-volume datasets across distributed systems.
• Architect and optimize backend services for high throughput and low-latency performance.
• Develop data-intensive and event-driven applications using Python, TypeScript, and AWS-native services.
• Process and transform massive datasets using Spark, EMR, Glue, and Kafka.
• Mentor developers, guide code reviews, and raise engineering quality standards.
• Automate deployments and CI/CD using Terraform, Serverless Framework, and Kubernetes-based workflows.

Requirements

• 7+ years of backend engineering experience with a strong focus on Python (APIs, automation, data pipelines).
• 3+ years of professional experience with TypeScript and Node.js.
• Advanced experience with AWS services (EC2, EKS, Lambda, S3, DynamoDB, RDS, Step Functions).
• Proven experience deploying and optimizing production workloads on Kubernetes.
• Strong expertise in distributed computing and batch/stream processing using Spark, Dask, EMR, Glue, or Kafka.
• Business-level English proficiency required for cross-functional communication.

Culture & Benefits

• Market-leading compensation package.
• Comprehensive health insurance coverage, including Medical, Dental, Vision, and Life Insurance.
• Full remote work flexibility and a results-driven work culture.
• Wellness programs to support overall health and wellbeing.
• Continuous development opportunities within a diverse, multicultural global environment.