Lead Data Engineer (Python)

TL;DR

Lead Data Engineer (Python/Spark): Designing and implementing end-to-end data solutions and modern data architectures for diverse clients with an accent on scalable data pipelines and distributed computing. Focus on leading technical teams, implementing TDD practices, and solving complex data governance and security challenges.

Location: Bangkok, Thailand. Must be a Thai Citizen

Company

A leading global technology consultancy that helps clients solve complex business problems through purposeful and impactful technical innovation.

What you will do

• Lead and manage data engineering projects from inception to completion, ensuring on-time delivery and cross-team collaboration.
• Design, develop, and operate modern data architecture and intricate data processing pipelines to meet business objectives.
• Collaborate with stakeholders to identify opportunities for leveraging data and improving data quality.
• Partner with data scientists to design and build scalable implementations of their models.
• Write clean, iterative code based on TDD and utilize continuous delivery practices for pipeline deployment.
• Advise clients on distributed storage and computing technologies and implement appropriate data models.

Requirements

• Proven experience in system design and the implementation of complex technical solutions.
• Hands-on expertise with Python (must have), Spark, and Big Data processing.
• Experience with at least one Cloud platform (AWS, Azure, or GCP).
• Deep understanding of data modeling and proficiency with various databases (SQL, NoSQL, data lakes).
• Experience building and deploying large-scale production data pipelines.
• Must be a Thai Citizen

Nice to have

• Experience with Databricks.
• Proficiency in data visualization techniques to communicate insights to diverse audiences.

Culture & Benefits

• Autonomy in career development supported by a strong cultivation culture.
• Access to numerous development programs and interactive growth tools.
• Inclusive community focused on technical excellence and continuous learning.
• Opportunity to work on high-impact projects for a variety of global clients.