Data Platform Engineer

#vacancy #fulltime #openposition #job #itcareer #itjob

Looking for a Data Platform Engineer
Location: EU
Employment Type: full time. longterm
English: B2
Contact: Показать контакты

About the Role
We are looking for a Data Platform Engineer to design, build, and optimize scalable data platform
infrastructure and pipelines. The ideal candidate will have deep expertise in Terraform, CI/CD and
Devops practices on platforms like AWS, Snowflake. While building the platform the candidate is
expected to maintain and troubleshoot data pipelines hence knowledge of SQL and Python is
necessary.
Key Responsibilities
❖ Platform Design and Development: Work with the lead to Architect and build the next
generation of our data platform, leveraging cloud technologies like AWS and Snowflake.
❖ Infrastructure as Code (IaC): Lead the implementation and maintenance of our data platform
infrastructure using Terraform for automation and reliability.
❖ CI/CD and DevOps: Implement and manage CI/CD pipelines for data infrastructure automation
and apply DevOps principles to the entire data platform lifecycle.
❖ Troubleshooting: Proactively monitor and troubleshoot complex data pipelines, jobs, and cloud
infrastructure to ensure high availability and meet SLAs.
❖ Performance and Cost Optimization: Take the lead on optimizing query performance, storage
costs, and compute resources within Snowflake and the AWS ecosystem.
❖ Mentorship and Collaboration: Collaborate closely with the Data Tech Lead and other
engineers, providing guidance and technical leadership to the team.
❖ Data Pipeline Engineering: Design, develop, and maintain robust and scalable ETL/ELT pipelines
using Python, SQL, and orchestration tools like Airflow, sqlmesh, or dbt.
Required Skills & Qualifications
➢ Snowflake - Understanding the engineering components and infrastructure of Snowflake
➢ Terraform - Should be highly proficient in maintaining infrastructure through code.
➢ Experience with version control (GitHub) and CI/CD for data pipelines.
➢ Working experience in GitHub Actions building complex pipelines ➢ Python
➢ SQL
➢ Understanding and experience of maintenance of Apache Airflow or Managed Airflow (MWAA)
➢ Strong problem-solving skills and ability to work independently in a fast-paced environment.
➢ Knowledge of AWS services - S3, Lambda
➢ Knowledge of Snowflake data platform