10 дней назад
Senior Big Data Software Engineer (AWS + Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Big Data Software Engineer (AWS + Databricks): Design and develop scalable batch and distributed data processing pipelines in AWS with an accent on Python, SQL, Spark, Databricks, and workflow orchestration. Focus on optimizing performance, reliability, scalability, and cost efficiency while building data platforms for analytics, automation, and AI-enabled solutions.
Location: Remote or office-based in Colombia or Chile
Company
delivers software engineering and data solutions for analytics, automation, and AI-enabled use cases.
What you will do
- Design, develop, and maintain scalable batch and distributed data processing pipelines.
- Build and optimize AWS and Databricks data solutions for performance, reliability, scalability, and cost efficiency.
- Develop data solutions using Python, SQL, Apache Spark, AWS Glue, Amazon Athena, and Amazon Aurora.
- Maintain workflow orchestration with Apache Airflow and support reliable data processing workflows.
- Contribute to CI/CD, Infrastructure as Code, testing, troubleshooting, and production support using Terraform or similar technologies.
- Collaborate with engineering, AI, and product teams and participate in data platform architecture discussions.
Requirements
- 5+ years of professional experience in Big Data, Data Engineering, or a related field.
- Strong proficiency in Python and SQL.
- Hands-on experience with Apache Spark, distributed data processing, and Databricks.
- Experience with AWS data services, including AWS Glue, Amazon Athena, and Amazon Aurora.
- Experience with PostgreSQL, MySQL, Apache Airflow, Apache Kafka, CI/CD, version control, and Terraform or similar Infrastructure as Code tools.
- Upper-intermediate or higher English proficiency required for cross-team collaboration.
Nice to have
- Java experience.
- Familiarity with GenAI, MLOps, machine learning workflows, or AI platform integrations.
Culture & Benefits
- Remote or office-based work format.
- Collaboration across engineering, AI, and product teams.
- Work on analytics, automation, and AI-enabled data solutions.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →