3 дня назад
Data Engineer (Databricks)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Building and maintaining scalable ETL/ELT pipelines, data models, and reporting capabilities on Databricks and AWS with an accent on Python, PySpark, DBT, SQL, and data platform architecture. Focus on designing secure and maintainable data systems, optimizing Spark workloads and cloud costs, and implementing CI/CD, monitoring, and data governance.
Location: Pune, India; hybrid with 2 days in-office
Company
provides an open hotel commerce platform that helps accommodation businesses attract and manage online bookings, supporting 56,000 hotels in more than 150 countries.
What you will do
- Develop, test, and maintain scalable ETL/ELT data pipelines using Python, PySpark, Databricks, and AWS.
- Lead data feature and service development from architectural design through deployment using Terraform, Spark Structured Streaming, and DLT.
- Implement CI/CD-controlled deployments with Databricks Asset Bundles and optimize serverless compute costs and performance.
- Collaborate with Product Managers, Data Scientists, and engineers to solve complex data challenges and maintain data quality, security, integrity, and governance.
- Own major components of the data platform architecture and lead technical design discussions.
- Analyze workloads, queries, clusters, warehouses, jobs, and services to identify performance and cost optimization opportunities, supported by monitoring dashboards.
Requirements
- Extensive experience in data engineering.
- Mandatory expertise in Databricks and DBT, including clusters, jobs, Delta Lake, Spark optimization, autoscaling, and Unity Catalog.
- Strong SQL and Python skills for automation, monitoring, and recommendation logic.
- Experience with Terraform and Airflow.
- Demonstrated ability to deliver performance improvements and cost savings through platform-level optimization.
- Hands-on, automation-driven approach with strong customer-value focus.
Nice to have
- Databricks certification.
- Familiarity with SOC2 and GDPR compliance frameworks.
- Knowledge of LLMs and AI frameworks.
Culture & Benefits
- Hybrid work model with two days in the office.
- Mental health and well-being initiatives.
- Generous parental leave, including secondary parental leave.
- Paid birthday, study, and volunteering leave.
- Training and personal growth opportunities, employee resource groups, social clubs, and team events.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →