обновлено 10 дней назад
Senior Azure Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Azure Data Engineer (Azure/Python): Building cloud-native batch and real-time data pipelines and a scalable data lake platform on Azure with an accent on Databricks, Data Factory, SQL, and stream processing. Focus on designing large-scale data infrastructure, automating workflows, processing structured and unstructured datasets, and improving pipeline reliability and testability.
Location: Remote, Hyderabad, India
Company
develops cloud-based data engineering solutions and scalable data platforms.
What you will do
- Design and develop business-critical backend systems, data pipelines, and stream-processing solutions on Azure.
- Build scalable batch and real-time data pipelines, data lakes, and cloud-native infrastructure.
- Assemble complex datasets and implement extraction, transformation, and loading processes using SQL and Azure big data technologies.
- Develop data pipelines that provide insights into customer acquisition, operational efficiency, and business performance.
- Automate data pipelines and workflows using DevOps tools, Azure Data Factory, and Logic Apps.
- Perform root cause analysis, code reviews, refactoring, and improvements to data processes and structures.
Requirements
- Bachelor's degree in computer science or equivalent experience.
- 4+ years of experience as a Data Engineer.
- Strong experience with Azure data engineering, Python, PySpark, Azure Databricks, Azure Data Factory, and SQL.
- Experience with Azure big data services including Databricks, HDInsight, ADLS, Azure SQL Database, Azure Synapse, and Azure virtual machines.
- Experience with relational and NoSQL databases, structured and unstructured datasets, and workflow management tools.
- Experience with stream-processing systems and developing Python notebooks.
Culture & Benefits
- Remote full-time work based in Hyderabad, India.
- Work on large-scale, cloud-native data platforms designed for real-time processing and extreme scalability.
- Continuous improvement and openness to replacing existing solutions with better approaches.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →