2 дня назад
Data Engineer (Azure)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Azure/Scala/Spark): Building secure enterprise data pipelines for real-time and batch processing with an accent on Azure data platforms, data quality, governance, and machine learning operationalization. Focus on designing scalable streaming and batch architectures, optimizing SQL Server and Azure services, and mentoring junior engineers.
Location: Pune, India; onsite role. Applicants may be required to appear onsite at a office during the recruitment process.
Employment type: Full time
Company
provides professional information, software, and services for specialized industries.
What you will do
- Translate business requirements and use cases into scalable data solutions with cross-functional teams.
- Design and develop secure, reliable enterprise data pipelines for real-time and batch processing.
- Build real-time data solutions with Scala, Apache Spark, and Azure Databricks.
- Operationalize machine learning models in partnership with data scientists and business stakeholders.
- Implement data governance, metadata management, validation frameworks, monitoring, and data quality controls.
- Participate in code reviews and documentation while mentoring junior engineers and sharing knowledge.
Requirements
- 3+ years of overall experience in data engineering or a related field.
- 2+ years of experience building pipelines for structured and unstructured data.
- Experience with PySpark, Hadoop, Kafka, EventHub, Stream Analytics, and other big data technologies.
- Experience with relational and dimensional data modeling, SQL Server, data warehousing, T-SQL, stored procedures, and performance tuning.
- Experience with Azure Data Factory, Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
- Bachelor’s degree in computer science, engineering, or equivalent practical experience; strong communication, collaboration, and problem-solving skills.
Nice to have
- Experience with Azure ML, Python, Scala, Power BI, and Azure Analysis Services.
- Experience with Agile/Scrum methodologies and DevOps practices.
- Familiarity with CI/CD pipelines and Git.
- Azure Data Engineer Certification or equivalent.
Culture & Benefits
- Collaborative work across engineering, data science, and business teams.
- Participation in peer code reviews, technical documentation, and knowledge-sharing activities.
- In-person interviews may be part of the recruitment process; AI tools or third-party assistance during interviews are not permitted.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →