7 дней назад
Senior Engineer - Data Engineer - Databricks
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Engineer - Data Engineer - Databricks (Azure/Data Platforms): Building enterprise-scale batch and streaming data pipelines and modern data lake solutions with an accent on Azure Data Factory, Synapse, Spark, Databricks, and PySpark. Focus on designing cloud-native, event-driven architectures, optimizing data models and queries, and implementing validation, quality, metadata, and lineage frameworks.
Location: Hyderabad, Telangana, India
Company
delivers consulting and customer-focused data platform solutions.
What you will do
- Design and implement end-to-end data ingestion, validation, enrichment, and processing pipelines.
- Build batch and streaming integrations using Azure Data Factory, Azure Functions, Stream Analytics, Spark, and Databricks.
- Design cloud-native data platforms with streaming and event-driven architectures.
- Develop data models, queries, and optimization solutions for relational, NoSQL, time-series, graph, warehouse, and lake environments.
- Define and manage metadata, data catalogs, stewardship tools, data quality, validation, and lineage frameworks.
- Participate in integrated validation and subsystem analysis on production servers while optimizing SDLC practices.
Requirements
- 5+ years of experience with Azure Data Factory, Azure SQL, Synapse, and Spark or Databricks.
- Hands-on experience with Azure, PySpark, Python, SQL, and Parquet files.
- Experience implementing enterprise-level data platforms and modern big data lakes.
- Knowledge of SQL Server, Oracle, MySQL, DynamoDB, Cosmos DB, and other relational, NoSQL, and column-oriented databases.
- Experience with automated testing, data validation and quality frameworks, data lineage, and metadata management tools such as OpenMetadata and Azure Purview.
- Bachelor’s degree in Computer Science, Engineering, or a related field, plus strong analytical, communication, interpersonal, and collaboration skills.
Culture & Benefits
- Full-time work in a team-oriented consulting and customer service environment.
- Role emphasizes intellectual curiosity, structured thinking, problem solving, and collaboration.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →