Data Engineer (Azure)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Data Engineer (Azure): Designing and maintaining scalable batch and streaming data pipelines with an accent on data modeling, performance optimization, and reliable data delivery. Focus on building ETL processes using Databricks and Azure Data Factory, implementing infrastructure as code with Terraform, and ensuring high data quality.
Location: Remote (Must be based in the USA for W2 contract eligibility)
Company
is a professional staffing and services firm providing technical talent for complex projects.
What you will do
- Develop and maintain batch and streaming data pipelines using modern tools and frameworks to ensure reliable data delivery.
- Design and implement scalable data models and storage solutions that support efficient querying and analysis.
- Implement and enforce data quality controls, validation, and compliance standards across all pipelines.
- Support the deployment, scheduling, and monitoring of data workflows for consistent execution.
- Collaborate with cross-functional teams in an agile environment to refine requirements and deliver high-quality solutions.
- Maintain comprehensive technical documentation and advocate for coding standards and reusable components.
Requirements
- 2-5 years of experience in data engineering, data modeling, and ETL pipelines.
- Proficiency in SQL and Python for creating and optimizing data pipelines.
- Experience with Azure and Databricks, specifically Delta Live Tables and Unity Catalog.
- Strong understanding of SnapLogic, Azure Data Factory, and Jenkins for orchestration and integration.
- Practical experience with Terraform for infrastructure as code (IaC).
- Proficiency in version control and CI/CD workflows using GitHub and integration with APIs.
Nice to have
- Knowledge of data quality and monitoring tools, particularly Soda.
Culture & Benefits
- Remote work schedule.
- Engagement via a W2 contract for a 6-month duration.
- Opportunity to work with a modern tech stack including Azure and Databricks.
- Collaborative agile team environment with a focus on peer learning and code reviews.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →