2 дня назад
Data Engineer (Databricks)
150 000 - 180 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Managing the organization’s data environment and building centralized automated pipelines for data ingestion, refreshes, validation, and monitoring with an accent on Databricks administration, Azure services, data governance, and quality. Focus on designing production-ready data assets, diagnosing pipeline issues, optimizing database performance, and integrating financial data from external APIs.
Location: New York, United States
Salary: USD 150,000–180,000 per year
Company
delivers global projects in a supportive, flexible, and innovative technology environment.
What you will do
- Manage Databricks instances, including dataset onboarding, permissions, security, and governance.
- Build centralized automated pipelines for ingesting data from multiple sources into the data warehouse.
- Automate data refreshes, validation, and monitoring processes.
- Handle reporting and data requests while serving as the central contact for organization-wide data projects.
- Collaborate on data policy and governance and ensure reliable, high-quality data availability.
Requirements
- 3+ years of experience managing Databricks and working with integrated Azure services.
- 3+ years of experience with object-oriented Python programming.
- Strong experience in pipeline creation, security, governance, and Change Data Capture.
- Experience diagnosing pipeline and data quality issues, integrating external APIs, and deploying production-ready data assets.
- Experience with Git workflows, CI/CD, data monitoring and validation frameworks, database design, optimization, normalization, and compression.
- Experience with financial data such as trade, reference, and position data, plus strong communication and independent problem-solving skills.
Nice to have
- Experience with agentic coding assistants.
- Familiarity with orchestration tools.
- Familiarity with Tableau and Sigma.
Culture & Benefits
- Vacation according to the laws of the employee’s country.
- Health insurance support for employees and their loved ones.
- 10 days of sick pay without a doctor’s note, with additional leave according to local laws.
- Time off for state holidays according to the official calendar.
- Coverage for IT certifications and access to courses and learning platforms.
- Corporate events and workplace comfort support.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
14 часов назад
Azure Databricks Data Engineer (AI)
120 000 - 140 000$
6 дней назад
Data Operations Engineer II (Databricks)
3 дня назад
Data Engineer (Databricks)
15 часов назад
Senior Data Engineer / Databricks Engineer
125 000 - 178 000$
8 часов назад
Data Engineer
15 часов назад
Data Engineer - Data Platform
185 000 - 210 000$