10 дней назад
Data Engineer Consultant (Databricks)
120 000 - 175 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer Consultant (Databricks) (Python/SQL): Building and deploying production-grade data pipelines for enterprise clients, modernizing legacy data platforms into cloud-native Lakehouses with an accent on Databricks, dbt, infrastructure as code, and data orchestration. Focus on migrating legacy warehouses, optimizing PySpark and SQL workloads, enforcing data governance, and delivering reliable client solutions under strict SLAs.
Location: New York, United States
Salary: $120,000–$175,000 annually, plus potential annual discretionary bonus
Company
delivers modern data engineering and cloud data solutions for enterprise clients.
What you will do
- Build and deploy production-grade data pipelines and Lakehouse modernization solutions for enterprise clients.
- Convert legacy Informatica, PL/SQL, and data warehouse systems into PySpark, Databricks SQL, and Delta Live Tables using Medallion Architecture.
- Develop modular, tested dbt models and advanced SQL transformations for trusted business-ready datasets.
- Provision AWS or GCP data infrastructure with Terraform and enforce governance through Unity Catalog.
- Build and monitor ELT/ETL workflows with Apache Airflow and Databricks Workflows while maintaining data quality, lineage, and SLA compliance.
- Participate in client engagements, code reviews, troubleshooting, query optimization, and cloud cost reduction.
Requirements
- Strong production experience with Python and advanced SQL.
- Hands-on experience with Databricks Lakehouse, Delta Lake, PySpark, Unity Catalog, and Workflows.
- Solid experience with dbt for transformation, testing, and documentation.
- Practical Terraform experience deploying AWS or GCP cloud data infrastructure.
- Proficiency with Git and CI/CD workflows, plus experience with schedulers such as Airflow.
- Ability to communicate technical decisions to clients and work effectively in a fast-paced consulting environment.
Nice to have
- Databricks, AWS, or dbt certifications.
- Experience migrating Teradata, Netezza, Snowflake, or Redshift warehouses to Databricks.
- Familiarity with Apache Kafka or change data capture pipelines.
Culture & Benefits
- Direct collaboration with technical client teams and global engineering squads.
- Embedded participation in client projects, daily standups, and code reviews.
- Work focused on delivering cloud-native data solutions in weeks rather than months.
- Potential eligibility for an annual discretionary bonus.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
10 дней назад
Principal Data Engineer (Data Platform)
220 000 - 260 000$
3 дня назад
Data Engineer (AI)
150 000 - 200 000$
12 дней назад
Digital Consulting - Databricks Technical Architect - Manager (Databricks)
145 000 - 170 000$
12 дней назад
Data Engineer I (Databricks, AWS, Python) (AI)
109 300 - 180 200$
10 дней назад
Data Engineer (Databricks)
140 000 - 160 000$
11 дней назад
Analytics Engineer (Finance & Modeling)
100 000 - 120 000$