2 часа назад
Senior Data Platform Engineer (Databricks)
100 000 - 131 500$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Platform Engineer (Databricks/AWS): Administering and automating an enterprise Databricks Lakehouse platform on AWS with an accent on security, governance, infrastructure as code, and cost optimization. Focus on designing scalable cloud networking, building Terraform and CI/CD automation, optimizing Spark and Delta Lake workloads, and evaluating Lakehouse AI, Vector Search, and other emerging Databricks capabilities.
Location: Hybrid role based at BJ's Club Support Center in Marlborough, Massachusetts; in-office Tuesday through Thursday and remote Monday and Friday.
Salary: $100,000–$131,500 per year
Company
operates a membership-based wholesale retail business with more than 30,000 team members.
What you will do
- Administer and enhance the enterprise Databricks Lakehouse platform, including workspaces, networking, compute, security, and operational reliability.
- Design secure and scalable AWS infrastructure using IAM, VPC, PrivateLink, S3, KMS, CloudWatch, and cross-account access patterns.
- Build Terraform-based infrastructure-as-code frameworks and automate platform operations with the Databricks CLI, REST APIs, Python, and shell scripting.
- Develop CI/CD and environment-promotion workflows across development, test, and production environments.
- Monitor DBU consumption and implement cost-governance controls such as cluster policies, budget alerts, tagging, and usage dashboards.
- Enable Data Engineering, Data Science, and AI workloads through Delta Lake, Spark, MLflow, Feature Store, streaming, and model deployment practices.
Requirements
- Hands-on experience administering Databricks workspaces, designing cluster and job policies, implementing Unity Catalog, and troubleshooting platform performance.
- Strong AWS experience with IAM, VPC networking and security, S3 data lakes, KMS encryption, CloudWatch, PrivateLink, and cross-account access.
- Experience with Terraform, infrastructure-as-code design, Databricks CLI and API automation, and Python or Bash scripting.
- Experience developing CI/CD pipelines, using Git-based workflows, and supporting monitoring, observability, incident management, and root-cause analysis.
- Knowledge of Apache Spark/PySpark, SQL optimization, Delta Lake tuning, streaming, orchestration, data modeling, ETL, and large-scale data workloads.
Nice to have
- Databricks Certified Data Engineer or Databricks Platform Architect certification.
- AWS Certified Solutions Architect certification.
- Experience designing enterprise-scale Lakehouse platforms, supporting large-scale ML workloads, or implementing data governance frameworks.
Culture & Benefits
- Full-time employment with weekly pay.
- Paid vacation, personal, sick, holiday, bereavement, and jury-duty leave.
- Medical, dental, vision, HSA, and flexible spending account options.
- 401(k) plan with company matching and an employee stock purchase plan.
- Free BJ's memberships for the employee and an eligible household member.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
22 часа назад
Data Engineer (Databricks)
110 000 - 126 000$
5 дней назад
Data Engineer I (AWS, Databricks)
109 300 - 180 200$
6 дней назад
Data Engineer (Databricks)
125 000 - 159 000$
4 дня назад
Senior Data Platform Engineer (Snowflake)
120 000 - 150 000$
4 дня назад
Analytics Engineer (dbt/Databricks)
101 600 - 175 200$
5 дней назад
Senior Data Engineer (Databricks)
115 000 - 165 000$