2 дня назад
Principal Databricks Architect
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Databricks Architect (Data Engineering): Leading the architecture, implementation, governance, and sustainment of a Databricks-based data and analytics environment with an accent on Lakehouse design, data governance, security, and scalable data pipelines. Focus on designing Delta Lake and Unity Catalog architectures, integrating enterprise systems, tuning batch and streaming workloads, and establishing engineering standards for reliable production operations.
Location: Remote within the United States; U.S. citizenship required. Travel up to 5%.
Company
is a mission-focused consulting company delivering technology and data solutions for public-sector and enterprise clients.
What you will do
- Lead the target architecture and technical roadmap for a Databricks data and analytics platform.
- Design and govern scalable Lakehouse architectures using Delta Lake, Unity Catalog, Databricks SQL, Lakeflow Jobs, Auto Loader, and Apache Spark.
- Define standards for data modeling, medallion architecture, pipelines, CI/CD, testing, observability, documentation, and incident response.
- Lead data governance covering cataloging, access controls, classification, lineage, auditability, retention, quality, and stewardship.
- Architect secure integrations with cloud services, enterprise applications, APIs, warehouses, and reporting tools.
- Provide hands-on technical leadership for complex pipelines, batch and streaming workloads, performance tuning, troubleshooting, reviews, releases, and engineer mentoring.
Requirements
- Bachelor’s degree in a technical discipline and 8+ years of experience designing and operating cloud data, analytics, or enterprise data platforms.
- 5+ years of hands-on experience with Python, SQL, Apache Spark, and production ETL/ELT pipelines.
- 3+ years of Databricks architecture and engineering experience, including Delta Lake, Unity Catalog, orchestration, performance tuning, and production support.
- Current Databricks Certified Data Engineer Professional certification.
- Ability to lead architecture, establish engineering and governance standards, and communicate with technical and nontechnical stakeholders.
- Must be a U.S. citizen and able to obtain a U.S. Public Trust suitability determination.
Nice to have
- Experience with enterprise data governance, security controls, metadata, lineage, auditability, data quality, and sensitive-data protection.
- Experience with Databricks Asset Bundles, Databricks CLI or APIs, infrastructure as code, CI/CD, and automated environment promotion.
- Experience integrating cloud services, enterprise systems, APIs, analytics platforms, and batch or streaming sources.
- AWS, Azure, Google Cloud, or additional Databricks certifications.
- Experience in regulated, public-sector, or security-sensitive environments and Agile technical leadership.
Culture & Benefits
- Remote work with limited travel.
- Generous paid time off, federal holidays, and parental leave.
- Medical, dental, vision, life, and disability coverage.
- 401(k) with company match and FSA/HSA options.
- Commuter benefits and an inclusive, employee-focused culture.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
Data Engineer (Databricks)
6 дней назад
Data Engineering Manager | Home Client Services
130 000 - 200 000$
6 дней назад
Senior Data Developer (Databricks)
7 дней назад
Databricks Data Engineer (AI)
175 000 - 195 000$
6 дней назад
Big Data Architect (Databricks + Azure)
7 дней назад