5 часов назад
Principal Software Engineer, Tech Lead - Platform (AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Software Engineer, Tech Lead - Platform (AWS): Designing and evolving a next-generation AWS data compute platform with an accent on lakehouse architecture, AI-ready data foundations, governance, and self-service access. Focus on building semantic layers, feature stores, and data ontologies, optimizing Spark and SQL workloads, and defining secure, reliable infrastructure-as-code standards.
Location: Remote, US
Company
operates a purchase intelligence and incentives platform that helps businesses attract, understand, and incentivize consumers through digital reward programs.
What you will do
- Design and evolve next-generation architectures and reference standards for batch, streaming, ML, and AI/agentic workloads.
- Build the semantic layer, feature store, and data ontology required for governed, self-service access by human and machine consumers.
- Partner with analysts, engineers, and business users by creating onboarding materials, self-service guides, and best-practice documentation.
- Set technical direction, mentor data and platform engineers, drive engineering excellence, and manage vendor relationships.
- Define monitoring standards and SLAs, tune Spark, Delta/Hudi, and SQL workloads, and lead incident response and root-cause analysis.
- Establish governance, security, compute, access, catalog, cost, and CI/CD standards for Databricks lakehouse platforms on AWS.
Requirements
- 7+ years of experience in data engineering or data platform roles, including at least 2 years in a technical lead or architecture capacity.
- Hands-on expertise with Databricks, AWS EMR or similar platforms, Delta Lake, Unity Catalog, Spark/PySpark, SQL, and AWS compute or cluster management.
- Experience designing and delivering production Lakehouse architectures and large-scale ELT/ETL pipelines.
- Proficiency with Infrastructure as Code tools such as Terraform.
- Experience supporting analysts, engineers including ML engineers, and non-technical business users.
- Strong knowledge of data governance, data modeling, cloud security, communication, and technical collaboration.
Nice to have
- Experience operating a production semantic layer, feature store, data ontology, or knowledge graph.
- Experience managing data for ML systems and AI/agentic applications, including LLM training pipelines or inference.
Culture & Benefits
- Flexible paid time off and company holidays.
- Medical, dental, and vision insurance from the first day.
- 401(k) retirement plan with company match and a student loan debt repayment option.
- Employee Stock Purchase Plan and educational assistance for continuing education.
- Lifestyle Spending Account and Calm app subscription for physical, emotional, and financial wellbeing.
- Work environment primarily uses macOS and Google Workspace, with Windows also supported.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
6 дней назад
Senior Data Architect - Databricks Platform (Databricks)
6 дней назад
Principal Data Architect (Databricks)
3 дня назад
Principal Data Architect (AI)
2 дня назад
Sr/Principal Data Architect (AI)
15 часов назад
Principal Architect/Solution Architect Senior Director (Databricks)
3 дня назад