Senior Software Engineer (Data Compute)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Software Engineer (Data Compute): Building and evolving large-scale Spark and Airflow environments for a global financial platform with an accent on infrastructure modernization and lakehouse fundamentals. Focus on migrating workloads to Databricks, optimizing compute resource utilization, and improving platform reliability through Unity Catalog and Trino.
Location: Hybrid (Bellevue, WA) - In-person attendance expected at least 3 days per week
Salary: $196,000 - $230,000 USD (Base Pay Zone 1)
Company
A financial services company on a mission to democratize finance for all.
What you will do
- Design and build scalable platform primitives for Spark and Airflow to support global data infrastructure needs.
- Lead the migration and modernization of Spark workloads to serverless Databricks and Delta Lake architectures.
- Optimize compute resource utilization and efficiency to manage costs across large-scale distributed systems.
- Collaborate with analytics and product engineering teams to deliver a seamless, self-serve data processing experience.
- Improve platform reliability and governance using Unity Catalog and Trino for metadata management and access controls.
Requirements
- Extensive experience with large-scale Spark and Databricks or similar platform infrastructure.
- Deep expertise in data orchestration using Airflow for complex job lifecycle management.
- Proven track record with lakehouse fundamentals, including S3-based data lakes, Delta Lake, and Parquet.
- Familiarity with query and serving infrastructure such as Trino, Pinot, or Hive Metastore.
- Ability to own multi-team platform reliability, cost optimization, and developer experience initiatives.
- Must be based in or able to commute to the Bellevue, WA office.
Culture & Benefits
- Performance-driven compensation including bonus programs and equity ownership.
- 100% paid health insurance for employees and 90% coverage for dependents.
- 401(k) matching and employer-paid life and disability insurance.
- Access to top-tier AI tools and continuous AI skill-building for all employees.
- Flexible lifestyle wallet for wellness, learning, and personal development.
- Exceptional office experience with catered meals, events, and comfortable workspaces.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →