TL;DR
Senior Data Engineer: Designing, building, and operating high-scale streaming and batch pipelines and optimizing data lake performance with an accent on data quality, reliability, and cost efficiency. Focus on solving complex data modeling challenges, optimizing query performance, and ensuring reliable data delivery to applications.
Location: Onsite in San Diego, CA, USA
Salary: $136,000.00 - $172,000.00 USD
Company
hirify.global makes roadways safer by transforming real-time video and telematics into actionable safety intelligence.
What you will do
- Build and operate streaming pipelines with Kafka and Flink for real-time telemetry and event processing.
- Design robust ETL with Airflow into Redshift and S3, supporting analytics and downstream services.
- Model data (event/telemetry and serving schemas); own data contracts, schema evolution, and table partitioning/compaction strategies.
- Optimize performance & cost across Redshift, Iceberg/Athena, and streaming jobs.
- Harden quality, reliability, and observability, including SLAs/SLOs, lineage, testing, validation, and alerting for data pipelines and datasets.
- Serve data to applications via APIs/GraphQL and scalable query services, ensuring predictable latency and well-documented contracts.
Requirements
- 6+ years of data engineering experience designing and operating production-grade streaming + batch data systems at scale.
- Deep hands-on experience with Kafka and stream processing technology.
- Strong SQL and performance tuning in Redshift; practical experience with Postgres.
- Production experience with Airflow (DAG design, SLAs, retries, idempotency) and Flink (job optimization).
- Experience with open table formats like Apache Iceberg (preferred) and Athena query performance.
- Solid data modeling for telemetry/events and analytics; understanding of data contracts, schema registry, and CDC patterns.
- Proficiency in object-oriented programming languages such as C# / Java / Python; strong software engineering fundamentals (testing, CI/CD, code review).
- AWS experience (S3, Redshift, Athena, IAM).
Nice to have
- Experience with IoT/telematics data.
- Knowledge of dbt / Great Expectations (or other data testing frameworks).
- Terraform/IaC, Kubernetes, and cost-aware architecture.
Culture & Benefits
- Medical, dental, and vision insurance.
- Health Savings Account and Flexible Spending Accounts.
- 401(k) and 401(k) match.
- Life and AD&D insurance, Short-Term and Long-Term Disability.
- FTO or PTO and 11 paid holidays plus 1 inclusive holiday per year.
- Employee Well-Being program, Volunteer Time Off, Education Reimbursement Program, Employee Referral program, and Employee Recognition and Appreciation program.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →