10 дней назад
Lead Data Engineer (Consumer)
170 000 - 190 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (Consumer) (SQL/Python/Spark): Building trusted, scalable, and reusable source-to-Silver data products for an enterprise data platform with an accent on ingestion, transformation, data quality, governance, and observability. Focus on leading distributed engineering delivery, designing reusable batch and event-driven pipeline patterns, and ensuring traceable, secure, production-ready data for analytics, AI, and operational use.
Location: New York, NY, USA. The role is associated with the New York office, and external candidates may be required to attend an in-person interview.
Salary: USD 170,000–190,000 yearly.
Company
is a media and entertainment business operating brands across political news, business news, golf, sports, and genre entertainment, with complementary digital assets.
What you will do
- Lead a distributed Data Engineering team delivering source-to-Silver data products.
- Translate product requirements into engineering plans, milestones, estimates, dependencies, and delivery commitments.
- Design and oversee ingestion, transformation, standardization, orchestration, and publication across operational, SaaS, file, streaming, API, and partner sources.
- Build reusable frameworks, templates, libraries, and pipeline patterns for batch, incremental, change-data-capture, and event-driven processing.
- Implement data-quality testing, reconciliation, freshness monitoring, lineage, alerting, access controls, masking, retention, and data-residency practices.
- Partner with architects, data modelers, product managers, platform teams, domain leaders, and source-system owners while coaching engineers and managing delivery standards.
Requirements
- 8+ years of data engineering, software engineering, or data-platform experience, including 2+ years leading engineers, technical workstreams, or large-scale delivery.
- Hands-on expertise in SQL, Python, Spark/PySpark, and modern ELT/ETL patterns.
- Experience designing enterprise-scale ingestion and transformation pipelines and working with Databricks, Delta Lake, or a comparable lakehouse platform.
- Experience with cloud storage, orchestration, CI/CD, layered Bronze/Silver/Gold data platforms, data quality, observability, lineage, metadata, and production support.
- Ability to lead distributed teams across time zones and communicate technical choices, risks, and tradeoffs to technical and non-technical stakeholders.
- Ability to attend an in-person interview at a location if required during the selection process.
Nice to have
- Experience with Unity Catalog or comparable governance, catalog, and access-control capabilities.
- Experience with data contracts, schema evolution, change-data capture, APIs, event streaming, and large-volume data processing.
- Experience with multiple data domains, global data products, regional data-residency requirements, infrastructure-as-code, DataOps, or automated environment provisioning.
- Experience in a regulated, high-scale, or operationally sensitive environment.
Culture & Benefits
- Full-time employment with health insurance, retirement plans, and paid time off.
- Distributed onshore/offshore delivery model with defined handoffs, overlap hours, documentation standards, ceremonies, and escalation paths.
- Focus on ownership, continuous improvement, reliable execution, and reusable engineering practices.
- Commitment to equal employment opportunity and reasonable accommodation during recruitment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
14 дней назад
Lead Data Engineer (Tax)
140 000 - 210 000$
2 дня назад
Lead Data Architect (Snowflake)
121 865 - 164 875$
13 дней назад
Data Engineer (AI)
180 000 - 220 000$
10 дней назад
Lead DataOps Engineer (Azure)
10 833 - 14 667$
10 дней назад
Senior Manager, Data Engineering (AWS)
199 000 - 220 000$
14 дней назад
Director of Data & Analytics (SaaS)
210 000 - 230 000$