5 дней назад
Senior Data Engineer (AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS): Building and scaling ingestion, catalog, and derived data pipelines for a digital infrastructure marketplace with an accent on data contracts, schema governance, and observability. Focus on architecting a greenfield graph layer for RouteFinder, modernizing legacy systems, and enforcing data quality across high-confidence InfraSpec datasets.
Location: US-based, fully remote, working US business hours
Company
operates a marketplace and advisory for buying and selling datacenter, cloud, and network services.
What you will do
- Build, optimize, and scale ingestion, catalog, and derived pipelines across core data domains feeding InfraSpec.
- Lead migration from legacy and single-owner scripts to a durable, scalable platform architecture.
- Architect the greenfield graph database layer for RouteFinder.
- Implement data contracts, consistency checks, quality gates, and workflow support for automated intake.
- Establish observability and automated testing to keep pipeline rework below the 20% target.
- Partner with Data Science/ML, Intelligence Engine, Trust, and global Data Foundation teams across time zones.
Requirements
- 10+ years of dedicated data engineering experience with senior individual contributor scope.
- Advanced SQL and Postgres skills, expert Python abilities, and experience with modern data warehouse patterns such as dbt or equivalent.
- Extensive experience designing large-scale ELT/ETL pipelines, data contracts, schema governance, and robust data models.
- Deep practical experience with AWS services for storage, orchestration, compute, and data processing.
- Must be a US-based full-time employee and work US business hours.
- Strong written and verbal English communication is required.
Nice to have
- Experience with graph databases such as Neo4j or AWS Neptune, especially for network topology, geospatial routing, or graph-based search.
- Experience with streaming technologies including Kafka, Kinesis, or Flink.
- Experience with data observability and quality frameworks such as Great Expectations, Monte Carlo, or Soda.
- Experience building ML feature pipelines or working with telecommunications, datacenter, or digital infrastructure data.
Culture & Benefits
- Fully remote work environment.
- Health insurance options fully covered for employees and their families.
- Unlimited paid time off.
- Dental and vision insurance options.
- Option grants for full-time employees, beginning to vest after the first year.
- Fast-paced startup environment with employee ownership.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →