6 часов назад
Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Python/AWS): Building and scaling production ETL pipelines, governed data models, and real-time data infrastructure for an agentic payments platform with an accent on data quality, security, observability, and scalable schema architecture. Focus on designing systems for 10x data growth, enabling self-serve AI-powered analytics, and operating reliable pipelines through on-call incident response.
Location: San Francisco, CA, United States; On-site
Company
provides an end-to-end infrastructure platform for shipping and scaling agentic products, including compute, identity, payments, automation, data, and monitoring capabilities.
What you will do
- Build, scale, and optimize production ETL pipelines from ingestion through data availability.
- Design data schemas and infrastructure capable of supporting 10x data growth.
- Establish data quality, governance, security, and schema standards across the platform.
- Develop standardized, self-serve data models for AI-powered analytics.
- Instrument pipeline observability and surface health metrics before issues become incidents.
- Partner with Data Science, Analytics, Engineering, and DevOps teams on reliable data infrastructure.
Requirements
- 5+ years of experience transforming raw data into governed, documented, production-ready datasets.
- Hands-on production experience with SQL, Python, Spark, AWS Glue, EMR, dbt, and Airflow.
- 3+ years of production experience with MPP databases such as Snowflake, AWS Redshift, or Teradata.
- Ability to design scalable schemas and data systems that support future growth.
- Experience partnering with Engineering, Analytics, Data Science, and DevOps teams.
- Comfort participating in an on-call rotation and responding to incidents outside regular working hours.
Culture & Benefits
- Foundational ownership of data infrastructure, standards, architecture, and culture.
- Work closely with cross-functional technical and business teams.
- Operate in an environment focused on production reliability, data trust, and rapid execution.
- Contribute to a payments platform processing agent transactions, policy decisions, and risk signals in real time.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →