4 дня назад
Data Engineer (Snowflake)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Snowflake) (Dagster/dbt/Python): Building and maintaining ingestion and transformation pipelines across Dagster or Airflow, dbt, Snowflake, Python, Airbyte, and AWS with an accent on reliable Postgres-to-Snowflake flows and third-party API loads. Focus on dimensional modeling, incremental strategies, backfills, production monitoring, and debugging IAM, memory, infrastructure, and data-quality failures.
Location: Fully remote position in the United States; Atlanta, Georgia is listed for posting-system purposes only.
Company
operates a platform focused on solving the affordable housing crisis.
What you will do
- Build and maintain Dagster or Airflow jobs, assets, schedules, sensors, dbt models, tests, and documentation through reviewed pull requests.
- Implement and debug Python pipelines for REST/API synchronization, large PostgreSQL extracts, Parquet loads, and Snowflake COPY operations.
- Configure and troubleshoot Airbyte connections and make occasional Terraform updates for secrets, environment variables, and job sizing.
- Monitor production runs and investigate failures involving IAM, out-of-memory conditions, Spot instances, and incorrect watermarks.
- Run backfills and incremental catch-ups while documenting data outcomes and rationale.
- Partner with analytics and product teams on dimensional modeling, incremental strategies, data quality, code reviews, and operational runbooks.
Requirements
- Strong understanding of relational databases, warehouse patterns, keys, grain, normalization, star schemas, and slowly changing dimensions.
- Hands-on experience with Dagster or Airflow and dbt models, tests, and documentation.
- Ability to write and maintain Python data pipelines operating at scale across extract, transform, and load stages.
- Practical working knowledge of AWS S3, IAM, and ECS/Fargate for job-level troubleshooting.
- Experience with Airbyte or similar extract-and-load tools, plus disciplined pull-request practices and rigorous code review.
- Ability to work fully remotely from the United States.
Culture & Benefits
- Fully remote work arrangement.
- Equity incentive plan and company-wide bonus opportunity.
- National medical, dental, and vision plans, plus company-provided life insurance.
- Optional accidental insurance, FSA, and DCFSA benefits.
- Unlimited paid time off, eleven company-observed holidays, and twelve weeks of paid leave for birth and non-birth parents.
- 401(k) plan.
Hiring process
- Application review by the PeopleOps team.
- Video interviews with PeopleOps, the Principal Data Scientist, key stakeholders, and a company leader.
- The process concludes with an offer when appropriate.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →