6 дней назад
Software Developer & Data Engineer (Python)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Software Developer & Data Engineer (Python): Building and operating The Pantry data lakehouse with an accent on source ingestion, entity resolution, pipeline consolidation, and trustworthy food-data publishing. Focus on designing lakehouse architecture, resolving product identities across sources, controlling cloud API costs, and delivering robust downstream data connectors.
Location: United States; fully remote
Company
is building a food intelligence platform that turns fragmented food data into consistent, explainable information for consumers, brands, and institutions.
What you will do
- Implement and shape the architecture of The Pantry data lakehouse using DuckLake, S3 Parquet, Postgres, Prefect, and Python.
- Build ingestion patterns for APIs, public text sources, and external databases.
- Design identity resolution and provenance systems that merge product records while preserving source-level traceability.
- Consolidate food enrichment pipelines and build downstream connectors for WISE Intel and the consumer app.
- Establish data ingestion, quality reporting, configuration discipline, and decision records.
Requirements
- 3+ years of experience in a similar software or data engineering role.
- Native proficiency in Python and SQL.
- Experience designing, shipping, and operating a lakehouse or data warehouse from scratch in production for at least one year.
- Experience with data identity, entity resolution, batch pipelines, paid cloud or third-party APIs, and strict cost controls.
- Experience working daily with other engineers in a fast-paced environment.
- Experience with DuckDB, DuckLake, S3 Parquet, Postgres, DynamoDB, Prefect, AWS infrastructure, Kubernetes or Fargate, Terraform, and GitHub Actions.
Nice to have
- Experience evaluating DuckDB and other lightweight query engines against Spark, Databricks, or Snowflake.
- Familiarity with web scraping or OCR API integration.
- Food or nutrition knowledge, deep Spark, Databricks, or Snowflake experience, and people management experience are not required.
Culture & Benefits
- Early-stage environment with room to shape platform and data architecture.
- Fully remote work.
- Unlimited PTO and 10 paid holidays.
- 401(k) with a 4% company match and immediate vesting.
- Medical, dental, vision, life, disability, identity theft, FSA, and HSA benefits, including employer-paid coverage and HSA contributions.
- Competitive base compensation, bonus, and meaningful equity.
Hiring process
- Compensation details are shared during the hiring process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →