2 дня назад
Data Engineer (Python)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Python): Building and optimizing critical data infrastructure for an ernative assets marketplace with an accent on scraping, processing, and ingesting transaction data from external marketplaces. Focus on designing robust pipelines, implementing comprehensive monitoring systems, and ensuring high data quality for pricing models.
Location: Remote (Must be based in the US)
Company
is unlocking the value of ernative assets, starting with the $5 B trading-card market.
What you will do
- Design, optimize, and own data pipelines to scrape and ingest transaction and listing data from major auction houses and marketplaces.
- Build comprehensive monitoring and alerting systems to track latency, uptime, and coverage metrics across all data sources.
- Modernize storage and processing technologies to optimize cost, performance, and reliability.
- Partner with internal teams to ensure pipelines deliver clean, standardized data that meets product requirements.
Requirements
- 3-4 years of experience in data engineering or related fields.
- Strong Python proficiency with at least 3 years of hands-on experience.
- Proven experience with large-scale data processing using dataframe technologies (Pandas, Polars, PySpark, or similar).
- Hands-on experience with pipeline orchestration tools (Airflow, Dagster, or similar DAG-based systems).
- Track record of owning at least one data pipeline end-to-end within the past 2 years.
- Solid SQL skills and previous startup experience.
Nice to have
- Experience with web scraping technologies (Selenium, Puppeteer, Beautiful Soup).
- Familiarity with AWS cloud services.
- Knowledge of trading cards, collectibles, or ernative asset markets.
- Experience with LLM-based automation tools for data extraction and processing.
Culture & Benefits
- Monthly work-from-home ($100) and wellness ($200) stipends.
- WeWork office stipend.
- 401(k) retirement benefits and flexible vacation policy.
- Generous paid parental leave.
- Competitive hehcare benefits, including HSA, for employees and dependents.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →