3 дня назад
Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Building and operating reliable, governed data ingestion and transformation pipelines for real-time financial decision-making with an accent on Databricks, PySpark, Delta Lake, and layered data architectures. Focus on standardizing CDC workflows, implementing observability and data quality controls, and enabling secure self-service data operations across Risk, Lending, Finance, Product, and Operations.
Location: Remote in Colombia
Company
is a fintech platform providing banking, payments, credit, e-commerce, and financial services in Colombia.
What you will do
- Own the design, deployment, monitoring, and operation of mission-critical data pipelines.
- Standardize data ingestion using CDC patterns, schema evolution, automated quality checks, and Bronze, Silver, and Gold layers.
- Build observability dashboards, alerting systems, and runbooks for independent incident resolution.
- Implement data governance, role-based access control, data classification, auditability, and compliance controls.
- Create reusable pipeline templates, CI/CD checks, and local testing utilities to improve developer productivity.
- Partner with Risk, Lending, Finance, Product, Analytics, and Operations teams to deliver robust datasets.
Requirements
- 4+ years of experience in data engineering, building and operating production-grade data pipelines.
- Bachelor’s degree in Computer Science, Software Engineering, Mathematics, or a related technical field.
- Strong hands-on experience with Databricks, PySpark, Delta Lake, batch processing, and streaming architectures.
- Experience with Airflow or similar orchestration tools, including scheduling, backfills, retries, and SLA/SLO management.
- Knowledge of Medallion architecture, CDC, merge patterns, clean code, testing, CI/CD, performance tuning, and Git workflows.
- Experience with data quality controls, data contracts, anomaly detection, observability, incident response, Unity Catalog or similar access controls, PII classification, DLP, and auditability.
Culture & Benefits
- Remote work in Colombia.
- Opportunity to build financial products that improve access to shopping, payments, banking, and credit.
- High-impact environment with ownership, collaboration, transparency, and rapid growth.
- Competitive compensation, company equity, and benefits.
- Work alongside an international engineering and product team.
Hiring process
- People interview with a recruiter, followed by an interview with the hiring manager.
- Take-home technical challenge to be completed within a 5–6 day window, requiring no more than five hours of work.
- Stakeholder interview with a Data Engineer and the Head of Data, followed by a co-founder interview.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Data Engineering Manager | Home Client Services
130 000 - 200 000$
7 дней назад
Senior Data Developer (Databricks)
3 дня назад
Data Engineer (Databricks)
8 дней назад
Senior BigData Engineer (Databricks + Azure)
3 дня назад
Principal Databricks Architect
9 дней назад