3 дня назад
Data Engineer Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer Data Engineer (AWS/Databricks): Building and optimizing scalable batch and streaming data pipelines for a fintech lending platform with an accent on lakehouse architecture, data quality, and production-grade transformations. Focus on implementing Medallion data models, incremental and CDC patterns, ETL/ELT orchestration, and reliable CI/CD-enabled data workflows.
Location: Hybrid in Manila or Cebu, Philippines
Company
is a fintech lender providing digital property-equity financing and Buy Now, Sell Later solutions for Australian homeowners.
What you will do
- Design, develop, and optimize scalable batch and streaming data pipelines using AWS and Databricks.
- Implement data models, transformations, ingestion frameworks, and Medallion architecture across Bronze, Silver, and Gold layers.
- Manage ETL/ELT orchestration with Azure Data Factory, Fabric Pipelines, or equivalent tools.
- Develop high-performance SQL queries and analytical models for reporting and analytics.
- Ensure data quality, reliability, lineage, monitoring, testing, and documentation.
- Collaborate with data scientists, analysts, engineers, and business stakeholders while applying Git, CI/CD, modular design, testing, and automation practices.
Requirements
- 3–5+ years of experience in data engineering across batch and streaming workloads.
- Strong Python skills, including NumPy, Pandas, and related data-processing libraries.
- Strong SQL skills for production-grade transformations and analytical models.
- Hands-on AWS and Databricks experience, especially with Delta Lake or lakehouse environments.
- Understanding of Star and Snowflake data modeling, Medallion architecture, and incremental or CDC design patterns.
- Experience with ETL/ELT orchestration and proficient Git usage, including branching strategies and CI/CD integration.
Nice to have
- Experience with AI-assisted development tools such as Cursor or GitHub Claude.
- Exposure to Power BI, Fabric Data Warehouse, semantic models, and DAX.
- Knowledge of data governance, lineage, data quality frameworks, DevOps, and cloud cost optimization.
- Experience integrating machine learning models or LLM-based workflows into data pipelines.
Culture & Benefits
- Work in an innovative and agile fintech environment with office-based collaboration.
- Birthday leave and one additional paid day for life events, celebrations, or mental health.
- Option to work remotely from a location of choice for two weeks each year.
- Professional development opportunities and internal learning initiatives.
- Social events throughout the year.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →