2 дня назад
Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Building and maintaining a central data platform with an accent on scalable data pipelines, secure data flows, and analytics and AI/ML workloads. Focus on developing lakehouse and data integration solutions, automating ETL/ELT workflows, managing metadata and data quality, and supporting reliable data availability.
Location: Petaling Jaya, Selangor, Malaysia
Company
Global provider of precision instruments and services for laboratory, process analytics, industrial, product inspection, and retailing applications.
What you will do
- Develop and maintain the central enterprise data platform, including data lake and lakehouse capabilities.
- Build batch and streaming data integration pipelines across internal systems, external partners, and cloud services.
- Implement ETL, ELT, and reverse ETL workflows for analytics, reporting, and AI/ML use cases.
- Automate ingestion, transformation, orchestration, and data distribution workflows.
- Create and maintain metadata catalogs, data lineage, feature stores, and data quality rules.
- Monitor, troubleshoot, optimize, and secure data pipelines while collaborating with data scientists, analysts, and business stakeholders.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or an equivalent technical field.
- 3+ years of hands-on experience in data engineering or a similar role.
- Strong experience with Apache Spark, Snowflake, Databricks, lakehouse or Delta Lake technologies, data lakes, Python, and SQL.
- Solid understanding of data modeling, ETL/ELT, data warehousing, and metadata management.
- Experience with orchestration tools such as Airflow or Prefect and familiarity with cloud platforms, preferably Azure.
- Strong analytical, problem-solving, communication, documentation, collaboration, data security, and continuous improvement skills.
Culture & Benefits
- Medical coverage for the employee’s spouse and children.
- Dental coverage for the employee’s spouse and children.
- Life insurance plan.
- Commitment to data protection, high-quality engineering standards, diversity, and equal opportunity.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →