Senior Data Engineer (Databricks)

Location: Onsite in Singapore; candidates must travel to Singapore within 30–45 days of onboarding, subject to paperwork completion.

Company

hirify.global is hiring for a consulting-focused data engineering role.

What you will do

• Design, build, operate, and optimize scalable data pipelines and end-to-end workflows on Databricks.
• Implement ingestion, transformation, consumption, error handling, monitoring, alerting, and data quality processes.
• Optimize Spark jobs and cluster configurations while managing Databricks Jobs and workflow orchestration.
• Refactor legacy pipelines to PySpark and migrate traditional ETL processes to modern ELT patterns while preserving data integrity.
• Design and maintain Delta Lake tables, reusable data engineering frameworks, and dimensional, data vault, or lakehouse models.
• Collaborate with architects, analysts, stakeholders, Infrastructure, Applications, and Cyber teams; mentor junior data engineers and document technical solutions.

Requirements

• 5–8 years of experience in the role overview, with a minimum of 8 years listed under professional experience.
• At least one Databricks certification is required: Databricks Certified Data Engineer Associate or Professional.
• At least 2–3 years of hands-on Databricks experience, including workspace, clusters, notebooks, and job orchestration.
• Strong Python and hands-on PySpark experience, including the DataFrames API, Spark SQL, and performance optimization.
• Experience with data pipeline design, ETL/ELT, multiple data sources and formats, production-scale systems, legacy modernization, and agile development.
• Knowledge of Delta Lake, data modeling, SQL, cloud platforms, data governance and security, streaming, Git, CI/CD, testing, and data quality frameworks; excellent communication and stakeholder management skills.

Nice to have

• Databricks Certified Associate Developer for Apache Spark.
• Azure, AWS, or Google Cloud data engineering certifications.
• Relevant data engineering or big data certifications.
• Knowledge of Databricks Workspace AI Agent capabilities and integration.

Culture & Benefits

• Work in an agile development environment.
• Collaborate across data, infrastructure, applications, cybersecurity, and business stakeholder groups.
• Participate in code reviews and share data engineering best practices with Team NCS.
• Mentor junior data engineers and maintain comprehensive technical documentation.