Senior Data Engineer (Databricks, Pharma)

TL;DR

Senior Data Engineer (Databricks, Pharma): Designing, developing, and optimizing scalable data pipelines for large-scale datasets with an accent on Databricks, Spark, and data modeling. Focus on building robust ETL/ELT solutions, ensuring data integrity, and enabling downstream analytics in the healthcare domain.

Location: Onsite in Karnataka, India

Company

hirify.global is a technology-led healthcare solutions provider, focused on enabling healthcare organizations to be future-ready.

What you will do

• Design, develop, and optimize scalable data pipelines using Databricks for reliable ingestion and transformation of large-scale datasets.
• Collaborate with product owners, analytics teams, and business stakeholders to translate data requirements into robust Databricks-based solutions.
• Design, implement, and maintain efficient data models (Lakehouse patterns) to support evolving analytical and business needs.
• Build, enhance, and migrate complex ETL/ELT pipelines leveraging Databricks, Delta Lake, Spark, and cloud object storage.
• Continuously improve performance, scalability, reliability, and cost efficiency of data pipelines through Spark optimization.
• Implement and adhere to data governance, data quality, security, and compliance standards within the Lakehouse.
• Apply domain knowledge in pharma commercial analytics to enable the creation of actionable KPIs.

Requirements

• 4+ years of overall experience in data engineering with strong hands-on ownership of data pipelines.
• Proven experience in ETL/ELT development, data modeling, and modern data architectures.
• Strong ability to work with stakeholders and translate business requirements into technical solutions.
• 4+ years of hands-on experience with Databricks, including notebooks, jobs, workflows, Databricks SQL, and Delta Lake.
• Strong expertise in Apache Spark (PySpark) for large-scale data processing.
• Hands-on experience with cloud object storage (ADLS / S3 / GCS) integrated with Databricks.
• Strong programming experience in Python for data engineering use cases and advanced SQL skills.
• Experience working with Life Sciences / Pharma data is a strong advantage.

Nice to have

• Exposure to ML/AI.
• Understanding of Gen-AI & Agentic AI.

Culture & Benefits

• Gain a unique career experience that celebrates entrepreneurship and is guided by passion, innovation, collaboration, and empathy.
• Access accelerated, global growth opportunities and mentorship from brilliant minds.
• Work at the exciting intersection of healthcare and technology.
• Be part of a purpose-driven organization focused on customer obsession.
• Commitment to Inclusion and Diversity, with all employment decisions based on merit and qualification.