Senior Data Engineer

TL;DR

Senior Data Engineer (Databricks/Lakehouse): Lead the initial phase of a data platform transformation by assessing the current Databricks environment and defining the target governed architecture with an accent on medallion (Bronze/Silver/Gold) design, data modeling standards, and documentation that enables scalable delivery. Focus on translating architectural direction into technical guidance, validating SQL/PySpark transformation patterns, and supporting governance/security practices via Unity Catalog.

Location: Guadalajara, Jalisco, Mexico

Company

hirify.global provides AI services and builds data-driven solutions by combining data science, AI, technology, and people.

What you will do

• Assess the existing Databricks environment and prior implementations to support architectural decisions.
• Analyze current components and document recommendations for reuse, refactoring, or redesign.
• Define and document the target lakehouse architecture, including Medallion (Bronze/Silver/Gold), data flows, ingestion patterns, and data modeling/analytics-readiness standards.
• Own architecture and delivery documentation: naming conventions, templates, architectural decisions/assumptions/trade-offs, and keep artifacts up to date.
• Support governance and security standards using Unity Catalog through documentation and guidance, including data ownership, access/environment standards, and metadata/lineage expectations.
• Assist with SQL-based transformation logic design/validation and do lightweight prototyping (SQL or PySpark) to validate architectural patterns.

Requirements

• Bachelor’s degree in Computer Science, Information Systems, or a related field.
• Strong working knowledge of Databricks and modern lakehouse architectures.
• Advanced SQL skills for data analysis, modeling, and transformation design.
• Working knowledge of Python (PySpark preferred) for analysis and prototyping.
• Experience supporting ETL/ELT pipelines in cloud environments (Azure preferred).
• 5+ years of experience in data platform analysis, documentation, and architectural support; excellent written and verbal English for effective communication.

Culture & Benefits

• Learning opportunities: AWS (AWS Partner), Databricks, and Snowflake certifications; Udemy Business; role-based AI learning paths; English lessons.
• Mentorship and career development plans.
• Company-provided equipment and special day rewards (birthdays, work anniversaries, milestones).
• Flexible working options; additional benefits may vary by LATAM location.