Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (Python/Spark): Building and optimizing scalable batch and real-time data pipelines and lakehouse solutions for an AI-powered customer analytics platform with an accent on large-scale data processing and ML/AI integration. Focus on designing production-grade data flows, scaling the data ecosystem for Big Data growth, and productionizing ML workloads.

Location: Remote (Mexico)

Salary: MXN 55,000 - 70,000 monthly

Company

NIQ is a global leader in consumer intelligence, providing AI-powered analytics and brand collaboration platforms to reveal consumer buying behavior.

What you will do

• Own end-to-end data flows from architecture and requirements through implementation and production operations.
• Design and build scalable batch and real-time data pipelines and lakehouse solutions focusing on large-scale processing.
• Explore and implement technologies to scale the data ecosystem to handle rapid Big Data growth.
• Partner with Data Science teams to productionize ML/AI workloads and ensure seamless product integration.
• Collaborate with cloud, DevOps, and application teams to deliver robust, secure, and scalable solutions.
• Evaluate and adopt new patterns and technologies as system scale and complexity increase.

Requirements

• 3+ years of experience building and operating production-grade data systems and pipelines.
• Proficiency in Python and working proficiency in Scala.
• Strong expertise with at least one major cloud provider (AWS, Azure, or GCP).
• Deep experience with Big Data processing (Spark, Databricks) and event streaming (Kafka).
• Strong SQL skills and experience with Data Lake/Lakehouse, columnar DB, or NoSQL systems.
• Experience with Airflow (DAGs), containers, Kubernetes, and modern CI/CD practices.

Nice to have

• Experience with Delta Lake, Apache Iceberg, or ML lifecycle tools like MLflow.
• Proficiency with Pandas/Polars and building data APIs using FastAPI.
• Experience building LLM-powered agents (RAG, tool calling) using LangChain or LangGraph.
• Infrastructure as Code skills (Terraform, Pulumi, CloudFormation) and cloud security fundamentals.
• Knowledge of observability tooling and experience with React and Node.js.

Culture & Benefits

• Flexible working environment.
• Volunteer time off.
• Access to LinkedIn Learning.
• Employee Assistance Program (EAP).