4 часа назад
Staff Data Engineer (Big Data)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff Data Engineer (Big Data): Building and maintaining a self-service, scalable, and secure data platform and end-to-end data pipelines with an accent on Spark, Airflow, AWS, Databricks, data modeling, and data quality. Focus on optimizing SQL performance, implementing governance and observability, designing lakehouse architectures, and enabling reliable self-service analytics.
Location: Remote-first, candidates can live anywhere in Brazil; optional work from São Paulo offices or partner coworking spaces up to twice a week.
Company
is a real estate technology ecosystem operating across Latin America, developing digital products and solutions for the housing journey.
What you will do
- Build and maintain a high-performance, scalable, self-service, and secure data platform.
- Design, develop, and maintain end-to-end data pipelines, including aggregation, transformation, cleaning, and quality checks.
- Create data models, transformation workflows, semantic abstractions, and multidimensional schemas.
- Own the development lifecycle, including deployment monitoring, documentation, performance, security, metrics, alarms, and SLO compliance.
- Investigate data inconsistencies, troubleshoot root causes, and enable teams to use data through self-service tools and well-modeled datasets.
- Collaborate with stakeholders, run proofs of concept and benchmarks, and contribute to the strategic vision for data engineering.
Requirements
- Expertise in Big Data technologies and concepts, including Spark, Hadoop, Hive, and MapReduce.
- Experience with Airflow, Spark, AWS, Databricks, columnar storage, and data lakehouse concepts.
- Strong software engineering foundation, with proficiency in Python or another major programming language and a focus on clean, maintainable code.
- Strong SQL query performance optimization skills and experience with Star or Snowflake dimensional schemas.
- Understanding of data lineage, governance, privacy, retention, and anonymization.
- Knowledge of Kubernetes or ECS, CI/CD, Terraform, Prometheus, Grafana, and experience as a technical or project lead. Proficiency in English is required.
Nice to have
- Experience building large-scale data platforms for big data sets and teams.
- Experience with Trino, Atlas, Ranger, or similar Big Data technologies.
- Experience building semantic layers.
Culture & Benefits
- Remote-first work model with home office allowance.
- Profit sharing, meal allowance, health insurance, dental plan, and life insurance.
- Childcare and atypical parenthood subsidies, extended parental leave, and Wellhub.
- Employee assistance covering mental health, social, legal, and financial support.
- Birthday, Mother’s Day, and Father’s Day leave, plus education discounts and a benefits club.
Hiring process
- Application and recruiter interview.
- Technical screening followed by technical interviews with the Data Team.
- Offer stage.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →