2 часа назад
Staff Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff Data Engineer (Big Data/Python): Building and maintaining self-service, scalable data platforms and end-to-end pipelines that enable analysts and data scientists to generate insights with an accent on data modeling, quality, security, and platform reliability. Focus on optimizing SQL and distributed processing, designing lakehouse architectures, solving data inconsistencies, and defining extensible solutions across teams.
Location: Remote-first, anywhere in Brazil, with the option to work from São Paulo offices or partner coworking spaces up to twice a week.
Company
Group is a Latin American real estate technology ecosystem developing platforms and solutions for the housing journey, including large-scale applications of artificial intelligence.
What you will do
- Design, build, and maintain scalable, secure, high-performance data platforms and end-to-end data pipelines.
- Create data modeling and transformation workflows, including aggregation, field transformation, data cleaning, and quality checks.
- Own the software development lifecycle for data systems, including deployment monitoring, documentation, performance, security, metrics, alarms, and SLO compliance.
- Enable self-service data access through well-modeled datasets and tools for analysts and data scientists.
- Investigate data inconsistencies, trace discrepancies to their sources, and align scalable solutions with stakeholder needs.
- Conduct proofs of concept and benchmarks, contribute to strategic technical decisions, and act as a reference for engineering practices.
Requirements
- Expertise in Big Data technologies such as Spark, Hadoop, Hive, and MapReduce.
- Experience with Python, Airflow, Spark, AWS, Databricks, columnar storage, and data lakehouse concepts.
- Strong software engineering fundamentals, clean and maintainable coding practices, and SQL query performance optimization skills.
- Experience building multidimensional data models using Star or Snowflake schemas and understanding data lineage, governance, privacy, retention, and anonymization.
- Knowledge of containers, orchestration, CI/CD, Terraform, observability, Kubernetes, ECS, Prometheus, or Grafana.
- Proficiency in English is required because code, documentation, tools, and materials are often in English; experience as a tech or project lead and strong stakeholder communication are also expected.
Nice to have
- Experience building large-scale data platforms for big datasets and teams with technologies such as Trino, Hive, Atlas, or Ranger.
- Experience building semantic layers.
Culture & Benefits
- Remote-first work model with home office allowance.
- Competitive salary, profit sharing, meal allowance, and health, dental, and life insurance.
- Childcare and atypical parenthood subsidies, extended parental leave, and Wellhub.
- Employee assistance program covering mental health, social, legal, and financial support.
- Birthday, Mother’s Day, and Father’s Day days off, plus education discounts and other benefits.
Hiring process
- Application, recruiter interview, and technical screening.
- Technical interviews with the Data Team followed by an offer.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →