Senior Data Developer (AWS)

TL;DR

Senior Data Developer (AWS/AI): Building scalable data pipelines and AI foundations using AWS Glue, Spark, and Python with an accent on AI ecosystem integration and vector database implementation. Focus on transforming raw data into curated datasets to accelerate AI capabilities across commercial and marketing domains.

Location: Remote (Must be based in Brazil)

Company

hirify.global is a tech transformation company that unites human expertise with AI to create scalable technical solutions for over 1,000 global clients.

What you will do

• Develop data pipelines using AWS Glue, Spark, and Python (Pandas/Lambdas) to curate datasets.
• Structure data in Amazon S3 and integrate it with Vector Databases or Redshift for advanced analytics.
• Process structured and unstructured data into optimized formats like Parquet for efficient querying.
• Configure and automate data processing workflows using AWS Step Functions or MWAA (Airflow).
• Collaborate with data scientists and stakeholders to build a unified ecosystem for AI capabilities.
• Implement data governance practices and scalable architectures to support corporate initiatives.

Requirements

• Advanced English proficiency for interaction with global teams and documentation.
• Must be based in Brazil.
• Strong experience with the AWS ecosystem, particularly S3 as the primary data source.
• Proficiency in AWS Glue, Spark, or Python.
• Experience with Databricks and API integrations for data processing.
• Expertise in handling Vector Databases (e.g., Qdrant) for AI applications.

Nice to have

• Familiarity with AI frameworks and methodologies.
• Experience with data orchestration tools like Apache Airflow.
• Knowledge of data governance and compliance standards.
• Understanding of performance optimization techniques for data pipelines.

Culture & Benefits

• Comprehensive health, dental, and life insurance.
• Meal and food allowance, along with childcare assistance.
• Profit Sharing and Results Participation (PLR).
• Continuous learning via hirify.global University and partnerships with online learning platforms.
• Wellness support via Wellhub (Gympass), TotalPass, and mental health platforms.
• Extended paternity leave and responsible parenting courses.