Software Engineer, Data Infrastructure & Acquisition (AI)

TL;DR

Software Engineer, Data Infrastructure & Acquisition (AI): Developing data ingestion pipelines and web crawling workflows for AI datasets with an accent on cloud infrastructure and large-scale data processing. Focus on building a dataset roadmap, managing infrastructure via Terraform, and optimizing data throughput for scientists.

Location: Ljubljana, Slovenia (Remote friendly)

What you will do

• Build and maintain the dataset roadmap for the AI team.
• Collaborate with scientists to optimize data cost, throughput, and quality.
• Develop web crawler workflows and identify new audio data sources.
• Extend and manage cloud infrastructure using Terraform.
• Operate and optimize large-scale data ingestion and processing pipelines.

Requirements

• Proficiency in Python and Bash.
• Experience with Google Cloud Platform (GCP) and Docker.
• Strong knowledge of Infrastructure as Code (IaC) and Terraform.
• Expertise in web crawling and large-scale data workflows.
• Experience working with Linux environments.

Culture & Benefits

• Asynchronous work culture.
• Flexible, hands-off management.
• Friendly and collaborative atmosphere.
• Remote-friendly distributed team setting.