Data Engineer

TL;DR

Data Engineer: Building and optimizing scalable data pipelines to process and integrate public web data from various sources with an accent on ETL/ELT workflows, database performance, and cloud infrastructure. Focus on designing real-time and batch processing systems, automating infrastructure, and ensuring data security and scalability.

Location: Remote

Salary: $100k - $140k

Company

Early-stage startup on a mission to make public web data accessible for AI through Grass, a residential proxy network that rewards users for sharing unused bandwidth.

What you will do

• Design, build, and optimize scalable data pipelines for real-time or batch processing from various sources.
• Develop and manage ETL/ELT workflows to transform raw data into structured formats for analysis.
• Integrate and configure database infrastructure like Redshift or Snowflake for performance and scalability.
• Automate data workflows and infrastructure using Airflow, Terraform, and similar tools.
• Collaborate with data scientists and analysts to ensure data accessibility and usability.
• Monitor, troubleshoot, and improve data pipelines and cloud resources on AWS, GCP, or Azure.
• Implement data governance, security, and disaster recovery best practices.

Requirements

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field.
• Extensive experience with databases like Redshift, Snowflake, or similar cloud solutions.
• Advanced SQL proficiency and query optimization.
• Hands-on with data pipelines using Airflow, AWS Glue, or equivalents.
• ETL processes and data integration best practices.
• Experience with Terraform, CloudFormation, Python, Scala, or Java for orchestration.
• Familiarity with Docker, Kubernetes, and cloud infrastructure (AWS, GCP, Azure).

Culture & Benefits

• Lean, autonomous team with flat structure and high responsibility.
• Driven by ambitious goals, urgency, and initiative-based leadership.
• Competitive salary and equity package.
• Low ego, high output culture focused on innovation in AI data access.