Senior Software Engineer (Data Product)

Senior Software Engineer, Data Product

Company

TRM Labs

Conditions

1 day agoSenior South America Remote Full Time Engineering Jobs by TRM Labs

Skills

Sparksql Flink Dataflow Workflow Orchestration Bigquery Postgres Airflow Dbt Terraform Data Pipeline Streaming Datadog Spark Data Processing Sql Python Docker Kubernetes Api Distributed System Blockchain Kafka Data Modeling

About the Role

You will design and build mission-critical data services that analyze blockchain transaction activity at petabyte scale. You will design and implement intricate data models for fast storage and retrieval, develop scalable APIs and distributed systems, and build pipelines and streaming workflows to load, query, and transform very large datasets. You will collaborate with data scientists, backend engineers, and product managers to turn requirements into production features, deploy and monitor infrastructure in public clouds, and use tools like Python, SQL or SparkSQL, BigQuery, Postgres, Airflow, DBT, Dataflow, Spark, Kafka, Flink, Docker, Terraform, Kubernetes, and Datadog to deliver reliable, low-latency solutions.

Requirements

• Bachelor's degree or equivalent in Computer Science or related field
• 5+ years of experience architecting scalable API development and distributed system architecture
• Exceptional programming skills in Python
• Proficiency in SQL or SparkSQL
• Experience with data stores such as BigQuery and Postgres
• Experience with pipeline and orchestration tools like Airflow and DBT
• Experience with data processing and streaming technologies such as Dataflow, Spark, Kafka, and Flink
• Experience deploying and monitoring infrastructure using Docker, Terraform, Kubernetes, and Datadog
• Proven ability to load, query, and transform extensive datasets

Responsibilities

• Build highly scalable features that integrate with multiple blockchains
• Design and architect data models for optimal storage and sub-second retrieval
• Collaborate with data scientists, backend engineers, and product managers to implement data-driven features
• Architect and develop scalable APIs and distributed systems
• Develop and maintain data pipelines and workflow orchestration
• Process, load, query, and transform large datasets
• Deploy, monitor, and maintain infrastructure in public cloud environments

Показать контакты