Senior Data Engineer

#lookfor #vacancy #remote #DataEngineer #SQL #Python #Airflow #Spark #DWH

We are looking for a Data Engineer to join remote outstaff projects for our partner companies.

Level: Middle+ / Senior
Format: Remote
Engagement: Full-time / long-term cooperation
English: B2+ required
Employment: possible official employment or contract cooperation in RF / RB / EU

Responsibilities:
• design, develop, and maintain ETL/ELT data pipelines;
• build data flows for analytics, BI, reporting, product, and ML use cases;
• work with batch processing and, depending on the project, streaming pipelines;
• develop workflows using Airflow or similar tools;
• write and optimize SQL queries;
• develop data processing logic using Python;
• work with Spark or similar distributed processing tools;
• design data models, data marts, and analytical datasets;
• work with DWH, Data Lake, or Lakehouse architectures;
• integrate data from databases, APIs, events, files, external systems, and cloud storage;
• ensure data quality, consistency, and pipeline reliability;
• support production pipelines and troubleshoot data issues.

Required skills:
• 3+ years as a Data Engineer or similar role;
• strong SQL: joins, CTEs, window functions, aggregations, optimization;
• Python for data processing and pipeline development;
• ETL/ELT pipeline development;
• Airflow or similar workflow orchestration tools;
• Spark or similar distributed processing tools;
• DWH / Data Lake / Lakehouse concepts;
• relational databases: PostgreSQL / Oracle / MySQL / MS SQL or similar;
• data modeling and analytical datasets / data marts;
• Git;
• data quality, validation, and pipeline reliability;
• data formats: Parquet / Avro / ORC / JSON / CSV;
• cloud storage or S3-compatible storage;
• Hadoop ecosystem: HDFS / Yarn / Hive Metastore / Ranger / Zookeeper;
• production troubleshooting;
• English B2+.

Nice to have:
• Kafka / Flink / Debezium;
• Snowflake / Redshift / BigQuery / Databricks / Azure Synapse / Microsoft Fabric;
• dbt;
• Trino / Presto;
• Iceberg / Delta Lake / Hudi;
• ClickHouse / Greenplum / Vertica;
• AWS / Azure / GCP;
• Docker / Kubernetes;
• Grafana / VictoriaMetrics / Zabbix;
• NiFi;
• reusable data processing templates;
• high-load or near real-time pipelines;

Please send your CV in English with your rate, availability, location, preferred cooperation format, data platforms, and examples of pipelines or data platforms you have built.

Contacts:
• Показать контакты