BigData Architect (Databricks + AWS)

TL;DR

BigData Architect (Databricks + AWS): Designing and implementing scalable data platforms on AWS with an accent on the Databricks ecosystem and Lakehouse architectures. Focus on building batch and streaming data pipelines, optimizing data ingestion, and ensuring system scalability across the full project lifecycle.

Location: Poland (Remote/Office)

Company

A leading global IT services company specializing in software development and digital transformation for various industries.

What you will do

• Design and implement scalable data solutions utilizing Databricks on AWS.
• Develop and maintain batch and streaming data pipelines and Lakehouse architectures.
• Collaborate with stakeholders to translate business requirements into technical specifications and implementation plans.
• Manage complex workflows using orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA.
• Implement real-time data processing solutions using Apache Kafka, Amazon MSK, or Kinesis.
• Create and maintain critical technical documentation, data schemas, and solution-related materials.

Requirements

• Proven experience designing scalable data platforms and data pipeline architectures.
• Strong expertise in AWS cloud services and Databricks components (Delta Lake, Unity Catalog, Workflows).
• Proficiency in Python, Scala, or Java, and advanced SQL skills.
• Knowledge of big data technologies such as Apache Spark or Flink.
• Practical experience with streaming technologies and data warehousing (Snowflake, Amazon Redshift).
• English: Upper-intermediate (B2) or higher level required.

Culture & Benefits

• Collaborative and innovation-driven professional environment.
• Opportunities to explore new technologies and build prototypes.
• Active knowledge sharing within a global engineering community.
• Commitment to diversity and equal opportunity employment.