Data Platform Specialist - Data Engineer (Big Data)

TL;DR

Data Platform Specialist - Data Engineer (Big Data): Designing, developing, and optimizing data pipelines and models for robust infrastructure and analytical solutions with an accent on building optimal and scalable data pipelines, integrating complex datasets, and creating actionable insights. Focus on automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.

Location: Onsite in Montreal (St. Laurent)

Company

hirify.global is a world-class company and industry leader passionate about innovation and using state-of-the-art tools.

What you will do

• Design, develop, and optimize data pipelines and models.
• Build optimal and scalable data pipelines aligned with the target architecture.
• Integrate data sets aligned with business requirements.
• Build infrastructure for optimal extraction, transformation, and loading of data from various sources and big data technologies.
• Identify, design, and implement internal process improvements, including automation and re-designing infrastructure.
• Build analytics tools to provide actionable insights into key business performance metrics.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum of 3 years industry experience working with data, coding, and scripting (Python/Java/Scala/SQL/JS/Bash), design and testing.
• Minimum of 3 years experience developing and administering large data systems.
• Solid knowledge of CS fundamentals in algorithms and data structures.
• Experience with big data tools (Hadoop, Spark, Kafka) and relational/NoSQL databases (SQL Server, CosmosDb).
• Experience with automated data pipeline and workflow management tools (DevOps, ARM, Data Factory, Airflow).
• Experience with Microsoft cloud services (Azure, Databricks) and stream-processing systems (Storm, Spark-Streaming).

Culture & Benefits

• Work in an environment where you can meet challenges and innovate.
• Utilize state-of-the-art tools and collaborate with experts from various sectors.
• Join a world-class company and industry leader.
• Committed to providing equal employment opportunities to all applicants and employees.
• Offers reasonable accommodations during the recruitment process.