Senior Data Engineer

TL;DR

Senior Data Engineer (Business Intelligence): Creating and managing metrics models for marketplace projects, collaborating with the Business Analyst to identify the right metrics and then collecting, managing, and converting raw data into useful information with an accent on finding the best way to acquire, activate, retain and convert user bases. Focus on building and managing data pipelines for technical metrics and UX/UI metrics that help increase audience engagement.

Company

hirify.global helps early-stage entrepreneurs, tech startups and growing companies to conceptualise, design, build, improve, and launch successful online marketplaces.

What you will do

• Design, deliver and continuously test data pipelines that will aggregate data into reports.
• Collaborate with the team to create innovative proofs-of-concept, pilot projects, minimum viable products, and business cases.
• Transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques.
• Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using data platform infrastructure effectively.
• Produce and automate delivery of key metrics and KPIs to the business.
• Monitor usage of data platforms and work with clients to deprecate reports and data sets that are not needed and create a continuous improvement model for the data.

Requirements

• Expert with Python (5+ years experience)
• Experience with SQL and NoSQL (5+ years experience)
• Experience with database technologies like Relational, NoSQL, MPP, Vector and Columnar databases (3+ years experience)
• Experience in AWS (3+ years experience)
• A comprehensive understanding of cloud data warehousing and data transformation (extract, transform and load) processes and supporting technologies such as Airbyte, Dbt, Dagster, AWS S3, EMR, Data Lakehouse, and other analytics tools.
• Proven ability to design Data Models and ETL pipelines that meet business requirements in the most efficient manner.

Nice to have

• Previous experience working with software development companies.
• An understanding of the platform economy, especially online marketplaces