Data Engineer

TL;DR

Data Engineer: Building and maintaining ETL workflows with an accent on data quality, data lineage and documenting data. Focus on creating a self service environment for data scientists to explore data independently where needed.

Location: Vietnam (HCMC, Ha Noi, Da Nang)

Company

hirify.global is a company that values openness, fun, and awesomeness.

What you will do

• Design database structures.
• Build and maintain ETL workflows.
• Write clean and well-tested code.
• Software design, modeling, web scraping and data crawling, cleaning, integration, processing, and analysis.
• Use tools like Docker, Conda, Singularity, and Elasticsearch, Airflow and how to use ci/cd tools to include custom compiled code if needed.
• Work with distributed computing engines (Spark, Trino, Presto, Flink) & streaming processing (Flink, kafka).

Requirements

• At least 3 years of experience in Data Engineering.
• Good communication in English.
• Degree in Computer Science or related field.
• Analytical mindset and good problem-solving skills.
• Good organizational skills.
• Ability to work both independently and as part of a team.
• Strong knowledge of Linux/Unix operating system and command line (bash script).
• Proficiency in programming languages, databases: (Python or Java), SQL, PostgreSQL, MySQL.
• Solid experience in software design, modeling, web scraping and data crawling, cleaning, integration, processing, and analysis.
• Experienced with tools like Docker, Conda, Singularity, and Elasticsearch, Airflow and how to use ci/cd tools to include custom compiled code if needed.
• Familiar with distributed computing engines (Spark, Trino, Presto, Flink) & streaming processing (Flink, kafka).

Nice to have

• Deep understanding of data formats, data lake abstractions and optimizations to ensure best performance at query stage (partitioning, bucketing, file sizes and how this relates to concurrency that can be achieved).
• Keen eye on data quality, data lineage and documenting data with a focus on creating a self service environment for data scientists to explore data independently where needed.
• Feature engineering experience from previous data science jobs, help data scientist with optimizing compute and to act as a guide for what is possible when data volumes are high or skew in distribution.

Culture & Benefits

• Nice and friendly working environment.
• Competitive salary with multiple bonus schemes.
• Lots of interesting and challenging projects to work on.
• 13th-month salary benefits.
• Chance to work onsite abroad.
• A fun, Silicon Valley-style startup culture that values openness, fun, and awesomeness.
• Attractive salary and annual salary review.
• Provide devices for work.
• A fun, awesome work environment with multiple exciting bonus schemes.
• Progressive and international working environment.
• Exciting company activities.
• Free in-house entertainment facilities (football), coffee, and snacks (instant noodles, cookies, candies…).