12 дней назад
Big Data Development Engineer Intern (AI and Data Governance)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Big Data Development Engineer Intern (AI and Data Governance): Building AI-assisted data governance capabilities for model review, semantic metric automation, and data quality monitoring with an accent on SQL, Python, data lineage, and LLM application development. Focus on delivering an end-to-end MVP, detecting governance issues across data assets, and measuring the precision, coverage, and operational impact of automated solutions.
Location: Hong Kong SAR; 5 days per week on-site. Minimum internship commitment: 3 months.
Company
is a cryptocurrency exchange and digital financial platform building products across trading, payments, wealth management, custody, institutional services, and Web3.
What you will do
- Research AI and data governance approaches covering metadata and lineage platforms, semantic layers, data quality frameworks, and natural-language data queries.
- Build AI-assisted data model review capabilities, including naming and layering validation, duplicate detection, lineage analysis, and refactoring recommendations.
- Automate metric definition extraction and standardization from SQL, lineage, and documentation while maintaining a machine-readable semantic layer.
- Develop data quality automation for anomaly detection, schema drift, lineage-based root cause analysis, alert grading, and remediation recommendations.
- Deliver at least one end-to-end MVP on a real data domain, measure results, iterate, and document the reusable framework.
- Present solution designs, evaluation methods, and findings to platform and data stakeholders.
Requirements
- Undergraduate or graduate student in Computer Science, Data Science, Statistics, or a related field.
- Solid SQL and Python skills, with an understanding of dimensional modeling, layered data warehouse architecture, metadata, and lineage.
- Hands-on experience developing LLM applications using prompt engineering, RAG, agent or tool-calling frameworks, and effectiveness evaluation.
- Ability to define governance problems clearly, establish measurable success criteria, and assess MVP results honestly.
- Fluent Mandarin is required; technical English reading and clear written communication are required. Fluent English is a plus.
- Ability to work on-site 5 days per week for at least 3 months.
Nice to have
- Experience with Spark, Flink, Hive, or StarRocks.
- Experience with DataHub, OpenMetadata, Atlas, dbt, Great Expectations, Deequ, or metric and semantic layer tooling.
- Self-driven approach and comfort working with ambiguity in exploratory projects.
Culture & Benefits
- Study Growth Fund supporting professional development and continuous learning.
- Internal team-building events, workshops, and collaboration activities.
- Opportunity to work with an international team and collaborate globally.
- Career advancement and internal mobility opportunities within a growing digital finance company.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →