7 дней назад
Lead Data Engineer (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (AI): Architecting a cloud data platform for high-volume trading and product data with an accent on AWS streaming, real-time replication, warehouse modeling, and AI-assisted engineering. Focus on building terabyte-scale CDC and ETL/ELT pipelines, connecting data systems to AI assistants through MCP, and leading operational reliability, data quality, and incident response.
Location: Hybrid in Kuala Lumpur, Malaysia
Company
operates a performance-based capital platform through its FundedNext brand, serving traders and users across global markets.
What you will do
- Architect and scale the end-to-end AWS cloud data platform, including ingestion, transformation, warehousing, monitoring, and data quality layers.
- Build real-time CDC and data replication pipelines across MySQL, PostgreSQL, and Amazon Redshift at terabyte and multi-terabyte scale.
- Design dimensional warehouse models and optimize OLAP workloads for performance, scalability, reliability, and cost efficiency.
- Develop AI-assisted engineering workflows, MCP servers, natural-language analytics, automated insights, and LLM-driven reporting.
- Establish orchestration, CI/CD, monitoring, alerting, incident response, data governance, lineage, and operational documentation.
- Lead, mentor, and set technical standards for the data engineering team while partnering with BI, analytics, product, finance, and business stakeholders.
Requirements
- 8+ years of experience in data engineering, data pipelines, ETL/ELT, and data warehousing at scale.
- Hands-on experience with CDC, real-time replication, production data platforms, and heterogeneous systems.
- Strong Python programming skills and deep experience with AWS, Snowflake and/or Google Cloud, PostgreSQL, MySQL, and Amazon Redshift.
- Proven experience with warehouse schema design, analytical modeling, and multi-terabyte data environments.
- Practical experience with Claude, Claude Code, or equivalent AI coding assistants, LLM APIs, and prompt engineering.
- Team management experience and willingness to participate in 24/7 alert monitoring and on-call coverage.
Nice to have
- Experience with MCP servers, AI-powered BI features, Kafka, Kinesis, Flink, GitHub Actions, Terraform, or data engineering certifications.
- Background in fintech, trading, or brokerage.
- Experience with R.
Culture & Benefits
- Hybrid work environment in Kuala Lumpur.
- Opportunity to build a data platform from scratch across multiple products.
- Daily use of AI-assisted engineering tools to accelerate development, debugging, documentation, and analysis.
- Ownership of end-to-end outcomes, including production reliability, data quality, and business impact.
Hiring process
- 30-minute HR interview with Talent Acquisition.
- 45-minute problem-solving interview with Talent Acquisition and the department front-line manager.
- 60-minute Bar Raiser interview with the department head and Talent Acquisition lead.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →