TL;DR
Staff Data Engineer (AI): Designing and developing scalable data pipelines for AI and digital platforms with an accent on GenAI/LLM-powered application development and operationalizing ML models. Focus on building secure, high-performance data infrastructure and integrating advanced AI capabilities into products.
Location: Global remote, supporting a distributed team across 36 countries.
Company
hirify.global is a Digital Product Engineering company that builds products, services, and experiences at scale for its global clients.
What you will do
- Design and develop scalable data pipelines across Hadoop and Teradata environments.
- Build ingestion and transformation frameworks using Java, Spark, Python, and Shell scripts.
- Develop full stack applications and internal tools with Python, Flask, and React.
- Create APIs and microservices to expose data and ML models securely.
- Collaborate with data scientists to operationalize ML models using Cloudera Machine Learning.
- Build and deploy GenAI/LLM-powered applications for intelligent data interaction, summarization, and automation.
- Implement enterprise-grade security controls including RBAC, LDAP, Kerberos, and Apache Ranger.
- Tune and optimize data applications for performance across Hadoop and Teradata.
Requirements
- Strong experience with Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas) and Teradata.
- Proficiency in Python, Shell scripting, REST APIs, and web frameworks (Flask, React).
- Hands-on experience with ML platforms (CML), Spark MLlib, and Python ML libraries (scikit-learn, XGBoost).
- Familiarity with building applications using large language models (OpenAI, Hugging Face, LangChain) and agent workflows.
- Experience with enterprise data security (LDAP, Kerberos, RBAC) and performance tuning in Hadoop/Teradata environments.
- Ability to work effectively in cross-functional teams.
- English: B2 required.
Culture & Benefits
- Dynamic and non-hierarchical work culture.
- Opportunity to work with a global team of 17500+ experts across 36 countries.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →