19 часов назад
Senior Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Python/AWS): Building and managing PostgreSQL database solutions and ETL pipelines for structured and unstructured data with an accent on database architecture, performance optimization, and batch and event-driven processing. Focus on designing scalable data platforms, automating deployments with CI/CD, and preparing data for AI and machine learning initiatives.
Location: Gurgaon, India; hybrid work environment
Company
provides business and technology research, analysis, and insights to enterprise leaders worldwide.
What you will do
- Architect, develop, and maintain PostgreSQL database structures, including tables, views, procedures, functions, and packages.
- Optimize database performance, debug complex SQL queries, and ensure reliability and scalability.
- Design and manage ETL pipelines with Python, AWS Glue, AWS Batch, and AWS S3.
- Build batch and event-driven data processing architectures for large structured and unstructured datasets.
- Implement CI/CD pipelines, automate deployments with Jenkins, and manage repositories with Git.
- Prepare, process, and manage data for AI and machine learning model training and inference.
Requirements
- 4+ years of hands-on data engineering experience, with strong PostgreSQL and preferably AWS RDS expertise.
- Advanced SQL skills and experience designing, optimizing, and maintaining complex database solutions and objects.
- Strong Python skills and experience with ETL pipelines, AWS Glue or AWS Batch, and AWS S3.
- Experience with batch and event-driven processing, data migration, and large datasets.
- Familiarity with Jenkins, Git, CI/CD, and Agile-Scrum environments.
- Bachelor’s degree or foreign equivalent in Computer Science or a related field; strong communication, prioritization, and problem-solving skills.
Nice to have
- Experience with AI and machine learning libraries and frameworks.
Culture & Benefits
- Hybrid flexibility, with virtual work when productive and in-person collaboration when useful.
- Opportunities for professional growth and skill development.
- Inclusive teams spanning diverse geographies, cultures, and backgrounds.
- Competitive compensation and benefits.
- Equal employment opportunities and reasonable accommodations for qualified applicants.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →