aipythonsqlgoscalaairflowsparkazure data factorydata pipelinesdask
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
78
Хорошая вакансия
развернуть
Понятная роль в инженерии данных в крупной технологической компании с практической работой над AI-продуктами и современным стеком; требование про агентов и онтологии сформулировано расплывчато и оставляет вопросы о масштабе задач.
Кликните для подробной информации
Неясное требованиеСовременный стекРазработка для AIКрупная компания
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Data & AI Engineer (Python/Scala/Spark): Designing and building scalable data platforms and productized pipelines for AI products with an accent on distributed processing, real-time data delivery, and data quality. Focus on automating workflows, profiling performance, validating data, and optimizing cloud workloads and costs.
Location: Hybrid in Mississauga, Canada — 3 days in the office and 2 days remote.
Pay range: $67,120–$100,680 annual, plus a target performance-based annual cash incentive equal to 5% of base pay.
Company
hirify.global develops smart solutions that anticipate customer and partner needs and address operational challenges.
What you will do
Design and implement data platforms supporting AI products.
Develop productized, parameterized, high-volume, and real-time data pipelines using GPUs and CPUs.
Develop data transformation code with Spark in Python and Scala, as well as Dask.
Build automated data pipeline workflows with Python and Argo.
Develop data validation tests, conduct performance testing and code profiling, and assess input data quality.
Operationalize scalable pipelines for data science and advanced analytics while optimizing cloud workloads and service costs.
Requirements
Bachelor’s degree or above in Computer Science or Engineering.
At least 1 year of programming experience with Python, Scala, or Go.
At least 1 year of experience with SQL and data transformation.
At least 1 year of experience developing distributed systems with open-source technologies such as Spark.
At least 1 year of experience building agents, with a complete understanding of ontology and data security.
At least 1 year of experience with relational or NoSQL databases running in Linux environments, including MySQL, MariaDB, PostgreSQL, MongoDB, or Redis.
Strong understanding of databases, SQL, cloud technologies, and modern data integration and orchestration tools such as Azure Data Factory, Informatica, and Airflow.
Strong verbal and written communication skills, including effective communication with clients and internal teams.
Nice to have
Experience working with Azure or GCP environments.
Experience with data models in the retail and consumer products industry.
Experience working on agile projects and understanding of agile concepts.
Ability to learn new technologies quickly and independently.
Ability to work toward stretch goals in an innovative, fast-paced environment.
Ability to collaborate in a diverse team environment.
Culture & Benefits
Collaborative environment focused on innovation, curiosity, caring, and inclusion.
Healthcare, wellness offerings, inclusion networks, and continued learning and development.
Community service days, traditional insurance, parental leave, employee assistance, and paid time off offerings depending on the country of employment.
Employment includes a target annual performance-based cash incentive equal to 5% of base pay.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →