Software Engineer, Search Data Infrastructure (AI)

TL;DR

Software Engineer, Search Data Infrastructure (AI): Designing and developing scalable, resilient offline indexing pipelines for Slack's search infrastructure with an accent on information retrieval, distributed systems, and generative AI integration. Focus on optimizing Solr clusters, ensuring high availability, and evolving cutting-edge search technology.

Location: Hybrid (Seattle, Washington or Atlanta, Georgia, USA)

Salary: $117,200 - $223,900 annually

Company

hirify.global is the #1 AI CRM, where humans with agents drive customer success through AI and innovation.

What you will do

• Design and develop scalable, resilient offline indexing pipelines for Slack's search infrastructure.
• Collaborate with product engineering to conceptualize and build new features for a large user base.
• Ensure high availability and reliability of a distributed search system.
• Deploy, configure, test, troubleshoot, maintain, and upgrade Solr clusters and environments.
• Plan resources and continuously optimize the infrastructure and configuration of Solr clusters.
• Improve engineering standards, tooling, and processes across the team.

Requirements

• 3+ years of experience working with distributed data processing frameworks such as Spark, Hadoop, or EMR.
• Experience with Solr, ElasticSearch, Lucene, or other search technology.
• Proficiency with functional or imperative programming languages like PHP, Python, Ruby, Go, C, or Java.
• Track record of developing high-availability, performant, and scalable distributed systems accessing large volumes of data.
• Ability to contribute to technical architecture discussions and help drive technical decisions.
• Strong communication skills to explain complex technical concepts to various stakeholders.

Nice to have

• Built large-scale data pipelines professionally and can craft clean code in Java, Scala, and/or SQL.
• Exposure to Hadoop/Spark.
• Experience around text mining and parsing.

Culture & Benefits

• Positive, diverse, and supportive culture valuing curiosity, inventiveness, and collaboration.
• Comprehensive benefits including time off programs, medical, dental, vision, and mental health support.
• Paid parental leave, life and disability insurance.
• 401(k) and an employee stock purchasing program.
• Equitable compensation practices and resources to support work-life balance.