Senior Software Engineer III (Scala/Big Data)

TL;DR

Senior Software Engineer III (Scala/Big Data): Building and optimizing high-performance data pipelines and microservices for an educational technology platform with an accent on Big Data processing, system architecture, and scalability. Focus on designing ETL pipelines, leveraging Spark and Kafka for real-time data streams, and mentoring engineering teams.

Location: Remote (US)

Salary: $93,250 - $166,250

Company

Educational technology organization providing award-winning learning programs like i-Ready to K-8 students.

What you will do

• Lead technical initiatives to develop innovative software solutions for complex challenges.
• Build scalable, high-performance pipelines and workflows for batch and real-time data processing.
• Design and develop data frameworks and microservices that integrate seamlessly with other services.
• Utilize Kafka, AWS S3 Data Lake, EMR, and Spark to ingest, transform, and query data.
• Mentor junior team members through detailed code reviews and promote continuous learning.
• Implement security protocols and data governance standards across all development projects.

Requirements

• 12+ years of experience designing and developing enterprise-level software solutions.
• 10+ years of experience with large volume data processing and Big Data tools (Apache Spark, Scala, Hadoop).
• 5+ years of experience developing Scala/Java applications and microservices using Spring Boot.
• 5+ years of experience working with SQL and relational databases.
• Must be based in the United States.
• 2+ years of experience working within Agile/Scrum environments.

Nice to have

• Extended experience with Amazon cloud computing infrastructure.
• Background in the educational technology domain.

Culture & Benefits

• Comprehensive medical, dental, vision, and basic life insurance for employees and families.
• 401k plan with company employer match.
• Flexible vacation and sick policy.
• Twelve paid holidays and a winter office closure between Christmas and New Year's.
• Minimal travel requirement (<10%) between sites or for training.