Senior Software Engineer (AI)

TL;DR

Senior Software Engineer (AI/Backend): Building scalable data pipelines, APIs, and retrieval frameworks for Edwin AI and AIOps products with an accent on GenAI-powered insights and real-time data infrastructure. Focus on designing streaming and batch pipelines, optimizing retrieval latency, and integrating LLM orchestration.

Location: Must be based in or near San Francisco, CA

Salary: $143,000 — $198,440 USD

Company

AI-first hybrid observability platform providing complete visibility and actionable intelligence across on-premises, cloud, and edge environments.

What you will do

• Design and build streaming and batch data pipelines for AI workflows using Kafka, Airflow, and Redis Streams.
• Develop ETL and feature-extraction pipelines with Python and Java microservices.
• Build data indexing and semantic search for large-scale observability and operational data.
• Create Python APIs (FastAPI/LangGraph) for LLM orchestration, summarization, and correlation reasoning.
• Maintain Java microservices (Spring Boot) that serve AI and analytics data to end applications.
• Implement schema contracts and streaming protocols including REST, gRPC, SSE, and WebSockets.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• 4-5 years of experience in backend or data systems engineering.
• Must be authorized to work in the United States on a full-time, permanent basis without requiring new employer-sponsored authorization.
• Strong programming background in Java and Python, including microservice design.
• Experience building streaming data pipelines using Kafka, Spark, or similar technologies.
• Familiarity with LLM pipelines, embeddings, and vector retrieval.

Nice to have

• Understanding of Kubernetes, containerization, and CI/CD workflows.
• Awareness of data governance, validation, and lineage best practices.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• 401K with company matching and a Lifestyle Spending Account.
• Unlimited vacation policy and generous parental leave.
• Access to Employee Assistance Program and various Wellness programs.
• Culture of performance and recognition, certified as a Great Place To Work®.