Senior Software Engineer (AI)

TL;DR

Senior Software Engineer (AI): Building new native and highly scalable connectors for databases and enterprise applications to ingest structured, semi-structured, and unstructured data with an accent on reliability, precision, and scalability. Focus on incremental ingestion and end-to-end monitoring of long-running ingestion workflows.

Company

Databricks is the data and AI company that unifies and democratizes data, analytics, and AI for over 10,000 organizations worldwide.

What you will do

• Build reliable connectors with zero data and precision loss.
• Scale the connectors to support ingesting millions of rows per day.
• Build incremental ingestion and reduce the end-to-end latency from the time data shows up in data sources to it being available in Delta Lake.
• Enable end-to-end monitoring and observability into long-running ingestion workflows.

Requirements

• BS (or higher) in Computer Science, or related field.
• 6+ years of industry experience in writing production code in Java, Scala, or C++.
• Experience working with data ingestion and processing systems.
• Experience with SQL and/or other database technologies, CDC, and data connectors.

Culture & Benefits

• Comprehensive benefits and perks to meet the needs of all employees.
• Committed to fostering a diverse and inclusive culture where everyone can excel.
• Hiring practices are inclusive and meet equal employment opportunity standards.