3 дня назад
Senior Software Engineer, Data Platform, AI Labs
180 000 - 240 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Software Engineer, Data Platform, AI Labs (Python/Data Infrastructure): Building scalable data infrastructure for an AI platform, including high-volume document ingestion, distributed processing, storage, and indexing, with an accent on reliability, multi-tenant architecture, and data consistency. Focus on designing fault-tolerant asynchronous pipelines, operating multi-million-file workloads, modernizing production systems without downtime, and establishing observability for AI data workflows.
Location: New York, NY; in-office 3–4 days per week. Must be authorized to work in the United States for any employer.
Salary: $180,000–$240,000 USD annually, with potential eligibility for an annual bonus.
Company
AI Labs is an innovation and engineering hub building AI platforms for corporate legal departments and global law firms.
What you will do
- Design scalable data pipelines for multi-million-file workloads, including parsing, ingestion, storage, partitioning, and indexing.
- Build fault-tolerant, queue-based asynchronous processing frameworks with retries, idempotency, dead-letter handling, and elastic capacity.
- Design storage and indexing architecture across relational, object, search, and vector stores.
- Build multi-tenant data architectures with tenant isolation, resource controls, and workload management for AI systems.
- Establish observability and service-level objectives for throughput, latency, queue depth, errors, and data quality.
- Lead modernization and migration efforts while preserving production availability and data integrity, and contribute to architecture reviews and engineering standards.
Requirements
- 5+ years of experience designing, building, and operating data-intensive or distributed backend systems in production.
- Experience with large-scale data-processing pipelines, message brokers, queue-based architectures, scaling, delivery guarantees, ordering, and failure handling.
- Strong relational database skills, including query optimization, indexing, partitioning, and zero-downtime schema migration.
- Experience with workflow orchestration frameworks such as Temporal, Airflow, or Dagster, and with search or vector indexes.
- Proficiency in Python or a comparable language, with the ability to work primarily in Python.
- Experience with observability tools, Azure or AWS, Kubernetes, Docker, system design, technical documentation, and AI tools in software development.
Nice to have
- Experience with document processing, OCR, text extraction, format conversion, and archive or email extraction.
- Experience modernizing production systems, using Terraform, or operating multi-region deployments with data-residency requirements.
- Experience with AI/ML data infrastructure and retrieval technologies such as Solr or Qdrant.
- Experience in legal technology or another regulated industry.
Culture & Benefits
- Collaborative, deeply technical environment with rapid iteration, thoughtful design, and end-to-end ownership.
- Enterprise-wide learning and internal mobility opportunities.
- Flexibility and respect for work-life balance.
- Cross-functional collaboration with engineering, product, and security teams.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
Senior Backend Engineer (AI)
210 000 - 265 000$
4 дня назад
Senior Backend Engineer (Cybersecurity)
202 190 - 273 551$
14 часов назад
Software Engineer - Cloud Solutions & AI
96 000 - 163 000$
3 дня назад
Staff Engineer (Data Platform)
115 000 - 230 000$
5 дней назад
Senior Software Application Development Engineer (AI)
117 620 - 227 270$
8 часов назад
Senior Software Development Engineer - Developer Platform
168 500 - 252 700$