Назад
Company hidden
12 дней назад

Principal Data Architect (Data Platform)

220 000 - 250 000$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
c1
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Principal Data Architect (Data Platform): Redesigning and rebuilding a petabyte-scale data platform and pipelines while leading its migration from AWS to Google Cloud with an accent on streaming and batch ingestion, storage rationalization, search, governance, and AI-ready retrieval. Focus on building reliable data services, hybrid keyword/vector/graph retrieval, lineage and provenance, and cost-efficient operation across cloud, FedRAMP, disconnected, and air-gapped environments.

Location: Reston, VA, US; hybrid

Salary: USD 220,000–250,000 per year

Company

Babel Street provides AI and data analytics solutions for identity intelligence, risk operations, government, and commercial organizations.

What you will do

  • Map the existing data estate and publish the target architecture and sequenced migration plan.
  • Design and build standardized streaming and batch ingestion, enrichment, processing, and delivery pipelines handling millions of documents per day.
  • Lead the data platform migration from AWS to GCP, deciding what to migrate, rebuild, or retire.
  • Rationalize BigQuery, Elasticsearch/OpenSearch, object, vector, graph, warehouse, and lakehouse storage for petabyte-scale performance and cost efficiency.
  • Build AI-ready data services with hybrid retrieval, provenance, lineage, and support for RAG and agentic workflows.
  • Establish data contracts, quality checks, observability, SLOs, governance, compliance, retention, and unit-cost attribution while mentoring engineers and handling critical incidents.

Requirements

  • 12+ years building data systems, including at least 5 years as a lead architect or principal engineer on a large-scale data platform.
  • Production coding experience with Python, plus at least one of Java, Scala, or Go, and fluent SQL.
  • Personal leadership of a major data-platform re-architecture or cloud migration, including design, sequencing, failures, and lessons learned.
  • Hands-on experience with distributed processing and streaming technologies such as Spark, Beam/Dataflow, Flink, Kafka, Pub/Sub, or Pulsar.
  • Production experience with GCP data services including BigQuery, Dataflow, Pub/Sub, GCS, and Spanner; AWS experience is also required.
  • Expert operation of Elasticsearch or OpenSearch at scale, including cluster sizing, mappings, aggregation performance, and cost tuning.
  • Experience with Iceberg, Delta, or Hudi lakehouse formats and orchestration tools such as Airflow/Composer, Dagster, or similar.
  • Demonstrated material platform-cost reductions without performance loss, supported by measurable results.
  • Clear written communication and the ability to create design documents for both executives and senior engineers.
  • Ability to obtain a US security clearance.

Nice to have

  • Vector search, embeddings pipelines, and retrieval architectures for LLM and agentic applications.
  • Entity resolution, knowledge graphs, or graph databases across multilingual or messy real-world data.
  • Experience in OSINT, national security, law enforcement, risk intelligence, or financial data.
  • Experience with FedRAMP, IL5, or air-gapped environments and data platforms without managed cloud services.
  • Data observability, lineage, and governance tooling such as OpenLineage, Great Expectations, Monte Carlo, or Dataplex.
  • Experience combining large volumes of scraped multimedia and structured third-party data.

Culture & Benefits

  • Hybrid work in Reston, Virginia.
  • Medical, dental, vision, life, and disability insurance, with 85–100% of monthly premiums covered for employees and families.
  • Traditional and Roth 401(k) plans with a competitive company match.
  • Unlimited flexible leave and 12 paid federal holidays.
  • Tuition reimbursement for continuing education.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →