Назад
Company hidden
2 дня назад

Senior Data Engineer (AWS)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (AWS): Building four enterprise content connectors and an ingestion pipeline that delivers permission-tagged, governed knowledge to S3 and Amazon Bedrock Knowledge Bases with an accent on incremental synchronization, metadata lineage, and retirement handling. Focus on designing resilient API integrations, deduplicating and extracting unstructured content, and instrumenting idempotent pipelines with throttling, failure isolation, and CloudWatch monitoring.

Location: USA; remote

Company

hirify.global is an AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. Following its acquisition of Tooploox, hirify.global provides end-to-end delivery from advisory and solution design through custom AI development and enterprise implementation.

What you will do

  • Build an iKNOW connector for Oracle B2C Service, including full inventory extraction, incremental synchronization by modified date, article status, and answer version capture.
  • Build SharePoint, OneDrive, and Teams connectors using Microsoft Graph, including enumeration, delta queries, sharing data, and group membership permissions.
  • Build a Sitecore connector for in-scope public web content.
  • Implement ingestion into S3 and Amazon Bedrock Knowledge Bases with document conversion, text extraction, content-hash deduplication, taxonomy enrichment, source prefixes, and architect-defined chunking.
  • Implement inventory reporting, retirement and deletion propagation, throttling and backoff, idempotent reruns, and source-level failure isolation.
  • Add CloudWatch metrics, write runbooks, and pair with client IT during weeks 7–10 to support pipeline operation and extension after transition.

Requirements

  • 4+ years building production data pipelines, including at least 2 years using AWS and Python.
  • Hands-on experience with Microsoft Graph API for SharePoint and Teams content, including delta queries, permissions, and throttling, or equivalent enterprise content platform experience.
  • Experience landing unstructured HTML, Office documents, PDF files, and chat transcripts in S3 and preparing them for search or vector indexing.
  • Working knowledge of Amazon Bedrock Knowledge Bases data sources and synchronization behavior, or a comparable OpenSearch vector ingestion path.
  • Infrastructure-as-code experience with Terraform or AWS CDK, plus CI for deploying pipelines into a client-owned account.
  • Comfort working from a shared backlog in client repositories and documenting work as it is completed.

Nice to have

  • AWS Certified Data Engineer Associate certification.
  • Integration experience with Oracle B2C Service or another Oracle Service Cloud product.
  • Integration experience with Sitecore XM or XP content APIs.
  • Experience with AWS Glue, Step Functions, or EventBridge, and document parsing libraries for Office and PDF formats.

Culture & Benefits

  • Remote, full-time work on AI-driven projects spanning startup innovation and enterprise transformation.
  • Global collaboration across continents and cultures.
  • Inclusive environment focused on continuous learning, innovation, and ethical AI standards.
  • Equal opportunity employment.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →