10 часов назад
Principal Data Engineer (AWS)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Data Engineer (AWS): Designing and leading scalable data ingestion and transformation pipelines that power data platforms, products, and automation initiatives with an accent on Python, SQL, AWS data workflows, and infrastructure as code. Focus on architecting orchestration with MWAA/Airflow, Lambda, ECS, and SQS, ensuring data quality and lineage, and mentoring senior engineers on complex infrastructure projects.
Location: Remote - US
Company
provides credit intelligence, data, and analytics for professionals in hedge funds, investment banking, management consulting, and law firms.
What you will do
- Lead the technical strategy for the data platform and align infrastructure development with business and product goals.
- Design, develop, and maintain scalable data ingestion and transformation pipelines across APIs, web data, internal feeds, and other sources.
- Architect and manage AWS-based data pipelines and orchestration workflows using MWAA/Airflow, Lambda, ECS, and SQS.
- Implement infrastructure as code with Terraform and maintain reproducible, compliant cloud infrastructure.
- Establish data modeling, schema design, ETL/ELT, data quality, lineage, monitoring, and alerting practices.
- Mentor senior engineers, provide architecture guidance, lead code reviews, and collaborate with analysts, data scientists, backend engineers, and technology leadership.
Requirements
- Expert Python development skills for data pipelines and automation.
- Advanced SQL skills, including complex query and data model optimization.
- Experience building cloud-native data pipelines on AWS, including services such as MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, and Redshift.
- Experience with data warehousing or lakehouse technologies such as Redshift, Snowflake, or Databricks.
- Experience managing Terraform or similar infrastructure-as-code frameworks, plus CI/CD, automated testing, DevOps, Docker, and workflow orchestration.
- 8+ years of data engineering or backend development experience, including technical leadership, mentoring, and end-to-end ownership of complex data infrastructure projects.
Nice to have
- Experience with streaming technologies such as Kafka, Kinesis, or Flink.
- Experience with data quality and observability tools such as Great Expectations or Monte Carlo.
- Familiarity with Scrapy, BeautifulSoup, or similar data extraction frameworks.
Culture & Benefits
- Values include action orientation, customer focus, effective teamwork, and continuous improvement.
- Health benefits, matched 401(k), pension plans, paid time off, and generous parental leave.
- Gym subsidies, educational reimbursement for career development, and recognition programs.
- Inclusive work environment with equal employment opportunities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →