Middle Big Data Software Engineer (AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Middle Big Data Software Engineer (AWS): Building and maintaining scalable data pipelines for end-to-end data & analytics solutions with an accent on large-scale processing, orchestration, and cloud-native AWS services. Focus on designing data ingestion pipelines, optimizing performance with Spark and Airflow, and ensuring production-ready reliability through IaC and modern dev practices.
Location: Ukraine (Remote/Office)
Company
Global digital solutions company headquartered in Austin, Texas, with Big Data & Analytics Center of Excellence building solutions for healthcare, finance, manufacturing, retail, and energy domains.
What you will do
- Build and maintain scalable data pipelines using Python, PySpark, Spark, and Airflow.
- Work hands-on with AWS services including Glue, S3, Aurora PostgreSQL, Athena, Lambda, and EKS.
- Implement infrastructure as code with Terraform and containerization with Docker.
- Address business and technology challenges in impactful projects across the full lifecycle from PoCs to full-scale implementation.
- Investigate new technologies, build prototypes, and share knowledge within the data community.
- Collaborate with top engineers, architects, and world-leading companies.
Requirements
- 3+ years in Data Engineering building scalable data pipelines
- Proficient in Python and PySpark for large-scale data processing
- Skilled in Apache Spark and Apache Airflow
- Hands-on with AWS: Glue, S3, Aurora PostgreSQL, Athena, Lambda, SQS, SNS, EventBridge, EKS, Glue Data Catalog
- Experience with Terraform, Docker, pytest, mypy, ruff, CI/CD (GitHub Actions), Pydantic
- English at upper-intermediate level
Nice to have
- Familiar with AI-assisted development tools
Culture & Benefits
- Team of data-focused engineers with continuous learning and daily knowledge-sharing
- Access to cutting-edge tech stack and early-access cloud services
- Dedicated career plan, Udemy courses, company-covered certifications
- Work with diverse customers from global corporations to crypto startups
- Adopt best practices from experts in a collaborative environment
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →