Python/Cloud Fullstack Engineer

TL;DR

Python/Cloud Fullstack Engineer: Building cloud-native, large-scale data pipelines and Django-based services with an accent on Apache Spark optimization, Kubernetes deployments, and distributed systems. Focus on connecting Spark to Kafka, managing cloud resources, and ensuring end-to-end data platform engineering.

Location: Hybrid, 3 days/week in office in Charlotte, NC, USA. W2 only. Visa sponsorship available.

Company

hirify.global is a staffing company specializing in contract placements.

What you will do

• Build cloud-native, large-scale data pipelines.
• Develop Django-based services and APIs.
• Deploy Spark workloads using Docker and Kubernetes/OpenShift.
• Optimize Spark jobs and manage compute/storage resources.
• Connect Spark to Kafka for data integration.
• Practice end-to-end data platform engineering.

Requirements

• Strong Python developer with 3+ years hands-on Apache Spark / PySpark experience.
• Experience deploying Spark workloads using Docker and Kubernetes/OpenShift.
• 1+ year building Airflow DAGs and Django-based services/APIs.
• Proven ability to optimize Spark jobs and manage compute/storage resources in cloud environments.
• At least 1+ year on GCP (AWS/Azure acceptable) with distributed systems exposure.
• Understanding of end-to-end data platform engineering.

Nice to have

• Shell scripting skills.