Senior AWS Python Developer (PySpark)

Location: Hybrid in Lafayette, Louisiana; Knoxville, Tennessee; Columbia, South Carolina; or Birmingham, Alabama, United States.

Company

hirify.global delivers outsourced services and workforce solutions across North America.

What you will do

• Develop scalable Python applications and data-processing solutions.
• Integrate REST APIs with external services and data sources.
• Write and optimize complex SQL queries and process large datasets using Spark and AWS services.
• Troubleshoot application and data-processing performance and optimize Spark jobs.
• Contribute to CI/CD and infrastructure automation.
• Collaborate with technical and business teams across a matrixed organization.

Requirements

• 8+ years of hands-on Python development, including data-intensive and big data applications.
• Strong Python fundamentals and experience developing scalable, production-grade applications.
• 5+ years of Apache Spark/PySpark experience, including troubleshooting and optimizing Spark jobs.
• 5+ years of hands-on AWS development, including EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.
• Advanced SQL skills, including complex queries, data transformations, joins, and recursive CTEs.
• Experience developing and consuming REST APIs and integrating applications with external services and data sources.
• Strong experience with large datasets, including data manipulation, transformation, analysis, and processing.
• Experience with Hadoop/EMR, Spark, and Hive.
• 4+ years of experience with AI-related technologies or applications.
• Hands-on CI/CD and infrastructure automation experience with GitLab and Terraform.
• Strong debugging, performance-tuning, analytical, and problem-solving skills.
• Ability to collaborate effectively across development teams and a matrixed organization.
• Bachelor's degree in Computer Science, Information Systems, or a related field.

Culture & Benefits

• Hybrid work model.
• Direct-hire employment.
• Eligible employees may receive medical, dental, vision, spending-account, life-insurance, and voluntary-plan coverage.
• Participation in a 401(k) plan is available to eligible employees.