Python Automation Engineer (AWS)

TL;DR

Python Automation Engineer (AWS): Designing and implementing advanced web scraping solutions using Python, Playwright, and AWS services, with an accent on automating interactions with complex, authentication-secured web applications. Focus on architecting scalable scraping pipelines using serverless AWS components and managing multi-factor authentication flows.

Location: Hybrid (Salt Lake City, Utah, United States). Office attendance required Monday-Thursday.

Salary: $100,000–$130,000

Company

hirify.global is a financial technology company focused on providing alternative investments.

What you will do

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
• Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session-based login flows.
• Architect scalable scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
• Build fault-tolerant systems that scale to support high volumes of data extraction.
• Integrate and manage complex workflows across multiple portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Requirements

• 5+ years of experience in Python development, with a strong focus on automation and data extraction.
• Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests.
• In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA) and CAPTCHA solving.
• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.
• Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.
• Solid understanding of web protocols and ability to reverse-engineer network calls and authentication mechanisms.
• Familiarity with CI/CD pipelines, Docker, and infrastructure as code (e.g., CloudFormation, Terraform).
• Must work in the office Monday-Thursday in Salt Lake City, Utah, United States.

Nice to have

• Background in data engineering or ETL workflows.
• Exposure to Python testing frameworks and writing unit or integration tests.

Culture & Benefits

• Comprehensive benefits package including employer-matched retirement plan.
• Generously subsidized healthcare with 100% employer paid dental, vision, telemedicine, and virtual mental health counseling.
• Parental leave.
• Unlimited paid time off (PTO).
• Flexibility to work remotely on Friday.