Python Automation Engineer (Web Scraping, AWS)

TL;DR

Python Automation Engineer (Web Scraping, AWS): Architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals with an accent on web scraping, automated portal interactions, and cloud-native deployment using AWS. Focus on handling multi-factor authentication, CAPTCHAs, and session or token-based login flows, and deploying scalable scraping tasks via AWS Lambda and related services.

Location: Employees in this role will work in the office Monday-Thursday, with the flexibility to work remotely on Friday. Must be based in Salt Lake City, Utah, United States.

Salary: $130,000–$160,000

Company

hirify.global is a company focused on providing financial technology solutions for alternative investments.

What you will do

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
• Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session-based login flows.
• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
• Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
• Integrate and manage complex workflows across multiple portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Requirements

• 10+ years of experience in Python development, with a strong focus on automation and data extraction.
• Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, and BeautifulSoup.
• In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA) and CAPTCHA solving.
• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.
• Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.
• Solid understanding of web protocols (HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms.

Nice to have

• Background in data engineering or ETL workflows.
• Exposure to Python testing frameworks and writing unit or integration tests.

Culture & Benefits

• Comprehensive benefits package, including an employer matched retirement plan.
• Generously subsidized healthcare with 100% employer paid dental, vision, telemedicine, and virtual mental health counseling.
• Parental leave and unlimited paid time off (PTO).
• Hybrid work model with office attendance required Monday-Thursday and remote work flexibility on Friday.
• Commitment to Equal Employment Opportunity and Affirmative Action.