Senior Data Engineer (Cybersecurity)

TL;DR

Senior Data Engineer (AWS/Spark): Building and optimizing core data infrastructure for a SaaS platform with an accent on scalable ETL pipelines and petabyte-sized data lakes. Focus on managing cloud compute services, data modeling, and optimizing Spark performance for high-efficiency analytics.

Location: Fixed location based in Johns Creek, GA; telecommuting from a home office may be allowed.

Company

hirify.global is a cybersecurity company providing a SaaS platform for privileged access management and data analytics.

What you will do

• Manage core data infrastructure powering all analytics products on the SaaS platform.
• Leverage AWS services including Lambda, DynamoDB, and Neptune to ensure fast computation of results.
• Create highly scalable and efficient ETL pipelines to populate an advanced data lake.
• Perform data modeling and database structuring to optimize system performance.
• Monitor infrastructure using Datadog and AWS Cloudwatch to ensure reliability.
• Apply data governance methods to ensure consistent and accurate data outcomes.

Requirements

• Master’s degree in Information Systems or a directly related field.
• 4+ years of experience in a Data Engineering role.
• Proven experience with Petabyte-sized Data Lakes and building end-to-end data applications on AWS.
• Deep expertise in Spark (RDDs, DataFrames) and optimization tools like Ganglia, Log4J, and Spark UI.
• Strong proficiency in SQL development, Python, and data modeling.
• Must be based in or be able to work from the Johns Creek, GA office.

Nice to have

• Experience with Snowflake and AWS Athena serverless data warehousing.
• Knowledge of the Hadoop ecosystem, including Hive, Presto, and YARN resource management.