AWS Databricks Engineer

Location: McLean, Virginia, United States; onsite

Salary: $155,000–$185,000 annually

Company

hirify.global delivers AI, cloud, cybersecurity, and modernization solutions for federal agencies, with more than 1,700 employees, 1,500 AI and data experts, and over 100 prime contracts.

What you will do

• Design, build, and optimize production data pipelines and processing workflows with Databricks, Apache Spark, PySpark, and Delta Lake.
• Design and implement AWS lakehouse solutions using medallion architecture and Bronze, Silver, and Gold data layers.
• Build ETL/ELT integrations across S3, Glue, RDS, Redshift, Lambda, and related AWS data platforms.
• Develop transformations with SQL, Python, and PySpark while optimizing workloads, queries, clusters, storage, reliability, and cost.
• Implement data quality, cataloging, lineage, governance, access control, CI/CD, IaC, and cloud deployment automation.
• Collaborate with engineering, data science, cloud, and mission stakeholders; support testing, troubleshooting, code reviews, security standards, and technical documentation.

Requirements

• U.S. citizenship and the ability to obtain and maintain a Secret clearance are required.
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related technical field.
• Hands-on experience in data engineering, cloud engineering, or related technical roles, including production solutions with Databricks, Apache Spark, and PySpark.
• Strong experience with AWS data services including S3, Glue, RDS, Redshift, Lambda, IAM, and CloudWatch.
• Strong understanding of ETL/ELT, data lake and lakehouse architectures, data modeling, and large-scale data processing.
• Hands-on experience with Delta Lake, SQL, Python, and Spark-based processing.
• Experience developing, scheduling, monitoring, and troubleshooting production data pipelines and workflows.
• Experience with Git and CI/CD platforms such as GitLab, GitHub Actions, Jenkins, or AWS CodePipeline.
• Understanding of cloud security, identity and access management, encryption, secure data handling, strong communication, and client-oriented collaboration.

Nice to have

• Experience with Databricks Lakehouse and medallion architecture, Unity Catalog, Delta Live Tables, Databricks Workflows, or similar orchestration and governance tools.
• Strong Python proficiency with PySpark, Pandas, and Pydantic.
• Experience with Terraform, OpenTofu, AWS CDK, or CloudFormation.
• AWS or Databricks certifications, including AWS Certified Data Engineer, AWS Certified Solutions Architect, or Databricks Certified Data Engineer.
• Knowledge of federal cybersecurity, RMF, FedRAMP, or other government compliance frameworks.
• Experience delivering cloud-native data solutions in federal government or highly regulated environments.

Culture & Benefits

• Medical, dental, and vision healthcare plans.
• 401(k) and IRA retirement plans.
• Life insurance, disability coverage, paid vacation, sick leave, and public holidays.
• Family leave, training and development, and wellness resources.