Senior Data Engineer (Databricks/AWS)

Location: TBD

Company

hirify.global operates a federal government contracting business serving civilian, defense, and intelligence community customers through the Seneca Nation Group portfolio.

What you will do

• Analyze and collect data from relational databases, APIs, external providers, and real-time streaming sources.
• Design, build, and maintain scalable data pipelines for cleansing, transformation, aggregation, reporting, and analytics.
• Develop Databricks medallion architecture with Bronze, Silver, and Gold data layers.
• Implement real-time and near-real-time ingestion using AWS Database Migration Service and other AWS-native services.
• Develop distributed data-processing logic with Python, R, Spark, PySpark, and Pandas.
• Manage source control, automated testing, deployments, and CI/CD workflows with GitLab while collaborating in an Agile environment.

Requirements

• Hands-on experience building production-grade data pipelines as a Data Engineer or Databricks Developer.
• Strong experience with Databricks on AWS, including E2 architecture, cluster configuration, job orchestration, and workspace management.
• Experience with Apache Spark, PySpark, Pandas, Python, Databricks Auto Loader, Delta Lake, Delta tables, and Amazon RDS.
• Advanced SQL skills, including complex joins, window functions, aggregations, and performance tuning.
• Experience with source-to-target mapping, unit testing, GitLab, CI/CD pipelines, and Agile/Scrum delivery.
• Ability to align data engineering practices with FISMA High and multi-tenant security, governance, and compliance requirements.

Nice to have

• Knowledge of AWS services including S3, Glue, Lambda, Step Functions, CloudWatch, and IAM.
• Experience with FISMA High, FedRAMP, or other regulated compliance environments.
• Experience with data quality frameworks, anomaly detection, and automated data validation.
• Exposure to Terraform or CloudFormation and streaming technologies such as Kafka, Kinesis, or Spark Structured Streaming.
• Working knowledge of R.

Culture & Benefits

• Collaborative work environment with a focus on mission-critical federal customer needs.
• Full-time employees working at least 30 hours per week are eligible for benefits and paid leave.
• Benefits include medical, dental, vision, life, disability, health savings, and flexible spending accounts.
• Retirement 401(k), voluntary benefit programs, professional development, flexible work-life balance, and recognition programs are offered.