Spark Data Engineer

Location: Tysons, Virginia, United States

Salary: $150,000–$250,000 USD per year

Company

hirify.global delivers technical and mission expertise for national security, defense, and advanced technology challenges.

What you will do

• Build and manage data pipelines for a national security customer project.
• Process and analyze data with Apache Spark across CSV, XML, JSON, Avro, and Parquet formats.
• Develop Python-based data engineering solutions using AWS services.
• Work with relational databases and write SQL queries.
• Write and validate unit tests for data processing code.
• Support pipeline orchestration, Spark cluster administration, and performance tuning when needed.

Requirements

• Active TS/SCI clearance with polygraph is required.
• Demonstrated experience building and managing data pipelines.
• Experience with Python, AWS, Apache Spark, relational databases, SQL, Linux, and shell scripting.
• Experience analyzing data in multiple file formats, including CSV, XML, JSON, Avro, and Parquet.
• Experience writing and validating unit tests.

Nice to have

• Experience with NiFi, Apache Airflow, or another data pipeline orchestration tool.
• Experience with Java or Scala.
• Experience administering EMR or Spark clusters and tuning Spark job performance.
• Experience developing cloud-based security solutions.
• Experience with configuration management and software release processes.

Culture & Benefits

• Healthcare coverage including medical, dental, and vision plans.
• Health Savings Account with company contribution.
• Paid time off, paid holidays, and paid parental leave.
• 401(k) plan with company match.
• Training and development opportunities.
• Award programs and company-sponsored events.