Data Engineer (Palantir Foundry)

TL;DR

Data Engineer (Palantir Foundry): Building and optimizing scalable data pipelines and platforms for mission-critical projects with an accent on ETL/ELT workflows and disparate data organization. Focus on implementing Palantir Foundry solutions, diagnosing complex data errors, and developing high-performance Spark applications.

Location: Remote (US). Secret clearance is required.

Salary: $77,600–$176,000 per year

Company

A leading technology and consulting firm providing mission-driven solutions for national intelligence, fraud detection, and scientific research.

What you will do

• Design and maintain complex data applications and scalable platforms at an enterprise scale.
• Develop ETL/ELT workflows to process structured and unstructured data from disparate sources.
• Build and modify data transformations using Palantir Foundry Data Pipeline Builder and Code Repositories.
• Manage the assessment and maintenance of data platforms to ensure system reliability.
• Collaborate with cross-functional teams of analysts and developers in an agile environment.

Requirements

• Secret clearance is required.
• 5+ years of experience in application development and complex data applications.
• 3+ years of experience in building scalable ETL/ELT workflows.
• Proficiency with PySpark and Spark SQL.
• Experience with Palantir Foundry (Ontology, Workshop, and debugging).
• Bachelor's degree.

Nice to have

• Experience with Python, SQL, Scala, or Java.
• Knowledge of UNIX/Linux and Shell scripting.
• Cloud experience (AWS, Azure, or GCP).
• Experience with distributed tools like Databricks, Hadoop, Hive, or Kafka.
• Familiarity with NoSQL (MongoDB, Cassandra) or data warehousing (Snowflake, Redshift).

Culture & Benefits

• Comprehensive health, life, disability, and retirement benefits.
• Paid leave and professional development opportunities.
• Tuition assistance and work-life programs.
• Recognition awards program for exceptional performance.
• Flexible work model with remote possibilities.