Data Engineer

TL;DR

Data Engineer (Airflow/Spark): Design and implement scalable data pipelines, ingestion, transformation, and storage workflows for Navy and DoD programs with an accent on data quality, ETL processes, and integration with software development. Focus on orchestrating complex data engineering solutions, ensuring accuracy in secure environments, and collaborating on high-stakes mission systems.

Location: Hybrid preferred in St. Paul, MN (United States); fully remote considered with increased travel expectations (up to 5%, 1–2 times per month).

Salary: 101,998 - 130,630 USD per year

Company

Mission-driven technology company specializing in national security, advanced sensors, autonomous systems, AI-enabled training, simulation, and logistics tools for DoD and allies.

What you will do

• Collaborate with developers, data scientists, and product managers to gather requirements and design data solutions.
• Build scalable data pipeline architecture, including ingestion, transformation, storage, and quality checks.
• Conduct testing (unit, integration, system) and debug issues to ensure data accuracy and software functionality.
• Document processes, pipelines, and data flows for consistency and support.
• Manage projects, coordinate cross-functional teams, and communicate technical details effectively.
• Integrate orchestration (Airflow) and processing (Spark) tools into workflows.

Requirements

• Bachelor’s in Computer Science, Engineering, or related; advanced degree or equivalent experience accepted.
• Proficient in Apache Airflow and Apache Spark (2-5 years experience).
• Advanced knowledge of object storage, unstructured data, containerization (Kubernetes, Docker, Helm), ETL, data warehousing.
• Experience with cross-domain solutions in secure environments and Agile methodologies.
• Conversant in object-oriented programming; excellent communication skills.
• Must be US Citizen and hold or be eligible for active U.S. national security clearance.

Nice to have

• CompTIA Security+ Certification.
• Experience with Typescript/Express, FastAPI, PostgreSQL, modern JS frameworks (Angular, React).
• In-depth knowledge of aerospace/defense industry and DoD software policies.

Culture & Benefits

• Hybrid work preferred with telework options on designated days.
• Paid Time Off, company holidays, medical/dental/vision insurance, HSA/FSA.
• Life/disability insurance, 401k matching, Employee Assistance Program.
• Support for mission-critical work contributing to national security.