Senior Data Platform Engineer (AI)

TL;DR

Senior Data Platform Engineer (AI): Designing and operating high-scale distributed storage systems and data platforms for autonomous trucking technology with an accent on OLAP/OLTP workloads and feature engineering. Focus on building reliable, fault-tolerant data pipelines and optimizing resource utilization for large-scale AI development.

Location: Must be based in the U.S. (Pittsburgh, PA or Remote)

Company

hirify.global develops advanced autonomous systems and AI-driven solutions for the trucking transportation industry.

What you will do

• Design and operate distributed storage systems for large-scale batch workloads.
• Build and maintain a modern, open-source data platform.
• Improve reliability and fault tolerance of storage systems and platform components.
• Optimize storage resource utilization across the infrastructure.
• Collaborate with product development teams to define and meet workload requirements.
• Contribute to platform tooling, automation, and CI/CD workflows.

Requirements

• 7+ years of experience building and operating distributed storage systems or modern data platforms.
• Experience operating streaming platforms such as Kafka or Pulsar.
• Fluent in Python and SQL with experience using Trino and Apache Spark.
• Knowledge of table formats like Iceberg, Delta Lake, or Hudi.
• Experience optimizing RDBMS such as Postgres or MySQL.
• Must be a U.S. person or citizen due to national security and export control regulations.

Culture & Benefits

• Commitment to an inclusive, innovative, and entrepreneurial workplace.
• Opportunity to work on cutting-edge autonomous systems and robotics.
• Focus on high-impact engineering challenges in a dynamic industry.
• Equal opportunity employer dedicated to diverse team outcomes.