Principal Data Engineer - AI

Location: Remote within the United States, limited to the Eastern or Central time zones. Employees within commuting distance of an office must work onsite two days per week under the hybrid model.

Company

Business planning and analysis platform provider focused on AI-infused scenario planning for enterprise customers.

What you will do

• Lead the architecture, design, deployment, and operation of scalable, high-throughput Big Data systems.
• Build real-time and batch ETL/ELT pipelines, API services, ingestion frameworks, data lakes, warehouses, and streaming architectures.
• Develop foundational AI infrastructure using vector, NoSQL, and document databases.
• Engineer context and feature pipelines for large-scale enterprise data across batch and streaming workloads.
• Optimize distributed queries and transformations for high performance and low latency.
• Implement data quality, integrity, reliability, and governance frameworks while collaborating with analytics, product, and platform teams.

Requirements

• Extensive hands-on experience delivering complex data engineering platforms in production.
• Deep knowledge of distributed processing frameworks such as Apache Spark, Flink, or Hadoop.
• Strong expertise with message brokers and event-streaming platforms such as Apache Kafka or Kinesis.
• Experience with workflow orchestration, cloud data warehouses, and data lake architectures.
• Advanced SQL skills and proficiency in Python.
• Strong software engineering practices, including testing, code review, CI/CD, and Infrastructure as Code.

Nice to have

• Experience leading technical projects and mentoring engineering teams.
• Experience with AWS, GCP, or Azure cloud-native infrastructure.
• Experience implementing data observability, monitoring, and alerting frameworks at scale.
• Familiarity with enterprise planning platforms.

Culture & Benefits

• Inclusive working environment centered on diversity, equity, inclusion, and belonging.
• Hybrid work model for employees within commuting distance of an office.
• Reasonable accommodations are provided for candidates and employees with disabilities.

Hiring process

• Extensive interview process with the recruitment team and hiring manager, conducted by video or in person.