Senior Analytics Engineer (AWS/Spark)

Location: Remote; must be based anywhere in Africa with reliable internet access and alignment with core working hours across time zones. Occasional international travel may be required for in-person team meetings, field support, or training.

Company

hirify.global is a California-incorporated nonprofit education technology organization providing scalable, evidence-based tablet learning for literacy and numeracy in partnership with governments, organizations, and communities.

What you will do

• Build and maintain AWS infrastructure, ClickHouse Cloud, Apache Superset, Apache Airflow, access controls, secrets management, monitoring, and infrastructure as code for the analytics platform.
• Develop ingestion pipelines from application databases, APIs, operational systems, and field data tools using AWS Glue, Airbyte, AWS Lambda, and related services.
• Process billions of device events with Spark on AWS Glue, designing efficient incremental loading, partitioning, compaction, and snapshot-management strategies for Apache Iceberg tables.
• Build Airflow workflows and dbt staging and core models in ClickHouse, including incremental models, tests, contracts, lineage, and documented definitions.
• Implement CI/CD, monitoring, alerting, incident response, root-cause analysis, backup and recovery procedures, security practices, and data-quality controls.
• Monitor AWS and ClickHouse costs and performance, propose architectural improvements, and collaborate with the Director of Analytics, BI Analyst, Data Scientist, and distributed operations teams.

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
• At least 7 years of experience in data engineering, software engineering, or platform engineering, including at least 3 years building and running distributed data processing with Spark or an equivalent technology in production.
• Experience taking responsibility for a production data platform or major parts of one, including reliability, performance, and day-to-day operation.
• Experience working with hundreds of millions to billions of records and designing processing that remains efficient as volumes grow.
• Experience managing data workloads within real budget constraints and balancing compute, storage, performance, and cost.
• Experience managing cloud infrastructure for data workloads, not only consuming managed services.
• Experience working in small teams with broad engineering scope and limited supervision, and with remote teams across multiple countries and time zones.
• Strong production-quality Python with testing and modular design; advanced SQL for analytical databases; and Spark/PySpark performance tuning for partitioning, shuffles, and data skew.
• Understanding of data lake design, Parquet or other columnar formats, partitioning strategy, and deciding whether processing should occur in the lake or warehouse.
• Hands-on AWS experience with services and infrastructure such as S3, Glue or EMR, IAM, and EC2; infrastructure as code with Terraform, CloudFormation, CDK, or similar; Linux administration; Docker; dbt in production; workflow orchestration; Git; CI/CD; and code review.

Nice to have

• Experience with Apache Iceberg or another open table format such as Delta Lake or Hudi; ClickHouse or a comparable columnar warehouse; Terraform specifically; Apache Airflow specifically; AWS Glue and Lake Formation; and analytics data modeling for reference data that changes over time.
• Experience with managed Spark platforms such as Databricks; streaming technologies such as Kafka, Flink, Kinesis, or Spark Structured Streaming; event, telemetry, or intermittently synchronized IoT data; Airbyte; Apache Superset administration; or software development beyond data pipelines.
• Experience in the nonprofit, international development, or social sector.

Culture & Benefits

• Full-time remote work from anywhere in Africa with reliable internet access.
• Independent work in a virtual environment with collaboration across Africa, the US, and the UK.
• Occasional international travel for team meetings, field support, or training.
• Competitive salary commensurate with experience.
• Equal-opportunity employment environment.

Hiring process

• Applications are reviewed on a rolling basis.