Senior Data Engineer, Exposure (Web3)

TL;DR

Senior Data Engineer, Exposure (Web3): Building cloud-native data ingest and aggregation processes, and optimizing high-performance Spark jobs in Python with an accent on detecting activities for market manipulation, fraud, and behavioral patterning. Focus on architecting and maintaining scalable data lakehouse environments and modernizing the data stack to operate at 10x current capacity.

Location: Aarhus Office

Company

hirify.global provides complete knowledge of what’s happening on blockchains through our data, services, and solutions.

What you will do

• Build cloud-native data ingest and aggregation processes that intake gigabytes of data per day.
• Develop and optimize high-performance Spark jobs in Python to detect activities for market manipulation, fraud, behavioral patterning, and more.
• Build and improve batch-based applications as well as real-time streaming pipelines processing billions of records per day.
• Architect and maintain scalable data lakehouse environments using formats like Parquet, Iceberg, and Delta Lake.
• Collaborate on building scalable API services on AWS that interface with our data layer to handle 1,000s of requests per second.
• Debug production data quality issues and performance bottlenecks across distributed systems and microservices.

Requirements

• Experience in designing and implementing cloud-native, distributed data processing systems in a major cloud provider (AWS preferred).
• Deep expertise in Python and Apache Spark, with a strong understanding of performance tuning and distributed computing principles.
• A technical background with extensive experience working directly on backend systems and large-scale data architecture.
• Pride in materializing complex product ideas into stable, production-grade data pipelines.
• Exposure to or interest in the cryptocurrency technology ecosystem and the unique data challenges it presents

Nice to have

• Mentored other engineers, leading cross-team data initiatives, and driving design and technology decisions is a plus
• Worked with Terraform and Kubernetes (EKS) for orchestrating data workloads is a plus
• A genuine excitement for significantly scaling large data systems and exploring the latest in "Modern Data Stack" technologies

Culture & Benefits

• Diversity of experience and thought makes us stronger.
• Committed to ensuring our team reflects the unique communities around us.
• Ensuring we keep learning by committing to continually revisit and reevaluate our diversity culture.
• We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more.