Data Engineer II (Web3)

TL;DR

Data Engineer II (Web3): Designing and building scalable ETL pipelines and analytics databases that power both internal operations and external customer solutions with an accent on large-scale distributed systems and data quality. Focus on redesigning infrastructure to handle billions of daily requests, developing frameworks for quality assessment, and implementing observability.

Location: New York Office

Salary: $190,000–$235,000

Company

hirify.global provides complete knowledge of what's happening on blockchains through data, services, and solutions, enabling organizations to navigate blockchains safely and with confidence.

What you will do

• Scale and redesign infrastructure to handle billions of daily requests and process tens of terabytes of data.
• Build ETL data pipelines using tools like Databricks, EMR, Athena, and Glue to enable internal and external customer insights.
• Develop frameworks for data quality testing, continuous assessment of data vendors, and streamline future integrations.
• Collaborate with product managers, data scientists, and UX teams to understand requirements and expose metrics effectively.
• Write solid, maintainable code in cloud-deployed infrastructure and implement observability and monitoring solutions.
• Participate in design and code review processes while supporting teammates through on-call responsibilities.

Requirements

• Bachelor's degree in Computer Science, Mathematics, Engineering, Information Management, Information Technology, or related field (or 5+ years equivalent experience); Master's degree acceptable with 3+ years experience.
• 4+ years developing scalable, large-scale data processing and ETL pipelines, and 3+ years building data pipelines using EMR, Airflow, Athena, Redshift, PostgreSQL, Snowflake, Kinesis, Lambda, or Databricks.
• 4+ years building software using Python or SQL.
• 3+ years implementing observability and monitoring tools (Humio, Datadog, Amazon CloudWatch, AWS CloudTrail).
• Strong communication skills with both technical and non-technical stakeholders.
• Experience with product-critical issues and ability to support teams during off-hours.

Nice to have

• Experience with self-healing infrastructure and auto-scaling systems.
• Familiarity with blockchain or cryptocurrency data platforms.
• Previous exposure to multiple data platforms and vendor ecosystems.

Culture & Benefits

• Offers Equity and Bonus.
• Committed to diversity of experience and thought, ensuring the team reflects unique communities.
• Encourages applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience.
• Provides accommodations for interview process accessibility due to disability.