Data Engineer (Databricks/AWS)

TL;DR

Data Engineer (Databricks/AWS): spearhead the construction, optimization, and maintenance of cloud-based distributed computing data pipelines with an accent on scalable data flow, database management, and data quality checks. Focus on assembling large complex datasets, implementing advanced data modeling and security protocols, and partnering with data teams to drive innovation and functionality.

Location: Work From Home 100% of the time, or come in to one of our global offices. Up to you.

Company

American software development and technology advisory firm that brings top-tier engineering talent to clients around the world, handling custom product development, staff augmentation, integrations, and upgrades.

What you will do

• Develop and operationalize scalable, reliable data pipelines for seamless data flow.
• Assemble large, complex datasets to meet functional and non-functional business requirements.
• Apply advanced techniques in database management, logical data modeling, physical optimization, and security.
• Improve data pipeline integrity with comprehensive Data Quality checks.
• Partner with Data and Analytics experts to enhance functionality and innovation.
• Provide On-Call support to resolve user issues based on system severity.

Requirements

• Excellent verbal and written English communication skills
• 5+ years of experience in Engineering and Operationalizing Data Pipelines with large and complex datasets.
• 3+ years working with unstructured data formats (JSON).
• Extensive experience in Advanced SQL and 3+ years with Python/PySpark.
• 3+ years transforming data using Databricks and working within the AWS ecosystem.
• Proven experience with GIT and CI/CD methodologies.
• Proficiency with Power BI or similar data visualization platforms.
• Strong analytical, organizational skills, and detail-oriented mindset.

Culture & Benefits

• Great colleagues and upbeat work environment with supportive engineers and project managers.
• Generous vacation schedule.
• Brand new laptop and other goodies.