Senior Data Engineer (Apache Spark)

Location: 811 Excellence Dr., Bentonville, AR 72716, United States

Salary: $90,000–$180,000 per year, plus annual or quarterly performance incentives.

Company

hirify.global is Walmart’s advertising technology business.

What you will do

• Design and implement data applications, pipelines, transformations, integrations, and automated data loads.
• Work with SQL and NoSQL databases, distributed datastores, data warehouses, data lakes, and enterprise big data platforms.
• Develop conceptual, logical, and physical data models, including data warehouse and data mart designs, relational tables, keys, and stored procedures.
• Analyze data quality, data flows, dependencies, system integrations, and modeling discrepancies; propose appropriate solutions.
• Apply ETL, streaming ingestion, APIs, crawlers, preprocessing, analytics, automation, and cloud technologies to business data problems.
• Oversee less experienced programmers, provide troubleshooting support, create training documentation, and train end users on data modeling.

Requirements

• Master’s degree or equivalent in Computer Science or a related field plus 1 year of experience in software engineering, data engineering, database engineering, business intelligence, business analytics, or a related field; or a Bachelor’s degree or equivalent plus 3 years of such experience.
• Experience designing and implementing applications with Apache Spark.
• Experience with Hadoop ecosystem components, including Hadoop, HDFS, YARN, TEZ, and MapReduce, and writing Hive applications with Hive query language.
• Experience building Unix shell scripts and scheduling production jobs with Apache Airflow and Oozie.
• Experience using Google Cloud Platform for application execution with clusters and data management.
• Experience with Maven and SBT deployment tools, Jenkins-based CI/CD pipelines, and Git source control.
• Experience with Agile methodologies, JIRA/Scrum, project management activities, and requirements gathering from multiple teams for project increment planning.
• Any amount of experience with the required skills will be accepted.

Culture & Benefits

• Full-time employment with medical, vision, and dental coverage.
• Financial benefits include 401(k), stock purchase opportunities, and company-paid life insurance.
• Paid time off includes PTO, sick leave, parental leave, family care leave, bereavement, jury duty, and voting leave.
• Additional benefits include short- and long-term disability, education assistance with company-paid college degrees, discounts, military service pay, and adoption expense reimbursement.
• Benefits and eligibility may depend on job classification and length of employment and are subject to plan terms and change.
• A drug-free workplace and zero-tolerance policy for illegal drugs and alcohol apply to employees.