Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (Azure/AI): Designing and maintaining AI-enabled data pipelines for large-scale dataset ingestion and distribution with an accent on scalability, security, and cost efficiency. Focus on optimizing data processing performance, integrating cloud services, and implementing robust data governance.

Location: Irving, Texas. Local telecommuting permitted.

Salary: $157,414 – $207,800 per year

Company

Enterprise software leader that helps large organizations and government agencies unify customer experiences through the hirify.global Infinity platform.

What you will do

• Spearhead the design, construction, and upkeep of AI-enabled data pipelines.
• Develop scalable pipelines for ingesting, transforming, and distributing large datasets.
• Design and implement secure data storage solutions and ensure regulatory compliance.
• Optimize data processing performance and cost efficiency through monitoring and tuning.
• Integrate cloud services and automation tools like Terraform and GitHub Actions to streamline operations.
• Support BI initiatives by integrating data with visualization tools such as Power BI and Looker.

Requirements

• Bachelor’s degree in Computer and Information Science or a related field.
• 6+ years of experience building big data pipelines and scalable data infrastructure.
• Experience with Azure, Data Lakes, ADSL2, and Delta Lake.
• Proficiency in Python, Go, Scala, or Java, and SQL for ETL processes.
• Hands-on experience with Spark, PySpark, Hive, Airflow, and Databricks.
• Knowledge of AI/ML tools including Pandas, NumPy, and Matplotlib.

Culture & Benefits

• Opportunity to work within a community that values contributions and professional growth.
• Local telecommuting options available.
• Eligibility for the Employee Referral Program.
• Inclusive work environment as an Equal Opportunity employer.