4 дня назад
Senior Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI): Building and optimizing an AI-ready enterprise data platform and scalable data pipelines with an accent on data transformation, workflow orchestration, and real-time processing. Focus on designing data models, automating pipeline execution with DBT and Airflow, and maintaining data integrity through monitoring, metrics, and alerts.
Location: Dallas, TX - Headquarters
Company
operates a global online vehicle auction platform connecting vehicle sellers with more than 750,000 buyers in over 190 countries.
What you will do
- Design and build an AI-ready enterprise data platform.
- Develop and automate scalable data processing systems and data transformations using DBT.
- Design workflow orchestration with Airflow and Cloud Composer for pipeline execution and scheduling across multiple systems.
- Implement logging, metrics, alerts, and monitoring for production data processes.
- Collaborate with Product Managers and application teams on data models and schemas for complex datasets.
- Maintain data integrity and prioritize conflicting requirements across production systems.
Requirements
- Bachelor’s degree or higher in Computer Science, Engineering, or a related field.
- 3–5 years of experience designing, developing, testing, and implementing scalable data warehouse and BI solutions.
- Enterprise database experience with systems such as SQL Server, Oracle, MySQL, Vertica, MemSQL, Netezza, Redshift, and Google BigQuery.
- Hands-on experience with real-time pipelines using Pub/Sub, Kinesis, or Kafka, including MPP database architecture.
- Experience with ETL/ELT and transformation tools such as DBT, DataFlow, and Informatica.
- Proficiency with Python, SQL, Java, Scala, cloud platforms, workflow orchestration, and BI tools.
Culture & Benefits
- Collaborative work with the Data & AI Team, application teams, executives, analysts, and other data consumers.
- Workplace focused on diversity, inclusion, collaboration, and professional growth.
- participates in the U.S. Department of Homeland Security E-Verify program for U.S. applicants and employees.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →