5 дней назад
Data Engineer (Scam Prevention)
80AUD
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Scam Prevention) (Databricks/Python): Building and operating scalable data ingestion, transformation, and governance platforms for telecommunications scam detection with an accent on Delta Lake architecture, high-volume event data, and trusted analyst-ready datasets. Focus on optimizing Databricks environments, implementing data quality and observability controls, and supporting fraud detection models and investigations.
Location: NSW, Australia; hybrid schedule with three days in the office and two days remote or from home
Additional benefit: AUD 80 monthly credit, plus competitive remuneration and employee discounts.
Company
is an Australian telecommunications company delivering mobile, broadband, and digital services to more than 11 million customers.
What you will do
- Build and maintain scalable ingestion pipelines for high-volume telecommunications event data powering the Scams Workbench platform.
- Design and operate Bronze, Silver, and Gold Delta Lake architectures and trusted data assets.
- Develop transformation and enrichment pipelines for scam detection, machine learning models, and analyst investigations.
- Implement data quality, validation, monitoring, alerting, anomaly detection, schema management, and observability practices.
- Optimize the performance, scalability, and operational health of Databricks and Delta Lake environments.
- Implement secure governance controls covering lineage, access management, auditability, compliance, and sensitive customer data.
Requirements
- 3+ years of experience designing, building, and operating production-grade data ingestion, transformation, and orchestration pipelines at scale.
- Experience with scam prevention, fraud detection, financial crime, AML, transaction monitoring, or a closely related risk environment.
- Strong understanding of fraud and scam detection use cases and the ability to translate requirements into data flows, detection features, rules, alerts, and analyst-ready datasets.
- Hands-on expertise in SQL and Python, with practical experience in Databricks, Apache Spark or PySpark, and Delta Lake or equivalent modern data platforms.
- Experience with high-volume, streaming, or near-real-time event data and ingestion frameworks.
- Knowledge of data governance and security practices, including access controls, audit logging, lineage, retention, validation, schema evolution, data contracts, and monitoring.
Culture & Benefits
- Flexible hybrid working arrangements.
- Competitive leave policies, including additional Connected days.
- Up to 16 weeks of inclusive, carer-neutral paid parental leave.
- Professional development through U micro-credentials developed with La Trobe and Macquarie Universities.
- Employee networks, diversity initiatives, and 24/7 counselling and wellbeing support.
- Office campus facilities include cafes, a gym, childcare, medical services, and an bus from Macquarie University Metro Station.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →