Senior Data Engineer (AWS/Spark)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (AWS/Spark): Designing and building scalable data platforms and pipelines to power identity verification products and analytics with an accent on automated data ingestion and ML feature engineering. Focus on optimizing cost, performance, and reliability of large-scale data workloads and integrating GenAI-assisted ingestion.
Location: Remote (US). cannot provide sponsorship now or in the future for this role.
Salary: $160K – $195K
Company
is building the identity trust infrastructure for the digital economy to verify identities in real time and stop fraud before it starts.
What you will do
- Design and build batch and streaming data pipelines for automated ingestion, ML feature engineering, and analytics across product domains.
- Own end-to-end delivery of complex data initiatives, including architecture, implementation, deployment, and monitoring.
- Develop and evolve a cloud-native data platform to support large-scale data processing.
- Automate data operations such as validation, quality checks, alerting, and recovery workflows to improve consistency.
- Optimize cost, performance, and reliability of data workloads.
- Collaborate with Data Science, Product, and Engineering teams to translate requirements into technical solutions.
Requirements
- 5+ years of hands-on data engineering experience building production-grade platforms and pipelines.
- Strong programming skills in Python or Scala and proficiency in SQL.
- Deep experience with Apache Spark, including performance tuning and optimization.
- Proven experience building data solutions using AWS services (EMR, Lambda, S3, etc.).
- Strong understanding of data modeling and warehousing concepts for large-scale datasets.
- Must be authorized to work in the US without sponsorship.
Nice to have
- Experience with streaming data processing using Kafka or Kinesis.
- Hands-on experience with data orchestration tools like Airflow or Step Functions.
- Familiarity with Data Lakehouse, Data Mesh, and large-scale data sharing patterns.
- Experience with prompt engineering, LLMs, and GenAI.
- Experience mentoring other engineers and establishing engineering standards.
Culture & Benefits
- Competitive compensation including base salary, equity, and bonuses.
- High-ownership environment where employees are expected to act as owners and move fast.
- Opportunity to solve complex problems with significant real-world impact on businesses and governments.
- Culture of high standards and critical thinking.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →