2 дня назад
Data Engineer II (AI)
104 000 - 135 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer II (Databricks/Spark): Building and evolving scalable data platforms, real-time and batch pipelines, and customer-facing data stores with an accent on AWS, distributed systems, and data reliability. Focus on optimizing ingestion and storage performance, preparing data for ML/LLM workflows, and solving complex production issues across security, quality, and observability.
Location: Austin, Texas, United States; flexible and remote-friendly work options are available, with an Austin office.
Base salary: $104,000–$135,000 per year
Company
is a cybersecurity product company that uses darknet data, advanced analytics, and AI to protect identities and disrupt cybercrime.
What you will do
- Design, build, and improve scalable data systems with a focus on performance and reliability.
- Use Databricks and Spark to prepare, transform, and serve data to customers and downstream systems.
- Build and maintain real-time and batch pipelines using AWS services, Terraform, and the Databricks ecosystem.
- Optimize the cost and performance of data ingestion, transformation, and storage workflows.
- Own complex data engineering initiatives from design and development through deployment and production support, including on-call troubleshooting.
- Partner with Product Management, Labs, and Engineering on architecture, data quality, security, observability, and AI/ML data workflows.
Requirements
- 5+ years of professional experience in data engineering, software engineering, or a related discipline.
- Experience with Lakehouse, Databricks, or large-scale distributed data architectures in AWS.
- Strong Python development skills for data-intensive systems and hands-on experience with ETL and data-processing pipelines.
- Experience with Elasticsearch or OpenSearch, DynamoDB, and other AWS-native data services.
- Experience with Terraform, production troubleshooting, data quality, performance, and reliability issues.
- Ability to independently own complex technical projects and contribute to architectural decisions across technical and non-technical teams.
Nice to have
- Familiarity with SageMaker, LangChain, vector databases, and other AI/ML tools.
- Knowledge of data governance, privacy, and compliance in AI and ML environments.
- Experience with observability tools, Go or C, and cybersecurity datasets or technologies.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field.
Culture & Benefits
- Mission-driven, innovative, collaborative, and inclusive work environment focused on disrupting cybercrime.
- Full-time benefits include 401(k) employer contribution, health, vision, and dental insurance, and an employer-contributed HSA.
- Employer-paid life, short-term disability, and long-term disability insurance.
- Generous PTO, 16 paid holidays, and flexible remote-friendly work options.
- Visa sponsorship is not available at this time.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Data Engineer (AI/ML)
81 499 - 138 549$
3 дня назад
Senior Databricks Consultant (AI)
175 000 - 250 000$
3 дня назад
Senior Databricks Consultant (AI)
175 000 - 250 000$
3 дня назад
Sr. Databricks Consultant - TS/SCI-FSP
175 000 - 250 000$
3 дня назад
Sr. Databricks Consultant (AI)
175 000 - 250 000$
3 дня назад
Data Engineer V (Databricks)
85 000 - 100 000$