20 часов назад
Senior Data Engineer (AI/ML)
145 000 - 220 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI/ML): Building and scaling AWS data infrastructure, lakehouse storage, ETL/ELT pipelines, knowledge graphs, and vector database integrations for financial analytics and AI-powered product features with an accent on data modeling, real-time processing, and production reliability. Focus on preparing ML datasets, enabling LLM-based agents, deploying containerized data services, and maintaining CI/CD and monitoring across regulated financial systems.
Location: Palo Alto, California, United States; hybrid office attendance required
Salary: $145,000–$220,000 base annually, plus potential discretionary performance-based bonus, equity, and benefits.
Company
is a fintech startup building a digital platform that helps RIAs and family offices discover, model, and manage private market investments.
What you will do
- Extend the AWS data lakehouse and model financial entities in a knowledge graph covering investors, funds, companies, and related relationships.
- Build scalable and reliable batch and real-time ETL/ELT pipelines using internal data and third-party APIs.
- Prepare datasets, feature stores, and retrieval infrastructure for machine learning models, LLM-based agents, semantic search, and real-time recommendations.
- Deploy and maintain data services with Docker, Kubernetes, AWS EKS, CI/CD, monitoring, dashboards, and production troubleshooting.
- Collaborate with the data lead, data science, backend, frontend, DevOps, and product teams to integrate data-driven features into the platform.
- Evaluate technologies such as Kafka, Kinesis, Airflow, and related data and AI tooling to improve reliability and scalability.
Requirements
- 5+ years of hands-on data engineering experience, including designing, building, and deploying large-scale pipelines and storage solutions.
- Strong AWS experience with services such as S3, EC2, ECS, EKS, Athena, Redshift, Glue, and Step Functions.
- Strong SQL, relational database design, data modeling, query optimization, and experience with data warehouses or lakehouses.
- Programming experience with Python and data-processing tools such as pandas or PySpark; experience with C#, Node, or TypeScript is valuable for data services.
- Experience with Docker, Kubernetes or AWS EKS, CI/CD, and workflow or DataOps tools such as Airflow, Prefect, or dbt.
- Understanding of ML data requirements, feature stores, vector embeddings, vector databases, AI agents, semantic search, and RAG; experience in a regulated SEC environment with sensitive financial data.
Nice to have
- Infrastructure-as-code experience with Terraform or CloudFormation.
- Experience with Snowflake, Databricks Delta Lake, Neo4j, AWS Neptune, pgvector, Chroma, or Pinecone.
- Familiarity with LangChain, LlamaIndex, Kafka, Kinesis, Airflow, or similar technologies.
- Bachelor’s degree in Computer Science or a similar technical field, or equivalent practical experience.
Culture & Benefits
- Hybrid collaboration from the Palo Alto office with a broader fully remote team.
- Medical, dental, and vision coverage, 401(k), and responsible vacation time.
- Travel may be required for team or department offsites.
- Culture focused on client experience, continuous improvement, open debate, meritocracy, adaptability, and technological change.
- Broadband internet connection required; compliance with the Code of Ethics is expected.
Hiring process
- An in-person interview may be required during the interview process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Senior Data Engineer (AI)
118 000 - 157 000$
1 день назад
Data Engineer (AI)
150 000 - 250 000$
3 дня назад
Data Engineer (Python/SQL)
120 000 - 160 000$
5 дней назад
Principal Data Engineer (AWS)
4 дня назад
Senior Engineer, Analytics (AI/ML)
113 000 - 141 525$
3 дня назад
Data Engineer I (Space)
80 000 - 115 000$