Data Scientist II (AI)

TL;DR

Data Scientist II (AI): Applying research and experimentation with Large Language Models (LLMs) to real-world customer interactions with an accent on prompting and orchestration strategies. Focus on optimizing RAG systems, designing experimentation frameworks for non-deterministic outputs, and integrating GenAI solutions into production.

Location: Fully Remote (USA)

Salary: $120,000 – $145,000 USD

Company

A leader in trusted enterprise conversational AI and digital transformation providing the Conversational Cloud platform.

What you will do

• Execute applied research initiatives using LLMs in a commercial setting to impact Conversational AI.
• Design effective prompting and orchestration strategies leveraging Transformer architecture (Attention, Tokenization, Embeddings).
• Analyze large-scale conversational datasets to optimize Retrieval-Augmented Generation (RAG) systems.
• Develop scientific evaluation and experimentation frameworks for non-deterministic model outputs.
• Collaborate with engineering teams to deploy GenAI/LLM solutions into production environments.
• Translate insights on model behavior into recommendations for product and business strategy.

Requirements

• Master's degree in Computer Science, AI, Computational Linguistics, Operations Research, Industrial Engineering, or a related field.
• Minimum 2 years of experience as a data scientist.
• Proficiency in Python and SQL.
• Experience designing LLM interaction flows, evaluation frameworks, or advanced prompting strategies.
• Must be based in the USA.

Nice to have

• Experience with LLM Orchestration Frameworks such as LangChain or LangGraph.
• Hands-on experience with Vector Databases and Semantic Search.
• Knowledge of advanced prompting techniques like Chain-of-Thought or Few-Shot prompting.
• Experience with dialogue systems and context management.

Culture & Benefits

• Comprehensive Medical, Dental, and Vision insurance plans.
• 401(k) retirement plan with a 4% employer match.
• HSA & FSA plans for pre-tax health expenses.
• Employee Stock Purchase Program (ESPP) with company share discounts.
• Flexible Paid Time Off (PTO) and generous parental leave policy.
• Remote-first work model with optional access to WeWork spaces for collaboration.