Data Science & Analytic Methodology SME (AI/LLM)

Location: Remote

Salary: $60–$120 per hour

Company

Technology consulting company delivering specialized expertise for high-impact data science and AI projects.

What you will do

• Map large-scale analytical and pipeline integration scenarios to established evaluation taxonomies.
• Develop analytical cases based on real-world deployment patterns, including automated triage, data enrichment, analysis at scale, and operational failure modes.
• Evaluate and grade outputs for source handling, reasoning quality, understanding of limitations, and practical utility.
• Identify model over-refusal that could disrupt legitimate analytical workflows or pipeline continuity.
• Document complex edge cases and emerging methodological challenges, and provide actionable improvement recommendations.
• Deliver clear written and verbal feedback to support iterative development and high-quality project outcomes.

Requirements

• Strong data science expertise and practical experience in analytical methodology, automation, and evaluating complex workflows.
• Strong technical writing skills and the ability to document methodologies clearly and communicate complex concepts in English.
• Ability to assess model limitations and failure patterns, evaluate performance, and provide actionable feedback.
• Ability to work effectively in distributed, international project environments with minimal clearance-related constraints.

Nice to have

• Experience integrating large language models, including government-specific GPT variants, into complex data or analytical pipelines.
• Experience conducting analysis at scale, with an understanding of automation failure modes and relevant evaluation metrics.
• Experience teaching, mentoring, or providing technical leadership in data science or related analytical disciplines.
• Familiarity with designing evaluation frameworks, benchmarks, or assessment systems.
• Experience in defense, intelligence, or government analytical environments.

Culture & Benefits

• Remote contractor engagement.
• Work in a distributed, international project environment.
• Contribute to next-generation AI systems and advanced analytical pipelines.
• Minimal clearance-related constraints.