Lead AI Tech Architect (AI Platforms)

Location: Atlanta, Austin, Boston, Brooklyn, Chicago, Dallas, Denver, Detroit, Durham, Houston, Miami, Minneapolis, Nashville, New York, Philadelphia, Pittsburgh, Summit, or Washington, United States. The role includes travel to work with clients and BCG teams as needed.

Base compensation: $190,000 USD, plus an annual discretionary performance bonus and profit-sharing and retirement contributions.

Company

Boston Consulting Group is a global consulting firm whose Platinion practice delivers technology architecture, AI, digital transformation, cybersecurity, and enterprise solutions for clients.

What you will do

• Design scalable AI and LLM-based platform architectures balancing performance, modularity, cost, latency, and operational complexity.
• Design agentic AI solutions using RAG, model orchestration, memory, task decomposition, and enterprise system integration.
• Evaluate AI frameworks and tooling such as LangChain, LangGraph, Semantic Kernel, AutoGen, LlamaIndex, Strands, and Google ADK.
• Build proofs of concept and architectural prototypes to validate AI platforms, RAG flows, and agent orchestration patterns.
• Guide the transition of AI platforms from prototypes to production, including performance, observability, governance, versioning, testing, deployment, and monitoring.
• Lead technical discussions, workshops, client presentations, architecture reviews, mentoring, and quality assurance across product, data, engineering, and client teams.

Requirements

• Bachelor’s degree in information technology, computer science, engineering, or a related field.
• 6+ years of experience in software engineering, data engineering, or AI systems, including architecture or technical leadership experience.
• Strong foundation in software architecture and distributed systems, with experience designing AI/ML or LLM-based systems in production or near-production environments.
• Knowledge of agentic AI concepts including RAG, multi-agent orchestration, memory patterns, vector databases, and function calling.
• Understanding of cloud architecture, data platforms, API integration, and at least one hyperscaler: AWS, Azure, or GCP.
• Experience with cloud AI platforms, enterprise data integration, Docker, Kubernetes, technical communication, consulting, and agile delivery.

Nice to have

• Master’s degree.
• Programming experience with Python, JavaScript, or TypeScript.
• Experience with AI-assisted development tools such as Cursor, Claude Code, Replit, or Lovable.
• Experience with Pinecone, Qdrant, Azure AI Search, or similar vector databases and retrieval technologies.
• GenAI fluency demonstrated through tools such as ChatGPT or Claude.

Culture & Benefits

• Cross-disciplinary work combining strategic consulting with hands-on technology implementation.
• Collaboration with technology, data, product, engineering, and client teams.
• Medical, dental, and vision coverage with zero-dollar employee premiums for eligible employees and families.
• Paid vacation, holidays, annual office closure, parental leave, and family benefits.
• Retirement contributions, profit sharing, fitness reimbursement, and orthodontia coverage.