What you will do (Responsibilities)

• Build and Manage AI Platform: Architect and implement a robust AI platform, including LLM gateways and infrastructure for AI agents capable of orchestrating complex workflows and conversational interfaces.

• Model Orchestration: Develop capabilities to dynamically configure and switch between specialized models optimized for different tasks such as reasoning, thinking, and coding to ensure optimal performance and cost-efficiency.

• Advanced Observability: Design and build comprehensive observability solutions using the latest frameworks (such as Langfuse) to provide deep visibility into agent performance, traces, and interactions.

• Benchmarking & Evaluation: Build rigorous benchmarking frameworks for AI applications to systematically evaluate model performance, latency, and quality across various use cases.

• Accuracy & Drift Monitoring: Design and implement data pipelines to collect production data and assess drifts in the accuracy of AI applications, ensuring high reliability and trust in our AI agents.

• System Scale & Reliability: Design, develop, test, maintain, monitor, and improve distributed systems and platform infrastructure to enable high-velocity iteration.

• Technical Leadership: Bring technical thought leadership to advance ThoughtSpot’s differentiation and market leadership in democratizing data analytics for business users.

Required skills and qualifications

• Education: Master's/PhD degree in Computer Science, Machine Learning, Data Science, or a related field.

• Experience: Have 10+ years of experience designing and implementing consumer-grade AI applications or distributed platforms. You understand what it takes to write software that is used by millions of people.

• AI Platforms & Agents: Proven track record of building AI platforms, specifically LLM gateways, and experience with agentic architectures (e.g., LangChain, AutoGPT concepts, or custom orchestrators).

• Observability: Hands-on experience with modern AI observability stacks (e.g., Langfuse, Arize, or custom solutions) for monitoring LLM behavior in production.

• Evaluation Frameworks: Experience building and maintaining benchmarking frameworks to evaluate the quality and performance of Generative AI applications.

• Data Engineering: Ability to build data pipelines for logging, evaluation datasets, and drift detection.

• Coding Proficiency: Strong coding skills in one of the modern languages such as C++, Go, Java, or Python.

• System Design: Experience with complex, high-volume distributed systems and an understanding of how to scale AI/ML infrastructure.

Hybrid Work at ThoughtSpot:

This office-assigned role is available as a hybrid position. Spotters assigned to an office are encouraged to experience the energy of their local office with an in-office requirement of at least three days per week. This approach balances the benefits of in-person collaboration and peer learning with the flexibility needed by individuals and teams.

What makes ThoughtSpot a great place to work?

ThoughtSpot is the experience layer of the modern data stack, leading the industry with our AI-powered analytics and natural language search. We hire people with unique identities, backgrounds, and perspectives—this balance-for-the-better philosophy is key to our success. When paired with our culture of Selfless Excellence and our drive for continuous improvement (2% done), ThoughtSpot cultivates a respectful culture that pushes norms to create world-class products. If you’re excited by the opportunity to work with some of the brightest minds in the business and make your mark on a truly innovative company, we invite you to read more about our mission, and apply to the role that’s right for you.

ThoughtSpot for All

Building a diverse and inclusive team isn't just the right thing to do for our people, it's the right thing to do for our business. We know we can’t solve complex data problems with a single perspective. It takes many voices, experiences, and areas of expertise to deliver the innovative solutions our customers need. At ThoughtSpot, we continually celebrate the diverse communities that individuals cultivate to empower every Spotter to bring their whole authentic self to work. We’re committed to being real and continuously learning when it comes to equality, equity, and creating space for underrepresented groups to thrive. Research shows that in order to apply for a job, women feel they need to meet 100% of the criteria while men usually apply after meeting 60%. Regardless of how you identify, if you believe you can do the job and are a good match, we encourage you to apply.