Building Cost Governance for AI Workloads

In this episode, Hunter Willis sits down with Andy Westbrook, Director of Cloud Transformation at NTT Data, to explore how FinOps practices are evolving to meet the demands of AI-first organizations. Andy shares how his team is tackling the challenges of tracking token consumption, optimizing large language model (LLM) usage, and activating cost governance.

From building an AI Center of Excellence to collaborating with developers on monthly LLM reviews, Andy offers a blueprint for FinOps teams navigating the fast-paced world of AI deployments.

In this episode we cover how organizations can:

• Track and optimize AI token consumption across LLMs
• Collaborate with developers to balance cost, performance and sustainability
• Establish governance and collaboration through an AI Center of Excellence