The Podcast That Explores the Future of AI and Data Sovereignty

Subscribe to the AI Confidential Newsletter

Navigating AI Evaluation and Observability

Atin Sanyal, Co-Founder & CTO, Galileo

As GenAI tools have become more intelligent and robust, the reliability of their output has decreased. Enter Galileo: an AI reliability platform designed for GenAI applications. Atin Sanyal — the Co-founder and CTO of Galileo — has a background building machine learning tech at Uber and Apple. One innovative technique that sets Galileo apart is ChainPoll — their hallucination detection methodology that uses consensus scoring and prompts the LLM to outline its step-by-step reasoning process. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to Atin about: what evaluation agents are, and why they get smarter over time; how Galileo helps enterprises evolve their own AI quality metrics; and why data quality and confidential computing will become increasingly important to enterprises building AI systems.

Season 1
Season 2
Select field

Check out our past episodes

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
EPISODE 1

Building Trust in AI

  • Mark Papermaster, CTO & EVP at AMD
  • Mark Russinovich, CTO and Deputy CISO of Microsoft Azure

How do you build AI applications that are not only powerful but also trustworthy and easy to adopt? Join Mark Papermaster and Mark Russinovich as they discuss the essential role of confidential computing in making AI seamless, secure, and accessible to businesses everywhere.

Season 1
Episode 2

Safe and Secure Generative AI

Teresa Tung, Senior Managing Director & Global Data Capability Lead at Accenture

Generative AI is transforming industries—but how do we ensure it’s safe? Teresa Tung dives into what companies need to make generative AI both impactful and secure, exploring the frameworks that bring safety to scale.

Season 1
Episode 3

Privacy Meets Innovation with Daniel Rohrer (NVIDIA) & Raluca Ada Popa (Opaque)

  • Daniel Rohrer, VP of Software Security at NVIDIA
  • Raluca Ada Popa, Co-Founder and President, Opaque

Can AI be both innovative and private? NVIDIA’s Daniel Rohrer and Opaque’s Raluca Ada Popa discuss the advancements in privacy-preserving technology that enable organizations to push AI forward without compromising data sovereignty.

Season 1
Episdoe 4

Making AI Work in the Real World

Will Grannis, CTO & VP at Google Cloud

AI is full of potential, but what does it really take to make it work in complex environments? Will Grannis shares his perspective on bridging AI innovation with practical application, including insights into the real challenges and rewards of implementing AI in today’s top enterprises.

Season 1
Episdoe 5

Protecting Our Future from AI

Jason Clinton, CISO at Anthropic

What does it take to ensure AI is safe, ethical, and resilient? In this season finale, Anthropic’s CISO joins Aaron to discuss the critical intersection of innovation, data privacy, and sovereignty, offering an optimistic perspective on what lies ahead for the future of confidential AI.

Season 1
Episode 1

Unleashing the Power of Agents with the "Forrest Gump of Tech"

Reuven Cohen, Founder, Agentics Foundation

From cloud computing to infrastructure-as-a-service, Reuven Cohen (AKA rUv) has been on the cutting edge of every major technology supercycle—and he’s now one of the most influential people in the agentic AI space. With the help of agents, rUv produced 10 million lines of usable code last year. That’s 33,000 years of output from one human. rUv’s approach proves one of two things: he’s either an outlier or a leading indicator of what’s to come. In this episode, we talk to rUv about: His approach to training autonomous agents; The rapid advancements in agentic code development; Why LLMs are vulnerable to data poisoning; and Why Python is bad for agentic development.

Season 2
EPISODE 2

Building Transparent, Open-Source AI with Sriram Raghavan

Sriram Raghavan, Vice President of IBM Research AI

Hosts Aaron Fulkerson and Mark Hinkle sit down with Sriram Raghavan, Vice President of IBM Research AI, at the AllThingsOpen.ai conference. As an experienced industry expert, Sriram leads a global team of over 750 research scientists and engineers focused on advancing AI. Sriram and IBM believe that the future of AI is open source. That’s why IBM recently contributed three AI projects — Docling, Data Prep Kit, and BeeAI — to the Linux Foundation. And while there is a lot of hype around LLMs right now, IBM is leaning into smaller “fit-for-purpose” models that give developers choice. In the episode, Sriram also digs into IBM’s approach to open-source models; What innovations he sees coming for enterprise AI; and How his team is approaching responsible, secure AI.

Season 2
EPISODE 3

How AI is Reshaping Enterprise Technology with James Kaplan

James Kaplan, Partner, McKinsey and CTO, McKinsey Technology

James Kaplan has been consulting enterprise clients on how to adopt and extract value from cutting-edge technologies for over 25 years. His dual role as Partner at McKinsey and CTO at McKinsey Technology gives him a unique vantage point into how CIOs and CTOs can harness AI to drive automation, increase productivity, and enhance data security. In this episode, James and Aaron talk about how AI is changing the enterprise technology landscape; what enterprises should be thinking about as they’re adopting and building AI systems; and how to avoid the “IT doom loop.”

Season 2
EPISODE 4

On the Cutting Edge of Agentic AI with João Moura

João Moura, CEO, CrewAI

João Moura built the agentic AI open source framework, CrewAI, with a central vision: to make agent creation feel borderline magical. Inspired by the Ruby on Rails philosophy of “convention over configuration,” CrewAI is designed for speed, clarity, and ease of use. What we love about João’s approach to agentic AI is that he’s not just disrupting the market. He’s shifting the way enterprise leaders think about long-term workflows and processes, too. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to João about: why interoperability across your stack is essential for scaling AI; how managers are uniquely equipped to build effective agents; and the dangers of “agent washing.”

Season 2
EPISODE 5

Navigating AI Evaluation ane Observability with Atin Sanyal

Atin Sanyal, Co-Founder & CTO, Galileo

As GenAI tools have become more intelligent and robust, the reliability of their output has decreased. Enter Galileo: an AI reliability platform designed for GenAI applications. Atin Sanyal — the Co-founder and CTO of Galileo — has a background building machine learning tech at Uber and Apple. One innovative technique that sets Galileo apart is ChainPoll — their hallucination detection methodology that uses consensus scoring and prompts the LLM to outline its step-by-step reasoning process. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to Atin about: what evaluation agents are, and why they get smarter over time; how Galileo helps enterprises evolve their own AI quality metrics; and why data quality and confidential computing will become increasingly important to enterprises building AI systems.

Season 2
Welcome to AI Confidential

The Podcast That Explores the Future of AI and Data Sovereignty

Subscribe to the AI Confidential Newsletter
Subscribe
Profile photograph of Mark Russinovich
Portrait photograph of Raluca Ada Popa
Portrait photograph of Teresa Tung
Portrait photograph of Will Grannis

What You’ll Discover

Whether you’re a tech leader, an AI enthusiast, or simply curious about what lies ahead, AI Confidential offers insights into:

The future of AI and how confidential computing will shape it

Real-world applications and breakthrough use cases

Insights from pioneers at the forefront of AI, data security, and privacy

Meet the Host

In today’s rapidly evolving tech landscape, AI is at the heart of transformation across industries. From finance to high tech, leaders are racing to harness its power while navigating complex challenges like data sovereignty, regulatory compliance, and privacy. But what if there was a way to solve these problems without sacrificing innovation?

On AI Confidential, join host Aaron Fulkerson as he dives deep with visionaries from AMD, Accenture, Google Cloud, Microsoft Azure, NVIDIA, and Opaque Systems to uncover how confidential computing is reshaping what’s possible for AI. Together, they explore pressing questions, share groundbreaking use cases, and take bold steps in predicting AI's future.

Host:
Aaron Fulkerson
Profile Shot of Aaron Fulkerson

Transform Your Business with Confidential AI

Harness sensitive data across silos while ensuring uncompromising privacy and regulatory compliance. Break through security barriers to accelerate your AI innovation. Seize the opportunity for secure, powerful analytics today.