Using promptfoo to test Claude Code configuration

Fri, 13 Nov 2026 00:00:00 +0000

Prologue

In my previous post, I experimented with implementing a poor man’s testing tool for my Claude Code configuration. One option I explored while researching the space was promptfoo. At the time of the initial research, promptfoo did support Claude Code as a provider, but with a catch. It only supported API billing, which was undesirable in my case.

In this post, I will explore the options for using promptfoo with Claude Code and a subscription:

Promptfoo on Ioannis Canellos

Using promptfoo to test Claude Code configuration

Prologue