---
title: "mizan-mcp"
description: "Expose the Mizan eval engine to agents and MCP clients as callable tools via the `mizan mcp` server. Registers a local stdio MCP server (`mizan mcp stdio`) advertising four tools, mizan_list_metrics, mizan_get_metric (re"
canonical: https://agentpluginsdirectory.com/plugins/mizan-mcp
last-updated: 2026-10-21
---

# mizan-mcp
Expose the Mizan eval engine to agents and MCP clients as callable tools via the `mizan mcp` server. Registers a local stdio MCP server (`mizan mcp stdio`) advertising four tools, mizan_list_metrics, mizan_get_metric (read-only), mizan_eval_run, and mizan_eval_pairwise, plus an agent-in-the-loop eval skill. Use when an agent should discover a judge and run an evaluation over MCP rather than shelling out to the CLI.
- Slug: mizan-mcp
- Publisher: ghchinoy
- Repository: https://github.com/ghchinoy/mizan
- Manifest: plugins/mizan-mcp/plugin.json
- Version: 0.1.0
- License: Apache-2.0
- Category (editorial): other
- Skills: 1 (evaluate-with-mcp)
- MCP servers: 0
- Stars: 2
- Repository created: 2026-08-07
- Repository last pushed: 2026-10-07
- Publisher type: User
- Listing: https://agentpluginsdirectory.com/plugins/mizan-mcp
- Schema: https://agent-plugins.org/schemas/1.0.0/plugin.schema.json

## Skills

- evaluate-with-mcp: Run an agent-in-the-loop Mizan evaluation over the Model Context Protocol (MCP), discover a judge (mizan_list_metrics -> mizan_get_metric), run it (mizan_eval_run / mizan_eval_pairwise), and read the persisted runId returned INLINE in the tool result. Use when an agent has the mizan MCP server conn…

Descriptions come from the frontmatter of each SKILL.md, punctuation lightly normalized.