peaceroad avatar

agent-eval-tools

v0.2.3

by peaceroad

Experimental evaluation and improvement of agent skills and plugins, including improvement methods.

Package we checked

The manifest we fetched is plugins/agent-eval-tools/plugin.json in peaceroad/ai-dotfiles. The plugin root is the directory that holds that file. Its $schema is https://agent-plugins.org/schemas/1.0.0/plugin.schema.json. The manifest lists 1 skill (agent-improve) and no MCP servers.

What agent-eval-tools does, in the publisher's words

An experimental Agent Plugins v1 package for evaluating and improving agent skills and plugins across their subject areas. Its single entry point, agent-improve, covers evaluation, comparisons, bounded improvement search, and applying that process to the improvement method itself.

  • Diagnose a recurring skill failure and compare a repair with preservation cases.
  • Test whether simplifying instructions preserves quality.
  • Explore a capability goal even when no failure log exists.
  • Remeasure a skill after a model change.
  • Use retained evidence to compare a new improvement method with the current one.

Ordinary edits and design reviews can continue with existing design skills. This package adds experiment execution and evidence; it does not require a separate design plugin. Useful observations are retained selectively, and self-improvement is a separately scoped run rather than mandatory overhead after every task.

From the project README, punctuation lightly normalized · Open the README on GitHub

Skills
1
MCP servers
0
Stars
0
License
n/a
Repo created
2026-07-17
Last pushed
2026-11-09
Publisher type
User
Version
0.2.3

Links

Skills · 1

agent-improve
Use when evaluating agent skills or plugins, comparing versions, or running evidence-based improvement experiments, including changes to the improvement method itself. Not for ordinary task execution, routine skill authoring, one-off edits, or general design reviews.

Descriptions come from the frontmatter of each SKILL.md, punctuation lightly normalized.

Category

Other. Assigned by this directory. Agent Plugins 1.0.0 has no category field, so no manifest declares one.

Keywords

agents · evaluation · skill-improvement

Related by publisher and keywords

  • Skills for designing, reviewing, and improving model-facing instructions and agent workflows.

  • Create, validate, migrate, and locally install portable Agent Plugins v1; assemble filesystem Marketplaces for plugins and standalone Agent Skills.

  • Use the ai-dotfiles agent CLI for managed development and Codex maintenance, and search locally exported conversations.

  • dot-toolkitpeaceroad

    Guidance and task support for the user's ongoing personal assistant, dot.

  • Scaffold, develop, evaluate, and deploy AI agents with Google ADK. Bundles skills for the agent development lifecycle.

  • Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore (Strands, LangGraph), connecting tools via Gateway and MCP, multi-agent and A2A orchestration, memory, Cedar policies, evaluation, observability, debugging traces and logs, and production hardening.

Add the verified badge to your README[![Verified by AgentPluginsDirectory.com against Schema 1.0.0](https://agentpluginsdirectory.com/badge.svg)](https://agentpluginsdirectory.com/plugins/agent-eval-tools)

✓ Verified . We fetched the manifest from GitHub and checked it against the official Agent Plugins 1.0.0 schema at agent-plugins.org.