agent-eval-tools
v0.2.3by peaceroad
Experimental evaluation and improvement of agent skills and plugins, including improvement methods.
Package we checked
The manifest we fetched is plugins/agent-eval-tools/plugin.json in peaceroad/ai-dotfiles. The plugin root is the directory that holds that file. Its $schema is https://agent-plugins.org/schemas/1.0.0/plugin.schema.json. The manifest lists 1 skill (agent-improve) and no MCP servers.
What agent-eval-tools does, in the publisher's words
An experimental Agent Plugins v1 package for evaluating and improving agent skills and plugins across their subject areas. Its single entry point, agent-improve, covers evaluation, comparisons, bounded improvement search, and applying that process to the improvement method itself.
- Diagnose a recurring skill failure and compare a repair with preservation cases.
- Test whether simplifying instructions preserves quality.
- Explore a capability goal even when no failure log exists.
- Remeasure a skill after a model change.
- Use retained evidence to compare a new improvement method with the current one.
Ordinary edits and design reviews can continue with existing design skills. This package adds experiment execution and evidence; it does not require a separate design plugin. Useful observations are retained selectively, and self-improvement is a separately scoped run rather than mandatory overhead after every task.
From the project README, punctuation lightly normalized · Open the README on GitHub
- Skills
- 1
- MCP servers
- 0
- Stars
- 0
- License
- n/a
- Repo created
- 2026-07-17
- Last pushed
- 2026-11-09
- Publisher type
- User
- Version
- 0.2.3
Links
Skills · 1
- agent-improve
- Use when evaluating agent skills or plugins, comparing versions, or running evidence-based improvement experiments, including changes to the improvement method itself. Not for ordinary task execution, routine skill authoring, one-off edits, or general design reviews.
Descriptions come from the frontmatter of each SKILL.md, punctuation lightly normalized.
Category
Other. Assigned by this directory. Agent Plugins 1.0.0 has no category field, so no manifest declares one.
Keywords
agents · evaluation · skill-improvement
Related by publisher and keywords
Skills for designing, reviewing, and improving model-facing instructions and agent workflows.
Create, validate, migrate, and locally install portable Agent Plugins v1; assemble filesystem Marketplaces for plugins and standalone Agent Skills.
Use the ai-dotfiles agent CLI for managed development and Codex maintenance, and search locally exported conversations.
Guidance and task support for the user's ongoing personal assistant, dot.
Scaffold, develop, evaluate, and deploy AI agents with Google ADK. Bundles skills for the agent development lifecycle.
Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore (Strands, LangGraph), connecting tools via Gateway and MCP, multi-agent and A2A orchestration, memory, Cedar policies, evaluation, observability, debugging traces and logs, and production hardening.
[](https://agentpluginsdirectory.com/plugins/agent-eval-tools)✓ Verified . We fetched the manifest from GitHub and checked it against the official Agent Plugins 1.0.0 schema at agent-plugins.org.