NEW Browse AI tools across categories — updated daily. See what's new →

Agent Evaluation Framework

Comprehensive Claude Code agent evaluation framework with multi-dimensional scoring, LLM-as-Judge mode, and research-backed performance variance analysis

AuthorNeoLabHQ
Version1.0.0
LicenseMIT
Token count~568
UpdatedJun 5, 2026

Install

Quick install

via npx skills · works with 57+ agents
npx skills add https://github.com/NeoLabHQ/context-engineering-kit/tree/master/plugins/customaize-agent/skills/agent-evaluation
Or pick agent:
npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework" --agent claude-code
npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework" --agent cursor
npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework" --agent codex
npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework" --agent opencode
npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework" --agent github-copilot
npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework" --agent windsurf
More install options

Shorthand — useful for multi-skill repos:

npx skills add NeoLabHQ/context-engineering-kit --skill "Agent Evaluation Framework"

Manual — clone the repo and drop the folder into your agent's skills directory:

git clone https://github.com/NeoLabHQ/context-engineering-kit.git
cp -r context-engineering-kit/plugins/customaize-agent/skills/agent-evaluation ~/.claude/skills/
How to use: Once installed, ask your agent to "use the Agent Evaluation Framework skill" or describe what you want (e.g. "Comprehensive Claude Code agent evaluation framework with multi-dimensional scor"). Requires Node.js 18+.

Agent Evaluation Framework

Comprehensive Claude Code agent evaluation framework with multi-dimensional scoring, LLM-as-Judge mode, and research-backed performance variance analysis

What is it?

  • Does the output actually complete the task?
  • Are the automated criterion scores reasonable?
  • What did the automation miss?

How to use it?

Install this skill in your Claude environment to enhance agent evaluation framework capabilities. Once installed, Claude will automatically apply the skill's guidelines when relevant tasks are detected. You can also explicitly invoke it by referencing its name in your prompts.

The full source and documentation is available on GitHub.

Key Features

  • Comprehensive Claude Code agent evaluation framework with multi-dimensional scoring, LLM-as-Judge mode, and research-backed performance variance analysis
  • Seamless integration with Claude's development workflow
  • Comprehensive guidelines and best practices for agent evaluation frameworkView on GitHub

GitHub Stats

StarsForksLast UpdateAuthorNeoLabHQLicenseGPL-3.0Version1.0.0

Categories

AI & MLDeveloper Tools

Tags

agent-evaluationllm-as-judgebenchmarkingcontext-engineeringquality-metrics

Features

Related Skills

More from AI & ML

Context Engineering Guide

Comprehensive context engineering tutorial covering attention mechanics, progressive disclosure, context budget management, and quality vs quantity trade-offs for AI agent development

433NeoLabHQAI & MLDeveloper Tools00

Multi-Perspective Critique

Multi-perspective review system using Multi-Agent Debate and LLM-as-Judge patterns with 3 specialized judges, debate rounds, and consensus building

433NeoLabHQAI & MLDeveloper Tools00

Create Claude Code Agent

Complete guide for creating Claude Code agents with YAML frontmatter structure, agent file format, trigger condition design, and system prompt writing

433NeoLabHQAI & MLDeveloper Tools00

---

Source: https://github.com/NeoLabHQ/context-engineering-kit/tree/master/plugins/customaize-agent/skills/agent-evaluation
Author: NeoLabHQ
License: https://www.gnu.org/licenses/gpl-3.0.html
GitHub Stars: 433
Tags: agent-evaluation, llm-as-judge, benchmarking, context-engineering, quality-metrics

SKILL.md source

---
name: Agent Evaluation Framework
description: Comprehensive Claude Code agent evaluation framework with multi-dimensional scoring, LLM-as-Judge mode, and research-backed performance variance analysis
---

# Agent Evaluation Framework

Comprehensive Claude Code agent evaluation framework with multi-dimensional scoring, LLM-as-Judge mode, and research-backed performance variance analysis

What is it?

* Does the output actually complete the task?

* Are the automated criterion scores reasonable?

* What did the automation miss?

## How to use it?
Install this skill in your Claude environment to enhance agent evaluation framework capabilities. Once installed, Claude will automatically apply the skill's guidelines when relevant tasks are detected. You can also explicitly invoke it by referencing its name in your prompts.

The full source and documentation is available on GitHub.

## Key Features

* Comprehensive Claude Code agent evaluation framework with multi-dimensional scoring, LLM-as-Judge mode, and research-backed performance variance analysis
* Seamless integration with Claude's development workflow
* Comprehensive guidelines and best practices for agent evaluation frameworkView on GitHub

### GitHub Stats
StarsForksLast UpdateAuthorNeoLabHQLicenseGPL-3.0Version1.0.0

### Categories
AI & MLDeveloper Tools

### Tags
agent-evaluationllm-as-judgebenchmarkingcontext-engineeringquality-metrics

### Features

## Related Skills
More from AI & ML

### Context Engineering Guide
Comprehensive context engineering tutorial covering attention mechanics, progressive disclosure, context budget management, and quality vs quantity trade-offs for AI agent development

433NeoLabHQAI & MLDeveloper Tools00

### Multi-Perspective Critique
Multi-perspective review system using Multi-Agent Debate and LLM-as-Judge patterns with 3 specialized judges, debate rounds, and consensus building

433NeoLabHQAI & MLDeveloper Tools00

### Create Claude Code Agent
Complete guide for creating Claude Code agents with YAML frontmatter structure, agent file format, trigger condition design, and system prompt writing

433NeoLabHQAI & MLDeveloper Tools00

---

**Source**: https://github.com/NeoLabHQ/context-engineering-kit/tree/master/plugins/customaize-agent/skills/agent-evaluation
**Author**: NeoLabHQ
**License**: https://www.gnu.org/licenses/gpl-3.0.html
**GitHub Stars**: 433
**Tags**: agent-evaluation, llm-as-judge, benchmarking, context-engineering, quality-metrics

Related skills 6