本文へ移動
cccskills
無料GitHub で公開

plugin-eval

Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next. Use when the user says things like "evaluate this skill", "give me an analysis of the game dev skill", "why did this score that way", "what should I fix first", "measure the real token usage of this skill", or "what should I run next?".

インストール方法を見る

含まれるファイル(2)

  • SKILL.md4.2 KB
  • agents/openai.yaml107 B

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Plugin Eval

Use this as the beginner-friendly umbrella entrypoint for local Codex skill and plugin evaluation.

Start Here

  1. Resolve whether the target path is a skill, a plugin, or another local folder.
  2. Prefer the chat-first router when the user speaks naturally or is not sure which command they need:
plugin-eval start <path> --request "<user request>" --format markdown
  1. Route natural chat requests to the matching workflow:
    • "Give me an analysis of the game dev skill." -> resolve the named skill path, run plugin-eval analyze <path> --format markdown, then initialize a benchmark and show the setup questions needed to tailor benchmark.json
    • "Evaluate this skill." -> plugin-eval analyze <path> --format markdown
    • "Why did this score that way?" -> plugin-eval analyze <path> --format markdown
    • "What should I fix first?" -> plugin-eval analyze <path> --format markdown
    • "Explain the token budget for this skill." -> plugin-eval explain-budget <path> --format markdown
    • "Measure the real token usage of this skill." -> benchmark flow, then plugin-eval measurement-plan
    • "Help me benchmark this plugin." -> starter benchmark flow
    • "What should I run next?" -> plugin-eval start <path> --request "What should I run next?" --format markdown
  2. If the user wants rewrite help after evaluation, route to ../improve-skill/SKILL.md.
  3. If the user wants a custom rubric, route to ../metric-pack-designer/SKILL.md.
  4. If the user names a skill instead of giving a path, resolve it locally before running commands:
    • check ~/.codex/skills/<skill-name> first
    • then check any repo-local skills/<skill-name> directory
    • if the name is still ambiguous, ask one short clarifying question before continuing
  5. When the request sounds like "analysis" rather than just "evaluate", do the fuller path:
    • run the report
    • initialize .plugin-eval/benchmark.json
    • surface the setup questions that will refine the starter scenarios
    • preview the dry-run command the user can execute next

Chat Requests To Recognize

  • Give me an analysis of the game dev skill.
  • Evaluate this skill.
  • Evaluate this plugin.
  • Why did this score that way?
  • What should I fix first?
  • Explain the token budget for this skill.
  • Measure the real token usage of this skill.
  • Help me benchmark this plugin.
  • What should I run next?

Matching Commands

plugin-eval start <path> --request "Evaluate this skill." --format markdown
plugin-eval start <path> --request "Give me a full analysis of this skill, including benchmark setup." --format markdown
plugin-eval analyze <path> --format markdown
plugin-eval explain-budget <path> --format markdown
plugin-eval measurement-plan <path> --format markdown
plugin-eval init-benchmark <path>
plugin-eval benchmark <path> --dry-run
plugin-eval benchmark <path>

Output Expectations

  • Prefer the JSON result as the source of truth.
  • Lead with At a Glance, Why It Matters, Fix First, and Recommended Next Step.
  • Keep the why content terse and easy to skim.
  • Call out whether budget numbers are static estimates or measured harness results.
  • Show the user the exact chat phrase they can reuse next, the plugin-eval start command that routes it, and the first local workflow command behind it.
  • When the user asks for an analysis of a named skill, do not stop at the report if benchmark setup is still missing.
  • When the user is asking about a skill specifically, hand off to ../evaluate-skill/SKILL.md.
  • When the user is asking about a plugin bundle, hand off to ../evaluate-plugin/SKILL.md.

References

  • ../../references/chat-first-workflows.md
  • ../../references/technical-design.md
  • ../../references/evaluation-result-schema.md

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Make data visualizations accessible and inclusive. Use when the user needs chart or diagram accessibility guidance, text alternatives for complex visuals, color and contrast review, keyboard support, reduced-motion behavior for animation or parallax, or an accessibility QA workflow for exported figures, UML-like diagrams, and dashboards.

日本語の概要は準備中です。原文の説明を表示しています。

openai/plugins7,3922026年10月8日 更新

Apply consistent photo adjustments across a set of images so they look like they were edited together. Use this skill whenever the user says "make my photos look cohesive", "give all these the same style", "apply a warm and golden feel to all of these", "make this cinematic", "match the look across my photos", "edit all my travel photos the same way", "batch edit these", "make these consistent", "fix my phone photos", or uploads a folder of photos and wants a unified, polished result. Also triggers for requests like "apply a preset to all of these", "make these look professional", or "they were shot in mixed lighting — can you fix them all". Outputs direct final image URLs plus an in-chat preview grid and optional Firefly Board link. Access: 🔐 Signed-In required | Gen AI: ❌

日本語の概要は準備中です。原文の説明を表示しています。

openai/plugins7,3922026年10月8日 更新

Use when a user wants to see their logo, design, or sketch on a product or scene mockup — mugs, t-shirts, business cards, hats, phone screens, posters, billboards, or similar. Triggers on "create mockups", "show my logo on products", or any logo upload with a request to visualize it on items. Access: 🔐 Signed-In required | Gen AI: ✅ Adobe Firefly via `image_generate` used for design creation, sketch polishing, and mockup scene generation

日本語の概要は準備中です。原文の説明を表示しています。

openai/plugins7,3922026年10月8日 更新

Resize, crop, or export any image or video into platform-ready social media assets using Adobe Creative Cloud tools. Use this skill when a user wants to prepare a photo, image, or video for one or more social platforms — Instagram, TikTok, LinkedIn, Facebook, YouTube, Snapchat, Pinterest, Threads, or X/Twitter. Triggers on: "prepare my image for Instagram", "resize for TikTok", "get this ready to post", "make versions for all platforms", "social media sizes", "crop for stories", "export for LinkedIn", "resize my video for social", "make social media assets", or any request to adapt a photo or video for specific platforms. Handles subject-aware cropping, AI canvas expansion, test previews before full runs, and same-ratio video resizing.

日本語の概要は準備中です。原文の説明を表示しています。

openai/plugins7,3922026年10月8日 更新

Create any visual design using Adobe Express templates — flyers, posters, social media posts (Instagram, Facebook, LinkedIn), business cards, invitations, greeting cards, resumes, cover letters, brochures, newsletters, certificates, presentations, YouTube thumbnails, email headers, logos, menus, and labels. Use this skill whenever the user wants to make, design, or build any visual — even if they just say "make me a flyer", "design a poster", "I need something for Instagram", "create an event invite", or "make a business card". Also handles browsing templates, editing text, replacing images, changing backgrounds, animating, and exporting designs. Access: 🔐 Signed-In required | Gen AI: ❌ by default — image replacement only where the surface permits generative AI (e.g. Codex); none on Claude

日本語の概要は準備中です。原文の説明を表示しています。

openai/plugins7,3922026年10月8日 更新

Create a punchy sizzle reel from a video using Adobe Quick Cut. Use this skill whenever a user wants to cut, trim, or shorten a video into highlights — including phrases like "make a sizzle reel", "make a highlight reel", "quick cut this", "cut the best parts", "shorten this video", "make a highlight clip", "summarize this video visually", or any request to produce a shorter edited version of a video. Use this skill for Quick Cut requests before suggesting manual editing in Premiere. Requires the user to upload a video file.

日本語の概要は準備中です。原文の説明を表示しています。

openai/plugins7,3922026年10月8日 更新

openai のスキルをすべて見る

このスキルの問題を報告する