本文へ移動
cccskills
無料GitHub で公開

test-model-selection

Picks the model a coding agent uses when a test or browser check sends an AI call. Use when choosing a model for any test, UI check, bench, or agent run, or when a test names Opus, Sonnet, Fable, Astra, or any model by habit.

インストール方法を見る

含まれるファイル(1)

  • SKILL.md3.1 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

<!-- SYNCED COPY — do not edit here. Canonical: common-docs/skills/test-model-selection/SKILL.md This file is distributed to every consuming repo by common-docs/meta/scripts/sync_skills.py. Edit the canonical, run the sync, and commit each repo. Edits made here are overwritten and lost. -->

test-model-selection — which model a coding agent tests with

Arman, 2026-10-10: "The point is to know what is being tested and adjust accordingly." Never pick a test model from memory. Ask what the test is for, then ask the catalog.

1. What are you testing?

The test is aboutPurposeGets you
Plumbing: UI, persistence, wiring, tools, streaming. The answer's content does not matter.plumbingThe cheapest unrestricted priced chat model that supports tool calls. Cheaper than Haiku.
Something that depends on the provider: its API, its streaming shape, its errors.provider + nameThe cheapest unrestricted model of THAT provider (Haiku for Anthropic).
The actual intelligence: answer quality, reasoning, an eval.intelligenceThe recommended default (Sonnet 5.5 today) plus the list of restricted models.

2. Ask (one call)

agent_catalog action=test_model purpose=plumbing
agent_catalog action=test_model purpose=provider provider=Anthropic
agent_catalog action=test_model purpose=intelligence

No MCP? From aidream/: uv run python scripts/test_model.py plumbing, or provider Anthropic, or intelligence. Both return the model id, name, price per 1M tokens in and out, and why. Use that model name as given.

3. Never a restricted model

Max-tier, Fable, Astra, Mythos, and anything at or above the cost rating the answer reports (restricted_min_cost_rating, 6 today) are off limits for testing. An intelligence answer lists them in restricted_models. The top-tier gate refuses them for anyone not approved, and a test account that asks for one raises a spend alarm to the super admins (one per account per day). The guard warns; it does not block, so the refusal is not your signal. This skill is.

4. Keep the test small

Fresh short context, as few calls as prove the point, and no premium pipeline re-run to check a code fix that does not depend on the model's reasoning. Rules: ai-model-and-spend-rules §5.

5. Where the answer comes from

One function, ai.test_model_choice(purpose, provider), computed from the live catalog (active, priced offerings only). Knobs under ai.test_models override it: plumbing_model, provider_models, intelligence_model, restricted_min_cost_rating, restricted_name_pattern. Reviewed monthly; the catalog changes, so never hard-code the answer in a test.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Admin debug system wiring for the floating AdminIndicator's live debug data and Copy Full Context. Use when adding debug visibility to a route or feature, wiring useDebugContext or the debug panel, capturing console errors, or enabling the copy-context workflow for a page.

日本語の概要は準備中です。原文の説明を表示しています。

armanisadeghi/ai-matrx32026年10月13日 更新

Compact two-icon Copy / Copy-for-AI controls (components/agent-copy). Use when adding copy buttons to a row, card, list, or record; merging duplicate Copy/JSON/AI controls; continuing the copy rollout; or writing a Copy-for-AI payload. NOT for markdown content actions (use rich-document-actions).

日本語の概要は準備中です。原文の説明を表示しています。

armanisadeghi/ai-matrx32026年10月13日 更新

Disclosing a surface's existing fixed AI jobs in the shell's top Agents menu. Use when a page, panel, overlay, or window already runs a mandate behind a button, assist, automatic action, or mode; when the agent-disclosure guard names a file; or during a surface check.

日本語の概要は準備中です。原文の説明を表示しています。

armanisadeghi/ai-matrx32026年10月13日 更新

The watch-fix-rerun method for making an existing platform agent or automated process efficient and correct: baseline its ledger, run one unit yourself, fix the class behind every wasted call, rerun, record. Use when asked to improve, optimize, watch, or 'make efficient' an agent, a sandbox session, a sync job, or any recurring automated process.

日本語の概要は準備中です。原文の説明を表示しています。

armanisadeghi/ai-matrx32026年10月13日 更新

Redux state for agent execution and firing agent shortcuts. Use when editing features/agents/redux/, building agent UI, creating a conversation, touching assembleRequest or NDJSON stream state, wiring agent-state selectors, adding a per-conversation capability, or triggering a shortcut from a button, menu, or code (useShortcutTrigger, launchAgentExecution).

日本語の概要は準備中です。原文の説明を表示しています。

armanisadeghi/ai-matrx32026年10月13日 更新

The provision for a call site: the exhaustive menu of values that place in the code can realistically produce. Use before creating or fixing a mandate or agent that reasons about more than its own input, when deciding whether an agent can answer at all with what it is sent, or when its output 'looks right' but nobody checked it could be. NOT for building the agent (use create-agent).

日本語の概要は準備中です。原文の説明を表示しています。

armanisadeghi/ai-matrx32026年10月13日 更新

armanisadeghi のスキルをすべて見る

このスキルの問題を報告する