本文へ移動
cccskills
無料GitHub で公開

harness-generation

Seed minimal agent harness v0 — manifest, eval checks stub, governance. AUTO-INVOKED after project-setup or retroactive-project-setup when docs/harness/manifest.json is missing. Also triggers on: generate harness, scaffold agents, agent bootstrap, first time agents in this repo, new project agent setup, set up agent harness, agent onboarding files, missing agent configuration, agent instructions setup, make agents read project rules, agent reliability setup, agents not configured. Pairs with project-setup. Evolution is harness-evolution.

インストール方法を見る

含まれるファイル(4)

  • SKILL.md7.5 KB
  • references/component-manifest.md2.1 KB
  • references/examples.md1.2 KB
  • references/scaffold-patterns.md3.5 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Harness Generation

You seed a minimal, auditable harness v0 — the scaffold around a model (prompts, tools, skills, memory hooks, lifecycle, verification interface, governance). You do not evolve harnesses; route ongoing improvement to harness-evolution.

Trigger Discipline

Auto-invoke when chained from project-setup 6c, retroactive-project-setup, harness-engineering Step 0, or setup-evaluation harness FAIL. See harness-engineering/references/harness-readiness-gate.md.

Hard Rules

Never generate a harness without a versioned component manifest (docs/harness/manifest.json). Never ship a pre-tuned bloated harness — v0 is minimal; components earn their place via measured rollouts (AHE). Never rely on prompt-only harness — tools, middleware, skills, and eval interface are required surfaces (AHE ablation). Never overwrite user-edited harness files without manifest drift check — refuse or merge explicitly. Never claim self-improving without eval interface stub + pointer to harness-evolution. Never embed external repo URLs in generated artifacts — distill patterns locally.


Workflow

Step 1 — Classify delivery context

Contextv0 focus
agent-loom skill library projectSkill routing, AGENTS.md orchestration map, eval stub for skill quality
Consumer app repoAGENTS.md, .agents/skills/, forbidden paths, key commands
Legacy repo (no AGENTS.md)Gap-fill only — pair with retroactive-project-setup first
Multi-agent chain plannedManifest only — topology is agent-builder, not this skill

Step 2 — Inventory repo (silent)

Read: manifests, existing AGENTS.md, .agents/skills/, CI configs, docs/memory/, docs/evals/, docs/harness/. Auto-extract commands per project-setup Step 1b.

Step 3 — Emit component manifest

Write docs/harness/manifest.json per references/component-manifest.md: seven orthogonal components (prompt, tools, middleware, skills, sub-agents, memory, governance), each with path, version, sha256, and generated|user-edited status.

Step 4 — Scaffold artifacts

Apply patterns from references/scaffold-patterns.md:

  1. Prompt / routing — merge into AGENTS.md or create harness section; keep ≤150 lines total.
  2. Skills — ensure Skill Invocation block present; list installed skills in Orchestration Map.
  3. Tools — document MCP/tool surfaces in manifest; stub docs/harness/tools.md if needed.
  4. Governance — forbidden paths, allowed-write scopes, verifier sandbox rules.
  5. Eval interface stub — docs/harness/eval-interface.md + empty docs/harness/tasks.json shape (file_phrase + command checks per metaharness pattern).
  6. Environment bootstrap — compact snapshot block (stack, key commands, git branch) for meta-agents.

If project-setup already ran: merge, never replace user interview content.

Step 5 — Drift gate

Document harness sync --check equivalent: compare manifest hashes to disk; flag user-edited files skipped on re-run. CI recommendation in manifest notes.

Step 6 — Hand off

Next needRoute
Full AGENTS.md interview missingproject-setup
Eval rubric + regression suiteeval-rubric-design → eval-pipeline
Improve harness from failuresharness-evolution (requires eval harness)
Multi-agent designagent-builder (orthogonal)

Append to docs/skill-outputs/SKILL-OUTPUTS.md. Log harness version v0 in docs/memory/current-state.md if memory suite installed.


Gotchas

  • Minimal seed is mandatory. Pre-tuned harnesses contaminate attribution — every component added later must justify itself with traces (Self-Harness, AHE).
  • AGENTS.md must stay lean. RHO/Codex paths cap combined project docs ~32KB — routing belongs in skills, detail in L3 refs.
  • Harness ≠ agent topology. agent-builder designs who talks to whom; this skill designs what files/tools/prompts wrap the model.
  • Deterministic scaffold beats one-shot LLM init. Inspect → plan → staged writes → manifest (harnessforge pattern); LLM fill is optional fallback only.
  • Blueprint validators that shell out are a trust boundary — document, never auto-run untrusted commands.

Output Format

Harness generation complete
Version: v0
Context: [library | consumer | legacy-gap-fill]
Manifest: docs/harness/manifest.json
Artifacts: [list paths]
Eval stub: docs/harness/eval-interface.md
Drift check: [documented command]
Next: [eval-pipeline | harness-evolution | project-setup]

Example

<examples> <example> <input>Generate a harness for this React monorepo — we have AGENTS.md from project-setup.</input> <output> Harness generation complete Version: v0 | Context: consumer Manifest: docs/harness/manifest.json (7 components, all generated) Merged: Skill Invocation + Orchestration Map preserved from interview Created: docs/harness/eval-interface.md, docs/harness/tasks.json (stub), docs/harness/governance.md Next: eval-rubric-design to define harness regression dimensions </output> </example> </examples>

Common Rationalizations

ExcuseReality
"AGENTS.md is enough"No manifest, eval stub, or governance = not a harness v0
"Skip eval stub for now"harness-evolution hard-fails without it
"Copy external harness README"Distill patterns; secure-scan; no URL embed
"Let LLM write the whole harness"Deterministic manifest + merge beats opaque generation
"Agent-builder already ran"Topology ≠ harness files — run both

Verification

  • docs/harness/manifest.json exists with 7 components and hashes
  • Eval interface stub + tasks.json shape present
  • AGENTS.md ≤150 lines; user content preserved on merge
  • Governance forbidden paths documented
  • SKILL-OUTPUTS.md appended

Red Flags

  • Harness v0 bloated with speculative prompts/tools
  • User-edited files overwritten without merge
  • No eval interface stub when evolution is planned
  • External SKILL.md vendored wholesale

Prune Log

Last pruned: 2026-07-05

  • Deep learn-from: scaffold-patterns L3 — drift CI, interface validation, AHE sandbox

Impact Report

Harness v0 generated: [context]
Manifest: docs/harness/manifest.json | Components: 7
Eval stub: [yes/no] | Merged AGENTS.md: [yes/no]
Files created: [count] | Next route: [skill]

Reference Files

  • references/component-manifest.md — seven components, JSON schema, ETCLOVG map
  • references/scaffold-patterns.md — inspect→render, drift CI, bootstrap snapshot
  • references/examples.md — library project + consumer repo worked examples

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Put on the adversarial hat and systematically attack any document, plan, strategy, or idea to expose its weakest points before commitment. Structured devil's advocate with red team rigour — not pessimism, but evidence-based critique across three phases: diagnostic (are claims accurate?), creative (is the problem artificially constrained?), challenge (are solutions robust?). Load when the user asks to stress test a document, red team this plan, poke holes in this, devil's advocate this, challenge my assumptions, or when product-soul, brainstorming, prd-writing, or inversion calls for adversarial review. Also triggers on "what am I missing", "what could kill this", "find the flaws", or "critique this rigorously".

日本語の概要は準備中です。原文の説明を表示しています。

dvy1987/agent-loom32026年8月8日 更新

Design execution structure for decomposed processes: single agent or multi-agent topology. Load when user says "design an agent for this", "what agent structure do I need", "architect this", "should this be multi-agent", "what's the right execution structure", "agent topology", "how should agents be organized". Takes process-decomposer output as primary input. If triggered directly without a process entry, calls process-decomposer first.

日本語の概要は準備中です。原文の説明を表示しています。

dvy1987/agent-loom32026年8月8日 更新

Internal skill. Called by setup-evaluation after a PASS. Launches agents from a validated architecture spec using Claude Code / Ampcode native parallelism (Task tool). Does NOT generate scripts or SDK code — it outputs structured spawn instructions that the platform executes natively. Never invoked directly by the user. Never launches without a setup-evaluation PASS.

日本語の概要は準備中です。原文の説明を表示しています。

dvy1987/agent-loom32026年8月8日 更新

Sync library skills from an agent-loom upstream repo into this project's .agents/skills while preserving project-local and forked skills. Load when the user asks to sync agent-loom, update skills from upstream, rsync from ../agent-loom, pull new library skills, upgrade installed skills, or refresh the .agents folder without losing custom project skills. Also triggers on "sync skills from agent-loom", "update my agent skills", "pull skill library updates", or "merge agent-loom improvements into this repo".

日本語の概要は準備中です。原文の説明を表示しています。

dvy1987/agent-loom32026年8月8日 更新

Instrument a shipped product's AI agents with tracing and observability so you can see what they did, why outputs happened, and what each run cost. Plain-language primer plus free-tier-first backend selection (Langfuse, Phoenix, LangSmith, Braintrust) and OpenTelemetry/OpenInference instrumentation. Load when the user asks to add observability, add tracing, instrument my agents, see what my agent is doing in production, set up Langfuse or Phoenix or LangSmith, debug why my agent gave a bad answer, or track LLM cost per request. Also fires when agent-system-architecture or setup-evaluation requires an observability plan for an agent-chain product. NOT for tracing the coding agent itself — that is run-trace. Precondition for runtime-learning-loop.

日本語の概要は準備中です。原文の説明を表示しています。

dvy1987/agent-loom32026年8月8日 更新

Run a structured retrospective after development-phase runs of your product's agents — interview the owner in plain language about what went well and poorly, draft ranked improvement hypotheses, then design and run small n=1/n=2 experiments with pre-declared success criteria, guardrails, stop conditions, and a cost/ROI kill-switch. Load when the user says how did that run go, retro this run, the agent output was bad, what should we improve, draft hypotheses, run a small experiment, or after repeated dev runs of an agentic system produce uneven quality. Priority: output quality over performance over cost, each with diminishing-returns stops. NOT a product A/B test (experimentation), NOT coding-agent harness repair (harness-evolution), NOT production-scale learning (runtime-learning-loop).

日本語の概要は準備中です。原文の説明を表示しています。

dvy1987/agent-loom32026年8月8日 更新

dvy1987 のスキルをすべて見る

このスキルの問題を報告する