本文へ移動
cccskills
無料GitHub で公開

audit-documentation-drift

Audit documentation claims against implementation and authoritative repository evidence. Use when checking whether README, architecture, configuration, API, usage, or feature documentation is stale, incomplete, contradicted by code, missing implemented behavior, or inconsistent with a normative contract.

インストール方法を見る

含まれるファイル(3)

  • SKILL.md6.2 KB
  • evals/evals.json1.6 KB
  • SKILL-GOALS.md554 B

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Audit Documentation Drift

Determine whether documentation still describes the system it governs. Treat drift as claim conformance: identify a documentation claim, identify the authoritative evidence governing or implementing it, compare them in the applicable revision/scope, and report only demonstrated disconnects.

Inputs and operating mode

Resolve the audited project/component, documentation surface, revision/branch, and material environment variants from the request. Ask only for missing scope that could change the audit result.

Audit read-only. Do not repair documentation or implementation unless a separate instruction explicitly requests repair after the audit.

Resolve scope and authority

  1. Discover only documentation and implementation artifacts capable of establishing the requested claims. Do not inventory every file merely because it exists.
  2. Distinguish artifact roles:
    • normative/contract documentation — specifies intended behavior;
    • descriptive documentation — describes current implementation;
    • planning/history — records proposed or past behavior;
    • generated/derived documentation — inherits from a source/generator contract;
    • implementation/tests/configuration — observed behavior evidence, not automatically intent.
  3. Record unresolved authority instead of assuming code always wins. An unambiguous normative requirement contradicted by implementation is implementation nonconformance, not documentation drift.

Extract testable claims

Extract claims whose truth can materially affect a user or maintainer:

  • supported features and public behavior;
  • commands, arguments, APIs, configuration keys/defaults and environment variables;
  • architecture responsibilities and data flows;
  • setup/operational procedures;
  • compatibility/version/platform statements;
  • executable examples.

For CLI/config-heavy systems, inspect the framework actually used (for example Typer/Click decorators, parser/schema definitions, Pydantic models, constants) rather than relying on language-specific grep recipes.

Ignore private/internal symbols unless the documentation's established purpose requires exposing them.

Compare claims with evidence

For each material claim:

  1. Record the documentation source and scope.
  2. Identify what evidence would support or falsify it.
  3. Inspect the strongest practical implementation/contract evidence.
  4. Execute a safe focused check when static evidence cannot distinguish possibilities.
  5. Use git history only when chronology, regression origin, or stale-revision explanation can change or locate the finding.
  6. Separate OBSERVED evidence from DERIVED conclusions.

Do not infer drift because code changed in commits that did not touch documentation. A drift window exists only when a documented claim demonstrably became false or incomplete.

Classify demonstrated disconnects

  • DOCUMENTED_NOT_IMPLEMENTED — descriptive docs claim behavior the audited implementation does not provide.
  • IMPLEMENTED_NOT_DOCUMENTED — public/user-relevant implemented behavior is absent from documentation whose established scope should cover it.
  • OUTDATED — documentation describes an older observed behavior rather than the audited revision.
  • MISMATCHED_DETAIL — docs and implementation disagree on a material parameter, name, default, path, sequence, or constraint.
  • IMPLEMENTATION_NONCONFORMANCE — authoritative normative documentation is unambiguous and implementation violates it.
  • UNCERTAIN — evidence, authority, scope, or environment cannot resolve the claim.

Evidence contract

Each finding records:

  • documentation claim and precise location;
  • implementation/contract evidence and precise location;
  • audited revision or commit when material;
  • classification;
  • concrete consequence;
  • correction surface: documentation, implementation, generator/source, or authority decision;
  • confidence/evidence gap where unresolved.

Use line numbers when stable and useful. Use commit SHAs when revision identity or chronology matters. Quote only enough source text to establish the discrepancy.

Prioritize by consequence

Do not map category mechanically to severity. Assess the specific consequence:

  • safety/security/data-loss or incompatible public contract;
  • commands/config/API guidance causing failed or incorrect execution;
  • architecture/operational guidance capable of producing materially wrong changes;
  • discoverability gaps for user-relevant capabilities;
  • minor descriptive inconsistency.

State why the consequence earns its priority.

Report structure

Produce:

# Documentation Drift Audit Report

## Scope
- Project/component:
- Revision:
- Environments/variants:
- Documentation inspected:
- Implementation/contract evidence inspected:

## Findings
### <finding>
- Classification:
- Consequence:
- Documentation:
- Evidence:
- Analysis:
- Correction surface:

## Unresolved Coverage / Evidence
<items that prevent a stronger conclusion>

## Optional Timeline
<include only when chronology materially explains or locates drift>

Counts may summarize demonstrated findings but are not a quality score.

Boundaries

  • Do not assume project structure, documentation scope, or authority without evidence.
  • Do not treat planning/TODO material as current implementation claims.
  • Do not treat tests as infallible intent.
  • Do not report generated-file drift without resolving the source/generator relationship.
  • Do not manufacture undocumented-feature findings from private implementation details.
  • Do not run broad git archaeology when current-state comparison resolves the question.
  • Do not make a correction recommendation without identifying which authoritative surface is wrong or unresolved.
  • Leave persistence, artifact registration, orchestration status, and caller-specific return envelopes to the caller; they are not part of documentation-drift analysis.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Add automated documentation updater to any Claude skill. Creates a Python sync script that downloads upstream docs, processes markdown for AI consumption, and maintains local cache with configurable refresh. Collects template variables, then delegates implementation through 5-phase workflow. Use when adding auto-updating reference documentation to plugins or skills.

日本語の概要は準備中です。原文の説明を表示しています。

Jamie-BitFlight/claude_skills672026年10月9日 更新

SAM-style feature initiation workflow — discovery through codebase analysis, architecture spec, task decomposition, validation, and context manifest. Use when a user asks to add a feature, plan a feature, or convert an idea into an executable SAM plan.

日本語の概要は準備中です。原文の説明を表示しています。

Jamie-BitFlight/claude_skills672026年10月9日 更新

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a button", "take a screenshot", "scrape data from a page", "test this web app", "login to a site", "automate browser actions", or any task requiring programmatic web interaction.

日本語の概要は準備中です。原文の説明を表示しています。

Jamie-BitFlight/claude_skills672026年10月9日 更新

Browser automation for AI agents using the agent-browser CLI and Playwright. Use when navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, logging into sites, or automating any browser task. Triggers on "open a website", "fill out a form", "click a button", "scrape data", "test this web app", "automate browser actions", or any programmatic web interaction request.

日本語の概要は準備中です。原文の説明を表示しています。

Jamie-BitFlight/claude_skills672026年10月9日 更新

Runs the description-drift experiment — spawns all Claude Code agents simultaneously to collect self-reported capabilities, then compares them against static frontmatter descriptions to reveal how reliable orchestrator routing based on descriptions actually is. Use when measuring description drift across the agent fleet, re-running the capability collection experiment, analyzing a specific agent's self-reported capabilities, or auditing whether frontmatter descriptions accurately reflect agent behavior.

日本語の概要は準備中です。原文の説明を表示しています。

Jamie-BitFlight/claude_skills672026年10月9日 更新

Create or adapt Claude Code agent definitions. Use when creating an agent, changing subagent configuration, selecting agent scope, or designing a specialized delegation role.

日本語の概要は準備中です。原文の説明を表示しています。

Jamie-BitFlight/claude_skills672026年10月9日 更新

Jamie-BitFlight のスキルをすべて見る

このスキルの問題を報告する