本文へ移動
cccskills
無料GitHub で公開

forecast-experiment

Records hypotheses, evidence and decisions when proposing, running or evaluating forecast experiments, including backtests and feature or model comparisons. Excludes routine tests and unchanged forecast operation.

インストール方法を見る

含まれるファイル(1)

  • SKILL.md2.0 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Forecast experiments

Read the evaluation contract and point-in-time contract before designing a comparison.

Before execution

Save a proposal with the MLflow experiment record before launching the run. Record:

  • The hypothesis and intended change.
  • Motivating experiment IDs and prior results inspected; use none for the first baseline.
  • The comparison baseline, fixed evaluation dates and metrics, and what result would support the hypothesis.

Use saved artifacts for the proposal and conclusion, and tags for related experiment/run IDs. Link execution runs for folds, variants and retries to the research record; distinguish these from experiments that motivated the idea. If proposing only, save the proposal without launching work.

During execution

Link the exact run manifests for inputs, code, environment, configuration and seeds; do not copy their contents into prose. Retain failed and interrupted attempts with their status. Preserve the original proposal; start a linked experiment when the hypothesis or evaluation protocol changes.

After execution

Append the results, evidence links, limitations, conclusion and next decision: keep, reject or investigate further. Compare against the baseline on matching evaluation rows. Record losses and failures as well as gains. If reviewing an existing run without a prior proposal, mark the rationale as retrospective; do not invent a pre-run hypothesis.

Identify evaluation periods whose results informed experiment choices as development data, not untouched holdouts. Keep experiment history in MLflow; put durable accepted design decisions in the wiki with experiment IDs. Follow this procedure manually when automation is absent.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

gh

無料

Diagnose GitHub CLI hiccups caused by Codex sandbox constraints; not a general GitHub workflow.

日本語の概要は準備中です。原文の説明を表示しています。

zoltanmaric/coppersushi692026年10月10日 更新

goldfish

無料

Review a design artifact (spec, plan, PR packet) with fresh, memoryless subagents. Invoke when the user asks — "goldfish this", "fresh eyes", "tear this apart" — or after suggesting it for a spec that has grown load-bearing and the user agrees.

日本語の概要は準備中です。原文の説明を表示しています。

zoltanmaric/coppersushi692026年10月10日 更新

grill

無料

Interrogate the user before implementing a non-trivial or ambiguous ask, converging on shared intent. Use when the user says "grill me", when an ask admits multiple interpretations, or before any sizable piece of work whose intent isn't fully clear.

日本語の概要は準備中です。原文の説明を表示しています。

zoltanmaric/coppersushi692026年10月10日 更新

Launches and supervises long-running commands — solves, workflows, downloads, builds — detached with a log, PID and exit sentinel, then tells stuck from slow and kills verifiably. Use before running anything that may exceed a minute, for nohup or background launches, and when a run hangs, shows no output, or timed out.

日本語の概要は準備中です。原文の説明を表示しています。

zoltanmaric/coppersushi692026年10月10日 更新

llm-wiki

無料

Build and maintain a persistent, LLM-maintained markdown wiki following Andrej Karpathy's LLM Wiki pattern — the agent incrementally compiles raw sources into an interlinked knowledge base instead of re-deriving answers from scratch. Use this whenever the user wants to ingest a source (an article, paper, transcript, chapter, meeting notes), file knowledge or conversation findings into the wiki, query the accumulated knowledge base, lint or health-check the wiki, or mentions "the wiki", "knowledge base", "ingest this", "file this", "what do we know about X", or accumulating notes on a topic over time — even if they don't say "LLM Wiki" explicitly.

日本語の概要は準備中です。原文の説明を表示しています。

zoltanmaric/coppersushi692026年10月10日 更新

mermaid

無料

Guides writing and editing Mermaid diagrams in GitHub-rendered Markdown so they remain readable across themes and preserve placeholder labels.

日本語の概要は準備中です。原文の説明を表示しています。

zoltanmaric/coppersushi692026年10月10日 更新

zoltanmaric のスキルをすべて見る

このスキルの問題を報告する