本文へ移動
cccskills
無料GitHub で公開

yolo-fb-gui-cli

YOLO + FB chooser (Frame B), Sapiens2 Pose, and GUI→CLI terminal mirror for vailá video-AI tools. Use when reopening Cursor CLI, wiring GUI buttons, printing copy-paste CLI from Tkinter runs, or continuing work on vaila.py yolotrackerpose / vaila_sam / vaila_sapiens / yolov26track / yolotrain.

インストール方法を見る

含まれるファイル(1)

  • SKILL.md6.9 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

YOLO + FB Chooser & GUI→CLI Mirror (v0.3.91)

Use when the user works on Frame B → YOLO + FB, wants terminal commands equivalent to GUI clicks, or resumes after closing the terminal in Cursor CLI.

Companion docs:

  • docs/vaila_buttons/yolo-fb.md — chooser table + launcher CLI
  • AGENTS.md § Conventions (GUI→CLI mirror) + § History (v0.3.72, v0.3.76)
  • docs/sessions/2026-07-06-yolo-fb-gui-cli-mirror.md — implementation log
  • docs/sessions/2026-07-07-sapiens-output-dir-fix.md — one processed_sapiens_* per run (v0.3.76)
  • .claude/skills/sam3-video/SKILL.md — SAM 3 specifics
  • vaila/help/vaila_sapiens.md — Sapiens2 Pose

Chooser (vaila.py yolotrackerpose)

Button: Frame B B4_r4_c1 — YOLO + FB (was “Video AI tools” / “YOLO + SAM”).

Each chooser button calls _print_yolo_fb_launch() before launching the tool:

Chooser buttonLauncher CLI
Tracker (v26)uv run python -u -m vaila.yolov26track
Pose (video)in-process yolov26track.run_yolov26pose_video from main GUI
Pose (tracking)uv run python -u -m vaila.yolov26track + GUI ID picker
Seg (v26)same as Tracker; pick -seg.pt + seg run mode
SAM 3 videouv run python -u vaila/vaila_sam.py
Sapiens2 Poseuv run python -u vaila/vaila_sapiens.py
SAM3+Sapiens2uv run python -u vaila/sam3sapiens2.py
SAM3+Sapiens2 Visualize IDuv run python -u vaila/sam3sapiens2_visualize.py
Train YOLOv26uv run python -u -m vaila.yolotrain

GUI→CLI mirror convention

Rule: any module with a CLI must print copy-paste commands on GUI Run.

  • Prefix: >> (not [bracketed] — absl from mediapipe/opencv eats bracketed stdout)
  • Chooser: launcher only (_print_yolo_fb_launch in vaila.py)
  • Run: full args after user confirms dialogs
  • Highlight (v0.3.103+): the printed banner is bold-yellow ANSI on an interactive TTY (plain text when redirected/piped or NO_COLOR is set), via the shared vaila/cli_highlight.py module — print_gui_cli_mirror(module_label, cli) for a single reproducible command (banner + >> header + command line), or highlight(text) to wrap an individual line when a module prints a multi-line hint block instead of one clean command (e.g. yolov26track.py's Pose workflow hints, getpixelvideo.py's STOP/READ warnings). Every module below imports one or both of these instead of hand-rolling its own ANSI/print formatting — don't reintroduce a local duplicate.
ModuleHelperWhen printed
vaila_sam.py_build_sam_cli_argv, _print_sam_equivalent_cli (→ print_gui_cli_mirror)SAM GUI Run
vaila_sapiens.py_format_sapiens_cli_command, _print_sapiens_equivalent_cli (→ print_gui_cli_mirror)Sapiens2 GUI Run
sam3sapiens2.py_format_gui_cli → print_gui_cli_mirrorSAM3+Sapiens2 GUI Run
sam3dinov3.py_format_gui_cli → print_gui_cli_mirrorSAM3+DINOv3 3D GUI Run
sapiens2_3d.py_format_gui_cli → print_gui_cli_mirrorSapiens2 3D Pose GUI Run
reid_markers.pyrun_geometric_merge callers → print_gui_cli_mirrorCLI main() and GUI merge dialog
markerless_2d_analysis.pyinline → print_gui_cli_mirrorBatch GUI Run
markerless2d_analysis_v2.pyinline → print_gui_cli_mirrormain() when -i/-o given
rec3d.pyinline → print_gui_cli_mirrorPreview + repeated after processing
rec3d_one_dlt3d.pyinline → print_gui_cli_mirrorPreview + repeated after processing
blender_viz.pyformat_blender_viz_cli → print_gui_cli_mirrorAnimation Blender button
vaila_deadlift_imu.py_format_cli_command → highlight() per lineRun-configuration summary
yolov26track.py_format_track_cli_command → highlight() per lineTracker GUI before video loop (one track per file)
yolov26track.py_print_pose_video_equivalent_cli → highlight() per linePose (video) after config dialog
yolov26track.py_print_pose_from_tracking_workflow_hint → highlight() per linePose (tracking) after dir pick
yolotrain.py_format_training_cli_command, _print_gui_stateStart Training + GUI open
getpixelvideo.py>> Equivalent CLI blocks → highlight() per blockLoad Tracking CSV / save hints

Adding mirror to a new GUI module

try:
    from .cli_highlight import print_gui_cli_mirror
except ImportError:
    from cli_highlight import print_gui_cli_mirror  # ty: ignore[unresolved-import]

import shlex

def _format_my_cli_command(input_path: str, output: str, *, flag: int) -> list[str]:
    return ["uv", "run", "vaila/my_module.py", "-i", input_path, "-o", output, "--flag", str(flag)]

def _print_equivalent_cli(...) -> None:
    print_gui_cli_mirror("vaila/my_module", _format_my_cli_command(...))

print_gui_cli_mirror accepts either an argv list[str] (joined via shlex.join) or an already-formatted command string. Call it after dialogs OK, before long work.


Sapiens2 Pose (v0.3.71+)

uv sync --extra sapiens
bash bin/setup_sapiens2.sh   # clones .local/third_party/sapiens2/ + HF weights
uv run vaila/vaila_sapiens.py -i VIDEO_OR_DIR -o OUT_PARENT --model 1b
  • Default model 1b (RTX 4090 24 GiB)
  • CUDA only; Meta Sapiens2 License
  • One processed_sapiens_<timestamp>/ per run (v0.3.76); per-video subdirs <timestamp>/<stem>/
  • Isolated workers receive --output-base from parent — no empty duplicate folder
  • GUI→CLI mirror prints only -o (not --output-base); CLI creates processed_sapiens_<ts>/ under -o
  • Tests: uv run pytest tests/test_vaila_sapiens.py -v

Quick QA after changes

uv run ruff check vaila/vaila_sapiens.py vaila/vaila_sam.py vaila/yolov26track.py vaila.py --fix
uv run ruff format vaila/
uv run pytest tests/test_vaila_sapiens.py tests/test_vaila_sam.py::test_build_sam_cli_argv_includes_prompt tests/test_yolov26track_pose_reid.py::test_format_track_cli_command_maps_config -v

Cursor CLI resume checklist

  1. cd ~/data/vaila && uv sync (add --extra sam / --extra sapiens, or --no-group cpu --group cuda for NVIDIA, as needed)
  2. Read AGENTS.md History § v0.3.76 (Sapiens2 output dir) and this skill
  3. Global version: 0.3.91 (vaila.py header)
  4. Never rename chooser back to “Video AI tools” in docs — use YOLO + FB
  5. Visualize ID: CLI --id N or omit --id for interactive prompt; GUI uses combobox after browsing the run dir. Overlay = SAM3 contour fill + Sapiens2 left/right skeleton colors.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Configures best-practice alerting policies for AI agents using OpenTelemetry (OTel) metrics, generating output as Terraform (.tf) configuration files. Use when analyzing, writing, or deploying alerting policies to monitor agent latency, error rates, token usage, and quality metrics. Don't use for standard infrastructure monitoring unrelated to AI agents, or when the agent is not instrumented with OpenTelemetry (for Reliability, Cost, Safety, Security alerts). NOTE: Reliability, Cost, Safety, and Security alerts use generic OTel metrics and work across runtimes (such as Cloud Run, Vertex AI). Quality alerts rely on Vertex AI Online Monitors and are strictly bound to Vertex AI deployments.

日本語の概要は準備中です。原文の説明を表示しています。

vaila-multimodaltoolbox/vaila192026年10月8日 更新

Deploy open models or custom weights from Model Garden to Agent Platform endpoints, check the status of an in-progress deployment operation, or clean up resources by undeploying models and deleting endpoints. Use when asked to actively deploy a model, list the Model Garden CATALOG of available models, check if a specific model is deployable (`gcloud ai model-garden models list-deployment-config`), query deployment cost, troubleshoot deployment errors (like quota limits), or undeploy/clean up endpoints. Also use when copying and deploying a 1P Tuned Model. Don't use for pure listing/discovery questions of the form "is X deployed?", "list my endpoints", or "which regions have models running?" — for those use `agent-platform-endpoint-management`. Don't use for public Vertex AI deployments (use the `vertex-deploy` skill) or for running model evaluations (use the `agent-platform-eval-flywheel` skill).

日本語の概要は準備中です。原文の説明を表示しています。

vaila-multimodaltoolbox/vaila192026年10月8日 更新

Manages Agent Platform serving endpoints. Use when you need to create, list, describe, update, or delete serving endpoints for model deployment on Agent Platform. Also use when troubleshooting endpoint permission, quota, or resource busy errors. Don't use for deploying models to endpoints or for running model evaluations.

日本語の概要は準備中です。原文の説明を表示しています。

vaila-multimodaltoolbox/vaila192026年10月8日 更新

Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy.

日本語の概要は準備中です。原文の説明を表示しています。

vaila-multimodaltoolbox/vaila192026年10月8日 更新

Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama, DeepSeek, Qwen, etc.). Use when asked to perform inference, ask a model a question, run a test prompt, execute chat completions, or generate code for calling Gemini or OpenMaaS models, authenticate with GenAI SDK, OpenAI SDK, or legacy Agent Platform SDK, configure base URLs and global/regional endpoints, or troubleshoot 429 Resource Exhausted (DSQ), 400 User Validation, or 404 Not Found errors. Don't use for deploying models to endpoints or for running model evaluations.

日本語の概要は準備中です。原文の説明を表示しています。

vaila-multimodaltoolbox/vaila192026年10月8日 更新

Guides agents and users through migrating from Gemini API in Google AI Studio to Gemini Enterprise Agent Platform (formerly Vertex AI). Use this skill when moving applications to Google Cloud, to leverage Cloud credits, or to unify inferencing with other Cloud infrastructure (IAM, billing, telemetry).

日本語の概要は準備中です。原文の説明を表示しています。

vaila-multimodaltoolbox/vaila192026年10月8日 更新

vaila-multimodaltoolbox のスキルをすべて見る

このスキルの問題を報告する