What problem does it solve?
Monitoring long-running experiments can be slow and confusing, making it hard to know whether training is progressing, finished successfully, or produced usable outputs.
Core Features & Use Cases
- Progress verification across compute backends: checks running sessions via SSH screen sessions, Vast.ai instances, and Modal app status/logs.
- Result collection and validation: retrieves the latest screen logs and inspects results directories for JSON outputs to present concrete numbers.
- Metric enrichment with W&B (optional): when enabled, pulls training/eval curves and final summaries from Weights & Biases and links to the run dashboard.
- Decision-ready reporting: summarizes results in a comparison table and interprets deltas versus the correct baseline; can also send a Feishu notification if configured.
Use case: You launched multiple experiments on a remote GPU host and want a single consolidated status update with the latest metrics and an interpretation of what changed versus the baseline.
Quick Start
Ask the assistant to monitor-experiment while passing the server alias or screen-name to check current status and collect the latest results.