longds-bench

Evaluate agent multi-turn data analysis skills using the LongDS-Bench benchmark.

128|12|Updated May 21, 2025
One-click install
npx skills add https://github.com/zjunlp/DataMind --skill longds-bench
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: longds-bench
Source: https://github.com/zjunlp/DataMind/tree/main/longds/runners/agent_agnostic/longds_bench
Command: npx skills add https://github.com/zjunlp/DataMind --skill longds-bench

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill provides a platform for self-evaluating an agent's multi-turn data analysis capabilities using the LongDS-Bench benchmark.

Core Features & Use Cases

  • Self-Evaluation: Run and score an agent on the LongDS-Bench benchmark without using DSGym's Docker executor.
  • Agent-Agnostic: Suitable for any harness with a shell/code-execution tool.
  • Use Case: For researchers and developers aiming to assess the performance of their data analysis agents on a standardized benchmark.

Quick Start

Run the longds-bench skill to evaluate your agent's performance on the LongDS-Bench benchmark.

Frequently Asked Questions about longds-bench

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate my agent's multi-turn data analysis skills?

To evaluate multi-turn data analysis skills, you can use the LongDS-Bench benchmark to score your agent's performance. This skill provides a standardized platform for researchers to assess agent capabilities without needing Docker.

What is the LongDS-Bench benchmark used for in agent evaluation?

The LongDS-Bench benchmark is used for self-evaluating an agent's multi-turn data analysis capabilities. It applies to agent development workflows and provides a standardized dataset to score performance.

Do I need Docker to run multi-turn data analysis benchmarks?

No, you do not need Docker to run this multi-turn data analysis benchmark. The skill allows you to run and score your agent locally without using DSGym's Docker executor, simplifying the evaluation process.

Can I evaluate any custom agent harness for data analysis?

Yes, you can evaluate any custom agent harness for data analysis. The benchmark is agent-agnostic and suitable for any harness that includes a shell or code-execution tool for running the scripts.

What environment is required to run LongDS-Bench evaluation scripts?

To run the LongDS-Bench evaluation scripts, you need Python installed for script execution and a local LongDS dataset. Your agent must also have a shell or code-execution tool available.

How do I score an agent on standardized data analysis tasks?

To score an agent on standardized data analysis tasks, run the skill to evaluate your agent's performance on the LongDS-Bench benchmark. It applies the benchmark scripts to assess multi-turn capabilities.