ds-supervised-modeling

Build, evaluate, and compare supervised machine learning models.

Updated Mar 8, 2026
One-click install
npx skills add https://github.com/Phife726/ds_agent --skill ds-supervised-modeling
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ds-supervised-modeling
Source: https://github.com/Phife726/ds_agent/tree/main/ds-supervised-modeling
Command: npx skills add https://github.com/Phife726/ds_agent --skill ds-supervised-modeling

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Streamline the end-to-end supervised learning workflow, from problem framing and algorithm selection to training, evaluation, interpretation, and deployment readiness.

Core Features & Use Cases

  • Algorithm selection framework for regression and classification tasks, with guidance on when to prefer linear models, tree ensembles, or heuristic approaches.
  • End-to-end workflow support: train/test splits, model training, cross-validation, evaluation, and interpretation.
  • Fairness auditing and bias checks to identify disparities across sensitive groups.
  • Model comparison and hyperparameter tuning to help choose the best performing model for a task.

Quick Start

Load a labeled dataset, split into train and test, train a baseline model, and evaluate its performance to establish a starting point.

Frequently Asked Questions about ds-supervised-modeling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose the right machine learning model for a classification or regression task?

Choosing the right supervised learning model requires an algorithm selection framework that evaluates whether linear models, tree ensembles, or heuristic approaches best fit your regression or classification task. You compare baseline models using cross-validation and metrics like accuracy, F1, or RMSE to identify the optimal performer.

What metrics do I need to evaluate supervised learning models effectively?

To evaluate supervised learning models effectively, you need appropriate metrics for your task: accuracy, F1, and AUC-ROC for classification, plus RMSE for regression. These metrics, combined with a proper train/test split and cross-validation, guide objective model selection and comparison.

How do I audit a machine learning model for fairness and bias?

Auditing a machine learning model for fairness involves performing fairness auditing and bias checks to identify performance disparities across sensitive groups. This process is integrated into the end-to-end supervised modeling workflow to ensure equitable outcomes before deployment.

What is the best way to start building a supervised learning model from a labeled dataset?

The best way to start building a supervised learning model is to load your labeled dataset, define the target variable, and split the data into train and test sets. Train a baseline model first, then evaluate its performance to establish a starting point for hyperparameter tuning.

Does hyperparameter tuning help with model selection across large datasets?

Hyperparameter tuning significantly helps with model selection across small to large datasets by optimizing algorithm parameters. It works alongside cross-validation and model comparison techniques to systematically identify and select the best performing model for your specific task.

When should I prioritize interpretability over complex tree ensembles in supervised learning?

You should prioritize interpretability over complex tree ensembles when problem framing demands transparent decision logic or when fairness auditing requires clear explanations of model behavior. Linear models often provide better interpretability while still delivering reliable performance for regression and classification tasks.