hpo

Run Bayesian hyperparameter optimization for LightGBM, XGBoost, and CatBoost models with Optuna.

Updated Feb 24, 2026
One-click install
npx skills add https://github.com/KameniAlexNea/gladius-agent --skill hpo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hpo
Source: https://github.com/KameniAlexNea/gladius-agent/tree/main/gladius/utils/templates/skills/hpo
Command: npx skills add https://github.com/KameniAlexNea/gladius-agent --skill hpo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires optuna, lightgbm, xgboost, catboost, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the process of finding the optimal hyperparameters for machine learning models, saving significant manual effort and computational resources.

Core Features & Use Cases

  • Bayesian Optimization: Leverages Optuna's TPE sampler for efficient hyperparameter search.
  • Fold-Level Pruning: Implements MedianPruner to cut off unpromising trials early, saving compute.
  • Model Support: Provides templates for LightGBM, XGBoost, and CatBoost.
  • Persistence: Saves results to SQLite, allowing interrupted searches to be resumed.
  • Use Case: After establishing a competitive baseline model, use this Skill to fine-tune its hyperparameters to achieve the best possible performance on your dataset.

Quick Start

Run the hyperparameter optimization script for LightGBM using your data.

Frequently Asked Questions about hpo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate hyperparameter tuning for XGBoost and LightGBM models?

Automate hyperparameter tuning for XGBoost and LightGBM by applying Optuna's Bayesian optimization with TPE sampling. This process searches for optimal parameters to improve model performance and uses fold-level pruning to save computational resources.

What is Bayesian hyperparameter optimization and when should I use it for gradient boosting?

Bayesian hyperparameter optimization uses past trial results to intelligently sample the next parameters, making it more efficient than random search. Use it for gradient boosting models like LightGBM, XGBoost, and CatBoost to achieve peak performance after establishing a baseline.

Can I resume an interrupted hyperparameter search if my training process crashes?

Yes, you can resume an interrupted hyperparameter search because the optimization results are saved to an SQLite database. This persistence mechanism allows you to stop and restart the Optuna study without losing previous trial data.

Do I need to install Optuna and CatBoost libraries separately before tuning?

Yes, you must install Optuna, LightGBM, XGBoost, and CatBoost libraries separately before execution. These dependencies are required for the Skill to run the hyperparameter search templates and train the corresponding gradient boosting models.

How does fold-level pruning improve hyperparameter search efficiency?

Fold-level pruning improves search efficiency by using Optuna's MedianPruner to terminate unpromising training trials early. This cuts off evaluations that are unlikely to beat the current best score, significantly saving compute time during optimization.