tao-train-grounding-dino

Automate Grounding DINO training, evaluation, and ONNX export with PyTorch.

83|20|Updated Apr 16, 2026
One-click install
npx skills add https://github.com/NVIDIA-TAO/tao-skill-bank --skill tao-train-grounding-dino
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: tao-train-grounding-dino
Source: https://github.com/NVIDIA-TAO/tao-skill-bank/tree/main/skills/models/tao-train-grounding-dino
Command: npx skills add https://github.com/NVIDIA-TAO/tao-skill-bank --skill tao-train-grounding-dino

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires torch, torchvision, torchaudio, onnx, torchscript, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill streamlines the process of training and deploying the Grounding DINO model for open-set object detection, providing a framework for efficient model development and inference.

Core Features & Use Cases

  • Training Support: Facilitates the training process of the Grounding DINO model, allowing for parameter tuning, dataset preparation, and monitoring.
  • Deployment Options: Enables the deployment of the trained model for inference and evaluation using various formats like ONNX.
  • Use Case: Imagine you need to develop an open-set object detection model that can identify objects from a diverse set of images without predefined classes. Use this Skill to train your model with a combination of visual and textual information.

Quick Start

Train a Grounding DINO model using the 'train' action with the following parameters:

tao-skill-bank train my_grounding_dino_model --dataset.train_data_sources.image_dir /path/to/train_images --dataset.val_data_sources.image_dir /path/to/val_images --train.num_epochs 10

Frequently Asked Questions about tao-train-grounding-dino

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train an open-set object detection model using PyTorch?

To train an open-set object detection model using PyTorch, you can configure and run the Grounding DINO training process by specifying your image directories and epoch count. This automates parameter tuning, dataset preparation, and monitoring for your custom visual and textual data.

What is open-set object detection and when do I need Grounding DINO?

Open-set object detection identifies objects from a diverse set of images without needing predefined classes. You need Grounding DINO when your model must combine visual and textual information to detect dynamic or unseen objects during inference.

Do I need Docker and NVIDIA Container Toolkit to run Grounding DINO training?

Yes, you need Docker and the NVIDIA Container Toolkit to run Grounding DINO training. This environment setup is required to execute the deep learning framework and handle the underlying PyTorch and ONNX dependencies for model development.

How do I export a trained Grounding DINO model to ONNX for inference?

You can export a trained Grounding DINO model to ONNX for inference by using the deployment options provided in the framework. This handles the model configuration and evaluation, outputting the ONNX file for your open-set object detection deployment.

Can I use TorchScript to deploy my open-set object detection model?

Yes, TorchScript is supported as a dependency for deploying your open-set object detection model. Alongside ONNX, you can utilize TorchScript to export your trained Grounding DINO model for efficient inference and evaluation.