trt-strong-typing-migration

Automate TensorRT build migration from weak to strong typing for Python networks.

13.2k|2.4k|Updated May 2, 2019
One-click install
npx skills add https://github.com/NVIDIA/TensorRT --skill trt-strong-typing-migration
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: trt-strong-typing-migration
Source: https://github.com/NVIDIA/TensorRT/tree/main/.agents/skills/trt-strong-typing-migration
Command: npx skills add https://github.com/NVIDIA/TensorRT --skill trt-strong-typing-migration

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of migrating TensorRT builds from weak to strong typing, ensuring compatibility with the latest TensorRT versions.

Core Features & Use Cases

  • Weak to Strong Typing Conversion: Automate the transformation of weakly-typed builds to strongly-typed networks.
  • AutoCast for ONNX Files: Provides AutoCast functionality for ONNX files to support mixed precision.
  • Rebuilding and Validating: Ensures engines are rebuilt correctly and validated against baseline results.

Quick Start

Use the 'trt-strong-typing-migration' skill to migrate a weakly-typed Python network definition to a strongly-typed one.

Frequently Asked Questions about trt-strong-typing-migration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate TensorRT builds from weak to strong typing?

Migrating TensorRT builds from weak to strong typing involves automating the transformation of weakly-typed Python network definitions into strongly-typed networks. This ensures compatibility with TensorRT 10.12 and later versions while validating new builds against baseline outputs.

What is ONNX AutoCast for mixed precision in TensorRT?

ONNX AutoCast is a functionality that provides AutoCast support for ONNX files to enable mixed precision. It is used during the migration to strongly-typed networks to streamline TensorRT builds and ensure engines are rebuilt correctly.

Does TensorRT 10.12 require strongly-typed network definitions?

TensorRT 10.12 and later versions require strongly-typed network definitions for compatibility. Migrating from weak to strong typing ensures your Python network definitions function correctly and allows for proper engine rebuilding and validation.

How do I validate TensorRT engines after migrating to strong typing?

To validate TensorRT engines after migrating to strong typing, the migration process automatically validates the newly rebuilt engines against baseline results. This ensures the strongly-typed networks produce correct outputs before deployment.

Can I convert an existing Python network definition to a strongly-typed network?

Yes, you can convert an existing weakly-typed Python network definition to a strongly-typed network. The migration automates this conversion process, handling the network transformation and rebuilding to support the latest TensorRT versions.