ttnn

Convert PyTorch tensors and execute tensor operations on Tenstorrent MeshDevice topologies.

341|51|Updated Aug 22, 2024
One-click install
npx skills add https://github.com/tenstorrent/tt-forge --skill ttnn
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ttnn
Source: https://github.com/tenstorrent/tt-forge/tree/main/skills/ttnn
Command: npx skills add https://github.com/tenstorrent/tt-forge --skill ttnn

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

TTNN provides high-performance tensor primitives and device management on Tenstorrent hardware, enabling efficient ML workloads and model conversions.

Core Features & Use Cases

  • High-level TTNN APIs for tensor creation, manipulation, and movement across MeshDevice topologies.
  • Multi-device execution across MeshDevice topologies with memory configurations.
  • Model conversion utilities from PyTorch to TTNN compatible formats for accelerated inference.
  • Integration with TT-Metal stack for MLIR pipelines and TT kernels.

Quick Start

Initialize TTNN on a device, convert a PyTorch tensor to TTNN, and execute a simple tensor operation on a MeshDevice.

Frequently Asked Questions about ttnn

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a PyTorch model to TTNN for accelerated inference on Tenstorrent hardware?

To convert a PyTorch model to TTNN, use the provided model conversion utilities to transform PyTorch tensors into TTNN compatible formats for accelerated inference on Tenstorrent hardware.

What is a MeshDevice topology and how does TTNN handle multi-device execution?

A MeshDevice topology enables multi-device execution in TTNN by managing tensor operations and memory configurations across distributed Tenstorrent hardware for scalable ML workloads.

Do I need to understand the TT-Metal stack and MLIR pipelines to use TTNN APIs?

You need knowledge of the TT-Metal stack and MLIR pipelines to use TTNN APIs effectively, as TTNN integrates with TT-Metal for low-level tensor operations and TT kernels.

How do I initialize tensor operations and manage memory configurations in TTNN?

TTNN provides high-level APIs for tensor creation, manipulation, and movement across MeshDevice topologies, requiring specific memory configurations to manage execution on Tenstorrent hardware.

What is the best way to scale tensor operations across multiple Tenstorrent devices?

The best way to scale tensor operations is using TTNN's multi-device execution across MeshDevice topologies, which handles tensor movement and memory configurations for distributed ML workloads.