tinker-sdk

Manage ML workflows via HTTP APIs, CLI and SDKs.

4.0k|507|Updated Jul 14, 2025
One-click install
npx skills add https://github.com/thinking-machines-lab/tinker-cookbook --skill tinker-sdk
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: tinker-sdk
Source: https://github.com/thinking-machines-lab/tinker-cookbook/tree/main/.claude/skills/tinker-sdk
Command: npx skills add https://github.com/thinking-machines-lab/tinker-cookbook --skill tinker-sdk

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The Tinker SDK provides a unified, Python-based interface to manage training, sampling, and REST interactions for fine-tuning LLMs, reducing boilerplate and integration effort.

Core Features & Use Cases

  • Unified API set: ServiceClient, TrainingClient, SamplingClient, and RestClient to cover end-to-end workflows.
  • Async-friendly patterns: futures and awaitable calls to overlap computation and IO for scalable experimentation.
  • Use cases include starting new training runs, resuming from checkpoints, generating samples, and managing deployments.

Quick Start

Instantiate a ServiceClient and create a TrainingClient to start a fine-tuning workflow on your base model.

Frequently Asked Questions about tinker-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up an async LLM fine-tuning pipeline?

To set up an async LLM fine-tuning pipeline, instantiate a ServiceClient, then create a TrainingClient to manage workflows. The SDK uses futures and awaitable async patterns to overlap computation and IO for scalable experimentation.

What is the best way to generate samples from a fine-tuned model?

To generate samples from a fine-tuned model, create a SamplingClient via the Tinker SDK. This client manages sampling workflows asynchronously, allowing you to retrieve generated text outputs efficiently after training.

Can I resume a training run from a checkpoint?

Yes, you can resume training runs from checkpoints. The TrainingClient within the Tinker SDK supports resuming workflows, allowing you to continue fine-tuning your base model from a previously saved state without restarting.

Does the Tinker SDK support REST interactions for managing deployments?

Yes, the Tinker SDK supports REST interactions for managing deployments through the RestClient. It provides a unified Python interface to handle REST API calls, reducing boilerplate when integrating deployment management into your workflows.

Why use async patterns for LLM fine-tuning and sampling?

Async patterns for LLM fine-tuning and sampling are used to overlap computation and IO operations. This async-friendly approach enables scalable experimentation by preventing resources from blocking during long-running training or sampling tasks.

What clients are needed for an end-to-end LLM fine-tuning workflow?

An end-to-end LLM fine-tuning workflow requires ServiceClient, TrainingClient, SamplingClient, and RestClient. These unified API clients cover starting training runs, resuming checkpoints, generating samples, and managing deployments.