fine-tuning-serving-openpi

Fine-tune and serve OpenPI robot policy models across ALOHA, DROID, and LIBERO.

6|3|Updated Jan 29, 2026
One-click install
npx skills add https://github.com/jonnabio/ace-framework --skill fine-tuning-serving-openpi-jonnabio
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: fine-tuning-serving-openpi
Source: https://github.com/jonnabio/ace-framework/tree/main/.ace/packs/ai-research/openpi
Command: npx skills add https://github.com/jonnabio/ace-framework --skill fine-tuning-serving-openpi-jonnabio

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires uv>=0.4.0, jax>=0.4.30, torch>=2.1.0, transformers>=4.53.2, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill addresses the challenge of fine-tuning and serving Physical Intelligence's OpenPI models (pi0, pi0-fast, pi0.5) for robot policy inference across ALOHA, DROID, and LIBERO environments.

Core Features & Use Cases

  • Fine-Tuning Models: Adapt pi0 models to custom datasets using JAX or PyTorch backends.
  • Policy Serving: Run policy inference servers for real-time control.
  • Checkpoint Conversion: Convert JAX checkpoints to PyTorch for deployment.
  • Debugging Tools: Includes tools for norm stats and GPU memory issues.
  • Use Case: For a team working on robot manipulation tasks, this Skill can streamline the process of customizing and deploying robot policies.

Quick Start

To serve a pretrained policy, follow these steps:

git clone --recurse-submodules https://github.com/Physical-Intelligence/openpi.git
cd openpi
GIT_LFS_SKIP_SMUDGE=1 uv sync
GIT_LFS_SKIP_SMUDGE=1 uv pip install -e .
uv run scripts/serve_policy.py --env DROID

Frequently Asked Questions about fine-tuning-serving-openpi

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fine-tune OpenPI robot policy models for custom datasets?

Fine-tune OpenPI robot policy models by adapting pi0 architectures to custom datasets using JAX or PyTorch backends. The Skill handles model adaptation for ALOHA, DROID, and LIBERO environments, streamlining customization for robot manipulation tasks.

Can I convert JAX checkpoints to PyTorch for robot policy inference?

Yes, checkpoint conversion from JAX to PyTorch is supported for deployment. The Skill handles converting JAX checkpoints to PyTorch format, enabling flexible deployment of Physical Intelligence OpenPI models across different frameworks.

What environments does OpenPI policy inference support for robot manipulation?

OpenPI policy inference supports ALOHA, DROID, and LIBERO environments for robot manipulation tasks. The Skill handles model adaptation and deployment across these specific environments using JAX or PyTorch backends.

Do I need both JAX and PyTorch to serve OpenPI robot policies?

No, you can use either JAX or PyTorch to fine-tune and serve OpenPI robot policies. The Skill requires uv>=0.4.0, JAX>=0.4.30 or PyTorch>=2.1.0, along with transformers>=4.53.2 for operation.

How do I run a policy inference server for real-time robot control?

Run a policy inference server for real-time control using the serve_policy.py script. After cloning the OpenPI repository and installing dependencies with uv, execute the script with the desired environment parameter like DROID.

What tools are available for debugging GPU memory issues during model fine-tuning?

Debugging tools for norm stats and GPU memory issues are included with the Skill. These tools help troubleshoot common problems encountered during OpenPI model fine-tuning and policy inference operations.