robotwin-instruction-to-env

Transforms a user task name and description into a RoboTwin environment and renders the first deterministic frame to verify usability.

Updated Mar 8, 2026
One-click install
npx skills add https://github.com/Geuan666/skills-robotwin --skill robotwin-instruction-to-env
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: robotwin-instruction-to-env
Source: https://github.com/Geuan666/skills-robotwin/tree/main/robotwin-instruction-to-env
Command: npx skills add https://github.com/Geuan666/skills-robotwin --skill robotwin-instruction-to-env

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill turns a task name and task description into a RoboTwin environment, then renders and checks the first frame so the result is directly usable. It inspects the local repo, reuses nearby env and asset patterns, writes conservative scene setup code, and iterates until the frame is reasonable. It now also uses local asset pose priors so default orientations are grounded instead of guessed.

Core Features & Use Cases

  • Normalize the user request into concrete scene requirements, including task name, task description, main objects, supports, containers, layout relations, embodiment constraints, camera/background constraints, and safe defaults for anything unspecified.
  • Discover the target RoboTwin-like repo and validate compatibility, reuse nearby env patterns, load pose priors, generate envs/<task>.py, render the first frame, and review against a first-frame checklist.
  • Render and validate a deterministic first frame using the repo's render path, with guidance from local pose manuals and repository conventions to ensure a stable initialization for downstream testing or demonstrations.

Quick Start

Provide a task name and description; the skill will build a RoboTwin env and render the first frame.

Frequently Asked Questions about robotwin-instruction-to-env

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a RoboTwin environment from a task description?

To generate a RoboTwin environment from a task description, provide a task name and brief to normalize scene requirements, write conservative setup code, and render a deterministic first frame. The process reuses nearby env patterns and local pose priors to ensure valid default orientations.

What is first-frame rendering for robot simulation tasks?

First-frame rendering for robot simulation tasks validates generated environment code by producing a deterministic initial scene image. It uses the repository's render path and local pose manuals to verify layout relations, camera constraints, and safe defaults before downstream testing.

How does repo discovery work when creating robot simulation environments?

Repo discovery for robot simulation environments inspects the local repository structure to validate compatibility and reuse nearby env patterns. It loads local asset pose priors to ground default orientations, ensuring the generated envs/<task>.py file follows existing conventions.

Can I use local asset pose priors to set default orientations in RoboTwin?

Yes, you can use local asset pose priors to set default orientations in RoboTwin. The skill loads these local pose manuals to ground object placements instead of guessing, ensuring stable initialization for downstream testing or demonstrations.

What are the limitations of instruction-driven scene creation for RoboTwin?

The limitation of instruction-driven scene creation for RoboTwin is its strict dependency on a specific local repo layout. Without the required envs/, task_config/, references/ directories and a render path, the skill cannot validate generated frames or guarantee safe defaults.