Skip to main content
Stage 2 · Chapter 6 · Build Your Robot Lab

6. Build Your Robot Lab

Assemble your hardware, standardize the task environment, and establish your control loops — with strict consistency between the digital twin and the physical world.

Scope of This Module​

Theory to practice

Scope of This Module

In this module, you will learn how to transition from theory to physical execution by assembling your hardware, standardizing your task environment, and establishing your control loops. Building an embodied-AI pipeline requires strict kinematic and visual consistency between the digital twin (simulation) and the physical world.

Specifically, you will unbox or assemble the SO-ARM101 pair, write servo IDs (kit version only — pre-built arms skip this), and perform the critical joint calibration to ensure precise real-world tracking. You will then construct a standardized light-controlled workspace — the studio — with camera brackets and fixed prop positions that match the visual assets used in Isaac Sim. Finally, you will master direct hardware teleoperation, the operational mode that real-world data collection relies on.

The Software Environment​

Install once

The Software Environment

The module assumes the LeRobot environment is ready. Chapter 7 walks through it step by step (uv, Python 3.12, the Seeed LeRobot fork with SO-101 support, and the Feetech SDK), and every later chapter reuses it.

If you would rather have an AI assistant install everything, the project repository ships a machine-readable setup skill:

skills/install-soarm-env.md in github.com/yuyoujiang/rebot-arm-dli-isaacsim

Copy the whole file to your AI assistant (Claude, ChatGPT, etc.) and ask it to run the steps. It contains every command in executable order, the expected output of each verification step, and a troubleshooting table (missing scservo_sdk, serial permissions, GPU freezes, UDP port collisions).

Chapters in This Module​

Two chapters

Chapters in This Module

  1. Chapter 7 — Prepare the Robot Arm: servo IDs, calibration, and the first teleoperation;
  2. Chapter 8 — Building the Workspace: lightbox, camera brackets, prop positions, and cameras.
Loading Comments...