OmniH2O: Revolutionizing Humanoid Teleoperation

OmniH2O, a groundbreaking system, offers a universal interface for whole-body humanoid teleoperation and autonomy. By leveraging kinematic pose control, users can operate humanoids in real-time through VR, verbal instructions, and RGB cameras. The system also supports autonomous operations by learning from demonstrations and integrating advanced models like GPT-4. OmniH2O showcases its versatility in performing complex tasks such as sports and object manipulation. A significant release is the OmniH2O-6 dataset, which facilitates the training of humanoid skills from teleoperated datasets.