← Back to the latest

Open sourceSep 10, 2026Entry № 323

Daxiao Robotics, Shanghai AI Laboratory and NTU S-Lab Release HSImul3R, a Simulation-Ready Human–Scene Interaction Reconstruction Framework


HSImul3R, a human–scene interaction reconstruction framework from Daxiao Robotics, Nanyang Technological University S-Lab, and Shanghai AI Laboratory, targets uncalibrated sparse-view input and produces simulation-ready scenes. The paper, accepted at ECCV 2026, describes a closed-loop optimization combining reinforcement learning for the scene with direct simulation-reward optimization, then transfers the refined motion to a Unitree G1 humanoid. On HSIBench, interaction stability reaches 53.68%, 30.56%, and 13.92% across three task tiers, while interpenetration drops from 69.51% to 22.90%. Code and paper are public; license was not stated.

Original sources (Chinese)

全球首个可仿真的人–场景交互重建框架 HSImul3R:让人类视频真正成为机器人技能来源qbitai