Soft Contact Simulation and Manipulation Learning of Deformable Objects with Vision-based Tactile Sensor
arxiv(2024)
摘要
Deformable object manipulation is a classical and challenging research area
in robotics. Compared with rigid object manipulation, this problem is more
complex due to the deformation properties including elastic, plastic, and
elastoplastic deformation. In this paper, we describe a new deformable object
manipulation method including soft contact simulation, manipulation learning,
and sim-to-real transfer. We propose a novel approach utilizing Vision-Based
Tactile Sensors (VBTSs) as the end-effector in simulation to produce
observations like relative position, squeezed area, and object contour, which
are transferable to real robots. For a more realistic contact simulation, a new
simulation environment including elastic, plastic, and elastoplastic
deformations is created. We utilize RL strategies to train agents in the
simulation, and expert demonstrations are applied for challenging tasks.
Finally, we build a real experimental platform to complete the sim-to-real
transfer and achieve a 90
sphere. To test the robustness of our method, we use plasticine of different
hardness and sizes to repeat the tasks including cylinder and sphere. The
experimental results show superior performances of deformable object
manipulation with the proposed method.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要