Research
I'm interested in robotics, dexterous manipulation, reinforcement learning, and sim-to-real transfer. My goal is to let the robot perform various cool behaviors in the real world as in the simulation.
|
Representative publication
|
|
Object-Centric Dexterous Manipulation from Human Motion Data
Yuanpei Chen,
Chen Wang,
Yaodong Yang,
C. Karen Liu
CoRL, 2024, Accepted
Project Page
/
ArXiv
/
Code (Coming Soon)
We introduce a hierarchical framework that uses human hand motion data and deep reinforcement learning to train dexterous robot hands for effective object-centric manipulation in both simulation and real world.
|
|
Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulation
Yuanpei Chen*,
Chen Wang*,
Li Fei-Fei,
C. Karen Liu
CoRL, 2023, Accepted
Project Page
/
ArXiv
/
Code
/
Video
We present Sequential Dexterity, a general system based on reinforcement learning (RL) that chains multiple dexterous policies for achieving long-horizon task goals.
|
|
Dynamic Handover: Throw and Catch with Bimanual Hands
Binghao Huang*,
Yuanpei Chen*,
Tianyu Wang,
Yuzhe Qin,
Yaodong Yang,
Nikolay Atanasov,
Xiaolong Wang
CoRL, 2023, Accepted
Project Page
/
ArXiv
/
Code
We design a system with two multi-finger hands attached to robot arms to solve the dynamic handover problem. We train our system using Multi-Agent Reinforcement Learning in simulation and perform Sim2Real transfer to deploy on the real robots.
|
|
Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning
Yuanpei Chen,
Tianhao Wu,
Shengjie Wang,
Xidong Feng,
Jiechuang Jiang,
Stephen Marcus McAleer,
Hao Dong,
Zongqing Lu,
Song-chun Zhu,
Yaodong Yang
Journal Version: T-PAMI, 2023, Accepted
Conference Version: NeurIPS, 2022, Accepted
Project Page
/
ArXiv
/
Code
We propose a bimanual dexterous manipulation benchmark (Bi-DexHands) according to literature from cognitive science for comprehensive reinforcement learning research.
|
Collaborative publication
|
|
Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learning
Zhecheng Yuan*,
Tianming Wei*,
Shuiqi Cheng,
Gu Zhang,
Yuanpei Chen,
Huazhe Xu,
CoRL, 2024, Accepted
Project Page
/
ArXiv
We propose Maniwhere, a generalizable framework tailored for visual reinforcement learning, enabling the trained robot policies to generalize across a combination of multiple visual disturbance types.
|
|
Neural Attention Field: Emerging Point Relevance in
3D Scenes for One-Shot Dexterous Grasping
Qianxu Wang,
Congyue Deng,
Tyler Lum,
Yuanpei Chen,
Yaodong Yang,
Jeannette Bohg,
Yixin Zhu,
Leonidas Guibas
CoRL, 2024, Accepted
We propose the neural attention field for representing semantic-aware dense feature fields in the 3D space by modeling inter-point relevance instead of individual point features.
|
|
GarmentLab: A Unified Simulation and Benchmark for Garment Manipulation
Haoran Lu,
Yitong Li,
Ruihai Wu,
Sijie Li,
Ziyu Zhu,
Chuanruo Ning,
Yan Shen,
Longzan Luo,
Yuanpei Chen,
Hao Dong
NeurIPS, 2024, Accepted
We present GarmentLab, a content-rich benchmark and realistic simulation designed for deformable object and garment manipulation.
|
|
ReDMan: Reliable Dexterous Manipulation with Safe Reinforcement Learning
Yiran Geng*,
Jiaming Ji*,
Yuanpei Chen*,
Haoran Geng,
Fangwei Zhong,
Yaodong Yang
Paper
/
Code
Machine Learning (Journal), 2023, Accepted
We introduce ReDMan, an open-source simulation platform that provides a standardized implementation of safe RL algorithms for Reliable Dexterous Manipulation.
|
|
Learning a Universal Human Prior for Dexterous Manipulation from Human Preference
Zihan Ding,
Yuanpei Chen,
Allen Z. Ren,
Shixiang Shane Gu,
Hao Dong,
Chi Jin
Arxiv
/
Project Page
/
Provide Your Preference
/
Code (Coming soon)
RSS Workshop on Learning Dexterous Manipulation, 2023, Accepted
We propose a framework to learn a universal human prior using direct human preference feedback over videos, for efficiently tuning the RL policy on 20 dual-hand robot manipulation tasks in simulation, without a single human demonstration
|
|
MyoChallenge: Learning contact-rich manipulation using a musculoskeletal hand
Yiran Geng,
Boshi An,
Yifan Zhong,
Jiaming Ji,
Yuanpei Chen,
Hao Dong,
Yaodong Yang
Challenge Page
/
Code
/
Slides
/
Talk
/
Award
/
Media (BIGAI)
/
Media (CFCS)
/
Media (PKU-EECS)
/
Media (PKU-IAI)
/
Media (PKU)
/
Media (China Youth Daily)
First Place in NeurIPS 2022 Challenge Track (1st in 340 submissions from 40 teams)
PMLR, 2023, Accepted
Reconfiguring a die to match desired goal orientations. This task require delicate coordination of various muscles to manipulate the die without dropping it.
|
|
Safe Multi-Agent Reinforcement Learning for Multi-Robot Control
Shangding Gu*,
Jakub Grudzien Kuba*,
Yuanpei Chen,
Yali Du,
Long Yang,
Alois Knoll,
Yaodong Yang
Journal of Artificial Intelligence (AIJ), 2022, Accepted
project Page
/
Code
We investigate safe MARL for multi-robot control on cooperative tasks, in which each individual robot has to not only meet its own safety constraints while maximising their reward, but also consider those of others to guarantee safe team behaviours.
|
|
End-to-End Affordance Learning for Robotic Manipulation
Yiran Geng*,
Boshi An*,
Haoran Geng,
Yuanpei Chen,
Yaodong Yang,
Hao Dong
(*equal contribution)
ICRA, 2022, Accepted
Project Page
/
ArXiv
In this study, we take advantage of visual affordance by using the contact information generated during the RL training process to predict contact maps of interest.
|
|
Zero-Shot Sim-to-Real Transfer of Reinforcement Learning Framework for Robotics Manipulation with Demonstration and Force Feedback
Yuanpei Chen,
Chao Zeng,
Zhiping Wang,
Peng Lu,
Chenguang Yang
IEEE-ARM, 2022, Outstanding Paper Selected for Robotica Journal
Project Page
/
Paper
/
Code
We propose Simulation Twin (SimTwin) : a deep reinforcement learning framework that can help directly transfer the model from simulation to reality without any real-world training.
|
|
Stanford University, CA
2022.10 - Present
Visiting Research Student
Advisor: Prof. Karen Liu and Prof. Fei-Fei Li
|
|
Peking University, China
2022.03 - 2023.07
Visiting Research Student
Advisor: Prof. Yaodong Yang
|
|
South China University of Technology, China
2019.09 - 2023.07
B.S.
Advisor: Prof. Chenguang Yang
|
Miscellaneous
I was quite into competitive robot🤖 and used to compete in RoboMaster🏅 and ICRA 2021 AI Challenge.
|
Template stolen from Jon Barron. Thanks for stopping by :)
Last updated: Nov 6, 2021
|
|