Embodied Robot Manipulation in the Era of Foundation Models--Planning and Learning Perspectives
IEEE Transactions on Robotics (TRO 2026)
Biography
Hi, I am Jin Yang. I received my Ph.D. degree in June 2026 from the Institute of Artificial Intelligence and Robotics (IAIR) at Xi'an Jiaotong University. I was supervised by Prof. Ping Wei.
My research mainly focuses on Multimodal Learning. I am interested in effective representation, fusion, and reasoning methods for multimodal information. My current goal is to build intelligent models and robotic systems that can perceive multimodal signals and make reliable decisions.
Welcome to contact me for any discussion and cooperation.
Multimodal LearningRobotics & Embodied IntelligenceReinforcement Learning
News
-
One survey paper accepted by IEEE Transactions on Robotics. [Embodied Manipulation Survey]
-
I successfully defended my Ph.D. dissertation.
-
One paper accepted by ICRA2026. [WaveComm]
-
One paper accepted by IEEE Transactions on Multimedia. [VABooster]
-
One paper accepted by Pattern Recognition. [UPM]
-
Invited speaker at ICCIR 2025, delivering an oral presentation on video multimodal learning. [ICCIR 2025]
-
Winner of the First Prize in the CVPR2025 Robotwin Dual-Arm Collaboration Challenge (Real-World Track). [Robotwin Challenge]
-
Winner of the Second Prize in the CVPR2025 Robotwin Dual-Arm Collaboration Challenge (Simulation Round1). [Robotwin Challenge]
-
One paper accepted at CVPR 2024. [TaskWeave]
-
One paper accepted by IEEE Transactions on Multimedia. [TransGMC]
-
One paper accepted by IEEE Transactions on Circuits and Systems for Video Technology. [TFFormer]
Publications
Selected Publications. The list may not be up-to-date. Please find my latest publications on Google Scholar.
Survey Papers
Research Papers
2026
Differential Amplifier-Inspired AmpAttention for Multi-View Robotic Manipulation
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)
A Mechanically Decoupled Six-Axis Spherical Rolling Robot For Stable Propeller-Driven Rolling
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026) Project leader
Lightweight Communication for Collaborative Perception via Wavelet Feature Distillation
IEEE International Conference on Robotics & Automation (ICRA 2026) Co-first author & Project leader
2025
2024
Cross Time-Frequency Transformer for Temporal Action Localization
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT 2024)
Perceptual Consistency-Driven Abstraction via Minimax Optimization for Joint Moment Retrieval and Highlight Detection
2023
Under Review
2023
Gated Multi-Scale Transformer for Temporal Action Localization
IEEE Transactions on Multimedia (TMM 2023)
Patents
CN Patent 魏平, 杨进, 陈一鑫, 郑南宁. 基于混合几何表征预训练的机械臂泛化操作方法及系统. No. 2025120549575
Method and system for generalizable robotic arm manipulation based on hybrid geometric representation pretraining
CN Patent 魏平, 杨进. 基于差分注意力的多视角机械臂操作方法及系统. No. 2025120550110
Method and system for multi-view robotic arm manipulation based on differential attention
CN Patent 魏平, 杨进. 基于多模态统一表征的视频语言时序定位方法及系统. No. 2025102048215
Method and system for video-language temporal grounding based on unified multimodal representations
CN Patent 彭刚, 杨进. 一种基于深度强化学习的机械臂运动规划方法和系统. No. 2022105019028
Robotic arm motion planning method and system based on deep reinforcement learning
CN Patent 彭刚, 杨进, 黎莉, 尹智. 一种智能清洗机器人路径规划方法及系统. No. 2021104000462
Path planning method and system for an intelligent cleaning robot
Awards
- 2026 Program for Supporting Young and Excellent Talents, Xi’an Jiaotong University (西安交通大学青年优秀人才支持计划)
- 2025 National Scholarship for Doctoral Students
- 2025 "Hu Baosheng" Outstanding Student Scholarship Rank 1, Speech by the Student Representative
- 2023 Honor of Excellent Postgraduate at University Level
- 2021 Huawei Scholarship
- 2020 Honor of Merit Postgraduate at University Level
- 2020/2017/2016 First Prize of Scholarship at University Level
- 2020 Shenzhen Stock Exchange Scholarship
- 2019 Third Prize of World Robot Contest (Trico-Robot Challenge) Rank 2
- 2018 Third Prize of National College Student Robot Contest (Robocon) Rank 1, Team Leader
- 2018 Second Prize of USA Undergraduate Mathematical Modeling Contest Rank 1
- 2017 First Prize of National Undergraduate IoT Design Contest Rank 1
- 2017 First Prize of Tianjin Undergraduate Robot Contest (Robot Creative Design) Rank 1
- 2017 Tianjin Undergraduate Innovation and Entrepreneurship project Host
Projects
WebUI for Joint Video Moment Retrieval and Highlight Detection
A WebUI for video moment retrieval and highlight detection. It retrieves moments of interest from long untrimmed videos and supports zero-shot adaptation to open-set content.
Deep Reinforcement Learning for Robotic Manipulator Motion Planning
This is a DRL-based robotic manipulator motion planning system for simulated-real scenarios. The two demos show dynamic target scenarios without and with obstacles, and the framework image summarizes the planning system.