👋Hi there, I am Zhiwei Shang (尚致违), currently a research assistant at Intelligent Transportation (INTR) Thrust in the System Hub, Hong Kong University of Science and Technology (Guangzhou campus), supervised by Prof. Meixin Zhu.

Before this, I received Master of Electronic and Information Engineering in Computer Technology from University of Chinese Academy of Sciences in 2023, supervised by Prof. Yunduan Cui. I received Bachelor of Engineering in Hydrology and Water Resources Engineering from Sichuan University in 2020.

My research interests lie in the study of Artificial Intelligence algorithms and their engineering applications. I believe that the development of Artificial Intelligence can help us build a better, safer and more equal society!You’re more than welcome to write me an email to connect (or make friends)! Let’s explore the exciting world together! 🌌

📖 Educations

  • Sep. 2020 - Jun. 2023
    Master of Electronic and Information Engineering, Computer Technology
    University of Chinese Academy of Sciences (UCAS)

  • Sep. 2016 - Jun. 2020
    Bachelor of Engineering, Hydrology and Water Resources Engineering
    Sichuan University (SCU)

💼 Research Experiences

  • The Hong Kong University of Science and Technology
    Aug. 2023 - present
    Supervised by Prof. Meixin Zhu
    Research on Reinforcement Learning

  • Shanghai Artificial Intelligence Laboratory (Remote Research Assistant)
    Feb. 2024 - Sep. 2024
    Supervised by Dr. Chenjia Bai
    Research on Intelligent Robots

  • Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences
    Sep. 2020 - Jun. 2023
    Supervised by Dr. Yunduan Cui
    Research on Reinforcement Learning and Intelligent Control

🔥 News

  • 2024.10:   🎉🎉 Please view our new work on diffusion-based locomotion policy on project website!
  • 2024.03:   🎉🎉 One paper is accepted by the 35th IEEE Intelligent Vehicles Symposium (IV 2024).

📝 Publications

* Co-first author, ✉️ Corresponding author.

Working Papers

  • Dynamic High-Order Control Barrier Functions with Diffuser for Safety-Critical Trajectory Planning at Signal-Free Intersections.
    Di Chen, Ruiguo Zhong, Kehua Chen, Zhiwei Shang, Meixin Zhu✉️.
    Submitted to IEEE Transactions on Intelligent Transportation Systems

  • Effective Reinforcement Learning Control using Conservative Soft Actor-Critic.
    Zhiwei Shang* , Xinyi Yuan*, Wenjun Huang, Yunduan Cui, Pengqin Wang, Di Chen, Meixin Zhu✉️, Shaojie Shen.
    Submitted to IEEE Transactions on Automation Science and Engineering

  • Preference Aligned Diffusion Planner for Quadrupedal Locomotion Control.
    Xinyi Yuan*, Zhiwei Shang* , Zifan Wang, Chenkai Wang, Zhao Shan, Zhenchao Qi, Meixin Zhu✉️, Chenjia Bai✉️, Xuelong Li.
    Submitted to 2025 IEEE International Conference on Robotics & Automation | [Website]

Published / Accepted Papers

  • Learning Realistic and Reactive Traffic Agents.
    Meixin Zhu✉️, Di Chen, Xinyi Yuan, Zhiwei Shang, Chenxi Liu.
    35th IEEE Intelligent Vehicles Symposium (IV 2024)

  • Relative Entropy Regularized Sample-Efficient Reinforcement Learning With Continuous Actions.
    Zhiwei Shang, Renxing Li, Chunhua Zheng, Huiyun Li, Yunduan Cui✉️.
    IEEE Transactions on Neural Networks and Learning Systems (IF=10.2, JCR Q1), 2023 | [Paper]

  • Efficient distributional reinforcement learning with Kullback-Leibler divergence regularization.
    Li Renxing, Zhiwei Shang, Chunhua Zheng, Huiyun Li, Qing Liang, Yunduan Cui✉️.
    Applied Intelligence (IF=3.4, JCR Q2), 2023 | [Paper]

  • Dynamic Policy Programming with Descending Regularization for Efficient Reinforcement Learning Control.
    Renxing Li, Zhiwei Shang, Chunhua Zheng, Huiyun Li, Qing Liang, Yunduan Cui✉️.
    5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI 2022) | [Paper]

  • Shiftable Dynamic Policy Programming for Efficient and Robust Reinforcement Learning Control.
    Zhiwei Shang, Huiyun Li, Yunduan Cui✉️.
    2021 IEEE International Conference on Robotics and Biomimetics (ROBIO 2021) | [Paper]

🎖 Awards

  • 2022.12, Outstanding Graduate Student Award of Dean’s Innovation Award of Shenzhen Institute of Advanced Integration Technology, Chinese Academy of Sciences and The Chinese University of Hong Kong (17 awardees among whole institute).
  • 2019.05 Outstanding Project of Provincial Student Innovation and Entrepreneurship Training Program (Top 10%)

💬 Talks

  • 2024.04, Guest Lecture of Reinforcement Learning, Hong Kong University of Science and Technology, Guangzhou Campus.

💻 Services

Journal Reviewer

  • IEEE Transactions on Intelligent Vehicles, Applied Intelligence