Jinrong Yang


Hello! I am Jinrong Yang (杨金荣). I am currently a 4th year Ph.D student at the Huazhong University of Science and Technology (HUST), supervised by Xiaoping Li. I am also an intern at Megvii Technology, supervised by Xiangyu Zhang and Zheng Ge. Before that, I got my bachelor’s degree at China University of Mining and Technology (CUMT) in 2019 and was recommended to study for my doctor’s degree at HUST.

My research interest mainly focus on Multimodal learning (LLM, AIGC), 2/3D (Perception, Tracking, Prediction, and Planning).


Dec 12, 2023 Before the year was over, we had released four LLM-based multimodal models:
(1) Referring Instruction Tuning Model ChatSpot; :sparkles:
(2) Foresight Minds Model Merlin; :sparkles:
(3) Synergistic Multimodal Comprehension and Creation Model DreamLLM; :sparkles:
(4) Scaling up the Vision Vocabulary Model Vary. :sparkles:
Jan 25, 2023 My second paper of corresponding author (PCET) is accepted by IEEE Robotics and Automation Letters (RA-L). Congratulations to Pan Wang!
Jan 21, 2023 One paper (DBQ-SSD) is accepted by ICLR 2023
Nov 1, 2022 Three papers (BEVDepth, BEVStereo, LTrack) are accepted by AAAI 2023
Mar 2, 2022 One paper (StreamYOLO) is accepted by CVPR 2022, Oral Presentation :sparkles:
Sep 28, 2021 One paper (COSOC) is accepted by NeurIPS 2021

Selected publications

* indicates equal contribution, ** indicates corresponding author.

  1. DreamLLM: Synergistic Multimodal Comprehension and Creation
    Runpei Dong, Chunrui Han, Yuang Peng, Zekun Qi, Zheng Ge, Jinrong Yang, Liang Zhao, Jianjian Sun, Hongyu Zhou, Haoran Wei, and 1 more author
    arXiv preprint arXiv:2309.11499, 2023
  2. ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning
    Liang Zhao, En Yu, Zheng Ge, Jinrong Yang, Haoran Wei, Hongyu Zhou, Jianjian Sun, Yuang Peng, Runpei Dong, Chunrui Han, and 1 more author
    arXiv preprint arXiv:2307.09474, 2023
  3. GroupLane: End-to-End 3D Lane Detection with Channel-wise Grouping
    Zhuoling Li, Chunrui Han, Zheng Ge, Jinrong Yang, En Yu, Haoqian Wang, Hengshuang Zhao, and Xiangyu Zhang
    arXiv preprint arXiv:2307.09472, 2023
  4. GMM: Delving into Gradient Aware and Model Perceive Depth Mining for Monocular 3D Detection
    Weixin Mao*, Jinrong Yang*, Zheng Ge, Lin Song, Hongyu Zhou, Tiezheng Mao, Zeming Li, and Osamu Yoshie
    arXiv preprint arXiv:2306.17450, 2023
  5. Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception
    Chunrui Han, Jianjian Sun, Zheng Ge, Jinrong Yang, Runpei Dong, Hongyu Zhou, Weixin Mao, Yuang Peng, and Xiangyu Zhang
    arXiv preprint arXiv:2303.05970, 2023
  6. DBQ-SSD: Dynamic Ball Query for Efficient 3D Object Detection
    Jinrong Yang*, Lin Song*, Songtao Liu, Weixin Mao, Zeming Li, Xiaoping Li, Hongbin Sun, Jian Sun, and Nanning Zheng
    In International Conference on Learning Representations (ICLR), 2023
  7. Implicit and Efficient Point Cloud Completion for 3D Single Object Tracking
    Pan Wang, Liangliang Ren, Shengkai Wu, Jinrong Yang**, En Yu, Hangcheng Yu, and Xiaoping Li
    IEEE Robotics and Automation Letters, 2023
  8. BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detection
    Yinhao Li, Zheng Ge, Guanyi Yu, Jinrong Yang, Zengran Wang, Yukang Shi, Jianjian Sun, and Zeming Li
    In Proceeding of Association for the Advancement of Artificial Intelligence (AAAI), 2023
  9. BEVStereo: Enhancing Depth Estimation in Multi-view 3D Object Detection with Dynamic Temporal Stereo
    Yinhao Li, Han Bao, Zheng Ge, Jinrong Yang, Jianjian Sun, and Zeming Li
    In Proceeding of Association for the Advancement of Artificial Intelligence (AAAI), 2023
  10. Generalizing Multiple Object Tracking to Unseen Domains by Introducing Natural Language Representation
    En Yu, Songtao Liu, Zhuoling Li, Jinrong Yang, Shoudong Han, Wenbing Tao, and  others
    In Proceeding of Association for the Advancement of Artificial Intelligence (AAAI), 2023
  11. Real-time Object Detection for Streaming Perception
    Jinrong Yang, Songtao Liu, Zeming Li, Xiaoping Li, and Jian Sun
    In Proceeding of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
  12. Towards 3D Object Detection with 2D Supervision
    Jinrong Yang, Tiancai Wang, Zheng Ge, Weixin Mao, Xiaoping Li, and Xiangyu Zhang
    arXiv preprint arXiv:2211.08287, 2022
  13. Quality Matters: Embracing Quality Clues for Robust 3D Multi-Object Tracking
    Jinrong Yang*, En Yu*, Zeming Li, Xiaoping Li, and Wenbing Tao
    arXiv preprint arXiv:2208.10976, 2022
  14. Iou-balanced Loss Functions for Single-stage Object Detection
    Shengkai Wu*, Jinrong Yang*, Xinggang Wang, and Xiaoping Li
    Pattern Recognition Letters (PRL), 2022
  15. Rectifying the Shortcut Learning of Background for Few-shot Learning
    Xu Luo, Longhui Wei, Liangjian Wen, Jinrong Yang, Lingxi Xie, Zenglin Xu, and Qi Tian
    In Proceeding of Advances in Neural Information Processing Systems (NeurIPS), 2021