avatar

Jianheng Liu

PhD Student in Embodied AI
University of Manchester
jianheng.elliot.liu[at]gmail.com


About Me

I’m a first-year PhD student in Computer Science at the University of Manchester, co-supervised by Dr. Clara Cheung, Dr. Akilu Yunusa-Kaltungo, and Dr. Wei Pan. My study is generously funded by University of Manchester Bicentenary Scholarship.

Prior to my PhD, I worked as a research engineer at Huawei Noah’s Ark Lab in London, working on AI agent research. Before this, I obtained my Master’s degree in Robotics and Computation from University College London in 2024 and a Bachelor’s degree in Automation from Beihang University in 2023.

I am always open to collaboration and exciting research opportunities, and I am excited about working on cutting-edge research in industry.

Research Interests

I’m mainly interested in reinforcement learning, embodied intelligence, and AI agent.

Publications

  1. Beyond Syntax: Action Semantics Learning for App Agents
    Bohan Tang*, Dezhao Luo*, Jianheng Liu, Jingxuan Chen, Shaogang Gong, Jianye Hao, Jun Wang, Kun Shao
    arXiv preprint, 2025
    Paper

    Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement Learning
    Qingyuan Wu*, Jianheng Liu*, Jianye Hao, Jun Wang, Kun Shao
    VLM4RWD Workshop on Annual Conference on Neural Information Processing Systems (NeurIPS), 2025
    Project Page Paper Code

    DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-device Control Agents
    Taiyi Wang*, Zhihao Wu*, Jianheng Liu, Jianye Hao, Jun Wang, Kun Shao
    International Conference on Learning Representations (ICLR), 2025
    Project Page Paper Code

    DreamerNav: Learning-Based Autonomous Navigation in Dynamic Indoor Environments Using World Models
    Stuart Shanks*, Jonathan Embley-Riches*, Jianheng Liu*, Andromachi Maria Delfaki, Carlo Ciliberto, Dimitrios Kanoulas
    Frontiers in Robotics and AI, 2025
    Paper

    OCMDP: Observation-Constrained Markov Decision Process
    Taiyi Wang*, Jianheng Liu*, Bryan Lee, Zhihao Wu, Yu Wu
    International Joint Conference on Neural Networks (IJCNN), 2025
    Paper

    Detect an Object At Once without Fine-tuning
    Junyu Hao*, Jianheng Liu*, Yongjia Zhao, Zuofan Chen, Qi Sun, Jinlong Chen, Jianguo Wei, Minghao Yang
    International Conference on Neural Information Processing (ICONIP), 2024
    Paper Code

Services

Conference Reviewers


Last updated in Feb 2026. Thanks for visiting by! 🤠