Jiaxi Jiang

Jiaxi Jiang 蒋佳熹

PhD Student in Computer Science
ETH Zurich, Switzerland
Google Scholar|Github|LinkedIn|Twitter|Email
Follow @cs_jiaxi_jiang

About Me

I am a PhD student at the Sensing, Interaction & Perception Lab, ETH Zurich with Prof. Christian Holz . My research lies at the intersection of Computer Vision, Digital Humans, Mixed Reality, and Human-Computer Interaction, with a particular focus on egocentric human motion modeling and estimation.

During my research journy, I was fortunate to collaborate with Larissa Laich and Dr. Patrick Snape from Reality Labs at Meta, Zurich. Before starting my PhD, I got my Master’s degree in Computational Engineering Science from RWTH Aachen University. I wrote my Master’s thesis on Image Restoration at the Computer Vision Lab, ETH Zurich, with Prof. Kai Zhang and Prof. Radu Timofte, supervised by Prof. Luc Van Gool and Prof. Bastian Leibe. Before that, I did a visiting research with Dr. Shuang Li and Prof. Jianwei Zhang at the University of Hamburg. Besides, I also worked with Dr. Jörg Stückler at Max Planck Institute for Intelligent Systems, and with Dr. Dengxin Dai at Max Planck Institute for Informatics.

Collaboration

If you are a motivated BS/MS student and would like to write your thesis with me, you are welcome to drop me an email. The current available thesis projects can be found at our lab's website SIPLAB (inside the ETHZ network) or SiROP (for logged in users). If you have any questions about my research or would like to collaborate with me, please also reach out to me.

News

09/2024 Our paper EgoSim is accepted by NeurIPS 2024.
07/2024 Two papers EgoPoser and MANIKIN are accepted by ECCV 2024. See you in Milan! Stay tuned for code releases.
04/2024 Our paper Ultra Inertial Poser is accepted by SIGGRAPH 2024.
08/2023 Our paper TapLight is accepted by UIST 2023.
09/2022 I am awarded the Springorium Commemorative Coin during the graduation ceremony by RWTH Aachen.
07/2022 Our paper AvatarPoser is accpeted by ECCV 2022.
02/2022 Our paper TapType is accepted by CHI 2022.
07/2021 I join Sensing, Interaction & Perception Lab, ETH Zurich as a research assistant.
07/2021 My master's thesis FBCNN is accepted by ICCV 2021! Great appreciation to Dr. Kai Zhang and Prof. Radu Timofte!
04/2021 I get my master's degree with distinction from RWTH Aachen University.
09/2020 I start my master's thesis at the Computer Vision Lab, ETH Zurich as an IDEA League research student.
06/2020 Our paper on Teleoperation is accepted by IROS 2020.

Publications

EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity
Dominik Hollidt, Paul Streli, Jiaxi Jiang, Yasaman Haghighi, Changlin Qian, Xintong Liu, Christian Holz
Neural Information Processing Systems (NeurIPS), 2024
Paper BibTeX

@inproceedings{hollidtegosim,
  title={EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity},
  author={Hollidt, Dominik and Streli, Paul and Jiang, Jiaxi and Haghighi, Yasaman and Qian, Changlin and Liu, Xintong and Holz, Christian},
  booktitle={The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track}
}

MANIKIN: Biomechanically Accurate Neural Inverse Kinematics for Human Motion Estimation
Jiaxi Jiang, Paul Streli, Xuejing Luo, Christoph Gebhardt, Christian Holz
European Conference on Computer Vision (ECCV), 2024.
Project Page Paper Poster BibTeX

@inproceedings{jiang2024manikin,
  title={Manikin: Biomechanically accurate neural inverse kinematics for human motion estimation},
  author={Jiang, Jiaxi and Streli, Paul and Luo, Xuejing and Gebhardt, Christoph and Holz, Christian},
  booktitle={European Conference on Computer Vision},
  year={2024},
  organization={Springer}
}

EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywhere
Jiaxi Jiang, Paul Streli, Manuel Meier, Christian Holz
European Conference on Computer Vision (ECCV), 2024.
Project Page Paper Poster BibTeX

@inproceedings{jiang2024egoposer,
  title={EgoPoser: Robust real-time egocentric pose estimation from sparse and intermittent observations everywhere},
  author={Jiang, Jiaxi and Streli, Paul and Meier, Manuel and Holz, Christian},
  booktitle={European Conference on Computer Vision},
  year={2024},
  organization={Springer}
}

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging
Rayan Armani, Changlin Qian, Jiaxi Jiang, Christian Holz
ACM SIGGRAPH 2024
Project Page Paper Video BibTeX Code

@article{armani2024ultra,
  title={Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging},
  author={Armani, Rayan and Qian, Changlin and Jiang, Jiaxi and Holz, Christian},
  journal={arXiv preprint arXiv:2404.19541},
  year={2024}
}

Structured Light Speckle: Joint Ego-Centric Depth Estimation and Low-Latency Contact Detection via Remote Vibrometry
Paul Streli, Jiaxi Jiang, Juliete Rossie, Christian Holz
ACM Symposium on User Interface Software and Technology (UIST), 2023.
Project Page Paper Video Talk BibTeX

@inproceedings{uist2023-structured_light_speckle,
  author = {Streli, Paul and Jiang, Jiaxi and Rossie, Juliete and Holz, Christian},
  title = {Structured Light Speckle: Joint Ego-Centric Depth Estimation and Low-Latency Contact Detection via Remote Vibrometry},
  year = {2023},
  isbn = {9798400701320},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  doi = {https://doi.org/10.1145/3586183.3606749},
  booktitle = {Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology},
  articleno = {26},
  numpages = {12}
                }

AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensing
Jiaxi Jiang, Paul Streli, Huajian Qiu, Andreas Fender, Larissa Laich, Patrick Snape, Christian Holz
European Conference on Computer Vision (ECCV), 2022.
Project Page Paper Poster Video BibTeX Code

@inproceedings{jiang2022avatarposer,
  title={Avatarposer: Articulated full-body pose tracking from sparse motion sensing},
  author={Jiang, Jiaxi and Streli, Paul and Qiu, Huajian and Fender, Andreas and Laich, Larissa and Snape, Patrick and Holz, Christian},
  booktitle={European Conference on Computer Vision},
  pages={443--460},
  year={2022},
  organization={Springer}
}

TapType: Ten-Finger Text Entry on Everyday Surfaces via Bayesian Inference
Paul Streli, Jiaxi Jiang, Manuel Meier, Hugo Romat, Andreas Fender, Christian Holz
ACM CHI Conference on Human Factors in Computing Systems (CHI), 2022.
Paper Video Demo BibTeX

@inproceedings{chi2022-taptype,
author = {Streli, Paul and Jiang, Jiaxi and Fender, Andreas and Meier, Manuel and Romat, Hugo and Holz, Christian},
title = {TapType: Ten-finger text entry on everyday surfaces via Bayesian inference},
year = {2022},
isbn = {9781450391573},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
doi = {https://doi.org/10.1145/3491102.3501878},
booktitle = {Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems},
numpages = {16}
}

Towards Flexible Blind JPEG Artifacts Removal
Jiaxi Jiang, Kai Zhang, Radu Timofte
International Conference on Computer Vision (ICCV), 2021.
Paper Poster BibTeX Code

@inproceedings{jiang2021towards,
title={Towards Flexible Blind JPEG Artifacts Removal},
author={Jiang, Jiaxi and Zhang, Kai and Timofte, Radu},
booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
pages={4997--5006},
year={2021}
}

A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU
Shuang Li, Jiaxi Jiang, Philipp Ruppel, Hongzhuo Liang, Xiaojian Ma, Norman Hendrich, Fuchun Sun, Jianwei Zhang
International Conference on Intelligent Robots and Systems (IROS), 2020.
Paper Video BibTeX Code

@inproceedings{li2020mobile,
title={A mobile robot hand-arm teleoperation system by vision and imu},
author={Li, Shuang and Jiang, Jiaxi and Ruppel, Philipp and Liang, Hongzhuo and Ma, Xiaojian and Hendrich, Norman and Sun, Fuchun and Zhang, Jianwei},
booktitle={2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
pages={10900--10906},
year={2020},
organization={IEEE}
}

Academic Services

Reviewers

Computer Vision: CVPR, ICCV, ECCV
Computer Graphics: SIGGRAPH, SIGGRAPH Asia
Machine Learning: NeurIPS, ICLR, AAAI
Human-Computer Interaction: CHI, UIST, IEEE VR

Teaching Assistant

Stochastics and Machine Learning, ETH Zurich, Spring 2024
Mixed Reality, ETH Zurich, Autumn 2023
Big Data For Engineers, ETH Zurich, Spring 2023

Mentored Students

Andela Ilic, Master Thesis, M.Sc. in Electrical Engineering, ETH Zurich, 04.2024 - Now
Shuyue Wang, Master Thesis, M.Sc. in Computer Science, ETH Zurich, 04.2024 - Now
Chang-Jin Lee, Bachelor Thesis, B.Sc. in Computer Science, ETH Zurich, 04.2024 - Now
Ying Xue, Master Thesis, M.Sc. in Computer Science, ETH Zurich, 01.2024 - Now
Changlin Qian, Research Intern, M.Sc. in Robotics, Systems and Control, ETH Zurich, 09.2023 - Now
Xuejing Luo, Master Thesis, M.Sc. in Robotics, Systems and Control, ETH Zurich, 05.2023 - 02.2024
Xintong Liu, Master Thesis, M.Sc. in Robotics, Systems and Control, ETH Zurich, 03.2023 - 03.2024
Filip Stanisic, Semester Thesis, M.Sc. in Electrical Engineering, ETH Zurich, 03.2023 - 07.2023
Huajian Qiu, Master Thesis, M.Sc. in Computational Science and Engineering, EPFL, 2021.10-2022.01