CV

Education

• Ph.D. in CS, KAUST, 2023 – Present
• B.S. in EE, Xidian University, 2017 – 2021

Experiences

• July 2024 – October 2024
  • NVIDIA, USA
  • Mentor: Dr Nic McDonald
  • Role: Research Intern
  • Duties included: Implementing and profiling the communication-computation overlap distributed GEMM for next generation NVIDIA hardware and software systems.
• February 2023 – October 2023
  • ETH Zurich, Switzerland
  • Supervisor: Prof Torsten Hoefler
  • Role: Academic Guest (funded by HiPEAC Grant)
  • Duties included: Investigating in sparse linear solver and 4bit quantization for transformer.
• July 2021 – September 2023
  • The University of Edinburgh, UK
  • Supervisor: Prof Luo Mai
  • Role: Academic Guest
  • Duties included: Investigating in sparse linear solver and meta learning.
• February 2022 – October 2023
  • MegEngine, Megvii Inc, China
  • Mentor: Biao Wang
  • Role: Intern
  • Duties included: Maintaining deep learning framework MegEngine, maintaining and updating internal CUTLASS (commit), and optimising depth-wise convolution kernels for Ampere devices achieves 5+ times speedup (commit).
• April 2021 – February 2022
  • 3D, Megvii Inc, China
  • Team Leader: Xiao Liu, Mentor: Ran Yan
  • Role: Intern
  • Duties included: Designing distributed GPU bundle adjustment library MegBA (accepted by ECCV 2022). Optimising the pipeline of HF-Net using TensorRT and wroting image processing CUDA kernels, which reduced the duration from 20ms to 5ms on 2080Ti.
• February 2020 – March 2021
  • Peking University, China
  • Supervisor: Prof Hao Dong
  • Role: Visiting Student
  • Duties included: Investigating reinforcement learning and Bayesian deep learning.

Service

• Conference Reviewer: International Conference on Parallel Processing (ICPP) (2024), International Conference on Learning Representations (ICLR) (2023-2024), Neural Information Processing Systems (NeurIPS) (2022-2023), International Conference on Machine Learning (ICML) (2022-2024), and International Conference on Intelligent Robots and Systems (IROS) (2021-2022).
• Journal Reviewer: Parallel Computing, International Journal of Computer Vision (IJCV) and IEEE Robotics and Automation Letters (RA-L).

Awards

• Gordon Bell Prize Finalist (2024)
• KAUST Dean’s Award (2024)
• EPSRC Doctoral Prize (2023)
• HiPEAC Grant (2023)