Kangrui Du

Kangrui Du

Georgia Institute of Technology

M.S. in Computational Science and Engineering

Hi! I’m Kangrui Du, a first-year M.S. in Computational Science and Engineering at College of Computing, Georgia Institute of Technology. Before that, I received my Bachelor’s degree in Computer Science and Technology at University of Electronic Science and Technology of China (UESTC), where I was a member of Brain and Intelligence Lab at (UESTC) supervised by Prof. Shi Gu. I was a research intern at The Hong Kong Polytechnic University where I’m fortunate to work with Prof. Shujun Wang.

My current research interests mainly lie in building systems for fast and efficient machine learning. I’m also interested in programing contests and traditional algorithms, and was a member of UESTC ACM-ICPC team.

🔥 News

  • 2024.6: I graduated from UESTC.
  • 2024.4: I joined ByteDance as an intern, developing cloud computing systems for Douyin (TikTok China) video search.
  • 2023.12: After a heated competition with the best students from various schools across the university, I’m awarded The Most Outstanding Students Award of UESTC (2023). Related link
  • 2023.10: I participate in IEEEXtreme 17.0 in team BunnyPonyRose and ranked 9th in the world

📝 Publications

In Submission to NeurIPS2024
sym

Temporal Flexibility in Spiking Neural Networks: Towards Generalization Across Time Steps and Deployment Friendliness

*Kangrui Du, *Yuhang Wu, Shikuang Deng, Shi Gu

Old version

  • Existing direct training methods are confined to a fixed timestep, which hinders on-chip dynamic energy-performance balancing and renders the models incompatible with fully event-driven chips.
  • Design Mixed Timestep Training to train Temporal Flexible SNNs compatible with varied temporal structures.
  • TFSNN exhibits near-SOTA performance, generalization across varied timesteps, and event-driven friendliness.
  • Our work is the first to report large model results (VGGSNN, cifar10-dvs) on fully event-driven platforms.
arXiv
sym

CMViM: Contrastive Masked Vim Autoencoder for 3D Multi-modal Representation Learning for AD classification

Guangqian Yang, Kangrui Du, Zhihan Yang, Ye Du, Yongping Zheng, Shujun Wang

Paper

  • While many efforts were made on multimodal representation learning for medical datasets, few discussions are made to 3D medical images.
  • Introduced Mamba SSM and contrastive learning in multimodal masked pre-training for 3D ViT. Our method surpassed current SOTA methods in multimodal diagnosis of Alzheimer’s Disease.

🎖 Honors and Awards

📖 Educations

  • 2024.08 - Present, M.S. in Computational Science and Engineering, Georgia Institute of Technology (Gatech).
  • 2020.09 - 2024.06, B.Eng. in Computer Science and Technology, University of Electronic Science and Technology of China (UESTC).

💻 Internships