Projects

You can find more of my projects on my GitHub Page.

Deep Learning

• LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training [GitHub] | [Paper]

  A series of open-sourced Mixture-of-Expert (MoE) models based on LLaMA 2 and SlimPajama.

• LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training [GitHub] | [Paper]

  A series of open-sourced Mixture-of-Expert (MoE) models based on LLaMA 3.

Other Stuff

• ChatGPT ArXiv Paper Assistant [GitHub]

  A ChatGPT/Gemini/DeepSeek based personalized arXiv paper assistant bot for automatic paper filtering.

• Easier PS and SoP [GitHub]

  A LaTeX template for writing Personal Statements (PS) and Statements of Purpose (SoP) for graduate school applications.