Hello! I’m Weixiong Lin (林玮雄).

I’m now an research intern of Alibaba Search and Recommendation Department. The vision is to develop large-scale visual searching system (拍立淘). And I am contributing to the superlarge-scale pre-training (10-billion image-text product data).

My research interest includes Representation Learning & Multi-Modal Foundation Model(Data Synthesis, Knowledge Injection). Feel free to reach me if you are seeking any form of cooperation.

I am fortunate to be advised by Prof. Weidi Xie(海外优青) and Prof. Ya Zhang(国家万人), in MediaBrain Group, Shanghai Jiao Tong University.

Email: wx_lin[at]outlook[dot]com

🔥 News

• 2024.07: 🎉 MMedLM are accepted by Nature Communication
• 2024.04: 🎉 PMC-LLaMA are accepted by JAMIA

📝 Publications

📚 Multimodal Large Language Models

• MICCAI 2023 PMC-CLIP: Contrastive Language-Image Pre-training Using Biomedical Documents
  Weixiong Lin*, Ziheng Zhao*, et al.
• JAMIA PMC-LLaMA: toward building open-source language models for medicine
  Chaoyi Wu*, Weixiong Lin*, et al.
• Nature Communication Towards Building Multilingual Language Model for Medicine
  Pengcheng Qiu, Chaoyi Wu, Xiaoman Zhang, Weixiong Lin, et al.
• PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering
  Xiaoman Zhang, Chaoyi Wu, Ziheng Zhao, Weixiong Lin, et al.
• Can GPT-4V (ision) Serve Medical Applications? Case Studies on GPT-4V for Multimodal Medical Diagnosis
  Chaoyi Wu, Jiayu Lei, Qiaoyu Zheng, Weke Zhao, Weixiong Lin, et al.

💻 Internships

• 2024.05 - Now, Alibaba, Hangzhou.
• 2023.10 - 2024.04, Shanghai AI Lab, Shanghai.
• 2021.07 - 2022.03, MSRA, Beijing.

🗞 Academics and Communications

• I am fortunate to meet many interesting people & Team:

1. University.
   • SJTU:   Chaoyi Wu, Xiaoman Zhang, Haicheng Wang, Jinxiang Liu, Yue Hu, Chaoqin Huang, Aofan Jiang.
2. Alibaba.  TAO Technology: Shuai Xiao, Zida Cheng, Mengting Chen, Xuewen Hong, Yixuan Huang, Lianyu Du.
3. Huawei. Peisen Zhao, Maosen Li
4. Apple.   Jinge Yao
5. MSRA. Bin Zhu
6. Hardware Company.   NVIDIA: Yangheng Zhao, Intel: Yujie Pan

🎖 Honors and Awards

• 2022.10 Zhiyuan Scholarship (Top 1%)
• 2021.10 Zhiyuan Scholarship (Top 1%)
• 2021.09 Finalist Prize in MCM Competition (Top 1%)