About
I am a fourth-year PhD student majoring in Statistics at the University of Wisconsin-Madison. My previous research experience has been primarily centered around machine learning, with a particular focus on the processing of sequential data. Currently, I am pursuing research interests in social network analysis, non-Euclidean models and large language models (LLM). I am privileged to work under the guidance of Professor Karl Rohe and Professor Frederic Sala.
Prior to that, I graduated from Zhejiang University with a B.S. in Statistics and the University of Wisconsin-Madison with a M.S. in Statistics. During my master's studies, I was lucky to work with Dr.Sebastian Raschka and co-authored Chapter 16: Transformers–Improving Natural Language Processing with Attention Mechanisms in his book Machine Learning with PyTorch and Scikit-Learn.
My full CV can be found here.
Work Experience
Meta
ML Engineer intern, 2024 summer
Built an unified typeahead ranker for Meta AI suggestions and keywords. Introduced Meta AI engagemented-based features into Meta AI ranker. Led an in-depth study on user reformulation for Meta AI search.
Amazon AGI
Applied scientist intern, 2023 summer
Built a vector search system for multi-modal data including text, image and video. Proposed a two-stage LLM-augmented search method to enable search by user preference.
Amazon Alexa AI
Applied scientist intern, 2022 summer
Built a transformer-based multi-task learning model for label automation and label recommendation.
Publications
“OTTER: Effortless Label Distribution Adaptation of Zero-shot Models”
C. Shin, J. Zhao, S. Cromp, H. Vishwakarma, and F. Sala
In ICML Workshop: Foundation Models in the Wild, 2024.
“MoRe Fine-Tuning with 10x Fewer Parameters”
W. Tan, N. Roberts, T.-H. Huang, J. Zhao, J. Cooper, S. Guo, C. Duan, and F. Sala
In ICML 2024 Workshop: Efficient Systems for Foundation Models II, 2024.
“Geometry-Aware Adaptation for Pretrained Models”
N. Roberts, X. Li, D. Adila, S. Cromp, T. Huang, J. Zhao, and F. Sala
In Neural Information Processing Systems (NeurIPS), 2023.
“Chapter 16: Transformers–Improving Natural Language Processing with Attention Mechanisms, Machine Learning with PyTorch and Scikit-Learn”
S. Raschka, J. Zhao
Birmingham, UK: Packt Publishing, 2022. ISBN: 978-1801819312.
Teaching Experience
STAT 371: Introductory Applied Statistics for the Life Sciences
20 Fall, 21 Spring, 21 Summer
STAT 451: Introduction to Machine learning and Statistical Pattern Classification
21 Fall, 22 Spring, 22 Fall, 23 Spring, 24 Fall