Publications

Preprints

 
On the Role of Attention Masks and LayerNorm in Transformers
Paper
Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs
Paper
What Are We Optimizing For? A Human-centric Evaluation of Deep Learning-based Movie Recommenders
Paper

2023

 
Demystifying Oversmoothing in Attention-Based Graph Neural Networks
NeurIPS 2023 (Spotlight) / Paper
LOG 2023 (Oral)/ Talk (starting at 4:47:40) / DeepMath 2023 (Oral) / Talk (starting at 6:20:30)

2022

 
Link Partitioning on Simplicial Complexes Using Higher-Order Laplacians
ICDM 2022 / Paper / Code

2020

 
Spectra of Quantum Graphs via a Scattering Matrix Approach
Xinyi Wu
Senior Thesis / Paper