I am a computer science Ph.D. student at the University of British Columbia (UBC), supervised by Prof. Danica Sutherland (2021-now). My main research interest lies in Machine Learning on Graphs. I explore diverse graph tasks, spanning supervised learning to generative models and evaluation methods used for them. Recently, I have been more focused on Graph Transformers. I enjoy exploring method theories and using them as inspiration to develop improved models. I find both the theoretical and practical aspects of these methods interesting.
I completed my M.Sc. in CS at Simon Fraser University, under Prof. Greg Mori. My focus was on generative models for Graphs. During this time, I used tree decomposition to enhance sequential graph generation. You can find my Master's thesis here.
I did my B.Sc. in Computer/Software Engineering and Mathematics (double majors) at Sharif University of Technology. During my M.Sc. and B.Sc. I had the privilege of doing internships at the Empirical-Inference Lab at Max-Planck Institute for Intelligent Systems, Borealis AI, and Autodesk AI Lab.
Graph Neural Networks, Theory & Applications
Graph Generative Models
Evaluation Metrics of Graph Generative Models
Summary: Graph transformers offer a promising architecture for various graph learning tasks. However, scaling them for large graphs while maintaining competitive accuracy is challenging. Our paper introduces Exphormer, a framework with a sparse attention mechanism using virtual nodes and expander graphs. These yield linear graph transformer complexity, maintain theoretical properties, and enhance models within the GraphGPS framework. We demonstrate Exphormer's competitiveness across diverse datasets, including outperforming prior models and scaling to larger graphs.
Summary: Various models have been proposed for Graph Generative Models, necessitating effective evaluation methods. Our work suggests using contrastively trained GNN representations for more reliable metrics. We show neither traditional approaches nor GNN-based approaches dominate the other, however, we demonstrate that Graph Substructure Networks can combine both approaches for theoretically and practically stronger evaluation metrics.
Summary: TD-GEN is a graph generation framework based on tree decomposition. The framework includes a permutation invariant tree generation model which forms the backbone of graph generation. Tree nodes are supernodes, each representing a cluster of nodes in the graph. Graph nodes and edges are incrementally generated inside the clusters by traversing the tree supernodes. We also discuss the shortcomings of standard evaluation criteria based on the statistical properties of the generated graphs as performance measures. We propose to compare the performance of models based on average likelihood, conditioned on the permutation of the nodes.