Open AccessProceedings Article
Simplifying Graph Convolutional Networks
Felix Wu,Amauri Holanda de Souza,Tianyi Zhang,Christopher Fifty,Tao Yu,Kilian Q. Weinberger +5 more
- pp 6861-6871
Reads0
Chats0
TLDR
This paper successively removes nonlinearities and collapsing weight matrices between consecutive layers, and theoretically analyze the resulting linear model and show that it corresponds to a fixed low-pass filter followed by a linear classifier.Abstract:
Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations. GCNs derive inspiration primarily from recent deep learning approaches, and as a result, may inherit unnecessary complexity and redundant computation. In this paper, we reduce this excess complexity through successively removing nonlinearities and collapsing weight matrices between consecutive layers. We theoretically analyze the resulting linear model and show that it corresponds to a fixed low-pass filter followed by a linear classifier. Notably, our experimental evaluation demonstrates that these simplifications do not negatively impact accuracy in many downstream applications. Moreover, the resulting model scales to larger datasets, is naturally interpretable, and yields up to two orders of magnitude speedup over FastGCN.read more
Citations
More filters
Posted Content
Open Graph Benchmark: Datasets for Machine Learning on Graphs
Weihua Hu,Matthias Fey,Marinka Zitnik,Yuxiao Dong,Hongyu Ren,Bowen Liu,Michele Catasta,Jure Leskovec +7 more
TL;DR: The OGB datasets are large-scale, encompass multiple important graph ML tasks, and cover a diverse range of domains, ranging from social and information networks to biological networks, molecular graphs, source code ASTs, and knowledge graphs, indicating fruitful opportunities for future research.
Posted Content
LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
TL;DR: This work proposes a new model named LightGCN, including only the most essential component in GCN -- neighborhood aggregation -- for collaborative filtering, and is much easier to implement and train, exhibiting substantial improvements over Neural Graph Collaborative Filtering (NGCF) under exactly the same experimental setting.
Proceedings ArticleDOI
LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
TL;DR: LightGCN as mentioned in this paper learns user and item embedding by linearly propagating them on the user-item interaction graph, and uses the weighted sum of the embeddings learned at all layers as the final embedding.
Posted Content
Deep Learning on Graphs: A Survey
Ziwei Zhang,Peng Cui,Wenwu Zhu +2 more
TL;DR: This survey comprehensively review the different types of deep learning methods on graphs by dividing the existing methods into five categories based on their model architectures and training strategies: graph recurrent neural networks, graph convolutional networks,graph autoencoders, graph reinforcement learning, and graph adversarial methods.
Proceedings ArticleDOI
Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition
TL;DR: A simple method to disentangle multi-scale graph convolutions and a unified spatial-temporal graph convolutional operator named G3D are presented and a powerful feature extractor named MS-G3D is developed based on which the model outperforms previous state-of-the-art methods on three large-scale datasets.