Open AccessProceedings Article
Inductive Representation Learning on Large Graphs
William L. Hamilton,Zhitao Ying,Jure Leskovec +2 more
- Vol. 30, pp 1024-1034
TLDR
GraphSAGE as mentioned in this paper is a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings instead of training individual embedding for each node.Abstract:
Low-dimensional embeddings of nodes in large graphs have proved extremely useful in a variety of prediction tasks, from content recommendation to identifying protein functions. However, most existing approaches require that all nodes in the graph are present during training of the embeddings; these previous approaches are inherently transductive and do not naturally generalize to unseen nodes. Here we present GraphSAGE, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings. Instead of training individual embeddings for each node, we learn a function that generates embeddings by sampling and aggregating features from a node's local neighborhood. Our algorithm outperforms strong baselines on three inductive node-classification benchmarks: we classify the category of unseen nodes in evolving information graphs based on citation and Reddit post data, and we show that our algorithm generalizes to completely unseen graphs using a multi-graph dataset of protein-protein interactions.read more
Citations
More filters
Posted Content
Reinforcement Learning on Job Shop Scheduling Problems Using Graph Networks.
TL;DR: This paper presents a novel approach for job shop scheduling problems using deep reinforcement learning that employs graph neural networks to model the various relations within production environments and casts the JSSP as a distributed optimization problem in which learning agents are individually assigned to resources.
Posted Content
A Graph Attention Spatio-temporal Convolutional Network for 3D Human Pose Estimation in Video
TL;DR: This work improves the learning of kinematic constraints in the human skeleton; namely posture, 2nd order joint relations, and symmetry by modeling both local and global spatial information via attention mechanisms and designing the interleaving of spatial information with temporal information to achieve a synergistic effect.
Posted Content
Hybrid Low-order and Higher-order Graph Convolutional Networks
TL;DR: A hybrid lower-order and higher-order graph convolutional network (HLHG) learning model, which uses a weight sharing mechanism to reduce the number of network parameters and a novel information fusion pooling layer to combine the high- order and low-order neighborhood matrix information is proposed.
Proceedings ArticleDOI
A Hyperbolic-to-Hyperbolic Graph Convolutional Network
TL;DR: In this article, a manifold-preserving graph convolutional network (H2H-GCN) is proposed to avoid the distortion caused by tangent space approximations and keep the global hyperbolic structure.
Posted Content
PyTorch-Direct: Enabling GPU Centric Data Access for Very Large Graph Neural Network Training with Irregular Accesses.
Seungwon Min,Kun Wu,Sitao Huang,Mert Hidayetoglu,Jinjun Xiong,Eiman Ebrahimi,Deming Chen,Wen-mei W. Hwu +7 more
TL;DR: PyTorch-Direct is introduced, which enables a GPU-centric data accessing paradigm for GNN training and introduces a new "unified tensor" type along with necessary changes to the PyTorch memory allocator, dispatch logic, and placement rules to minimize programmer effort.