scispace - formally typeset
Open AccessProceedings Article

Inductive Representation Learning on Large Graphs

TLDR
GraphSAGE as mentioned in this paper is a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings instead of training individual embedding for each node.
Abstract
Low-dimensional embeddings of nodes in large graphs have proved extremely useful in a variety of prediction tasks, from content recommendation to identifying protein functions. However, most existing approaches require that all nodes in the graph are present during training of the embeddings; these previous approaches are inherently transductive and do not naturally generalize to unseen nodes. Here we present GraphSAGE, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings. Instead of training individual embeddings for each node, we learn a function that generates embeddings by sampling and aggregating features from a node's local neighborhood. Our algorithm outperforms strong baselines on three inductive node-classification benchmarks: we classify the category of unseen nodes in evolving information graphs based on citation and Reddit post data, and we show that our algorithm generalizes to completely unseen graphs using a multi-graph dataset of protein-protein interactions.

read more

Content maybe subject to copyright    Report

Citations
More filters
Posted Content

Reinforcement Learning on Job Shop Scheduling Problems Using Graph Networks.

TL;DR: This paper presents a novel approach for job shop scheduling problems using deep reinforcement learning that employs graph neural networks to model the various relations within production environments and casts the JSSP as a distributed optimization problem in which learning agents are individually assigned to resources.
Posted Content

A Graph Attention Spatio-temporal Convolutional Network for 3D Human Pose Estimation in Video

TL;DR: This work improves the learning of kinematic constraints in the human skeleton; namely posture, 2nd order joint relations, and symmetry by modeling both local and global spatial information via attention mechanisms and designing the interleaving of spatial information with temporal information to achieve a synergistic effect.
Posted Content

Hybrid Low-order and Higher-order Graph Convolutional Networks

TL;DR: A hybrid lower-order and higher-order graph convolutional network (HLHG) learning model, which uses a weight sharing mechanism to reduce the number of network parameters and a novel information fusion pooling layer to combine the high- order and low-order neighborhood matrix information is proposed.
Proceedings ArticleDOI

A Hyperbolic-to-Hyperbolic Graph Convolutional Network

TL;DR: In this article, a manifold-preserving graph convolutional network (H2H-GCN) is proposed to avoid the distortion caused by tangent space approximations and keep the global hyperbolic structure.
Posted Content

PyTorch-Direct: Enabling GPU Centric Data Access for Very Large Graph Neural Network Training with Irregular Accesses.

TL;DR: PyTorch-Direct is introduced, which enables a GPU-centric data accessing paradigm for GNN training and introduces a new "unified tensor" type along with necessary changes to the PyTorch memory allocator, dispatch logic, and placement rules to minimize programmer effort.
Related Papers (5)