DeepFM: a factorization-machine based neural network for CTR prediction
Huifeng Guo,Ruiming Tang,Yunming Ye,Zhenguo Li,Xiuqiang He +4 more
- pp 1725-1731
TLDR
This paper shows that it is possible to derive an end-to-end learning model that emphasizes both low- and high-order feature interactions, and combines the power of factorization machines for recommendation and deep learning for feature learning in a new neural network architecture.Abstract:
Learning sophisticated feature interactions behind user behaviors is critical in maximizing CTR for recommender systems. Despite great progress, existing methods seem to have a strong bias towards low- or high-order interactions, or require expertise feature engineering. In this paper, we show that it is possible to derive an end-to-end learning model that emphasizes both low- and high-order feature interactions. The proposed model, DeepFM, combines the power of factorization machines for recommendation and deep learning for feature learning in a new neural network architecture. Compared to the latest Wide & Deep model from Google, DeepFM has a shared input to its "wide" and "deep" parts, with no need of feature engineering besides raw features. Comprehensive experiments are conducted to demonstrate the effectiveness and efficiency of DeepFM over the existing models for CTR prediction, on both benchmark data and commercial data.read more
Citations
More filters
Journal ArticleDOI
Improving hypergraph convolution network collaborative filtering with feature crossing and contrastive learning
Posted Content
Learning to Embed Categorical Features without Embedding Tables for Recommendation
Wang-Cheng Kang,Derek Zhiyuan Cheng,Tiansheng Yao,Xinyang Yi,Ting Chen,Lichan Hong,Ed H. Chi +6 more
TL;DR: Deep Hash Embedding (DHE) as mentioned in this paper replaces the traditional embedding tables by a deep embedding network to compute embeddings on the fly, which can handle high-cardinality features and unseen feature values.
Journal ArticleDOI
Improved Deep Neural Network Generalization Using m-Sharpness-Aware Minimization
Kayhan Behdin,Qingquan Song,Aman Gupta,David Durfee,Ayan Acharya,S. Sathiya Keerthi,Rahul Mazumder +6 more
TL;DR: In this paper , a variant of Sharpness-Aware Minimization (SAM) known as mSAM is proposed, which, during training, averages the updates generated by adversarial perturbations across several disjoint shards of a mini-batch.
Journal ArticleDOI
DeepBP: A bilinear model integrating multi-order statistics for fine-grained recognition
TL;DR: Wang et al. as discussed by the authors proposed a DeepBP model composed of a deep network module and a bilinear pooling module, which explicitly captures low-order statistical features and implicitly learns high-order features.
Posted Content
A Social Search Model for Large Scale Social Networks.
TL;DR: A social retrieval mechanism is introduced, a deep neural network is investigated that handles textual and social relevance in a two-tower approach, and the importance of personalization and textual signals in the ranking problem is examined.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Journal Article
Dropout: a simple way to prevent neural networks from overfitting
TL;DR: It is shown that dropout improves the performance of neural networks on supervised learning tasks in vision, speech recognition, document classification and computational biology, obtaining state-of-the-art results on many benchmark data sets.
Proceedings ArticleDOI
Deep Neural Networks for YouTube Recommendations
TL;DR: This paper details a deep candidate generation model and then describes a separate deep ranking model and provides practical lessons and insights derived from designing, iterating and maintaining a massive recommendation system with enormous user-facing impact.
Proceedings ArticleDOI
Factorization Machines
TL;DR: Factorization Machines (FM) are introduced which are a new model class that combines the advantages of Support Vector Machines (SVM) with factorization models and can mimic these models just by specifying the input data (i.e. the feature vectors).
Proceedings ArticleDOI
Restricted Boltzmann machines for collaborative filtering
TL;DR: This paper shows how a class of two-layer undirected graphical models, called Restricted Boltzmann Machines (RBM's), can be used to model tabular data, such as user's ratings of movies, and demonstrates that RBM's can be successfully applied to the Netflix data set.