Multi-task Peer-Review Score Prediction.
Jiyi Li,Ayaka Sato,Kazuya Shimura,Fumiyo Fukumoto +3 more
- pp 121-126
Reads0
Chats0
TLDR
A multi-task shared structure encoding approach which automatically selects good shared network structures as well as good auxiliary resources for improving the performance of the target.Abstract:
Automatic prediction on the peer-review aspect scores of academic papers can be a useful assistant tool for both reviewers and authors. To handle the small size of published datasets on the target aspect of scores, we propose a multi-task approach to leverage additional information from other aspects of scores for improving the performance of the target. Because one of the problems of building multi-task models is how to select the proper resources of auxiliary tasks and how to select the proper shared structures. We propose a multi-task shared structure encoding approach which automatically selects good shared network structures as well as good auxiliary resources. The experiments based on peer-review datasets show that our approach is effective and has better performance on the target scores than the single-task method and naive multi-task methods.read more
Citations
More filters
Journal ArticleDOI
Which structure of academic articles do referees pay more attention to?: perspective of peer review and full-text of academic articles
Chenglei Qin,Chengzhi Zhang +1 more
TL;DR: In this article , the authors explore which structures of academic articles referees would pay more attention to, what specific content referees focus on, and whether the distribution of PRC is related to the citations.
Journal ArticleDOI
Predicting article quality scores with machine learning: The U.K. Research Excellence Framework
Mike Thelwall,Kayvan Kousha,Mahshid Abdoli,Emma Stuart,Meiko Makita,Paul Wilson,Jonathan M. Levitt,Petr Knoth,Matteo Cancellieri +8 more
TL;DR: In this article, the authors assess whether machine learning could provide a third alternative, estimating article quality using more multiple bibliometric and metadata inputs, using three-level this article2021 peer review scores for 84,966 articles submitted to the U.K. Research Excellence Framework 2021.
Journal ArticleDOI
Deep learning for predicting patent application outcome: The fusion of text and network embeddings
TL;DR: In this article , a deep learning framework is proposed to mine both the text content and context network, and then fuse these two aspects of features to train a forecasting model to predict the outcome of patent applications.
Journal ArticleDOI
The Quality Assist: A Technology-Assisted Peer Review Based on Citation Functions to Predict the Paper Quality
TL;DR: In this article , the authors developed a prediction model for paper quality assessment to support technology-assisted peer review, which relies only on features extracted from the paper to address this issue.
Posted Content
Automated scholarly paper review: Possibility and challenges
TL;DR: In this article, the authors proposed the concept of automated scholarly paper review (ASPR) and reviewed the relevant literature and technologies to discuss the possibility of achieving a full-scale computerized review process.
References
More filters
Proceedings ArticleDOI
Convolutional Neural Networks for Sentence Classification
TL;DR: The CNN models discussed herein improve upon the state of the art on 4 out of 7 tasks, which include sentiment analysis and question classification, and are proposed to allow for the use of both task-specific and static vectors.
Posted Content
Convolutional Neural Networks for Sentence Classification
TL;DR: In this article, CNNs are trained on top of pre-trained word vectors for sentence-level classification tasks and a simple CNN with little hyperparameter tuning and static vectors achieves excellent results on multiple benchmarks.
Journal ArticleDOI
Enriching Word Vectors with Subword Information
TL;DR: This paper proposed a new approach based on skip-gram model, where each word is represented as a bag of character n-grams, words being represented as the sum of these representations, allowing to train models on large corpora quickly and allowing to compute word representations for words that did not appear in the training data.
Proceedings Article
Practical Bayesian Optimization of Machine Learning Algorithms
TL;DR: This work describes new algorithms that take into account the variable cost of learning algorithm experiments and that can leverage the presence of multiple cores for parallel experimentation and shows that these proposed algorithms improve on previous automatic procedures and can reach or surpass human expert-level optimization for many algorithms.
Proceedings ArticleDOI
Learning Transferable Architectures for Scalable Image Recognition
TL;DR: NASNet as discussed by the authors proposes to search for an architectural building block on a small dataset and then transfer the block to a larger dataset, which enables transferability and achieves state-of-the-art performance.