R
Ramon Fermandez
Researcher at Carnegie Mellon University
Publications - 2
Citations - 694
Ramon Fermandez is an academic researcher from Carnegie Mellon University. The author has contributed to research in topics: Bag-of-words model & Language model. The author has an hindex of 2, co-authored 2 publications receiving 624 citations.
Papers
More filters
Proceedings ArticleDOI
Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation
Wang Ling,Chris Dyer,Alan W. Black,Isabel Trancoso,Ramon Fermandez,Silvio Amir,Luís Marujo,Tiago Luís +7 more
TL;DR: A model for constructing vector representations of words by composing characters using bidirectional LSTMs that requires only a single vector per character type and a fixed set of parameters for the compositional model, which yields state- of-the-art results in language modeling and part-of-speech tagging.
Proceedings ArticleDOI
Not All Contexts Are Created Equal: Better Word Representations with Variable Attention
Wang Ling,Yulia Tsvetkov,Silvio Amir,Ramon Fermandez,Chris Dyer,Alan W. Black,Isabel Trancoso,Chu-Cheng Lin +7 more
TL;DR: An extension to the bag-ofwords model for learning words representations that take into account both syntactic and semantic properties within language is introduced by employing an attention model that finds within the contextual words, the words that are relevant for each prediction.