Recurrent neural networks for language understanding.
Citations
2,817 citations
Cites background from "Recurrent neural networks for langu..."
...[403] reported the success of RNNs in spoken language understanding....
[...]
...to emotion recognition from speech in [207, 222], to spoken language understanding in [242, 366, 403], to speaker recognition in [351, 372], to language-type recognition in [112], to dialogue state tracking for spoken dialogue systems in [94, 152], to automatic voice activity detection in [442], to speech enhancement in [396], to voice conversion in [266], and to single-channel source separation in [132, 387]....
[...]
562 citations
Cites background or methods or result from "Recurrent neural networks for langu..."
...We used a context window of 3 for bag-of-word feature [24]....
[...]
...some preliminary SLU experiments [15], [24], [30], [56], in this...
[...]
...Such word embeddings actually present interesting properties [23] and tend to cluster [20] when their semantics are similar While [15][24] suggest initializing the embedding vectors with unsupervised vised learned features and then fine-tune it on the task of interest, we found that directly learning the embedding vectors initialized from random values led to the same performance on the ATIS dataset, when using the SENNA word embeddings (http://ml....
[...]
...In our experiments, we preprocessed the data as in [24]....
[...]
...6% reported in [24] with the 95% significance level based on the binomial test....
[...]
503 citations
Cites methods from "Recurrent neural networks for langu..."
...Future work will explore more efficient training of RNNs and the choice of more comprehensive features [28] and using a different RNN training toolkit [14] incorporating more advanced features....
[...]
501 citations
464 citations
Additional excerpts
...[23] and Mesnil et al....
[...]
References
30,124 citations
"Recurrent neural networks for langu..." refers methods in this paper
...To understand it better, we use t-SNE [39] to plot frequent words that are in the ten most common slots in two-dimensional space, as shown in color in Figure 5....
[...]
13,190 citations
"Recurrent neural networks for langu..." refers methods in this paper
...Perhaps the most obvious approach to this task is the use of Conditional Random Fields (CRFs) [26], in which an exponential model is used to compute the probability of a label sequence given the input word sequence....
[...]
10,264 citations
"Recurrent neural networks for langu..." refers methods in this paper
...To adapt the RNN-LM to the LU task, we use the classic Elman RNN architecture [31] adopted by Mikolov [1]....
[...]
6,832 citations