Convolutional neural networks were first introduced in the context of computer vision. This lecture gives a short survey of how convolutional neural networks (CNNs) have been used in NLP applications.
Lecture slides
Readings
-
Chapter 13 of Yoav Goldberg, Neural network methods for natural language processing. Synthesis Lectures on Human Language Technologies. 2017 Apr 17;10(1):1-309.
-
(*) Kalchbrenner, Nal, Edward Grefenstette, and Phil Blunsom. “A Convolutional Neural Network for Modelling Sentences.” In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 655-665. 2014.
-
(*) Kim, Yoon. “Convolutional Neural Networks for Sentence Classification.” In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1746-1751. 2014.
-
(*) Kim, Yoon, Yacine Jernite, David Sontag, and Alexander M. Rush. “Character-Aware Neural Language Models.” In AAAI, pp. 2741-2749. 2016.
-
(*) Strubell, Emma, Patrick Verga, David Belanger, and Andrew McCallum. “Fast and Accurate Entity Recognition with Iterated Dilated Convolutions.” In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2670-2680. 2017.