Back close

Capturing Discriminative Attributes Using Convolution Neural Network Over ConceptNet Numberbatch Embedding

Publication Type : Conference Paper

Publisher : Springer Verlag

Source : Lecture Notes in Electrical Engineering, Springer Verlag, Volume 545, p.793-802 (2019)

Url : https://www.scopus.com/inward/record.uri?eid=2-s2.0-85065482589&doi=10.1007%2f978-981-13-5802-9_69&partnerID=40&md5=81ca72f1cf7c677e3c1fb9ec8a711ad9

ISBN : 9789811358012

Keywords : ConceptNet, Convolution, Convolution neural network, Discriminative attributes, Embeddings, Feature representation, Fundamental properties, Lexical associations, Natural language processing systems, Semantic representation, Semantics, Word Sense Disambiguation

Campus : Coimbatore

School : School of Engineering

Center : Computational Engineering and Networking

Department : Electronics and Communication

Year : 2019

Abstract : A semantic representation of text helps us understand the lexical association between words. Capturing these associations becomes an integral part of perceiving any language. One such fundamental property that expresses these associations is ‘similarity.’ This property shows consistency in comprehending similar words in the same manner. However, seldom it falls short on specific tasks where the lexical similarity in itself is not sufficient enough to validate the semantic representations. In this paper, the objective is to capture such semantic distinctions. It is based on the shared task ‘capturing discriminative attributes’ conducted in SemEval-2018. Our team participated in the task and held an F1 score of 0.658 with GloVe representation. An extension to this work is taken up in this paper where a new embedding known as ConceptNet Numberbatch is explored. The ConceptNet word embedding in overall showed improvement in the scores with the previous rule-based feature representation. The model is further tuned over certain hyperparameters, which improved the score to as much as 6%. A comparison is also put forth here with another prominent embedding like FastText. The ConceptNet model achieved a near par score with the state of the art, based only on a simple ensemble of features as representation. © 2019, Springer Nature Singapore Pte Ltd.

Cite this Research Publication : V. Vinayan, M. Kumar, A., and Dr. Soman K. P., “Capturing Discriminative Attributes Using Convolution Neural Network Over ConceptNet Numberbatch Embedding”, in Lecture Notes in Electrical Engineering, 2019, vol. 545, pp. 793-802.

Admissions Apply Now