Back close

Considering Misconceptions in Automatic Essay Scoring with A-TEST – Amrita Test Evaluation & Scoring Tool

Publication Type : Conference Paper

Thematic Areas : Learning-Technologies

Publisher : AFRICOMM 2013, Springer Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST)

Source : AFRICOMM 2013, Springer Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST) (2014)

Url : https://www.springerprofessional.de/en/considering-misconceptions-in-automatic-essay-scoring-with-a-tes/2185726

Keywords : AES, Essay scoring, Feature extraction, Latent Semantic Analysis (LSA), Natural Language Process- NLP, SVD, text analysis, Text mining

Campus : Amritapuri

School : School of Engineering

Center : Technologies & Education (AmritaCREATE), Amrita Center For Research in Analytics

Department : Computer Science and Engineering

Year : 2014

Abstract : In large classrooms with limited teacher time, there is a need for automatic evaluation of text answers and real-time personalized feedback during the learning process. In this paper, we discuss Amrita Test Evaluation & Scoring Tool (A-TEST), a text evaluation and scoring tool that learns from course materials and from human-rater scored text answers and also directly from teacher input. We use latent semantic analysis (LSA) to identify the key concepts. While most AES systems use LSA to compare students’ responses with a set of ideal essays, this ignores learning the common misconceptions that students may have about a topic. A-TEST also uses LSA to learn misconceptions from the lowest scoring essays using this as a factor for scoring. ‘A-TEST’ was evaluated using two datasets of 1400 and 1800 pre-scored text answers that were manually scored by two teachers. The scoring accuracy and kappa scores between the derived ‘A-TEST’ model and the human raters were comparable to those between the human raters.

Cite this Research Publication : Prema Nedungadi, L, J., and Raghu Raman, “Considering Misconceptions in Automatic Essay Scoring with A-TEST - Amrita Test Evaluation & Scoring Tool”, in AFRICOMM 2013, Springer Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST) , 2014.

Admissions Apply Now