OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Design and evaluation of a semantic indicator for automatically supporting programming learning

Broisin, Julien and Herouard, Clément Design and evaluation of a semantic indicator for automatically supporting programming learning. (2019) In: 12th International Conference on Educational Data Mining (EDM 2019), 2 July 2019 - 5 July 2019 (Montreal, Canada).

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


How to support students in programming learning has beena great research challenge in the last years. To address thischallenge, prior works have mainly focused on proposingsolutions based on syntactic analysis to provide studentswith personalized feedback about their grammatical pro-gramming errors and misconceptions. However, syntacticanalysis falls short on informing learners how they solve theprogramming problem, even if one key learning outcome ofprogramming relates to the development of an individual'sability to solve a problem. In this article, we introduce anindicator to analyze beginners' code based on semantic prox-imity. This indicator adapts an edit distance algorithm (i.e.,the Levenshtein distance) to express the proximity of thestudents' code with the expected solution provided by theteacher, in order to express the learners' capacity to solvethe given problem. To process our indicator, we applied ma-chine learning techniques to a dataset from an introductoryprogramming course with a sample of 166 students. Thefirst results are encouraging. On the one hand, the semanticindicator can be used to automatically classify source codesas semantically correct or incorrect in 58% of the cases. Onthe other hand, the indicator is correlated with teachers'summative evaluations of students' codes. Even if furtherinvestigations must be conducted to improve the indicator'saccuracy, the results of this study make it possible to use ourapproach as the foundations for future research in semantic-based intelligent and awareness programming systems.

Item Type:Conference or Workshop Item (Paper)
HAL Id:hal-02884706
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Other partners > Ecole Normale Supérieure de Rennes - ENS Rennes (FRANCE)
Laboratory name:
Deposited On:29 Jun 2020 15:16

Repository Staff Only: item control page