Evaluation of Learner Performance during Practical Activities: an Experimentation in Computer Education

Abstract

This paper addresses learning analytics for evaluation of learners performance in remote laboratories. The objectives we identified to provide self-and social awareness while learners are practicing in their virtual learning environment are threefold: (1) the definition of a performance metric that requires no assessment tests, (2) the tracking of data to infer that metric in real time, and (3) the visualization of the performance metric without impacting learners' cognitive load. To support these needs, we propose (i) a metric related to the technical rightness of instructions carried out by learners, (ii) a generic learning analytics framework featuring an enriching engine able to infer indicators, and (iii) two distinct visualization tools. These proposals have been implemented in Lab4CE, our remote laboratory for computer education, and experimented in an authentic learning context. This experimentation showed that most students have significantly used both visualization tools, and that their usage decreased while the overall learners performance increased.