The Electronic Journal of e-Learning provides perspectives on topics relevant to the study, implementation and management of e-Learning initiatives
For general enquiries email administrator@ejel.org
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the current European Conference on e-Learning is available here

For infomation on the International Conference on eLearning, click here

For infomation on the European Conference on Games Based Learning clickhere

 
Journal Issue
Volume 9 Issue 1, ECEL 2010 special issue / Apr 2011  pp1‑114

Editor: Carlos Vaz de Carvalho

Download PDF (free)

An Automated Individual Feedback and Marking System: An Empirical Study  pp1‑14

Trevor Barker

Look inside Download PDF (free)

Semi‑Automatic Grading of Students’ Answers Written in Free Text  pp15‑22

Nuno Escudeiro, Paula Escudeiro, Augusto Cruz

Look inside Download PDF (free)

Enhanced Approach of Automatic Creation of Test Items to foster Modern Learning Setting  pp23‑38

Christian Gutl, Klaus Lankmayr, Joachim Weinhofer, Margit Hofler

Look inside Download PDF (free)

Abstract

Research in automated creation of test items for assessment purposes became increasingly important during the recent years. Due to automatic question creation it is possible to support personalized and self‑directed learning activities by preparing appropriate and individualized test items quite easily with relatively little effort or even fully automatically. In this paper, which is an extended version of the conference paper of Gütl, Lankmayr and Weinhofer (2010), we present our most recent work on the automated creation of different types of test items. More precisely, we describe the design and the development of the Enhanced Automatic Question Creator (EAQC) which extracts most important concepts out of textual learning content and creates single choice, multiple‑choice, completion exercises and open ended questions on the basis of these concepts. Our approach combines statistical, structural and semantic methods of natural language processing as well as a rule‑based AI solution for concept extraction and test item creation. The prototype is designed in a flexible way to support easy changes or improvements of the above mentioned methods. EAQC is designed to deal with multilingual learning material and in its recent version English and German content is supported. Furthermore, we discuss the usage of the EAGC from the users’ viewpoint and also present first results of an evaluation study in which students were asked to evaluate the relevance of the extracted concepts and the quality of the created test items. Results of this study showed that the concepts extracted and questions created by the EAQC were indeed relevant with respect to the learning content. Also the level of the questions and the provided answers were appropriate. Regarding the terminology of the questions and the selection of the distractors, which had been criticized most during the evaluation study, we discuss some aspects that could be considered in the future in order to enhance the automatic generation of questions. Nevertheless the results are promising and suggest that the quality of the automatically extracted concepts and created test items is comparable to human generated ones. 

 

Keywords: e-assessment, automated test item creation, distance learning, self-directed learning, natural language processing, computer-based assessment

 

Share |
Methodology for Evaluating Quality and Reusability of Learning Objects  pp39‑51

Eugenijus Kurilovas, Virginija Bireniene, Silvija Serikoviene

Look inside Download PDF (free)

Fluidity in the Networked Society ‑ Self‑initiated learning as a Digital Literacy Competence  pp52‑62

Karin Tweddell Levinsen

Look inside Download PDF (free)

Discovering Student Web Usage Profiles Using Markov Chains  pp63‑74

Alice Marques, Orlando Belo

Look inside Download PDF (free)

Assessing Student Transitions in an Online Learning Environment  pp75‑86

Minoru Nakayama, Hiroh Yamamoto

Look inside Download PDF (free)

Science, Sport and Technology ‑ a Contribution to Educational Challenges  pp87‑97

Kelly O’Hara, Paula Reis, Dulce Esteves, Rui Brás, Luísa Branco

Look inside Download PDF (free)

From Soap Opera to Research Methods Teaching: Developing an Interactive Website/DVD to Teach Research in Health and Social Care  pp98‑104

Abigail Sabey, Sue Horrocks

Look inside Download PDF (free)

A Different Vision in eLearning: Metaphors  pp105‑114

Nazime Tuncay, Ioana Andreea Stanescu, Mustafa Tuncay

Look inside Download PDF (free)