Abstract:
© 2017 Copyright held by the owner/author(s). Publication rights licensed to ACM. Failure rates in introductory programming courses are notoriously high, and researchers have noted that students struggle with the assessments that we typically use to evaluate programming ability. Current assessment practices in introductory courses consist predominantly of questions that involve a multitude of different concepts and facts. Students with fragile knowledge in any of the areas required may be unable to produce a working solution, even when they may know most of the required material. These assessments also make it dificult for a teacher to distinguish between the specific information that a student does and does not know. In this paper, we analyse examination questions used to assess novice programming at the syntax level and describe the extent to which each syntax component is used across the various examination questions. We also explore the degree to which questions involve multiple syntax elements as an indicator of how independently concepts are examined.