Quantitative analysis of control-themed Advent calendar questions based on the using-explaining taxonomy

Abstract

This paper considers data collected for a control themed advent calendar quiz in 2023. The created calendar consists of one problem for each of the 24 days before Christmas. We analyze the difficulty of the questions based on the involved teachers' assessment using a taxonomy, which differentiates between being able to explain, reason, and understand a concept, and being able to apply and use a concept. This information is put into context with the amount of correct answers received per question. The analysis shows that predominantly conceptual questions rather than questions focusing on computations were included in the calendar and that more difficult questions according to the teachers' assessment also received less correct answers.