Carleton University - School of Computer Science Honours Project
Winter 2022
Effectiveness of a Quiz User Interface
Shubham Sharan
SCS Honours Project Image
ABSTRACT
The goal of the study is to compare the effectiveness of game design elements in isolation and analyze how these elements have an impact on the motivation and participant’s success. We conducted a week-long user study to gather quantitative metrics and an optional interview to gather qualitative insights. We had 24 participants initially for the week-long user study and 1 participant for the interview. Those 24 participants were divided into 3 groups: Control, Badges, and Leaderboard. For our analysis, we borrowed the understanding of how game design elements cater to psychological needs from Sailer et al.’s research, and the contextual learnings from Karoline Rye Finckenhagen’s research. Due to the small sample sizes, we did not have statistically significant results and much of the insights were deduced from the trends extrapolated. We found that participants in the Badges group performed better in terms of time invested in the application and overall performance on the questions. Participants were open to trying new categories but did have a preference for categories they were stronger in. Lastly, we found that money can be a great hook, but retaining the users' overall experience matters the most. In the end, this study teaches us the measures and precautions one should take to test the effectiveness of game design elements.