Skip to main content

Blackbox: A Large Scale Repository of Novice Programmers’ Activity

Brown, Neil C.C., Kölling, Michael, McCall, Davin, Utting, Ian (2014) Blackbox: A Large Scale Repository of Novice Programmers’ Activity. In: Proceedings of the 45th SIGCSE technical symposium on computer science education (SIGCSE 2014). . ACM

PDF - Publisher pdf
Download (226kB) Preview


Automatically observing and recording the programming be- haviour of novices is an established computing education research technique. However, prior studies have been con- ducted at a single institution on a small or medium scale, without the possibility of data re-use. Now, the widespread availability of always-on Internet access allows for data col- lection at a much larger, global scale. In this paper we re- port on the Blackbox project, begun in June 2013. Black- box is a perpetual data collection project that collects data from worldwide users of the BlueJ IDE – a programming environment designed for novice programmers. Over one hundred thousand users have already opted-in to Blackbox. The collected data is anonymous and is available to other researchers for use in their own studies, thus benefitting the larger research community. In this paper, we describe the data available via Blackbox, show some examples of analyses that can be performed using the collected data, and discuss some of the analysis challenges that lie ahead.

Item Type: Conference or workshop item (Paper)
Uncontrolled keywords: Blackbox, BlueJ, data collection, programming education
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming,
Divisions: Faculties > Sciences > School of Computing > Computing Education Group
Depositing User: Michael Kolling
Date Deposited: 27 Mar 2014 16:20 UTC
Last Modified: 01 Aug 2019 10:36 UTC
Resource URI: (The current URI for this page, for reference purposes)
Utting, Ian:
  • Depositors only (login required):


Downloads per month over past year