Many companies around the world provide educational trainings and exams. Some of these exams were already available in online environments before 2019 in addition to paper-based tests. However, in the year 2020, due to COVID-19, the majority of all examinations were forced to move into the digital world.
The digitization of the knowledge assessment has not only changed the way knowledge is assessed but has also helped us to store data on the process of completing the digital exam, thus collecting additional information about the way the testing person interacts with the test. For example, digital assessments record the interactions of individuals with the exam material (e.g., mouse clicks, mouse movements, character keystrokes with timestamps), which collects and processes information that opens a new way in knowledge measurement and assessment.
These interactions are logged as digital traces that can be used in many ways. These digital traces can be used to further develop the exam materials, to measure the examinees' knowledge more accurately, to determine what response pattern they follow, whether an examinee is focused, how his / her performance changes as the digital exam progresses, etc. Based on these information pieces, we can provide them more information-rich feedback. We can identify similar exam solution patterns and examine whether there is a correlation between how the exam is solved and the exam result.
As part of the LogDataAnalysis project, we develop the LogDataAnalyser software, which collects valuable information from log data automatically recorded by various software, visualizes it, and performs analyses using data mining methods. Thus, further improvement of exam tasks can be achieved based on log data, information-rich feedback to examinees, identification of similar digital exam solution patterns, and correlation testing between the way the exam is solved and the exam result.
In summary, LogDataAnalyser software provides an opportunity for companies and institutes around the world to extract and analyze in detail the interaction data collected during digital exams with data mining techniques, which will expand their services.