Skip to main content

Advertisement

Table 1 Inventory of ITS messages aggregated from ITS design teams

From: ElectronixTutor: an intelligent tutoring system with multiple learning resources for electronics

Learner performance messages
 Completed User completed a learning task was completed and a certain score (0–1) was returned.  
 KnowledgeComponentScore User demonstrated mastery of a specific knowledge component on a task (0–1)  
 CompletedAllSteps User completed a certain percentage of all steps of a task (0–1)  
 CompletedStep User completed a specific step of a task (0–1 for quality of step)  
 AnswerSemanticMatch User’s answer matched the ideal to a certain quality level (0–1)  
 Misconception User demonstrated a known misconception  
Help messages
 TaskSupport User received a certain overall level of help on a task (0–1)
 TaskHelp User received some kind of help on a certain task step
 TaskHint User received a hint on a certain task step
 TaskFeedback User received feedback (positive, negative, or neutral) on a certain step
 TaskDecomposition User decomposed a task into subparts to complete (used only by the LearnForm ITS)
 TaskHelpCount Number of times user requested help in a session (summary, for systems that cannot report individual events)
User interface communication messages
 Presented Information was presented to the user by the system
 SelectedOption User selected a given option in the system
 SubmittedAnswer User submitted a certain answer (e.g., text, option choice)
System control messages
 Loaded The task loaded successfully and is running
 Heartbeat The task is still running and has not frozen or otherwise stopped
Micro-level metrics messages
 WordsPerSecond System estimated user input text as a given words per second
 ActionsPerSecond System estimated user input actions per second
 Persistence System estimated persistence on a given task
   Impetuousness System estimated impetuousness (e.g., guessing) on a task
   GamingTheSystem System estimated gaming the system on a task
   WheelSpinning System estimated wheel spinning on a given task
   Confusion System estimated user confusion on a given task
   Disengagement System estimated user disengagement on a given task