Skip to main content

Table 1 Inventory of ITS messages aggregated from ITS design teams

From: ElectronixTutor: an intelligent tutoring system with multiple learning resources for electronics

Learner performance messages

 Completed

User completed a learning task was completed and a certain score (0–1) was returned.

 

 KnowledgeComponentScore

User demonstrated mastery of a specific knowledge component on a task (0–1)

 

 CompletedAllSteps

User completed a certain percentage of all steps of a task (0–1)

 

 CompletedStep

User completed a specific step of a task (0–1 for quality of step)

 

 AnswerSemanticMatch

User’s answer matched the ideal to a certain quality level (0–1)

 

 Misconception

User demonstrated a known misconception

 

Help messages

 TaskSupport

User received a certain overall level of help on a task (0–1)

 TaskHelp

User received some kind of help on a certain task step

 TaskHint

User received a hint on a certain task step

 TaskFeedback

User received feedback (positive, negative, or neutral) on a certain step

 TaskDecomposition

User decomposed a task into subparts to complete (used only by the LearnForm ITS)

 TaskHelpCount

Number of times user requested help in a session (summary, for systems that cannot report individual events)

User interface communication messages

 Presented

Information was presented to the user by the system

 SelectedOption

User selected a given option in the system

 SubmittedAnswer

User submitted a certain answer (e.g., text, option choice)

System control messages

 Loaded

The task loaded successfully and is running

 Heartbeat

The task is still running and has not frozen or otherwise stopped

Micro-level metrics messages

 WordsPerSecond

System estimated user input text as a given words per second

 ActionsPerSecond

System estimated user input actions per second

 Persistence

System estimated persistence on a given task

 

 Impetuousness

System estimated impetuousness (e.g., guessing) on a task

 

 GamingTheSystem

System estimated gaming the system on a task

 

 WheelSpinning

System estimated wheel spinning on a given task

 

 Confusion

System estimated user confusion on a given task

 

 Disengagement

System estimated user disengagement on a given task