Tracking learners' progress in scenarios

You can see how your learners have interacted with the scenario by opening it in the editor and clicking the ‘Stats’ button in the upper right corner.  

There are two types of tracking available for scenarios:

• Basic tracking will show you how much time each learner has spent viewing the scenario, what goals they’ve accomplished, and how many points they’ve received. Basic tracking is available on all plans that have access to scenarios.

• Advanced tracking will also save learners’ exact path and how much time they’ve spent on each node.

In both cases, the learner must have a ThingLink account and they must be logged in. If the learner is not logged in then we will not be able to record how they've completed a scenario.

You can enable advanced tracking data via scenario settings (the cog icon). Note that advanced tracking is available on Enterprise plans only. 

Basic data

You can view basic tracking data directly on the stats page:

The page lists how much time each learner has spent on the scenario ('Duration'), how many points they've received by completing goals ('Score'), and the goals they've reached ('Goals achieved'). This data is cumulative for all attempts to complete the scenario.

Tip: Scroll over the circles representing different goals to see which goals the learner has reached.

Advanced tracking data

Advanced tracking data includes:

• Which blocks each learner has visited (which allows you to check their learning path),
• How much time each learner has spent on the scenario as a whole and on each block,
• Whether the learner has correctly answered the questions from 'Question' blocks on their first attempt,
• How many times viewers have selected different options in Branching blocks.

Keep in mind that advanced tracking is off by default and has to be enabled via scenario settings. If a learner completes a scenario before advanced tracking has been enabled, we will not record additional data for them.

Using the Analytics overlay

The easiest way to view advanced tracking data is by enabling the Analytics overlay in the scenario editor. Simply toggle on 'Analyticcs overlay' in the top toolbar:

Once the overlay is turned on, you will see the following metrics:

• 'AVG time on node' measures how much time, on average, learners spend viewing this block. The metric is calculated as an average across all sessions/attempts to complete the scenario. This metric is displayed for each scenario block.
• X users were here' represents how many unique learners have seen a scenario block. This metric is calculated across all attempts to complete the scenario. This metric is displayed for each scenario block.
• 'X users completed this path' represents the number of learners who have reached the last block in this branch of your scenario. This metric is displayed at the end of each branch.
• 'Paths taken' distribution for branching blocks shows how frequently each path was chosen by the learners. This includes data for each time the branching block was shown - if your scenario is structured in a way that allows users to go through the same branching block multiple times, we will record multiple choices for each attempt at completing the scenario.
  
  This metric is shown only on branching blocks.
• 'X / Y correct first answers' represents how many learners have provided a correct answer when answering a Question block for the first time, where 'X' is the number of learners who have provided a correct answer on their first attempt and 'Y' is the total number of learners who have answered this Question block.
  
  Note that subsequent answers do not affect this metric, only the first answer counts. 
•  

In addition to these block-specific metrics, you will also see some aggregate stats in the top-left corner:

• 'Average time to complete' calculates how much time, on average, learners needed to get from the beginning of a scenario to the scenario results screen. This metric is calculated as an average of all attempts, meaning that if a learner has completed the scenario multiple times, all of their attempts will be counted separately.
• 'Unique viewers' represents the number of unique learners who have started the scenario.
• 'Total attempts' represents the total number of times learners have started the scenario.

Miscellaneous notes on metrics & scenario structure:

•  The metrics for how many learners have viewed different blocks or completed different paths will be affected by Jump blocks that redirect learners from one block to another. For example, if a jump block redirects learners from path A to path B, you may notice that the number of learners who completed path B will be higher than then the number of learners who have viewed preceding blocks in that path.
• Similarly, Jump blocks and the ability to use the 'Back' button may lead to cases where learners view the same branching block multiple times, so the distribution of choices made in the branching block may not align with how many learners have completed the scenario.
• The scenario stats exclude any attempts made by the author of the scenario - your own interactions do not count towards any metrics listed here.

Analytics overlay controls

You can use the 'Data display settings' window below the 'Analytics overlay' toggle to control how the data is displayed.

• View data: 'All' or 'By block'. If you select All, you will see the stats for all blocks displayed at once. If you select 'By block', the data will be shown only when you hover over a scenario block.
  The default setting is 'All'.
• Filter data: 'All' or 'By user'. By default, you see the data for all learners who have attempted to complete the scenario. However, you can view data for specific learners or groups of learners by selecting the 'By user' option and then selecting users or groups from the dropdown menu:
  

Exporting tracking data 

You can also export advanced tracking data as an Excel file. Open the scenario editor, click 'Statistics' and select the 'User progress' tab, then click the 'Download report' button in the upper-right corner.