Early Alerts: About the data behind risk levels

Tracked items

• All Mastering standard Homework and combined Test and/or Quiz assignment item parts for credit are tracked.

• This includes any for-credit item part questions you may have edited or created as well as for-credit items in Parent assignments and items in their associated Adaptive Follow-ups.

What's NOT tracked: Time and other assignment types

• Risk data does not consider how much time students spend on items.

• Any items that are for-practice (0 credit) or extra-credit are not tracked.

• Neither Dynamic Study Modules nor Learning Catalytics assignments contribute to student risk level, even if associated with a Mastering course.

• Any work students complete outside of Mastering is not included in the risk analysis.

A minimum of either 20 Homework or 20 Test/Quiz assignment item parts are required.

• The Early Alerts algorithm requires this minimum number of item parts from for-credit assignments completed within the past 120 days of the course.

• If students have completed at least 20 Homework item parts AND 20 Test/ Quiz item parts , the algorithm takes both into account.

Current Risk Levels show as No/Low Info when the minimum amount of student work is not met.

• If all of your students are in the No/Low Info risk level group — Consider assigning more work.
• To check whether students in this group have done ANY work — Select Student List, the No/Low Info check box, and then look in the Test/Quiz and Homework columns for % scores (some work completed) or - (no work completed).

The algorithm used to calculate Current Risk Levels is based on the following student performance indicators.

Homework problem indicators

• Did students get the question right on the first time?

  Examines all item parts in the past 120 days. Tracks the percentage of correct first answers students submitted the first time they worked the assignment.

• Have students been getting the question right on the first try recently—for the last 20 Homework item parts?
• Can students get the question right within 3 or the max number of tries?

• Have students been getting the question right within 3 or the max number of tries recently—for the last 20 Homework item parts?

Quiz/Test problem indicators

• Did students figure out the answer to Test/Quiz item parts?

  Examines all item parts in the past 120 days. Tracks the percentage of answers that students got correct, including submissions in the last allowed attempt.

• Did students figure out the answer recently—for the last 20 Test/Quiz item parts?