Data and Analytics

Join

Hi folks. What would you consider to be the best KPIs for monitoring the usage of your...

Olly.Fayers3120
Olly.Fayers3120 Posts: 18 🌱
edited November 2022 in Social Groups

Hi folks. What would you consider to be the best KPIs for monitoring the usage of your Brightspace implementation?

 

Would you be looking at average time spent in content by a typical user? Number of logins per user?

 

Would love to know how you measure the success of the platform where you work.

· Share on Twitter

Comments

  • Bettina.S.6
    Bettina.S.6 Posts: 121
    edited November 2022

    Hi @Olly Fayers​, we used to think that the number of logins per user were an indication for success, but lately with the move to more or fully online we've seen that sometimes the number of logins per user goes down while the length per user session increases, most likely because instructional activities have been moved from the classroom to Brightspace. So students spend their time in Brightspace instead of in a classroom and their activities might be more intense going beyond checking in or downloading material.

    Having said this, whatever number you look at, it means not much without general and institutional context.

    · Share on Twitter
  • Sara.C.942
    Sara.C.942 Posts: 1 🌱
    edited November 2022

    Thank you for posing this question @Olly Fayers​ ; I am interested to hear what other institutions are using as metrics for engagement. We use a variety of numbers much like you've mentioned in terms of logins, time in content, activity within specific assignments, quizzes, discussions, etc. But I would like to have input from what has worked or is worthwhile to target at other institutions.

    · Share on Twitter
  • Renee.J.194
    Renee.J.194 Posts: 127 ✨
    edited November 2022

    @Bettina Schlass​ , so right about the context! We have a course where much of the content is pages that have the student link out in a new window, and I think the time in content gets for those pages with links. We have students who only go to Grades and tool links (outside of content navigation) and simply bypass the Content tool much of the time. The instructor give the reading assignments in the downloadable syllabus, and the Assignment instructions are pages long in that field in the assignment tool. We are also trying to figure out a KPI.

    · Share on Twitter
  • Bettina.S.6
    Bettina.S.6 Posts: 121
    edited November 2022

    I would say you engage students every time you let them do something with the content you've provided them with and then you come out at tool usage like self-assessment, quizzes, discussions, assignments. On top of that I think it's safe to assume that the more variety you offer your students the more engaging a course is, especially in an online environment. So a first KPI could be how many different tools are being used in your courses, a second KPI how intensely are they used. You could gradually build this up and combine it with the promotion of one tool after another in your institution. Start with measuring your current baseline and see how tool usage growth over time.

    · Share on Twitter
  • Renee.J.194
    Renee.J.194 Posts: 127 ✨
    edited November 2022

    We have the same tools in all courses as part of our need for a consistent interface and navigation. However, not all tools are actually populated in all courses. We have an entire college that doesn't believe in quizzes, and another the prefers to use external tools for quizzes. We do not recommend the Links tool but have to retain it because of courses migrated from Bb. The student-actionable tools for which use is required in ALL courses are Content, Grades, and Assignments. Rubrics are also required. I point this out simply because for us, data about tools in courses is fairly useless. But tool use is extremely useful. Visits and submissions to tools is interesting. Time in a tool, on the other hand, is not useful other than Content (were it accurate). The reason time in assignments is not interesting is that the student gets the assignment instructions and attachment, and then may spend 6 or 8 hours outside of the tool or even offline completing the assignment before returning to submit the Assignment. A few minutes online engagement to for a lot of engaged work.

    · Share on Twitter
  • Stefanie.B.518
    Stefanie.B.518 Posts: 650 admin
    edited November 2022

    Hi All,

    This is a really wonderful discussion and one that I'm learning from as well.

    In case it also helps in your exploration of available data to help inform key questions you have about engagement

     

     

     

     

    · Share on Twitter

Categories