Data and Analytics

Join

I am working with the rubrics data sets, and have a few questions after studying the entity...

Renee.J.194
Renee.J.194 Posts: 126 ✨
edited November 2022 in Social Groups

I am working with the rubrics data sets, and have a few questions after studying the entity relationships. I think I know the answers to most, but the reports we produce will directly inform decisions so I want to be sure.

  1. Rubric Assessment dataset, according to the rubric datasets documentation, "Returns rubric outcomes that are associated with a competency." I think I am pulling data from courses that do not have rubrics associated with competencies. Since most of our courses do not use competencies, it is a good thing I am getting data from them! But could I be losing this data because I am not supposed to get it? Please remove my anxiety, or give me the warning I need.
  2. Our content-provisioning process uses master classes that are copied every semester into various "live" course offerings. I think that the RubricId is unique to a rubric in an offering. Correct?
  3. What happens when there is a shared rubric is in a course, coming from another course? (I know this locks the rubric in the LE, but what happens in analytics?) And if a shared rubric is in a master course? (I don't know the answer to this one and have no real-life example test but it could come up at some point.)
  4. Again with master courses and many clones in mind, I think that AssessmentId (shared between RubricAssessments and RubricAssessmentCriteria, among others) is unique to an assessment (discussion, assignment) in a course offering. Correct?
  5. Does this AssessmentId appear in any other group of datasets? (I don't see it but thought I would ask for planning purposes.)
  6. A course can, for example, attach a single discussion rubric to a dozen discussion topics. I see the same RubricId for each Discussion topic, and the same CriterionId for each time the criterion is assessed for various students,, so the UserID and the AssessmentId combined with the RubricID and the CriterionId provides the unique assessment morsel that differentiates each row in RubricAssessmentCriteria.
  7. The Score in RubricAssessmentCriteria is the score given by the instructor vs. the default score associated with the criterion-level selected.
· Share on Twitter

Comments

  • Renee.J.194
    Renee.J.194 Posts: 126 ✨
    edited November 2022

    Thanks! And, hoping to be a bit clearer, when I say "unique to a ... in a course offering", I mean that rows referring to a different course offering with content (including rubrics) copied from the same master course course would contain a different value for the particular field.

    · Share on Twitter
  • Renee.J.194
    Renee.J.194 Posts: 126 ✨
    edited November 2022

    And, regarding my first question, even though we do not use competencies very often, all our rubrics are checked to allow new associations in competencies. We do that so we can associate the rubrics with activities.

    · Share on Twitter
  • Wendy.L.931
    Wendy.L.931 Posts: 7 Analytics Builder Transition
    edited November 2022

    @Renee Judd​ I have been working with the rubric data set quite a bit. We are trying to use a Brightspace site for program level assessment where faculty or coordinators submit their program assessment report as an 'assignment' and out assessment director gives them feedback using a rubric. Here is what I am finding:

     

    1. I agree that we get the data not associated with a Competency. This is a good thing. I was not worried this would change, now I am asking this too - did you get an answer?
    2. Rubric ID is unique within an offering.
    3. We are sharing rubrics like this for the first time as I have a program doing reports. But they just submit an end of term activity and that has not happened yet. A couple weeks, I could answer this if you did not get one.
    4. Yes, Assessment ID is unique.
    5. Not sure here - only using the rubric data set right now.
    6. I believe you are correct - matches my experience.
    7. Yes - this is what I see.

    New things to consider:

    1. Group assignments - when our Director evaluates an assignment for a group, it replicates the results for each member of the group. If 3 'students' in group, then we get 3 rows. If 5 'students', we get 5 rows. This makes sense but we did not plan correctly for this.
    2. We are finding that the Feedback seems to be missing from the report for rubrics with the Text Only scoring method. At least this is my best guess as to what is happening. I am going to open a ticket to ask about this.

    question - have you found a way to match the results back to a course? If you only have the data - who completed the assignment (userid), what the assessment ID is, the rubric ID and the criterion ID, do you happen to know if there's a table that can tell me what course offering this was in? I have not had time to spend reviewing data hub except when I need very specific information like this.

     

     

    · Share on Twitter
  • Renee.J.194
    Renee.J.194 Posts: 126 ✨
    edited November 2022

    @Wendy Lampner​ , I can answer your question about the course association. This works as long as the rubric is in the course where the assessment is given. You use the rubric id to left join RubricAssessment to RubricAssessmentCriteria. RubricAssessment has OrgUnitID. You can use OrganizationalUnits to get a friendlier identification of the course offering: OrgUnitName, OrgUnitCode. If it is helpful to you, you can also take that org unit id to the OrgUnitAncestors data set to get department, semester, etc.

    The reason I said it works if the rubric is located in the same course offering as the assessment is that I asked my TAM about shared rubrics, and he tested. If the rubric is in the top organization, then the top organization, not the course, is what is reported. How to identify the course using a shared rubric? This is being explored.

    Thanks for sharing about group assignments. I was going to test that, and you have saved me the trouble!

    @Praful Rodrigues​ , our TAM, verified my other assumptions, including the the AssessmentId is not included in other datasets. (I was asking that because it occurred to me I could use it to find the course when a shared rubric is used; NOT so.)

    I've now mapped out the data and joins and queries that we can use to reconstructor our "snowflake" rubric report from BSD using the following datasets: RubricAssessment, RubricAssessmentCriteria, OrgUnits, OrgUnitAncestors, Users, UserEnrollments. When that replacement is in place for our datalake to be used by the processes that, I'd like to improve on that "snowflake" by joining in data from other rubric datasets, so that besides a raw score, for example, I can provide an "out of" to make sense of it! And the criteria group is critical information for some programs' analytics; I can get RubricGroupId and GroupName from RubricObjectCriteria dataset joining on RubricCriteriaId.

    My next question to investigate: If an assessment has two or more rubrics, one is designated as the grading rubric. Do both rubrics report to the rubric datasets?

    · Share on Twitter

Categories