The Team Evaluation tool enhances the grading of group work using the UNSW Workshop and Moodle Assignment activities. Group activities in Moodle result in each member of a group getting the same grade, which isn't necessarily a fair reflection of each group member's contribution. The Team Evaluation tool asks each team member to assess their own and each other's contribution to the group activity and then scales the group grade up or down for each member of the group to reflect their individual level of contribution.
Setting up Team Evaluation with a Moodle Assignment
- Set up a group assignment .
- Change the Students submit in groups & Require group to make submission drop-down menu to Yes. For further guidance on setting up groups and assigning activities to them click here.
- Once the assignment is set up click on the assignment link.
- Click on the Turn On Team Evaluation button.
- Click on the Settings link.
- On this page you can adjust the default settings if required,
- Enabled: Uncheck this box if you want to disable a Team Evaluation that has already been set up.
- Self-assessment: Uncheck this box if you do not want students to assess themselves.
- Automatically Release Marks: Uncheck this box if you want to manually release marks at a later date.
- Public: Check this box if you wish to share your questionnaire with other instructors.
- Adjustment Fraction: Change this setting from the default (50%) if you want more or less than 50% of the group mark to be adjusted for each individual. The larger this percentage the more the data produced by the questionairre scales each individual's grade up or down.
- Non-completion penalty: Change this if you want to change the default (10%) penalty for not completing the Team Evaluation questionnaire. This setting only changes an individuals grade if they do not answer the questionairre and does not penalise anyone else in the group.
- Deadline: Enable and set a deadline date if you want to limit how long group members have to answer the questionnaire.
Then click Save.
- You will now need to add/create questions for the students to answer. The process for adding/creating questions can be seen in the next section of this page Adding questions to the questionnaire.
Adding questions to the questionnaire
- Questions now need to be created or added to the questionnaire. To add a new question click +Add Question.
- Select a question type,
- Comment: Comment only. Unless you also add a numeric question Team Evaluation will not scale individual results.
- Likert: Each question is answered on a 1-5 category scale (score) by default. You can increase or decrease the number of scores available when setting up this type of question. For each score on the scale you have to provide a brief description to assist students to assess each other's contribution.
- Split 100: Each question is answered by using the proportion sliders to represent each group member's contribution, to a combined group total of 100%.
- If you have selected the Split 100 question type complete the question title and description and then Save.
- The question will now be displayed. The proportion (%) slider displayed is a non-functioning example of how students will see and use the question.
-
If you have selected the Likert question type complete the question title and description, adjust the score range if required (maximum rage is 0-10), type a score meaning for each score and then Save.
- The question will now be displayed as a non-functioning example of how students will see the question.
- If you have selected the Comment question type complete the question title and description and then Save.
- The question will now be displayed as a non-functioning example of how students will see the question.
Grading and scaling of marks
- Once the due date for the assignment has passed grading can occur.
- When a grade has been given the questionairre will become available to students.
- When all group members have answered the questionairre or the deadlline date specified when setting the activity up passes each group member's grade is scaled using the Score which is calcuated using the date produced by the questionaiire.
- Grades and comments will then be automatically released by default unless you have disabled automatic release when setting up the activity.
- If you select the Scores report type in the Results section the results will be displayed as shown below, including the scaled grade, any non-completion penalty and the final grade that is passed to the gradebook. In the example below the unscaled group grade was 70%.
- If you select the Responses report type the results will be displayed as shown below, including each user's response to each question.
- If you select the Feedback report type the written feedback comments will be displayed.
Manually releasing marks and comments
- To manually release marks and comments uncheck Automatically Release Marks. The default setting is to automatically release grades and comments. See point #6 of the Setting up Team Evaluation with a Moodle Assignment section above. Then click Save.
- After marking has occurred you can manually release all graded and comment based question results by clicking on the Release Marks and Comments link.
On the Release Marks and Comments Page you can,
- Release all marks and comments by manipulation the slider until it displays as green.
- Release a group's marks and comments by manipulation the slider until it displays as green.
- Release an individual's marks and comments by manipulation the slider until it displays as green.
- When you have finished click Save Changes.
Hiding comments
- Once grades and comments have been released grades can't be hidden again and grades have to be changed in the gradebook if necessary. However, comments can be hidden by navigating to the Results>Feedback page.
You can then,
- Hide all comments by moving the Release All Marks slider to the red state.
- Hide all comments for a whole group by moving the Release marks for group slider to the red state.
- Hide individual comments by moving the Release Marks slider to the red state.
- When ready to confirm these changes click Save changes.
Using Team Evaluation with the UNSW Workshop activity
Using the Team Evaluation tool with UNSW Workshop is very similar to the procedures described in previous sections which demonstrate setting up and using the Team Evaluation tool in combination with the Moodle Assignment tool. The only major difference is during the setup process. Step #2 of the Setting up Team Evaluation with a Moodle Assignment instructions section above, where group submissions are activated is replaced by the following step when setting up Team Evaluation with the UNSW Workshop tool.
- Click on the Team Mode radio button to check it, allowing group submissions to be made. For further guidance on setting up groups and assigning activities to them click here.