Manager Evaluation

..

What is Manager Evaluation?

Manager Evaluation is an evaluation system for reporting managers to assess, evaluate, and score learners' performance in a course using a simple score or an advanced Rubrics system.
 

The score awarded here varies from the conventional grading system as it does not directly depend on just the learner giving the correct answer but can also take into account how good the answer is, or the thought process, or in any way a manager wishes to assess the learner's performance. 

..

Why is it useful?

We often find employees who may excel in specific areas and lag behind in others, this evaluation can help in shedding light on the strengths and weaknesses of a learner based on their performance.
Manager evaluation allows the reporting manager to evaluate learner performance in a course more intricately.


There are two different methods of evaluation, a simple and a Rubrics method which is customizable and can be tailor-made to suit the course type.
Go beyond just awarding marks for correct answers, take into account the presentation, quality, proficiency, etc. 

Note 1: Manager evaluation will be skipped for employees who do not have an assigned manager.

Note 2: Manager evaluation will be initiated only after the learner has completed all mandatory course entities and post-course activities if any.

Note 3: Once manager evaluation scores are published it cannot be modified.

Setting up Manager Evaluation - Score Method (Simple)

  1. Go to LMS, and open a course for which you would like to enable manager evaluation, click on the ellipses icon on the top right corner and go to Settings.
  2. Now go to the Manager Evaluation tab.
  3. Choose either the Score or Rubrics method. By default, No Evaluation option will be selected. 

Let's take a look at setting up the Simple manager evaluation method first: 

  1. Specify when the evaluation should start.
  2. Enter the maximum score that managers can award, you can also choose if you would like to show the evaluation to the learner by enabling the Show evaluation to learner checkbox. 
  3. Add achievements for different percentages, this will be indicated on the results page based on the score that the manager awards to the learner. 
  4. Click Save​.

Setting up Manager Evaluation - Rubrics Method (Advanced)

Before we learn about setting up Rubrics method of managers evaluation, let us first understand what Rubrics or Rubrics evaluation is all about. 

..

What is Rubric in Manager Evaluation?

By definition, a Rubric is a scoring guide used to evaluate the quality of learners answers or performance in a course. Put simply, it is a set of defined criteria and their corresponding levels that is used for evaluating a learner's performance in a course.

Rubrics are defined in a tabular format and can be used by reporting managers when marking a learner. The method contains different levels, criteria, and descriptions.  Scoring well would mean that the learner has shown quality work in a course.

Follow these steps to set up Rubrics Method

  1. While within a course, access Settings from the top right ellipses icon and go to the Manager Evaluation tab
  2. Select Rubrics. Specify when the evaluation should start, and enable the show evaluation to learner checkbox if required.
  3. Configure overall achievement as required.
  4. Click Add Rubrics to define Rubrics.

  1. There are two ways to go about when defining Rubrics in managers evaluation:
    i.Fixed points 
    ii.Custom points
    (The difference is shown by example screenshots below. Also, refer the notes mentioned below)

Note 1: You can add up to 10 levels and 10 criteria when defining Rubrics in an evaluation.

Note 2: You can add multiple Rubrics for the same evaluation/course. Click on + Add Grading Rubric. The purpose is to enable the evaluation of different types of answer content within the same course. Example: You can have a Rubric configured to suit programming output, and a different one for viva (oral tests), descriptive type of course entities.

Note 3: When using fixed points method, the level with the highest associated score will be the maximum achievable score in all criteria. So, the total score = Highest score achieved in a level X number of criteria.

Note 4: When using custom points method, each criteria can have a different maximum achievable score (defined individually in description). So, the total score would be a summation of the maximum achieved score in each criteria.

  1. To better understand defining Rubrics, examples of how you can define criteria for two examples are given below: 1. A programming-based answer content evaluation using fixed point and 2. Descriptive type answer content using custom points method.
    In essence, level names can be terms that describe the quality of the answer. (For example, it can range from excellent or exceptional to poor or unsatisfactory)
    Criteria terms can describe what is being evaluated (For example it can be "writing style", "subject knowledge" or "execution")
    Description based on the positioning (level vs criteria) in the table describes the typical characteristic of the answer.
    Criteria group name can be an identification term for the configured Rubric.
    (Multiple criteria can be configured if the course has varied entities with different answer content thus invoking the need for multiple Rubrics for answer evaluation.)
    Once you have defined Rubrics click Save and Publish 
..

Rubrics Example 1 (For evaluating programming output in a course - fixed point)

In the example above, The learner took up a programming course. As part of the course, they attended a test and submitted a computer program as an answer to the final offline test. The Rubric configured shows how the manager can evaluate the code, execution, and knowledge of the learner.

..

Rubrics Example 2 (For evaluating descriptive answers in a course - custom point)

In the above example,  The learner attended an ethics course and submitted a descriptive answer as part of an online test. The defined Rubric sheds light on what the manager thought about the learner's knowledge of the subject, creativity, and content engagement.
(Click here to view screenshots that show the Manager's perspective of the evaluation and result page.)

Evaluating a Learner - Score Method 

As stated earlier, in order to begin the evaluation, a learner will have to complete the course first. Once a learner has completed all mandatory course entities and all post-course activities, the manager can evaluate the learner. 
An email will be dispatched to the reporting manager through which managers can start their evaluation. Additionally, managers can begin evaluation from the My Team page as shown below.

  1. Go to LMS My Team > Select employee.
  2. Hover the pointer over a completed course and click on the manager evaluation icon.

  1. Enter the score. Based on the score you input the corresponding achievement will be highlighted in green.
  2. Enter comments if required. It could be a note on what was good and where the learner needs to improve.
  3. Click Save followed by Publish.​

The learner will get an email when the manager publishes the score. They can also go to the course overview page and click on View Evaluation to see the score.

Evaluating a Rubrics type manager evaluation is also similar, click on the corresponding level grey boxes with points and descriptions in each criteria to mark the learner. (it will turn green on being selected). Use the circular down arrow icon to expand multiple grading Rubrics if present.

The above screenshots (screenshots S1 & S2) show the Manager Evaluation view of Examples 1 & 2 covered earlier on this page.