๐Ÿ“Š Assessment Course Phase๏ƒ

The Assessment Phase allows instructors to evaluate students across multiple competencies using a structured scoring system. Students can be assessed through self-evaluation, peer evaluation, and tutor/instructor evaluation. Students may also evaluate their tutors and team leads.


๐Ÿ“ Using the Assessment Phase๏ƒ

Once the assessment phase is set up, students and instructors can begin evaluations. Hereโ€™s how to navigate and complete assessments effectively.

For Students๏ƒ

  1. Access the Phase: Log in and navigate to the assessment phase in your course dashboard.

  2. Self-Evaluation: If enabled, rate your own competencies using the provided template.

  3. Peer Evaluation: Evaluate team members based on the peer template (if applicable).

  4. Tutor Evaluation: Provide feedback on tutors or leads using the designated template.

  5. Submit: Ensure all evaluations are submitted and marked as final before the deadline.

For Instructors/Tutors๏ƒ

  1. Review Submissions: Monitor student progress and submissions in the phase overview.

  2. Conduct Assessments: Use the tutor template to assess students.

  3. Provide Feedback: Offer constructive comments to support student development.

๐Ÿ’ก Tip: Regularly check for updates and communicate with your team to ensure timely submissions.

This section guides you through the practical use of the assessment phase for a smooth evaluation process.

๐Ÿ“บ Video Tutorial: Watch here!

โš™๏ธ Setting Up the Assessment Phase๏ƒ

To configure the assessment phase, follow these steps:

1. Add an Assessment Phase๏ƒ

Use the Course Configurator to add an Assessment Phase to your course structure. Connect the participants and team data (if you want to use peer or tutor evaluations).

2. Open the Configuration๏ƒ

In the course sidebar, select the newly added assessment phase, then click on: Settings (gear icon).

This opens a dialog for setting the phaseโ€™s behavior and schedule.

3. Configure Assessment Phase Settings๏ƒ

You must define the following core settings:

Setting

Description

Assessment Template

Select which assessment template to use (defines the competency structure)

Start Date

When the assessment phase begins (using the timeframe selector)

Deadline

When the assessment phase ends (using the timeframe selector)

Optional Evaluation Types๏ƒ

You can enable additional evaluation methods

Evaluation Type

Description

Self Evaluation

Students evaluate themselves using a separate competency template

Peer Evaluation

Students evaluate their peers using a separate competency template

Tutor Evaluation

Students evaluate tutors using a separate competency template

Each evaluation type has its own:

  • Template: Which competencies to evaluate

  • Start Date: When this evaluation becomes available

  • Deadline: When this evaluation closes

โš ๏ธ Note: All timestamps use system time (Europe/Berlin) with deadlines ending at 23:59.


๐Ÿ—๏ธ Creating and Editing Assessment Schemas๏ƒ

Assessment schemas define the structure of your evaluation through Assessment Templates.

Understanding the Hierarchy๏ƒ

The assessment system uses a three-level hierarchy:

Assessment Template
โ”œโ”€โ”€ Categories (weighted groups)
โ”‚   โ”œโ”€โ”€ Competency 1 (individual skills with weights)
โ”‚   โ”œโ”€โ”€ Competency 2
โ”‚   โ””โ”€โ”€ ...
โ””โ”€โ”€ ...

Creating a New Assessment Template๏ƒ

  1. Navigate to Settings: In your assessment phase, go to the Settings page

  2. Create Template: Click โ€œCreate New Templateโ€ in the template selector

  3. Fill Template Details:

    • Name: A descriptive name for your template

    • Description: Brief explanation of the templateโ€™s purpose

Building the Competency Structure๏ƒ

Once your template is created, you need to build the competency structure:

Adding Categories๏ƒ

Categories are weighted groups of related competencies:

  1. Click โ€œAdd Categoryโ€

  2. Fill in the category details:

    • Name: Category title (e.g., โ€œTechnical Skillsโ€)

    • Short Name: Abbreviated version

    • Description: Brief explanation

    • Weight: Numerical weight for final score calculation

  3. Click โ€œCreateโ€

Adding Competencies๏ƒ

Competencies are individual skills within categories:

  1. Click โ€œAdd Competencyโ€ within a category

  2. Complete the competency form:

    • Name: Competency title (e.g., โ€œProgramming Abilityโ€)

    • Short Name: Abbreviated version

    • Weight: Numerical weight within the category

    • Description: Brief explanation

    • Score Level Descriptions: Define what each level means:

      • Very Bad: Description for lowest performance

      • Bad: Description for below-average performance

      • Ok: Description for average performance

      • Good: Description for above-average performance

      • Very Good: Description for excellent performance

Editing Existing Templates๏ƒ

  • Edit Categories: Click the edit icon next to any category

  • Edit Competencies: Click the edit icon next to any competency

  • Delete Items: Click the trash icon (โš ๏ธ this cannot be undone)

๐Ÿ“บ Video Tutorial: Coming soon


๐Ÿ—บ๏ธ Setting Up the Competency Map๏ƒ

The competency map allows you to link competencies from your self and peer evaluation templates to your assessment, so they show up in the assessment view.

Understanding Competency Mapping๏ƒ

When you have self or peer evaluation enabled, you can map evaluation competencies to the main assessment:

  • Self Evaluation โ†’ Assessment: Link self evaluation competencies to the main assessment competencies

  • Peer Evaluation โ†’ Assessment: Link peer evaluation competencies to the main assessment competencies

This enables them to show up in the main assessment view to be taken into account in the main assessment.

Creating Mappings๏ƒ

  1. Navigate to Settings: Go to the Settings page in your assessment phase

  2. Find Competency: Locate the competency you want to map to

  3. Select Mapping: In the assessment mapping section:

    • Choose the source competency from the self or peer evaluation dropdown

    • Select โ€œNo mappingโ€ to remove an existing mapping

  4. Save Changes: Mappings are saved automatically

โš ๏ธ Note: You can map only one self and one peer competency to each assessment competency.

๐Ÿ“บ Video Tutorial: Coming soon


๐Ÿ“ˆ How Average Scores Are Calculated๏ƒ

The assessment system uses a sophisticated weighted scoring algorithm to compute final scores.

Score Level Conversion๏ƒ

Each score level is converted to a numerical value:

Score Level

Numerical Value

Very Good

1.0

Good

2.0

Ok

3.0

Bad

4.0

Very Bad

5.0

Calculation Process๏ƒ

The getWeightedScoreLevel function computes the final score through these steps:

1. Competency-Level Calculation๏ƒ

For each competency with scores:

Competency Score = (Sum of all scores ร— competency weight) / number of scores / total category competency weights

2. Category-Level Aggregation๏ƒ

For each category:

Category Score = Sum of all competency scores in category
Weighted Category Score = Category Score ร— category weight

3. Final Score Calculation๏ƒ

Final Score = Sum of all weighted category scores / Sum of all category weights

Key Features๏ƒ

  • Weight-Based: Both competency and category weights influence the final score

  • Proportional: Only categories and competencies with actual scores contribute to the calculation

  • Flexible: Handles partial assessments (not all competencies need scores)

  • Normalized: Final score is normalized by the total weights of assessed categories


๐ŸŽฏ Best Practices๏ƒ

Template Design๏ƒ

  • Clear Descriptions: Write specific, measurable descriptions for each score level

  • Balanced Weights: Distribute weights logically across categories and competencies

  • Consistent Granularity: Keep similar levels of detail across all competencies

Competency Mapping๏ƒ

  • Strategic Mapping: Only map competencies where cross-evaluation adds value

  • Documentation: Keep notes on your mapping rationale for future reference

  • Validation: Test your mapping strategy with a small group before full deployment


Getting Help๏ƒ

If you encounter issues not covered here:

  1. Check that all required fields are filled

  2. Verify date ranges and permissions

  3. Contact your system administrator for technical support


โœ… Youโ€™re all set! Your assessment phase is now configured and ready for student evaluations.