Creating Scorecards in Oversai

📝 Creating Scorecards in Oversai

Oversai makes it easy for you to build and customize your own scorecards to run manual QA audits that align with your team’s quality standards. In this article, we’ll walk you through the step-by-step process to create a scorecard from scratch.

1. Go to the “Apps” section in the Oversai platform and click on “Scorecards.”
   Here, you’ll see a list of your existing scorecards along with key details such as their status, creation date, and quick action buttons to edit, clone, or delete them.

2. To create a new scorecard, click on the “Create Scorecard” button in the top right corner.

🧩 Step-by-Step Scorecard Creation

1. Basic Details

Start by entering the basic information:

• Scorecard Name

• Status (Active or Inactive)

• Goal (Minimum passing score for an evaluation to be considered “Passed”)

2. Create Sections

Sections allow you to group related questions under one topic — for example, “Greeting” or “Closing.”

For each section, you’ll need to:

• Assign a name

• Set a weight (% value) that reflects its importance

🔔 Note: The total weight across all sections must equal 100%.

3. Add Questions

Within each section, you can add questions of two types:

✅ Multiple Choice

You can add options like:

• Yes

• No

• N/A

And assign scores to each response.

⭐ Rating (Scale)

Create a scale (e.g., 1–5) for more nuanced evaluations.

4. Define Error Impact with Option Type

Each multiple-choice question can be tagged with a specific “option type” to define how critical it is:

• Default: Only deducts the score for that question

• Fail Section: If failed, the entire section gets a score of 0

• Fail All: A critical error — failing this question sets the entire evaluation score to 0

This is a powerful feature for prioritizing key behaviors.

5. Optional Feedback Fields

Use the “Allow Feedback” toggle to let evaluators explain why they selected a specific response — this adds qualitative insight to the evaluation. Below there is an example:

6. Save Your Scorecard

Once you've added all your sections and questions, click the “Save” button in the bottom right corner.

7. Preview Your Scorecard

At any time during or after creation, you can click “Preview Scorecard” in the top right corner to see how your scorecard will look inside the Chrome extension.

🎉 And That’s It!

You’ve just created your first QA scorecard in Oversai! Once published, your scorecard will be available for manual evaluations via the Chrome extension.

If you have any questions or need help designing your ideal scorecard, don’t hesitate to reach out — we’re happy to support you.