✅ Integrity First: Only Finalised Evaluations Now Shape Consensus Results! ✅
We're excited to share a focused but important update to our Advanced Evaluations module. This release sharpens the scoring workflow to uphold the highest standards of accuracy and fairness in your consensus process. Based on client feedback and best-practice insights, we've adjusted a core behaviour to ensure only fully completed individual evaluations contribute to the final consensus score - boosting the reliability and rigor of your decisions.
This release will be live on Wednesday 15th October 2025
🎯 Enhanced: Evaluations Consensus Scoring Integrity
We understand that the accuracy of your evaluation process is paramount. Previously, if an Evaluation Chair advanced to the consensus scoring stage, partially completed individual scores were still factored into the final view. This could inadvertently skew the consensus results and didn't align with best-practice evaluation governance, which requires all evaluators to complete their work before moving on.
We've listened and adjusted the system's behaviour to uphold the principle that an evaluation must be fully completed to count towards the consensus.
What's New in the Workflow?
- Clear System Prompting for Chairs: As the Evaluation Chair, when you choose to move to Consensus Scoring, a clear system prompt will now alert you to any evaluators who have not yet completed and submitted their individual scores. This gives you absolute transparency before proceeding.
- Scores Will Not Be Counted: If you choose to move forward while some evaluators haven’t submitted their scores, the system will now exclude all scores from their incomplete evaluations in the consensus calculation. Their entries will be marked as 'Not Completed' in the overall evaluation status.
- Progress is Saved: Crucially, any in-progress answers provided by an evaluator are not deleted or removed. They remain saved within the system, but their overall evaluation status prevents them from influencing the Consensus Scores.
This enhancement ensures that your consensus scores are based solely on the considered judgement of evaluators who have completed their task, resulting in a more accurate and defensible valuation process.
We hope this critical update provides the robust integrity and accuracy your evaluation processes demand. Your trust and feedback are what drive these improvements. We’re always keen to hear your thoughts on how we can continue to streamline your processes. Please don't hesitate to reach out to your Account Manager/Customer Success Manager with any feedback or questions.
