What is Mentor AI Evaluator?
Mentor AI Evaluator is a formidable and powerful AI tool designed to transform the way institutions review and assess applications by leveraging the power of AI to support admissions teams throughout the evaluation process.
Traditionally, reviewing applications can be a time-consuming and repetitive task, requiring staff to manually analyse applicant information, verify qualifications, and assess candidates against specific admission criteria. Mentor AI Evaluator helps simplify this process by automatically analysing application data and supporting evaluations based on predefined criteria, significantly reducing the manual workload involved. By incorporating AI into the admissions process, institutions can benefit from:
Faster Application Reviews: Accelerate the evaluation process by reducing the time spent manually reviewing applicant information, allowing admissions teams to process applications more efficiently.
Greater Consistency and Fairness: Support more standardised assessments by applying the same predefined evaluation criteria across applications, helping minimise inconsistencies associated with manual reviews.
Reduced Administrative Workload: Automate repetitive evaluation tasks, freeing up valuable staff time to focus on more strategic activities and applicant engagement.
More Informed Decision-Making: Provide admissions teams with AI-assisted insights that help them assess candidates more effectively and make well-informed decisions.
Improved Scalability: Manage increasing volumes of applications without a proportional increase in administrative effort, particularly during peak admissions periods.
Enhanced Applicant Experience: By accelerating application assessments, institutions can potentially reduce waiting times and provide applicants with faster updates throughout their admissions journey.
Importantly, Mentor AI Evaluator is intended to support admissions teams, not replace human judgment. Institutions can combine the efficiency of AI-powered assessments with the expertise and oversight of their staff, maintaining control over important admissions decisions.
How can I set up Mentor AI Evaluator?
To set it up you'll need to create a brand new evaluation template (it cannot be added to existing template). Follow these steps:
Access General Settings -> Templates & Documents -> Evaluation Templates
In the list of templates, click on Create a new template:
Give your template a name, select the option MentorAI Agent, and proceed by clicking Create template and add more info:
Now in the template's settings, visit the Criteria tab:
Insert the criteria, or better said, the instructions for Mentor AI to use:
To ensure the prompt is correct and Mentor uses it appropriatelly, you can test it first and make amendments if necessary. Click on Test prompt.
Select an application template, and a submitted application from a real applicant. Now Run test. The agent will process that application and evaluate it according to your previously inserted prompt.
Make the necessary prompt amendments if necessary, until your new evaluation template with Mentor AI Evaluator is ready to be used!
How to use Mentor AI Evaluator in real evaluations?
Right above we saw how you can test your prompt. Now things will get real, lets see how Mentor AI actually works on a live evaluation.
Since a new Evaluation template was created, now you must link it to the application template whose submissions you will evaluate. Go to General Settings -> Templates & Documents -> Application Templates. Open the desired template, go to the Evaluations tab, and select the respective evaluation template in the section MENTOR AI:
And the magic comes now! Once an application from that template is submitted, Mentor AI Evaluator will automatically generate and submit a new evaluation. You can open it directly from the profile's applications widget, or from the Evaluations tab inside that submitted application:
Open it, and you'll find all the evaluation fields populated by Mentor AI Evaluator based on the prompt/criteria you've previously set up in the evaluation template:
It's not possible to make content updates to evaluations done by Mentor AI Evaluato, for that you would need to create a brand new manual evaluation, but you can delete it by clicking on delete evaluation (located at the top right):
