CASPer Test & Multiple Mini Interview (MMI) Seem to be Highly Coachable, New BeMo^® Study Reveals

Arguably, the most challenging parts of the admissions process for many applicants are the dreaded situational judgement tests CASPer and the Multiple Mini Interview (MMI interview). 

Applicants are generally not provided with detailed instructions on how to prepare in advance by official admissions and test administrators. In fact, a handful of official sources claim that it is not possible to prepare in advance for such tests and going as far as claiming that such tests are "immune to test preparation" and encouraging applicants to "be yourself". 

We have already highlighted the myths about such claims in a previous report and we have advised future applicants to aspire to be their "best self" instead as part of their life-long journey of becoming future practicing professionals. We have also argued in this report that situational judgement tests are coachable just like any other tests. 

In a new study highlighted here, we provide formal proof that both CASPer and MMI are highly coachable and applicants can significantly improve their practice scores with appropriate preparation.

Highlights:

• MMI and CASPer practice scores increased 23-27% on average with BeMo preparation programs, respectively. 
• Applicants’ CASPer practice scores improved significantly by 10 percentage points going from a baseline average of 53% before preparation to 63% after just 3 preparatory sessions.
• On the other hand, applicants’ MMI practice scores improved significantly by 15 percentage points from a baseline of 66% to 81%. 
• While CASPer practice test performance required only 3 coaching sessions to show improvements, MMI practice performance normally required at least 6 preparatory sessions to show improvement.

MMI Study Methodology:

• 44 applicants with an upcoming multiple mini interview were selected randomly to participate in the BeMo study from the total pool of applicants enrolled in BeMo's MMI Prep program. The students' baseline performance was determined by conducting a realistic mock interview (MMI SIM™) using BeMo's MMI Prep program protocols followed by expert feedback and numeric scoring identical to the scoring system designed by the official MMI administrators. 
• The applicants were coached by identifying areas of improvement and re-tested using additional independent mock interviews.
• Each applicant received a minimum of 6 (and a maximum of 8) mock interviews followed by expert feedback. 
• Neither the study participants nor BeMo interview experts were aware of the study in progress to avoid inadvertent bias. 

CASPer Study Methodology:

• 24 applicants with an upcoming CASPer test were selected randomly to participate in the BeMo study from the total pool of applicants enrolled in BeMo's CASPer Prep program. The students' baseline performance was determined by conducting a realistic mock CASPer test (CASPer SIM™)(Super Intelligent Mentorship™) using BeMo's CASPer Test Prep program protocols followed by expert feedback and numeric scoring identical to the scoring system designed by the official CASPer test administrators.
• The applicants were coached by identifying areas of improvement and re-tested using additional independent mock CASPer practice tests.
• Each applicant received a total of 3 practice CASPer tests followed by expert feedback.
• Neither the study participants nor BeMo CASPer experts were aware of the study in progress to avoid inadvertent bias. 

Applicants’ MMI and CASPer Practice Scores Increased 23-27%

The above figure highlights the percentage improvement in applicants' practice scores over time. Both CASPer and Multiple Mini Interview practice scores of applicants improved significantly by 23% and 27%, respectively, with the use of BeMo preparation programs.

BeMo CASPer Prep & MMI Prep Programs Significantly Improve Applicants' Overall Practice Scores

Specifically, as indicated in the figure above, practice CASPer scores increased significantly by 10 percentage points going from a baseline average of 53% before preparation ("Pre") to 63% after just 3 preparatory sessions ("Post") with BeMo. On the other hand, applicants’ MMI practice scores improved significantly by 15 percentage points from a baseline of 66% to 81%. MMI performance normally required at least 6 preparatory sessions to show improvement. 

The study results are not surprising given that all human behavior is learned behavior and there are no exceptions to professionalism skills tested by CASPer and MMI. In support of these finding is the observation that reviewing sample questions alone without coaching and expert feedback, however, have not demonstrated any significant improvements in test scores. 

These findings provide the first formal proof that both CASPer test and MMI Interview are highly coachable and applicants can dramatically increase their practice performance with appropriate preparation such as those provided by BeMo to reduce the socioeconomic and social bias observed in medical schools and other professional programs, given that admissions preparation has been proven not to correlate with the observed bias (see here & here).

To learn more about BeMo's CASPer Prep programs, click here.

To learn more about BeMo MMI Prep programs, click here. 

To your success,

Your friends at BeMo

BeMo Academic Consulting

Disclaimer: CASPer stands for computer-based assessment for sampling personal characteristics and is claimed to be a trademark of McMaster & Altus. BeMo does not recommend, endorse nor affiliate with CASPer, Altus or McMaster and vice versa. BeMo only provides preparation services and practice tests. To take CASPer, contact Altus directly.