Rm Plc · LSE:RM.

Rm — AI in Action Summit 2025

6 slides from Rm's conference presentation, Oct 8, 2025

  1. Slide 1: RM Focus: Marking Engine in Action

    Summit 2025 RM Focus Marking Engine in Action Dr. Gráinne Watson, RM Chief Operations Officer

  2. Slide 2: Marking Engine background

    Marking Engine background RM built a Marking Engine using Generative AI and proved: We could match 1 and complement human Logic: Consensus Experience: Rubrics & marking Framework Real and Created 2 We could provide Marking appropriate feedback to Engine explain mark provided Data: Feedback: 3 We cou

  3. Slide 3: What next? More subjects

    What next? More subjects We are currently working on several complex PoCs where we are marking a variety of subjects and we are seeing some commonalities from our other PoCs First look commonalities  For some answers, the AI marking engine can mark as well as humans from the outset  But overall, A

  4. Slide 4: How do we work on consistency?

    How do we work on consistency? What do we assess? AI Marker Confidence Analysis Confidence vs Marker Disagreement Top-Tail Analysis AI in Action | 8th October 2025

  5. Slide 5: What are the takeaways?

    What are the takeaways? There is consistently a gap between what a human marker knows and a rubric, making three points vital: Feedback Marking Engine Ability to choose methods of marking AI in Action | 8th October 2025

  6. Slide 6: Integrating a Marking Engine

    Integrating a Marking Engine AI Marking Questions Questions Marking Marking Configure AI markers and instructions instructions feedback AI marking only Questions, Marking instructions 100% double marking Relevant content (AI +human) Responses Responses Create marking instructions for AI 100% AI mark

RM — AI in Action Summit 2025 on 6ix