A tool for generating primary FRCA practice questions using large language models and anaesthetic reference material. Minerva explores whether AI can help produce useful revision questions, with a small blinded study comparing its output against Royal College reference questions.

Overview

Minerva is a Python command-line tool that generates single best answer questions in the style of the primary FRCA examination. It retrieves relevant material from an anaesthetic reference corpus and uses example questions to guide the format of its output.

In a small blinded evaluation, eight anaesthetists assessed twenty generated questions alongside ten Royal College reference questions for clarity, relevance, and difficulty. The study explored question quality and whether assessors could identify the source; validation across candidate cohorts would require further work.

Code

The source code is on GitHub.