This project enables learners to practise communication skills in various settings including a pharmacy, clinic or hospital by interacting with AI-powered virtual patients.
Featuring stylized and customizable avatars, these characters engage in human-like voice conversations - able to share details of their ailments and medical histories.
Powered by next-gen speech-to-text AI service Convai and built with Unity, 'Meet the Patients' showcases the potential for this emerging technology in an educational context.
Educators can create custom virtual patients and scenarios - with options to modify physical appearance, voice and personality. Each virtual patient can be equipped and trained with a detailed backstory including their background and case history.
In contrast to our other project, Interactive Perspectives, that uses actors and videos to simulate realistic and authentic clinical experiences, Meet The Patients is designed to offer an interactive and fun, 3D game-like environment to develop communication skills.
We’re also currently working on using learners’ conversation transcripts to develop a feedback system for both formative and summative assessment.
Previously, many simulations have relied on scripted conversations with a limited set of responses to choose from. Thanks to innovations and advancements in AI, learners can now engage in lifelike conversations with virtual patients. Our AI characters are designed and trained with structured parameters - ask them anything, and they will respond interactively while constantly referring back to their detailed background and case history.
This project is currently in its early stages of development. We recently presented a working prototype at the American Association of Colleges of Pharmacy (AACP) conference in Boston, USA. If you're interested in following our progress or contributing, please connect with us!
Are you thinking about incorporating our projects into your courses or have unique requirements? We’d love to hear from you!
Rooted in a philosophy of collaboration, we partner with stakeholders, educators and software developers to explore innovative uses of interactive technology in education.
In partnership with educators, EduXSim develops interactive experiences for learners.